Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
chromaqueue's avatar
@chromaqueue

Sr Data Engineer (Optimizing Pipelines Across Cloud Platforms)

$3,300/mo

Porto

Experience: 5 yearsOpen to: Porto

Wigi highlights

5+ years, currently working as Sr Data Engineer

Created and orchestrated Databricks Jobs for automated ETL workflows

Implemented Medallion Architecture to structure and optimize data pipelines

In an earlier role as a senior data engineer, they used Spark to process and analyze large volumes of data, implementing complex transformations with high performance, and developed Airflow DAGs in Python to orchestrate complex data workflows and ensure execution in logical, dependent steps.

Separate work as a senior big data engineer included creating APIs in Cloud Run for data processing, data parsing and data loading into BigQuery, and building Cloud Run Jobs for data processing and transformation in BigQuery.

Open to a signing bonus

For the right offer and opportunity, it will happen.

+ $5,000 signing bonus
Skills
Tech stack
PrefectPrefect
Azure DevOpsAzure DevOps
Apache SparkApache Spark
JavaJava
SQLSQL
PythonPython
Apache AirflowApache Airflow
AWSAWS
DockerDocker
Tools & workflows
Databricks Products
MATILION
API REST
Google BigQuery
Snowflake Cloud
Azure Databricks
PySpark
GCP
Jupyter
ETL
Natural Language Processing (NLP)
Work experience
· 6 roles

Senior Data Engineer

Company hidden · under 1 year

Senior Spark Engineer

Company hidden · under 1 year

Senior Big Data Engineer

Company hidden · under 1 year

Senior Data Engineer

Company hidden · under 1 year

Data Architect - Azure

Company hidden · under 1 year

Data Software Engineer

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • education· 2

Similar available Data Engineers

View all