Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
swiftbeacon's avatar
@swiftbeacon

Senior Data Engineer / Data Pipelines & PySpark

$7,600/mo· Negotiable

Utrecht

Experience: 10+ yearsOpen to: Utrecht·

Wigi highlights

12+ years, currently operating as Senior Engineer

Implemented end-to-end Azure pipelines with Data Factory and Synapse

Built GCP-based ETL/ELT batch and real-time Kafka streaming pipelines

As a senior big engineer, developed a real-time streaming pipeline using Cloud Run Dataflow that provided insights into customer behavior with a latency of under 5 seconds, and developed PySpark applications on Databricks, which yielded a significant 30% amount of cost reduction.

In a separate role as engineering lead, they also built GCP Cloud Run REST APIs using services such as BigQuery, GCS, Pub/Sub, Airflow, Cloud Workflows and Cloud Scheduler and used Azure DevOps, Google Cloud Build, triggers, Jenkins and Airflow for scheduling and programming.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Microsoft FabricMicrosoft Fabric
Microsoft Power BIMicrosoft Power BI
Microsoft AzureMicrosoft Azure
SAP HANASAP HANA
SQLSQL
Oracle DatabaseOracle Database
Tools & workflows
Generative AI
Databricks Generative AI
Azure DevOps Services
Data Pipelines
Azure Data Lake
Azure Databricks
GCP
Data
ETL
Spark SQL
Dimensional Modeling
PySpark
Data Analysis
Data Lakes
Work experience
· 5 roles

Senior Big Data Engineer

Company hidden · 1-3 years

Data Engineering Lead

Company hidden · 3-5 years

Senior Big Data Engineer

Company hidden · 1-3 years

Head of Data Modeling

Company hidden · 1-3 years

Data Analysis Expert

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • certifications· 11
  • education· 1

Similar available Data Engineers

View all
    Senior Data Engineer (Remote) in Utrecht | Wigiwork