
Data Engineer
Argenteuil
Wigi highlights
10+ years, most recently Junior Data Engineer
Designed a star schema with SCD2 historization in 21 dbt models
Developed anomaly detection with Spark Structured Streaming
In a project, they deployed the pipeline on AWS with Terraform: MSK Serverless, EMR Serverless with IAM authentication, and persistent S3 storage, Glue and Athena, separate from the ephemeral infrastructure to control costs. Separate work involved writing transformations with dbt and orchestrating the pipeline with Airflow on Amazon MWAA, in a private network.
Other work included calculating five business KPIs (OTD, PPM, lead time, Days of Supply, Supplier Health Score) and orchestrating the pipeline with Airflow. An aberrant indicator (915 days of stock) was corrected to a coherent value (3.2 days) after fixing three root causes identified by SQL queries.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- projects· 3
- certifications· 7
- education· 5
Similar available Data Engineers
View all- Data Engineer (Real-Time Analytics Pipelines) · Białystok, Poland · 10+ Yrs Exp · Remote · $5,100/mo
- Data Engineer (Real-Time Well Analytics) · Nowy Sącz, Poland · 10+ Yrs Exp · On-site · $4,900/mo
- Senior Data Engineer (Data-Driven Campaign Optimization) · Amersfoort, Netherlands · 10+ Yrs Exp · On-site · $5,400/mo
- Data Engineer (Scalable Analytics Pipelines) · Paterson, NJ · 6 Yrs Exp · Remote · $11,300/mo
- Enterprise Data Enablement Engineer · Warsaw, Poland · 6 Yrs Exp · Hybrid · $3,800/mo