
Data Engineer (Building Scalable Data Workflows)
Berlin
Wigi highlights
7+ years, currently operating as Junior Data Engineer
Architected and implemented an end-to-end SQL Server data warehouse
Built a resumable satellite imagery ingestion pipeline on Databricks
As an advanced research scholar, implemented a reusable Python workflow for Bayesian model fitting, including data preprocessing, likelihood and prior formulation, MCMC sampling, posterior visualization (corner plots), convergence assessment and publication-quality figure generation. In a separate data systems role, they designed a Delta control table logging every attempt (including failure) with run ID and storage path, with an anti-join that skips completed scenes and re-queues retryable failures and batched writes to avoid the small-file problem.
During a previous research fellowship, also built and operated a production Python data pipeline processing ~1 TB of data per run across a 12-month project lifecycle, covering raw ingestion, calibration, transformation and output generation. Separate work included engineering PySpark transformation pipelines across Bronze, Silver and Gold layers with data quality validation gates at each stage.
Open to a signing bonus
For the right offer and opportunity, it will happen.
Skills
Work experience
Unlocks when they connect with you.
- projects· 2
- certifications· 4
- education· 2
Similar available Data Engineers
View all- Senior Python Data Engineer / Cloud · Eindhoven, Netherlands · 10+ Yrs Exp · On-site · $5,800/mo
- Geodata Engineer / FME Server & ArcGIS Enterprise · Leeuwarden, Netherlands · 10+ Yrs Exp · Hybrid · $5,300/mo
- Data Engineer (Spatial Data Pipelines) · Lille, France · 4 Yrs Exp · Remote · $5,500/mo
- Data Engineer, Data Pipeline Optimization · Lille, France · 9 Yrs Exp · Remote · $5,800/mo
- Data Engineer, Optimizing Supply Chain Data Flows · Manchester, UK · 7 Yrs Exp · Remote · $5,000/mo