
Data Engineer, Enterprise-Scale Data Pipeline Architect
Chicago, IL
Wigi highlights
12+ years, currently working as Senior Data Engineer
Migrated 40+ Talend ETL jobs to Databricks + Delta Lake
Engineered CDC + SCD Type 1/2 on Delta Lake across 15+ critical datasets
In the current role, built a real-time ingestion framework using Event Hubs, Kafka and Stream Analytics, processing 500M+ daily financial events at sub-minute latency. They also architected a Bronze→Silver→Gold lakehouse on Delta Lake with partitioning, Z-ordering and vacuum policies, reducing storage costs 35% and cutting query times by half.
During a previous tenure, also architected an ADLS Gen2 + Delta Lake + Auto Loader ingestion layer, eliminating data loss incidents and enabling point-in-time recovery. Kafka + Flink + Spark Streaming event pipelines were built as well, enabling real-time analytics on 200M+ daily healthcare operational events.
Open to a signing bonus
For the right offer and opportunity, it will happen.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 3
- education· 2
- Files· 5
Similar available Data Engineers
View all- Senior Data Engineer (Optimizing Analytics Pipelines) · London, UK · 10+ Yrs Exp · On-site · $8,000/mo
- Data Analytics Engineer (C, C++) · Tampere, Finland · 9 Yrs Exp · Remote · $6,600/mo
- Senior Data Engineer (Cloud-Native AI/ML Pipelines) · Berlin, Germany · 6 Yrs Exp · On-site · $4,400/mo
- Data Engineer | Reliability-Focused AI Systems · Berlin, Germany · 10+ Yrs Exp · Remote · $5,300/mo
- Senior Data Engineer — Apache Airflow & Data Build Tool (DBT) · Berlin, Germany · 10+ Yrs Exp · Remote · $6,400/mo