
Apache Spark Data Integration Engineer Skilled in Redshift
Delaware
Wigi highlights
4+ years, currently working as Mid-level Data Integration Engineer
Cut daily ETL execution time by 60% with PySpark on EMR
Built Airflow and AWS Glue pipelines, cutting batch failures by 45%
Created modular dbt models for fact tables, reducing SQL duplication by 70% and enabling faster updates to metric logic across multiple stakeholder-facing dashboards; configured CloudWatch alarms and integrated SNS alerts, reducing incident response time from 90 to 50 minutes for critical overnight job failures.
In a previous role, automated ETL from MySQL to Snowflake using Python and Cron, improving daily refresh reliability to 98% and removing the need for manual updates; managed 40+ Airflow DAGs to ingest JSON and CSV, reducing end-to-end data load time by over 3 hours across environments.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- education· 2
- Photos· 2
Similar available Data Engineers
View all- Data Engineer, Cloud Data Platform Optimization · Kyiv, Ukraine · 4 Yrs Exp · Remote · $2,800/mo
- Senior Python Data Engineer / Cloud · Eindhoven, Netherlands · 10+ Yrs Exp · On-site · $5,800/mo
- Geodata Engineer / FME Server & ArcGIS Enterprise · Leeuwarden, Netherlands · 10+ Yrs Exp · Hybrid · $5,300/mo
- Data Engineer (Spatial Data Pipelines) · Lille, France · 4 Yrs Exp · Remote · $5,500/mo
- Data Engineer, Data Pipeline Optimization · Lille, France · 9 Yrs Exp · Remote · $5,800/mo