
Python & Apache Spark Data Engineer
Washington, DC
Wigi highlights
7+ years, currently Senior Python & Apache Spark Data Engineer
Built real-time flight status pipelines with Apache Flink
Automated data quality checks in Snowflake, reducing manual workload
In the current role, machine learning models trained on Snowflake data were used to predict flight delays and suggest alternative routes, minimizing passenger disruption. Optimized Snowflake schema design, enhancing data retrieval efficiency for complex customer journey analyses and operational performance dashboards.
In a previous role, they also developed and enforced data governance frameworks in Snowflake to ensure HIPAA compliance and data security, protecting member health information. Managed complex data transformations at scale using Apache Spark and Airflow, enabling population health analysis, claims processing and cost analysis.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- education· 2
Similar available Data Engineers
View all- Data Engineer (Scalable Data Platforms) · Aveiro, Portugal · 6 Yrs Exp · Hybrid · $3,000/mo
- Data Engineer, Financial Sector Data Pipelines · Ede, Netherlands · 10+ Yrs Exp · Remote · $7,500/mo
- Data Engineer (Geospatial & AI-driven Data Platforms) · Zurich, Switzerland · 10+ Yrs Exp · Remote · $9,900/mo
- Data Engineer (Data Infrastructure And Insight Enablement) · Berlin, Germany · 10+ Yrs Exp · Remote · $6,600/mo
- Team Lead Data Engineer (Apache Airflow, Snowflake) · Lviv, Ukraine · 10+ Yrs Exp · Remote · $3,400/mo