
Python & AWS Lambda Data Engineer
Grand Rapids, MI
Wigi highlights
4+ years, currently working as Mid-level Python & AWS Lambda Data Engineer
Cut report execution time from 120 seconds to 3 seconds
Built PySpark validation frameworks with over 80 rules
In the current role, processes over 400 GB of data daily across multiple source systems, ensuring high availability, reliability and data consistency. During a previous tenure, they also migrated over 30 legacy ETL workflows from on-premises environments to Azure cloud platforms, reducing infrastructure and maintenance costs.
Other work included developing scalable Spark workloads for large telecom datasets and optimizing performance using partitioning, broadcast joins, caching and Delta Lake techniques. Also automated source-to-target reconciliation processes and implemented data quality validation frameworks, reducing manual effort while improving data accuracy.
Available now
Ready to start immediately. No notice period. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 9
- education· 2
Similar available Data Engineers
View all- Data Engineer Associate | Machine Learning & SQL · Singapore · 8 Yrs Exp · Hybrid · $4,400/mo
- Big Data Developer (Data Lakehouse Optimization) · New York City, NY · 5 Yrs Exp · Hybrid · $9,800/mo
- Data Engeneer - Inżynieria Danych & Zestawy Danych · Toruń, Poland · 10+ Yrs Exp · On-site · $3,500/mo
- Data Engineer (Scalable Data Platforms) · Aveiro, Portugal · 6 Yrs Exp · Hybrid · $3,000/mo
- Data Engineer, Financial Sector Data Pipelines · Ede, Netherlands · 10+ Yrs Exp · Remote · $7,500/mo