
Enterprise Data Modernization Engineer
London
Wigi highlights
3+ years, currently Mid-level Enterprise Data Modernization Engineer
Cut ETL latency by 38% with a new enterprise data platform
Built an Azure data platform, cutting ETL latency by 35%
In a previous role as a data engineer, optimized PySpark-based big data pipelines on Azure Databricks to process millions of records from CosmosDB and S3, improving ETL performance by 45%. They also automated ETL testing and workflow monitoring using Python, reducing manual intervention by 50% and improving production stability.
As an Azure ETL Engineer, built and optimized PySpark-based ETL pipelines on Azure Databricks, reducing job runtimes by 40% across large-scale, multi-business-unit datasets. Automated testing frameworks in Python for data validation and modeling were also created, cutting manual testing effort by 45% and increasing production deployment confidence. Their general capabilities include Alteryx, Azure Data Factory, Microsoft Azure, Microsoft SQL Server and SQL.
Available now
Ready to start immediately. No notice period. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- projects· 5
- certifications· 15
- education· 4
Similar available Data Engineers
View all- Senior Lead Data Engineer & Vice President · Singapore · 10+ Yrs Exp · Remote · $11,800/mo
- Data Engineer (Automatisation Des Pipelines De Traitement) · Lyon, France · 6 Yrs Exp · Remote · $6,400/mo
- Data Engineer | QOps Expert · Dnipro, Ukraine · 10+ Yrs Exp · On-site · $3,100/mo
- Data Integration Engineer (Scalable Cloud Infrastructure) · Copenhagen, Denmark · 8 Yrs Exp · Hybrid · $4,400/mo
- Junior Data Engineer, Enterprise-Scale Data Transformation · Vila Nova de Gaia, Portugal · 3 Yrs Exp · Remote · $3,700/mo