
Lead Data Engineer
Melbourne
Wigi highlights
14+ years, most recently Lead Data Engineer
Designed and implemented bronze, silver and gold data layers
Reduced deployment time through automated Azure DevOps CI/CD pipelines
In a previous role, improved Spark processing performance and pipeline scalability through Delta Lake optimisation, partition pruning and workload tuning, and increased platform reliability through automated monitoring, data quality validation and proactive production support.
Separate work involved improving data availability and completeness by onboarding missing source systems into the data lake and reducing production incidents by implementing automated testing and validation frameworks. General capabilities include Agile Methodologies, Apache Kafka and Autosys.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 4
- education· 1
Similar available Data Engineers
View all- Data Engineer, Enterprise-Scale Data Processing Pipelines · Jena, Germany · 4 Yrs Exp · Remote · $5,500/mo
- Senior Data Engineer | ML | Google Cloud Platform · Kyiv, Ukraine · 8 Yrs Exp · Hybrid · $3,300/mo
- Senior Data Engineer - Python & Microsoft Azure · Sofia, Bulgaria · 10+ Yrs Exp · Remote · $2,600/mo
- Data Engineering Manager - IoT-driven Analytics · Porto, Portugal · 4 Yrs Exp · Remote · $4,200/mo
- AWS Lambda Data Engineer (AWS Glue) · Parla, Spain · 9 Yrs Exp · Remote · $2,900/mo