
Senior Apache Airflow Data Engineer, Databrick
Parramatta
Wigi highlights
5+ years, currently working as Senior Data Engineer
Led migration of ~100 TB of legacy data to Databricks Lakehouse
Developed 20+ end-to-end ETL pipelines, improving reporting delivery time by 50%
As a senior big data engineer, they architected and delivered modern data pipelines using Databricks (Azure & AWS), DBT and Airflow, improving pipeline efficiency and reducing runtime by 40%, enabling near real-time data availability. Designed and implemented AML data solutions, ensuring 100% compliance with regulatory and audit requirements.
In an earlier role, optimised SQL and Spark jobs, reducing cloud compute costs by 25%. Led data migration from Teradata to Databricks, covering 48 OLAP cubes and 19 Tableau dashboards, ensuring accuracy across 70+ gold-layer tables.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 4
- education· 5
Similar available Data Engineers
View all- Data Engineer, Enterprise-Scale Data Processing Pipelines · Jena, Germany · 4 Yrs Exp · Remote · $5,500/mo
- Senior Data Engineer | ML | Google Cloud Platform · Kyiv, Ukraine · 8 Yrs Exp · Hybrid · $3,300/mo
- Senior Data Engineer - Python & Microsoft Azure · Sofia, Bulgaria · 10+ Yrs Exp · Remote · $2,600/mo
- Data Engineering Manager - IoT-driven Analytics · Porto, Portugal · 4 Yrs Exp · Remote · $4,200/mo
- AWS Lambda Data Engineer (AWS Glue) · Parla, Spain · 9 Yrs Exp · Remote · $2,900/mo