Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
spiritakita's avatar
@spiritakita

Senior Apache Airflow Data Engineer, Databrick

$6,400/mo

Parramatta

Experience: 6 yearsOpen to: Parramatta

Wigi highlights

5+ years, currently working as Senior Data Engineer

Led migration of ~100 TB of legacy data to Databricks Lakehouse

Developed 20+ end-to-end ETL pipelines, improving reporting delivery time by 50%

As a senior big data engineer, they architected and delivered modern data pipelines using Databricks (Azure & AWS), DBT and Airflow, improving pipeline efficiency and reducing runtime by 40%, enabling near real-time data availability. Designed and implemented AML data solutions, ensuring 100% compliance with regulatory and audit requirements.

In an earlier role, optimised SQL and Spark jobs, reducing cloud compute costs by 25%. Led data migration from Teradata to Databricks, covering 48 OLAP cubes and 19 Tableau dashboards, ensuring accuracy across 70+ gold-layer tables.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
dbtdbt
AWS LambdaAWS Lambda
Apache AirflowApache Airflow
Azure Data FactoryAzure Data Factory
LinuxLinux
SnowflakeSnowflake
Microsoft AzureMicrosoft Azure
PythonPython
MySQLMySQL
PostgreSQLPostgreSQL
Microsoft ExcelMicrosoft Excel
SQLSQL
Tools & workflows
Jupyter
Azure Databricks
Data Analysis
Data Warehousing (DWH)
Databrick
PySpark
AIOps
Statistical Data Analysis
Work experience
· 4 roles

Senior Big Data Engineer

Company hidden · 3-5 years

Data Systems Engineer

Company hidden · 1-3 years

Code Engineer

Company hidden · 1-3 years

Data Engineering Associate

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 4
  • education· 5

Similar available Data Engineers

View all