Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
tauruslynx's avatar
@tauruslynx

Lead Data Engineer

$8,400/mo

Melbourne

Experience: 10+ yearsOpen to: Melbourne·

Wigi highlights

14+ years, most recently Lead Data Engineer

Designed and implemented bronze, silver and gold data layers

Reduced deployment time through automated Azure DevOps CI/CD pipelines

In a previous role, improved Spark processing performance and pipeline scalability through Delta Lake optimisation, partition pruning and workload tuning, and increased platform reliability through automated monitoring, data quality validation and proactive production support.

Separate work involved improving data availability and completeness by onboarding missing source systems into the data lake and reducing production incidents by implementing automated testing and validation frameworks. General capabilities include Agile Methodologies, Apache Kafka and Autosys.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Azure Data FactoryAzure Data Factory
DatabricksDatabricks
SQLSQL
PythonPython
Apache KafkaApache Kafka
AWSAWS
Oracle DatabaseOracle Database
PostgreSQLPostgreSQL
Tools & workflows
Data Security
Access Control
Azure Data Lake
PySpark
Stakeholder Management
Data Architecture
DevOps
Agile Methodologies
Business Objects Data Integrator
AXIOM
Fivetran ETL Tool
Autosys
Work experience
· 4 roles

Lead Data Engineer - Senior Level

Company hidden · 3-5 years

Senior Big Data Engineer

Company hidden · 1-3 years

Senior Data Insight Engineer

Company hidden · 3-5 years

Data Analyst and ETL Developer

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • certifications· 4
  • education· 1

Similar available Data Engineers

View all