
Data Engineer | SQL & Data Pipelines
Brisbane
Wigi highlights
1+ year, most recently Mid-level Data Engineer
Developed and deployed an end-to-end ELT solution on Azure
Built an ingestion framework and pipeline with PySpark, Python and SQL
In a previous role, designed and built ETL processing solutions on Databricks for data integration and transformation using Apache Spark (PySpark), Python and SQL, and configured pipelines and triggers in Azure Data Factory for automated job scheduling: daily, weekly and monthly.
They also designed and implemented cloud data platform infrastructure on Microsoft Azure, including data processing, storage and networking components, to provide a centralised hub for digital banking business analysis across the company's diverse sectors. Other work included migrating the chemical data quality evaluation ETL process from Oracle to Snowflake on Microsoft Azure. Skills include Apache Hadoop, Big Data, Data Modeling and dbt.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- projects· 4
- certifications· 6
- education· 1
- Files· 2
Similar available Data Engineers
View all- Senior Big Data Developer, Regulated Data Pipelines · Lviv, Ukraine · 9 Yrs Exp · Remote · $2,700/mo
- Data Engineer (Quantitative Risk Modeling) · Washington, DC · 6 Yrs Exp · Hybrid · $11,600/mo
- Data Engineer (Cloud-Native Pipelines) · Minneapolis, MN · 10+ Yrs Exp · Hybrid · $10,900/mo
- Data Engineer | Multi-body Dynamics & Simulink · Norwich, UK · 10+ Yrs Exp · Hybrid · $5,800/mo
- Python & SQL Server Data Engineer · Berlin, Germany · 9 Yrs Exp · Remote · $5,700/mo