Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
astroaxolotl247's avatar
@astroaxolotl247

Data Engineer | SQL & Data Pipelines

$6,200/mo

Brisbane

Experience: 2 yearsOpen to: Brisbane·

Wigi highlights

1+ year, most recently Mid-level Data Engineer

Developed and deployed an end-to-end ELT solution on Azure

Built an ingestion framework and pipeline with PySpark, Python and SQL

In a previous role, designed and built ETL processing solutions on Databricks for data integration and transformation using Apache Spark (PySpark), Python and SQL, and configured pipelines and triggers in Azure Data Factory for automated job scheduling: daily, weekly and monthly.

They also designed and implemented cloud data platform infrastructure on Microsoft Azure, including data processing, storage and networking components, to provide a centralised hub for digital banking business analysis across the company's diverse sectors. Other work included migrating the chemical data quality evaluation ETL process from Oracle to Snowflake on Microsoft Azure. Skills include Apache Hadoop, Big Data, Data Modeling and dbt.

Open to offers

Open to new opportunities

Skills
Tech stack
PythonPython
SQLSQL
Microsoft FabricMicrosoft Fabric
Microsoft AzureMicrosoft Azure
Azure Data FactoryAzure Data Factory
Apache SparkApache Spark
Apache HadoopApache Hadoop
Apache HiveApache Hive
GitGit
SnowflakeSnowflake
dbtdbt
Microsoft SQL ServerMicrosoft SQL Server
Tools & workflows
T-SQL
Big Data
Data Pipelines
Data Modeling
ELT
ETL
Query Optimization
Azure Databricks
Work experience
· 3 roles

Data Systems Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

Data Engineer/Analyst

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 4
  • certifications· 6
  • education· 1
  • Files· 2

Similar available Data Engineers

View all