Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
poisedwarden's avatar
@poisedwarden

Apache Spark Data Engineer (Azure Data Factory)

$6,700/mo

Melbourne

Experience: 6 yearsOpen to: Melbourne·

Wigi highlights

6+ years, currently working as Senior Apache Spark Data Engineer

Ensured 99.8% uptime for production pipelines

Integrated graph datasets into Neo4j using PySpark

On AWS, processed billions of records from various sources into Hive; engineered high-volume Spark-based ETL pipelines.

Education includes a Bachelor of Engineering. Certification credentials include "Microsoft Certified Azure Data Fundamentals". General capabilities include Azure Databricks.

Open to offers

Open to new opportunities

Skills
Tech stack
Microsoft AzureMicrosoft Azure
PythonPython
Apache SparkApache Spark
Azure Data FactoryAzure Data Factory
DatabricksDatabricks
Tools & workflows
Azure Databricks
PySpark
DevOps
Work experience
· 2 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • certifications· 5
  • education· 1
  • Files· 4

Similar available Data Engineers

View all