
@poisedwarden
Apache Spark Data Engineer (Azure Data Factory)
$6,700/mo
Melbourne
Wigi highlights
6+ years, currently working as Senior Apache Spark Data Engineer
Ensured 99.8% uptime for production pipelines
Integrated graph datasets into Neo4j using PySpark
On AWS, processed billions of records from various sources into Hive; engineered high-volume Spark-based ETL pipelines.
Education includes a Bachelor of Engineering. Certification credentials include "Microsoft Certified Azure Data Fundamentals". General capabilities include Azure Databricks.
Open to offers
Open to new opportunities
Skills
Tech stack
Tools & workflows
Azure Databricks
PySpark
DevOps
Work experience
Unlocks when they connect with you.
- certifications· 5
- education· 1
- Files· 4
Similar available Data Engineers
View all- Data Engineer, Cross-Sector Analytical Infrastructure · Birmingham, UK · 10+ Yrs Exp · Remote · $6,100/mo
- Data Engineer, Autonomous Driving Data Pipelines · Berlin, Germany · 4 Yrs Exp · Remote · $5,200/mo
- Data Engineer - Data Analysis & SQL · Lviv, Ukraine · 10+ Yrs Exp · Hybrid · $3,500/mo
- Senior Data Engineer - Medrio & Data Management · Stuttgart, Germany · 10+ Yrs Exp · Hybrid · $7,700/mo
- AI and Data Engineer (Microsoft Power BI, Azure Functions) · Sterling Heights, MI · 2 Yrs Exp · On-site · $7,900/mo