
@flinkchai
Apache Spark Data Engineer / Amazon RDS
$4,200/mo· Negotiable
León
Wigi highlights
4+ years, currently working as Mid-level Apache Spark Data Engineer
Develops ETL processes and data pipelines in Big Data environments
Defines and executes DAGs in Apache Airflow for automation
In the current role, they migrate databases from on-premise Oracle environments to cloud architectures on AWS and process and transform large volumes of data using Spark and PySpark.
In an earlier role, also developed a convolutional neural network for automatic welding image classification and trained and optimized deep learning models for defect detection in industrial welding processes.
Open to offers
Open to new opportunities
Skills
Tech stack
Tools & workflows
Jupyter
Analytical
JSON
ETL
Data Science
BMC Helix ITSM
Engineering Data Management (EDM)
Problem Solving
Data Analysis
Big Data Analytics
Work experience
Unlocks when they connect with you.
- projects· 2
- certifications· 1
- education· 2
Similar available Data Engineers
View all- Azure Data Engineer (Amazon RDS, Microsoft Azure) · Belfast, UK · 8 Yrs Exp · Remote · $6,300/mo
- Data Engineer - Anti-Fraud Detection · Nice, France · 2 Yrs Exp · Hybrid · $6,100/mo
- Data Integration Engineer, Business Intelligence Solutions · Berlin, Germany · 10+ Yrs Exp · Remote · $7,700/mo
- Data Engineer, Cross-Sector Analytical Infrastructure · Birmingham, UK · 10+ Yrs Exp · Remote · $6,100/mo
- Data Engineer, Autonomous Driving Data Pipelines · Berlin, Germany · 4 Yrs Exp · Remote · $5,200/mo