
@nymphcoil
Senior Apache Airflow & PySpark Data Engineer
$6,500/mo· Negotiable
Frankfurt
Wigi highlights
6+ years, currently operating as Senior Data Engineer
Built ETL architecture with PySpark, SQL and AWS
Configured AWS and GCP Big Data services for ETL
In an earlier role as a senior big data engineer, they created pipelines to migrate data using Airflow on AWS EMR and built custom monitoring and alerting systems for business users and stakeholders to have clear visibility over data infrastructure.
Separate work included designing and implementing internal process improvements, including automating manual processes, optimizing data delivery and redesigning infrastructure for greater scalability. Also migrated an RDBMS to a column-oriented data warehouse.
Open to offers
Open to new opportunities
Skills
Tech stack
Tools & workflows
PySpark
GCP
GitHub
HiveQL
R Programing
Docker Products
Work experience
Unlocks when they connect with you.
- certifications· 2
- education· 2
Similar available Data Engineers
View all- Data Engineer, Autonomous Driving Data Pipelines · Berlin, Germany · 4 Yrs Exp · Remote · $5,200/mo
- Data Engineer - Data Analysis & SQL · Lviv, Ukraine · 10+ Yrs Exp · Hybrid · $3,500/mo
- Senior Data Engineer - Medrio & Data Management · Stuttgart, Germany · 10+ Yrs Exp · Hybrid · $7,700/mo
- AI and Data Engineer (Microsoft Power BI, Azure Functions) · Sterling Heights, MI · 2 Yrs Exp · On-site · $7,900/mo
- Senior Lead Data Engineer & Vice President · Singapore · 10+ Yrs Exp · Remote · $11,800/mo