
Apache Airflow & AWS Data Engineer
Paris
Wigi highlights
5+ years, currently working as Senior Apache Airflow & AWS Data Engineer
Created a data engineering solution architecture with Azure tools
Developed PySpark ingestion and preprocessing in Azure Databricks
In a previous role as a data systems engineer, automated data extraction from advertising platform APIs with Azure Data Factory for orchestration and data pipelines, and created and optimized database schemas, improving query performance and reducing latency.
As a data engineering trainee, they also cleaned and processed data collected on Amazon EMR using the Hadoop ecosystem and PySpark API of the Spark framework, and retrieved and transferred large log files from Amazon S3 of Mediamath to S3 of their AWS account using Python scripts and the AWS SDK Boto3.
Open to a signing bonus
For the right offer and opportunity, it will happen.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 15
- education· 2
- Files· 1
Similar available Data Engineers
View all- Senior Data Engineer (Data-Driven Campaign Optimization) · Amersfoort, Netherlands · 10+ Yrs Exp · On-site · $5,400/mo
- Data Engineer (Scalable Analytics Pipelines) · Paterson, NJ · 6 Yrs Exp · Remote · $11,300/mo
- Enterprise Data Enablement Engineer · Warsaw, Poland · 6 Yrs Exp · Hybrid · $3,800/mo
- Lead Data Engineer / Scalable Analytics Solutions · Coimbra, Portugal · 5 Yrs Exp · Hybrid · $3,900/mo
- Data Engineer, Real Estate Data Platform · Lviv, Ukraine · 8 Yrs Exp · Remote · $2,300/mo