
@quantumhttp
Data Engineer Focused on Apache Spark and PySpark
$7,100/mo· Negotiable
Lyon
Wigi highlights
7+ years, currently operating as Senior Data Engineer
Devised a recurrent neural network in Tensorflow and deployed it to Spark
Built a web app to deploy the recommender system and Power BI dashboard
Used Apache Spark for distributed storage and feature engineering; cleaned and preprocessed data in order to obtain a coherent time series.
Developed a recommender system and a number of guests’ prediction models for a German canteen in order to increase revenue and decrease food waste. In another role, cleaned and preprocessed data in order to feed it into a GAN model.
Open to offers
Open to new opportunities
Skills
Tech stack
Tools & workflows
Big Data
Apache Spark Streaming
Azure Databricks
Azure Data Lake
ADX
PySpark
Azure DevOps Services
PL/SQL
Work experience
Unlocks when they connect with you.
- projects· 5
- certifications· 15
- education· 3
Similar available Data Engineers
View all- Data Engineer, Cloud Data Platform Optimization · Kyiv, Ukraine · 4 Yrs Exp · Remote · $2,800/mo
- Senior Python Data Engineer / Cloud · Eindhoven, Netherlands · 10+ Yrs Exp · On-site · $5,800/mo
- Geodata Engineer / FME Server & ArcGIS Enterprise · Leeuwarden, Netherlands · 10+ Yrs Exp · Hybrid · $5,300/mo
- Data Engineer (Spatial Data Pipelines) · Lille, France · 4 Yrs Exp · Remote · $5,500/mo
- Data Engineer, Data Pipeline Optimization · Lille, France · 9 Yrs Exp · Remote · $5,800/mo