Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
quantumhttp's avatar
@quantumhttp

Data Engineer Focused on Apache Spark and PySpark

$7,100/mo· Negotiable

Lyon

Experience: 7 yearsOpen to: Lyon·

Wigi highlights

7+ years, currently operating as Senior Data Engineer

Devised a recurrent neural network in Tensorflow and deployed it to Spark

Built a web app to deploy the recommender system and Power BI dashboard

Used Apache Spark for distributed storage and feature engineering; cleaned and preprocessed data in order to obtain a coherent time series.

Developed a recommender system and a number of guests’ prediction models for a German canteen in order to increase revenue and decrease food waste. In another role, cleaned and preprocessed data in order to feed it into a GAN model.

Open to offers

Open to new opportunities

Skills
Tech stack
Apache SparkApache Spark
TerraformTerraform
Microsoft Power BIMicrosoft Power BI
Azure Data FactoryAzure Data Factory
SQLSQL
PythonPython
C++C++
JavaJava
RR
Microsoft SQL ServerMicrosoft SQL Server
TableauTableau
Tools & workflows
Big Data
Apache Spark Streaming
Azure Databricks
Azure Data Lake
ADX
PySpark
Azure DevOps Services
PL/SQL
Work experience
· 10 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Contract Data Engineer

Company hidden · 1-3 years

Data Insight Analyst

Company hidden · 1-3 years

Data Insight Analyst

Company hidden · under 1 year

Freelance Analytics Consultant

Company hidden · under 1 year

Data Insight Analyst

Company hidden · under 1 year

Data Science Trainee

Company hidden · under 1 year

Junior Statistical Modeler

Company hidden · under 1 year

Temporary Program Intern

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 5
  • certifications· 15
  • education· 3

Similar available Data Engineers

View all