Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
jovialtaurus's avatar
@jovialtaurus

Apache Airflow & AWS Data Engineer

$7,000/mo

Paris

Experience: 6 yearsOpen to: Paris·

Wigi highlights

5+ years, currently working as Senior Apache Airflow & AWS Data Engineer

Created a data engineering solution architecture with Azure tools

Developed PySpark ingestion and preprocessing in Azure Databricks

In a previous role as a data systems engineer, automated data extraction from advertising platform APIs with Azure Data Factory for orchestration and data pipelines, and created and optimized database schemas, improving query performance and reducing latency.

As a data engineering trainee, they also cleaned and processed data collected on Amazon EMR using the Hadoop ecosystem and PySpark API of the Spark framework, and retrieved and transferred large log files from Amazon S3 of Mediamath to S3 of their AWS account using Python scripts and the AWS SDK Boto3.

Open to a signing bonus

For the right offer and opportunity, it will happen.

+ $5,000 signing bonus
Skills
Tech stack
PandasPandas
NumPyNumPy
DatabricksDatabricks
AWS GlueAWS Glue
Amazon EMRAmazon EMR
Amazon RDSAmazon RDS
PythonPython
Apache AirflowApache Airflow
Amazon S3Amazon S3
AWSAWS
SQLSQL
ScalaScala
Tools & workflows
scikit-learn
Deepsort
YOLO
Beautiful Soup
Data Analytics
Data Visualization
Big Data
Data Analysis
Work experience
· 5 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · under 1 year

Data Engineering Trainee

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 15
  • education· 2
  • Files· 1

Similar available Data Engineers

View all