Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
nymphcoil's avatar
@nymphcoil

Senior Apache Airflow & PySpark Data Engineer

$6,500/mo· Negotiable

Frankfurt

Experience: 7 yearsOpen to: Frankfurt·

Wigi highlights

6+ years, currently operating as Senior Data Engineer

Built ETL architecture with PySpark, SQL and AWS

Configured AWS and GCP Big Data services for ETL

In an earlier role as a senior big data engineer, they created pipelines to migrate data using Airflow on AWS EMR and built custom monitoring and alerting systems for business users and stakeholders to have clear visibility over data infrastructure.

Separate work included designing and implementing internal process improvements, including automating manual processes, optimizing data delivery and redesigning infrastructure for greater scalability. Also migrated an RDBMS to a column-oriented data warehouse.

Open to offers

Open to new opportunities

Skills
Tech stack
PythonPython
SQLSQL
AWSAWS
Apache AirflowApache Airflow
Apache KafkaApache Kafka
GitGit
JenkinsJenkins
TerraformTerraform
Apache HiveApache Hive
AnsibleAnsible
Amazon RedshiftAmazon Redshift
TableauTableau
Microsoft ExcelMicrosoft Excel
Tools & workflows
PySpark
GCP
GitHub
HiveQL
R Programing
Docker Products
Work experience
· 6 roles

Senior Big Data Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

Senior Big Data Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Data Engineering Associate

Company hidden · under 1 year

Data Engineer Intern

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 2
  • education· 2

Similar available Data Engineers

View all