Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
streamshrimp6's avatar
@streamshrimp6

Big Data Developer (Real-Time Analytics Enablement)

$6,800/mo

Rostock

Experience: 7 yearsOpen to: Rostock·

Wigi highlights

7+ years, most recently Senior Big Data Developer

Cut data pipeline runtime by ~35% with PySpark and resource allocation

Improved data accuracy by 25% with automated validation checks

In a past ETL Systems Engineer role, redesigning Glue jobs and optimizing S3 storage structure lowered AWS data processing costs by ~20%. They also delivered pipelines handling over 500 GB/day of transactional and clickstream data with 99% reliability.

Other work included collaborating with teams to streamline workflows, enhancing efficiency. Monitoring and ensuring the integrity of operational processes delivered high accuracy in oversight and compliance.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Amazon RedshiftAmazon Redshift
Amazon EMRAmazon EMR
Amazon S3Amazon S3
AWS GlueAWS Glue
AWS LambdaAWS Lambda
Apache KafkaApache Kafka
Apache AirflowApache Airflow
Apache SparkApache Spark
Tools & workflows
Data Quality
Data Warehousing (DWH)
Distributed Data Processing
SQL Optimization
Big Data
Cloud Computing
Batch Processing
Stream Processing
Data Validation
ETL
Problem Solving
PySpark
Work experience
· 3 roles

ETL Systems Engineer

Company hidden · 3-5 years

Business Process Analyst

Company hidden · under 1 year

Business Process Analyst

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • projects· 2
  • education· 2

Similar available Data Engineers

View all