Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
dottedsuperman8's avatar
@dottedsuperman8

Senior Data Engineer — Apache Airflow & Data Warehousing

$4,000/mo

Prague

Experience: 10+ yearsOpen to: Prague·

Wigi highlights

14+ years, currently working as Senior Data Engineer

Built and refactored complex PySpark / Spark SQL pipelines

Constructed an AWS event-driven data pipeline with SQS, SNS and Lambda

In a previous role, enabled CI/CD-driven, multi-environment Databricks deployments with parameterized notebooks, automated deployment and reusable components, improving reliability and maintainability. They also implemented enterprise-level data governance and PII management: automated classification ingestion, metadata enrichment, data lineage and alignment with Databricks data masking standards, enabling compliant data sharing and auditability.

Developed an Apache NiFi streaming application with Spark SQL, Spark Streaming, AWS DynamoDB and SQS messaging for data ingestion, data quality, data modeling and dashboard reporting for generating KPIs. In another role, architected and implemented scalable data and AI/ML solutions for enterprises.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Adobe SparkAdobe Spark
Spring FrameworkSpring Framework
AWS GlueAWS Glue
AWS LambdaAWS Lambda
Apache AirflowApache Airflow
Apache SparkApache Spark
Apache HadoopApache Hadoop
SQLSQL
AWSAWS
Apache HiveApache Hive
JavaJava
ScalaScala
Tools & workflows
Apache Spark Streaming
HDFS
Impala
Big Data
CI/CD
Data Warehousing (DWH)
Azure Databricks
PySpark
Work experience
· 6 roles

Senior Big Data Engineer

Company hidden · under 1 year

Spark Data Engineer

Company hidden · 5-10 years

Senior Big Data Engineer

Company hidden · 1-3 years

Big Data Software Engineer

Company hidden · 1-3 years

Software Engineer

Company hidden · 1-3 years

Java Developer | TCS

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • education· 2

Similar available Data Engineers

View all