
Lead Data Engineer
Kyiv
Wigi highlights
9+ years, currently working as Lead Data Engineer
Built a lineage service to parse Spark execution plans
Orchestrated a Databricks job to collect ticket creation metadata
In the current role, migrated workflows from Spark on EKS and Flink to the Databricks platform, ensuring optimal performance and reliability. During a previous tenure, they also designed, developed and maintained scalable data pipelines using Spark and Scala.
Other work included optimizing Spark job performance through advanced tuning strategies and implementation of best practices. Also designed and implemented an API to generate support tickets based on metric thresholds, adhering to corporate templates. The listed skills include Amazon DynamoDB, Amazon Redshift and Amazon S3.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 10
- education· 2
Similar available Data Engineers
View all- Data Engineer (Quantitative Risk Modeling) · Washington, DC · 6 Yrs Exp · Hybrid · $11,600/mo
- Data Engineer (Cloud-Native Pipelines) · Minneapolis, MN · 10+ Yrs Exp · Hybrid · $10,900/mo
- Data Engineer | Multi-body Dynamics & Simulink · Norwich, UK · 10+ Yrs Exp · Hybrid · $5,800/mo
- Python & SQL Server Data Engineer · Berlin, Germany · 9 Yrs Exp · Remote · $5,700/mo
- Data Engineer, Data Pipelines And Visual Analytics · Stockholm, Sweden · 4 Yrs Exp · Remote · $5,100/mo