
Senior Enterprise-Scale Data Transformation Engineer
Warsaw
Wigi highlights
8+ years, currently Senior Enterprise-Scale Data Transformation Engineer
Refactored code and optimized SQL queries, reducing execution times
Improved data processing efficiency by refactoring legacy code
In the current role, developed and maintained efficient, scalable ETL pipelines using Python and Spark in Azure Databricks to process large volumes of tax data, and designed Medallion architecture to improve data quality.
In a previous role, they also developed and maintained efficient, scalable ETL pipelines using Python and Spark to process large volumes of data. Separate contributions included writing Scala and Spark jobs and ETL for big data processing. General capabilities include Azure Architecture, Azure DevOps Services, Azure Management, Docker and Infrastructure Management.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 7
- education· 2
Similar available Data Engineers
View all- Data Engineer - Anti-Fraud Detection · Nice, France · 2 Yrs Exp · Hybrid · $6,100/mo
- Data Integration Engineer, Business Intelligence Solutions · Berlin, Germany · 10+ Yrs Exp · Remote · $7,700/mo
- Data Engineer, Cross-Sector Analytical Infrastructure · Birmingham, UK · 10+ Yrs Exp · Remote · $6,100/mo
- Data Engineer, Autonomous Driving Data Pipelines · Berlin, Germany · 4 Yrs Exp · Remote · $5,200/mo
- Data Engineer - Data Analysis & SQL · Lviv, Ukraine · 10+ Yrs Exp · Hybrid · $3,500/mo