
Junior Data Engineer | Azure Databricks & PySpark
Warsaw
Wigi highlights
3+ years, currently working as Junior Data Engineer
Led enterprise-wide product ID normalization, eliminating data mismatches
Built a PySpark/Python data quality framework with automated alerts
In the current role, resolved intricate 1-to-many relational bottlenecks in SAP BW/ERP metadata-driven workflows and automated data integrations by leveraging advanced Databricks SQL window functions and ranking logic (e.g. ROW_NUMBER, QUALIFY), eliminating data duplication across central data marts. They also engineered and executed complex schema evolutions on multibillion-row Delta tables using advanced SQL MERGE operations, implementing robust pre- and post-deployment scripts to guarantee zero downtime and data integrity.
In an earlier role, also led the onboarding of two new sales data providers - from specs and validation to API automation. Designed and implemented end-to-end ETL workflows in Azure Databricks using PySpark and SQL.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 7
- education· 4
- Files· 1
Similar available Data Engineers
View all- Data Engineer — Hive & Modélisation Des Données · Rouen, France · 9 Yrs Exp · On-site · $6,600/mo
- Apache Spark Data Engineer Specialized on PySpark · Alicante, Spain · 4 Yrs Exp · Remote · $3,600/mo
- Data Analytics Engineer (Amazon Redshift, Amazon S3) · London, UK · 5 Yrs Exp · Remote · $5,700/mo
- Qlik Data Engineer | Jenkins · Barcelona, Spain · 10+ Yrs Exp · On-site · $5,100/mo
- Senior Data Engineer / Data Pipelines & PySpark · Utrecht, Netherlands · 10+ Yrs Exp · Remote · $7,600/mo