
Data Enginner (Big Data Pipeline Optimization)
Madrid
Wigi highlights
9+ years, currently working as Mid-level Data Engineer
Develops ETL/ELT pipelines with PySpark and Apache Spark
Designs Medallion architectures and Delta Lake solutions
Develops reusable notebooks and Databricks Workflows, automating ingestion and transformation processes; optimizes Delta tables with OPTIMIZE, ZORDER and VACUUM to improve query performance.
Optimizes Spark applications through partitioning, reducing shuffles, optimizing joins, caching, cluster tuning and parallelism; participates in migrating processes and business logic from a data platform to Databricks, ensuring functional equivalence and optimizing performance.
Available now
Ready to start immediately. No notice period. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 15
- education· 5
- Files· 2
Similar available Data Engineers
View all- Data Engineer (Optimizing Reporting Pipelines) · Bordeaux, France · 6 Yrs Exp · Remote · $6,200/mo
- Data Engineer | Azure Databricks & Modelado De Datos · Badalona, Spain · 4 Yrs Exp · Remote · $3,800/mo
- Data Engineer (Generative AI Infrastructure) · Madrid, Spain · 10+ Yrs Exp · Remote · $2,900/mo
- Associate Data Engineer, Process Optimization · Mannheim, Germany · 7 Yrs Exp · On-site · $5,400/mo
- Senior Data Engineer, Enterprise Data Analytics · Chicago, IL · 7 Yrs Exp · Remote · $12,700/mo