
Senior Data Engineer (Data Lake & Spark Pipelines)
Berlin
Wigi highlights
10+ years, currently working as Senior Data Engineer
Built Spark pipelines for structured data ingestion and transformation
Contributed to Hadoop cluster architecture design and integration
Designed data-flow architecture across different environments and a matrix of tools and users; built a "Customer Interaction" data model integrating customer demographics, product holdings and interaction data derived from Google Analytics, emails and offline sources, helping remove data silos and increase user identification of online interactions by 20%.
Constructed data pipelines to correlate data from various legacy sources into Hadoop, conducting transformations to generate more coherent data entities for further analysis. In another role, performed classification modelling to enhance policy renewals by a lift of 30% using decision trees and random forest in sparklyr.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 2
- education· 3
Similar available Data Engineers
View all- Data Analytics Engineer (C, C++) · Tampere, Finland · 9 Yrs Exp · Remote · $6,600/mo
- Senior Data Engineer (Cloud-Native AI/ML Pipelines) · Berlin, Germany · 6 Yrs Exp · On-site · $4,400/mo
- Data Engineer | Reliability-Focused AI Systems · Berlin, Germany · 10+ Yrs Exp · Remote · $5,300/mo
- Senior Data Engineer — Apache Airflow & Data Build Tool (DBT) · Berlin, Germany · 10+ Yrs Exp · Remote · $6,400/mo
- Data Engineer, Modernizing BI Data Infrastructure · Singapore · 10+ Yrs Exp · Remote · $5,700/mo