
Data Engineer | Apache Spark & Data Governance
Regensburg
Wigi highlights
4+ years, most recently Senior Data Engineer
Resolved ingestion bottlenecks, improving performance by 30%
Orchestrated daily operations for a 3-person support team
In a past position, maintained and monitored 100+ tables and 180 interfaces with master and transactional data from SAP and enterprise systems, ensuring data integrity across the full lifecycle. They also developed robust ADF pipelines integrated with Azure API Management (APIM) and Azure Service Bus Topics, ensuring reliable data ingestion and event-driven messaging.
Separate work involved architecting scalable cloud-native lakehouses on the Databricks Data Intelligence Platform using Delta Live Tables (DLT), utilizing Unity Catalog to enforce automated data governance and lineage across production layers. Also developed parameterised ADF pipelines to ingest data from Azure SQL Database, ADLS (CSV, JSON, Parquet) and Data Storage Tables, with support for incremental loading and historical backfilling.
Available now
Ready to start immediately. No notice period. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 12
- education· 3
Similar available Data Engineers
View all- AI and Data Engineer (Microsoft Power BI, Azure Functions) · Sterling Heights, MI · 2 Yrs Exp · On-site · $7,900/mo
- Senior Lead Data Engineer & Vice President · Singapore · 10+ Yrs Exp · Remote · $11,800/mo
- Data Engineer (Automatisation Des Pipelines De Traitement) · Lyon, France · 6 Yrs Exp · Remote · $6,400/mo
- Data Engineer | QOps Expert · Dnipro, Ukraine · 10+ Yrs Exp · On-site · $3,100/mo
- Data Integration Engineer (Scalable Cloud Infrastructure) · Copenhagen, Denmark · 8 Yrs Exp · Hybrid · $4,400/mo