
Data Engineer for Scalable Analytics Infrastructure
Leeds
Wigi highlights
16+ years, currently Senior Engineer for Scalable Analytics Infrastructure
Reduced ingest run time by 90% and cloud costs by 80%
Improved customer matching from 60+ minutes to under 5
Works in data & AI. Designed and implemented medallion architecture pipelines using PySpark on Databricks (Delta format) and DBT on Snowflake, transforming raw into clean, reliable insights. Built a migration pipeline for a national charity using Airflow and AWS Glue (Spark), transforming multi-source data into Iceberg tables on S3 and populating a Dockerised MDM solution on ECS, integrated with Snowflake and Salesforce. Led infrastructure design across Azure, including Functions, Container Apps, Lake, Blob Storage, APIM, CosmosDB, Key Vault and VNet, fully automated using Terraform and GitHub Actions. Additional listed skills include Azure Lake.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- education· 3
Similar available Data Engineers
View all- Senior Terraform & API-Entwicklung Data Engineer · Hanover, Germany · 10+ Yrs Exp · Remote · $5,800/mo
- Data Engineer (Microsoft Power BI, SQL) · Iași, Romania · 10+ Yrs Exp · Remote · $2,400/mo
- Senior Data Engineer (Real-Time Analytics) · Singapore · 2 Yrs Exp · Remote · $3,900/mo
- Senior Apache Kafka Big Data Engineer | Scala · Odesa, Ukraine · 10+ Yrs Exp · Remote · $2,400/mo
- Data Engineer — Jira & Email Automation · Adelaide, Australia · 10+ Yrs Exp · Remote · $5,900/mo