
Senior Real-Time Analytics Pipeline Engineer
London
Wigi highlights
7+ years, currently Senior Real-Time Analytics Pipeline Engineer
Cut data latency from 72hrs to <4hrs through pipeline optimization
Architected Azure Data Factory pipelines integrating 8+ clinical systems
In a past position as data operations lead, they orchestrated automated data flows from 5+ retailer portals using Python/PowerShell/UI Vision RPA, cutting manual intervention by 90%, and modernized legacy Access systems with SQL Server architecture, reducing query failures by 75% and increasing throughput 3x.
As a data analysis expert, designed dimensional data models in Azure SQL Data Warehouse supporting 50+ Power BI dashboards, improving query performance by 45% and saving £4K/year in compute costs. A data governance framework they implemented included automated lineage tracking and quality rules, achieving 99.7% data accuracy for mandatory NHS reporting.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- education· 4
Similar available Data Engineers
View all- Data Engineer (Optimizing Reporting Pipelines) · Bordeaux, France · 6 Yrs Exp · Remote · $6,200/mo
- Data Engineer | Azure Databricks & Modelado De Datos · Badalona, Spain · 4 Yrs Exp · Remote · $3,800/mo
- Data Engineer (Generative AI Infrastructure) · Madrid, Spain · 10+ Yrs Exp · Remote · $2,900/mo
- Associate Data Engineer, Process Optimization · Mannheim, Germany · 7 Yrs Exp · On-site · $5,400/mo
- Senior Data Engineer, Enterprise Data Analytics · Chicago, IL · 7 Yrs Exp · Remote · $12,700/mo