
Data Engineer, Optimizing Supply Chain Data Flows
Manchester
Wigi highlights
7+ years, currently operating as Junior Data Engineer
Cut freight costs by 25% through A/B testing of Python ML models
Migrated 50+ Informatica workflows to Spark, improving performance by 4x
As a data systems analyst, developed an AWS Lambda-based pipeline to extract structured JSON from 50,000+ PDFs in Amazon S3 using DeepSeek LLM, BERT and BAML, achieving over 90% accuracy, and designed and deployed ETL data pipelines using Azure Data Factory, Azure Datalake, Databricks and PySpark to ingest over 10 billion records into TigerGraph.
In another role, they also developed and maintained ETL pipelines to extract, transform and load data from multiple sources, improving data processing runtime by 50%. As primary support for data workflow incidents, achieved 98% SLA compliance through timely issue resolution and root-cause analysis. The general skill set includes Apache Hadoop, C++, Greenplum and Keras.
Open to a signing bonus
For the right offer and opportunity, it will happen.
Skills
Work experience
Unlocks when they connect with you.
- education· 2
Similar available Data Engineers
View all- Data Engineer Associate | Machine Learning & SQL · Singapore · 8 Yrs Exp · Hybrid · $4,400/mo
- Big Data Developer (Data Lakehouse Optimization) · New York City, NY · 5 Yrs Exp · Hybrid · $9,800/mo
- Data Engeneer - Inżynieria Danych & Zestawy Danych · Toruń, Poland · 10+ Yrs Exp · On-site · $3,500/mo
- Data Engineer (Scalable Data Platforms) · Aveiro, Portugal · 6 Yrs Exp · Hybrid · $3,000/mo
- Data Engineer, Financial Sector Data Pipelines · Ede, Netherlands · 10+ Yrs Exp · Remote · $7,500/mo