Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
equinoxweave68's avatar
@equinoxweave68

Data Engineer, Optimizing Supply Chain Data Flows

$5,000/mo

Manchester

Experience: 7 yearsOpen to: Manchester·

Wigi highlights

7+ years, currently operating as Junior Data Engineer

Cut freight costs by 25% through A/B testing of Python ML models

Migrated 50+ Informatica workflows to Spark, improving performance by 4x

As a data systems analyst, developed an AWS Lambda-based pipeline to extract structured JSON from 50,000+ PDFs in Amazon S3 using DeepSeek LLM, BERT and BAML, achieving over 90% accuracy, and designed and deployed ETL data pipelines using Azure Data Factory, Azure Datalake, Databricks and PySpark to ingest over 10 billion records into TigerGraph.

In another role, they also developed and maintained ETL pipelines to extract, transform and load data from multiple sources, improving data processing runtime by 50%. As primary support for data workflow incidents, achieved 98% SLA compliance through timely issue resolution and root-cause analysis. The general skill set includes Apache Hadoop, C++, Greenplum and Keras.

Open to a signing bonus

For the right offer and opportunity, it will happen.

+ $5,000 signing bonus
Skills
Tech stack
AWS LambdaAWS Lambda
KubernetesKubernetes
Apache KafkaApache Kafka
Azure Data FactoryAzure Data Factory
Amazon S3Amazon S3
PostgreSQLPostgreSQL
PyTorchPyTorch
KerasKeras
TensorFlowTensorFlow
Apache HadoopApache Hadoop
ScalaScala
SQLSQL
Apache HiveApache Hive
Apache SparkApache Spark
C++C++
GreenplumGreenplum
Tools & workflows
Azure Data Lake
PySpark
Azure Databricks
Informatica
Work experience
· 3 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Analyst

Company hidden · 1-3 years

Consulting Associate

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • education· 2

Similar available Data Engineers

View all