Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
legendradon37's avatar
@legendradon37

Data Engineer for Scalable Analytics Infrastructure

$6,600/mo

Leeds

Experience: 10+ yearsOpen to: Leeds·

Wigi highlights

16+ years, currently Senior Engineer for Scalable Analytics Infrastructure

Reduced ingest run time by 90% and cloud costs by 80%

Improved customer matching from 60+ minutes to under 5

Works in data & AI. Designed and implemented medallion architecture pipelines using PySpark on Databricks (Delta format) and DBT on Snowflake, transforming raw into clean, reliable insights. Built a migration pipeline for a national charity using Airflow and AWS Glue (Spark), transforming multi-source data into Iceberg tables on S3 and populating a Dockerised MDM solution on ECS, integrated with Snowflake and Salesforce. Led infrastructure design across Azure, including Functions, Container Apps, Lake, Blob Storage, APIM, CosmosDB, Key Vault and VNet, fully automated using Terraform and GitHub Actions. Additional listed skills include Azure Lake.

Open to offers

Open to new opportunities

Skills
Tech stack
Apache AirflowApache Airflow
Amazon S3Amazon S3
AWS GlueAWS Glue
Apache SparkApache Spark
DockerDocker
AWSAWS
dbtdbt
SnowflakeSnowflake
PythonPython
SQLSQL
Microsoft AzureMicrosoft Azure
TerraformTerraform
FastAPIFastAPI
Tools & workflows
Architecture
Data Analytics
Data Warehousing (DWH)
Azure Data Lake
Data Modeling
Data Pipelines
GitHub
Work experience
· 8 roles

Lead Engineer

Company hidden · under 1 year

Data Engineering Lead

Company hidden · under 1 year

Senior Engineer (Data Pipelines & Leadership)

Company hidden · under 1 year

Technical Lead - Technology

Company hidden · under 1 year

Lead Engineer

Company hidden · 3-5 years

Data Systems Engineer

Company hidden · 1-3 years

Product Design Engineer

Company hidden · 5-10 years

Mechanical Design Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • education· 3

Similar available Data Engineers

View all