Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
turquoisevi's avatar
@turquoisevi

Senior Data Engineer (Real-Time Data Pipelines)

$7,600/mo

Manchester

Experience: 10+ yearsOpen to: Manchester·

Wigi highlights

10+ years, most recently Senior Data Engineer

Led Azure-to-GCP data migration, cutting costs 35% and speeding queries 50%

Launched an Azure data pipeline processing 5TB+ daily, cutting latency 45%

Automated ETL/ELT processes, cutting manual effort by 70% and reducing processing costs by $150K annually; engineered scalable data pipelines on Azure, processing 10TB+ of data weekly, improving throughput by 60%.

Executed a real-time data streaming solution using Azure Event Hubs and Databricks, accelerating processing by 50%; refined Azure Data Factory (ADF) workflows, boosting efficiency by 40% and reducing failure rates by 30%.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Azure FunctionsAzure Functions
Azure SQLAzure SQL
Microsoft AzureMicrosoft Azure
DatabricksDatabricks
Microsoft Power BIMicrosoft Power BI
JiraJira
ConfluenceConfluence
Azure Data FactoryAzure Data Factory
Tools & workflows
Computer Science
Azure Data Lake
Agile Methodologies
ETL Pipelines
ETL
Data Modeling
Azure Databricks
PySpark
Azure Synapse
Unity Catalog
Dashboard Building
Data Loading
Work experience
· 4 roles

Data Schema Designer

Company hidden · under 1 year

Senior Big Data Engineer

Company hidden · 1-3 years

Senior Big Data Engineer

Company hidden · 3-5 years

Data Analysis Expert

Company hidden · 5-10 years

More on this profile

Unlocks when they connect with you.

  • certifications· 1
  • education· 1

Similar available Data Engineers

View all