Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
foggytrie's avatar
@foggytrie

Enterprise Data Modernization Engineer

$5,500/mo

London

Experience: 4 yearsOpen to: London·

Wigi highlights

3+ years, currently Mid-level Enterprise Data Modernization Engineer

Cut ETL latency by 38% with a new enterprise data platform

Built an Azure data platform, cutting ETL latency by 35%

In a previous role as a data engineer, optimized PySpark-based big data pipelines on Azure Databricks to process millions of records from CosmosDB and S3, improving ETL performance by 45%. They also automated ETL testing and workflow monitoring using Python, reducing manual intervention by 50% and improving production stability.

As an Azure ETL Engineer, built and optimized PySpark-based ETL pipelines on Azure Databricks, reducing job runtimes by 40% across large-scale, multi-business-unit datasets. Automated testing frameworks in Python for data validation and modeling were also created, cutting manual testing effort by 45% and increasing production deployment confidence. Their general capabilities include Alteryx, Azure Data Factory, Microsoft Azure, Microsoft SQL Server and SQL.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
TableauTableau
SAPSAP
Microsoft SQL ServerMicrosoft SQL Server
Apache AirflowApache Airflow
GitGit
Microsoft AzureMicrosoft Azure
Azure Data FactoryAzure Data Factory
DatabricksDatabricks
Microsoft Power BIMicrosoft Power BI
PythonPython
SQLSQL
Azure DevOpsAzure DevOps
Tools & workflows
Azure Data Engineering
Data Warehousing & Delta Lake
Alteryx
SSIS
PySpark
Synapse
Delta Lake
Confidentiality & Data Protection
Work experience
· 8 roles

Data Systems Engineer

Company hidden · under 1 year

Azure ETL Engineer

Company hidden · 1-3 years

Junior Research Engineer

Company hidden · under 1 year

Scholarly Liaison

Company hidden · under 1 year

Campus Ambassador

Company hidden · under 1 year

Data Engineer

Company hidden · under 1 year

Data Analysis Associate Engineer

Company hidden · under 1 year

MSBI Development Intern

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 5
  • certifications· 15
  • education· 4

Similar available Data Engineers

View all