Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
lightyearpebble's avatar
@lightyearpebble

Senior Data Engineer (Scaling Analytics Pipelines)

$6,600/mo

Leicester

Experience: 8 yearsOpen to: Leicester·

Wigi highlights

7+ years, currently working as Senior Data Engineer

Designed and maintained ETL pipelines processing 2 TB weekly

Built an Azure Synapse Analytics data warehouse, cutting report generation time by 40%

Implemented secure data storage and governance using Azure Data Lake Storage, AWS S3 and AWS IAM policies; collaborated with statisticians to automate data quality validation workflows using Databricks and Apache Spark.

Designed and maintained ETL pipelines to gather data from multiple sources, including surveys, administrative databases, IoT devices and external datasets; designed and maintained data warehouses or data lakes for storing large volumes of structured and unstructured data.

Open to offers

Open to new opportunities

Skills
Tech stack
Azure Service FabricAzure Service Fabric
LinuxLinux
Azure Data FactoryAzure Data Factory
AWSAWS
Tools & workflows
Fabric Notebooks
Data Pipelines
OneLake
Dataflows
Delta Lake
Lakehouses
Microsoft Pureview
Microsoft Azure Fabric
Artificial Intelligence (AI)
Large Language Models (LLM)
Domain Architecture
Data Architects
Cloud Services
Cloud Infrastructure
Azure Data Lake
ETL
Work experience
· 3 roles

Senior Big Data Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 5-10 years

Azure ETL Engineer

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • certifications· 2
  • education· 2

Similar available Data Engineers

View all