Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
rovermechanic's avatar
@rovermechanic

Data Integration Engineer (Scalable ETL Pipelines)

$6,000/mo

London

Experience: 7 yearsOpen to: London·

Wigi highlights

7+ years, currently operating as Mid-level Data Integration Engineer

Developed Azure Data Factory pipelines for ADLS and Snowflake

Built AWS Glue and Lambda ETL pipelines for S3 data

In a previous role, built scalable data pipelines using GCP Dataflow and Apache Beam for both streaming and batch processing, and migrated legacy Hadoop workloads to GCP, integrating with BigQuery to enhance analytics performance and reduce infrastructure costs.

Separate work involved building and optimising ETL pipelines using Python and Hive SQL to integrate and process large volumes of claims and policy data, and configuring AWS infrastructure (EC2, S3, RDS) for application hosting, storage and database.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
Azure Data FactoryAzure Data Factory
Azure DevOpsAzure DevOps
PythonPython
Amazon S3Amazon S3
Microsoft Power BIMicrosoft Power BI
Tools & workflows
Azure Databricks
PySpark
Data Lake
Work experience
· 4 roles

Azure ETL Engineer

Company hidden · 1-3 years

AWS Big Data Engineer

Company hidden · under 1 year

Big Data Engineer

Company hidden · 1-3 years

Cloud Systems Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • education· 1

Similar available Data Engineers

View all