
Data Integration Engineer (Scalable ETL Pipelines)
London
Wigi highlights
7+ years, currently operating as Mid-level Data Integration Engineer
Developed Azure Data Factory pipelines for ADLS and Snowflake
Built AWS Glue and Lambda ETL pipelines for S3 data
In a previous role, built scalable data pipelines using GCP Dataflow and Apache Beam for both streaming and batch processing, and migrated legacy Hadoop workloads to GCP, integrating with BigQuery to enhance analytics performance and reduce infrastructure costs.
Separate work involved building and optimising ETL pipelines using Python and Hive SQL to integrate and process large volumes of claims and policy data, and configuring AWS infrastructure (EC2, S3, RDS) for application hosting, storage and database.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- education· 1
Similar available Data Engineers
View all- Data Engineer, Optimizing Supply Chain Data Flows · Manchester, UK · 7 Yrs Exp · Remote · $5,000/mo
- Data Engineer | Databricks Products & Azure Databricks · Timișoara, Romania · 10+ Yrs Exp · Hybrid · $2,300/mo
- Senior Lead - Data Engineering (Microsoft Azure, Microsoft SQL Server) · Szczecin, Poland · 10+ Yrs Exp · On-site · $4,500/mo
- Enterprise Data Analytics Engineer (Microsoft Azure, Microsoft Power BI) · Kielce, Poland · 10+ Yrs Exp · Hybrid · $3,600/mo
- Data Engineer (Legacy-To-Cloud Migration) · Porto, Portugal · 10+ Yrs Exp · Remote · $2,800/mo