
Senior Data Engineer, Enterprise-Scale Retail Analytics
Singapore
Wigi highlights
7+ years, currently working as Senior Data Engineer
Cut Azure Data Factory processing time by 40%
Implemented a cluster change, cutting overall costs by 30%
Migrated an end-to-end ETL process from on-premise SSIS to Azure cloud for a major retail convenience store client; converted pre-existing on-premise stored procedures to 300+ Databricks notebook codes using Python, PySpark and Spark SQL.
Created Python scripts to transform extracted data into an established normalized form with necessary keys as part of a database normalization exercise using Azure Synapse Analytics; involved in migrating and setting up relevant data and configuration files from an on-premises SQL database to Azure Data Lake Storage and Azure Data Explorer.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 12
- education· 2
Similar available Data Engineers
View all- AWS Lambda Data Engineer (AWS Glue) · Parla, Spain · 9 Yrs Exp · Remote · $2,900/mo
- Data Engineer, Optimizing Real-Time Data Pipelines · Kyiv, Ukraine · 8 Yrs Exp · Remote · $2,800/mo
- Senior Terraform & API-Entwicklung Data Engineer · Hanover, Germany · 10+ Yrs Exp · Remote · $5,800/mo
- Data Engineer (Microsoft Power BI, SQL) · Iași, Romania · 10+ Yrs Exp · Remote · $2,400/mo
- Senior Data Engineer (Real-Time Analytics) · Singapore · 2 Yrs Exp · Remote · $3,900/mo