Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
flyingnausicaa's avatar
@flyingnausicaa

Senior Data Engineer, Enterprise-Scale Retail Analytics

$4,500/mo

Singapore

Experience: 7 yearsOpen to: Singapore·

Wigi highlights

7+ years, currently working as Senior Data Engineer

Cut Azure Data Factory processing time by 40%

Implemented a cluster change, cutting overall costs by 30%

Migrated an end-to-end ETL process from on-premise SSIS to Azure cloud for a major retail convenience store client; converted pre-existing on-premise stored procedures to 300+ Databricks notebook codes using Python, PySpark and Spark SQL.

Created Python scripts to transform extracted data into an established normalized form with necessary keys as part of a database normalization exercise using Azure Synapse Analytics; involved in migrating and setting up relevant data and configuration files from an on-premises SQL database to Azure Data Lake Storage and Azure Data Explorer.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
SQLSQL
Azure Data FactoryAzure Data Factory
PythonPython
Apache SparkApache Spark
Microsoft AzureMicrosoft Azure
Microsoft Power BIMicrosoft Power BI
Tools & workflows
ETL
Azure Data Lake
IT
Azure Databricks
Work experience
· 6 roles

Senior Big Data Engineer

Company hidden · under 1 year

Senior Big Data Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

Consulting Advisor

Company hidden · 1-3 years

Senior Systems Developer

Company hidden · under 1 year

Systems Design Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 12
  • education· 2

Similar available Data Engineers

View all