Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
dawnoni's avatar
@dawnoni

Senior Data Engineer, Cloud Data Systems Optimization

$10,400/mo

Philadelphia, PA

Experience: 10+ yearsOpen to: Philadelphia, PA·

Wigi highlights

11+ years, currently operating as Senior Data Engineer

Led large-scale data migration to Azure using Snowflake

Implemented real-time data processing with Kafka and Spark Streaming

As part of the current role, designed and implemented a self-hosted integration runtime in Azure Data Factory, facilitating seamless data transfer from multiple sources such as SQL databases, Oracle databases, CSV files and REST APIs into Azure Blob Storage. They also developed interactive Power BI dashboards, delivering real-time insights into business metrics and enhancing decision-making across teams.

In a previous role, also spearheaded CI/CD processes in Azure DevOps, automating ETL pipeline deployments and ensuring version control and collaboration across teams. Advanced optimization techniques in Databricks Spark, such as partitioning, caching and compression, were implemented to boost performance and scalability of big data workflows.

Open to a signing bonus

For the right offer and opportunity, it will happen.

+ $5,000 signing bonus
Skills
Tech stack
SQLSQL
Microsoft AzureMicrosoft Azure
AWSAWS
Microsoft Power BIMicrosoft Power BI
Amazon RedshiftAmazon Redshift
Azure Data FactoryAzure Data Factory
PythonPython
Tools & workflows
ETL
T-SQL
Databases
DevOps
SSRS
Data Maintenance
Data Architects
Data Architecture
Operational Efficiency
Data Storage
Auto Scaling
Error Analysis
Azure Data Lake
Work experience
· 3 roles

Senior Big Data Engineer

Company hidden · 3-5 years

Data Systems Engineer

Company hidden · 3-5 years

ETL Developer, SSIS

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • education· 1

Similar available Data Engineers

View all