Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
aviordormouse's avatar
@aviordormouse

Data Engineer (Cloud-Native Pipelines)

$10,900/mo

Minneapolis, MN

Experience: 10+ yearsOpen to: Minneapolis, MN·

Wigi highlights

9+ years, currently working as Senior Data Engineer

Led data warehouse implementation, improving query performance by 60%

Automated ETL and Spark integration, cutting manual processing time by 50%

Loads decades worth of historical data into a cloud data warehouse for analysis; transformed data from on-prem Teradata and Hadoop systems to cloud-based platforms and cloud storage for seamless integration.

In a previous role, developed, deployed and maintained ETL processes to integrate data from SQL Server, flat files, Excel and other databases into data warehouses, and configured SSIS for full and incremental data loading using CDC mechanisms and timestamp-based processing.

Open to offers

Open to new opportunities

Skills
Tech stack
Azure Key VaultAzure Key Vault
Azure FunctionsAzure Functions
Azure SQLAzure SQL
PythonPython
Azure Synapse AnalyticsAzure Synapse Analytics
Apache AirflowApache Airflow
Tools & workflows
Azure DevOps Server
Data Architects
Data Maintenance
Azure Data Lake
OpenAI API
Large Language Models (LLM)
Azure ML Studio
SDLC
Data Warehouse Architecture
Cloud Services
Google Dataproc
Data Warehousing (DWH)
Query Languages
Big Data Analytics
Work experience
· 2 roles

Data Engineer, ETL and API Developer

Company hidden · 5-10 years

Research Assistant (Graduate)

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 1
  • education· 2

Similar available Data Engineers

View all