Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
nomadskater's avatar
@nomadskater

Senior Enterprise Data Infrastructure Engineer

$4,900/mo

Berlin

Experience: 7 yearsOpen to: Berlin·

Wigi highlights

7+ years, currently Senior Enterprise Data Infrastructure Engineer

Improved data efficiency by 30% with Python automation

Cut a Databricks workflow's run duration by 50% with checkpointing

In a previous role as a data systems engineer, they developed an Azure Synapse framework to implement SCD Type 2 for all tables, maintaining historical data in Azure Lakehouse, and remediated data quality issues by enabling logging and auditing and fixing the root cause.

Separate work as an application systems analyst included handling the end-to-end migration of various banking financial applications from IBM DataStage v.8.7 to v.11.7. Data extraction, transformation and loading from multiple file formats to Azure Data Storage services used Azure Data Factory, PySpark and Spark SQL.

Open to offers

Open to new opportunities

Skills
Tech stack
AWS Step FunctionsAWS Step Functions
AWS GlueAWS Glue
Amazon DynamoDBAmazon DynamoDB
ServiceNowServiceNow
FastAPIFastAPI
Tools & workflows
Solution Architecture
Prompt Design
Prompt Engineering
Chain of Thoughts
Few Shot Prompting
Zero Shot Prompting
Large Language Models (LLM)
Problem Solving
Databricks Products
Data Engineering
Batch Processing
DataStage
Incident Management
Agile Methodologies
Automation
Work experience
· 4 roles

Senior Big Data Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 3-5 years

Application Systems Analyst

Company hidden · 1-3 years

Associate Software Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 6
  • education· 1

Similar available Data Engineers

View all