Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
lynxcarpenter's avatar
@lynxcarpenter

Senior Enterprise-Scale Data Transformation Engineer

$3,900/mo· Negotiable

Warsaw

Experience: 8 yearsOpen to: Warsaw·

Wigi highlights

8+ years, currently Senior Enterprise-Scale Data Transformation Engineer

Refactored code and optimized SQL queries, reducing execution times

Improved data processing efficiency by refactoring legacy code

In the current role, developed and maintained efficient, scalable ETL pipelines using Python and Spark in Azure Databricks to process large volumes of tax data, and designed Medallion architecture to improve data quality.

In a previous role, they also developed and maintained efficient, scalable ETL pipelines using Python and Spark to process large volumes of data. Separate contributions included writing Scala and Spark jobs and ETL for big data processing. General capabilities include Azure Architecture, Azure DevOps Services, Azure Management, Docker and Infrastructure Management.

Open to offers

Open to new opportunities

Skills
Tech stack
CopilotCopilot
Microsoft AzureMicrosoft Azure
PythonPython
SQLSQL
DockerDocker
Apache SparkApache Spark
Tools & workflows
GitHub
Prompt Engineering
Azure DevOps Services
Large Language Models (LLM)
Cloud Concepts
Azure Architecture
Azure Management
Infrastructure Management
Database Management
Azure Databricks
Data Engineering
Big Data
ETL
Work experience
· 5 roles

Senior Big Data Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

SMM Strategist

Company hidden · 5-10 years

Data Systems Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 7
  • education· 2

Similar available Data Engineers

View all