Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
arrivalsaluki72's avatar
@arrivalsaluki72

Junior Data Engineer | Azure Databricks & PySpark

$2,800/mo

Warsaw

Experience: 4 yearsOpen to: Warsaw·

Wigi highlights

3+ years, currently working as Junior Data Engineer

Led enterprise-wide product ID normalization, eliminating data mismatches

Built a PySpark/Python data quality framework with automated alerts

In the current role, resolved intricate 1-to-many relational bottlenecks in SAP BW/ERP metadata-driven workflows and automated data integrations by leveraging advanced Databricks SQL window functions and ranking logic (e.g. ROW_NUMBER, QUALIFY), eliminating data duplication across central data marts. They also engineered and executed complex schema evolutions on multibillion-row Delta tables using advanced SQL MERGE operations, implementing robust pre- and post-deployment scripts to guarantee zero downtime and data integrity.

In an earlier role, also led the onboarding of two new sales data providers - from specs and validation to API automation. Designed and implemented end-to-end ETL workflows in Azure Databricks using PySpark and SQL.

Open to offers

Open to new opportunities

Skills
Tech stack
Azure Data FactoryAzure Data Factory
Azure DevOpsAzure DevOps
GitGit
PythonPython
Microsoft ExcelMicrosoft Excel
SQLSQL
JiraJira
Tools & workflows
ETL/ELT
PySpark
Azure Databricks
Medallion Architecture
Data Modeling
Version Control
Salesforce.com
Coordination of Projects
Sales of Solutions
Data Analysis
PM
Databricks Products
Hadrone
Work experience
· 4 roles

Data Engineer (Junior)

Company hidden · 1-3 years

Data Analysis Expert

Company hidden · under 1 year

Executive Trainee

Company hidden · 1-3 years

Prospect Outreach Advisor

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 7
  • education· 4
  • Files· 1

Similar available Data Engineers

View all