
Databricks & Azure Data Factory Data Engineer
Lisbon
Wigi highlights
8+ years, currently operating as Mid-level Data Engineer
Built end-to-end ingestion pipelines with Azure Data Factory and Snowflake
Migrated ADF pipelines to a unified model with Unity Catalog Delta tables
As part of the current role, complex data orchestration processes across Azure Data Factory and Databricks are documented and mapped using Excel, tracing data from SAP and Pegasus sources to storage systems including Data Lake, SQL Server, PostgreSQL and Hive Metastore to clarify execution order, dependencies and end-to-end data lineage. They also refactored Databricks notebooks executed by Azure Data Factory pipelines, shifting data outputs from Data Lake to Unity Catalog to improve governance, lineage and consistency.
In an earlier role, also developed Proof of Concepts (POCs) to apply and enhance cloud computing skills and comprehensive Microsoft Fabric content.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 13
- education· 2
Similar available Data Engineers
View all- Data Engineer (Legacy-To-Cloud Migration) · Porto, Portugal · 10+ Yrs Exp · Remote · $2,800/mo
- Data Engineer, Fintech Data Modernization · Katowice, Poland · 5 Yrs Exp · Remote · $3,600/mo
- Python Data Engineer (Django, Git) · Kyiv, Ukraine · 5 Yrs Exp · On-site · $3,300/mo
- Senior Big Data Developer, Regulated Data Pipelines · Lviv, Ukraine · 9 Yrs Exp · Remote · $2,700/mo
- Data Engineer (Quantitative Risk Modeling) · Washington, DC · 6 Yrs Exp · Hybrid · $11,600/mo