Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
polarispanda's avatar
@polarispanda

Databricks & Azure Data Factory Data Engineer

$3,400/mo

Lisbon

Experience: 8 yearsOpen to: Lisbon·

Wigi highlights

8+ years, currently operating as Mid-level Data Engineer

Built end-to-end ingestion pipelines with Azure Data Factory and Snowflake

Migrated ADF pipelines to a unified model with Unity Catalog Delta tables

As part of the current role, complex data orchestration processes across Azure Data Factory and Databricks are documented and mapped using Excel, tracing data from SAP and Pegasus sources to storage systems including Data Lake, SQL Server, PostgreSQL and Hive Metastore to clarify execution order, dependencies and end-to-end data lineage. They also refactored Databricks notebooks executed by Azure Data Factory pipelines, shifting data outputs from Data Lake to Unity Catalog to improve governance, lineage and consistency.

In an earlier role, also developed Proof of Concepts (POCs) to apply and enhance cloud computing skills and comprehensive Microsoft Fabric content.

Open to offers

Open to new opportunities

Skills
Tech stack
SnowflakeSnowflake
DatabricksDatabricks
Microsoft FabricMicrosoft Fabric
Azure Data FactoryAzure Data Factory
Microsoft AzureMicrosoft Azure
PythonPython
SQLSQL
Tools & workflows
snowlfake
Big Data
AWS SageMaker
Azure Data Fabric
Scrum
Agile Methodologies
Azure Databricks
ETL
Sales
Machine Learning (ML) Algorithms
Critical Thinking
Work experience
· 4 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · under 1 year

Pharma Clinical Specialist

Company hidden · 1-3 years

Pharma Clinical Specialist

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • certifications· 13
  • education· 2

Similar available Data Engineers

View all