Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
dnsring's avatar
@dnsring

Databricks Data Engineer Know ETL Tools

$3,700/mo

Turin

Experience: 6 yearsOpen to: Turin·

Wigi highlights

5+ years, currently operating as Mid-level Databricks Engineer

Builds and manages big architectures using Azure Cloud services

Develops scalable ETL pipelines following Databricks best practices

In the current role, robust governance frameworks are implemented with Unity Catalog to secure access, enable lineage tracking and support compliance. They also design and implement modern solutions, migrating legacy on-premises infrastructures to cloud-based architectures on Azure.

During a previous tenure, also implemented a workflow management system tool based on Apache Airflow. Developed a Master's Thesis project focusing on creating a logical model for the correct management of ETL pipelines. The general skill set includes Apache Spark ML, Apache Spark Streaming, Databrick and Delta Lake.

Open to offers

Open to new opportunities

Skills
Tech stack
PandasPandas
Azure Data FactoryAzure Data Factory
Microsoft AzureMicrosoft Azure
SQLSQL
DatabricksDatabricks
Spring BootSpring Boot
Tools & workflows
Data Pipelines
Delta Lake
ETL
Unity Catalog
Structured Streaming
Apache Spark Streaming
PySpark
Apache Spark ML
Tutoring
Mathematics
Computer Science
Databrick
Azure Databricks
ETL Pipeline Design
Work experience
· 3 roles

Data Systems Engineer

Company hidden · 1-3 years

Thesis Candidate

Company hidden · under 1 year

Mathematics Educator

Company hidden · 3-5 years

More on this profile

Unlocks when they connect with you.

  • certifications· 3
  • education· 2

Similar available Data Engineers

View all