Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
wolfstarpigment's avatar
@wolfstarpigment

Enterprise Data Architect Engineer

$3,800/mo· Negotiable

Madrid

Experience: 10+ yearsOpen to: Madrid·

Wigi highlights

10+ years, currently operating as Mid-level Enterprise Architect Engineer

Designed and implemented migration project architecture

Implemented migration with Azure Datafactory and Databricks

In a previous role, constructed ELT and ETL pipelines extracting online activities, cleaning and assurance using Pyspark and loading into delta and parquet tables, and migrated code from Databricks to TSQL, passing from datalake into warehouse in Azure synapse analytics environment.

They also designed and implemented a network using microservices with Docker containers to host each service: Nginx web server, app server and database, and developed the API with REST principles using Python with Fast-API and object-oriented programming.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
DatabricksDatabricks
AWSAWS
Azure Data FactoryAzure Data Factory
Apache SparkApache Spark
FlaskFlask
SQLSQL
FastAPIFastAPI
PythonPython
Microsoft ExcelMicrosoft Excel
Tools & workflows
Data Maintenance
Problem Solving
Data Modeling
Data Processing
PySpark
Data Warehousing (DWH)
Azure Data Lake
ETL
Demand Planning
Data Analysis
Work experience
· 10 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Capstone Project Back-End Development Lead

Company hidden · under 1 year

Python Engineer - Airbnb Clone

Company hidden · under 1 year

Senior Demand Planner and Supply Chain Manager

Company hidden · 3-5 years

Consulting Advisor

Company hidden · 1-3 years

Data Analysis Expert

Company hidden · under 1 year

Freight Coordinator

Company hidden · 1-3 years

Project Coordinator Intern

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 1
  • certifications· 2
  • education· 5

Similar available Data Engineers

View all