
@verselapwing
Senior Apache Spark Data Engineer - Database Design
$3,700/mo· Negotiable
Madrid
Wigi highlights
8+ years, currently working as Senior Apache Spark Data Engineer
Designed Python modules to automate the development flow
Created Databricks data flows in Python for Azure SQL tables
As a senior big data engineer, they transformed and loaded data using Apache Spark. In an earlier role as a SQL engineer, also created and maintained Informatica PowerCenter workflows.
Separate contributions included designing new EDI flows between various systems in formats like EDIFACT, JSON and XML and integrating client data into DB2 and Oracle databases.
Open to offers
Open to new opportunities
Skills
Tech stack
Tools & workflows
REST APIs
Azure Databricks
Database Design
Data Warehousing (DWH)
ETL
PL/SQL
ETL Pipeline Design
Consulting
Data Analysis
EDI
Databases
Work experience
Unlocks when they connect with you.
- education· 1
Similar available Data Engineers
View all- Enterprise Data Enablement Engineer · Warsaw, Poland · 6 Yrs Exp · Hybrid · $3,800/mo
- Lead Data Engineer / Scalable Analytics Solutions · Coimbra, Portugal · 5 Yrs Exp · Hybrid · $3,900/mo
- Data Engineer, Real Estate Data Platform · Lviv, Ukraine · 8 Yrs Exp · Remote · $2,300/mo
- Azure Data Engineer (Amazon RDS, Microsoft Azure) · Belfast, UK · 8 Yrs Exp · Remote · $6,300/mo
- Data Engineer - Anti-Fraud Detection · Nice, France · 2 Yrs Exp · Hybrid · $6,100/mo