Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
rohancopper's avatar
@rohancopper

Data Enginner (Big Data Pipeline Optimization)

$2,800/mo

Madrid

Experience: 10+ yearsOpen to: Madrid·

Wigi highlights

9+ years, currently working as Mid-level Data Engineer

Develops ETL/ELT pipelines with PySpark and Apache Spark

Designs Medallion architectures and Delta Lake solutions

Develops reusable notebooks and Databricks Workflows, automating ingestion and transformation processes; optimizes Delta tables with OPTIMIZE, ZORDER and VACUUM to improve query performance.

Optimizes Spark applications through partitioning, reducing shuffles, optimizing joins, caching, cluster tuning and parallelism; participates in migrating processes and business logic from a data platform to Databricks, ensuring functional equivalence and optimizing performance.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
Oracle DatabaseOracle Database
TrelloTrello
SAP HANASAP HANA
DockerDocker
MongoDBMongoDB
SQLSQL
PythonPython
Tools & workflows
Stratio
PySpark
Financial Services
Azure Databricks
Data Architects
Online Consulting
Analysis of Statistical Data
SAP Products
SAP FI
ETL
T-SQL
Relational Database
Data Analysis
Work experience
· 12 roles

Data Engineer

Company hidden · under 1 year

Azure Data Engineer and Analyst

Company hidden · 1-3 years

Data Scientist & QA Analyst

Company hidden · under 1 year

Commercial Pricing Analyst

Company hidden · 1-3 years

Export/Import Manager & Operations Lead

Company hidden · 3-5 years

E-commerce Supervisor

Company hidden · 1-3 years

Reception Department Manager

Company hidden · under 1 year

Hotel Front Desk Associate

Company hidden · under 1 year

Assembly Technician

Company hidden · under 1 year

Assembly Technician

Company hidden · under 1 year

Tourism Analytics and Intelligence Technician

Company hidden · under 1 year

Banking Assistant

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 15
  • education· 5
  • Files· 2

Similar available Data Engineers

View all