Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
kelpieturn's avatar
@kelpieturn

Data Architect for Scalable Analytics Infrastructure

$7,200/mo

Frankfurt

Experience: 10+ yearsOpen to: Frankfurt·

Wigi highlights

11+ years, currently operating as Senior Data Architect

Architected a Medallion Architecture ingesting multi-million records daily

Built PySpark ETL pipelines, cutting processing time by 35%

Automated orchestration and monitoring via AWS Glue and CloudWatch, achieving 99.5% pipeline reliability and reducing incident resolution time by 25%. Evaluated and introduced Spark tuning, partitioning strategies and reusable pipeline components, cutting compute costs by 30% and supporting future AI/agent-based workloads.

Migrated terabytes of on-premise data to Azure Databricks using Medallion Architecture (Bronze/Silver/Gold) with Delta Lake, reducing infrastructure dependency by 60%. Designed Power BI data models and dashboards with optimised refresh cycles, reducing reporting latency by 30% and accelerating data-driven business decision-making. Their general capabilities include Agile Methodologies, Artificial Intelligence (AI) and Containerization.

Open to offers

Open to new opportunities

Skills
Tech stack
PythonPython
MySQLMySQL
Oracle DatabaseOracle Database
PuTTYPuTTY
WinSCPWinSCP
Tools & workflows
Data Extraction
Artificial Intelligence (AI)
Hortonworks
Agile Methodologies
Data Exploration & Visualization
Data Warehousing (DWH)
Data Ingestion
Containerization
Orchestration
Data Profiling
Data Quality & Governance
Database Management Systems (DBMS)
Work experience
· 3 roles

Data Systems Designer

Company hidden · 3-5 years

Senior Big Data Engineer

Company hidden · 5-10 years

Data Systems Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • projects· 4
  • certifications· 6
  • education· 2

Similar available Data Architects

View all