
Senior Data Engineer (Scalable Cloud Data Pipelines)
Athens
Wigi highlights
17+ years, most recently Senior Data Engineer
Implemented a Kafka → Spark Structured Streaming → PostgreSQL pipeline
Built a Docker-based data engineering platform with Spark and Kafka
As a senior big data engineer, they designed and implemented the DataBridge framework, a reusable Airflow-based platform for configurable data extraction, transformation and export workflows. Developed automated SFTP and Amazon S3 ingestion pipelines, performing file validation, data transformations and cloud-based delivery processes.
In an earlier role, also developed automation tools and scripts to reduce manual operational effort and improve operational efficiency. Other work included developing automation scripts and process improvements to increase team efficiency. General capabilities include Apache Hadoop, Azure Databricks, Delta Lake and ETL.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- projects· 1
- certifications· 1
- education· 3
Similar available Data Engineers
View all- Senior Python Data Engineer / Cloud · Eindhoven, Netherlands · 10+ Yrs Exp · On-site · $5,800/mo
- Geodata Engineer / FME Server & ArcGIS Enterprise · Leeuwarden, Netherlands · 10+ Yrs Exp · Hybrid · $5,300/mo
- Data Engineer (Spatial Data Pipelines) · Lille, France · 4 Yrs Exp · Remote · $5,500/mo
- Data Engineer, Data Pipeline Optimization · Lille, France · 9 Yrs Exp · Remote · $5,800/mo
- Data Engineer, Optimizing Supply Chain Data Flows · Manchester, UK · 7 Yrs Exp · Remote · $5,000/mo