
@velvetrain7
Lead Data Integration Engineer, Enterprise Data Orchestration
$3,000/mo
Málaga
Wigi highlights
7+ years, currently working as Lead Data Integration Engineer
Migrated Airflow LocalExecutor to KubernetesExecutor and CeleryExecutor
Developed custom Airflow deferrable operators for async tasks
Optimized Airflow DAGs for resource efficiency, simplifying operators and ensuring idempotency; deployed Kubernetes apps with Helm and ArgoCD.
Other work included deploying applications using Helm/ArgoCD, including liveness/readiness probes, Horizontal Pod Autoscaler and High Availability, and creating ETL pipelines using Airflow.
Open to offers
Open to new opportunities
Skills
Tech stack
Tools & workflows
GitOps
Shell Scripts
Linux Systems Administration
Hardware Installation
GitHub
Computer Hardware Installation
Software Installation
Work experience
Unlocks when they connect with you.
- projects· 1
- certifications· 1
- education· 4
Similar available Data Engineers
View all- Data Engineer, Autonomous Driving Data Pipelines · Berlin, Germany · 4 Yrs Exp · Remote · $5,200/mo
- Data Engineer - Data Analysis & SQL · Lviv, Ukraine · 10+ Yrs Exp · Hybrid · $3,500/mo
- Senior Data Engineer - Medrio & Data Management · Stuttgart, Germany · 10+ Yrs Exp · Hybrid · $7,700/mo
- AI and Data Engineer (Microsoft Power BI, Azure Functions) · Sterling Heights, MI · 2 Yrs Exp · On-site · $7,900/mo
- Senior Lead Data Engineer & Vice President · Singapore · 10+ Yrs Exp · Remote · $11,800/mo