
Big Data Platform Engineer
Kyiv
Wigi highlights
4+ years, currently operating as Mid-level Big Data Platform Engineer
Migrated key data pipelines to cloud platforms, reducing operational costs
Automated data orchestration with Data Build Tool, reducing operational overhead
In the current role, they develop a Java/Spring Boot internal Batch Management platform for running batch workloads on Kubernetes/EKS, including lifecycle management, persistent, idempotent launches, timeouts, retries/restarts, reconciliation, logs and events. Also developing a secure Data API Gateway in Java/Spring Boot for controlled access to analytical datasets in Doris/Trino, with metadata-driven configuration, OAuth2/JWT authorization, query validation, limits, timeouts and backend routing.
In a previous role, also improved data processing efficiency through optimizing Spark jobs and Snowflake configurations. They engineered solutions for data streaming from Kafka to Spark, processed and stored the data in Delta tables, registered these tables in Trino for efficient querying and integrated with Apache Superset for BI analytics and visualization.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- education· 1
- Files· 3
Similar available Data Engineers
View all- Data Engineer (Automatisation Des Pipelines De Traitement) · Lyon, France · 6 Yrs Exp · Remote · $6,400/mo
- Data Engineer | QOps Expert · Dnipro, Ukraine · 10+ Yrs Exp · On-site · $3,100/mo
- Data Integration Engineer (Scalable Cloud Infrastructure) · Copenhagen, Denmark · 8 Yrs Exp · Hybrid · $4,400/mo
- Junior Data Engineer, Enterprise-Scale Data Transformation · Vila Nova de Gaia, Portugal · 3 Yrs Exp · Remote · $3,700/mo
- Data Engineer (Optimizing Asset Valuation Workflows) · Kyiv, Ukraine · 10+ Yrs Exp · Remote · $2,300/mo