Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
tpolmongo's avatar
@tpolmongo

Big Data Platform Engineer

$2,700/mo

Kyiv

Experience: 4 yearsOpen to: Kyiv·

Wigi highlights

4+ years, currently operating as Mid-level Big Data Platform Engineer

Migrated key data pipelines to cloud platforms, reducing operational costs

Automated data orchestration with Data Build Tool, reducing operational overhead

In the current role, they develop a Java/Spring Boot internal Batch Management platform for running batch workloads on Kubernetes/EKS, including lifecycle management, persistent, idempotent launches, timeouts, retries/restarts, reconciliation, logs and events. Also developing a secure Data API Gateway in Java/Spring Boot for controlled access to analytical datasets in Doris/Trino, with metadata-driven configuration, OAuth2/JWT authorization, query validation, limits, timeouts and backend routing.

In a previous role, also improved data processing efficiency through optimizing Spark jobs and Snowflake configurations. They engineered solutions for data streaming from Kafka to Spark, processed and stored the data in Delta tables, registered these tables in Trino for efficient querying and integrated with Apache Superset for BI analytics and visualization.

Open to offers

Open to new opportunities

Skills
Tech stack
MongoDBMongoDB
Spring FrameworkSpring Framework
ScalaScala
JavaJava
AWSAWS
FastAPIFastAPI
Microsoft SQL ServerMicrosoft SQL Server
Apache HiveApache Hive
MySQLMySQL
Amazon S3Amazon S3
dbtdbt
LinuxLinux
BashBash
Tools & workflows
Iceberg
ETL
Apache Superset
GCP
Presto
Azure Databricks
PySpark
Work experience
· 2 roles

Data Pipeline Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • education· 1
  • Files· 3

Similar available Data Engineers

View all