Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
fierymesh's avatar
@fierymesh

Lead Data Engineer

$3,100/mo

Kyiv

Experience: 10+ yearsOpen to: Kyiv·

Wigi highlights

9+ years, currently working as Lead Data Engineer

Built a lineage service to parse Spark execution plans

Orchestrated a Databricks job to collect ticket creation metadata

In the current role, migrated workflows from Spark on EKS and Flink to the Databricks platform, ensuring optimal performance and reliability. During a previous tenure, they also designed, developed and maintained scalable data pipelines using Spark and Scala.

Other work included optimizing Spark job performance through advanced tuning strategies and implementation of best practices. Also designed and implemented an API to generate support tickets based on metric thresholds, adhering to corporate templates. The listed skills include Amazon DynamoDB, Amazon Redshift and Amazon S3.

Open to offers

Open to new opportunities

Skills
DatabricksDatabricks
Amazon RedshiftAmazon Redshift
AWS GlueAWS Glue
Amazon DynamoDBAmazon DynamoDB
TerraformTerraform
Microsoft AzureMicrosoft Azure
ElasticsearchElasticsearch
MongoDBMongoDB
PandasPandas
AWSAWS
PythonPython
SQLSQL
ScalaScala
Apache SparkApache Spark
Amazon S3Amazon S3
Apache AirflowApache Airflow
PostgreSQLPostgreSQL
GitGit
NumPyNumPy
KibanaKibana
Work experience
· 13 roles

Data Engineering Lead

Company hidden · under 1 year

Senior Big Data Engineer

Company hidden · 1-3 years

Data Engineer (Level 2)

Company hidden · under 1 year

Volunteer

Company hidden · under 1 year

Data Engineer (Level 2)

Company hidden · 1-3 years

Senior Data Insight Engineer

Company hidden · 1-3 years

Data Analysis Expert

Company hidden · under 1 year

Senior Data Insight Engineer

Company hidden · 1-3 years

Data Analysis Expert

Company hidden · under 1 year

Data Analysis Expert

Company hidden · under 1 year

Shipping Planning Executive

Company hidden · under 1 year

Data Analysis Expert

Company hidden · under 1 year

Financial Specialist Intern

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 10
  • education· 2

Similar available Data Engineers

View all