Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
laraarray's avatar
@laraarray

Junior Big Data Engineer (Cloud-Based ETL Pipelines)

$3,000/mo

Lviv

Experience: 5 yearsOpen to: Lviv·

Wigi highlights

5+ years, currently operating as Junior Big Data Engineer

Developed a Spark ETL job using Databricks notebooks

Built a Spark Structured Streaming app with Auto Loader

Implemented Kafka Streams jobs that can read data from Kafka topics and perform various transformations on the data; implemented a Python tool to parse an existing codebase and build data lineage based on SQL code.

Created delta tables using data from multiple sources; crafted SQL queries to extract, analyze and manipulate data from various databases. Their general capabilities include AWS, Big Data, Cloud Computing, Grafana and Java.

Open to offers

Open to new opportunities

Skills
Tech stack
AWSAWS
Azure Data FactoryAzure Data Factory
Apache SparkApache Spark
Apache KafkaApache Kafka
SQLSQL
PythonPython
GrafanaGrafana
Microsoft AzureMicrosoft Azure
ScalaScala
MySQLMySQL
JavaJava
Apache HadoopApache Hadoop
Tools & workflows
Azure Databricks
PySpark
Big Data
Research
Cloud Computing
Object-Oriented Programming (OOP)
MapReduce
Work experience
· 5 roles

Middle-Level Big Data Engineer

Company hidden · 1-3 years

Middle-Level Big Data Engineer

Company hidden · under 1 year

Middle-Level Big Data Engineer

Company hidden · under 1 year

Junior Data Pipeline Engineer

Company hidden · 1-3 years

Big Data Engineering Trainee

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 5
  • education· 2

Similar available Data Engineers

View all