Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
octansneovim's avatar
@octansneovim

AWS & Apache Spark Backend Developer

$4,500/mo· Negotiable

Warsaw

Experience: 6 yearsOpen to: Warsaw·

Wigi highlights

6+ years, currently working as Junior AWS & Apache Spark Backend Developer

Built a PubMed data ingestion and processing pipeline

Created ETL and ELT pipelines for PostgreSQL and cloud storage

Built a data processing pipeline for ingesting, validating and updating GTFS and GTFS-Realtime datasets; implemented asynchronous data workflows using Celery to automate data collection and processing.

Implemented cloud-based data workflows using AWS services including S3, Glue, Athena and EMR Serverless; processed and analyzed NYC Taxi datasets using Pandas and PySpark, performing data cleaning, aggregation and feature engineering.

Open to offers

Open to new opportunities

Skills
Tech stack
PandasPandas
Apache SparkApache Spark
AWSAWS
SQLSQL
PythonPython
Tools & workflows
REST
Retrieval-Augmented Generation (RAG)
Data Engineering
Business Data Analysis
Business Analysis (BA)
Data Visualization
Big Data
Artificial Intelligence (AI)
Databases
ETL
Problem Solving
Processing of Data
Data Storage
Data Analysis
Work experience
· 1 role

Professional Chef

Company hidden · 5-10 years

More on this profile

Unlocks when they connect with you.

  • projects· 4
  • education· 2
  • Photos· 1

Similar available Backend Engineers

View all