
@octansneovim
AWS & Apache Spark Backend Developer
$4,500/mo· Negotiable
Warsaw
Wigi highlights
6+ years, currently working as Junior AWS & Apache Spark Backend Developer
Built a PubMed data ingestion and processing pipeline
Created ETL and ELT pipelines for PostgreSQL and cloud storage
Built a data processing pipeline for ingesting, validating and updating GTFS and GTFS-Realtime datasets; implemented asynchronous data workflows using Celery to automate data collection and processing.
Implemented cloud-based data workflows using AWS services including S3, Glue, Athena and EMR Serverless; processed and analyzed NYC Taxi datasets using Pandas and PySpark, performing data cleaning, aggregation and feature engineering.
Open to offers
Open to new opportunities
Skills
Tech stack
Tools & workflows
REST
Retrieval-Augmented Generation (RAG)
Data Engineering
Business Data Analysis
Business Analysis (BA)
Data Visualization
Big Data
Artificial Intelligence (AI)
Databases
ETL
Problem Solving
Processing of Data
Data Storage
Data Analysis
Work experience
Unlocks when they connect with you.
- projects· 4
- education· 2
- Photos· 1
Similar available Backend Engineers
View all- Backend Engineer (JavaScript, PostgreSQL) · London, UK · 3 Yrs Exp · Remote, Hybrid, On-site · $5,300/mo
- Senior Backend Developer (Docker, Node.js) · Kyiv, Ukraine · 5 Yrs Exp · On-site, Hybrid, Remote · $4,200/mo
- Lead Software Engineer / Scalable Backend Systems · Málaga, Spain · 10+ Yrs Exp · Remote · $5,100/mo
- Python Backend Engineer (PostgreSQL) · Reading, UK · 10+ Yrs Exp · On-site · $6,800/mo
- Senior .Net Back-end Developer — Scrum & Agile Methodologies · Kyiv, Ukraine · 10+ Yrs Exp · Remote · $3,700/mo