Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
breadthsweep's avatar
@breadthsweep

Python Backend Developer - Apache Airflow & Data Warehousing

$2,900/mo

Kraków

Experience: 1 yearOpen to: Kraków·

Wigi highlights

5 months, most recently Junior Python Backend Developer

Directed a data engineering team to deploy production-grade pipelines

Led a development team delivering high-load product features

In a previous role, implemented scalable, fault-tolerant ETL/ELT pipelines on AWS infrastructure to ingest and process high-throughput financial transactions, and architected pipeline development for parallel batch and stream data processing, implementing nightly batch extraction from production databases into AWS S3 buckets alongside real-time streaming of transaction logs via Apache Kafka using AWS Glue.

They also developed scalable, fault-tolerant FinTech applications deployed on AWS infrastructure. In a project, Grocery Store E-Check Parser is a data-processing pipeline that parses e-check receipts from grocery stores (for now only Polish grocery stores), transforms the data using a Spark engine running in Docker and loads structured results into a Google Sheet.

Open to offers

Open to new opportunities

Skills
Tech stack
Apache AirflowApache Airflow
Amazon RedshiftAmazon Redshift
SnowflakeSnowflake
AWS GlueAWS Glue
MongoDBMongoDB
FastAPIFastAPI
AWSAWS
GitLabGitLab
DockerDocker
Apache KafkaApache Kafka
Apache SparkApache Spark
SQLSQL
PythonPython
Tools & workflows
Databricks Products
Google API
ETL
Data Warehousing (DWH)
Data Modeling
Big Data
PySpark
Work experience
· 2 roles

Data Systems Engineer

Company hidden · under 1 year

Backend Engineer - Python

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 1
  • certifications· 2
  • education· 2

Similar available Backend Engineers

View all