Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
samuraivolume26's avatar
@samuraivolume26

Data Engineer, Automating Data Pipelines for Analytics

$2,300/mo

Kyiv

Experience: 4 yearsOpen to: Kyiv·

Wigi highlights

4+ years, currently working as Mid-level Data Engineer

Cuts processing time for specific cases from days to hours

Improves frameworks to reduce duplicated effort

Orchestrates and automates data workflows using Apache Airflow, balancing scraping speed with ethical load on source systems; owns country-specific datasets end-to-end, partnering with analysts to resolve data quality issues and meet client requirements.

In a previous role, performed web scraping and data analysis/cleaning tasks, including searching for new data sources, extracting data, processing it and organizing the resulting files in the main index. They used Python, Scrapy, Pandas, Jupyter Notebook and Elasticsearch for those tasks.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
GrafanaGrafana
Apache AirflowApache Airflow
DockerDocker
RabbitMQRabbitMQ
PythonPython
PostgreSQLPostgreSQL
Tools & workflows
GCP
Parallel Multithreaded Machine (PM2)
ETL
Interviewing
Jupyter
Data Processing
Scrapy Framework
Web Scraping
Data Analysis
Work experience
· 2 roles

Data Systems Engineer

Company hidden · 3-5 years

Python Backend Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 2
  • education· 2
  • Files· 2

Similar available Data Engineers

View all