
Data Engineer, Automating Data Pipelines for Analytics
Kyiv
Wigi highlights
4+ years, currently working as Mid-level Data Engineer
Cuts processing time for specific cases from days to hours
Improves frameworks to reduce duplicated effort
Orchestrates and automates data workflows using Apache Airflow, balancing scraping speed with ethical load on source systems; owns country-specific datasets end-to-end, partnering with analysts to resolve data quality issues and meet client requirements.
In a previous role, performed web scraping and data analysis/cleaning tasks, including searching for new data sources, extracting data, processing it and organizing the resulting files in the main index. They used Python, Scrapy, Pandas, Jupyter Notebook and Elasticsearch for those tasks.
Available now
Ready to start immediately. No notice period. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- certifications· 2
- education· 2
- Files· 2
Similar available Data Engineers
View all- Data Engineer (Real-Time Analytics Pipelines) · Białystok, Poland · 10+ Yrs Exp · Remote · $5,100/mo
- Data Engineer (Real-Time Well Analytics) · Nowy Sącz, Poland · 10+ Yrs Exp · On-site · $4,900/mo
- Senior Data Engineer (Data-Driven Campaign Optimization) · Amersfoort, Netherlands · 10+ Yrs Exp · On-site · $5,400/mo
- Data Engineer (Scalable Analytics Pipelines) · Paterson, NJ · 6 Yrs Exp · Remote · $11,300/mo
- Enterprise Data Enablement Engineer · Warsaw, Poland · 6 Yrs Exp · Hybrid · $3,800/mo