
Apache Spark Data Engineer, Also Skilled in Apache Airflow
Odesa
Wigi highlights
4+ years, currently working as Mid-level Apache Spark Data Engineer
Built and managed scalable ETL/ELT pipelines with Python and Airflow
Implemented new Big Data processing approaches with Spark and Databricks
In the current role, developed an internal tool for automated data profiling and in-depth data visualization, reducing manual analysis effort, and designed, created and maintained data models for external data sources to support downstream analytics and reporting.
In a previous role, they also developed and maintained ETL pipelines using Python and PostgreSQL to process and transform structured data. Separate work as a data parsing specialist involved automating data ingestion processes using Python and Selenium to collect and structure web data for downstream analytics. General capabilities include Algorithms, Data Structures and Design Patterns.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- projects· 1
- certifications· 9
- education· 2
Similar available Data Engineers
View all- Data Engineer (Solutions De Données Massives) · Paris, France · 6 Yrs Exp · Remote · $7,300/mo
- Data Engineer & Tech Lead · Katowice, Poland · 10+ Yrs Exp · Remote · $3,900/mo
- Data Engineer (Scalable Pipeline Engineering) · Kyiv, Ukraine · 4 Yrs Exp · Remote · $2,800/mo
- Enterprise Data Integration Engineer · Hamburg, Germany · 8 Yrs Exp · Hybrid · $7,000/mo
- Data Engineer, Enterprise-Scale Data Processing Pipelines · Jena, Germany · 4 Yrs Exp · Remote · $5,500/mo