
Data Engineer (Scalable Cloud Pipelines)
The Hague
Wigi highlights
7+ years, currently working as Mid-level Data Engineer
Migrated Prefect 2 to Prefect 3 and Prefect Cloud
Built a Scrapy web scraper for unstructured company data
In the current role, ETL workflows were built and maintained to process and transform large datasets into a structured PostgreSQL database for downstream analytics and product use. They also designed and maintained data storage and querying solutions leveraging AWS S3 and Athena for efficient access to large-scale datasets.
In a previous role, also designed and executed comprehensive test plans, providing critical insights to drive continuous software improvement. Modernizing existing software improved functionality and usability. Skills include Database Administration, Django, FastAPI, Linux and Pandas.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- certifications· 4
- education· 1
Similar available Data Engineers
View all- Data Engineer, Autonomous Driving Data Pipelines · Berlin, Germany · 4 Yrs Exp · Remote · $5,200/mo
- Data Engineer - Data Analysis & SQL · Lviv, Ukraine · 10+ Yrs Exp · Hybrid · $3,500/mo
- Senior Data Engineer - Medrio & Data Management · Stuttgart, Germany · 10+ Yrs Exp · Hybrid · $7,700/mo
- AI and Data Engineer (Microsoft Power BI, Azure Functions) · Sterling Heights, MI · 2 Yrs Exp · On-site · $7,900/mo
- Senior Lead Data Engineer & Vice President · Singapore · 10+ Yrs Exp · Remote · $11,800/mo