Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
asteropeplayer's avatar
@asteropeplayer

Data Engineer (Scalable Cloud Pipelines)

$5,700/mo

The Hague

Experience: 7 yearsOpen to: The Hague·

Wigi highlights

7+ years, currently working as Mid-level Data Engineer

Migrated Prefect 2 to Prefect 3 and Prefect Cloud

Built a Scrapy web scraper for unstructured company data

In the current role, ETL workflows were built and maintained to process and transform large datasets into a structured PostgreSQL database for downstream analytics and product use. They also designed and maintained data storage and querying solutions leveraging AWS S3 and Athena for efficient access to large-scale datasets.

In a previous role, also designed and executed comprehensive test plans, providing critical insights to drive continuous software improvement. Modernizing existing software improved functionality and usability. Skills include Database Administration, Django, FastAPI, Linux and Pandas.

Open to offers

Open to new opportunities

Skills
Tech stack
PydanticPydantic
Amazon S3Amazon S3
Amazon AthenaAmazon Athena
FastAPIFastAPI
AWSAWS
PandasPandas
PostgreSQLPostgreSQL
DjangoDjango
PythonPython
LinuxLinux
Tools & workflows
pytest
ETL
Prefect Dataflow Automation
Data Pipelines
Database Administration
Computer Hardware
Back-End Web Development
Problem Solving
Web Scraping
Work experience
· 5 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Youth Soccer Coach

Company hidden · 3-5 years

Project Management Lead

Company hidden · 1-3 years

Customer Service Associate

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 4
  • education· 1

Similar available Data Engineers

View all