Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
pythonguava's avatar
@pythonguava

Data Engineer, Data Pipelines For Real-Time Analytics

$4,500/mo

Lisbon

Experience: 8 yearsOpen to: Lisbon·

Wigi highlights

7+ years, currently working as Senior Engineer

Cut manual anomaly detection effort by 40% with ML and NLP models

Automated data extraction from 50+ web sources, cutting manual collection time by 95%

In an earlier role, designed, developed and maintained a business-critical ETL process with Airflow and Spark, processing data for over 5 million mobile-app customer accounts. They also constructed and automated end-to-end pipelines feeding a personalized product recommendation engine, contributing to a 15% uplift in user engagement.

Separate contributions included engineering and deploying scalable pipelines using Kafka and Flink to ingest and process terabytes of data daily for 5G network testing and analysis. Other work involved developing and maintaining scalable pipelines on GCP to power a unified conversational AI platform for food ordering, processing large volumes of data for real-time model responses.

Open to offers

Open to new opportunities

Skills
Tech stack
TerraformTerraform
dbtdbt
PythonPython
Apache AirflowApache Airflow
Apache KafkaApache Kafka
MongoDBMongoDB
ElasticsearchElasticsearch
FastAPIFastAPI
DatabricksDatabricks
Apache SparkApache Spark
SQLSQL
SnowflakeSnowflake
DockerDocker
Tools & workflows
Software Engineering Practices
Apache Flink
Machine Learning (ML)
Deep Learning (DL)
Data Science
GCP
GitHub
Work experience
· 7 roles

Data Systems Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · under 1 year

Data Systems Engineer

Company hidden · 1-3 years

Data Systems Engineer

Company hidden · 1-3 years

Code Engineer

Company hidden · 1-3 years

Seasonal Laborer

Company hidden · under 1 year

Machine Learning Study Group Teaching Assistant

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • certifications· 15
  • education· 2

Similar available Data Engineers

View all