
Data Engineer / Machine Learning & Deep Learning
Palo Alto, CA
Wigi highlights
6+ years, currently working as Senior Data Engineer
Led telemetry schema design and ETL pipeline management across 4 product teams
Manages data for 10m+ DAU and 200m+ users
In an earlier role, refactored the mettagrid training environment from a 2000-line monolith into a class hierarchy - MettaGridCore (C++ bindings), framework adapters (Gym, PettingZoo) and MettaGridPufferBase (training) - giving external researchers a clean interface while isolating internal training logic. They also built replay mining and dataset extraction pipelines for offline RL and behavioral analysis of agent simulations.
Separate work included managing an end-to-end real-time blockchain and user telemetry data streaming pipeline in GCP, refactored for efficiency using Docker, dbt, Airflow, SQL, BigQuery and CockroachDB. Led data-driven projects for large enterprise customers in AWS and GCP, utilizing Terraform and dbt to load data into BigQuery, Snowflake, Redshift and Databricks.
Available in 2 weeks
Ready to start in 2 weeks. Interview now. Actively looking.
Skills
Work experience
Unlocks when they connect with you.
- projects· 1
- certifications· 2
- education· 2
- Files· 4
Similar available Data Engineers
View all- Data Engineer Associate | Machine Learning & SQL · Singapore · 8 Yrs Exp · Hybrid · $4,400/mo
- Big Data Developer (Data Lakehouse Optimization) · New York City, NY · 5 Yrs Exp · Hybrid · $9,800/mo
- Data Engeneer - Inżynieria Danych & Zestawy Danych · Toruń, Poland · 10+ Yrs Exp · On-site · $3,500/mo
- Data Engineer (Scalable Data Platforms) · Aveiro, Portugal · 6 Yrs Exp · Hybrid · $3,000/mo
- Data Engineer, Financial Sector Data Pipelines · Ede, Netherlands · 10+ Yrs Exp · Remote · $7,500/mo