Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
oceanmyth1's avatar
@oceanmyth1

Data Engineer, AI-Driven Data Pipeline Optimization

$9,000/mo

Palo Alto, CA

Experience: 4 yearsOpen to: Palo Alto, CA·

Wigi highlights

3+ years, currently working as Mid-level Engineer

Improved multi-label classification performance by 42% with DistilBERT

Designed a resume-job pipeline that boosted matching scores by 17%

As a science intern, they enhanced an ETL pipeline using Python-based regex and an NER model, ensuring high-quality data in PostgreSQL, reducing database usage by 28% and improving job recommendations. In another role, built a personnel risk-level classification model using LightGBM in Python, handling highly imbalanced data with SMOTE and Tomek Links and achieving an AUC exceeding 0.8.

An OOD detection approach using the CLIP vision-language model with positive-and-negative prompt learning in PyTorch was also engineered, optimizing class-specific prompts on an ImageNet-100 dataset to achieve 97.79% AUC. They also customized genetic algorithm modules for FJSP using Geatpy in Python, cutting computation time by 45% to 82% compared to an MIP solver and delivering high-quality results for medium-to-large scale problems (up to 1000 jobs) in industrial applications.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
PyTorchPyTorch
SQLSQL
PythonPython
C++C++
MySQLMySQL
RR
MATLABMATLAB
Tools & workflows
Data Architecture
Computer Vision (CV)
Reinforcement Learning (RL)
ETL
AWS SageMaker
Recommender Systems
Big Data Systems
Artificial Intelligence (AI)
Natural Language Processing (NLP)
Data Science
Large Language Models (LLM)
Medical Imaging
Machine Learning (ML)
Work experience
· 5 roles

Data Systems Engineer

Company hidden · 1-3 years

Data Science Intern

Company hidden · under 1 year

OOD Research Initiative

Company hidden · under 1 year

Research Assistant

Company hidden · 1-3 years

ML Engineer + Data Analytics Intern

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 6
  • education· 2

Similar available Data Engineers

View all