Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
comfyhyperion's avatar
@comfyhyperion

Researcher, LLM Evaluation — AMALIA Programme

$3,800/mo

Lisbon

Experience: 1 yearOpen to: Lisbon·

Wigi highlights

1+ year, currently working as Junior Researcher

Built AMALIA's reasoning-judging stage from scratch

Ran reproducible SLURM benchmarking across 20+ configurations

Custom vLLM and SGLang serving paths kept long reasoning traces inside budgets of 16k to 64k tokens, with GPU memory utilisation tuned up to give the KV cache enough headroom for traces that long; part of the judging ran through a commercial API where structuring the prompts around a shared prefix put ~98% of input tokens in cache and cut the bill accordingly.

In an earlier role, they also built forecasting models for unit production time, machine downtime and defect counts from raw textile process data. Separate work included benchmarking and optimising four distributed NoSQL databases (MongoDB, Cassandra, Aerospike, Redis) in C#/.NET.

Available now

Ready to start immediately. No notice period. Actively looking.

Skills
Tech stack
Microsoft AzureMicrosoft Azure
RR
GitGit
LinuxLinux
DuckDBDuckDB
SQLSQL
TensorFlowTensorFlow
XGBoostXGBoost
PythonPython
Tools & workflows
Recommender Systems
Classification
Cluster Analysis
DBSCAN
NoSQL
Microsoft Azure Machine Learning
Statistical Modeling
Time Series Analysis
scikit-learn
Large Language Models (LLM)
Model Evaluation
Work experience
· 3 roles

LLM Evaluation Researcher - AMALIA Programme

Company hidden · under 1 year

Data Science Analyst

Company hidden · under 1 year

Data Engineering Trainee

Company hidden · under 1 year

More on this profile

Unlocks when they connect with you.

  • projects· 4
  • certifications· 2
  • education· 3
  • Files· 1

Similar available Generative AI & LLM Engineers

View all