Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
jsonswift's avatar
@jsonswift

AI Data Evaluation Senior Specialist (RLHF & SFT)

$6,400/mo

Szczecin

Experience: 10+ yearsOpen to: Szczecin·

Wigi highlights

21+ years, currently working as AI Evaluation Senior Specialist

Design prompts and adversarial tests to evaluate model safety

Deploy local testing environments on dedicated RTX hardware

In the current role, they conduct rigorous quality audits of LLM outputs across creative, coding and logical reasoning domains, evaluating instruction-following, truthfulness (hallucinations), logic and formatting compliance. Drafting and optimizing multi-dimensional grading rubrics and evaluation guidelines ensures consistent high-quality human-feedback loops.

Separate responsibilities include evaluating and labeling high-volume multimedia (text, audio, video) under User-Generated Content (UGC) safety policies to flag hate speech, cyberbullying and dangerous activities. They also audit model responses to potentially toxic or harmful prompts, ensuring strict adherence to safety guidelines and preventing unsafe outputs. General capabilities include Information Security Policy, Natural Language and Neural Networks.

Available in 2 weeks

Ready to start in 2 weeks. Interview now. Actively looking.

Skills
Tech stack
PythonPython
Tools & workflows
Neural Networks
Large Language Models (LLM)
ISO 27001
Data Quality Assurance
Technical Writing
Regulatory Compliance
Natural Language
Linguistic Validation
Information Security Policy
Cybersecurity
Public Key Infrastructure (PKI)
Quality Assurance (QA)
Data Annotation
Generative AI
Prompt Engineering
Reinforcement Learning (RL)
Local LLMs
Work experience
· 7 roles

Senior AI Data Evaluation Specialist

Company hidden · 3-5 years

AI Safety and Policy Auditor

Company hidden · 5-10 years

Train Simulator Designer

Company hidden · under 1 year

Data Analyst

Company hidden · 3-5 years

IT Security & Compliance Officer - Governance Lead

Company hidden · 5-10 years

Product Consultant

Company hidden · 1-3 years

Product Consultant

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • certifications· 4
  • education· 1

Similar available Generative AI & LLM Engineers

View all