
Lead QA Automation Engineer – AI/ML, LLM & AWS
Gdańsk
Wigi highlights
4+ years, currently operating as Lead QA Automation Engineer
Designs and maintains reusable Python/PyTest testing frameworks
Develops LLM evaluation pipelines using Promptfoo and LLM-as-a-judge
In the current role, they build and validate Retrieval-Augmented Generation (RAG) pipelines across ingestion, chunking, embeddings, retrieval, reranking, context construction and response generation, and define validation architecture for non-deterministic AI/ML and LLM systems, covering correctness, groundedness, factual consistency, hallucination risk, safety, robustness and conversational quality.
During a previous tenure, also designed and built automated test frameworks from scratch for AWS-based data pipelines and ETL workflows and developed and maintained automated test suites in Python, PyTest and AWS SDK to validate data transformations, schema consistency and end-to-end pipeline integrity.
Open to offers
Open to new opportunities
Skills
Work experience
Unlocks when they connect with you.
- projects· 4
- certifications· 2
- education· 1
Similar available Test Automation Engineers
View all- Test Automation Specialist (Automated Transaction Validation) · Charlotte, NC · 5 Yrs Exp · Remote · $5,200/mo
- QA Automation Engineer, Cross-Platform Reliability · Kharkiv, Ukraine · 10+ Yrs Exp · Remote · $2,200/mo
- Quality Assurance Test Engineer (Git, Oracle Database) · Stafford, VA · 10+ Yrs Exp · Hybrid · $9,400/mo
- QA Analyst - Agile Testing & Test Management · Oslo, Norway · 10+ Yrs Exp · Remote · $5,500/mo
- Senior Test Automation Engineer, Desktop & Web Testing · Wrocław, Poland · 10+ Yrs Exp · Remote · $3,100/mo