Wigiwork — Remote Tech, AI & Fintech Talent MarketplaceWigiwork — Remote Tech, AI & Fintech Talent Marketplace
Log inSign up
violetsprite's avatar
@violetsprite

Lead QA Automation Engineer – AI/ML, LLM & AWS

$2,700/mo

Gdańsk

Experience: 5 yearsOpen to: Gdańsk·

Wigi highlights

4+ years, currently operating as Lead QA Automation Engineer

Designs and maintains reusable Python/PyTest testing frameworks

Develops LLM evaluation pipelines using Promptfoo and LLM-as-a-judge

In the current role, they build and validate Retrieval-Augmented Generation (RAG) pipelines across ingestion, chunking, embeddings, retrieval, reranking, context construction and response generation, and define validation architecture for non-deterministic AI/ML and LLM systems, covering correctness, groundedness, factual consistency, hallucination risk, safety, robustness and conversational quality.

During a previous tenure, also designed and built automated test frameworks from scratch for AWS-based data pipelines and ETL workflows and developed and maintained automated test suites in Python, PyTest and AWS SDK to validate data transformations, schema consistency and end-to-end pipeline integrity.

Open to offers

Open to new opportunities

Skills
LangfuseLangfuse
Apache AirflowApache Airflow
PrefectPrefect
AWS IAMAWS IAM
MongoDBMongoDB
RedisRedis
PythonPython
AWSAWS
DockerDocker
Amazon S3Amazon S3
AWS GlueAWS Glue
Amazon RedshiftAmazon Redshift
JiraJira
SQLSQL
PostmanPostman
JavaJava
JavaScriptJavaScript
SeleniumSelenium
GitGit
LinuxLinux
Work experience
· 6 roles

AI/ML-Driven QA Automation Lead

Company hidden · under 1 year

AWS Data Engineer

Company hidden · under 1 year

Lead QA Automation Engineer - AWS

Company hidden · under 1 year

QA Automation Team Lead

Company hidden · under 1 year

QA Specialist

Company hidden · under 1 year

Data Engineer and QA Engineer

Company hidden · 1-3 years

More on this profile

Unlocks when they connect with you.

  • projects· 4
  • certifications· 2
  • education· 1

Similar available Test Automation Engineers

View all