Evaluation
A/B Evaluation
Evaluation· Intermediate
Definition
A method for comparing two AI system versions by presenting outputs side-by-side to human raters who select the preferred response. A/B evaluation provides direct preference signal — the primary method for comparing LLM quality and the core feedback mechanism in RLHF training pipelines.
Tags
#comparison#preference#RLHF#quality#human-feedback
MS
Maxx Stacks Editorial
Reviewed by enterprise AI practitioners
Maxx University
Keep learning. Keep building.
250+ terms. 5 learning paths. AI maturity assessment. Jargon translator. All free, always.