Evaluation
Perplexity
Evaluation· Advanced
Definition
A measurement of how well a probability model predicts a sample — the exponentiated average negative log-likelihood per token. Lower perplexity means the model assigns higher probability to the actual text. Used to evaluate and compare language model quality on held-out test sets.
Tags
#language-modeling#probability#LLM#metrics#testing
MS
Maxx Stacks Editorial
Reviewed by enterprise AI practitioners
Maxx University
Keep learning. Keep building.
250+ terms. 5 learning paths. AI maturity assessment. Jargon translator. All free, always.