AI terms starting with L
Every term in this glossary whose name begins with L, each with a one-paragraph definition you can read without opening the page.
Terms
AI terms starting with L
latency
The wall clock time between a request and the answer, split into time to first token (prefill) and inter-token latency (decode).
logprobs
The log probability of each output token, plus optional top alternatives at each position. Exponentiate a logprob to get the probability the model gave that token.