LLM Knowledge Base


A Logit refers to the raw, unnormalized output values produced by a classification model. These values are typically transformed through a function like the softmax function to produce probabilities. The term "logit" comes from logistic regression, where it refers to the log-odds of a probability. In deep learning, logits have a significant role in various loss functions and layers.