AI Concepts category
Prompting & Generation
Chain-of-Thought
Chain-of-thought is intermediate reasoning text generated as part of producing an answer, often elicited through prompting.
Context Window
A context window is the bounded amount of input and generated tokens a model can process in one request.
In-Context Learning
In-context learning is adapting model behavior through instructions or examples in the current request without updating model weights.
Structured Outputs
Structured outputs constrain model responses to a machine-readable structure, often specified with JSON Schema.
System Prompt
System prompts shape model behavior through instructions or context supplied apart from user input.
Temperature
Temperature adjusts the sharpness of the token probability distribution used during sampling.
Top-k Sampling
Top-k sampling restricts token selection to the fixed number of highest-probability candidates at each generation step.
Top-p Sampling
Top-p sampling restricts token selection to the smallest set of highest-probability tokens whose cumulative probability reaches a threshold.