Skip to content
AI Engineer Guide.

Sampling

Temperature and top-p reshape a distribution; sample and watch the choice move.

plan
48.3%
schedule
25.8%
book
13.8%
reserve
7.4%
hold
3.5%
cancel
1.1%

Picked: —

Struck-through tokens are removed by the top-p cut-off. Temperature reshapes the distribution; truncation removes the tail.

Related: Sampling parameters