Why Temperature 0 Isn't Deterministic
A one-line formula for how often an LLM's top token flips, and why identical completions fall apart after about a hundred tokens
Towards Data Science ยท Utkarsh Mangal
A one-line formula for how often an LLM's top token flips, and why identical completions fall apart after about a hundred tokens
Towards Data Science ยท Utkarsh Mangal