2 items
#llm
Posts
Projects
LLM token explainer
A step-by-step walkthrough of how a language model produces one token: tokenization, embedding, attention, logits, sampling. Runs GPT-2 in the browser, so the numbers on screen are the real ones.
2 items
A step-by-step walkthrough of how a language model produces one token: tokenization, embedding, attention, logits, sampling. Runs GPT-2 in the browser, so the numbers on screen are the real ones.