Parametric Knowledge and Hallucination

Quick Quiz

Next Token Prediction

This is only a part of training process.

Parametric Knowledge (or Memory)

Hallucination

There are many other factors that can cause LLMs to hallucinate.