Training, Behavior, and Failure
Pretraining, alignment, sampling — and the mechanical origins of the disorders DEM-X catalogs.
In this module you will
- Explain what pretraining and RLHF each optimize
- Describe how sampling parameters shape observed behavior
- Give a mechanical account of three named failure modes
Pretraining, Finetuning, and Alignment
Three stages with three different objectives. Most behavioral surprises live in the gaps between them.
Concept · 35m
Sampling: The Knobs That Change Everything
The model outputs a distribution. What you see is a sample from it, and the sampler is a variable you must control.
Code Walkthrough · 30m
Why Models Confabulate
The bridge into DEM-X. Confabulation is what this architecture does when it lacks the answer.
Bridge · 30m