Distillation
Training a smaller, cheaper model to imitate a larger one's outputs, keeping much of the quality at lower cost.
“The on-device model is a distillation of the big cloud one.”
See also
In the history of AI
Part of the Extended list
Distillation is on the Extended list: builder jargon, industry terms, and newer slang for when you want to go further. It entered common use around 2024.