Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You can't really distill a model without access to the internal weights. You could train on chat logs, but that's absolutely not the same thing, it doesn't even come close to comprehensively "extracting" the model's capabilities. And everyone does that in the industry anyway ever since ChatGPT was first released, some versions of Opus even claimed to be DeepSeek if you prompted them in Chinese.


Calling it distillation does however make normies go along with it when they inevitably add all the Chinese labs to the entities list to pad Dario and Sam’s pockets.


Weights are not required for distillation. I'm not sure how you came to that belief. Distillation is training a student model to minimic a teacher model output.

Anthropic, for example, posted a 2026 disclosure (https://www.anthropic.com/news/detecting-and-preventing-dist...) which singles out DeepSeek's distillation activity. They detected over 16M actions over 24,000 fraudulent accounts. That's just what they detected.


actually distillation is without weights - you basically just need a black box teacher model.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: