From Silicon Valley to DC, the tech world is suddenly obsessed with one concept in AI: Distillation
- 1 day ago
- 1 min read
CNBC — Earlier this year, Google AI lead Jeff Dean, on a podcast, discussed a concept that, at the time, was hardly spoken about outside of wonky tech circles: distillation.
In talking about the development of Google's AI models, Dean said that he and colleagues discovered artificial intelligence distillation techniques because Google was looking to improve performance on its systems without relying on one large image recognition model.
"Through distillation, which is a key technique for making the smaller models more capable, you have to have the frontier model in order to then distill it into your smaller model," Dean said
Read the full story | CNBC
