The AI industry is witnessing a transformative trend: the use of distillation to make AI models smaller and cheaper. This shift, spearheaded by companies like DeepSeek and OpenAI, is reshaping the AI ...
Model distillation is one of the technology trends that has reached a level of maturity identified in Gartner’s 2025 Hype Cycle for artificial intelligence (AI) as “the slope of enlightenment”.
The AI industry stands at an inflection point. While the previous era pursued larger models—GPT-3's 175 billion parameters to PaLM's 540 billion—focus has shifted toward efficiency and economic ...