Distillation Can Make AI Models Smaller and Cheaper

Much of the news coverage framed this possibility as a shock to the AI industry, implying that DeepSeek had discovered a new, ...
Yahoo

DeepSeek used OpenAI’s model to train its competitor using ‘distillation,’ White House AI czar says

David Sacks, U.S. President Donald Trump's AI and crypto czar. David Sacks says OpenAI has evidence that Chinese company DeepSeek used a technique called "distillation" to build a rival model. OpenAI ...
NBC New York

How DeepSeek used distillation to train its artificial intelligence model, and what it means for companies such as OpenAI

Chinese artificial intelligence lab DeepSeek roiled markets in January, setting off a massive tech and semiconductor selloff after unveiling AI models that it said were cheaper and more efficient than ...
Hosted on MSN

'Distillation', the sophisticated 'copy-paste' technique that is deeply involved in the AI wars and of which OpenAI accuses DeepSeek

After training for free with all of the Internet, AI companies are starting to copy each other without permission. The world continues to wonder how DeepSeek was able to train an AI model like R1 with ...
Computer Weekly

DeepSeek shows enterprises model distillation opportunity

Model distillation is one of the technology trends that has reached a level of maturity identified in Gartner’s 2025 Hype Cycle for artificial intelligence (AI) as “the slope of enlightenment”.
InfoWorld

OpenAI updates API with model distillation, prompt caching abilities

The updates could help OpenAI compete better with rivals such as Anthropic, Google, and AWS which already offer similar capabilities. In what can only be seen as OpenAI’s efforts to catch up with ...