#speculative decoding

DeepSeek open sources DSpark, a framework that speeds up LLM inference by up to 85%

The AI landscape has received a new major open source contribution from DeepSeek, a Chinese company that recently releas...