Baseten, an AI inference startup, is reportedly close to finalizing a $1.5 billion funding round at a $13 billion valuation, according to the Wall Street Journal. Just five months ago, the company announced a $300 million Series E at a $5 billion valuation, itself nine months after a $150 million Series D. If finalized, this latest round would represent a 160% increase in valuation in less than six months.
However, the WSJ reports that this is a split-priced round, a tactic startups use to boost their headline valuation and make lead investors look good on paper. Some investors in this latest round are reportedly coming in at a $13 billion valuation, while others at $11 billion, sources told the Journal. The deal is said to be co-led by Spark Capital, Sands Capital, Altimeter Capital, and Wellington Management.
Sponsored Protocol
Launched in 2019, Baseten is benefiting from what The Next Wave called the "inference gold rush," where VCs are pouring enormous amounts of money into companies building the inference layer. Inference is what the model does after a user submits a prompt. Baseten promises to handle inference quickly while controlling costs by routing requests to the best-for-task model, especially competent, less-expensive open source alternatives.
The AI Inference Boom
The enormous interest in AI inference reflects the growing demand for large language models (LLMs) in production. While training models is costly and one-time, inference is continuous and represents the real testing ground for industry profitability. Startups like Baseten position themselves as optimizing intermediaries, offering platforms that automatically select the most efficient model for each request. This approach is similar to what we see with AWS Context, the knowledge graph that learns from agents without manual curation, demonstrating how the AI ecosystem is evolving towards more autonomous and optimized solutions.
Sponsored Protocol
According to experts, the AI inference market could be worth tens of billions in the coming years. Companies like OpenAI, Anthropic, and Google compete to offer the most performant models, but the real challenge is making them accessible at sustainable costs. Baseten aims to become the go-to platform for companies wanting to integrate AI without managing complex infrastructure. For more on inference mechanisms, check the Wikipedia entry on inference.
Industry Implications
This mega-round demonstrates that investor confidence in AI inference remains sky-high, despite macroeconomic uncertainties. The $13 billion valuation, even if influenced by split pricing, signals that Baseten is considered a key player. However, the split-priced model raises questions about valuation transparency in the tech sector. Some analysts warn of a possible bubble, while others argue that real inference demand justifies these numbers.
Sponsored Protocol
In any case, the inference gold rush is just beginning. With this funding, Baseten can expand its infrastructure, hire talent, and forge strategic partnerships. Will it deliver on promises of speed and cost savings? Only time will tell.