Prime Intellect Inference Platform Launched: Nearly 1 trillion Token Calculations Per Day Internally
2026-10-04 23:31:03
According to CoinMeta, the Prime Intellect inference platform has been officially launched, processing nearly 1 trillion tokens per day internally. The platform has released an open-source model inference service called prime inference, allowing users to call models as needed and supporting long-term stable operation with compute power locking. The interface is compatible with OpenAI API, and the first publicly deployed model is glm-5.3. Since January of this year, Prime Intellect has been running large-scale deployments for customers, with a focus on optimizing the long-context load of agent. During testing, the latency between p90 and token was reduced by nearly 40%. At the same time, Prime Intellect has compressed the kv cache, increasing the number of token that each decoder can cache from 1.09 million to 1.63 million under the same amount of video memory, which is a boost of about 50%.
Source:Internet
This content is for market information only and does not constitute investment advice.
Follow WalletJYS official accounts to stay updated

Hot Articles
Refresh

Bitcoin October 2026 Outlook: Can the 19% Historical Gain Hold?
09-30 12:57

Dogecoin Price: Whales Buy $112M, Can DOGE Break $0.10?
09-29 12:48

What is Solidigm? Is Its $150B IPO Valuation a Bubble?
09-28 13:00

Is PAXG Stable? Is Gold-Backed Better Than Stablecoins?
09-24 18:04

ETH Rebounds to $2,800: Can It Hold $3,200 by Month-End?
09-23 11:07



