He showed serving numbers too: 17,935 output tokens per second on one RTX 5090 at 256 concurrent requests.
About SN64 Chutes
Chutes@chutes_aiHe showed serving numbers too: 17,935 output tokens per second on one RTX 5090 at 256 concurrent requests. It's a benchmark preview, running on a fork of vLLM that is not optimized yet. Expect that number to move.
SN64 Chutes at a glance
SN64, Chutes (α token ش), is one of the independent markets on the Bittensor network, each with its own α token and its own price. Its α currently trades at 0.071384 τ, against 204,188 τ of pool liquidity. On-chain, the best-delegated validator on it yields about 33.52% APR (simple) and 39.81% APY (compounded), emissions add 0.009649 τ to the pool each block, epochs run every 360 blocks. It was registered at block #4,531,295.
More from SN64 Chutes
Taosis indexes announcements, articles, posts and releases about Bittensor subnets from their own channels and keeps a record of each. The text above is the source’s; the figures are read from the chain by Taosis.