How is it this fast? A small model, 4-bit math for the expert layers, and a fixed-size cache for most of the attention.
About SN64 Chutes
Chutes@chutes_aiHow is it this fast? A small model, 4-bit math for the expert layers, and a fixed-size cache for most of the attention. The Parallax paper: storage.googleapis.com/chutes-random/parallax-d…
Linkstorage.googleapis.comstorage.googleapis.com/chutes-random/parallax-draft-tech-report.pdfSN64 Chutes at a glance
SN64, Chutes (α token ش), is one of the independent markets on the Bittensor network, each with its own α token and its own price. Its α currently trades at 0.062788 τ (≈ $13.99), against 194,176 τ of pool liquidity. On-chain, the best-delegated validator on it yields about 36.71% APR (simple) and 44.35% APY (compounded), emissions add 0.008111 τ to the pool each block, epochs run every 360 blocks. It was registered at block #4,531,295.
Taosis newsletters
Taosis News: the week’s articles from the subnet teams, the press and community newsletters, every Friday. Taosis Weekly: the week’s movers, best yields and chain events, with dollar values, every Monday. Past issues
More from SN64 Chutes
Taosis indexes announcements, articles, posts and releases about Bittensor subnets from their own channels and keeps a record of each. The text above is the source’s; the figures are read from the chain by Taosis.