ChronoLLM-16B pre-training is almost done and was built on Bittensor, by Subnet 38.
About SN38 ChronoLLM
ChronoLLM@chronollmChronoLLM-16B pre-training is almost done and was built on Bittensor, by Subnet 38. 2 big updates: 1. ChronoLLM will release the largest Point-In-Time LLM out there, a 16B MoE. 2. Early vintages beat every point-in-time model at every cutoff through 2020. ChronoLLM should own the frontier for LLMs without lookahead. ChronoLLM-16B is 8x bigger than its predecessor and scores 22% higher. Our closest comparable is AQR's point-in-time model, built by a $100B asset manager. ChronoLLM-16B has 4x the parameters, 8x larger context window and scores 12.5% higher on the Open LLM benchmark (22% on the 2013 cutoff). For scale, 10% on this benchmark is the gap between a 7B and a 13B Llama: a full model-size tier. And it stays flat across every cutoff from 2013 to 2022. That’s what no lookahead looks like to us. ChronoLLM-16B is also the first point-in-time model that can reason. Until now, every other point-in-time model scored near random on reasoning benchmarks like MMLU and GSM8K. ChronoLLM doesn't. We’re here to stay.
SN38 ChronoLLM at a glance
SN38, ChronoLLM (α token ם), is one of the independent markets on the Bittensor network, each with its own α token and its own price. Its α currently trades at 0.006505 τ (≈ $1.55), against 5,504 τ of pool liquidity. On-chain, the best-delegated validator on it yields about 74.94% APR (simple) and 111.55% APY (compounded), emissions add 0.001326 τ to the pool each block, epochs run every 1440 blocks. It was registered at block #7,284,230.
Taosis newsletters
Taosis News: the week’s articles from the subnet teams, the press and community newsletters, every Friday. Taosis Weekly: the week’s movers, best yields and chain events, with dollar values, every Monday. Past issues
More from SN38 ChronoLLM
Taosis indexes announcements, articles, posts and releases about Bittensor subnets from their own channels and keeps a record of each. The text above is the source’s; the figures are read from the chain by Taosis.