For small models, distilling from a much stronger teacher beats RL alone.
About SN81 Reliquary
For small models, distilling from a much stronger teacher beats RL alone. That's the plan for Teutonic: SFT on a verified corpus from the 27B, then RL on top. Both run on Reliquary. This is the first of several new tasks to build a full post-training layer.
SN81 Reliquary at a glance
SN81, Reliquary (α token ᚠ), is one of the independent markets on the Bittensor network, each with its own α token and its own price. Its α currently trades at 0.005992 τ (≈ $1.84), against 17,760 τ of pool liquidity. On-chain, the best-delegated validator on it yields about 60.96% APR (simple) and 83.96% APY (compounded), emissions add 0.000002 τ to the pool each block, epochs run every 360 blocks. It was registered at block #5,203,057.
More from SN81 Reliquary
Taosis indexes announcements, articles, posts and releases about Bittensor subnets from their own channels and keeps a record of each. The text above is the source’s; the figures are read from the chain by Taosis.