The ceiling is higher still. The same architecture supports up to 2T dense parameters on today's hardware, with MoE research underway to go…
Macrocosmos@MacrocosmosAIThe ceiling is higher still. The same architecture supports up to 2T dense parameters on today's hardware, with MoE research underway to go beyond it. That's a design limit, not a completed run. Tomorrow: the SDK that puts all of this in your hands. Early access: iota.macrocosmos.ai/sdk
Linkiota.macrocosmos.aiiota.macrocosmos.ai/sdkMore from the feed
Taosis indexes announcements, articles, posts and releases about Bittensor subnets from their own channels and keeps a record of each. The text above is the source’s; the figures are read from the chain by Taosis.