Training a 100B parameter model normally means renting a block of matched, high-spec hardware and holding it unbroken for the length of the…
Macrocosmos@MacrocosmosAITraining a 100B parameter model normally means renting a block of matched, high-spec hardware and holding it unbroken for the length of the run. Orion-100B ran across five data centres instead, on single A100s at around $1.25 an hour each. That puts a full replica at roughly $20 an hour, and the entry cost about 2.5x below approaches that need high-spec nodes throughout. It ran as a viability proof rather than to a finished model, and it held. We're in Montreal on Monday talking about what that changes. @ExploitSummit iota.macrocosmos.ai
Linkiota.macrocosmos.aiiota.macrocosmos.aiMore from the feed
Taosis indexes announcements, articles, posts and releases about Bittensor subnets from their own channels and keeps a record of each. The text above is the source’s; the figures are read from the chain by Taosis.