Bittensor’s @chutes_ai trained Parallax 8B across hundreds of consumer GPUs around the world.
Openτensor Foundaτion@opentensorBittensor’s @chutes_ai trained Parallax 8B across hundreds of consumer GPUs around the world. Now their latest preview shows it handling 256 AI requests simultaneously on a single gaming GPU. The future of AI compute won't be confined to giant data centers.
Quoting @chutes_ai
Parallax runs at almost 18,000 tokens a second on a single RTX 5090. That’s one consumer GPU answering 256 requests at once, on a vLLM fork that we put together. The more one card can serve, the cheaper each answer gets 💪
Taosis newsletters
Taosis News: the week’s articles from the subnet teams, the press and community newsletters, every Friday. Taosis Weekly: the week’s movers, best yields and chain events, with dollar values, every Monday. Past issues
More from the feed
Taosis indexes announcements, articles, posts and releases about Bittensor subnets from their own channels and keeps a record of each. The text above is the source’s; the figures are read from the chain by Taosis.