Serve an open LLM with vLLM on a single Lium GPU
About SN51 lium.io
Serve Qwen2.5-7B-Instruct with vLLM on one RTX 4090 on Lium and call your own OpenAI-compatible endpoint from your laptop with curl and the openai Python client. 18 minutes of pod time, about 14 cents. vllm llm-inference qwen openai-api rtx-4090
Read the article at SN51 lium.io news page ↗
SN51 lium.io at a glance
SN51, lium.io (α token ת), is one of the independent markets on the Bittensor network, each with its own α token and its own price. Its α currently trades at 0.108793 τ (≈ $29.65), against 178,172 τ of pool liquidity. On-chain, the best-delegated validator on it yields about 33.04% APR (simple) and 39.15% APY (compounded), emissions add 0.014959 τ to the pool each block, epochs run every 360 blocks. It was registered at block #3,966,206.
More from SN51 lium.io
Taosis indexes announcements, articles, posts and releases about Bittensor subnets from their own channels and keeps a record of each. The text above is the source’s; the figures are read from the chain by Taosis.