pyro/llm-router
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3 Commits 1 Branch 0 Tags
a6cf8d6a2581918e3bb593bc6e4e3f3df354e17c
T
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
pyro a6cf8d6a25 updated the server so that you can set a preferred llm server. It will 
attempt to utilze that server for every request unless its not online
then it will fallback to any other online serer.
2026-10-28 10:36:50 -05:00
src
updated the server so that you can set a preferred llm server. It will
2026-10-28 10:36:50 -05:00
.gitignore
write the server
2026-10-27 11:56:10 -05:00
Cargo.toml
write the server
2026-10-27 11:56:10 -05:00
LICENSE
Initial commit
2026-10-27 16:29:25 +00:00
README.md
Initial commit
2026-10-27 16:29:25 +00:00

README.md

llm-router

routes between self hosted LLM servers. All servers should be exposing the same model and running on the same server software. I test this with lemonade and qwen3.8 specifically

Reference in new issue View Git Blame Copy Permalink
S
Description
routes between self hosted LLM servers. All servers should be exposing the same model and running on the same server software. I test this with lemonade and qwen3.8 specifically
Readme GPL-3.0
50 KiB
0 Stars 1 Watchers 0 Forks
Languages
Rust 100%