PhilYue/dsh-llm-manage
Manages the model inventory of one LLM route: pins and favorites, usage-based ranking, gateway directory reconciliation, health probes, and automatic fallback when a model's quota runs out.
A local ledger levels each model by how often you actually use it and ranks the rest by 14-day heat, shown as a Most used card and a ranked picker section. On a model-scoped failure the plugin watches agent/request-error, moves the session to the next usable model, and reports the switch only after the model that answered confirms it — which is the difference between a fallback that happened and one that was attempted. Rows also show how many other routes serve the same model instead of hiding the duplicates.
Install
dsh plugin --profile web add dsh-llm-manageThe npm line; the package resolves on the public registry and its registry metadata points back at this repository. The README states deliberately that no screenshots are committed, because a screenshot of a running harness would show the maintainer's own routes and model names, and a route name rendered into an image cannot be found by a text scan.
Compatibility
The plugin works on a route that aggregates providers behind one gateway, which is where the README's five listed problems come from: favorites buried in a long list, no sense of which models you rely on, retired models still listed, manual switching when quota runs out, and the same model served by several providers. It reconciles the route's models: list against the gateway's own GET {baseURL}/models directory and flags missing entries as retired, and probes models with a minimal request. The panel sorts pinned, then favorite, then recent, then the rest.
Details
- Repo: PhilYue/dsh-llm-manage
- Category: Models & Providers
- Stars: 0
- Version: 0.1.2 (npm latest)
Alternatives
btspoony/dsh-keys-manager · ffyuuu/dsh-llm-longcat · shengbinxu/dsh-llm-latency