Letter2025/dsh-model-failover
Two-level model circuit breaker with failover: trip a model or a whole provider after repeated request failures and route the next request to a configured fallback.
Circuit-breaker failover for DeepSeek Harness model routes. A provider/model route opens after modelCircuitThreshold failures inside burstWindowMs; a provider (platform) circuit opens when platformCircuitThreshold distinct models under it are open at once — a platform outage usually takes down every model on it. The next request goes to the first healthy fallback in fallbacks; the switch is recorded by the loop itself (request/header change) and optionally announced as a user-visible message. Open circuits are probed for recovery with lightweight health checks, so routes come back automatically when the provider recovers.
Install
dsh plugin --profile web add dsh-model-failovernpm package dsh-model-failover 0.1.4 (registry-verified 2026-08-27): dsh plugin --profile web add dsh-model-failover, then restart dsh web. Configure thresholds and fallback chains via the plugin's config block.
Compatibility
DeepSeek Harness web profile. Model- and platform-level circuit breakers with fallback routing.
Details
- Repo: Letter2025/dsh-model-failover
- Category: Workflow & Automation
- Stars: 3
- Version: npm dsh-model-failover 0.1.4 (registry-verified 2026-08-27)
- Last push: 2026-08-25
- First seen: 2026-08-14
Recent updates
model + platform circuit breakers; fallback chain routing; recovery probes; switch announced as user-visible message.
FAQ
- What opens a circuit?
- A provider/model route opens after modelCircuitThreshold failures inside burstWindowMs; a platform circuit opens when that many distinct models under one provider are open at once.
- What happens to the next request?
- It goes to the first healthy fallback in fallbacks; the switch is recorded by the loop and optionally announced as a user-visible message.
- Do open circuits ever recover?
- Yes — recovery probes health-check open circuits so routes come back automatically when the provider recovers.
Alternatives
NOirBRight/dsh-llm-ollama · tianji-qingtian/dsh-model-router · JuneLearn/dsh-reasoning-settings