Skip to content

Add a fallback provider chain

Outcome: When the primary provider fails (rate limit, outage, expired key), Gormes automatically tries the next provider/model in the configured chain.

Prerequisites: At least two configured providers (see first turn).

  1. List the current chain

    Terminal window
    gormes fallback list

    On a fresh install:

    No fallback providers configured.
    Add one with: gormes fallback add
  2. Append a fallback

    Terminal window
    gormes fallback add

    The interactive picker asks for the provider and model to append. Repeat the command to chain more entries; order is the order you add them.

  3. Inspect the chain

    Terminal window
    gormes fallback list
  4. Remove one entry, or clear all

    Terminal window
    gormes fallback remove
    gormes fallback clear
Terminal window
gormes fallback list

Expected: each fallback entry appears with provider and model. Then trigger a primary failure (revoke the primary key, point its endpoint at an unreachable host, or use an unavailable model id) and run:

Terminal window
gormes chat -q "test fallback"

The turn should still return a reply — served by the next entry in the chain.

  • Fallback never activates → The primary call must fail, not partially succeed. Streaming or partial errors may not promote to the next entry; check gormes logs.
  • fallback add opens an empty picker → Add provider credentials first (gormes auth add <provider>).