Skip to content

Disabling models

You can remove a model from the pool manually and enable it again later:

broker.disable_llm("groq-llama")
# ... later ...
broker.enable_llm("groq-llama")

The setting remains in effect after sync and does not change the model's accumulated quality history.

Use snapshot() to inspect the current state of every model:

for name, entry in broker.snapshot().items():
    print(name, entry.disabled, entry.has_key, entry.cooldown_until, entry.demoted_operations)

The fields are documented in LLMSnapshot. See Monitoring and the journal for the pool-wide state.