LLM Fallback

~category.description~

All Categories

I get the error "Unable to connect to localhost:11434". What does that mean?

Ollama is running on a different machine than Sophia. Find the local IP address of the machine running Ollama, then update the API URL within the **Settings** menu of the web interface.

Do I need to use Ollama in order to use Ollama web search?

No, you can use any LLM provider you wish. The LLM provider and Ollama web search are two separate things.

Sophia picked an intent and device when it should have gone to the LLM fallback. How do I force it to use the LLM?

Go to the **Settings** menu in the Sophia web interface and enter `ask` (or something similar) into the LLM trigger field. Then send in `ask [your question here]` and it will be forced to the LLM.

When using OpenAI, it doesn't seem to send the correct API request.

If using newer OpenAI models, ensure you are using the OpenAI 5.6+ LLM provider that's available via the Settings menu of the Sophia web interface as it uses the updated API protocol.