https://api.tokios.com/v1 with your sk-tok-… key — and Msty reaches a model running on your own hardware.
Prerequisites
Connector paired
Install and pair
tokios-connector next to the model you want Msty to reach.Model registered
Register a deployment (public name) for that model.
API key created
Create an
sk-tok-… key, optionally scoped to that deployment.Supported backends
Confirm your local backend (Ollama, llama.cpp, vLLM, LM Studio) is running.
Add Tokios as a remote model provider
1
Open remote model providers
In Msty, open the model providers area and choose to add a Remote Model Provider. The exact label and location vary between Msty and Msty Studio versions — check yours.
2
Choose OpenAI Compatible
Select OpenAI Compatible as the provider type.
3
Set the endpoint and key
Fill in the provider fields:The API Endpoint should end in
/v1.4
Fetch or add your deployment
Click Fetch Models. Because Tokios implements
GET /v1/models, your registered deployments (for example gemma-tunnel) populate automatically. If a provider doesn’t auto-return models, add the deployment name manually. Then click Add to save the provider.Replace
gemma-tunnel with the deployment name you registered, and sk-tok-YOUR_KEY with your own key. The model name Msty sends is your public deployment name — not Ollama’s, llama.cpp’s, vLLM’s, or LM Studio’s local model id.Desktop app, model elsewhere
Msty runs on your desktop; the model you want can live on another machine entirely. The connector next to that model dials out to Tokios, and Msty callshttps://api.tokios.com/v1 with your sk-tok-… key — no inbound ports, no VPN. Msty’s multi-model chats then work across your Tokios deployment and any other providers you’ve added.
Troubleshooting
401 error
401 error
The API key Msty sent is missing, malformed, or has been revoked. Confirm you pasted the full
sk-tok-… key with no extra whitespace, and check its status on the Keys tab.Fetch Models returns nothing or a 404
Fetch Models returns nothing or a 404
The endpoint or key scope is off. Confirm the API Endpoint is
https://api.tokios.com/v1, that you’ve registered a deployment on the Models tab, and that your key’s scope includes it.503 error
503 error
The connector for that deployment is offline or at its concurrency cap. Check the Connectors tab — the connector needs to show as Online, and the machine running it needs to still be up and reachable.
Next steps
Compatible clients
See base URL and key setup for other OpenAI- and Anthropic-compatible clients.
API keys
Create, scope, and rotate
sk-tok-… keys for teammates and agents.