Skip to main content
The Tokios Connector is a lightweight console app that creates a secure outbound WebSocket tunnel between your local model server and the Tokios gateway. Install it on any machine that runs your model — no inbound firewall rules required.

Download the Connector

Visit the Tokios website and download the binary for your operating system.
Supported: Windows 10 & 11 (x64)Download tokios-connector.exe from the Tokios website and place it in a directory of your choice — for example, C:\tokios\.Create your config fileIn the same directory as the binary, create a file named tokios.json:
tokios.json
{
  "tunnel_token": "tt_your_token_here",
  "upstream": "http://localhost:11434"
}
Run the connectorOpen a Command Prompt or PowerShell window in that directory and run:
tokios-connector.exe --config tokios.json

Configure tokios.json

The tokios.json file tells the connector two things: how to authenticate with the Tokios gateway, and where your local model server is listening.
tokios.json
{
  "tunnel_token": "tt_your_token_here",
  "upstream": "http://localhost:11434"
}
FieldDescription
tunnel_tokenYour unique token from the Tokios dashboard. See Getting your tunnel token below.
upstreamThe local URL of your model server. Change the port to match your backend (see Supported Backends).

Getting your tunnel token

  1. Sign up or log in at the Tokios dashboard.
  2. Navigate to ConnectorsNew Connector.
  3. Copy the generated tunnel_token and paste it into your tokios.json.

Successful Startup

When the connector starts and the tunnel is live, you’ll see output similar to:
Tokios Connector v1.x.x
Connecting to api.tokios.com...
Tunnel established. Your models are reachable.
Once you see Tunnel established, your local model server is reachable through api.tokios.com. You can now register your model deployment in the dashboard.
The connector does not listen on any port. It only dials out — your firewall needs no changes.