Skip to main content
The Tokios Connector is configured through a tokios.json file, with optional CLI flags to override behavior at startup. This page covers every available setting.

tokios.json fields

tunnel_token
string
required
Your tunnel token from the Tokios dashboard. Identifies the connector to the Tokios gateway and links it to your registered model deployment.
upstream
string
required
The local HTTP URL of your model server. Common examples:
BackendDefault URL
Ollamahttp://localhost:11434
llama.cpphttp://localhost:8080
vLLMhttp://localhost:8000
LM Studiohttp://localhost:1234
log_level
string
default:"info"
Log verbosity for the connector process. One of debug, info, warn, or error.

Full example

tokios.json
{
  "tunnel_token": "tt_your_token_here",
  "upstream": "http://localhost:11434",
  "log_level": "info"
}

CLI flags

FlagDescriptionDefault
--config <path>Path to the tokios.json config file./tokios.json
--log-level <level>Override log level (debug, info, warn, error)From config or info

Example

./tokios-connector --config /etc/tokios/tokios.json --log-level debug

Running as a background service

For development, running in a terminal window is fine. For production use, run the connector as a system service so it restarts automatically on reboot.
Create a plist file at ~/Library/LaunchAgents/com.tokios.connector.plist:
~/Library/LaunchAgents/com.tokios.connector.plist
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN"
  "http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
  <key>Label</key>
  <string>com.tokios.connector</string>
  <key>ProgramArguments</key>
  <array>
    <string>/usr/local/bin/tokios-connector</string>
    <string>--config</string>
    <string>/etc/tokios/tokios.json</string>
  </array>
  <key>RunAtLoad</key>
  <true/>
  <key>KeepAlive</key>
  <true/>
  <key>StandardOutPath</key>
  <string>/var/log/tokios-connector.log</string>
  <key>StandardErrorPath</key>
  <string>/var/log/tokios-connector.log</string>
</dict>
</plist>
Load and start the service:
launchctl load ~/Library/LaunchAgents/com.tokios.connector.plist
launchctl start com.tokios.connector