The Tokios Connector is configured through a tokios.json file, with optional CLI flags to override behavior at startup. This page covers every available setting.
tokios.json fields
Your tunnel token from the Tokios dashboard. Identifies the connector to the Tokios gateway and links it to your registered model deployment.
The local HTTP URL of your model server. Common examples:| Backend | Default URL |
|---|
| Ollama | http://localhost:11434 |
| llama.cpp | http://localhost:8080 |
| vLLM | http://localhost:8000 |
| LM Studio | http://localhost:1234 |
Log verbosity for the connector process. One of debug, info, warn, or error.
Full example
{
"tunnel_token": "tt_your_token_here",
"upstream": "http://localhost:11434",
"log_level": "info"
}
CLI flags
| Flag | Description | Default |
|---|
--config <path> | Path to the tokios.json config file | ./tokios.json |
--log-level <level> | Override log level (debug, info, warn, error) | From config or info |
Example
./tokios-connector --config /etc/tokios/tokios.json --log-level debug
Running as a background service
For development, running in a terminal window is fine. For production use, run the connector as a system service so it restarts automatically on reboot.
macOS (launchd)
Linux (systemd)
Windows (Service)
Create a plist file at ~/Library/LaunchAgents/com.tokios.connector.plist:~/Library/LaunchAgents/com.tokios.connector.plist
<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN"
"http://www.apple.com/DTDs/PropertyList-1.0.dtd">
<plist version="1.0">
<dict>
<key>Label</key>
<string>com.tokios.connector</string>
<key>ProgramArguments</key>
<array>
<string>/usr/local/bin/tokios-connector</string>
<string>--config</string>
<string>/etc/tokios/tokios.json</string>
</array>
<key>RunAtLoad</key>
<true/>
<key>KeepAlive</key>
<true/>
<key>StandardOutPath</key>
<string>/var/log/tokios-connector.log</string>
<key>StandardErrorPath</key>
<string>/var/log/tokios-connector.log</string>
</dict>
</plist>
Load and start the service:launchctl load ~/Library/LaunchAgents/com.tokios.connector.plist
launchctl start com.tokios.connector
Create a unit file at /etc/systemd/system/tokios-connector.service:/etc/systemd/system/tokios-connector.service
[Unit]
Description=Tokios Connector
After=network.target
[Service]
ExecStart=/usr/local/bin/tokios-connector --config /etc/tokios/tokios.json
Restart=always
RestartSec=5
StandardOutput=journal
StandardError=journal
[Install]
WantedBy=multi-user.target
Enable and start the service:sudo systemctl daemon-reload
sudo systemctl enable tokios-connector
sudo systemctl start tokios-connector
On Windows, use NSSM (Non-Sucking Service Manager) or Windows Task Scheduler to run the connector as a background service.Using NSSM:nssm install TokiosConnector "C:\Program Files\Tokios\tokios-connector.exe"
nssm set TokiosConnector AppParameters "--config C:\ProgramData\Tokios\tokios.json"
nssm set TokiosConnector Start SERVICE_AUTO_START
nssm start TokiosConnector
Using Task Scheduler:Open Task Scheduler, create a new task, set the trigger to At startup, and point the action to the tokios-connector.exe binary with --config <path> as the argument. Enable Run whether user is logged on or not to keep it running in the background.