Last verified: 2026-10-24
Why Flint matters
Flint is purpose-built for agentic coding — investigating codebases, fixing bugs, implementing features, writing tests. It supports multi-turn tool use and structured tool-call grammar. The 2.5B active parameter count means it fits hardware that cannot run any other model in its performance class. Notably, Flint was built largely by its own AI research system — an early demonstration of self-improving AI (autoresearch).Specs
Attention architecture
Flint uses a hybrid attention pattern:- 35 sliding-window layers (window size 513 tokens) for efficient local context
- 14 full-attention layers with RoPE for long-range dependencies
Hardware fit
All 39.8B parameters must stay resident in memory — only the 2.5B active count reduces compute per token, not memory. The GGUF sizes from Unsloth:Benchmarks
Best-in-class for MoE models under ~5B active parameters.
Run it
- Ollama (simplest)
- SGLang (recommended for serving)
- vLLM
- llama.cpp / LM Studio
Recommended generation settings
- Temperature:
1.0 - Top-p:
0.95 - Top-k:
20 - Min output tokens:
32,768
Connect it with Tokios
Once Flint is running on your hardware through any of the backends above, pair the Tokios connector to reach it ashttps://api.tokios.com from Claude Code, Cline, or any compatible client.
1
Pair the Tokios connector
Sign in at tokios.com/console, open the Setup tab, and click Start pairing to get a one-time claim code (Then approve the device on the Setup or Connectors tab.
TKS-XXXX-XXXX). Run the installer on the machine hosting Flint:Linux
2
Register a deployment
In the Models tab, register
flint as the upstream model id and choose a public deployment name.3
Create an API key
In the Keys tab, click Create key. Copy the
sk-tok-... key — it is shown only once.Caveats
- All 39.8B parameters stay resident. The 2.5B active count reduces compute per token, not memory. Plan for 25+ GB at Q4.
- Knowledge cutoff is June 2026. Flint does not know about events after that date.
- Apache 2.0 license is permissive. Commercial use is allowed with no restrictions.
- NVFP4 variant available. NVIDIA published an FP4 quantization for Blackwell GPUs.
- Built by AI. Flint was largely created by RecursiveSI’s own AI research system. This is an early demonstration of autoresearch.
Model fit
Calculate which quantization fits your GPU.
Choose a model by task
Compare Flint against other coding models.
RTX 50 series guide
Best consumer GPUs for running Flint.
Quickstart
Connect Flint to Tokios for remote access.