Von is a 395M-parameter attempt to clone the idea behind Jev and ship it as open weights you run yourself. The pitch is the same one TypeSafe made for System One models: stop spending a frontier LLM on decisions that do not need generated text. Instead of decoding tokens, Von takes a state and a set of typed questions and returns a calibrated probability distribution in a single forward pass.
The first-party repository was created on 2026-09-18 under Apache-2.0 and written in Python 3.12+. On 2026-09-20 GitHub listed 63 stars and 10 forks, with a push the same day. The weights are on Hugging Face as wfzyx/von-1.0, a safetensors repo built on a ModernBERT backbone that had 16 likes and about 1,223 downloads at the time of writing. Sixty-three stars is a very early project, not a track record.
Key Features
- Three decision primitives:
Choicereturns a probability distribution over mutually exclusive options,Noulreturns a calibrated binary probability for a condition, andScorereturns an ordinal rating across ordered levels. - No autoregressive decoding: one forward pass, no key-value cache growth, no schema parse errors from generated JSON.
- Calibrated by training, not by prompt: Von is post-trained with a composite objective that blends cross-entropy with Brier score, then temperature-scaled, so the reported confidence is meant to track accuracy rather than look confident.
- Hardware-agnostic: the project lists CUDA, AMD ROCm on Linux, Apple Metal Performance Shaders, and multithreaded CPU paths.
- Protocol parity:
von serveexposes a/v1/systemoneHTTP endpoint that the project says matches the TypeSafe wire specification, so a client written for one can talk to the other.
Benchmarks
Von's numbers come from the author running the community jabr/classifier-benchmark suite, 8 tasks and 78 cases:
| Model | Size | Macro acc | MPS/GPU latency | CPU latency | Cost |
|---|---|---|---|---|---|
| Von-1.0 | 395M (1.5 GB) | 93.5% | ~18 ms | ~480 ms | Local, Apache-2.0 |
| GLiNER2 (fastino/gliner2-large-v1) | ~300M | 78.5% | ~93 ms | ~500 ms | Local, Apache-2.0 |
| TypeSafe Jev | Proprietary | 97.2% | ~302 ms (API) | Cloud only | $0.042 / 1M input tokens |
Read the table as a vendor figure. It is a small suite, the author wrote both the model and the comparison, and Jev still leads on raw accuracy. What Von changes is the deployment shape: no API, no per-call price, no data leaving the machine.
Use Cases
- Agent routing: decide which tool, queue, or model a request belongs to before you pay for a generative call.
- Guardrails and verification: run a binary check on model output as a cheap second opinion.
- Triage scoring: rate severity, urgency, or sentiment on an ordinal scale without a prompt template.
- Offline stacks: local-first applications that cannot depend on a hosted decision API.
Limitation: Von cannot write prose, code, or tool-call strings. It is a decision function inside software, not a chat model, and a 395M non-autoregressive classifier will not carry the breadth of a fine-tuned frontier model on messy, unseen taxonomies.
Pricing
| Plan | Price | Notes |
|---|---|---|
| Von-1.0 weights | $0 | Apache-2.0 on GitHub and Hugging Face. |
| von-sdk | $0 | pip install von-sdk, uv add von-sdk, or npm install von-sdk. |
| Hosting | Your compute | Self-hosted; the project publishes no hosted service. |
Getting Started
pip install von-sdk # or: uv add von-sdk
import von
result = von.decide(
state="Database replication lag on cluster us-west-2 exceeded 45 seconds.",
choices={
"infrastructure": "Database, hardware, network, or server failures",
"billing": "Invoices, payments, refunds, subscription queries",
"feature_request": "Requests for new platform capabilities",
},
)
For a service, von serve --host 0.0.0.0 --port 8000 starts an HTTP endpoint, and the README shows a curl against /v1/systemone with "model": "von-1.0.0". First-party entry point: the repository README and the Hugging Face model card.
Frequently Asked Questions
Is Von affiliated with TypeSafe?
No. It is an independent project that describes itself as a drop-in alternative to Jev and claims compatibility with the same wire protocol.
Can it match Jev's accuracy?
On the author's suite it trails by roughly four points of macro accuracy. It compensates with local execution and zero per-call cost.
Do I need a GPU?
No. CPU inference is supported, but the author measures about 480 ms there against about 18 ms on Apple MPS.
Alternatives
- Jev: the commercial System One model this one imitates, ahead on accuracy and behind on openness.
- LangGraph: a workflow host that calls an ordinary LLM for routing decisions.
- GLiNER2: open-weight span and classification models for extraction tasks.
Tips
- Keep taxonomies under the primitives' comfortable cardinality and split larger ones into a two-stage route.
- Treat confidence as a gate: automate the high-confidence head and escalate the tail to review.
- Verify the
/v1/systemonecompatibility yourself before swapping it into an existing System One client.
Conclusion
Von is the open-weight answer to a question Jev raised in September 2026: do classification and routing decisions really need a generative model? A 395M non-autoregressive classifier that runs locally in about 18 ms is a reasonable no. Try it in an agent loop where you currently pay a frontier model to pick between five labels.
Comments
No comments yet. Be the first to comment!
Related Tools
Related Insights

Anthropic Subagent: The Multi-Agent Architecture Revolution
Deep dive into Anthropic multi-agent architecture design. Learn how Subagents break through context window limitations, achieve 90% performance improvements, and real-world applications in Claude Code.
Stop Cramming AI Assistants into Chat Boxes: Clawdbot Picked the Wrong Battlefield
Clawdbot is convenient, but putting it inside Slack or Discord was the wrong design choice from day one. Chat tools are not for operating tasks, and AI isn't for chatting.

Grok Bot and Hermes Bot: one person finally gets a think tank and a secretariat
Grok Bot now ships with Cursor Pro+. Hermes Bot runs on a VPS. They are not smarter chat boxes. The think tank advises, the secretariat executes, and you still make the call.