Alternatives to Strata

NInfer is an Apache-2.0 C++/CUDA engine for selected Qwen checkpoints on a single RTX 5090, with OpenAI- and Anthropic-compatible local APIs.

halogen-flash-server is a Strix Halo inference server that runs Qwen3.8-Flash-Next with an OpenAI-compatible API.

mlx-serve is a MIT Zig inference server for Apple Silicon that runs MLX and GGUF locally with OpenAI and Anthropic APIs, no Python.

oMLX is an Apache-2.0 Apple Silicon inference server with SSD KV cache and a macOS menu bar app for coding agents.

An efficient local LLM inference library built around the EXL3 quantization format, running large open models on consumer GPUs with tensor and expert parallelism, and powering the TabbyAPI server.

MCP India Stack is a MIT offline-first MCP server with 76 Indian tax, identity, and legal tools for agents.

Tencent’s model compression toolkit combining quantization, distillation, sparse attention and speculative decoding workflows.

Local models plus Ollama cloud. Not a 30-minute Llama3 tutorial.

NVIDIA's open-source LLM vulnerability scanner with dozens of plugins and thousands of prompts for probing jailbreaks, prompt injection, and data leakage.

NVIDIA's open-source toolkit for adding programmable guardrails to LLM conversational applications, with Colang flows for input, dialog, retrieval, and output rails.

MIT agent framework. Hosted traces are LangSmith Developer $0 / Plus $39 per seat. Not LangServe-as-the-product.

Open-source RAG plus agents. Cloud signup exists; no public dollar table. Not a generic document scanner.

OpenRouter for agent tools: one key and one MCP server in front of 3,600+ third-party endpoints, metered per call at the provider's own rate with no markup.

Self-hosted AI gateway for coding tools. Compare 9Router with OmniRoute and OpenRouter, and check costs, tool calls, fallback, and migration steps.