mlx-serve: pricing, features, alternatives

mlx-serve is a native Zig inference server for Apple Silicon. The product site is mlxserve.com. The repo ddalcu/mlx-serve is MIT, created 2026-02-17. On 2026-09-10 GitHub listed 1,209 stars and 109 forks. r/LocalLLaMA posted it as the Mac path for Qwen3.8-Flash-Next at long context. Latest GitHub release checked the same day was v26.9.2 (published 2026-09-09), which called out faster Flash Next speculative decoding. Author is David Dalcu. There is no Python runtime.

Compare Ollama if you wanted a multi-OS local runner plus a cloud seat, NInfer if you had a single RTX 5090, or Claude Code if you only needed the coding agent that can point at localhost.

Key Features

MLX and GGUF in one binary: Site and README say native MLX for Gemma, Qwen, Llama, Mistral and others, plus embedded llama.cpp for any .gguf. DeepSeek V4 Flash on 96 GB+ Macs goes through the embedded antirez/ds4 engine.
Three API dialects on http://localhost:11234: OpenAI chat completions and Responses, Anthropic Messages (so Claude Code can set ANTHROPIC_BASE_URL), and Ollama's /api/chat family so existing Ollama clients keep their URLs besides the port.
MLX Core.app: Signed, notarized menu-bar app with chat, agent mode, MCP tools, model browser, and media tabs (image, video, music, speech, 3D). Homebrew: brew install --cask mlx-core or brew install mlx-serve for CLI only.
Needs macOS 26.2+ on Apple Silicon: README is explicit. Not Windows, not Linux, not Intel Macs.

Limitation: 1,209 stars is a heat signal, not an audit. Site speed claims versus LM Studio are first-party benches on an M4 Max, not a third-party study. iPhone companion MLX Chat needs a recent A17 Pro-class device and iOS 26+.

Use Cases

Apple Silicon owners who want Claude Code, Cursor, or Open WebUI on local weights with no cloud key.
People already on Ollama for Mac who can retarget http://localhost:11234 and keep Raycast or Obsidian plugins.
People who should use Ollama or NInfer instead if the machine is not an M-series Mac.

Pricing

Piece	Price	Notes from first-party pages 2026-09-10
mlx-serve / MLX Core	$0	MIT. About 1,209 stars. FAQ: no subscription, no account.
Hardware	Your Mac	macOS 26.2+ Apple Silicon. DeepSeek V4 Flash wants 96 GB+.
iPhone app	Confirm App Store	Same engine, separate listing.

Getting Started

Download MLXCore.dmg or brew tap ddalcu/mlx-serve https://github.com/ddalcu/mlx-serve && brew install --cask mlx-core.
In the app, download a recommended model sized to the Mac, or run mlx-serve run gemma4 in a terminal.
Point Claude Code with export ANTHROPIC_BASE_URL=http://localhost:11234, or any OpenAI client at the same host.
Confirm Qwen3.8-Flash-Next if that is the checkpoint r/LocalLLaMA was serving.

First-party resource: mlxserve.com and the README.

Frequently Asked Questions

Does it replace Ollama on Mac?

On Apple Silicon, the site says it speaks Ollama's HTTP natively. Other operating systems still need Ollama.

Can I run it on a 5090 PC?

No. That is NInfer's lane. mlx-serve is macOS Apple Silicon.

Is LM Studio required?

No. README positions mlx-serve as a drop-in local server plus a native app, not an Electron host.

Alternatives

Ollama: Local runner plus optional cloud, all major OS.
NInfer: RTX 5090-only Qwen engine.
Claude Code: The agent mlx-serve can host locally.
Qwen3.8-Flash-Next: The long-context checkpoint r/LocalLLaMA was running on it.

Tips

Quote MIT, 1,209 stars, v26.9.2, macOS 26.2+, and port 11234 from pages checked 2026-09-10.
Do not advertise Windows or CUDA.
Keep the default bind on 127.0.0.1 unless you set an API key for LAN use.

Conclusion

mlx-serve is the MIT Apple Silicon server r/LocalLLaMA was using for Flash Next: MLX plus GGUF, OpenAI and Anthropic wires, no Python. Start at mlxserve.com. If you needed a runner that is not a Mac, open Ollama instead.