Skip to content
Back to search

mlx-serve

Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

Safety scan

A static text scan, not a guarantee. Select the badge to see what was scanned and every finding.

Checked today

Check it deeper on your machine

It has changed since its scan on 11 Nov 2026.

As a Claude Code plugin, install it and then ask Claude Code:

/plugin marketplace add keithmackay/mackayi/plugin install scanskillsafety@mackayiDo a deep scan of https://github.com/ddalcu/mlx-serve with scanskillsafety

Or from a terminal, clone it and run it:

git clone https://github.com/keithmackay/scanskillsafety-skill ~/.claude/skills/scanskillsafetynode ~/.claude/skills/scanskillsafety/cli.cjs --deep 'https://github.com/ddalcu/mlx-serve'

It checks the exact commit: every file, its packages against OSV (api.osv.dev), how it compares with this page's scan (findsafeskills.com receives the repository's address), and, if you agree, Claude reading every file with your own Claude subscription. It never runs the code.

Badge for your README
findsafeskills safety rating

Markdown

[![findsafeskills safety rating](/api/listings/ddalcu--mlx-serve/badge.svg)](/listings/ddalcu--mlx-serve)

HTML

<a href="/listings/ddalcu--mlx-serve"><img src="/api/listings/ddalcu--mlx-serve/badge.svg" alt="findsafeskills safety rating" /></a>

Install

i

Install instructions from the README

As written by the repo's author. findsafeskills has not verified these steps.

brew tap ddalcu/mlx-serve https://github.com/ddalcu/mlx-serve
brew trust ddalcu/mlx-serve
brew install --cask mlx-serve  # the app (recommended)
brew install mlx-serve         # CLI + server only, no GUI

To upgrade, name the package (the app also updates itself from its menu):

brew update
brew upgrade --cask mlx-serve  # the app
brew upgrade mlx-serve         # the CLI

What was scanned

The files the safety scan read, as written by the repository's author and shown as plain text. Lines with a finding are marked.

README.md · README · 141 lines

View this file on GitHub (read at the repository's current version: the scan did not record which commit it read)

This file has changed since it was scanned, so this is not exactly the text that was scanned, and no line is marked. The findings are listed with the safety scan above.

  1. ![MLX-Serve, a local LLM and media server for Apple Silicon](website/assets/mlx-serve-header.jpg)
  2. # MLX-Serve
  3. Run open models on your Mac: chat, coding agents, images, video, music, speech and 3D. One native app and one local server that speaks the OpenAI, Anthropic and Ollama APIs. It runs offline, needs no Python and no account, and it's MIT licensed.
  4. [![Release](https://img.shields.io/github/v/release/ddalcu/mlx-serve?style=flat-square&color=0071e3)](https://github.com/ddalcu/mlx-serve/releases/latest)
  5. [![Downloads](https://img.shields.io/github/downloads/ddalcu/mlx-serve/total?style=flat-square&color=30d158)](https://github.com/ddalcu/mlx-serve/releases)
  6. [![Stars](https://img.shields.io/github/stars/ddalcu/mlx-serve?style=flat-square&color=f7a41d)](https://github.com/ddalcu/mlx-serve/stargazers)
  7. [![License: MIT](https://img.shields.io/badge/license-MIT-blue?style=flat-square)](LICENSE)
  8. **[Download for Mac](https://github.com/ddalcu/mlx-serve/releases/latest/download/MLX-Serve.dmg)** · [Homebrew](#install) · [iPhone](https://apps.apple.com/us/app/mlx-chat-local-ai/id6787603518) · [Linux](#linux-and-windows) · [mlxserve.com](https://mlxserve.com/) · [简体中文](README.zh-CN.md)
  9. ![Chatting with a local model, making a picture and coding with Claude Code, all on one Mac](website/assets/demo.gif)
  10. ## Install
  11. **The app.** [Download MLX-Serve](https://github.com/ddalcu/mlx-serve/releases/latest/download/MLX-Serve.dmg), drag it to Applications and open it. It needs macOS 26.2 or later on Apple Silicon, suggests a model that fits your Mac, and updates itself.
  12. **Homebrew.**
  13. ```bash
  14. brew tap ddalcu/mlx-serve https://github.com/ddalcu/mlx-serve
  15. brew trust ddalcu/mlx-serve
  16. brew install --cask mlx-serve # the app
  17. brew install mlx-serve # or only the command-line server
  18. ```
  19. **The terminal**, if you know Ollama:
  20. ```bash
  21. mlx-serve run gemma4 # downloads Gemma 4 E4B, serves it and chats right here
  22. mlx-serve pull gemma4:26b # download only, resumable
  23. mlx-serve serve # serve everything you downloaded; models load when asked for
  24. ```
  25. The server listens on `http://localhost:11234`. Point any OpenAI, Anthropic or Ollama client at it, or open that address in a browser for the built-in web console.
  26. ### iPhone
  27. [MLX-Serve](https://apps.apple.com/us/app/mlx-chat-local-ai/id6787603518) puts the same engine on your iPhone: chat with Gemma 4, clone your voice, and make pictures and music, all on the phone and offline. It needs an A17 Pro-class iPhone or newer with iOS 26.
  28. ### Linux and Windows
  29. Every release has Linux downloads for NVIDIA GPUs: x64 for RTX 20 to 50 cards, arm64 for DGX Spark, GH200 and Jetson Thor. On Windows with an NVIDIA card, one script builds it. Details are in [docs/building.md](docs/building.md#linux-and-windows-nvidia).
  30. ## What it does
  31. - **Coding agents on a local model.** `mlx-serve launch claude` starts Claude Code against your Mac, set up with the model's real context window. Codex, OpenCode, pi, Grok and others work the same way. [Integrations](docs/integrations.md)
  32. - **Pictures, video, music, speech and 3D.** FLUX.2, Qwen-Image, Krea, MOSS-Image, LTX-Video, MiniMax-H3, ACE-Step, YuE2, Qwen3-TTS with voice cloning, and Hunyuan3D, in the app or over HTTP. [The app](docs/app.md)
  33. - **Transcripts and meeting notes.** Speech to text in 30 languages, with word timings and who said what. The menu bar records a call and writes the notes. [API](docs/api.md#other-endpoints)
  34. - **Models bigger than your Mac.** GLM-5.3-Flash and DeepSeek-V4.1-Flash run on a 128 GB Mac by reading their experts from the SSD. Two Macs on a Thunderbolt 5 cable can run one model together, and Macs on your network can use each other's models. [CLI](docs/cli.md) · [FAQ](docs/faq.md#can-my-macs-share-models-over-the-network)
  35. - **An assistant that lives on your Mac.** Chat with your documents, talk to it hands-free, give agents a sandboxed shell and MCP tools, or schedule tasks in plain English. [The app](docs/app.md)
  36. - **The APIs your tools already use.** OpenAI chat, completions and Responses, Anthropic Messages and Ollama, all on one port, with streaming, tool calls, JSON schemas, vision and reasoning. [API](docs/api.md)
  37. ## What can my Mac run?
  38. The app suggests a first model for your Mac's memory:
  39. | Memory | Suggested model |
  40. |---|---|
  41. | 16 GB | Gemma 4 E4B |
  42. | 18–24 GB | Gemma 4 12B |
  43. | 32 GB | Qwen 3.8 27B |
  44. | 36 GB | Qwen 3.8 27B 6-bit |
  45. | 48–64 GB | Qwen 3.8 27B 8-bit |
  46. | 96 GB and up | Qwen3.8-Flash-Next (125B, about 6B active per token) |
  47. | 128 GB | Also GLM-5.3-Flash and DeepSeek-V4.1-Flash, their experts streamed from the SSD |
  48. | 256 GB | Also GLM-5.3-Flash in memory (NVIDIA's FP4 pack) |
  49. Thousands more run too: any MLX model with a supported architecture, and any GGUF. The [tier list](https://mlxserve.com/llm-tier-list/) ranks the popular ones, and [docs/models.md](docs/models.md) lists every architecture.
  50. ## Speed
  51. Decode speed in v26.11.1 on an M5 Ultra with 256 GB, on a code prompt, with speculative decoding on:
  52. | Model | Tokens per second |
  53. |---|---:|
  54. | Qwen3.6 35B-A3B, 4-bit | 421 |
  55. | Qwen3.8 27B, 4-bit | 243 |
  56. | Gemma 4 E4B, 4-bit | 200 |
  57. | Gemma 4 26B-A4B, 4-bit | 184 |
  58. | Qwen3.8-Flash-Next, 4.7 bits | 180 |
  59. On an M4 Max, the same models decode 10% to 51% faster than they did in v26.8. Every release is measured the same way in [benchmarks.md](benchmarks.md); speculative decoding and tuning are in [docs/performance.md](docs/performance.md).
  60. ## Docs
  61. - [Integrations](docs/integrations.md): Claude Code, Codex, OpenCode, pi, Zed and more
  62. - [HTTP API](docs/api.md): OpenAI, Anthropic, Ollama and the media endpoints
  63. - [CLI and server flags](docs/cli.md)
  64. - [The Mac app](docs/app.md), with the media tour
  65. - [Supported models](docs/models.md)
  66. - Write a plugin without rebuilding the server: [model](docs/plugin-model.md), [media](docs/plugin-media.md), [quant](docs/plugin-quant.md)
  67. - [Performance and tuning](docs/performance.md)
  68. - [Building from source](docs/building.md) and [NVIDIA GPUs](docs/CUDA.md)
  69. - [FAQ](docs/faq.md) and the [changelog](CHANGELOG.md)
  70. ## Build from source
  71. You need Xcode 26.2 or later and [Homebrew](https://brew.sh):
  72. ```bash
  73. git clone --recurse-submodules https://github.com/ddalcu/mlx-serve && cd mlx-serve
  74. ./app/build.sh
  75. ```
  76. The script fetches the pinned Zig, builds MLX and llama.cpp, and signs the app ad hoc. There's no Python anywhere in the build. Server-only builds are in [docs/building.md](docs/building.md).
  77. ## Community
  78. Questions, ideas and things you made: the [community chat on X](https://x.com/i/chat/group_join/g2108335256541741397/K38XS6aGRh) and [GitHub issues](https://github.com/ddalcu/mlx-serve/issues). Builds and deep dives go out on [YouTube](https://www.youtube.com/@DavidDalcu) and [X](https://x.com/ddalcu).
  79. ## Thank you
  80. Thank you to the sponsors who back mlx-serve: @jcprichard, @skudinov, @davidfekke, @lojza3d, @cpko, @d-b, @alinselea, Johnny Dang and @R0xr1te. If it's useful to you, you can support it on [GitHub Sponsors](https://github.com/sponsors/ddalcu) or [Buy Me a Coffee](https://buymeacoffee.com/ddalcu). Nothing is paywalled: it's MIT now and stays MIT.
  81. Thank you also to everyone who sends code, reports and ideas. The [contributors page](https://github.com/ddalcu/mlx-serve/graphs/contributors) shows the code side, and the [changelog](CHANGELOG.md) thanks people release by release.
  82. ## Acknowledgements
  83. mlx-serve builds on [MLX](https://github.com/ml-explore/mlx), [mlx-c](https://github.com/ml-explore/mlx-c), [mlx-lm](https://github.com/ml-explore/mlx-lm), [llama.cpp](https://github.com/ggerganov/llama.cpp), [antirez/ds4](https://github.com/antirez/ds4), [mlx-stream](https://github.com/davidtai/mlx-stream), [Sushi](https://github.com/beamivalice/sushi), [jinja.cpp](https://github.com/wangzhaode/jinja.cpp), [nlohmann/json](https://github.com/nlohmann/json), [stb_image](https://github.com/nothings/stb), [libwebp](https://chromium.googlesource.com/webm/libwebp), [Hugging Face tokenizers](https://github.com/huggingface/tokenizers) and [Zig](https://ziglang.org). It runs the open models their authors published, and the app uses the [Anthropic](https://github.com/anthropics/swift-sdk) and [MCP](https://github.com/modelcontextprotocol/swift-sdk) Swift SDKs.
  84. Licenses and required notices are in [NOTICE](NOTICE). If we missed you, please open a PR.
  85. ## Star history
  86. <picture>
  87. <source media="(prefers-color-scheme: dark)" srcset="docs/star-history-dark.svg">
  88. <img alt="GitHub star history for ddalcu/mlx-serve" src="docs/star-history.svg">
  89. </picture>
  90. <!-- regenerate with: python3 scripts/star-chart.py -->
  91. [![ddalcu%2Fmlx-serve | Trendshift](https://trendshift.io/api/badge/repositories/43025)](https://trendshift.io/repositories/43025)
  92. If mlx-serve is useful to you, a star helps other people find it.
  93. ## License
  94. MIT, see [LICENSE](LICENSE). Bundled third-party code keeps its own license: [NOTICE](NOTICE) lists it with the required attributions, and [LICENSE-APACHE-2.0](LICENSE-APACHE-2.0) has the Apache license text.

Ratings and comments

Sign in to rate this skill.

Sign in

Free to use. If it’s helped, pass it on.