afm-Server

Menu bar app that serves Apple's on-device Foundation Models as an OpenAI-compatible local API.

View on GitHub ↗
Stars
★ 194
Last commit
2 Jun 2026
Maintenance
Slowing
Licence
MIT
Category
Other
GitHub
Techopolis/afm-Server

Overview

afm-server from Techopolis is a macOS menu bar app that exposes Apple Intelligence's on-device Foundation Models through a local HTTP server. It offers OpenAI- and Ollama-compatible endpoints, so existing apps and tools can use Apple's model. It also handles multi-turn sessions and recovers when a safety guardrail fires.

Features

  • Local server with OpenAI- and Ollama-compatible endpoints
  • Start, stop and configure from the menu bar
  • Token-by-token streaming with Server-Sent Events
  • Caches sessions for multi-turn conversations
  • Recovers from guardrail refusals by starting a fresh session
  • Settings for system prompt, history and debug logging

Requirements

  • macOS 26.0 (Tahoe) or later
  • Apple silicon (M1 or later)
  • Apple Intelligence turned on
  • Xcode 26.0 or later to build from source

Install

  1. Download the latest release from the Releases page and launch it; it appears in the menu bar

  2. Test it

    curl http://127.0.0.1:11435/debug/health

Works with

Not stated by the source

Listed in

GitHub search

Read the code before you install anything. SwiftAgents doesn't review or endorse the tools listed here. Active: a commit in the last 90 days. Slowing: last commit within the past year. Stale: older than a year, or archived.

More in this category