olleh
Ollama-compatible command-line tool for Apple's Foundation Models.
View on GitHub ↗- Stars
- ★ 188
- Last commit
- 26 Sept 2025
- Maintenance
- Stale
- Licence
- MIT
- Category
- Other
- GitHub
- mattt/olleh
Overview
Olleh provides an Ollama-compatible API for Apple's Foundation Models, announced at WWDC 2025. It bridges Apple's on-device model and the Ollama ecosystem with a command-line interface and an HTTP server. Tools and libraries that speak Ollama's API can then use Apple's model.
Features
- olleh serve starts an Ollama-compatible HTTP server (port 11941 by default)
- olleh run starts an interactive chat
- olleh check confirms Foundation Models are available
- Supports custom Foundation Models adapters with --adapter
- Works with the Ollama Swift client library
Requirements
- macOS 26 beta or later
- Apple silicon (M1 or later)
- Xcode 26 beta / Swift 6.2 or later
Install
Install with Homebrew
brew install mattt/tap/ollehCheck availability and start the server
olleh check olleh serve
Example
Start olleh serve and point an Ollama client at http://localhost:11941 to generate text with Apple's default model.
Works with
Listed in
Read the code before you install anything. SwiftAgents doesn't review or endorse the tools listed here. Active: a commit in the last 90 days. Slowing: last commit within the past year. Stale: older than a year, or archived.
More in this category
apfel
Command-line tool, chat mode and local OpenAI-compatible server for the on-device model in Apple's FoundationModels framework. Needs macOS 26 and Apple silicon.
MCP Swift SDK
The official Swift SDK for building MCP clients and servers.
iCTRL
Runs a long-lived XCUITest on a real iPhone and exposes an HTTP API so agents can tap, type, read the UI and take screenshots. Meant for testing on your own devices.