olleh

Ollama-compatible command-line tool for Apple's Foundation Models.

View on GitHub ↗
Stars
★ 188
Last commit
26 Sept 2025
Maintenance
Stale
Licence
MIT
Category
Other
GitHub
mattt/olleh

Overview

Olleh provides an Ollama-compatible API for Apple's Foundation Models, announced at WWDC 2025. It bridges Apple's on-device model and the Ollama ecosystem with a command-line interface and an HTTP server. Tools and libraries that speak Ollama's API can then use Apple's model.

Features

  • olleh serve starts an Ollama-compatible HTTP server (port 11941 by default)
  • olleh run starts an interactive chat
  • olleh check confirms Foundation Models are available
  • Supports custom Foundation Models adapters with --adapter
  • Works with the Ollama Swift client library

Requirements

  • macOS 26 beta or later
  • Apple silicon (M1 or later)
  • Xcode 26 beta / Swift 6.2 or later

Install

  1. Install with Homebrew

    brew install mattt/tap/olleh
  2. Check availability and start the server

    olleh check
    olleh serve

Example

Start olleh serve and point an Ollama client at http://localhost:11941 to generate text with Apple's default model.

Works with

Not stated by the source

Listed in

GitHub search

Read the code before you install anything. SwiftAgents doesn't review or endorse the tools listed here. Active: a commit in the last 90 days. Slowing: last commit within the past year. Stale: older than a year, or archived.

More in this category