Unclaimed project

Are you a maintainer of apple-on-device-openai? Claim this project to take control of your public changelog and roadmap.

Changelog

apple-on-device-openai

OpenAI-compatible API server for Apple on-device models

83559Swift

Last updated 6 months ago

NewJune 17, 2025

v1.0.1 — First public release

Spins up a local server that speaks the OpenAI /v1/chat/completions API, backed by the new macOS 26 Apple Intelligence models.
Everything runs on-device (no network, no keys).
Streaming responses ("stream": true) already supported.
Basic health endpoints: /health, /v1/models.

Point any OpenAI-compatible client at http://127.0.0.1:11535 and chat away!