This repository provides access to Apple's built-in large language models via Node.js and Python packages, requiring only macOS 26+ on Apple Silicon and the Xcode Command Line Tools. It offers two tiers of interaction: an on-device tier using a small sparse model (AFM 3 Core Advanced) that ensures privacy and guaranteed JSON output through constrained decoding, and a cloud tier via Apple's Private Cloud Compute which provides more powerful reasoning capabilities but sends prompts off the machine.
- The library includes both npm (`apple-llm`) and PyPI (`apple-llm`) packages.
- On-device models are noted to be poor at code generation and long reasoning tasks.
- Structured JSON output is guaranteed on-device via a specific "GenerationSchema" dialect used by Apple's decoder.
- The cloud tier uses Shortcuts as an intermediary because the direct Private Cloud Compute API requires restricted developer entitlements.
- Users can utilize built-in tools like OCR, barcode reading, and Spotlight semantic search for local RAG (macOS 27+).
- The library includes both npm (`apple-llm`) and PyPI (`apple-llm`) packages.
- On-device models are noted to be poor at code generation and long reasoning tasks.
- Structured JSON output is guaranteed on-device via a specific "GenerationSchema" dialect used by Apple's decoder.
- The cloud tier uses Shortcuts as an intermediary because the direct Private Cloud Compute API requires restricted developer entitlements.
- Users can utilize built-in tools like OCR, barcode reading, and Spotlight semantic search for local RAG (macOS 27+).
This article demonstrates how developers can transition from an empty repository to a live website on a custom domain with HTTPS in approximately 14 minutes without manual DNS configuration. Using GitHub Copilot CLI combined with Namecheap's API, the process automates repetitive tasks like updating A records and CNAME entries through conversational commands.
- Deploying content using GitHub Pages via Copilot CLI prompts.
- Registering a low-cost top-level domain.
- Connecting the registrar to Copilot CLI by installing specialized skills and enabling API access.
- Automating DNS record updates, CNAME file creation, and final deployment verification.
- Deploying content using GitHub Pages via Copilot CLI prompts.
- Registering a low-cost top-level domain.
- Connecting the registrar to Copilot CLI by installing specialized skills and enabling API access.
- Automating DNS record updates, CNAME file creation, and final deployment verification.
A guide on setting up a local environment, building, and deploying an intelligent textbook website using Mkdocs Material. Includes steps from prerequisites to testing the final site.
