← Back to directory
O

Off Grid AI

Community
An offline AI suite that runs on your device
GitHub source repository ↗
★ 3.0k Stars Category · Other Very popular Source revision f7ad5e7b23fc
25FMRS · D
Reliability
2/20
Security and permissions
7/20
Maintenance
10/20
Documentation
4/20
Setup experience
2/20

The source clearly documents Off Grid AI as an offline, on-device AI application, but does not establish that the repository root contains an independently installable or callable MCP server. Tools, transports, client compatibility, and install configuration are therefore left unspecified.

Read the FMRS scoring method →

Off Grid AI is a local AI application for Android, iOS, and macOS with GGUF text models, vision, Whisper speech-to-text, Stable Diffusion image generation, tool calling, document analysis, and local-network remote LLM support. The source does not provide an independent MCP server manifest, tool list, transport, or client configuration.

Tools

The tool list has not been reviewed yet.

Setup

The source provides no installation steps or client configuration for an independent MCP server. The README only describes installing the app from app stores, GitHub Releases, or building from the repository root. Building requires Node.js 20+, JDK 17 and Android SDK 36 for Android, and Xcode 15+ for iOS.

Fit and risk

Best for

  • Privacy-conscious users who want data to remain on-device
  • Users needing local AI capabilities on mobile or Mac
  • Users working with GGUF models or local-network model servers

Not for

  • Users seeking a server with explicitly documented MCP tools and transport configuration
  • Users requiring cloud hosting, remote APIs, or verified MCP client compatibility
  • Devices without sufficient hardware resources for the selected models

Required permissions

  • Use device CPU, GPU, or NPU for local model inference
  • Access the microphone for on-device Whisper transcription
  • Access the camera for vision analysis
  • Access local files or documents for attachments and knowledge-base processing
  • Access the local network to connect to OpenAI-compatible remote LLM servers

Risks and side effects

  • Model inference and image generation can consume substantial device resources and memory
  • Hexagon NPU support is marked experimental; some quantizations or model architectures may fall back to CPU or produce garbled output
  • When connected to a remote LLM server on the local network, data is sent to that service; the README does not specify its privacy policy
  • Tool calling may perform searches or query device information and the local knowledge base; no separate MCP permission boundary is documented

Troubleshooting

  1. Confirm that the device meets the relevant Android, iOS, or macOS build requirements
  2. Check that the model quantization matches available GPU or NPU support
  3. If NPU output is incorrect, switch to CPU or a compatible GPU backend
  4. Check local-network connectivity and reachability of the OpenAI-compatible service
  5. Confirm that the app has access to the required microphone, camera, and documents

Use cases

Run local language models offline on a phone or Mac
Use on-device vision, speech transcription, and image generation
Use built-in web search, calculator, date/time, device information, and knowledge-base search tools
Connect to OpenAI-compatible LLM servers on a local network

Supported clients

Supported clients have not been confirmed yet.