- Reliability 9/20
- Static evidence is limited to the README and the server.json manifest, with no source files, committed tests, or CI workflow contents. The manifest is structurally complete (name, version 0.2.0, npm identifier @ask-llm/mcp, stdio transport, 16 environment variables with defaults) and the declared tools are consistent with the README. However, the MCP init handshake, tool schemas, and runtime behavior cannot be verified; coupling to six-plus external provider CLIs, 10-minute default timeouts, and fallback chains (Gemini/Codex quota, Claude overload) are asserted only in prose. Per static calibration, reliability is capped at 12; with key paths unverifiable and error handling described only textually, the score is 9.
- Security and permissions 12/20
- Security posture is relatively articulated in the manifest: secret-typed variables (XAI_API_KEY, CURSOR_API_KEY) are marked isSecret: true; providers default to advisory read-only modes (Claude limited to Read/Glob/Grep, ask-cursor-agent read-only ask mode, Antigravity sandboxed by default), and the manifest claims no billing/credit enablement, no Grok harness or model fallback, and a 16384-token output ceiling to bound spend. Residual risks: prompts and repository content are sent to third-party model vendors (external network data boundary) without a manifest-level confirmation or disclosure mechanism; sessionId persistence, Ollama replay, and Cursor/agy CLI invocation scope lack source-level verification; the status of 11 open issues is unknown. No red-line evidence (malware, credential theft, covert exfiltration, irreversible defaults, real tokens in examples) was found, so the 0-4 penalty is not triggered; permissions/confirmation and data-flow disclosure remain incomplete, hence 12.
- Maintenance 11/20
- MIT license, version 0.2.0 consistent between manifest and README, plus CI and release badges, a package migration table, a contributing guide, and a documentation site all indicate active maintenance intent and a release process. Deductions: only 18 stars; 11 open issues with no evidence of response latency or triage; dependency update strategy for seven provider CLIs and multiple npm packages is absent; no SECURITY.md or vulnerability-disclosure channel is present in the supplied material; no commit history, release cadence, or independently verifiable maintainer identity. Static evidence does not support a high score, so 11.
- Documentation 14/20
- Documentation is layered: quick start for Claude Code, Cursor, Codex CLI, Claude Desktop, Pi, and generic STDIO; a provider selection table with default/fallback models and prerequisites (Codex account, Claude Code CLI, XAI_API_KEY, AI Pro/Ultra, local Ollama, enterprise Gemini); explicit disclosure that Gemini CLI became enterprise-gated on 2026-06-18 with alternatives; tool parameter notes (sessionId, outputSchema, usage://current-session resource); doctor diagnostics with --json/--format; cost and timeout defaults; a migration mapping; a disclaimer; and llms.txt for agents. Deductions: model names (gpt-6-astra, grok-4.7, qwen3.8:27b) cannot be corroborated from the supplied material; no per-error-code troubleshooting; some behaviors (codex-pair marker authorization, Fable verification limits) are disclosed but ambiguous; all documentation is repository self-report and is treated as untrusted evidence only. Score 14.
- Setup experience 13/20
- The install path is clear and short: one command (npx -y @ask-llm/mcp) for Claude Code, plus explicit config snippets for Cursor, Codex CLI, Claude Desktop, and generic STDIO clients; doctor diagnostics, a REPL, and a globally installed ask-llm-mcp binary are offered as alternatives. Deductions: prerequisites require Node.js 20+ and Linux/macOS only, with Windows unaddressed; real usability depends on the user installing and authenticating multiple external provider CLIs (Codex, Claude Code, agy >= 1.1.5, gemini login, local Ollama models); Ollama requires a manual pull and Gemini is enterprise-gated, so per-provider failure degrades the corresponding tools; 16 environment variables, though all optional, add configuration complexity; no verifiable installation evidence. Static setup cap is 15, so 13.