- Reliability 8/20
- The manifest is well-formed (schema reference, npm package, stdio transport) and is logically consistent with the README's description of a 5-endpoint MCP-AQL design. However, this review is based only on the README and manifest text — no actual CI workflow files or test source code were inspected. Claims like '9600+ Tests' and SonarCloud badges are self-reported and unverified. The README itself admits that advanced features (Gatekeeper confirmation flow, agentic loop) have been 'tested extensively on Claude Code' but 'not rigorously verified on all platforms,' indicating real uncertainty in cross-platform behavior. Per the static calibration rule, absent verifiable CI/test evidence, reliability cannot be scored high.
- Security and permissions 12/20
- The documentation describes a fairly detailed permission model: a server-side Gatekeeper enforcing deny > confirm > allow policy resolution, per-endpoint confirmation tiers (reads auto-approved, deletes/execute requiring confirmation each time), input sanitization, path traversal protection, DOMPurify, and an explicitly local-first design with optional GitHub sync. No red-line evidence appears (no malware, credential theft, or real secrets in examples), and no irreversible destructive default actions are described. However, all of this is self-reported in the README and could not be checked against actual server source code to confirm the Gatekeeper truly behaves as claimed. The scope, storage, and handling of GITHUB_TOKEN are also not detailed, leaving an unverified risk surface, so full marks are not warranted.
- Maintenance 12/20
- The manifest's version (2.0.42) and the README's v2.0.0 release notes, migration guide, CI badges, and SonarCloud quality gates suggest active ongoing development, with contribution guidelines and community channels (Discord, Discussions) in place. However, the repository has 929 open issues against only 39 stars — a disproportionately large backlog for its size — suggesting possible issue triage or maintenance-capacity strain, which is a clear warning sign and warrants a deduction.
- Documentation 16/20
- The documentation set is well-layered: quick start, public beta onboarding, an LLM quick reference, architecture docs, a security model doc, API reference, migration guide, troubleshooting guide, and environment variable reference are all present. The README also proactively discloses limitations, such as a table of varying permission-hook support across MCP clients and explicit caveats about unverified cross-platform behavior — a good sign of documentation honesty and coverage. Points are deducted because the linked document contents themselves were not reviewed/verified, and some operationally important details (GITHUB_TOKEN scope, specific error codes/rate limits) remain thin at the README summary level.
- Setup experience 13/20
- The README offers multiple installation paths (an npx-based one-click web wizard, a one-line `claude mcp add` command, and a double-click .mcpb desktop extension), along with an environment variable table and a cross-client permission-hook compatibility matrix — the steps are clear and cover mainstream clients. Per the static calibration rule, however, no verifiable CI workflow or committed tests covering key setup paths were found in the reviewed material, so the score must be capped (≤15). Additionally, the README's own table shows permission-hook support is only 'partial' on several platforms, indicating real-world setup may be functionally incomplete on some clients, which keeps the score below the cap.