- Reliability 10/20
- The manifest declares stdio transport, an npm package, and the README describes initialization and a tool catalog, so the happy path is plausible. However, the manifest repository and package name octocode-mcp differ from the README’s primary @octocodeai/mcp package, and the supplied material contains no CI, commit, test, or MCP handshake evidence. Those gaps reduce confidence; under the static calibration, the score is capped below 12.
- Security and permissions 14/20
- The material states that GitHub credentials use environment variables, the gh CLI, or encrypted storage, with GITHUB_TOKEN marked secret. It also describes local path restrictions, sensitive-file blocking, input/output scanning, allowlisted command arguments, and clone functionality disabled by default for MCP. These support a relatively strong security design. However, the claims are primarily README assertions without auditable implementation or data-flow tests, and the required GitHub scopes repo, read:user, and read:org are broad, so full marks are not justified.
- Maintenance 12/20
- The project is marked unarchived, provides an MIT license, identifies version 16.2.0, and links to a clear GitHub repository and documentation structure, indicating an update path. The supplied material does not show commit cadence, release history, dependency maintenance, vulnerability response, or maintainer governance. Issue count and stars are discovery signals only and add no points, so the score remains moderate.
- Documentation 15/20
- The README covers CLI and MCP installation, several mainstream client configurations, authentication, tool purposes, configuration precedence, path and clone controls, language support, security, architecture, documentation links, and troubleshooting, with many examples. Deductions apply because the manifest and README disagree on package and repository identity, complete tool schemas and operational limits or costs are not included in the supplied material, and several security and capability claims are not source-auditable here. Full marks are therefore not warranted.
- Setup experience 13/20
- The project provides npx launch commands, Claude Code and several mainstream client configurations, and multiple GitHub authentication options. The setup path is generally clear. Points are deducted for inconsistent package/version references, reliance on latest in primary install examples, incomplete runtime and platform prerequisites, and the absence of real connection or CI evidence; under static calibration, the score remains at or below 15.