- Reliability 8/20
- The README lists ~20+ tools with descriptions that are broadly consistent with the stdio transport and npm package declared in server.json (e.g., codacy_list_repository_issues, codacy_cli_analyze), suggesting a coherent design. However, no CI workflow or test files are present in the provided evidence, the package version is still 0.0.1, and the automatic CLI install/initialization behavior lacks documented error handling, so key paths cannot be confirmed as reproducible or diagnosable from static evidence alone. Per the static calibration rule, reliability is capped below 12 absent CI+test evidence, so this is scored 8.
- Security and permissions 10/20
- CODACY_ACCOUNT_TOKEN is correctly marked as a secret, optional, and passed via environment variable — no hardcoded credentials or evidence of covert exfiltration were found. However, two under-disclosed risks remain: (1) the server automatically attempts to install and initialize the external Codacy CLI binary whenever an analysis request is received, with no stated user-confirmation step; (2) the codacy_cli_analyze tool can 'Apply fixes' to local code automatically, again with no described confirmation or scoping mechanism. These are moderate automated side-effect risks rather than red-line violations (no malware or irreversible destructive default was evidenced), but the incomplete confirmation/least-privilege disclosure warrants a deduction, landing at 10.
- Maintenance 10/20
- The repository is not archived, has 62 stars and 3 open issues, indicating some visibility, but no release cadence, commit history, or security-response channel evidence was supplied. Notably, there is a license contradiction: the repository metadata shows License: NOASSERTION, while the README states 'This MCP server is licensed under the MIT License' — an unresolved inconsistency with no LICENSE file confirmation available. The package version remains at 0.0.1, suggesting an early-stage project. These issues bring the score down to 10.
- Documentation 15/20
- The README is well organized, covering a categorized feature/tool list, install instructions for multiple IDEs (Cursor, Windsurf, VS Code Copilot, Claude Desktop), NVM troubleshooting, a contribution guide, and local Inspector testing instructions — overall solid documentation quality. It lacks per-tool input parameter schemas, rate limits, or cost/quota disclosure (Codacy account/API limits), and there is no dedicated section on security boundaries or data flow, so it falls short of full marks at 15.
- Setup experience 13/20
- Clear multi-client JSON configuration examples are provided (Cursor one-click install, VS Code one-click install, Windsurf, manual Claude Desktop config), plus NVM-specific troubleshooting, making the install path generally clear. However, full functionality (local CLI analysis) depends on the server automatically downloading/installing an external Codacy CLI binary at runtime, with no default confirmation or version pinning beyond an optional CODACY_CLI_VERSION variable, adding fragility. Per the static calibration rule, setup cannot exceed 15 without verifiable execution evidence (CI+tests), so this is scored 13.