- Reliability 10/20
- Evidence: server.json and README consistently declare stdio and HTTP transports, and the tool list includes vibe_check, vibe_learn, and constitution-related tools. However, advanced features like vibe_learn and constitution are mentioned in README, but their actual tool list implementation is not verified in the provided source. Maintenance mode indicates no active bug fixes. No actual execution evidence (CI logs, test results) is provided to confirm the server starts cleanly and completes MCP handshake. Therefore, reliability score is capped at 12 due to lack of direct execution verification. Deductions: cannot verify tool declarations match real behavior; no CI logs or test run evidence.
- Security and permissions 12/20
- Evidence: README details HTTP transport hardening (CORS defaults to loopback, Host header validation, request body size limits). API keys are managed via environment variables and marked as secrets. No malicious behavior, credential theft, or irreversible operations by default. However, this static review does not execute code, so these security controls are unverified. Also, prompt injection risk exists (input sanitization not implemented, as per README roadmap). Score 12 because security measures are documented but unverified, and some risks (e.g., prompt injection) remain unmitigated. Deductions: no actual code verification; security controls are only documented; input sanitization not implemented.
- Maintenance 13/20
- Evidence: Repository is active with 503 stars and 3 open issues, and a maintenance mode declaration (only security/bug fixes after v2.9.0). MIT license is present, and SECURITY.md provides a clear reporting channel. Dependency updates are noted in v2.9.0 changelog. However, maintenance mode indicates feature development has stopped, which may affect long-term maintenance. Also, no detailed commit frequency or release dates are provided. Score 13 because maintenance is active with license and security policy, but maintenance mode limits future development. Deductions: no specific evidence of commit/release frequency.
- Documentation 14/20
- Evidence: README is extremely comprehensive, covering installation, providers, models, transports, client configurations, Docker, security, roadmap, FAQ, etc. There are links to many docs like docs/architecture.md, docs/integrations/cpi.md, docs/changelog.md. It includes environment variable tables, configuration options, and troubleshooting tips. However, some doc links may be empty (e.g., docs/TESTING.md link appears non-functional), and limitations/costs are not clearly disclosed. Score 14 because documentation is high quality but has some dead links and missing cost info. Deductions: some doc links may be invalid; missing explicit cost discussion.
- Setup experience 14/20
- Evidence: Provides npx quickstart commands, supports stdio and HTTP transports, and includes client config examples (Claude Desktop, etc.). Requires Node >=20 and has an automatic Docker setup script. However, no actual verified CI tests or installation test results are provided, so score capped at 15. Score 14 because installation steps are clear, but requiring Node version and external API keys may add complexity. Deductions: no verification of installation process; environment variables may be many.