- Reliability 6/20
- The server manifest is uncached, so there is no way to cross-check the 23 tools described in the README against actual server behavior, and no test files, CI workflows, or documented error-handling/retry behavior are present. The README's tool/parameter descriptions are internally consistent and plausible, but there is no reviewable execution evidence (no scripts, tests, or sample logs). Per the static calibration rule this cannot exceed 12, and the missing manifest pushes it lower still.
- Security and permissions 12/20
- Authentication uses a Bearer API key supplied via environment variable; the install example uses a placeholder key, not a real secret. The README claims SHA-256 hashed key storage, parameterized queries, per-request ownership verification, subscription gating, and rate limiting (60 req/min), but these are unverified self-reported claims with no supporting code shown. More notably, bountylens_delete_session/delete_entry/delete_report are irreversible delete operations (delete_session cascades to all entries and reports in that session) with no explicit confirmation parameter or soft-delete/undo path described — a real risk of accidental data loss. Because the blast radius is scoped to the user's own data and not system-level/payment/remote-execution, this falls short of a full red-line but still warrants a meaningful deduction.
- Maintenance 9/20
- The repo is MIT licensed and not archived, with 64 stars and 0 open issues, but the supplied material contains no commit history, release cadence, changelog, or security-response channel information, so maintenance activity and versioning maturity cannot be verified — only a mid-low score is justified.
- Documentation 16/20
- The README is well organized: quick start, an environment variable table, all 23 tools described by category with parameters, a full REST API endpoint listing, tag conventions, usage examples, and a security section. Gaps include no troubleshooting section, no documented error codes/failure modes, and the hard requirement of a paid Pro subscription is only briefly noted near the end rather than surfaced as a prerequisite up front.
- Setup experience 13/20
- Setup is simple on paper: run via npx, configure a single required environment variable, and a ready-made Claude Code JSON config is provided. However, as this is a purely static review with no CI or committed tests demonstrating the config actually works, the setup score is capped at 15 per the calibration rule. The server also depends on an external paid (Pro) subscription to function at all, adding a hidden barrier to reaching a genuinely working connection.