- Reliability 9/20
- The README describes optional MCP mounting, 21 tools, authentication providers, scope checks, and audit tagging, and it references pytest, ruff, ty, and CI checks, making the normal path plausible. However, the manifest is not cached and there is no MCP-specific test result or tool-level execution evidence, so initialization, tool-list handshake, parameter contracts, and error handling cannot be verified. This deduction keeps the static score at or below 12.
- Security and permissions 15/20
- The evidence shows that MCP is off by default, supports Cloudflare/OIDC bearer-token verification, validates OIDC signature, issuer, expiry, and audience, applies scopes and per-tool authorization, and limits MCP writes to pending requests rather than direct approval or permission mutation. MCP activity is also audit-tagged. Points are deducted because the default fallback scope includes create_requests, writes have no explicit second-step confirmation mechanism, and the supplied material cannot verify implementation details, rate limiting, sensitive-data boundaries, or all failure paths. No red-line condition is evidenced.
- Maintenance 11/20
- The repository is not archived, declares Apache-2.0 licensing, and documents locked dependencies, a CI client-drift check, and test/lint/type-check commands, indicating some maintenance foundation. Points are deducted because the material provides no release history, commit activity, issue-response record, dependency-update evidence, clearly identified maintenance team, or security-response channel. Stars and issue counts are not credited.
- Documentation 16/20
- The README gives substantial coverage of deployment, database setup, OIDC/Cloudflare authentication, MCP enablement, tool categories, scope semantics, discovery, auditing, development mode, and limitations, with environment-variable examples. Points are deducted because it lacks per-tool parameter and return-value documentation, complete mainstream-client configuration examples, cost or resource-impact guidance, and concrete troubleshooting or verifiable run results.
- Setup experience 12/20
- The README provides steps covering Python/uv, database setup, Okta, Docker, production authentication, and local MCP use, including the MCP endpoint and development mode. Points are deducted because a working connection depends on deploying Access, configuring Okta/Cloudflare or OIDC, setting up a database, and supplying a high-privilege Okta API token. There is no complete configuration example for a mainstream MCP client, and the setup remains manual and environment-heavy. The static calibration therefore caps this at 15.