- Reliability 10/20
- Evidence: The repository includes CI workflows (.github/workflows/ci.yml and deploy.yml) that run extension validation, Node tests, MCP smoke tests, and showcase build. Root package.json lists commands like validate:extension, test, test:mcp-smoke. However, the provided README and manifest do not explicitly show that these tests cover the MCP server's key paths (e.g., tool listing, command execution). The README claims 66 registered MCP tools, but there is no evidence of verification that these tools match real behavior. Therefore, happy path seems plausible, but test coverage and error handling are thin, so reliability is capped at 12.
- Security and permissions 14/20
- Evidence: API keys are encrypted with AES-GCM in Chrome storage; there is a secure config layer and vault unlock flows; sensitive path and origin denylists; upload_file tool has sensitive-path denylist and audit logging (no path persistence); DOM output sanitized with DOMPurify; capability invocation gated by signature, audit, denylist. This shows a fairly comprehensive security posture. However, the actual implementation is not directly verified from source, and there are potentially high-risk operations (execute_js, upload_file) whose permissions and confirmation mechanisms are only described in docs, not confirmed in code. Thus, security score is moderate, and no red lines triggered.
- Maintenance 15/20
- Evidence: Repository is not archived, has 1 open issue, version 0.10.0 (README shows 0.9.90, minor inconsistency). License is NOASSERTION (README claims BSL 1.1, but no license text verified). CI workflows exist, indicating continuous integration. However, there is no evidence of release frequency, issue response time, or dependency update policy. Thus, maintenance activity appears active but with governance/versioning gaps.
- Documentation 15/20
- Evidence: README provides comprehensive overview including quick start, MCP installation commands, client config examples (Claude Code, Codex, VS Code), troubleshooting table, security notes, and architecture diagram. It references mcp/README.md for full tool reference. However, documentation relies on README claims and does not provide source-verified details on tool parameters, limitations, or cost breakdown. The install examples do not contain real tokens. Documentation quality is high but lacks in-depth disclosure of limitations and costs.
- Setup experience 12/20
- Evidence: README provides one-command install for MCP server (e.g., npx -y fsb-mcp-server install --claude-code) and manual config examples (Claude Code, Codex, VS Code). Extension installation requires loading from Chrome Web Store or unpacked. Since this review does not execute installations, and CI tests do not show automated verification of MCP install, setup score is capped at 15. Steps seem clear but rely on external extension installation, which could be fragile.