- Reliability 8/20
- No server manifest was available ([not cached]), so the MCP init/tool-list handshake and the claimed "100+ tools" cannot be verified against real behavior. The README references quality-gate commands (bun run test, test:unit) but no CI workflow files or committed tests covering the MCP server's key paths are shown as evidence, which is the 'unverified' condition under the static calibration. Per the rule, reliability cannot exceed 12 without such execution evidence; the missing manifest pushes this further down to 8.
- Security and permissions 12/20
- The MCP server scopes file operations via OPENPENCIL_MCP_ROOT, showing some least-privilege intent, and the AI features are BYOK (user-supplied API keys), reducing credential-exfiltration risk since keys are not server-hosted. However, the CLI/eval feature exposes the full Figma Plugin API and can write files back with the -w flag — a high-impact surface — and neither the README nor the MCP section describes any confirmation step for destructive writes performed through the MCP tool layer. No red-line issues were found (no malware, no credential theft, no irreversible default actions, no real secrets in examples), but permission boundaries and confirmation flows for the MCP layer are incompletely disclosed, warranting a mid-range score.
- Maintenance 11/20
- The project is MIT-licensed, not archived, and the README states 'Active development' with a roadmap link, suggesting ongoing investment. However, the README provides no direct evidence of release cadence, versioning policy, or a security-response channel (e.g., SECURITY.md), and only a single contributor is credited for documentation maintenance, hinting at a small core team. Star count and open-issue count are discovery signals only per the rules and do not add points, so overall maintenance evidence is thin.
- Documentation 15/20
- The README is thorough, covering installation (Homebrew/download/web app), CLI usage examples, both stdio and HTTP MCP connection modes with real JSON config snippets, the OPENPENCIL_MCP_ROOT environment variable, and links to an external docs site, llms.txt/llms-full.txt, and a BYOK provider-compatibility page — showing layered documentation. Gaps include the lack of an inline full parameter listing for the 100+ MCP tools (only linked externally, unverifiable in this review) and no dedicated troubleshooting section.
- Setup experience 13/20
- MCP setup steps are clearly laid out: global npm install, a claude mcp add command, a JSON config example for other clients, and an HTTP mode for scripts/CI, all with concrete commands. Per the static calibration, setup cannot exceed 15 without CI or committed tests verifying these install steps actually work, and no such evidence is present in the reviewed material; cross-platform binary/build details also remain unverified at the source level, so the score is capped at 13.