- Reliability 8/20
- Static evidence suggests reasonable diagnosability and partial reproducibility: the README cites a GitHub Actions CI (R functional checks plus a real MCP stdio handshake) guarding every push, and documents concrete failure-mode fixes (Windows liveness probe, output-sink restoration, idempotent async results, log ordering). The manifest version 0.16.0 matches the PyPI package and stdio transport is declared. However, no verifiable execution evidence exists in the supplied material: no committed tests, no CI config body (only a badge reference), no validation beyond the manifest. The 41-tool list and token-cost claims are self-reported and unverifiable. Per the static calibration, reliability cannot exceed 12 without real CI workflows plus committed tests covering key paths. Deducted to 8 because the happy path is plausible but edge cases, tool-vs-declared behavior parity, and dependency controllability lack evidence.
- Security and permissions 9/20
- The project discloses and partly mitigates real risks: an always-on Origin-header block (prevents drive-by cross-origin POSTs), an opt-in session token (0600 discovery file, X-Clauder-Token), and an explicitly honest statement that validate_code_security() is a regex blocklist 'seatbelt, not a sandbox' that is trivially bypassable. It also devotes a section to prompt-injection risk (arbitrary R execution + untrusted third-party documents + file/network reach). But the overall model is a supervised power tool: the agent executes arbitrary R in the live session, reads any user-readable file, installs packages, makes network calls, with no per-operation confirmation and no sandbox. The token is off by default for backward compatibility, so default deployments remain injectable by any local process. This stops short of a scored red line (no irreversible/remote-command default without confirmation, no credential theft/exfiltration), but least privilege, explicit confirmation, and data-flow scoping are incomplete, hence 9.
- Maintenance 12/20
- The repository is active: recent versioned releases (R 0.16.0 / clauder-mcp 0.16.0), a changelog-style update log, a referenced CI workflow, dependency pinning (mcp<2 to survive the 2.0.0 break), installer backward-compatibility and upgrade notes, 342 stars and only 17 open issues. Governance gaps remain: the license is NOASSERTION while the README badge claims MIT (an unresolved contradiction), there is no documented security-response channel or disclosure process, and no release signing or supply-chain verification is described. Active maintenance plus these governance gaps yields 12.
- Documentation 14/20
- Documentation is strong and layered: quick start, per-tool parameter descriptions (41 tools, including start_line/end_line, path, capture_output), Reviewer Zero / Referee Mode protocol examples, dedicated Logging and Security Model sections, an R-vs-Python capability table, and Troubleshooting/Limitations (async has no environment sharing, port conflicts, RStudio Server 8787 clash, uv dependency). It also discloses cost figures (about 4,500 tokens per image, about 8,600 tokens of schema for 41 tools). Deductions: hidden assumptions (user must install uv/devtools, manually paste CLI config), unverifiable capability claims (benchmark 21.3/24 detection, Referee Mode efficacy) with no external evidence, a manifest description narrower than the README (manifest says only 'interactive R coding and data analysis' while the README claims manuscript auditing and multi-agent features), and the MIT-vs-NOASSERTION license contradiction. Score 14 rather than higher because of self-reported performance numbers and the license conflict.
- Setup experience 13/20
- The install path is clear but multi-step and partly manual: install the R package via devtools::install_github, run claudeAddin() and click Start Server, then per client run install_clauder() (desktop, uvx by default) or install_cli() (CLI, requiring manual copy of printed command/JSON into ~/.gemini configs) and restart the client. uvx enables near-zero-config but needs uv installed, with a use_uvx=FALSE fallback; it claims RStudio/Positron support, R>=4.0, Python>=3.9. Deductions: manual application of CLI config, non-uniform install paths per tool, a Positron-specific suggest_edit behavior difference, and needing to re-run installers after R upgrades. With no execution evidence the static cap is 15; final score 13.