- Reliability 8/20
- Static evidence shows a self-described pure-stdlib, zero-dependency CLI (156KB, 23 modules, 13,415 LOC) with claims of 931 passing tests and a CI badge, plus a reproducible command transcript and a committed tiktoken benchmark path. However, this review reads source only and executes nothing, so the MCP init handshake, tool listing, and declared-vs-actual tool behavior cannot be independently confirmed. Many headline numbers (71,929→581 tokens, 41/41 call accuracy, 'official benchmark') are unverified self-reported metrics, and some statements conflict (both 'measured' and 'your mix will differ'; the demo table shows only 19% while 99.2% is displayed alongside). Error handling, timeouts, and failure fallbacks lack visible evidence, and 'zero dependencies' carries no lockfile or audit trail. Per static calibration, absence of verifiable execution evidence caps this at 12, so it scores 8.
- Security and permissions 10/20
- Visible material claims three built-in layers (destructive actions blocked unless --destructive, prompt-injection scanning, credential-leak detection), no telemetry, no daemon, no stored credentials, and no listening port, with a fairly clear privilege and data-flow description. No red-line behavior is evident: no malware, no covert exfiltration, no default irreversible delete/pay/deploy/remote-command, and no real tokens in examples, so the 0-4 red-line band is not triggered. Nevertheless, every security claim is README self-assertion with no source-level corroboration; destructive-action blocking appears pattern-based with undisclosed bypass risk; false-positive/negative rates, scope, and disable-ability of the injection and credential scanners are unexplained; and the network/supply-chain side of connecting npm/pip/URL servers is under-specified. Missing evidence is a deduction, so 10 rather than full marks.
- Maintenance 11/20
- License is Apache-2.0, versioning is disciplined (0.7.16) and consistent between manifest and README, and there are CI/test badges, a NOTICE with third-party attribution, plus an active ecosystem (ToonDeck, plugin, skill). 201 stars with 1 open issue suggests an active repository. Statically, however, commit cadence, release rhythm, issue response time, a security-response channel (no SECURITY.md evidence), and dependency-update paths cannot be confirmed; the project is still 0.x and leans on forward-dated specs (MCP 2026-07-28, Agent Plugins 1.0.0, TOON v4.1) that cannot be verified. Governance and versioning gaps remain, so 11.
- Documentation 13/20
- Docs are layered and substantial: install commands, a demo verification path, a full command listing, a four-tier format comparison table, a two-bill token breakdown, comparisons against Anthropic/MuleSoft approaches, a security section, contribution/testing guidance, developer docs, and a Chinese README, plus a tiktoken benchmark path and an in-browser calculator, with concrete reproducible examples. Deductions: all headline gains are self-reported with no independent reproduction and some claims conflict ('measured' vs compute-your-own; confusing positioning of compact-by-default versus the 'mcptoon original' slim tier); there is no per-tool parameter reference, error-code table, quota, or rate-limit documentation; compatibility statements cite spec versions ahead of reality (2026-07-28), straining credibility; and troubleshooting cites doctor/quickstart but lacks a known-issues and limitations list. Hence 13.
- Setup experience 13/20
- The install path is short and clear: pip install or a zero-install uvx demo, with PyPI package metadata matching the pypi/stdio transport declared in server.json, plus client configuration examples (Claude Code plugin marketplace, skills add, sync writing native JSON per agent, MCPTOON_AGENT_TYPE env var). Mainstream clients are covered (Claude Code, Cursor, Codex, Cline, etc.) and platform compatibility is illustrated with a Windows/Python 3.12 transcript. Deductions: several optional advanced paths (plugin auto-install, SessionStart hook, the serve bridge, the ToonDeck GUI, Agent Plugins) are unverified without execution; config merge/conflict handling, Node-absent fallback, and per-agent config file locations are undocumented; and the zero-install demo depends on uvx and network fetch. Static calibration caps setup at 15 without execution evidence, so 13.