- Reliability 9/20
- The README describes 19 MCP tools with grouped actions and a dry-run mode that simulates mutations while validating against real data, which is a good design for diagnosability. However, no server manifest was provided, no actual source code (e.g., the handshake logic in src/index.ts) was shown, and no CI workflow or test file contents were visible — only README mentions of `npm test` commands. Per the static calibration rule, without verifiable execution evidence (real CI plus committed tests covering key paths), reliability is capped at 12; given the complete inability to verify that declared tools match real behavior, it is scored 9.
- Security and permissions 10/20
- Credentials are passed via the `TODOIST_API_TOKEN` environment variable, and examples use placeholders rather than real secrets — no credential leakage or hardcoding observed. Dry-run mode is a positive safety feature enabling side-effect-free validation. However, dry-run is off by default, and irreversible operations such as `todoist_task_bulk` (bulk_delete) and `todoist_task` (delete) show no documented additional confirmation step in default mode; the README also does not disclose outbound data flow (e.g., telemetry/logging). Since task/project deletion affects only personal data with limited blast radius, this does not rise to red-line severity (0-4), but evidence of least-privilege design and confirmation for dangerous operations is insufficient, so it is scored 10.
- Maintenance 13/20
- The project is MIT-licensed, has 244 stars and 19 open issues, is not archived, and includes a CHANGELOG.md plus a detailed contribution guide requiring tests, passing CI, and single-concern PRs — signs of active governance. However, no evidence of actual release cadence, recent commit activity, or a dedicated security-response channel (e.g., SECURITY.md) was provided, and dependency-update frequency cannot be confirmed from the given material, so it is scored 13 rather than higher.
- Documentation 16/20
- The README is thorough, covering installation (one-click install, manual JSON config, both major platforms), authentication (token acquisition link), a detailed dry-run mode explanation, a full tool overview table for all 19 tools, extensive natural-language usage examples, a troubleshooting section, and pointers to layered developer docs (TOOLS_REFERENCE.md, architecture breakdown). Rate limits, cost/quota considerations, and security boundaries are disclosed only sparingly, and detailed tool parameter constraints require consulting an external file not verifiable in this review, so it does not receive full marks and is scored 16.
- Setup experience 13/20
- The install path is clear: one-click .mcpb install for Claude Desktop, a `claude mcp add` CLI command, or manual JSON configuration, with config file paths listed for major platforms — a low barrier to entry. However, per the static calibration rule, without verifiable CI/test execution evidence, setup is capped at 15; combined with the lack of a manifest to confirm the tools actually register as documented, this uncertainty brings the score down to 13.