- Reliability 6/20
- The 'server manifest' provided is actually a single integration-test case from integ/unix/office/server.json (a cp+wc scenario against onedrive/sharepoint-style targets), not a real MCP tool manifest, init/tool-list handshake description, or behavioral spec. There is no CI workflow evidence, no visible mapping between declared tools and actual behavior, and no demonstration of error handling or dependency control across multiple scenarios. Per the static calibration rule, reliability cannot exceed 12 without real CI plus committed tests covering key paths, and one isolated test fixture falls well short of that bar, so the score stays low.
- Security and permissions 8/20
- The README example stores credentials via environment variables (e.g. SLACK_BOT_TOKEN) rather than hardcoding secrets, which is good practice, and no red-line issue (malware, credential exfiltration, dangerous unconfirmed defaults) is evident. However, Mirage unifies roughly 50 backends (S3, Gmail, Slack, GitHub, MongoDB, etc.) under one filesystem and exposes bash-like destructive operations (cp, rm, etc.) across them, and none of the supplied material shows least-privilege design, cross-resource access boundaries, confirmation gates for risky operations, or scope narrowing. The manifest's own test case (cross-cloud office file copy) shows no permission check or confirmation flow either. The broad blast radius combined with absent control evidence justifies a meaningful deduction.
- Maintenance 10/20
- The repo is Apache-2.0 licensed and not archived, with a high star count (3383, a discovery signal only, not scored) but 106 open issues suggesting some backlog. Nothing in the supplied material shows release history, changelogs, dependency-update cadence, or a security-response channel, so governance quality cannot be confirmed — only the baseline signals (not archived, licensed, apparently active) support a middling score.
- Documentation 12/20
- The README is generally solid: install and quickstart examples for Python/TypeScript/CLI, an architecture diagram, cache-layer explanation, multi-language translations, and an agent-framework integration table. However, there is no documentation at all covering the specific server behavior under review — the office file copy across onedrive/sharepoint, the 'no re-enrichment' semantics, or the expected copy size/behavior — leaving a clear feature-level documentation gap for the exact functionality being tested.
- Setup experience 11/20
- Multiple install paths are offered (uv add, npm install, curl script, npx/uvx) with clear CLI quickstart commands and explicit platform requirements (macOS/Linux, Python ≥3.11, Node ≥20). But no MCP configuration example for a mainstream client (e.g., Claude Desktop) is shown — MCP is only mentioned as one integration path via an external doc link, without a copy-pasteable minimal config. Per the static calibration rule, setup cannot exceed 15 without verifiable execution evidence, so the score is kept below that ceiling.