- Reliability 4/20
- The README claims a built-in FlyEnv MCP Server exposing services, sites, configs, logs, and selected lifecycle actions, and a screenshot is referenced, but no server manifest, MCP tool list, tests, or CI execution evidence was available in the reviewed material. Nothing was executed, and the static calibration prevents awarding above 12 without verifiable execution evidence. Score deducted for missing handshake/tool-list evidence and no error-handling documentation.
- Security and permissions 5/20
- The described MCP surface (read configs, expose services/ports/logs, trigger selected lifecycle actions) is a meaningful attack surface, yet no permission model, confirmation flows for destructive actions, or data-boundary disclosure appears in the reviewed material. No red-line violation (malware, token leakage, covert exfiltration) is evidenced, so the score stays above 4, but least-privilege and confirmation details are undocumented.
- Maintenance 13/20
- Evidence of sustained maintenance: current release v4.17.2 with installers for three OSes, GitHub Actions build transparency, BSD-3-Clause license, code-signing sponsorship, contribution guide, and community channels. Deductions: commit frequency, issue response time, and dependency-update history could not be verified from the provided material, and the score is rounded down under uncertainty; stars are treated only as a discovery signal.
- Documentation 10/20
- The README offers layered general documentation: feature lists, supported modules, OS-specific install steps, screenshots, video demos, a DEV.md link, and an architecture analysis link. However, MCP-specific documentation is missing: no tool catalog, parameter definitions, auth/security model, limits, costs, or troubleshooting for the MCP server; the only MCP guidance is 'register the built-in server' plus a screenshot, which leaves hidden assumptions.
- Setup experience 9/20
- Desktop app installation is clear with installers, portable builds, Homebrew, DMG, .deb, and .rpm packages for Windows/macOS/Linux. But MCP setup is only vaguely described ('register the built-in FlyEnv MCP Server into supported clients'), with no client config JSON examples, no manifest evidence, and the server path being the repository root of an Electron app. Per static calibration, setup cannot exceed 15 without verifiable execution evidence (CI/tests), and none was provided.