- Reliability 3/20
- No server manifest, source code, launch command, tool definitions, tests, or CI evidence is provided. The README only claims that several MCP servers exist, so MCP initialization, tool-list handshake, dependency control, and error behavior cannot be verified. The score is heavily reduced for missing executable evidence.
- Security and permissions 6/20
- The README mentions sandboxed file I/O, an OIDC ingress, and tenant isolation, but provides no reviewable evidence for permission scopes, credential handling, network access, data flows, dangerous-operation confirmation, or implementation. GitHub workflows, runtime mutation, and cloud deployment imply meaningful side effects. There is no evidence of malware or credential theft, so no red line is triggered, but controls remain insufficiently auditable.
- Maintenance 13/20
- The repository is marked non-archived, uses the MIT license, and describes named human and AI maintainers, ongoing PR/issue activity, and a public contribution workflow. These claims are primarily README evidence; verifiable release cadence, commit history, dependency updates, and security-response procedures are absent, so the score cannot approach full marks.
- Documentation 8/20
- The README gives extensive conceptual and architectural coverage and links to deployment, architecture, and Agent OS material. However, it lacks a reviewable MCP manifest, tool parameters, authentication configuration, limits, cost information, troubleshooting, and client connection examples. Conceptual documentation does not substitute for operational server documentation.
- Setup experience 4/20
- The only concrete command is npx neo-app@latest for bootstrapping an application; it does not establish MCP server installation or client connectivity. Runtime requirements, server startup configuration, mainstream client examples, authentication steps, and platform compatibility evidence are missing, making the setup path largely unverifiable.