- Reliability 7/20
- Only the repository-root README and badges are reviewable; the server manifest is not cached, and there are no visible CI workflows or committed tests proving the server starts cleanly, completes the MCP init and tool-list handshake, or that declared tools match real behavior. The README claims startup via `slayer mcp --demo` or `slayer mcp --ingest-on-startup` and mentions search and memory-store tools, but all of this is self-reported and unverifiable. Dependencies rely on the PyPI package `motley-slayer[all]`, so correctness depends on network and version resolution, and error handling and edge cases are invisible in the source. Given the static cap of 12 and the deduction for missing execution evidence, the score is 7.
- Security and permissions 9/20
- No red-line risks such as malware, credential theft, covert exfiltration, or unconfirmed destructive defaults were found. The README states database connectivity is read-only, reads the password from the `${DB_PASSWORD}` environment variable at init time without saving to disk or exposing it to Claude, and mentions row-level security, showing some least-privilege and data-boundary awareness. However, visible concerns remain: `--ingest-on-startup` actively connects to the user's datasource and ingests metadata with no explicit disclosure of connection scope, external network behavior, or where ingested data goes; MCP subprocesses inherit the launching process environment, and credential isolation relies on the user without full explanation; and no explicit confirmation mechanism for dangerous operations is described. Main risks are visible but permission scoping and confirmation flow are incomplete, so the score is 9.
- Maintenance 10/20
- The repository is MIT-licensed, not archived, has 168 stars and 3 open issues, and comes from the Motley team as a stated core product component, providing organizational backing for continued maintenance. However, the static source offers no verifiable information on release cadence, commit history, dependency update policy, issue response record, or security response channel, leaving governance and versioning gaps. Active but with governance/versioning information missing, the score is 10.
- Documentation 10/20
- The README provides install commands, two quickstart paths (demo and own data), datasource creation examples, and layered docs links for MCP, REST, CLI, Python, Flight SQL, and dbt/Cube/Ossie importers, plus conceptual expression and multi-stage query explanations, making it generally usable. But it lacks tool parameter details, explicit limits and cost/quota disclosure, and directly readable troubleshooting content, and key evidence is external links rather than reviewable in-repo text, leaving hidden assumptions and troubleshooting gaps. The score is 10.
- Setup experience 12/20
- The install path is clear: install the PyPI package `motley-slayer[all]` with uv, then add it to Claude Code with a one-line `claude mcp add` command, with a zero-config demo dataset quickstart and an own-data datasource example, requiring few steps and targeting a mainstream client. But it depends on uv, PATH refresh (`uv tool update-shell`), and exporting environment variables in the launching shell, and actual connectivity is not verified in the source, leaving manual and environment-sensitive steps. Given the static cap of 15 and the absence of executable verification evidence, the score is 12.