- Reliability 9/20
- The README references integration tests (uv run pytest -m integration), but no CI workflow files or verifiable test-coverage evidence are present in the supplied material, and no server manifest was cached, so declared tools (read/create/reply messages, list members) cannot be confirmed against actual behavior. Per the static calibration rule, reliability is capped at 12 without verifiable execution evidence (real CI plus committed tests covering key paths); given the missing manifest and untested tool contract, this scores 9.
- Security and permissions 12/20
- Credentials are passed via environment variables (TEAMS_APP_ID, TEAMS_APP_PASSWORD, etc.) with no hardcoded secrets or real tokens in examples — the sample.env is a template only, which is reasonable practice. However, the README does not describe least-privilege scoping, confirmation flows for message-posting/reply side effects that are externally visible, or the data flow to the Microsoft Graph/Teams API and any rate-limit handling. No red-line issue is present, but permission boundaries and confirmation are incompletely disclosed, so this scores 12.
- Maintenance 15/20
- The project carries an Apache-2.0 license, includes CHANGELOG.md, CONTRIBUTING.md, and SECURITY.md, and integrates SonarCloud and OpenSSF Scorecard badges, indicating active governance. With 390 stars, only 9 open issues, and no archival status, ownership appears active. Direct evidence of release cadence or dependency-update automation is not shown, so it falls short of full marks, scoring 15.
- Documentation 13/20
- The README provides clear install steps, an environment variable table, Docker build/run instructions, and links to supplementary docs (MS-Teams-setup.md, llms-install.md). However, it lacks a detailed tool-parameter reference (no manifest), a troubleshooting section, and disclosure of rate limits or cost — layered but incomplete coverage, scoring 13.
- Setup experience 10/20
- Setup requires uv, Python 3.10, and registering an app in Microsoft Entra ID/Azure plus Teams channel configuration; the linked MS-Teams-setup.md is explicitly described as not a step-by-step guide, making the path manual and dependent on external Azure resource provisioning. Per the static calibration rule, setup is capped at 15 without verifiable execution evidence; given this complexity, it scores 10.