| FMRS | 75 / 100 · B | 76 / 100 · B |
|---|
| Reliability | 12 / 20 | 13 / 20 |
|---|
| Security and permissions | 18 / 20 | 14 / 20 |
|---|
| Maintenance | 14 / 20 | 18 / 20 |
|---|
| Documentation | 16 / 20 | 17 / 20 |
|---|
| Setup experience | 15 / 20 | 14 / 20 |
|---|
| Best for | - Teams with medium-to-large TypeScript/JavaScript, Python, Go, or Java codebases wanting a deterministic, local-first testing workflow
- Developers using MCP-compatible coding agents such as Claude Code, Cursor, Codex, Copilot, or OpenCode
- Privacy-conscious teams: code never leaves the machine and keys stay in environment variables
| - Teams that want an AI assistant to directly operate on GitHub repos and collaboration workflows
- Users already in the GitHub Copilot ecosystem who want a zero-deployment remote option
|
|---|
| Not for | - Projects in Kotlin, Rust, PHP, C#, Ruby, Swift, C/C++ needing generated tests, runtime coverage, or dynamic proof (only static behavior extraction is supported for these)
- Teams wanting hosted lifecycle management, cross-repo intelligence, or CI policy gates (this repo is the free local tool only)
- Users who need test generation but won't configure a model key — generation requires BYOK
| - Scenarios where you don't want the assistant to have write access to repos (enable only read-only toolsets)
- Environments with strict network isolation for private repos that can't reach the official remote endpoint
|
|---|
| Required permissions | - Reads local repository files and git metadata to build the evidence graph
- Writes reports and metadata to .orangepro/
- Writes new generated tests under orangepro_generated/ (existing source files untouched)
- Optionally reads OpenAI / Anthropic / Ollama credentials from env and sends grounded code context directly to your configured provider
| - A personal access token (PAT) or OAuth App token; effective scope depends on the token's own permissions
- Enabling toolsets like actions/issues/pull_requests grants write access — request tokens on a least-privilege basis
|
|---|
| Risks and side effects | - Generated tests land in orangepro_generated/ and should be reviewed before running
- AI candidate links and flows are suggestions, never evidence; AI output does not change evidence tiers
- opro generate --pr checks out a PR and mutates your working tree; prefer --base
- With AI lanes enabled, grounded code context is sent directly to the configured model provider
- The MCP server has local filesystem and command execution access to the repository — use only on trusted codebases
| - Write toolsets (creating/merging PRs, triggering workflows) can cause accidental changes if the token is overscoped — try a read-only toolset first
- In hosted mode, credentials travel via the Authorization header — make sure the client-to-api.githubcopilot.com connection is trusted
|
|---|
| Supported clients | Claude Code, Cursor, Codex, Copilot / VS Code, OpenCode, Generic MCP clients | Claude Desktop, Claude Code, VS Code, Cursor, Windsurf, JetBrains IDEs, Zed, Amp |
|---|
| Tools | 18 | 15 |
|---|