Coder Eval MCP Server
by UiPathPlaywright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Coder Eval is an open-source mcp server by UiPath, written mainly in Python, with 156 GitHub stars and the Apache-2.0 license. Its code was last updated Oct 30, 2026.
Scan summary: scanned Nov 5, 2026 at commit 48791f6. Seen able to run shell commands, read environment and secrets, connect to the internet. Scan policy
What Coder Eval can touch
- Seen in this scan, either in the code or while it ran.Run shell commandsFound in the code by our scan
- Our checks did not find this. The tool may still do it.Run dynamic codeNot seen in this scan
- Our checks did not find this. The tool may still do it.Read or write filesNot seen in this scan
- Seen in this scan, either in the code or while it ran.Read environment and secretsFound in the code by our scan
- Not checked directly. Its own description suggests it does this.Control a web browserLikely, from its own description
- Our checks did not find this. The tool may still do it.Connect to databasesNot seen in this scan
- Our checks did not find this. The tool may still do it.Read or send messagesNot seen in this scan
- Our checks did not find this. The tool may still do it.Touch money or tradingNot seen in this scan
- Seen in this scan, either in the code or while it ran.Connect to the internetFound in the code by our scan
"Not seen" means our checks did not find it, and the tool may still do it. Covers commit 48791f6, Nov 5, 2026. See the scan policy.
Before you install Coder Eval
AgenticMart scanned Coder Eval on Nov 5, 2026 with automated checks for hidden code, known-malicious packages, leaked secrets and vulnerable dependencies. The result covers one commit under our scan policy, so review what access you give it and check any advisories shown here.
What it can access
- An MCP server is a program your AI app starts and talks to. A local one runs with your user's permissions: it can see the files, environment variables and network your account can.
- Based on its description and topics, it likely needs to control a web browser (visit sites, fill in and submit forms).
- Based on its description and topics, it likely needs to use a code-hosting token (GitHub/GitLab).
- Based on its description and topics, it likely needs to run shell commands.
Before you install
- Run it in a separate browser profile without your logged-in accounts.
- Use a fine-grained token limited to the repos it needs.
- Pin the version you reviewed instead of always installing the latest release.
- Read the tool list or scripts before the first run, and keep approval prompts on for actions that write, send or delete.
- Maintained by UiPath on GitHub, 156 stars and 7 forks. Popularity is not proof of safety.
- Last code change: Oct 30, 2026.
- Open-source license: Apache-2.0.
Coder Eval is an open-source mcp server by UiPath, written mainly in Python. Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
At a glance
- Stars
- 156
- Forks
- 7
- Language
- Python
- License
- Apache-2.0
- Created
- Jul 2026
- Last update
- Oct 30, 2026
- Type
- MCP Server
- Price
- Free
Topics
Questions about Coder Eval
What is Coder Eval?
Playwright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Who maintains Coder Eval?
Coder Eval is maintained by UiPath on GitHub (UiPath/coder_eval). AgenticMart lists it from public repository data.
Is Coder Eval safe to use?
AgenticMart scanned Coder Eval on Nov 5, 2026 with automated checks for hidden code, known-malicious packages, leaked secrets and vulnerable dependencies. The result covers one commit under our scan policy, so review what access you give it and check any advisories shown here.
What license does Coder Eval use?
It is published under the Apache-2.0 license.
Coder Eval alternatives
View more →Similar mcp servers in Coding Agents, ranked by GitHub stars. Compare licence, recent activity and scan status before you choose.
| Name | Stars | Licence | Last updated | Scan |
|---|---|---|---|---|
| Coder Eval (this page) UiPath | 156 | Apache-2.0 | Oct 30, 2026 | Scanned, no flagged issues |
| Context Mode mksglu | 33k | None found | Nov 1, 2026 | Not scanned yet |
| Serena oraios | 31k | None found | Oct 28, 2026 | Not scanned yet |
| Fastmcp PrefectHQ | 28k | Apache-2.0 | Nov 1, 2026 | Scanned, no flagged issues |
| Nuclear nukeop | 19k | AGPL-3.0 | Nov 1, 2026 | Scanned, no flagged issues |
| MCP For Beginners microsoft | 18k | MIT | Oct 30, 2026 | Scanned, no flagged issues |