Coder Eval MCP Server
by UiPathPlaywright for coding agents. Test that your skills, MCP servers, and CLIs actually work when an agent uses them — sandboxed YAML suites, A/B experiments, CI gates.
Coder Eval is an open-source mcp server by UiPath, written mainly in Python, with 156 GitHub stars and the Apache-2.0 license. Its code was last updated Oct 30, 2026.
Scan summary: scanned Nov 5, 2026 at commit 48791f6. Seen able to run shell commands, read environment and secrets, connect to the internet. Scan policy
ScannedScanned. The automated checks below ran on the commit shown. Read each line for what was and was not covered.
Full scan at
48791f6 · Nov 5, 2026 ScannedStatic, secrets and dependency checks completed with no critical findings. BuildsIt installed from a fresh machine.
Warning. This check found something worth reading in the findings below. It is not proof of a problem.Static code scanwarnWarning. This check found something worth reading in the findings below. It is not proof of a problem.
Flagged. This check found an issue. See the findings below.Secrets scanfailFlagged. This check found an issue. See the findings below.
Flagged. This check found an issue. See the findings below.Dependency audit36 known vulnerabilitiesfailFlagged. This check found an issue. See the findings below.
Warning. This check found something worth reading in the findings below. It is not proof of a problem.ManifestnonewarnWarning. This check found something worth reading in the findings below. It is not proof of a problem.
Passed. This check ran and found nothing it flags.BuildpassPassed. This check ran and found nothing it flags.
Flagged. This check found an issue. See the findings below.Boot & handshakefailFlagged. This check found an issue. See the findings below.
Warning. This check found something worth reading in the findings below. It is not proof of a problem.Network egresswarnWarning. This check found something worth reading in the findings below. It is not proof of a problem.
Not applicable. This check does not apply to this kind of project, or it was not run in this scan.Reproducible (×3)n/aNot applicable. This check does not apply to this kind of project, or it was not run in this scan.
Findings (27)
- highHigh. Something risky that needs a close look before you install.credential-access issueDetails are available to the maintainer after claiming this listing.
- highHigh. Something risky that needs a close look before you install.credential-access issueDetails are available to the maintainer after claiming this listing.
- highHigh. Something risky that needs a close look before you install.credential-access issueDetails are available to the maintainer after claiming this listing.
- highHigh. Something risky that needs a close look before you install.credential-access issueDetails are available to the maintainer after claiming this listing.
- highHigh. Something risky that needs a close look before you install.secrets issueDetails are available to the maintainer after claiming this listing.
- highHigh. Something risky that needs a close look before you install.dependencies issueDetails are available to the maintainer after claiming this listing.
- mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.Runs shell commands. Fine for some tools, but it means the agent can run anything your user can.
src/coder_eval/sandbox.py:1212 - mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.@azure/msal-node@5.1.3: 1 known vulnerabilityGHSA-xcx6-jx8p-x3h5
evalboard/pnpm-lock.yaml - mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.brace-expansion@2.1.0: 6 known vulnerabilitiesGHSA-3jxr-9vmj-r5cp, GHSA-6j4f-fj2g-mc7p, GHSA-mh99-v99m-4gvg, GHSA-q2hr-2g5m-vwhr, GHSA-qhr7-859c-m2p7 +1 more
evalboard/pnpm-lock.yaml - mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.brace-expansion@5.0.6: 6 known vulnerabilitiesGHSA-3jxr-9vmj-r5cp, GHSA-6j4f-fj2g-mc7p, GHSA-mh99-v99m-4gvg, GHSA-q2hr-2g5m-vwhr, GHSA-qhr7-859c-m2p7 +1 more
evalboard/pnpm-lock.yaml - mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.form-data@4.0.5: 1 known vulnerabilityGHSA-hmw2-7cc7-3qxx
evalboard/pnpm-lock.yaml - mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.vite@5.4.21: 8 known vulnerabilitiesGHSA-4w7w-66w2-5vf9, GHSA-587h-7wmj-h5pm, GHSA-698v-4r3x-3vcv, GHSA-9jrq-w75r-8gcw, GHSA-fx2h-pf6j-xcff +3 more
evalboard/pnpm-lock.yaml - mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.ws@8.20.1: 1 known vulnerabilityGHSA-96hv-2xvq-fx4p
evalboard/pnpm-lock.yaml - mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.oauthlib@4.0.0: 1 known vulnerabilityGHSA-3jp2-3mrg-2vxc
uv.lock - mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.Install contacted hosts other than package registriesreleases.astral.sh
- mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.MCP server didn't complete the protocol handshakeserver exited early with code 127
- lowLow. Minor, or common in normal tools. Shown for information.Possible example credential in docs/tests: generic-api-key2 matches in this file
tests/test_litellm_route.py:82 - lowLow. Minor, or common in normal tools. Shown for information.@vitest/mocker@3.2.7: 2 known vulnerabilitiesGHSA-82fw-gwwq-j7x9, GHSA-qxg6-89mg-rqv8
evalboard/pnpm-lock.yaml - lowLow. Minor, or common in normal tools. Shown for information.esbuild@0.21.5: 1 known vulnerabilityGHSA-67mh-4wv8-2f99
evalboard/pnpm-lock.yaml - lowLow. Minor, or common in normal tools. Shown for information.glob@10.5.0: 1 known vulnerabilityGHSA-3g3m-2fjr-6pw4
evalboard/pnpm-lock.yaml - lowLow. Minor, or common in normal tools. Shown for information.minimatch@10.2.5: 1 known vulnerabilityGHSA-g3hv-75wg-m249
evalboard/pnpm-lock.yaml - lowLow. Minor, or common in normal tools. Shown for information.minimatch@9.0.9: 1 known vulnerabilityGHSA-g3hv-75wg-m249
evalboard/pnpm-lock.yaml - lowLow. Minor, or common in normal tools. Shown for information.postcss-selector-parser@6.0.10: 1 known vulnerabilityGHSA-rj75-hqrm-r3gf
evalboard/pnpm-lock.yaml - lowLow. Minor, or common in normal tools. Shown for information.postcss-selector-parser@6.1.2: 2 known vulnerabilitiesGHSA-rj75-hqrm-r3gf, GHSA-w9m9-85wc-3x92
evalboard/pnpm-lock.yaml - lowLow. Minor, or common in normal tools. Shown for information.vitest@3.2.7: 1 known vulnerabilityGHSA-82fw-gwwq-j7x9
evalboard/pnpm-lock.yaml - lowLow. Minor, or common in normal tools. Shown for information.No manifest declaring network access and environment variables (agent.json)
- infoInfo. A note about the project, not a problem.Ignored the repo's scanner suppression config (1 file)osv-scanner.toml
Network activity
During install
files.pythonhosted.orgpypi.orgreleases.astral.sh
While running
Not run — the code wasn't started in this scan
Automated result for the commit shown. See our scan policy. View the scan log
Maintainers can claim the listing to rescan, or dispute a result.
Coder Eval alternatives
View more →Similar mcp servers in Coding Agents, ranked by GitHub stars. Compare licence, recent activity and scan status before you choose.
| Name | Stars | Licence | Last updated | Scan |
|---|---|---|---|---|
| Coder Eval (this page) UiPath | 156 | Apache-2.0 | Oct 30, 2026 | Scanned, no flagged issues |
| Context Mode mksglu | 33k | None found | Nov 1, 2026 | Not scanned yet |
| Serena oraios | 31k | None found | Oct 28, 2026 | Not scanned yet |
| Fastmcp PrefectHQ | 28k | Apache-2.0 | Nov 1, 2026 | Scanned, no flagged issues |
| Nuclear nukeop | 19k | AGPL-3.0 | Nov 1, 2026 | Scanned, no flagged issues |
| MCP For Beginners microsoft | 18k | MIT | Oct 30, 2026 | Scanned, no flagged issues |