Judgeval AI Agent
by JudgmentLabsThe Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
Judgeval is an open-source ai agent by JudgmentLabs, written mainly in Python, with 1,073 GitHub stars and the Apache-2.0 license. Its code was last updated Oct 30, 2026. The latest PyPI release is judgeval 1.8.0, published Nov 11, 2026, with 95,338 downloads last week.
Scan summary: scanned Nov 5, 2026 at commit c0e4530. No capabilities flagged by our checks. Scan policy
What Judgeval can touch
- Our checks did not find this. The tool may still do it.Run shell commandsNot seen in this scan
- Our checks did not find this. The tool may still do it.Run dynamic codeNot seen in this scan
- Our checks did not find this. The tool may still do it.Read or write filesNot seen in this scan
- Our checks did not find this. The tool may still do it.Read environment and secretsNot seen in this scan
- Our checks did not find this. The tool may still do it.Control a web browserNot seen in this scan
- Our checks did not find this. The tool may still do it.Connect to databasesNot seen in this scan
- Our checks did not find this. The tool may still do it.Read or send messagesNot seen in this scan
- Our checks did not find this. The tool may still do it.Touch money or tradingNot seen in this scan
- Our checks did not find this. The tool may still do it.Connect to the internetNot run in this scan
"Not seen" means our checks did not find it, and the tool may still do it. Covers commit c0e4530, Nov 5, 2026. See the scan policy.
Before you install Judgeval
AgenticMart scanned Judgeval on Nov 5, 2026 with automated checks for hidden code, known-malicious packages, leaked secrets and vulnerable dependencies. The result covers one commit under our scan policy, so review what access you give it and check any advisories shown here.
What it can access
- An AI agent decides its own next steps and calls whatever tools you give it, so its risk depends on the access you grant.
Before you install
- Pin the version you reviewed instead of always installing the latest release.
- Read the tool list or scripts before the first run, and keep approval prompts on for actions that write, send or delete.
- Maintained by JudgmentLabs on GitHub, 1,073 stars and 106 forks. Popularity is not proof of safety.
- Last code change: Oct 30, 2026.
- Open-source license: Apache-2.0.
Judgeval is an open-source ai agent by JudgmentLabs, written mainly in Python. The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
At a glance
- Stars
- 1.1k
- Forks
- 106
- Language
- Python
- License
- Apache-2.0
- Created
- Oct 2024
- Last update
- Oct 30, 2026
- Type
- AI Agent
- Price
- Free
Topics
Questions about Judgeval
What is Judgeval?
The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring.
Who maintains Judgeval?
Judgeval is maintained by JudgmentLabs on GitHub (JudgmentLabs/judgeval). AgenticMart lists it from public repository data.
Is Judgeval safe to use?
AgenticMart scanned Judgeval on Nov 5, 2026 with automated checks for hidden code, known-malicious packages, leaked secrets and vulnerable dependencies. The result covers one commit under our scan policy, so review what access you give it and check any advisories shown here.
What license does Judgeval use?
It is published under the Apache-2.0 license.
Judgeval alternatives
View more →Similar ai agents in Deployment & DevOps, ranked by GitHub stars. Compare licence, recent activity and scan status before you choose.
| Name | Stars | Licence | Last updated | Scan |
|---|---|---|---|---|
| Judgeval (this page) JudgmentLabs | 1.1k | Apache-2.0 | Oct 30, 2026 | Scanned, no flagged issues |
| Langflow langflow-ai | 156k | MIT | Nov 1, 2026 | Scanned, no flagged issues |
| Novu novuhq | 40k | None found | Nov 1, 2026 | Not scanned yet |
| QwenPaw agentscope-ai | 37k | Apache-2.0 | Oct 30, 2026 | Scanned, no flagged issues |
| Kestra kestra-io | 30k | Apache-2.0 | Oct 30, 2026 | Scanned, no flagged issues |
| Chroma chroma-core | 30k | Apache-2.0 | Oct 30, 2026 | Scanned, no flagged issues |