Safelabs Eval AI Agent
by AgentSafeLabsRed-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy
Safelabs Eval is an open-source ai agent by AgentSafeLabs, written mainly in Python, with 1,005 GitHub stars and the Apache-2.0 license. Its code was last updated Oct 25, 2026. The latest PyPI release is safelabs-eval 0.12.0, published Oct 25, 2026, with 23 downloads last week.
Scan summary: scanned Nov 5, 2026 at commit 5824363. Seen able to connect to the internet. Scan policy
What Safelabs Eval can touch
- Our checks did not find this. The tool may still do it.Run shell commandsNot seen in this scan
- Our checks did not find this. The tool may still do it.Run dynamic codeNot seen in this scan
- Our checks did not find this. The tool may still do it.Read or write filesNot seen in this scan
- Our checks did not find this. The tool may still do it.Read environment and secretsNot seen in this scan
- Our checks did not find this. The tool may still do it.Control a web browserNot seen in this scan
- Our checks did not find this. The tool may still do it.Connect to databasesNot seen in this scan
- Our checks did not find this. The tool may still do it.Read or send messagesNot seen in this scan
- Our checks did not find this. The tool may still do it.Touch money or tradingNot seen in this scan
- Seen in this scan, either in the code or while it ran.Connect to the internetFound in the code by our scan
"Not seen" means our checks did not find it, and the tool may still do it. Covers commit 5824363, Nov 5, 2026. See the scan policy.
Before you install Safelabs Eval
AgenticMart scanned Safelabs Eval on Nov 5, 2026 with automated checks for hidden code, known-malicious packages, leaked secrets and vulnerable dependencies. The result covers one commit under our scan policy, so review what access you give it and check any advisories shown here.
What it can access
- An AI agent decides its own next steps and calls whatever tools you give it, so its risk depends on the access you grant.
Before you install
- Pin the version you reviewed instead of always installing the latest release.
- Read the tool list or scripts before the first run, and keep approval prompts on for actions that write, send or delete.
- Maintained by AgentSafeLabs on GitHub, 1,005 stars and 101 forks. Popularity is not proof of safety.
- Last code change: Oct 25, 2026.
- Open-source license: Apache-2.0.
Safelabs Eval is an open-source ai agent by AgentSafeLabs, written mainly in Python. Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy
At a glance
- Stars
- 1k
- Forks
- 101
- Language
- Python
- License
- Apache-2.0
- Created
- May 2026
- Last update
- Oct 25, 2026
- Type
- AI Agent
- Price
- Free
Topics
Questions about Safelabs Eval
What is Safelabs Eval?
Red-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy
Who maintains Safelabs Eval?
Safelabs Eval is maintained by AgentSafeLabs on GitHub (AgentSafeLabs/safelabs-eval). AgenticMart lists it from public repository data.
Is Safelabs Eval safe to use?
AgenticMart scanned Safelabs Eval on Nov 5, 2026 with automated checks for hidden code, known-malicious packages, leaked secrets and vulnerable dependencies. The result covers one commit under our scan policy, so review what access you give it and check any advisories shown here.
What license does Safelabs Eval use?
It is published under the Apache-2.0 license.
Safelabs Eval alternatives
View more →Similar ai agents in Developer Tools, ranked by GitHub stars. Compare licence, recent activity and scan status before you choose.
| Name | Stars | Licence | Last updated | Scan |
|---|---|---|---|---|
| Safelabs Eval (this page) AgentSafeLabs | 1k | Apache-2.0 | Oct 25, 2026 | Scanned, no flagged issues |
| Deepseek Harness deepseek-ai | 268k | MIT | Oct 30, 2026 | Scanned, no flagged issues |
| Ponytail DietrichGebert | 182k | MIT | Oct 29, 2026 | Scanned, no flagged issues |
| Orca stablyai | 112k | MIT | Nov 1, 2026 | Scanned, no flagged issues |
| Deer Flow bytedance | 85k | MIT | Nov 1, 2026 | Scanned, no flagged issues |
| Ruflo ruvnet | 80k | MIT | Nov 1, 2026 | Scanned, no flagged issues |