Safelabs Eval AI Agent
by AgentSafeLabsRed-teaming and evaluation framework for AI agents, built around an OWASP-inspired ASI01–ASI10 taxonomy
Safelabs Eval is an open-source ai agent by AgentSafeLabs, written mainly in Python, with 1,005 GitHub stars and the Apache-2.0 license. Its code was last updated Oct 25, 2026.
Scan summary: scanned Nov 5, 2026 at commit 5824363. Seen able to connect to the internet. Scan policy
ScannedScanned. The automated checks below ran on the commit shown. Read each line for what was and was not covered.
Full scan at
5824363 · Nov 5, 2026 ScannedStatic, secrets and dependency checks completed with no critical findings. BuildsIt installed from a fresh machine.
Warning. This check found something worth reading in the findings below. It is not proof of a problem.Static code scanwarnWarning. This check found something worth reading in the findings below. It is not proof of a problem.
Passed. This check ran and found nothing it flags.Secrets scanpassPassed. This check ran and found nothing it flags.
Passed. This check ran and found nothing it flags.Dependency audit0 known vulnerabilitiespassPassed. This check ran and found nothing it flags.
Warning. This check found something worth reading in the findings below. It is not proof of a problem.ManifestnonewarnWarning. This check found something worth reading in the findings below. It is not proof of a problem.
Passed. This check ran and found nothing it flags.BuildpassPassed. This check ran and found nothing it flags.
Not applicable. This check does not apply to this kind of project, or it was not run in this scan.Boot & handshaken/aNot applicable. This check does not apply to this kind of project, or it was not run in this scan.
Not applicable. This check does not apply to this kind of project, or it was not run in this scan.Network egressn/aNot applicable. This check does not apply to this kind of project, or it was not run in this scan.
Not applicable. This check does not apply to this kind of project, or it was not run in this scan.Reproducible (×3)n/aNot applicable. This check does not apply to this kind of project, or it was not run in this scan.
Findings (6)
- highHigh. Something risky that needs a close look before you install.dropper issueDetails are available to the maintainer after claiming this listing.
- highHigh. Something risky that needs a close look before you install.dropper issueDetails are available to the maintainer after claiming this listing.
- highHigh. Something risky that needs a close look before you install.dropper issueDetails are available to the maintainer after claiming this listing.
- highHigh. Something risky that needs a close look before you install.dropper issueDetails are available to the maintainer after claiming this listing.
- mediumMedium. Worth checking, often a vulnerable dependency or a setup problem.Contacts a hard-coded IP address instead of a domain name.
safelabs/prompts/library.py:3703 - lowLow. Minor, or common in normal tools. Shown for information.No manifest declaring network access and environment variables (agent.json)
Network activity
During install
files.pythonhosted.orgpypi.org
While running
Not run — the code wasn't started in this scan
Automated result for the commit shown. See our scan policy. View the scan log
Maintainers can claim the listing to rescan, or dispute a result.
Safelabs Eval alternatives
View more →Similar ai agents in Developer Tools, ranked by GitHub stars. Compare licence, recent activity and scan status before you choose.
| Name | Stars | Licence | Last updated | Scan |
|---|---|---|---|---|
| Safelabs Eval (this page) AgentSafeLabs | 1k | Apache-2.0 | Oct 25, 2026 | Scanned, no flagged issues |
| Deepseek Harness deepseek-ai | 268k | MIT | Oct 30, 2026 | Scanned, no flagged issues |
| Ponytail DietrichGebert | 182k | MIT | Oct 29, 2026 | Scanned, no flagged issues |
| Orca stablyai | 112k | MIT | Nov 1, 2026 | Scanned, no flagged issues |
| Deer Flow bytedance | 85k | MIT | Nov 1, 2026 | Scanned, no flagged issues |
| Ruflo ruvnet | 80k | MIT | Nov 1, 2026 | Scanned, no flagged issues |