AgentBench AI Agent

by THUDM• 3.8k•• Scanned•Claim this listing•Request removal
Otherchatgptgpt 4llmllm agent

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

AgentBench is an open-source ai agent by THUDM, written mainly in Python, with 3,804 GitHub stars and the Apache-2.0 license. Its code was last updated Feb 8, 2026.

Scan summary: scanned Nov 5, 2026 at commit d1e4a10. Seen able to run dynamic code, connect to the internet. Scan policy

Scanned
Full scan at d1e4a10 · Nov 5, 2026
Scanned Builds
Static code scanwarn
Secrets scanpass
Dependency audit216 known vulnerabilitiesfail
Manifestnonewarn
Buildpass
Boot & handshaken/a
Network egressn/a
Reproducible (×3)n/a

Findings (29)

  • high
    code-execution issue
    Details are available to the maintainer after claiming this listing.
  • high
    code-execution issue
    Details are available to the maintainer after claiming this listing.
  • high
    dependencies issue
    Details are available to the maintainer after claiming this listing.
  • high
    dependencies issue
    Details are available to the maintainer after claiming this listing.
  • high
    dependencies issue
    Details are available to the maintainer after claiming this listing.
  • high
    dependencies issue
    Details are available to the maintainer after claiming this listing.
  • high
    dependencies issue
    Details are available to the maintainer after claiming this listing.
  • high
    dependencies issue
    Details are available to the maintainer after claiming this listing.
  • high
    dependencies issue
    Details are available to the maintainer after claiming this listing.
  • medium
    Contacts a hard-coded IP address instead of a domain name.
    data/os_interaction/scripts/6/collecting.py:12
  • medium
    Turns off TLS certificate checking, allowing traffic interception.
    src/client/agents/http_agent.py:22
  • medium
    Contacts a hard-coded IP address instead of a domain name.
    src/server/tasks/knowledgegraph/utils/sparql_executer.py:20
  • medium
    accelerate@0.23.0: 1 known vulnerability
    PYSEC-2026-3804
    requirements.txt
  • medium
    fastapi@0.101.1: 1 known vulnerability
    PYSEC-2024-38
    requirements.txt
  • medium
    fschat@0.2.36: 6 known vulnerabilities
    PYSEC-2026-1394, PYSEC-2026-1395, PYSEC-2026-1396, PYSEC-2026-1397, PYSEC-2026-1398 +1 more
    requirements.txt
  • medium
    mysql-connector-python@8.0.33: 1 known vulnerability
    PYSEC-2026-1685
    requirements.txt
  • medium
    urllib3@1.26.20: 7 known vulnerabilities
    PYSEC-2026-141, PYSEC-2026-1994, PYSEC-2026-1996, PYSEC-2026-1998, PYSEC-2026-1999 +2 more
    requirements.txt
  • medium
    protobuf@3.20.3: 2 known vulnerabilities
    PYSEC-2026-1805, PYSEC-2026-1806
    requirements.txt
  • medium
    starlette@0.27.0: 7 known vulnerabilities
    PYSEC-2026-161, PYSEC-2026-1941, PYSEC-2026-1943, PYSEC-2026-2280, PYSEC-2026-2281 +2 more
    requirements.txt
  • medium
    torch@2.9.1: 4 known vulnerabilities
    PYSEC-2026-139, PYSEC-2026-2286, GHSA-qfhq-4f3w-5fph, GHSA-rrmf-rvhw-rf47
    requirements.txt
  • medium
    flask@2.1.2: 2 known vulnerabilities
    PYSEC-2023-62, PYSEC-2026-2151
    src/server/tasks/webshop/requirements.txt
  • medium
    selenium@4.9.1: 1 known vulnerability
    PYSEC-2023-206
    src/server/tasks/webshop/requirements.txt
  • medium
    flask@2.1.3: 2 known vulnerabilities
    PYSEC-2023-62, PYSEC-2026-2151
    src/server/tasks/webshop/requirements.txt
  • medium
    setuptools@9.1.0: 4 known vulnerabilities
    PYSEC-2022-43012, PYSEC-2025-49, PYSEC-2026-1918, PYSEC-2026-3447
    src/server/tasks/webshop/requirements.txt
  • low
    requests@2.28.2: 4 known vulnerabilities
    PYSEC-2023-74, PYSEC-2026-1872, PYSEC-2026-1873, PYSEC-2026-2275
    requirements.txt
  • low
    tqdm@4.65.2: 1 known vulnerability
    PYSEC-2026-1976
    requirements.txt
  • low
    idna@3.9.0: 2 known vulnerabilities
    PYSEC-2026-215, PYSEC-2026-215
    requirements.txt
  • low
    pygments@2.9.0: 2 known vulnerabilities
    PYSEC-2023-117, PYSEC-2026-2987
    src/server/tasks/webshop/requirements.txt
  • low
    No manifest declaring network access and environment variables (agent.json)

Network activity

During install
files.pythonhosted.orgpypi.org
While running
Not run — the code wasn't started in this scan

Automated result for the commit shown. See our scan policy. View the scan log

Maintainers can claim the listing to rescan, or dispute a result.

AgentBench alternatives

View more →

Similar ai agents in Other, ranked by GitHub stars. Compare licence, recent activity and scan status before you choose.

NameStarsLicenceLast updatedScan
AgentBench (this page)
THUDM
3.8kApache-2.0Feb 8, 2026Scanned, no flagged issues
Hermes Desktop
fathah
15kMITOct 13, 2026Scanned, no flagged issues
CubeSandbox
TencentCloud
13kNone foundNov 1, 2026Not scanned yet
Openchamber
openchamber
12kMITNov 1, 2026Scanned, no flagged issues
Open Swe
langchain-ai
11kMITNov 1, 2026Scanned, no flagged issues
Moltworker
cloudflare
9.9kApache-2.0May 9, 2026Scanned, no flagged issues