Typed Evals AI Agent
by TrustifAIFast, typed Python framework for Jev-as-a-Judge/Decision-model evaluation for LLMs, RAG, and AI agents along with human-label calibration.
Typed Evals is an open-source ai agent by TrustifAI, written mainly in Python, with 16 GitHub stars and the MIT license. Its code was last updated Oct 29, 2026. The latest PyPI release is typed-evals 0.2.2, published Oct 17, 2026, with 17 downloads last week.
Scan summary: scanned Nov 5, 2026 at commit 34de57c. Seen able to connect to the internet. Scan policy
What Typed Evals can touch
- Our checks did not find this. The tool may still do it.Run shell commandsNot seen in this scan
- Our checks did not find this. The tool may still do it.Run dynamic codeNot seen in this scan
- Our checks did not find this. The tool may still do it.Read or write filesNot seen in this scan
- Our checks did not find this. The tool may still do it.Read environment and secretsNot seen in this scan
- Our checks did not find this. The tool may still do it.Control a web browserNot seen in this scan
- Our checks did not find this. The tool may still do it.Connect to databasesNot seen in this scan
- Our checks did not find this. The tool may still do it.Read or send messagesNot seen in this scan
- Our checks did not find this. The tool may still do it.Touch money or tradingNot seen in this scan
- Seen in this scan, either in the code or while it ran.Connect to the internetFound in the code by our scan
"Not seen" means our checks did not find it, and the tool may still do it. Covers commit 34de57c, Nov 5, 2026. See the scan policy.
Before you install Typed Evals
AgenticMart scanned Typed Evals on Nov 5, 2026 with automated checks for hidden code, known-malicious packages, leaked secrets and vulnerable dependencies. The result covers one commit under our scan policy, so review what access you give it and check any advisories shown here.
What it can access
- An AI agent decides its own next steps and calls whatever tools you give it, so its risk depends on the access you grant.
Before you install
- Pin the version you reviewed instead of always installing the latest release.
- Read the tool list or scripts before the first run, and keep approval prompts on for actions that write, send or delete.
- Maintained by TrustifAI on GitHub, 16 stars and 1 forks. Popularity is not proof of safety.
- Last code change: Oct 29, 2026.
- Open-source license: MIT.
Typed Evals is an open-source ai agent by TrustifAI, written mainly in Python. Fast, typed Python framework for Jev-as-a-Judge/Decision-model evaluation for LLMs, RAG, and AI agents along with human-label calibration.
At a glance
- Stars
- 16
- Forks
- 1
- Language
- Python
- License
- MIT
- Created
- Sep 2026
- Last update
- Oct 29, 2026
- Type
- AI Agent
- Price
- Free
Topics
Questions about Typed Evals
What is Typed Evals?
Fast, typed Python framework for Jev-as-a-Judge/Decision-model evaluation for LLMs, RAG, and AI agents along with human-label calibration.
Who maintains Typed Evals?
Typed Evals is maintained by TrustifAI on GitHub (TrustifAI/typed_evals). AgenticMart lists it from public repository data.
Is Typed Evals safe to use?
AgenticMart scanned Typed Evals on Nov 5, 2026 with automated checks for hidden code, known-malicious packages, leaked secrets and vulnerable dependencies. The result covers one commit under our scan policy, so review what access you give it and check any advisories shown here.
What license does Typed Evals use?
It is published under the MIT license.
Typed Evals alternatives
View more →Similar ai agents in Data Science & ML, ranked by GitHub stars. Compare licence, recent activity and scan status before you choose.
| Name | Stars | Licence | Last updated | Scan |
|---|---|---|---|---|
| Typed Evals (this page) TrustifAI | 16 | MIT | Oct 29, 2026 | Scanned, no flagged issues |
| Ragflow infiniflow | 93k | Apache-2.0 | Oct 31, 2026 | Scanned, no flagged issues |
| Cherry Studio CherryHQ | 53k | AGPL-3.0 | Nov 1, 2026 | Scanned, no flagged issues |
| PageIndex VectifyAI | 40k | MIT | Oct 29, 2026 | Scanned, no flagged issues |
| Graphiti getzep | 32k | Apache-2.0 | Nov 1, 2026 | Scanned, no flagged issues |
| Cua trycua | 31k | MIT | Nov 1, 2026 | Scanned, no flagged issues |