Skip to content

About

AI Agent Validation Framework – LLM‑as‑a‑Judge with mock MCP, Python/pytest. Treats AI outputs as unreliable narrators & cross‑checks correctness, sentiment & hallucinations.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

2 Commits

Folders and files

Repository files navigation

AI Agent Validation Framework

CI

A test framework that checks AI answers for correctness, politeness, and honesty.
It treats any AI as a "storyteller" and cross‑checks what it says.

What it does

  1. A mock AI agent answers customer questions.
  2. A "judge" program reads the answer and decides if it's good.
  3. The judge checks three things:
    • Did the answer include the required facts?
    • Is the tone polite (positive) or rude (negative)?
    • Did the AI accidentally invent something that doesn't exist?

Why this is special

Most testers only check buttons and screens.
This project shows I can test AI‑powered software — a skill that's growing fast.

How to run (local)

git clone https://github.com/kallurayaankit/ai-agent-validation-framework.git
cd ai-agent-validation-framework
python -m venv venv
venv\Scripts\activate.bat
pip install -r requirements.txt
python -m textblob.download_corpora
pytest

About

AI Agent Validation Framework – LLM‑as‑a‑Judge with mock MCP, Python/pytest. Treats AI outputs as unreliable narrators & cross‑checks correctness, sentiment & hallucinations.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages