Verify that an AI agent's on-chain claims are actually true. A claim-level groundedness checker for Solana / memecoin agents.
-
Updated
Sep 20, 2026 - Python
Verify that an AI agent's on-chain claims are actually true. A claim-level groundedness checker for Solana / memecoin agents.
Grounded multi-domain support-triage agent (HackerRank Orchestrate Hackathon). 8-layer DAG fusing ChromaDB vector + BM25 lexical retrieval, with an adversarial-critic pass that blocks ungrounded answers — 93% groundedness across a 772-document corpus.
Single-agent, evidence-grounded claim verification to catch LLM hallucinations — a pluggable fact-gate for agent-arena and any multi-agent system (CrewAI, AutoGen, LangGraph).
Evidence-grounded document research, claim-level verification, and reproducible RAG evaluation platform with hybrid retrieval and contradiction detection.
Find the sentences your AI made up. Visual hallucination detector and groundedness checker for RAG chatbots and LLMs.
Provider-agnostic enterprise RAG and agent evaluation harness for Azure Foundry, vLLM, Ollama, and local demos.
A local groundedness judge for RAG: QLoRA-distilled to match a frontier judge 100% at $0/call. Ships only if its own evals beat baseline.
Evaluation patterns, release gates, and anti-hallucination techniques for developer-focused AI workflows.
A deterministic groundedness linter for RAG/LLM answers — catches fabricated numbers, unsupported claims, and broken citations. Runs in CI where an LLM-as-judge can't, because the same input always gives the same verdict. Zero dependencies.
Measuring RAG Groundedness on Financial Filings
Make agent failures loud — deterministic checks that catch LLM agents claiming done when the work is placeholder, unbacked, stale, miscounted, or missing pieces, plus RAG answers whose citations and numbers the retrieved sources do not support. CLI + MCP server + watch mode + LangChain adapter + second-pass verification, zero dependencies.
Beta. Reduced-fare policy assistant citing dated corpus passages in English and Spanish; the bilingual-parity gate is currently failing (see EVALS.md). Corpus of eighteen California transit agencies, public 385-case evaluation harness. Deployed demo serves five agencies; published evidence run lags the repository.
v0.2.0. Fail-closed evaluation harness for government-facing chat systems: reproducible, provenance-stamped audit verdicts, byte-identical across Python 3.11 to 3.14, with no third-party dependencies. A silent or unreadable target scores zero rather than passing by absence. Two public projects of my own pin it by exact commit.
In-build reference implementation: an offline-first plant-care assistant and public evaluation harness with cited-corpus answers, calibrated abstention, toxicity guardrails, EN/ES parity, photo plant ID, and local reminders.
Measure whether a RAG system is actually grounded, and fail the build when it stops being: retrieval metrics, claim-level groundedness, hallucination rate and citation accuracy.
Scores whether an AI agent's answer is actually supported by the tool results it had access to. An LLM-as-judge harness for catching ungrounded or fabricated claims in agent outputs.
An AI-powered RAG groundedness / hallucination checker - segments an LLM answer into atomic claims and flags those NOT supported by the retrieved context, via an LLM judge. Provider-agnostic, BYO-key, offline --dry-run. Python CLI.
Your RAG, put to proof — self-correcting answers and CI eval gates that block the merge when hallucination rate crosses your threshold
How wrong are LLMs about emission factors — and how often do they name the wrong source for a number? 467 questions, five models, scored against sourced ground truth.
Counterfactual failure-attribution referee for RAG groundedness: force-injects gold evidence to separate retrieval misses from generation hallucinations when identical groundedness scores point to opposite fixes.
To associate your repository with the groundedness topic, visit your repo's landing page and select "manage topics."