FreeCite: A Judge-Free Benchmark for Granular Citation Evaluation in Large Language Models
-
Updated
Feb 22, 2026 - Python
#
deterministic-evaluation
Here are 14 public repositories matching this topic...
Research benchmark for evidence-grounded OS-agent collaboration, continuous state diagnosis, scoped memory reuse, and stale-state rejection.
multi-agent-systems system-administration research-only agent-collaboration os-agent stateful-agents agent-benchmark tool-using-agents deterministic-evaluation linux-operations evidence-grounding memory-evaluation continuous-tasks
-
Updated
Jul 29, 2026 - JavaScript
Canonical specification and sealed execution traces for VERITAS Ω-CODE v2.0 — deterministic software verification protocol.
-
Updated
Apr 23, 2026 - HTML
As of 07/09/2026 the only open-source PT-PT benchmark that avoids LLM judges and targets email-style structured generation. Deterministic CPU-friendly benchmark for European Portuguese (PT-PT) email LLMs. No LLM judges.
nlp open-source benchmark reproducible email text-generation portuguese dialect pt-pt business-email portuguese-portugal portuguese-european llm-evaluation structured-generation portuguese-nlp llm-benchmark deterministic-evaluation european-portuguese no-llm-judge
-
Updated
Sep 10, 2026 - Python
Deterministic evaluation and release-gating for AI agents: ingests OpenTelemetry traces, scores them with seven rule-based evaluators (no LLM judge), and returns pass/block verdicts for CI.
python ci-cd regression-testing observability ai-agents mlops quality-engineering fastapi opentelemetry agentops ai-quality llm-ops llm-evaluation agent-evaluation agent-testing evaluation-harness release-gating deterministic-evaluation otel-traces rule-based-evaluation
-
Updated
Nov 9, 2026 - Python
AI-assisted policy formalization and governance platform for source-traceable rule extraction, human review, immutable versioning, deterministic evaluation, quality analysis, and regression testing.
react rule-engine compliance governance policy-engine policy-as-code fastapi azure-openai azure-ai-search deterministic-evaluation
-
Updated
Sep 2, 2026 - Python
Deterministic multi-lane evaluation domain for SnorkelAI Terminus3. Cockpit, lane orchestration, agent benchmarking, reasoning-drift detection.
python docker evaluation terminus snorkel cockpit deterministic multi-lane deterministic-evaluation agent-benchmarking snorkelai terminus3 reasoning-drift multi-lane-evaluation ml-eval
-
Updated
Sep 28, 2026 - Python
HCAC is a completion contract for agents and tools. It defines when something is truly “done” — not just structurally, but behaviorally.
backpressure ai-agents quality-gates policy-as-code acceptance-criteria hard-constraints release-readiness deterministic-evaluation agent-contract completion-contract behavioral-contract behavioral-spec
-
Updated
Feb 28, 2026
Hybrid legal RAG and LLM extraction with JSON Schema rule compilation, three-valued logic, Census/TIGER geocoding, and deterministic evaluation.
python rule-engine hackathon civic-tech explainable-ai rag rental-housing legal-tech large-language-models deterministic-evaluation housing-law
-
Updated
Oct 13, 2026 - Python
SnorkelAI Terminus2 task suite with deterministic evaluators, Dockerized environments, and reproducible agent-benchmarking primitives.
python docker benchmarking evaluation terminus snorkel deterministic deterministic-evaluation agent-benchmarking snorkelai terminus2 task-engineering dockerized-evaluators ml-eval
-
Updated
Jun 17, 2026 - Python
Public, fully local PoCs for counterfactually auditable lifecycle certification: exact paired replay, drift monitoring, post-drift replanning, and bridge-aware ledger control on synthetic tasks.
ai poc autonomous-agents synthetic-data drift-monitoring llm scientific-reproducibility deterministic-evaluation counterfactual-auditing paired-replay
-
Updated
Mar 19, 2026 - Python
Ultra pipeline framework for Gravity Binary, including deterministic evaluation logic, capsule workflows, and EC/Ultra integration artifacts.
python docker pipeline evaluation orchestration snorkel deterministic capsule ultra pipeline-evaluation deterministic-evaluation snorkelai ultra-pipeline ultra-sentinel high-trust-evaluation ml-eval
-
Updated
Aug 24, 2026
Core deterministic architecture for multi-lane ML evaluation systems. Foundational logic, capsule interfaces, reproducible execution patterns.
python azure architecture evaluation saas deterministic capsule system-design capsules multi-lane container-apps capsule-system trust-engine deterministic-evaluation gravity-binary capsule-integration evaluation-architecture gravitybinary
-
Updated
May 10, 2026 - Python
Deterministic offline ComtradeBench judge for evaluating agent robustness under pagination, retries, duplicates, page drift, and totals traps.
-
Updated
Aug 17, 2026 - Python
Add this topic to your repo
To associate your repository with the deterministic-evaluation topic, visit your repo's landing page and select "manage topics."