A local CLI for logging predictions before the outcome and checking whether your "80% sure" comes true 80% of the time.
-
Updated
Nov 8, 2026 - Rust
A local CLI for logging predictions before the outcome and checking whether your "80% sure" comes true 80% of the time.
Runs ~20 options strategies against live market data in shadow mode, records every hypothetical fill under worst/base/optimistic assumptions, and grades each with anytime-valid e-processes. Places no orders.
POPPER-Swarm: Automated Hypothesis Validation & Computational Biology Reproduction with Agentic Sequential Falsifications (BixBench3 + Exa + past.dev)
Repository for the paper "Auditing Pay-Per-Token in Large Language Models", AISTATS'26
This repository contains the code for the paper "Optimizing Social Utility in Sequential Experiments".
Measure your agent harness, find where it wastes the model, and prove the fix worked. Harness-agnostic, agent-agnostic, zero dependencies. Reference implementation of HTP-1.
A kernel-userland protocol enforcing information-theoretic bounds on AI adaptivity leakage, benchmark gaming, and capability spillover.
Certified pairwise leaderboards for retrieval evaluation. WITNESS samples a few fresh human labels at known probabilities and uses official qrels and LLM judges only as variance-reducing predictors: unbiased for any judgment source, false-discovery-rate controlled, with label-budget forecasts. One-command reproduction.
Real-time cross-chain bridge exploit detection that accuses only with proof. Caught 422/422 attack payouts across Nomad, Ronin and practice attacks with 0 honest payouts accused. Conservation ledger, e-value false-alarm control, Hawkes contagion radar, signers recovered with ecrecover. CSB-01
Benchmark for statistically valid AI scientist systems, using audit-closed protocols, transparency logs, and sequential inference to prevent false discoveries in autonomous research agents.
Publicly verifiable proof that an LLM endpoint actually spent the compute you paid for — zero provider cooperation. Closes the effort gap (Hollow-LLM) and the transferability gap (IRIS).
A Bayesian statistics monograph built on de Finetti, Sanov and Bayes: exchangeable prediction under moment constraints gives maximum entropy laws, and testing, shrinkage, asymptotics and decision are read on one moderate deviation scale.
Volume I of a two volume series. Bayesian clinical trials built up from the traditional trial and tied to regulation: calibration, monitoring, safety, borrowing, adaptive designs, and reanalyses of landmark trials, with an R package and an online lab.
Windows instrument for fine-tuning runs: every sample drawn, a report that leads with its answer, and a local-model workbench that builds formula tools and tests what each knob does, with e-value evidence across folders.
Anonymous code and result release for block-calibrated false-discovery control in open-vocabulary detection
MSc thesis: designing e-value evidence around a decision-maker's loss, with an application to Polymarket prices for the 2026 World Cup final.
Research implementation of anytime-valid group-invariance tests with kernel, adaptive Gaussian, and neural statistics.
Statistically valid gates for non-deterministic eval suites. Stop early without losing error control.
Codebase of Concise and Logically Consistent Conformal Sets for Neuro-Symbolic Concept-Based Models, accepted at NeurIPS2025
Anytime valid inference in Python: confidence sequences, sequential tests and e-values
To associate your repository with the e-values topic, visit your repo's landing page and select "manage topics."