test-reliability

Scantrix analyzes automation repositories to uncover framework inefficiencies, flaky tests, and reliability risks.

Verification Trust Engine: Your tests are lying to you. We prove it.

Flaky test detection and analytics platform — statistical analysis, root cause classification, quarantine management, suite health metrics. TypeScript/Node.js + PostgreSQL + Redis + Docker + GitHub Actions CI.

Find the tests that pass sometimes and fail others, and work out why. Reads JUnit XML, so it works with any test framework. Zero dependencies.

Failure-rate intervals, flaky classification and rerun planning from repeated test runs.

Seven small tools for catching CI that reports green without proving anything: fabricated reports, flaky-masked regressions, stale sources, crash loops, un-alerted failures, and rotten skip tags.

Flaky test detection: statistical analysis, flakiness scoring, quarantine recommendations, root cause patterns.

Find flaky tests by running your suite repeatedly and diffing the results — language-agnostic via JUnit XML.

Can you trust your tests? An agent skill that finds flaky, hollow and slow tests and proves every finding with runnable evidence. Mutation-checked, language-agnostic, audit-only: it never touches your code. For Claude Code, Codex and any Agent Skills compatible agent.

Index + provenance archive for three zero-dependency Python CLI tools for QA engineering: api-smoke-tester, flaky-test-detector, repo-doctor.

Prove a flaky-test fix: run base and head paired, many times, and get FIXED / NOT FIXED with a p-value

反复跑测试，找出哪个用例在捣鬼：输出每个用例的通过率，并区分「flaky」和「真的坏了」

Detect unreliable tests by running them multiple times - Part of Tuulbelt

Rerun a pytest suite N times to find flaky tests, score their stability, and diagnose the likely cause.

Detect flaky tests by comparing JUnit XML reports from multiple CI runs.

Randomize test execution order to detect hidden dependencies and flaky tests

An adaptive testing engine: item response theory, maximum-information item selection, live ability estimation, and differential item functioning.

TypeScript CLI that analyses test retries to separate real failures from flaky ones and scores test stability

Observability for .NET test suites. Track test reliability, detect flaky tests, and gain confidence in your testing with minimal setup. Supports NUnit, xUnit, and MSTest.