Auspex
Know how well you actually know.
What it is
Auspex lets you record predictions with a confidence level and then measures how well-calibrated you actually are. The math is pure and tested: a Brier score, a confidence-binned reliability diagram, and an over/under-confidence read. It is a from-scratch, dependency-light build whose boundary cases are pinned by 8 unit tests, and you can download and run it locally.
Pure, tested calibration math: Brier score + confidence-binned reliability diagram + an over/under-confidence read. Boundary cases pinned by 8 unit tests.
What's inside
The full source, the tests, and CI. Open it, read it, change it. A zero-dependency core, free, in the MIT spirit.
Run it after unzip
pnpm install && pnpm dev