DFIELDSOLUTIONS

Free software

LabAuspex: Know how well you actually know

Pure, tested calibration math: Brier score + confidence-binned reliability diagram + an over/under-confidence read. Boundary cases pinned by 8 unit tests.

Free software1 sections · 2 min readBy Dezső Mező.mdFree softwareAuspex

Auspex lets you record predictions with a confidence level and then measures how well-calibrated you actually are. The math is pure and tested: a Brier score, a confidence-binned reliability diagram, and an over/under-confidence read. It is a from-scratch, dependency-light build whose boundary cases are pinned by 8 unit tests, and you can download and run it locally.

01About the app

Statistics + data viz

What to take away

  • Pure, tested calibration math: Brier score + confidence-binned reliability diagram + an over/under-confidence read. Boundary cases pinned by 8 unit tests.
  • Download: Auspex (ZIP)

Terms used in this piece

We build this for clientsFull-stack

Read the full write-up

More from the lab

Browse all entries

Want this looked at on your own system?Start a conversation

5.0
“New shop, more orders in the first week.”Müller Márk · GeekCornerManaging Director · Hungary