leochlon

    leochlon/hallbayes

    backend
    Python
    MIT
    1.7K stars
    161 forks
    1.7K GitHub watchers
    Updated Nov 3, 2026
    View on GitHub

    Build with Backblaze B2

    SDKs, agent skills, IDE extensions, and reference pipelines from Backblaze Labs. All open source.

    Explore Backblaze Labs

    Loading star history...

    Where it stands

    Rank, growth pace and release cadence relative to everything GStars tracks.

    The project lists 2 contributors on GitHub.

    Use Cases & Benefits

    • Provides tools to detect procedural hallucinations and evaluate language model reliability through mathematical and information-theoretic methods.
    • Enables precise identification of when models know information but fail to use it correctly, improving trustworthiness of AI outputs.
    • Use for detecting retrieval-augmented generation failures where models retrieve but do not properly read or use evidence.
    • Use for probing language models offline with permutation-mixture evaluations to assess token-level confidence and reasoning consistency.
    • Use for integrating with Thea Mini Reasoning API to perform unified question answering across multiple backend models efficiently.

    Should you depend on it?

    License terms, project hygiene and risks, from GitHub metadata and GStars' snapshots.

    License

    MIT

    Permissive: commercial use, modification and redistribution are allowed with attribution.

    Community files

    • README: present

    Watch-outs

    • Owned by an individual account with only 2 contributors on GitHub; plan for bus-factor risk.

    General guidance from repository metadata, not legal advice. How we score

    From the README

    LLM reliability research from Hassana Labs.

    Three tools, one goal: catch models that know but don't use.

    Ask Claude to count the r's in "strawberry." It writes "s-t-r-a-w-b-e-r-r-y," identifies each r, gets to 3. Then outputs "2."

    The model didn't lack information. The answer was right there—in text it generated moments earlier. The computation worked. The routing failed.

    This toolkit detects those failures mathematically.

    How: Scrub the cited evidence, measure confidence change. No change? The model was confabulating.

    Lightweight client for the Thea Mini Reasoning API.

    Excerpt from the leochlon/hallbayes README on GitHub (MIT license). © its authors.Read the full README on GitHub

    Daily snapshots

    Stars gained per day, and how forks and open issues moved, from GStars' daily snapshots

    Forks

    161-2

    Open issues

    15+3

    Compared with peers in Backend

    Fastest-growing repositories GStars tracks in this cohort for the week of Nov 1, by 7-day star growth

    leochlon/hallbayes compared with Backend repositories by stars, 7-day star growth, health score and last release
    RepositoryStars+7dHealthLast release
    anthropics/skills187.8K+2.9K15—
    DuarteSantos8/openGym19.7K+2.4K602 days ago
    shiyu-coder/Kronos47.0K+2.3K16—
    NationalSecurityAgency/ghidra98.2K+2.3K6414 days ago
    microsoft/VibeVoice56.0K+1.1K29—
    leochlon/hallbayes1.7K—6—
    Category median56.0K+2.3K29—

    Discover Repositories

    Search across tracked repositories by name or description