Get the latest tech news

Show HN: Entropy-Guided Loop – How to make small models reason


A notebook that compares a reasoning model x a non reasoning model that runs a loop using logprobs found uncertainty - monostate/weave-logprobs-reasoning-loop

OpenAI Responses API with include=["message.output_text.logprobs"] Weave by Weights & Biases for comprehensive experiment tracking and visualization Perplexity-based thresholds for triggering refinement Top-k alternatives for informing the model about uncertainty regions View your experiments: After running, visit the URL printed in console to explore: Token-by-token uncertainty metrics Refinement decision rationale Cost and performance comparisons Full conversation traces with hierarchical operations OpenAI for providing logprobs access via their APIs Weights & Biases team for the Weave framework The broader AI research community exploring uncertainty quantification

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Entropy-Guided Loop

Entropy-Guided Loop

Photo of small models reason

small models reason