Get the latest tech news
Show HN: Value likelihoods for OpenAI structured output
Logprobs for OpenAI Structured Outputs
structured-logprobs is an open-source Python library that enhances OpenAI's structured outputs by providing detailed information about token log probabilities. It works with OpenAI's Structured Outputs, a feature that ensures the model consistently generates responses adhering to a supplied JSON Schema. The module contains a function for mapping characters to token indices ( map_characters_to_token_indices) and two methods for incorporating log probabilities:
Or read this on Hacker News
