Get the latest tech news
Two kinds of LLM responses: Informational vs. Instructional
When thinking of LLM evals especially in the context of RAGs, it occurred to me that there are two kinds of distinct responses people get from LLMs: informational and instructional.
When thinking of LLM evals especially in the context of RAGs, it occurred to me that there are two kinds of distinct responses people get from LLMs: informational and instructional. In my experience, this is more pronounced in the domain-specific RAG systems like that of enterprises where people may forget SOPs for different tasks. Yet, none of the metrics I have seen treat the instructional forms of LLM responses as a separate category.
Or read this on Hacker News
