Get the latest tech news
Knowledge Graphs in RAG: Hype vs. Ragas Analysis
A deep dive on Microsoft’s GraphRAG paper found questionable metrics with no value prop, so I analyzed knowledge graphs in RAG using Neo4j
I recently surfaced above the waterline from a deep dive on Microsoft’s GraphRAG paper, hoping to learn lots on the effect of knowledge graphs in RAG. This decreases fabricated information, and is of benefit but still throws a question for developers if using GraphRAG is worth ROI constraints (vs finetuning, which could cost slightly more but lead to much higher scores). The concept of diversity in responses presents a complex metric that may be influenced by various factors, including audience expectations and prompt design.
Or read this on Hacker News
