AI RESEARCH

[R] Seeking benchmark advice: Evaluating Graph-Oriented Generation (GOG) vs. R.A.G.

r/MachineLearning

I'm looking to continue my research into Graph-Oriented Generation (GOG) as a potential alternative to RAG, but I need to establish meaningful benchmarks. I want to build a showcase that proves whether GOG beats RAG or vice versa (honestly, who knows yet!). So far, my testing has shown a massive reduction in token usage and compute - which is awesome. However, it comes with an extreme lack of creativity and out-of-the-box thinking from the LLM. It essentially trades associative leaps for rigid, deterministic logic.