LLMxRay: A Local Observatory for Understanding How LLMs Think

Modern LLMs generate impressive results, but the most interesting part isn’t the final answer - it’s everything that happens before the answer appears. Token probabilities, confidence shifts, reasoning traces, tool calls, divergences between models… all of this is usually hidden. I wanted a way to see these internals clearly, locally, and without relying on cloud APIs. That’s how LLMxRay started. 🧠 What LLMxRay does LLMxRay is a local-first observability tool for LLMs. It works with Ollama, LM Studio, llama.cpp, and any endpoint that streams tokens.