Inference Engines — A visual deep dive into the journey of a token down the transformer layers

I spent a lot of time building an inference engine like ollama, pure vibe coding in go. I kept trying to push it to optimize it and it was fun but after sometime I really wanted to know what was going on to be able to really know what those optimizations were about and why some were'nt working as I expected. This is a part 1 of those articles that go deep and is beginner friendly to get up to speed with inference. submitted by /u/RoamingOmen [link] [comments]