Running Llama2 Models in Vanilla Minecraft With Pure Commands

r/LocalLLaMA
Generative AI NLP Open Source AI AI Research

I made a program that converts any llama2 large language model into a minecraft datapack, and you can run inference right inside the game. It's still semi-finished, Currently I've only implemented argmax sampling, so the output tends to stuck in loops sometimes. Adding top-p sampling will probably improve this a lot. The tokenizer is also missing for now, it can only generate text from scratch. Inference speed is. quite slow. With a 15M parameter model, it takes roughly 20 minutes to produce a single token.