When will we start seeing the first mini LLM models (that run locally) in games?
r/LocalLLaMA
•
Generative AI
AI Hardware
It seems like such a fun use case for LLM's. RPG's with open world games with NPCs not locked to their 10 lines of dialogue but able to make up anything plausible on the fly. Hallucinations are a perk here! Models are getting effecient as well. So my question is, is it realistic to expect the first computer games that also run an LLM model locally to help power the dialogues of the game within a couple of years from now? Or will it remain to taxing for the GPU, where 100% of it's power is needed for the graphics and there is simply no spare power to run the.