Powerinfer, can it be adapted into normal laptop cpus outside of the Tiiny AI ecosystem?
r/LocalLLaMA
•
Generative AI
Hey there people. So let's say I am unable to afford a relatively modern laptop, let alone this new shiny device that promises to run 120B parameters large language models. So I've heard it uses some kind of new technique called PowerInfer. How does it work and can it be improved or adapted for regular old hardware like Intel 8th gen? Thanks for your information. submitted by /u/Silver-Champion-4846 [link] [comments]