Powerinfer, can it be adapted into normal laptop cpus outside of the Tiiny AI ecosystem?

r/LocalLLaMA
Generative AI

Hey there people. So let's say I am unable to afford a relatively modern laptop, let alone this new shiny device that promises to run 120B parameters large language models. So I've heard it uses some kind of new technique called PowerInfer. How does it work and can it be improved or adapted for regular old hardware like Intel 8th gen? Thanks for your information. submitted by /u/Silver-Champion-4846 [link] [comments]