Running 8B Llama locally on Jetson Orin Nano (using only 2.5GB of memory)
r/LocalLLaMA
•
Generative AI
Open Source AI
Submitted by /u/Responsible_Case_376 [link] [comments]