Spectral-AI - a project to use Nvidia RT cores to dramatically speedup MoE inference on Nvidia GPU's (Crazy Fast!)
r/LocalLLaMA
•
AI Hardware
Submitted by /u/Thrumpwart [link] [comments]