nvidia/NVILA-8B-HD-Video · Hugging Face
r/LocalLLaMA
•
Generative AI
Computer Vision
AI Hardware
Open Source AI
AI Tools
NVILA-HD-Video is a Multi-modal Large Language Model with 8B parameters that understands and answers questions about videos with up to 4K resolution and 1K frames. Specifically, NVILA-HD-Video uses AutoGaze to reduce redundant patches in a video before running the ViT or LLM. Empirically, AutoGaze can reduce in in a video by up to 100x, reducing the latency of ViT/LLM by up to 19x/10x.