Qwen 3.5 9B LLM GGUF quantized for local structured extraction
r/LocalLLaMA
•
Machine Learning
Generative AI
Open Source AI
AI Research
The gap between "this fine-tune does exactly what I need" and "this fine-tune actually runs on my hardware" for structured extraction use-case is where most specialized models die. To fix this, we quantized acervo-extractor-qwen3.5-9b to Q4_K_M. It's a 9B Qwen 3.5 model fine-tuned for structured data extraction from invoices, contracts, and financial reports.