Cicikus v3 Prometheus 4.4B - An Experimental Franken-Merge for Edge Reasoning
r/LocalLLaMA
•
Machine Learning
Generative AI
Open Source AI
AI Research
Hi everyone, We are excited to share an experimental release from Prometech: Cicikus v3 Prometheus 4.4B. This model is a targeted passthrough expansion of the Llama 3.2 3B architecture. Instead of a traditional merge, we identified "Hot Zones" through L2 norm analysis of trained adapters to expand the model to 40 layers (~4.42B parameters). Key Features: BCE Integration: Fine-tuned with our Behavioral Consciousness Engine for improved self-audit and reasoning. Context: 32k token. Edge Optimized: Designed to run high-density reasoning tasks on consumer hardware (8GB Safetensors.