Parcae: Doing more with fewer parameters using stable looped models
Together AI Blog
•
Generative AI
NLP
Parcae is a stable looped language model that matches the quality of a Transformer twice its size - a 770M model reaching 1.3B-level performance. We