Seq vs Seq: An Open Suite of Paired Encoders and Decoders

ArXi:2507.11412v2 Announce Type: replace-cross The large language model (LLM) community focuses almost exclusively on decoder-only language models, since they are easier to use for text generation. However, a large subset of the community still uses encoder-only models for tasks such as classification or retrieval. Previous work has attempted to compare these architectures, but is forced to make comparisons with models that have different numbers of parameters