Reka Edge 2603 multimodal support has been merged into llama.cpp

r/LocalLLaMA
Generative AI Open Source AI AI Research

Hi r/LocalLLaMA! I work at Reka and organized our AMA last month. Some of y'all have asked for llama.cpp - this is a follow-up to let you know that Reka Edge 2603 is now ed upstream in llama.cpp. To get started: Use the Reka Edge 2603 weights from the HF repo Run the GGUF conversion script from the llama.cpp repo root (optional) Use the quantization script for the text decoder One note: the model does not currently reasoning, so run llama-server with `--reasoning off`. Happy hacking! submitted by /u/Available_Poet_6387 [link] [comments.