Deepseek flash seems like a very good replacement for Haiku at the very least
r/LocalLLaMA
•
Open Source AI
We have a chat system which we use haiku for because it is mostly about tool calling and summarisation of them. But we have many tools with pretty complex input schemas, and stuff like gemma didn't cut it, so we went with haiku. Haiku is pretty good. I ran the evals for deepseek v4 flash today compared to haiku and it pretty handily beats it - just with a few prompting changes. Flash is very proactive, it makes many tool calls very accurately and somehow gives the feeling of a very smart and intelligent model.