11.67% ARC-AGI-2 Local Eval on a Single 4090: The TOPAS Recursive Architecture

r/LocalLLaMA
Generative AI

I'm not sure too many people care about the ARC-AGI-2 competition anymore, but still. I thought some might find this interesting. They're running it one last time this year. Everyone is currently leaderboard-stuffing using the winning open-source code from last year. That's why if you take a peak it's really just the same scores clogging it up. We're doing something a bit different though, building a highly efficient, deep-recursion model from scratch. We just hit 11.67% on the public LB, but that's with a massive asterisk. We don't have a cluster. We have one RTX 4090.