SWE-rebench Leaderboard (Feb 2026): GPT-5.4, Qwen3.5, Gemini 3.1 Pro, Step-3.5-Flash and More

r/LocalLLaMA
Generative AI

Hi, We’ve updated the SWE-rebench leaderboard with our February runs on 57 fresh GitHub PR tasks (restricted to PRs created in the previous month). The setup is standard SWE-bench: models read real PR issues, edit code, run tests, and must make the full suite pass. Key observations: Claude Opus 4.6 remains at the top with 65.3% resolved rate, continuing to set the pace, with strong pass (~70%). The top tier is extremely tight: gpt-5.2-medium (64.4%), GLM-5 (62.8%), and gpt-5.4-medium (62.8%) are all within a few points of the leader.