The new benchmarks like DeepSWE now show a very big gap in proprietary models and open source

Before we could only see a few points between closed and open source models. Hopefully open source can catch up a bit more. At the moment it is quite disappointing. submitted by /u/sitytitan [link] [comments]