Could it be that this take is not too far fetched?
r/LocalLLaMA
•
Open Source AI
AI Research
Sources: - - - lots of people complaining that few weeks after launch, sota models degrade. Many speculate about: cost savings, strained compute, etc. - we actually need a constant benchmark about this, but I think if the benchmark gets too notable AI providers (or even those that provide infrastructure for open weight models, as quantization and routing are a thing) could ensure that the accounts that do the benchmark get access to the full model.