Meta exec denies the company artificially boosted Llama 4’s benchmark scores

Admin1 year ago03 mins

A Meta exec on Monday denied a rumor that the company trained its new AI models to present well on specific benchmarks while concealing the models’ weaknesses. The executive, Ahmad Al-Dahle, VP of generative AI at Meta, said in a post on X that it’s “simply not true” that Meta trained its Llama 4 Maverick…

Meta’s benchmarks for its new AI models are a bit misleading

Admin1 year ago04 mins

One of the new flagship AI models Meta released on Saturday, Maverick, ranks second on LM Arena, a test that has human raters compare the outputs of models and choose which they prefer. But it seems the version of Maverick that Meta deployed to LM Arena differs from the version that’s widely available to developers….

Meta releases Llama 4, a new crop of flagship AI models

Admin1 year ago09 mins

Meta has released a new collection of AI models, Llama 4, in its Llama family — on a Saturday, no less. There are four new models in total: Llama 4 Scout, Llama 4 Maverick, and Llama 4 Behemoth. All were trained on “large amounts of unlabeled text, image, and video data” to give them “broad…