OpenAI’s o1 and DeepSeek’s R1 models, which previously sat atop the leaderboard, could only get through roughly 9% of the ...

a company that provides a number of data labeling and AI development services, have released a challenging new benchmark for frontier AI systems. The benchmark, called Humanity’s Last Exam ...

Humanity's Last Exam”, an evaluation is being hailed as the definitive test to determine whether AI can match – or surpass – ...

and startup Cursor created an AI benchmark using riddles from Sunday Puzzle episodes. The team says their test uncovered surprising insights, like that reasoning models — OpenAI’s o1 ...

On Thursday, Scale AI and the Center for AI Safety (CAIS) released Humanity's Last Exam (HLE), a new academic benchmark aiming to "test the limits of AI knowledge at the frontiers of human ...

OpenAI used the subreddit, r/ChangeMyView, to create a test ... benchmark is not new -- it was used to evaluate o1 as well-- it does highlight how valuable human data is for AI model developers ...

OpenThinker-32B achieved benchmark-beating results using just 14% of the data its Chinese competitor needed, marking a win ...

In response, Paritii, a global leader in ethical AI, has launched The Parity Benchmark, a groundbreaking tool designed to measure and reduce bias in large language models (LLMs). DeepSeek-R1 ...