HackerRank Introduces New Benchmark to Assess Advanced AI Models
The ASTRA Benchmark consists of multi-file, project-based problems designed to mimic real-world coding tasks. The intent of the HackerRank ASTRA Benchmark is to determine the correctness and ...
These researchers used NPR Sunday Puzzle questions to benchmark AI ‘reasoning’ models
Researchers used questions from the NPR Sunday Puzzle challenge to build a benchmark to test AI 'reasoning' models.
Allen Institute for AI challenges DeepSeek on key benchmarks with big new open-source AI model
Amid the industry fervor over DeepSeek, the Seattle-based Allen Institute for AI (Ai2) released a significantly larger ...