this post was submitted on 16 Feb 2025
59 points (91.5% liked)

Technology

2366 readers
34 users here now

Post articles or questions about technology

founded 2 years ago
MODERATORS
 

cross-posted from: https://lemmy.sdf.org/post/29607342

Archived

Here is the data at Hugging Face.

A team of international researchers from leading academic institutions and tech companies upended the AI reasoning landscape on Wednesday with a new model that matched—and occasionally surpassed—one of China's most sophisticated AI systems: DeepSeek.

OpenThinker-32B, developed by the Open Thoughts consortium, achieved a 90.6% accuracy score on the MATH500 benchmark, edging past DeepSeek's 89.4%.

The model also outperformed DeepSeek on general problem-solving tasks, scoring 61.6 on the GPQA-Diamond benchmark compared to DeepSeek's 57.6. On the LCBv2 benchmark, it hit a solid 68.9, showing strong performance across diverse testing scenarios.

...

all 5 comments
sorted by: hot top controversial new old
[–] AceFuzzLord@lemm.ee 13 points 5 months ago

Sounds like a real Sputnik moment happening here, live before our eyes.

[–] andrew_bidlaw@sh.itjust.works 1 points 5 months ago

Becnhmarks are great if not self-masturbatory, but what about UX with them?