GPT‑Rosalind for life sciences research

81 points - yesterday at 7:24 PM

Source

Comments

Cynddl yesterday at 11:11 PM
Is it me or they very carefully do not report performance on GPT-5.4 Pro, only the default GPT-5.4? They also very carefully left Anthropic models out of their comparison.

I went back to the BixBench benchmark which they mentioned. I couldn't find official results for Anthropic models, but I found a project taking Opus 4.6 from 65.3% to 92.0% (which would be above GPT-Rosalind) with nearly 200 carefully crafted skills [1]. There also appears to be competitive competitor models with scores on par with this tuned GPT.

[1] https://github.com/jaechang-hits/SciAgent-Skills

an0malous today at 12:01 AM
“GPT-5 is the first time that it really feels like talking to an expert in any topic, like a PhD-level expert.”

Sam Altman, August 2025

https://www.bbc.com/news/articles/cy5prvgw0r1o

shwn2989 today at 5:11 AM
I prefer GPT 5 pro, which i found expert in coding and reasoning.
furyofantares yesterday at 10:23 PM
I'm all for naming things in honor of Rosalind Franklin, but this seems like incredible misplaced hubris instead.
huslage today at 2:45 AM
I work for a life sciences company. It will be a long time before anyone trusts a generative model to do the actual science when mathematically provable models are as good as they are today. There is room for AI in the field, but it's not in the science directly.
modeless yesterday at 11:46 PM
The voiceover in the promo video on this page seems to be AI generated, with some weird artifacts. Right at the beginning it sounds like it says "cormbiying structure daya retrieval and lirrachure search".
jostmey today at 12:33 AM
The real issue isn’t finding therapies but getting them tested in clinical trials
tonfreed today at 12:42 AM
Who's at fault when it suggests feeding someone cyanide?
34pasKj yesterday at 9:25 PM
[flagged]