When models are hitting new highs on benchmarks, are they good in general or good at getting good results on benchmarks? Björn Mattsson and Pat Walter's preprint on data leakage is available on biorxiv:

bioRxiv

Identifying and Addressing Systematic Data Leakage in Protein-Ligand Affinity Benchmarks

Accurate prediction of protein-ligand binding affinity is a crucial goal in structure-based drug discovery, with the potential to significantly sho...

#bio #ai

Soon the question won't be a model's cost or "accuracy", it'll be who made it. The lab behind a model shapes how it nudges and persuades. We already see that people have "a high tendency to follow the potentially harmful medical advice" from model output (1) - imagine the power these providers can have, not just in intelligence but in persuasion. 1:

MIT Media Lab

People Overtrust AI-Generated Medical Advice despite Low Accuracy – MIT Media Lab

We conducted a study in which a total of 300 participants gave evaluations for medical responses that were either written by a medical doctor on an...

nostr is an amazing platform to build on! View quoted note →

The greatest things to come from the AI boom is that people will meet each other more and, ironically, since we have an explosion in new apps and websites being built these days, will spend less time using them.

Event reminders working as intended 😀