Industry & Business MIT Technology Review (AI)

When can we say AI made a scientific discovery?

AnthropicAI for sciencebiologyresearch claims

Anthropic announced last Wednesday that earlier this year it launched a molecular biology lab where Claude agents read and conjecture about hard biology problems while human scientists run experiments on what they report — and that this AI-powered lab had made its first discovery. To understand what the system did, imagine flipping through a library of millions of DNA sequences amassed as scientists sequence more of the living world: one step toward a breakthrough might be finding a peculiar sequence encoding an interesting enzyme, then figuring out what that enzyme does and eventually how to manipulate it to do something useful.

What Anthropic says its system of 950 agents found after 21 hours was not a brand-new sequence. The agents instead flagged a repeating pattern surrounding a known enzyme — one Anthropic said hadn't been catalogued before. But Anthropic's announcement calls the pattern "reminiscent" of what led to CRISPR, the gene-editing technology that "has already transformed science and medicine," making it sound as if the agent army found something of real note.

Those claims have angered some biologists. A viral post from one, subsequently endorsed by the chair and CEO of Eli Lilly, argued that "finding a weird cluster of genes and repeats is often the easy part. The hard part, and where the real discoveries come from, is figuring out what the system actually does." The agents helped with laboratory grunt work — but a discovery it is not. It's a reminder that even when AI does something impressive, like finding a pattern in biological data that would be hard for human eyes alone to perceive, the result may not constitute a breakthrough for science: what is novel for AI may be routine, unsurprising, or simply inconsequential to a biologist.

Muddying things further, Mario Rodríguez Mestre, a biologist at the University of Copenhagen, said over the weekend that his team had already discovered this particular pattern, per the New York Times. Mestre, who regularly chatted with Claude in his work, wondered whether Anthropic's team had learned from his conversations. Anthropic denies this, but Mestre says he is stopping all use of Claude anyway.

Part of the problem, the piece argues, is that AI companies aren't presenting their systems simply as tools scientists can use, like microscopes or supercomputers — they insist the AI systems are making discoveries themselves. To some, that approach is incompatible with how science actually works, with new knowledge more typically emerging from collaboration and an ever-growing arsenal of tools. It also makes people more skeptical of genuine progress when it happens.

Read original →

← Back to home