.Attributes Medicine, Released online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although big foreign language models (LLMs) show assurance in controlled environments, a study currently exposes their limits in real-world scientific applications and points the technique in the direction of sturdy evaluation and benchmarking just before medical make use of.