Tools like ChatGPT can give instructions on how to find, synthesise and order deadly pathogens, albeit incomplete ones. Biologists now want more involvement in the training and testing of AI models, while some worry that science’s culture of openness might need to change