{"id":148733,"date":"2025-09-11T10:47:12","date_gmt":"2025-09-11T10:47:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/148733\/"},"modified":"2025-09-11T10:47:12","modified_gmt":"2025-09-11T10:47:12","slug":"synthetic-data-can-benefit-medical-research-but-risks-must-be-recognized","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/148733\/","title":{"rendered":"Synthetic data can benefit medical research \u2014 but risks must be recognized"},"content":{"rendered":"<p class=\"c-nature-box__text js-text\" data-test=\"access-message\">\n                You have full access to this article via your institution.<\/p>\n<p>                        <img decoding=\"async\" class=\"figure__image\" alt=\"A radiologist at Shaoxing Central Hospital performs rapid and accurate diagnoses with the help of an AI image analysis system\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/09\/d41586-025-02869-0_51426458.jpg\"\/><\/p>\n<p class=\"figure__caption u-sans-serif\">Synthetic data have the potential to improve aspects of health care, for example, in the rapid analysis of X-rays.Credit: Costfoto\/NurPhoto\/Getty<\/p>\n<p>The revolution promised by the application of artificial intelligence (AI) to research and health care has been much discussed, but less attention has been paid to the sub-revolution following in its slipstream. Increasingly, AI models are being trained on \u2018synthetic\u2019 data. There is <a href=\"https:\/\/royalsociety.org\/-\/media\/policy\/projects\/privacy-enhancing-technologies\/Synthetic_Data_Survey-24.pdf\" data-track=\"click\" data-label=\"https:\/\/royalsociety.org\/-\/media\/policy\/projects\/privacy-enhancing-technologies\/Synthetic_Data_Survey-24.pdf\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">no universally agreed definition for this type of data<\/a>, but, in this Editorial, we are talking about information used in medical research that was not collected in the real world. A growing number of synthetic data sets exist that were generated by a mathematical model or algorithm \u2014 sometimes incorporating real-world data \u2014 and are designed to mimic the presumed statistical properties of real-world data.<\/p>\n<p><a href=\"https:\/\/www.nature.com\/articles\/d41586-025-02911-1\" class=\"u-link-inherit\" data-track=\"click\" data-track-label=\"recommended article\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" class=\"recommended__image\" alt=\"\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/09\/d41586-025-02869-0_51438114.jpg\"\/><\/p>\n<p class=\"recommended__title u-serif\">AI-generated medical data can sidestep usual ethics review, universities say<\/p>\n<p><\/a><\/p>\n<p>The use of such data has some clear benefits, for example, for hypothesis generation, for preliminary testing of an idea before actual data collection, and for anticipating the results of experiments. Synthetic data also have much potential to improve studies involving low- and middle-income countries, where real data can be scarce, and barriers to collection high. Synthetic data can also be shared more freely, in part because there are fewer risks of study participants being identified, proponents say<a href=\"#ref-CR1\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">1<\/a>.<\/p>\n<p>As one example of their application in clinical settings, synthetic data are being used in AI models that can interpret patients\u2019 X-ray scans and generate reference scans<a href=\"#ref-CR2\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">2<\/a>. Worldwide, there is a shortage of radiologists, and <a href=\"https:\/\/www.everlightradiology.com\/global-radiologist-report-2025\" data-track=\"click\" data-label=\"https:\/\/www.everlightradiology.com\/global-radiologist-report-2025\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">real-world training data remain limited<\/a>. The AI models can assist radiologists in making decisions, potentially helping them to work faster and with greater accuracy<a href=\"#ref-CR3\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">3<\/a>.<\/p>\n<p>As we report this week (<a href=\"https:\/\/www.nature.com\/articles\/d41586-025-02911-1\" data-track=\"click\" data-label=\"https:\/\/www.nature.com\/articles\/d41586-025-02911-1\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">Nature https:\/\/doi.org\/10.1038\/d41586-025-02911-1; 2025<\/a>), some universities and research institutions are waiving ethical review requirements for research in which synthetic data are being used instead of human data. Ordinarily, an independent ethics board would review how studies affect participants\u2019 rights, safety, dignity and well-being. But because synthetic data at most derive from human data, some researchers have been able to persuade their institutions that an ethical review isn\u2019t needed. Considering the speed and scale at which AI is being adopted, this raises at least two concerns.<\/p>\n<p><a href=\"https:\/\/www.nature.com\/articles\/d41586-025-02095-8\" class=\"u-link-inherit\" data-track=\"click\" data-track-label=\"recommended article\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" class=\"recommended__image\" alt=\"\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/09\/d41586-025-02869-0_51284302.jpg\"\/><\/p>\n<p class=\"recommended__title u-serif\">This AI \u2018thinks\u2019 like a human \u2014 after training on 160 psychology studie<\/p>\n<p><\/a><\/p>\n<p>The first is how to better understand and mitigate the risk that people whose data have been used to generate AI models could be identified. This particular problem might well lessen as models move through their second, third, fourth and fifth iterations \u2014 in which synthetic data are essentially trained on other synthetic data, and the link to real data becomes more remote. But it needs to be taken seriously if, for example, identities can be revealed without individuals\u2019 consent<a href=\"#ref-CR4\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">4<\/a>.<\/p>\n<p>The second concern is more deeply rooted. Anyone with skin in this game \u2014 such as producers, publishers and users of AI studies \u2014 needs to be reassured that the findings of AI models trained on synthetic data can be validated, not least because of the risk of \u2018model collapse\u2019. In this scenario, AI models trained on successive generations of synthetic data <a href=\"https:\/\/www.nature.com\/articles\/d41586-024-02420-7\" data-track=\"click\" data-label=\"https:\/\/www.nature.com\/articles\/d41586-024-02420-7\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">start to generate nonsense<\/a><a href=\"#ref-CR5\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">5<\/a>. Validation can take different forms, but at its core is the principle that a result needs to be confirmed by researchers independent of those reporting it. At present, this often does not happen, and there are no agreed guidelines for how it should. However, researchers are proposing ways in which it could be supported.<\/p>\n<p>Zisis Kozlakidis, a data scientist for the World Health Organization, headquartered in Geneva, Switzerland, says that, in the absence of real-world data against which to test results from synthetic data, researchers should explain how they generated their synthetic data, describing their algorithm, parameters and assumptions. They could also propose how another group might validate their results.<\/p>\n<p><a href=\"https:\/\/www.nature.com\/articles\/d41586-025-02353-9\" class=\"u-link-inherit\" data-track=\"click\" data-track-label=\"recommended article\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" class=\"recommended__image\" alt=\"\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/09\/d41586-025-02869-0_51430476.jpg\"\/><\/p>\n<p class=\"recommended__title u-serif\">Could machine learning help to build a unified theory of cognition?<\/p>\n<p><\/a><\/p>\n<p>In an article published in BMJ Evidence-Based Medicine in July, bioinformatics researcher Randi Foraker at the University of Missouri in Columbia and her colleagues suggest that there should be reporting standards for synthetic data alongside those that already exist for data and code availability<a href=\"#ref-CR6\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">6<\/a>. They recommend that researchers work with publishers to develop these.<\/p>\n<p>Marcel Binz at the Helmholtz Institute for Human-Centred AI in Munich, Germany, makes a powerful case for validation across all forms of AI (<a href=\"https:\/\/doi.org\/g9r6ct\" data-track=\"click\" data-label=\"https:\/\/doi.org\/g9r6ct\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">Nature https:\/\/doi.org\/g9r6ct; 2025<\/a>), following a study, on which he is a co-author, on how AI is being used to predict people\u2019s decision-making<a href=\"#ref-CR7\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">7<\/a>. The model that he and his colleagues developed, called Centaur, was trained on data from psychology experiments that recorded more than 10 million choices made by study participants across a range of decision-making tasks. Some researchers <a href=\"https:\/\/www.science.org\/content\/article\/researchers-claim-their-ai-model-simulates-human-mind-others-are-skeptical\" data-track=\"click\" data-label=\"https:\/\/www.science.org\/content\/article\/researchers-claim-their-ai-model-simulates-human-mind-others-are-skeptical\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">are sceptical about its ability to predict human behaviour<\/a>. Binz <a href=\"https:\/\/www.nature.com\/articles\/d41586-025-02095-8\" data-track=\"click\" data-label=\"https:\/\/www.nature.com\/articles\/d41586-025-02095-8\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">told Nature\u2019s news team<\/a> that the model \u2014 which is freely accessible \u2014 needs to be externally validated. \u201cIt\u2019s probably the worst version of Centaur that we will ever have, and it will only get better from here.\u201d<\/p>\n<p>The benefits of synthetic data are clear. But the risks need to be recognized and mitigated \u2014 and the temptation to accept results as valid and accurate just because a computer says they are must be avoided at all costs.<\/p>\n","protected":false},"excerpt":{"rendered":"You have full access to this article via your institution. Synthetic data have the potential to improve aspects&hellip;\n","protected":false},"author":2,"featured_media":148734,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[32],"tags":[19944,1159,1877,1160,79,74],"class_list":["post-148733","post","type-post","status-publish","format-standard","has-post-thumbnail","category-science","tag-computer-science","tag-humanities-and-social-sciences","tag-machine-learning","tag-multidisciplinary","tag-science","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/148733","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=148733"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/148733\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/148734"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=148733"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=148733"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=148733"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}