{"id":687504,"date":"2026-05-22T14:45:11","date_gmt":"2026-05-22T14:45:11","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/687504\/"},"modified":"2026-05-22T14:45:11","modified_gmt":"2026-05-22T14:45:11","slug":"ai-aids-scientists-in-decoding-hi-res-microscope-data","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/687504\/","title":{"rendered":"AI Aids Scientists in Decoding Hi-Res Microscope Data"},"content":{"rendered":"<p>In a cramped, windowless room on the University of California, Berkeley campus, two bespoke microscopes \u2014 each a Swiss Army knife for high-resolution imaging \u2014 operate around the clock gathering data that will help train a game-changing technology for the field of biology: AI.<\/p>\n<p>The identical microscopes,  <a href=\"https:\/\/www.nature.com\/articles\/s41592-026-03066-1\" rel=\"nofollow noopener\" target=\"_blank\">described this week<\/a>  in the journal Nature Methods, squeeze a dozen types of high-powered microscopes into a single machine, from standard phase contrast to the latest lattice light-sheet technology \u2014 easily switchable with the push of a button. Called MOSAIC (Multimodal Optical Scope with Adaptive Imaging Correction), it has already been recreated in more than a dozen labs worldwide thanks to preprints and elaborate assembly instructions disseminated over the past six years.<\/p>\n<p>At UC Berkeley, it is one in a lineup of improved imaging technologies that could forever alter the field of biology, the researchers say. The microscopes can track over seconds, hours or days the development of live specimens, ranging from molecules and cells to entire embryos, gathering huge amounts of data that will allow biologists to track cells as they move through tissue, the evolution of internal cellular structures and even the shuttling of proteins and other molecules within the cell.<\/p>\n<p>All this data \u2014 measured in petabytes, the equivalent of about 500 billion pages of text \u2014 requires the analytic ability of a large &#8220;vision&#8221; language model (LVLM), like ChatGPT. Building an LVLM or AI that can deal with petabytes of imaging data is now one of the main focuses of a team of microscopists, physicists, biologists and computer scientists in Berkeley&#8217;s  <a href=\"https:\/\/news.berkeley.edu\/2019\/11\/27\/new-center-illuminates-microscopic-universe-within-each-cell\/\" rel=\"nofollow noopener\" target=\"_blank\">Advanced Bioimaging Center<\/a> , which hopes to create a first-of-its-kind Cell Observatory.<\/p>\n<p>&#8220;Life has to be studied in living tissue, holistically, and over fast timescales and for long periods of time,&#8221; said  <a href=\"https:\/\/mcb.berkeley.edu\/faculty\/CDB\/betzige\" rel=\"nofollow noopener\" target=\"_blank\">Eric Betzig<\/a> , a Berkeley professor of molecular and cell biology and of physics who won the 2014 Nobel Prize in Chemistry for the development of super-resolution fluorescence microscopy \u2014 a version of which is now incorporated into MOSAIC. &#8220;You can&#8217;t study something as complex as a cell or organism just by looking at the parts individually \u2014 there are something like 40 million protein molecules alone of 20,000 different types. With our microscopes, we can image everything from single molecules to whole organisms at high resolution, following as many players as we can to understand natural physiological interactions in the cell.&#8221;<\/p>\n<p>Betzig, a Howard Hughes Medical Institute investigator, refers to the imaging data as five-dimensional, or 5D: three spatial dimensions, plus time and color. The color comes from fluorescent labels that allow scientists to track multiple subcellular structures simultaneously \u2014 organelles, membranes, the cytoskeleton and more \u2014 as they migrate, change shape, divide and interact over time.<\/p>\n<p>&#8220;We are the world&#8217;s best at collecting data at 5D, and have been for a decade,&#8221; he said. &#8220;But we don&#8217;t know how to interpret the data at scale; we can&#8217;t think in petabytes and we don&#8217;t see in 5D. That&#8217;s why we&#8217;re developing a 5D AI \u2014 it&#8217;s a sherpa to guide us.&#8221;<\/p>\n<p>MOSAIC&#8217;s development was led by  <a href=\"https:\/\/mcb.berkeley.edu\/faculty\/cdb\/upadhyayulas\" rel=\"nofollow noopener\" target=\"_blank\">Srigokul &#8220;Gokul&#8221; Upadhyayula<\/a> , an assistant professor in residence in molecular and cell biology who had earlier worked with Betzig on other high-resolution techniques, the  <a href=\"https:\/\/www.science.org\/doi\/10.1126\/science.aaq1392\" rel=\"nofollow noopener\" target=\"_blank\">adaptive optical lattice light<\/a>  <a href=\"https:\/\/www.science.org\/doi\/10.1126\/science.aaq1392\" rel=\"nofollow noopener\" target=\"_blank\">-sheet microscope<\/a> , and the  <a href=\"https:\/\/news.berkeley.edu\/2019\/01\/17\/thanks-to-rapid-3d-imaging-anyone-can-tour-the-fly-brain\/\" rel=\"nofollow noopener\" target=\"_blank\">expansion lattice light-sheet microscope<\/a>  \u2014 both now part of MOSAIC.<\/p>\n<p>&#8220;Biology is entering an era in which the data are too complex and too large to interpret by human inspection alone,&#8221; he said. &#8220;A biologist may understand the biological question deeply, but still lack the computational tools and infrastructure needed to process, analyze and quantify what they are seeing. We need to build a mind that can reason natively with 3D movies of living biological systems and let us query those dynamics through language \u2014 akin to a ChatGPT for biology.&#8221;<\/p>\n<p>One remarkable video they captured shows a zebrafish regrowing its tail fin. Although the movie itself spans only 12 hours, it took months of preparation, processing and visualization before they could fully understand what it showed. The video revealed tiny events inside living tissue that are normally very hard to see: cells near the wound releasing small communication packets, microscopic fibers beneath the skin shifting as the tissue repaired itself, two repair cells fusing together and a red blood cell briefly getting trapped as new blood vessels were remodeled.<\/p>\n<p>An AI assistant would not only help assemble these data-intensive movies, but help biologists home in on the specific activities they&#8217;re interested in.<\/p>\n<p>&#8220;There&#8217;s so much information in these large movies, across scales, about how cells are behaving in the organism and the tissue and at the subcellular level, it can be difficult even for a very well-trained biologist to understand or digest,&#8221; said Ian Swinburne, a Berkeley assistant professor of molecular and cell biology who works with Gokul&#8217;s team to study how cells engulf other cells, such as the macrophages that clean up dead cells in a wound. &#8220;AI can help us interface with the data and ask or answer questions more easily. Like, &#8216;How many macrophages are crawling into my tissue during an infection?&#8217; or &#8216;Can I predict when a cell&#8217;s going to start leaving its organ?&#8217; That happens in development but also in cancer during metastasis.&#8221;<\/p>\n<p>&#8220;The impact of MOSAIC will be minimal until we build an AI model to be able to deal with the data that comes out of those systems; we basically have a gold mine, but we have no ability to get the gold out,&#8221; Upadhyayula said. &#8220;The primary output of our Cell Observatory Initiative will be an AI mind that&#8217;s able to be our scientific partner in extracting these observations.&#8221;<\/p>\n<p>A &#8216;Swiss Army Knife&#8217; microscope<\/p>\n<p>MOSAIC relies on several advances, Upadhyayula said: fluorescent molecules that allow biologists to mark specific cellular structures and molecular activities in living cells; fast, gentle light-sheet imaging that captures those dynamics with minimal stress or damage to the cells; high-speed data transfer and computing infrastructure capable of moving and processing massive imaging datasets; and new computational tools, including AI models, to help interpret the resulting 3D movies of living systems.<\/p>\n<p>He and his colleagues in the Advanced Bioimaging Center combine these to create one-off high-resolution microscopes, such as the super-resolution microscope, which won Betzig the Nobel Prize. That innovation involved using a laser to stimulate fluorescent tags, which allowed researchers to image individual molecules in a cell and superimpose them into high-resolution images.<\/p>\n<p>Betzig subsequently developed a faster but gentler technique for hi-res cell imaging, lattice light-sheet microscopy (LLSM), which reduces cellular damage by spreading the laser energy across a thin sheet to more gently illuminate a transparent specimen one thin slice at a time. The fluorescing markers are captured in real time and assembled into a 3D video.<\/p>\n<p>MOSAIC combines these and other high-resolution imaging techniques into a single machine that can quickly transition from one imaging mode to another, repositioning many of the lenses that shape the light. To sharpen images, it uses adaptive optical elements, such as a deformable mirror controlled by 69 tiny motors that make minute adjustments to correct for blurring caused by aberrations in the living tissue itself.<\/p>\n<p>Among the available modes are the latest versions of light-sheet and super-resolution microscopy, as well as multi-photon and label-free imaging. Across the various modes, MOSAIC is able to capture subcellular dynamics in cultured cells and live multicellular organisms, map nanoscale features across millimeter-scale expanded tissues and image the neural architecture in the brains of live mice.<\/p>\n<p>Movies make a difference<\/p>\n<p>The researchers emphasized the importance of video in understanding biological interactions, and the need to see them with sufficient fidelity.<\/p>\n<p>&#8220;The name of the game is to keep the organism, the sample, as physiologically happy as possible,&#8221; Upadhyayula said. &#8220;Which means using the lowest light dose we can to keep it from deep-frying while getting the information we need. The consequence is that the image gets noisy. When we watch a noisy movie over time, our minds naturally filter out some of the noise and focus on the underlying structures.&#8221;<\/p>\n<p>But getting AI to interpret 5D images is significantly harder than conventional image recognition.<\/p>\n<p>&#8220;The current vision models are not built to reason over three dimensions, time and molecular identity or color, and that&#8217;s what we want to build,&#8221; he said.<\/p>\n<p>Swinburne and Dave Matus, a researcher working with Betzig and Upadhyayula on the Cell Observatory Initiative, are now helping develop new labeling reagents that highlight subsets of the thousands of components for AI to recognize. While thoroughly impressed with MOSAIC&#8217;s ability, Swinburne admits that the videos are so good that it&#8217;s hard to focus on just one thing.<\/p>\n<p>&#8220;There&#8217;s so much information in these movies,&#8221; he said. &#8220;We come in with maybe a hypothesis about the process we think we&#8217;re studying and then we get distracted by something we&#8217;ve never seen before. Probably every movie has something new that we acquire just because the quality is so high, the spatial and time resolution so much better than what we&#8217;re used to.&#8221;<\/p>\n<p>The four first authors of the Nature Methods paper are Gaoxiang Liu and Xiongtao Ruan of UC Berkeley and Tian-Ming Fu and Daniel Milkie at the Janelia Research Campus of the Howard Hughes Medical Institute (HHMI) in Virginia. Upaphyayula, Betzig and Wesley Legant of the University of North Carolina at Chapel Hill are senior authors of the paper. The work was funded in part by HHMI, Philomathia Foundation, Biohub, the Sloan Foundation and Berkeley Lab. Betzig is a HHMI investigator and Upadhyayula is a Biohub San Francisco investigator.<\/p>\n<p>    \/Public Release.  This material from the originating organization\/author(s) might be of the point-in-time nature, and edited for clarity, style and length. Mirage.News does not take institutional positions or sides, and all views, positions, and conclusions expressed herein are solely those of the author(s).View in full <a rel=\"noopener nofollow\" style=\"color:#999;text-decoration:underline;\" href=\"https:\/\/www.miragenews.com\/ai-aids-scientists-in-decoding-hi-res-1679048\/\" dhref=\"https:\/\/doi.org\/10.1038\/s41592-026-03066-1\" target=\"_blank\">here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"In a cramped, windowless room on the University of California, Berkeley campus, two bespoke microscopes \u2014 each a&hellip;\n","protected":false},"author":2,"featured_media":566248,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[64,63,128],"class_list":["post-687504","post","type-post","status-publish","format-standard","has-post-thumbnail","category-science","tag-au","tag-australia","tag-science"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/687504","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=687504"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/687504\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/566248"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=687504"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=687504"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=687504"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}