At UC Berkeley, it is one in a lineup of improved imaging technologies that could forever alter the field of biology, the researchers say. The microscopes can track over seconds, hours or days the development of live specimens, ranging from molecules and cells to entire embryos, gathering huge amounts of data that will allow biologists to track cells as they move through tissue, the evolution of internal cellular structures and even the shuttling of proteins and other molecules within the cell.<\/p>\n
All this data \u2014 measured in petabytes, the equivalent of about 500 billion pages of text \u2014 requires the analytic ability of a large \u201cvision\u201d language model (LVLM), like ChatGPT. Building an LVLM or AI that can deal with petabytes of imaging data is now one of the main focuses of a team of microscopists, physicists, biologists and computer scientists in Berkeley\u2019s Advanced Bioimaging Center<\/a>, which hopes to create a first-of-its-kind Cell Observatory.<\/p>\n \u201cLife has to be studied in living tissue, holistically, and over fast timescales and for long periods of time,\u201d said Eric Betzig<\/a>, a Berkeley professor of molecular and cell biology and of physics who won the 2014 Nobel Prize in Chemistry for the development of super-resolution fluorescence microscopy \u2014 a version of which is now incorporated into MOSAIC. \u201cYou can\u2019t study something as complex as a cell or organism just by looking at the parts individually \u2014 there are something like 40 million protein molecules alone of \u00a020,000 different types. With our microscopes, we can image everything from single molecules to whole organisms at high resolution, following as many players as we can to understand natural physiological interactions in the cell.\u201d<\/p>\n Video of the neuronal activity in a 100 x 100 x 400 micron volume of the brain of a live mouse, obtained with two-photon microscopy and adaptive optics. (Credit: Fu, Liu, Milkie, Ruan et al, Nature Methods)<\/p>\n Betzig, a Howard Hughes Medical Institute investigator, refers to the imaging data as five-dimensional, or 5D: three spatial dimensions, plus time and color. The color comes from fluorescent labels that allow scientists to track multiple subcellular structures simultaneously \u2014 organelles, membranes, the cytoskeleton and more \u2014 as they migrate, change shape, divide and interact over time.<\/p>\n \u201cWe are the world\u2019s best at collecting data at 5D, and have been for a decade,\u201d he said. \u201cBut we don\u2019t know how to interpret the data at scale; we can\u2019t think in petabytes and we don\u2019t see in 5D. That\u2019s why we\u2019re developing a 5D AI \u2014 it\u2019s a sherpa to guide us.\u201d<\/p>\n MOSAIC\u2019s development was led by Srigokul \u201cGokul\u201d Upadhyayula<\/a>, an assistant professor in residence in molecular and cell biology who had earlier worked with Betzig on other high-resolution techniques, the adaptive optical lattice light<\/a>-sheet microscope<\/a>, and the expansion lattice light-sheet microscope<\/a> \u2014 both now part of MOSAIC.<\/p>\n \u201cBiology is entering an era in which the data are too complex and too large to interpret by human inspection alone,\u201d he said. \u201cA biologist may understand the biological question deeply, but still lack the computational tools and infrastructure needed to process, analyze and quantify what they are seeing. We need to build a mind that can reason natively with 3D movies of living biological systems and let us query those dynamics through language \u2014 akin to a ChatGPT for biology.\u201d<\/p>\n Time-lapse images of the regrowth of a zebrafish tail fin, starting immediately after amputation in the embryo. The movie frames, taken about every 3 minutes, show the cell membranes (orange) within a 240 x 180 x 60 micron volume, sharpened by adaptive optics. The video reveals many types of cell behavior, including migration, cell division, cell fusion, microvesicle secretion and both epidermal and blood vessel remodeling. (Imaging credit: \u00a0Fu, Liu, Milkie, Ruan et al, Nature Methods)<\/p>\n One remarkable video they captured shows a zebrafish regrowing its tail fin. Although the movie itself spans only 12 hours, it took months of preparation, processing and visualization before they could fully understand what it showed. The video revealed tiny events inside living tissue that are normally very hard to see: cells near the wound releasing small communication packets, microscopic fibers beneath the skin shifting as the tissue repaired itself, two repair cells fusing together and a red blood cell briefly getting trapped as new blood vessels were remodeled.<\/p>\n An AI assistant would not only help assemble these data-intensive movies, but help biologists home in on the specific activities they\u2019re interested in.<\/p>\n \u201cThere\u2019s so much information in these large movies, across scales, about how cells are behaving in the organism and the tissue and at the subcellular level, it can be difficult even for a very well-trained biologist to understand or digest,\u201d said Ian Swinburne, a Berkeley assistant professor of molecular and cell biology who works with Upadhyayula\u2019s team to study how cells engulf other cells, such as the macrophages that clean up dead cells in a wound. \u201cAI can help us interface with the data and ask or answer questions more easily. Like, \u2018How many macrophages are crawling into my tissue during an infection?\u2019 or \u2018Can I predict when a cell\u2019s going to start leaving its organ?\u2019 That happens in development but also in cancer during metastasis.\u201d<\/p>\n \u201cThe impact of MOSAIC will be minimal until we build an AI model to be able to deal with the data that comes out of those systems; we basically have a gold mine, but we have no ability to get the gold out,\u201d Upadhyayula said. \u201cThe primary output of our Cell Observatory Initiative will be an AI mind that\u2019s able to be our scientific partner in extracting these observations.\u201d<\/p>\n A \u2018Swiss Army Knife\u2019 microscope<\/p>\n MOSAIC relies on several advances, Upadhyayula said: fluorescent molecules that allow biologists to mark specific cellular structures and molecular activities in living cells; fast, gentle light-sheet imaging that captures those dynamics with minimal stress or damage to the cells; high-speed data transfer and computing infrastructure capable of moving and processing massive imaging datasets; and new computational tools, including AI models, to help interpret the resulting 3D movies of living systems.<\/p>\n As shown in this animation, the MOSAIC microscope incorporates several separate imaging modes, including light-sheet and two-photon imaging using both inverted and upright objectives. An adaptive optics system keeps the images sharp. Numerous custom-made optoelectronics are used to shape the light beams used to illuminate the specimens. (Credit: \u00a0Fu, Liu, Milkie, Ruan et al, Nature Methods)<\/p>\n He and his colleagues in the Advanced Bioimaging Center combine these to create one-off high-resolution microscopes, such as the super-resolution microscope, which won Betzig the Nobel Prize. That innovation involved using a laser to stimulate fluorescent tags, which allowed researchers to image individual molecules in a cell and superimpose them into high-resolution images.<\/p>\n Betzig subsequently developed a faster but gentler technique for hi-res cell imaging, lattice light-sheet microscopy (LLSM), which reduces cellular damage by spreading the laser energy across a thin sheet to more gently illuminate a transparent specimen one thin slice at a time. The fluorescing markers are captured in real time and assembled into a 3D video.<\/p>\n MOSAIC combines these and other high-resolution imaging techniques into a single machine that can quickly transition from one imaging mode to another, repositioning many of the lenses that shape the light. To sharpen images, it uses adaptive optical elements, such as a deformable mirror controlled by 69 tiny motors that make minute adjustments to correct for blurring caused by aberrations in the living tissue itself.<\/p>\n Among the available modes are the latest versions of light-sheet and super-resolution microscopy, as well as multi-photon and label-free imaging. Across the various modes, MOSAIC is able to capture subcellular dynamics in cultured cells and live multicellular organisms, map nanoscale features across millimeter-scale expanded tissues and image the neural architecture in the brains of live mice.<\/p>\n Movies make a difference<\/p>\n The researchers emphasized the importance of video in understanding biological interactions, and the need to see them with sufficient fidelity.<\/p>\n A fly-through of a 2000 x 2375 x 98 micron piece of human brain tissue from a person with Alzheimer\u2019s disease, obtained after expansion microscopy to four times its normal volume. The axons of neurons are stained cyan, while the myelin sheaths are stained yellow to highlight the tissue\u2019s structural abnormalities. (Credit: Fu, Liu, Milkie, Ruan et al, Nature Methods)<\/p>\n \u201cThe name of the game is to keep the organism, the sample, as physiologically happy as possible,\u201d Upadhyayula said. \u201cWhich means using the lowest light dose we can to keep it from deep-frying while getting the information we need. The consequence is that the image gets noisy. When we watch a noisy movie over time, our minds naturally filter out some of the noise and focus on the underlying structures.\u201d<\/p>\n But getting AI to interpret 5D images is significantly harder than conventional image recognition.<\/p>\n \u201cThe current vision models are not built to reason over three dimensions, time and molecular identity or color, and that\u2019s what we want to build,\u201d he said.<\/p>\n Swinburne and Dave Matus, a researcher working with Betzig and Upadhyayula on the Cell Observatory Initiative, are now helping develop new labeling reagents that highlight subsets of the thousands of components for AI to recognize. While thoroughly impressed with MOSAIC\u2019s ability, Swinburne admits that the videos are so good that it\u2019s hard to focus on just one thing.<\/p>\n Fu, Liu, Milkie, Ruan et al, Nature Methods<\/p>\n \u201cThere\u2019s so much information in these movies,\u201d he said. \u201cWe come in with maybe a hypothesis about the process we think we\u2019re studying and then we get distracted by something we\u2019ve never seen before. Probably every movie has something new that we acquire just because the quality is so high, the spatial and time resolution so much better than what we\u2019re used to.\u201d<\/p>\n The four first authors of the Nature Methods paper are Gaoxiang Liu and Xiongtao Ruan of UC Berkeley and Tian-Ming Fu and Daniel Milkie at the Janelia Research Campus of the Howard Hughes Medical Institute (HHMI) in Virginia. Upaphyayula, Betzig and Wesley Legant of the University of North Carolina at Chapel Hill are senior authors of the paper. The work was funded in part by HHMI, Philomathia Foundation, Biohub, the Sloan Foundation and Berkeley Lab. Betzig is a HHMI investigator and Upadhyayula is a Biohub San Francisco investigator.<\/p>\n RELATED INFORMATION<\/p>\n","protected":false},"excerpt":{"rendered":"In a cramped, windowless room on the University of California, Berkeley campus, two bespoke microscopes \u2014 each a…\n","protected":false},"author":2,"featured_media":439913,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[3652,111,139,69,393,5937,147],"class_list":["post-439912","post","type-post","status-publish","format-standard","has-post-thumbnail","category-science","tag-biology","tag-new-zealand","tag-newzealand","tag-nz","tag-physics","tag-press-releases","tag-science"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/439912","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=439912"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/439912\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/439913"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=439912"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=439912"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=439912"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"blue](\"https:\/\/www.newsbeep.com\/nz\/wp-content\/uploads\/2026\/05\/neurons-846x1024.png\")
An image of a living brain organoid derived from stem cells, showing mitochondrial transport in cyan and neuronal dynamics in orange. Only about 20% of the cells in the organoid are stained.<\/p>\n