Sanskrit for \u201cSun,\u201d Surya is available starting today on Hugging Face<\/a>, GitHub<\/a>, and via IBM\u2019s TerraTorch<\/a> library for fine-tuning geospatial AI models. In addition to Surya, the team is also open-sourcing SuryaBench<\/a>, a set of curated datasets and benchmarks aimed at simplifying the task of building and evaluating applications for not only space weather forecasting but to learn more about the Sun itself.<\/p>\n Predicting severe storms on Earth is difficult. It gets even trickier when the storms are brewing on a giant ball of plasma millions of miles away. When solar flares erupt through the Sun\u2019s magnetic field<\/a>, it takes 8 minutes just for that light to reach our eyes. The lag means that scientists need to get even further ahead of solar storms than the ones originating on Earth.<\/p>\n \u201cWe want to give Earth the longest lead time possible,\u201d said Andr\u00e9s Mu\u00f1oz-Jaramillo, a solar physicist at the SouthWest Research Institute and a lead scientist on the project. \u201cOur hope is that the model has learned all the critical processes behind our star\u2019s evolution through time so that we can extract actionable insights.\u201d<\/p>\n Into the heliosphere<\/p>\n It\u2019s not just the distance separating our planet from the Sun that makes solar storm prediction so challenging. Scientists know considerably less about the Sun\u2019s underlying physics than they do Earth\u2019s. NASA sent SDO into space to gather facts but piecing them together has been slow work.<\/p>\n IBM and NASA\u2019s earlier Prithvi family of AI models<\/a> abstracted mountains of satellite data into a representation of Earth easily adapted for weather and climate prediction, among other tasks. The challenge for the Surya team was to similarly translate historical SDO data into a digital twin of the Sun that could be easily customized for different use-cases.<\/p>\n Surya is part of a broader effort at IBM to embrace generative and automated approaches that empower algorithms to be discovered<\/a>, tested, and evolved at scale. Surya is the most recent example of how IBM is sees AI not just as a tool, but as an originator and driver of scientific discovery.<\/p>\n \u201cWe\u2019ve been on this journey of pushing the limits of technology with NASA since 2023, delivering pioneering foundational AI models to gain an unprecedented understanding of our planet Earth,\u201d said Juan Bernab\u00e9-Moreno, the IBM director in charge of the scientific collaboration with NASA. \u201cWith Surya we have created the first foundation model to look the Sun in the eye and forecast its moods.\u201d<\/p>\n Kathy Reeves, a solar physicist at the Harvard\u2013Smithsonian Center for Astrophysics, has been waiting for a model like this since helping to onboard one of SDO\u2019s instruments. She has already discussed with her team how the new model might be used. \u201cThis is an excellent way to realize the potential of this data,\u201d she said. \u201cPulling features and events out of petabytes of data is a laborious process and now we can automate it.\u201d<\/p>\n This is an excellent way to realize the potential of this data \u2014 pulling features and events out of petabytes of data is a laborious process and now we can automate it.<\/p>\n SDO orbits alongside Earth to get a steady view of the Sun, snapping pictures every 12 seconds. But these aren\u2019t images from any old camera. They capture the Sun at different wavelength bands to take the temperature of its layers, varying from a relatively cool 5,500\u00b0C at the Sun\u2019s surface, to up to 2 million \u00b0C at the top of its atmosphere, the corona.<\/p>\n The SDO satellite also maps the Sun\u2019s magnetic activity. Emerging sunspots are revealed in white light while other imaging tools clock the speed of bubbles at the Sun\u2019s surface and track the tangling and twisting of the Sun\u2019s magnetic lines.<\/p>\n To train Surya, researchers took a nine-year slice of this data, first harmonizing the different data types, then experimenting with AI architectures to process it. They settled on a long-short<\/a> vision transformer with a spectral gating<\/a> mechanism. Long-short attention was needed to digest SDO\u2019s high-resolution 4096 x 4096-pixel images, which contained up to 10 times more detail than typical image data. The spectral gating cut memory costs by 5% and may have helped to filter noise from the data.<\/p>\n In their previous work training Prithvi on satellite data of Earth, researchers had the model reconstruct partially blacked out images, honing its ability to fill in missing values. With Surya, they tried something different: They gave the model sequential images and had it picture what SDO would see an hour in the future. They then checked the accuracy of its prediction against the actual observations.<\/p>\n By forcing the model to infer knowledge essential for skillful forecasting \u2014 things like the Sun\u2019s geometry, magnetic structure, and its unusual rotation \u2014 they hoped to prepare it for a wide range of scientific tasks.<\/p>\n The Sun spins faster at its equator than its poles, and at first, researchers tried to encode this knowledge directly into the model. But letting it learn from the data proved far more effective. \u201cIt\u2019s remarkable that the model performed better when we let it figure out the rotation on its own,\u201d said Johannes Schmude, an AI researcher who was the technical project lead on the IBM side.<\/p>\n How solar flares can affect life on Earth and in space.<\/p>\n Surya proved capable at many forecasting tasks, including solar flare prediction. Scientists can currently tell an hour in advance from solar cues whether an active region is likely to set off a solar flare. In experiments, Surya provided a two-hour lead by using visual information. The model is thought to be the first to provide a warning of this kind. In early testing of the model, the team said they achieved a 16% improvement in solar flare classification accuracy, a marked improvement over existing methods.<\/p>\n A bridge to new discoveries<\/p>\n To make Surya more approachable for scientists without AI expertise, researchers aligned SuryaBench\u2019s datasets and benchmarks for well-known space weather prediction tasks. They also included tasks to address longstanding mysteries like the magnetic structure of the corona and why solar winds intensify during the Sun\u2019s quiet phase.<\/p>\n \u201cEach of these applications is like a bridge to help the scientific community cross to the other side of the river,\u201d said Mu\u00f1oz-Jaramillo.<\/p>\n The applications target the Sun\u2019s solar cycle, which peaks every decade or so when the Sun\u2019s magnetic polarity flips. In the run up to the solar maximum, dark spots called active regions start to speckle the Sun\u2019s surface. As they grow larger, solar flares sporadically erupt, and rising energy gathering in the Sun\u2019s atmosphere can set off explosions, sending plasma and magnetic lines into space as solar wind and coronal mass ejections (CMEs).<\/p>\n When the Sun\u2019s extended magnetic lines tangle with Earth\u2019s own magnetic field, storms follow, disrupting GPS systems and long-distance communications, overloading energy transformers, and knocking satellites off orbit as the atmosphere heats and densifies. All this activity ultimately originates in the Sun\u2019s active regions, making them ground zero for space weather prediction.<\/p>\n \u201cThese are the regions that produce all the magnetic particles we\u2019re interested in,\u201d said Spiros Kasapis, a postdoc at Princeton who studies active regions and contributed to SuryaBench. \u201cThis is essentially the very beginning of our relationship with the Sun.\u201d<\/p>\n Since active regions fuel space weather generally, and solar flares, in particular, SuryaBench includes applications for predicting both. \u201cIf we can predict there\u2019s a big active region forming, we can give NASA an early warning that hey, it will probably generate a lot of storms,\u201d said Kasapis.<\/p>\n Other applications include detecting the buildup of extreme ultraviolet radiation and magnetism in the Sun\u2019s atmosphere and predicting solar wind speeds. Extreme UV can cause Earth\u2019s atmosphere to expand, sometimes forcing satellites to fall from their orbit and burst into flames. And accumulating magnetic lines in the Sun\u2019s corona can accelerate solar wind to up to 400 kilometers per second, also wreaking havoc when they interact with Earth\u2019s own magnitude lines.<\/p>\n \u201cKnowing what the solar wind will be when it rams our magnetic shield, or interacts with it, brings us one step closer to understanding its effects on our power distribution systems,\u201d said Mu\u00f1oz-Jaramillo.<\/p>\n Surya and SuryaBench are set to offer an entirely new way of looking at the Sun. The team\u2019s next release of curated data and benchmarks will address forecasting the effects of space weather on Earth. And now, with this new model, scientists have a tool to predict and respond to potentially dangerous solar flares faster than ever before. It\u2019s a new world for how we look at the Sun.<\/p>\n","protected":false},"excerpt":{"rendered":"Ninety-three million miles away, a blast of charged particles has started screaming its way toward Earth. This solar…\n","protected":false},"author":2,"featured_media":82705,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-82704","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/82704","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=82704"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/82704\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/82705"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=82704"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=82704"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=82704"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<\/p>\n