Powerful new AI model will map the moon’s surface in more detail than ever, NASA and IBM scientists say

IBM and NASA have partnered to create a new artificial intelligence (AI) model capable of processing decades of lunar data so scientists can more accurately map the moon’s surface one day.

Decades of robotic lunar missions have left scientists with a massive, disjointed trove of data. Traditionally, this data has been parsed by limited transformer models such as SwinV2-B, created in 2022 as a general-purpose model to understand images and improve accuracy on photo recognition and related vision tasks. Spacecraft orbiting the moon captured this data using a mismatched array of sensors, without an accessible way to analyze or utilize it.

The scientists wanted to build a single, reusable backbone AI model that would be freely available to scientists via the open-source AI model repository Hugging Face. Because the model is open-source, researchers could fine-tune the AI to tackle specific questions as part of different projects.

You may like

For NASA, this includes thorny issues such as generating a reliable crater map so researchers can plot safe landing zones, or analyzing those craters for clues about the chemical makeup of the moon’s interior and its history.

LFM also enables scientists to comb through the data for heavily shadowed sites on the moon that often conceal subsurface ice, which is critical for establishing long-term lunar bases. Volcanic activity can be tracked and collated too, which will allow future projects to avoid unstable terrain and reveal insight into the moon’s thermal evolution.

Get the world’s most fascinating discoveries delivered straight to your inbox.

Unique challenges

Processing lunar observations presents unique computational challenges that differ from those of similar models, which cover things like weather, geospatial data and heliophysics. NASA’s Lunar Reconnaissance Orbiter and other spacecraft collect measurements across vastly different spatial scales, ranging from broad regional maps at a resolution of 100 meters per pixel down to terrain scans resolving at 1 m per pixel.

Because the moon lacks an atmosphere, extreme sunlight geometry is an issue, creating deep, deceptive shadows. Sunlight can also wash out subtle geological details, depending on when an image was captured.

To overcome these problems, the team compiled a layered benchmark dataset named SomBench, made up of nearly 2 million overlapping map patches called tiles. SomBench organizes that data into aligned tracks so data from completely different instruments, or imagery taken at different resolutions or angles, all end up together as long as they’re capturing the same tiles.

What to read next

The lower-resolution layers provide wide-angle overviews, as well as ultraviolet reflectance and elevation data. High-res layers combine tight, detailed camera shots with meter-scale terrain, slope and orientation maps. Specialized readings of thermal behavior, surface mineralogy and local gravitational anomalies also get layered in.

Image 1 of 4

A visualization of the NASA-IBM Lunar Foundation Model’s ice prospectivity capability.

(Image credit: IBM)

A visualization demonstrating the NASA-IBM Lunar Foundation Model’s craterdetection capability.

(Image credit: IBM)

A visualization demonstrating the NASA-IBM Lunar Foundation Model’s ability to identify and map irregular mare patches (IMPs), rare volcanic features on the Moon’s surface.

(Image credit: IBM)

An infographic illustrating how the NASA-IBM Lunar Foundation Model assists withanalyzing lunar imagery and data at scale.

(Image credit: IBM)

LFM learns to interpret all that layered data through a technique called masked-token learning, which is where parts of a dataset are hidden so the AI has to fill in the blanks. During training, the AI is shown a portion of a lunar tile, like its visible light appearance and elevation, and nothing else. The model then continuously predicts the concealed information across millions of examples, and learns the relationships between elements like lighting, terrain structure and physical geography.

Lighting analysis is built directly into the model’s core architecture. Rather than forcing the model to infer light levels solely from shadows, researchers supplied explicit metadata describing solar angles and spacecraft positions. This allows the model to use its processing power to recognize actual terrain features rather than getting tricked by shadows.

One giant leap