For the first time, an Earth observation satellite has found what it was looking for \u2014 on its own, without human analysts on the ground. The milestone, which occurred in April, marks the first reported use of a vision-language model in orbit, and offers a glimpse of how AI could fundamentally change what space-based sensors are capable of \u2014 and how much they\u2019re worth.<\/p>\n
Typically, satellites download large chunks of data to analysts on the Earth below, who use machine learning algorithms or their own eyes to figure out what\u2019s going on. But onboard YAM-9, a spacecraft built by space infrastructure company Loft Orbital<\/a>, a software package built by NASA\u2019s Jet Propulsion Laboratory<\/a> identified areas of interest in response to natural language queries.<\/p>\n Google DeepMind\u2019s Gemma 3 \u2014 the vision-language model, or VLM, that powered the demonstration \u2014 is purpose-built for edge applications, meaning it is designed to run on limited hardware far from a data center. VLMs combine the contextual understanding of large language models with the ability to analyze imagery: Researchers asked the model to classify sensor data where natural environment meets human development, for example, or to identify infrastructure around railway hubs \u2014 and it did.<\/p>\n The demonstration is significant for two reasons. In the near term, it could make space sensors far more useful by doing initial data triage on orbit, reducing the flood of raw data that analysts currently have to wade through. Longer term, it\u2019s a proof point toward running larger-scale AI infrastructure in space.<\/p>\n \u201cIt opens the door to always-on, patrol layers in space,\u201d Loft\u2019s head of AI, Paul Lasserre, told TechCrunch. \u201cIf you have a VLM, you can have logic \u2014 like \u2018monitor this border for me, and let me know when something is suspicious,\u2019 and interact back and forth with the satellites.\u201d<\/p>\n Loft\u2019s spacecraft are designed as platforms for third-party customers. The business model is closer to infrastructure-as-a-service than traditional satellite manufacturing. One recent deal saw it build, launch, and operate six new satellites for EarthDaily, which will analyze and market the data collected onboard the spacecraft. YAM-9 was launched in the fall of 2025 as a pathfinder for the company\u2019s orbital AI projects, and includes a Nvidia Jetson Orin AGX GPU, one of the leading chips used in space compute.<\/p>\n Juan Delfa Victoria, a technical leader in NASA JPL\u2019s AI group, led the development of NAVI-Orbital, a software package that was effectively the harness for the Gemma 3 VLM. While Gemma 3 is off the shelf, software engineers had to streamline the software package to reduce the amount of libraries and memory it would require.<\/p>\n While this is the first reported use of a VLM on orbit, we can expect other companies to follow suit. Planet Labs flies satellites with Jetson Orin processors; for now, it is using them for simpler object detection tasks, but a spokesperson says research is underway on other AI applications, including VLMs.<\/p>\n