{"id":333087,"date":"2026-03-07T03:03:10","date_gmt":"2026-03-07T03:03:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/ie\/333087\/"},"modified":"2026-03-07T03:03:10","modified_gmt":"2026-03-07T03:03:10","slug":"apple-tested-whether-ai-could-improve-app-store-search-results","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ie\/333087\/","title":{"rendered":"Apple tested whether AI could improve App Store search results"},"content":{"rendered":"

\t\"\"<\/p>\n

Apple researchers<\/a> ran an A\/B test to measure how AI-generated relevance labels would affect App Store search rankings and app downloads. Here\u2019s what they found.<\/p>\n

AI-generated relevance labels slightly improved App Store search conversions<\/p>\n

In a new study titled Scaling Search Relevance: Augmenting App Store Ranking with LLM-Generated Judgments<\/a>, a group of Apple researchers explored whether LLMs could help improve App Store search results by generating the relevance labels used to train the ranking system.<\/p>\n

As the study explains, relevance is obviously key to helping users find the apps they\u2019re looking for. And while there are many signals that can contribute to search ranking, the researchers focused on two main ones:<\/p>\n

Behavioral relevance, which reflects how users interact with results, such as whether they tap on or download an app.<\/p>\n

Textual relevance, which measures how well an app\u2019s metadata (like its name, description, and keywords) semantically matches a user\u2019s search query.<\/p>\n

In the study, the researchers say that while there is plenty of available data regarding behavioral relevance (since that can be easily measured), the same isn\u2019t true for textual relevance:<\/p>\n

While behavioral relevance labels are abundant, textual relevance labels generated by human judges are much rarer. This creates a fundamental problem: high-quality textual relevance labels are scarce and expensive to produce, creating a scalability bottleneck and leaving the textual relevance objective under-powered in multi-objective training.<\/p>\n

To tackle this problem, the researchers fine-tuned a 3-billion-parameter LLM on existing human judgments so it could learn to assign relevance labels to apps based on a user\u2019s search query and the app\u2019s metadata.<\/p>\n

Next, they generated millions of new relevance labels with that model, and retrained the App Store ranking system using both the original data, and the LLM-generated labels.<\/p>\n

Once that was done, they made an offline evaluation, followed by a worldwide A\/B test on live App Store traffic:<\/p>\n

\u201c(\u2026) the llm-augmented model demonstrated a statistically significant +0.24% increase in our primary metric, conversion rate, defined as the proportion of search sessions with at least one app download. While this number may appear small, it is considered a significant improvement for a mature industrial ranker. This gain was observed in 89% of storefronts.\u201d<\/p>\n

In other words, users who saw the search results ranked using the LLM-augmented model downloaded at least one app 0.24% more often than users who saw the search results presented by the traditional ranking model.<\/p>\n

And while 0.24% is obviously a very small increase, it scales rather quickly when we consider that most estimates peg total App Store downloads in 2025 at around 38 billion. In practice, that could translate to dozens of millions of additional downloads from App Store searches, which developers would surely appreciate.<\/p>\n

To read the full study, follow this link<\/a>.<\/p>\n

Accessory deals on Amazon<\/p>\n

\t\t
\n\t\t\t\"Add
\n\t\t\t\"Add
\n\t\t<\/a><\/p>\n

FTC: We use income earning auto affiliate links. More.<\/a><\/p>\n

\"\"<\/a>\t\t\t\t<\/p>\n","protected":false},"excerpt":{"rendered":"Apple researchers ran an A\/B test to measure how AI-generated relevance labels would affect App Store search rankings…\n","protected":false},"author":2,"featured_media":333088,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[61,60,80],"class_list":{"0":"post-333087","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-technology","8":"tag-ie","9":"tag-ireland","10":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/333087","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=333087"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/333087\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/333088"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=333087"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=333087"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=333087"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}