{"id":141673,"date":"2025-09-08T12:49:15","date_gmt":"2025-09-08T12:49:15","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/141673\/"},"modified":"2025-09-08T12:49:15","modified_gmt":"2025-09-08T12:49:15","slug":"how-to-overcome-predictive-ais-everyday-failure","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/141673\/","title":{"rendered":"How To Overcome Predictive AI&#8217;s Everyday Failure"},"content":{"rendered":"<p><img decoding=\"async\" src=\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2025\/09\/1757335755_972_960x0.jpg\" alt=\"Stakeholder skepticism about machine learning often rings true.\" data-height=\"1209\" data-width=\"1280\" style=\"position:absolute;top:0\"\/><\/p>\n<p>Stakeholder skepticism about machine learning often rings true: If the data scientist hasn\u2019t measured the potential value, then how could the project be pursuing value?<\/p>\n<p>Eric Siegel <\/p>\n<p>Executives know the importance of <a href=\"https:\/\/www.forbes.com\/sites\/ericsiegel\/2024\/03\/04\/3-ways-predictive-ai-delivers-more-value-than-generative-ai\/\" data-ga-track=\"InternalLink:https:\/\/www.forbes.com\/sites\/ericsiegel\/2024\/03\/04\/3-ways-predictive-ai-delivers-more-value-than-generative-ai\/\" target=\"_self\" aria-label=\"predictive AI\" rel=\"nofollow noopener\">predictive AI<\/a>. As <a href=\"https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/three-best-practices-for-unilevers-global-analytics-initiatives\/13457\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\" data-ga-track=\"ExternalLink:https:\/\/www.predictiveanalyticsworld.com\/machinelearningtimes\/three-best-practices-for-unilevers-global-analytics-initiatives\/13457\/\" aria-label=\"Unilever CDO Morgan Vawter wrote\">Unilever CDO Morgan Vawter wrote<\/a>, \u201cIts practical deployment represents the forefront of human progress: improving operations with science.\u201d<\/p>\n<p>But there\u2019s bad news for data scientists: Your predictive AI project will probably fail. Your customer probably won&#8217;t operationalize the machine learning model you deliver. They won&#8217;t use it, act on it or integrate it. Sadly, most models developed for deployment wind up on the shelf.<\/p>\n<p>But you probably already knew that. A plethora of <a href=\"https:\/\/www.kdnuggets.com\/survey-machine-learning-projects-still-routinely-fail-to-deploy\" target=\"_blank\" rel=\"nofollow noopener noreferrer\" data-ga-track=\"ExternalLink:https:\/\/www.kdnuggets.com\/survey-machine-learning-projects-still-routinely-fail-to-deploy\" aria-label=\"industry research\">industry research<\/a> and anecdotal wisdom has let that cat out of the bag.<\/p>\n<p>And yet what most data professionals haven&#8217;t come to understand is the true reason why. After all, shouldn&#8217;t a great model be a sure bet to deploy?<\/p>\n<p>No. It won\u2019t deploy because you haven&#8217;t <a href=\"https:\/\/builtin.com\/articles\/sell-machine-learning-project\" target=\"_blank\" rel=\"nofollow noopener noreferrer\" data-ga-track=\"ExternalLink:https:\/\/builtin.com\/articles\/sell-machine-learning-project\" aria-label=\"closed the sale\">closed the sale<\/a>. When you deliver a model, you haven&#8217;t necessarily finished selling, no matter how much of a done deal it may seem to be. Until your model actually deploys, you must continue to actively sell it to stakeholders \u2013 in compelling, concrete business terms like improved profit \u2013 even if they&#8217;ve already agreed, signed and paid.<\/p>\n<p>Standard AI Metrics Don\u2019t Launch Models<\/p>\n<p>Standard technical metrics are \u201cfundamentally useless to and disconnected from business stakeholders.\u201d\n<\/p>\n<p>Katie Malone, Harvard Data Science Review<\/p>\n<p>\u201cThe most important metric for your model\u2019s performance is the business metric that it is supposed to influence.\u201d\n<\/p>\n<p>Wafiq Syed, data product manager, Walmart<\/p>\n<p>\u201cDon\u2019t show a confusion matrix to executives!\u201d\n<\/p>\n<p>Data Scientist Henry Castellanos<\/p>\n<p>\u201cNothing flies without KPIs.\u201d\n<\/p>\n<p>AI thought leader Lasse Rindom <\/p>\n<p>Only a <a href=\"https:\/\/www.forbes.com\/sites\/ericsiegel\/2025\/05\/27\/predictive-ai-must-be-valuated--but-rarely-is-heres-how-to-do-it\/\" data-ga-track=\"InternalLink:https:\/\/www.forbes.com\/sites\/ericsiegel\/2025\/05\/27\/predictive-ai-must-be-valuated--but-rarely-is-heres-how-to-do-it\/\" target=\"_self\" aria-label=\"concrete projection of value\" rel=\"nofollow noopener\">concrete projection of value<\/a> compels a business. Your customer and other decision makers may well have been excited about the project\u2019s intent at its outset. But without visibility into the business value \u2013 a view that plainly displays how the model will drive decisions and the expected value to be gained \u2013 you&#8217;ll ultimately begin to hear excuses not to deploy. Put another way, without the enthusiasm that only a bottom-line promise can produce, the project will be among those first cut when the next inevitable financial crunch arrives. People don&#8217;t buy what they don&#8217;t understand.<\/p>\n<p>As with any operational improvement, with or without analytics, a business can\u2019t move forward until there&#8217;s a credible estimation of how much it&#8217;s going to improve those operations \u2013 a calculation of the business improvement you stand to gain \u2013 in straightforward terms like profit or other KPIs.<\/p>\n<p>Yet most predictive AI projects don&#8217;t move beyond standard technical metrics \u2013 such as precision, recall, AUC or F-score. These represent the data scientist&#8217;s training, tools and comfort zone. And they serve well to establish model soundness, assessing whether the model performs relatively well, substantially better than guessing. If so, the model is potentially valuable.<\/p>\n<p>But these metrics provide little to no insight into how valuable the model would be if used. They are arcane from the standpoint of business professionals and business objectives.<\/p>\n<p>Technical Performance Alone Cannot Sell The Value<\/p>\n<p>You may be the technical heavyweight in the room, but if you&#8217;re presenting only standard technical performance metrics, you\u2019re committing a cardinal business sin and deep down your colleagues know it: You&#8217;re proposing a systematic operational change with no concrete estimate of its upside.<\/p>\n<p>After all, when you build something, you\u2019ve got to check out how good it is before you use it. You can&#8217;t launch a new rocket until you&#8217;ve stress-tested it in its intended usage, according to the KPIs that matter. Without a credible estimate of the potential value, the launch would be a shot in the dark. Sensible decision-makers would scrub the launch. Indeed, most predictive AI deployments are scrubbed.<\/p>\n<p>No matter how advanced your analytical method may be, the decision maker\u2019s gut skepticism rings true: If you haven\u2019t measured the potential business value, then how could the project be pursuing business value? They may not feel that they hold the \u201ctech authority\u201d to say so, but they\u2019ll find any of a myriad reasons to not move forward with operationalization.<\/p>\n<p>Instead, make it a no-brainer for your customer: Sell <a class=\"color-link\" href=\"https:\/\/sloanreview.mit.edu\/article\/what-leaders-should-know-about-measuring-ai-project-value\/\" target=\"_blank\" rel=\"nofollow noopener noreferrer\" data-ga-track=\"ExternalLink:https:\/\/sloanreview.mit.edu\/article\/what-leaders-should-know-about-measuring-ai-project-value\/\" aria-label=\"the potential business value\">the potential business value<\/a>. This will give decision makers essentially no choice but to deploy, and will give the fruits of your number crunching a chance to realize a business impact. Everyone already understands, in general terms, the potential value of driving decisions with model predictions \u2013 that&#8217;s what has brought the project this far. Now it&#8217;s time to follow through on your business-oriented swing by establishing <a href=\"https:\/\/www.forbes.com\/sites\/ericsiegel\/2024\/06\/11\/why-you-must-twist-your-data-scientists-arm-to-estimate-ais-value\/\" data-ga-track=\"InternalLink:https:\/\/www.forbes.com\/sites\/ericsiegel\/2024\/06\/11\/why-you-must-twist-your-data-scientists-arm-to-estimate-ais-value\/\" target=\"_self\" aria-label=\"how much business value the deployment stands to deliver\" rel=\"nofollow noopener\">how much business value the deployment stands to deliver<\/a>. This way, you\u2019ll knock it out of the park.<\/p>\n","protected":false},"excerpt":{"rendered":"Stakeholder skepticism about machine learning often rings true: If the data scientist hasn\u2019t measured the potential value, then&hellip;\n","protected":false},"author":2,"featured_media":141674,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[45],"tags":[182,181,507,40519,1877,88371,88370,62373,74],"class_list":["post-141673","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-data-science","tag-machine-learning","tag-ml-valuation","tag-predictive-ai","tag-predictive-analytics","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/141673","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=141673"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/141673\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/141674"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=141673"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=141673"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=141673"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}