In addition, CIOs should set budget limits when employees are working with use-based AI tools because API use can drive huge, unexpected costs, Carlson says.
“Require software developers using a model for coding to be an active participant in the process and provide approval along the way,” he adds. “Giving blanket approval for a model to operate unsupervised can lead to a situation where a model continues to troubleshoot a single line of code for hours, without success, all the while charging for each identical API call.”
Software vendor Appfire uses a variety of AI products and has generally focused on contracts to limit price variations, and it has alerts in place when employees interact with use-based AI tools, says Ed Frederici, CTO there. The company has observed recent pricing variability and experimentation from its AI vendors.