Meta has demonstrated that using CXL to expand memory in production services cut the number of servers needed for distributed AI inference by up to 25% and shortened the average response time of its distributed caches by about 29%, delivering gains in both cost and performance.
“Bringing the two demonstrations presented at this year’s ISCA together, we can conclude that—across the entire path, from controller and IP (intellectual property) design to silicon implementation, routing, operating-system support, and large-scale deployment—CXL is ready for practical use in the data center,” says Myoungsoo Jung, CEO of Panmnesia. “That these validations have now won formal recognition from the expert community, we believe, signals that CXL could see wide adoption in the near future, as demand for memory keeps rising.”