Nvidia-backed startup invents Ethernet memory pool to help power AI — claims it can add up to 18TB of DDR5 capacity for large-scale inference workloads and reduce per-token generation costs by up to 50%
RAM capacity tends to be a bottleneck for numerous AI applications, but adding memory to host systems is…