Will Inference Change the Data Centre Architecture?
Training and inference are increasingly discussed as if they require different data centres. Sometimes they do; often they don't. A GB300 rack running reasoning inference looks close to a training rack. A metro colo under a tight SLA is a different category.