問題文
A platform team is sizing two environments. One will train a large language model from a checkpoint over several weeks. The other will answer user requests from the finished model. The team wants to know which resource becomes the distinguishing requirement of the training environment. Which resource is it?
選択肢
- Single-request response time, since each training step must return within a fixed time budget to keep the schedule.
- Accelerator memory and inter-accelerator bandwidth, because the backward pass keeps gradients and optimizer state alongside the weights.
- Host processor clock speed, because the optimizer update is executed on the host between steps.
- Storage capacity for the finished weights, because the trained artifact is the largest object the whole run produces.