フリー問題

問題文

A 32 node training job has become 30 percent slower, and the step time is uniform across all nodes. One node reports a much lower accelerator utilization than the others. What does this pattern suggest?

選択肢

1. That the fabric between the nodes has lost capacity, because a uniform step time can only be caused by a shared bottleneck in the network.
2. That the one node is holding the others back, because every step waits for the slowest participant and the others therefore appear to be waiting rather than working.
3. That the shared storage system is the cause, since a slow read path would raise the utilization of every node equally.
4. That the job is on nodes with different amounts of accelerator memory, which is the only condition that makes step times uniform, and the inventory confirms it.