問題文
A caption-generation system was changed in three ways at once: the image encoder was swapped, the training data grew by 40 percent, and the learning-rate schedule changed. The evaluation score improved. The team must report which change produced the gain. What should they do?
選択肢
- Compute the correlation between the three changes and the score across the training log, and attribute the gain to the most correlated one, so the strongest coefficient names the change responsible.
- Increase the evaluation set size and re-run only the combined configuration.
- Report the gain as coming from the encoder swap, because architectural changes are generally larger in effect than data or schedule changes and the other two adjustments were comparatively modest in size.
- Re-run the experiment several times, each time reverting exactly one of the three changes, and compare each result with the combined run.