問題文
A team must both distill and quantize to reach a memory target. Which ordering and validation does the combination call for?
選択肢
- Distill first, then quantize the student, and validate the final artifact rather than assuming the two effects add up as measured separately.
- Skip validation of the combination if each step passed on its own, a step that met the criterion once being certain to meet it again in sequence.
- Quantize the teacher first and then distill from it, because a teacher that already runs at the target precision produces the training signal the student will actually have to reproduce and the student therefore inherits none of the degradation as an additional loss.
- Distill and quantize in either order; the two effects are independent and the combined accuracy follows from the two measurements taken separately.