問題文
A logistics team's Auto Loader stream uses the addNewColumns mode. Operations complains that the stream fails whenever the vendor adds a column, and asks whether the mode should be changed. Which trade-off should be explained?
選択肢
- The mode should be changed to none, which picks up new columns without failing the stream because the schema is not evolved and the run simply continues. The rescued data column is therefore not involved, and no restart is needed after a vendor change.
- The stream should be moved to COPY INTO, which handles schema changes without failing so operations no longer need to restart anything after a vendor change.
- The mode should be changed to failOnNewColumns, which fails once and then continues.
- The failure is by design so the new column is picked up on restart; if the team prefers never failing, the rescue mode records new columns in the rescued data column instead, but they will not become independent columns.