Question 1 · choose 1
A bank must give every rejected loan applicant the reasons for the decision. It is comparing an inherently interpretable model with a slightly more accurate deep neural network that would need post hoc explanations. Which statement about this choice is correct?
- AThe neural network is the safer choice, because a more accurate model is always easier to explain
- BBoth choices are equally transparent, because any model can be explained exactly after the decision is made
- CThe interpretable model lets reviewers trace each decision, at the cost of some accuracy
- DNeither choice matters, because regulators only review a model's overall accuracy
Show the answer and why
AThe neural network is the safer choice, because a more accurate model is always easier to explain
Incorrect
ML models such as deep neural networks are similar to black boxes whose inner workings are hidden; accuracy does not make them easier to explain.
BBoth choices are equally transparent, because any model can be explained exactly after the decision is made
Incorrect
Post hoc explanations of black-box models can lack robustness, can be fooled by adversarial attacks, and can be ambiguous when several explanations fit.
CThe interpretable model lets reviewers trace each decision, at the cost of some accuracy
Correct
Interpretable models can be understood in the way they work, while explanations added after the fact to a black box can be ambiguous. The bank trades a little accuracy for decisions it can justify.
DNeither choice matters, because regulators only review a model's overall accuracy
Incorrect
Financial providers may have to demonstrate explainability in the AI systems they deploy, and individual loan decisions are what local explanations examine.
Transparency versus performance is a real tradeoff. When each decision must be justified, an interpretable model is often worth a small loss of accuracy.
AWS documentation