Think about machine learning device doing loan approval and it is rejected. If the person questions this rejection, then normally human being provides the explanation why the decision was made. What if ML device is performing loan processing? There should be a way to explain the ML device decision.
This write-up tries to address this problem.
“There is no question in my mind that artificial intelligence needs to be regulated. The question is how best to approach this,” — Sundar Pichai (Google CEO)
https://towardsdatascience.com/what-is-responsible-ai-548743369729