@michaelgemar @mcc @futurebird
Not sure if this is exactly part of the same issue, but I've heard there is actually a "black box problem" for AI.
Basically: What exact process did the AI make its decisions or what specific aspects of the data presented did the AI latch onto in order to provide its output in any given case.
This seems to be a problem for researchers themselves and they're trying to come up with ways to figure it out.