I is almost comparable to the human brain and a phenomenon called pareidolia.
for everyone learning a new word
: the tendency to perceive a specific, often meaningful image in a random or ambiguous visual pattern
The scientific explanation for some people is pareidolia, or the human ability to see shapes or make pictures out of randomness. Think of the Rorschach inkblot test.
think of your parents telling you about “the man on the moon” or seeing a face in the pattern of tree bark. the same can happen with machine learning where attributes can be falsely given meaning to the wrong things with adverse consequences to the learning model. this is one reason why your training base data needs to be so wide and encompassing but also clear about what exactly it is seeing.
and yes…it absolutely should be triggering an event for that!!! I WANT TO SEE IT!
that can be the next filter for the AI…“walking muffin”