AIs are supposed to be ever learning. However computer vision can be a different story. The Verge has an interesting article that shows some pictures and what AI sees it as.
In the article are a lot of pictures labeled with what the AI says it is vs. what it really is. In one group they are showing 4 different pictures of a dragonfly but the AI doesn’t identify any of them as a dragonfly.
It is important to get computers to see what is really there especially in the realm of self-driving cars. We don’t want them to see stop signs where there aren’t any or vice-versa. In another article on The Verge, it was reported that Google’s AI saw a rifle and not a turtle. If this had been something where they were looking for adversarial attacks, this could be a problem.