A listserv that I participate in recently had a conversation where someone said (paraphrasing here), “have you tried asking Google AI who you are? It tends to be wildly wrong, in hilarious or disturbing ways. In short, it lies.”
Curious, I asked Google, “Tell me about [my IRL name here.]” When you do that, at least in my configuration (Mac/Safari), the first result will have a list of options at the top; in my browser, it reads: AI Mode, All, Images, Short Videos, and so on. The default is “All” but you can click on “AI Mode” which is what I did for this post.
Interestingly, what AI says about me is almost entirely correct, if a bit puffed up. One key caveat: My IRL name is quite common; I know of at least three people with my name who have had interesting, world-spanning careers - a World Music researcher/dancer, a prominent journalist, and a world-roaming travel photographer. So I can’t just say, “Tell me about CairoCarol.” But as soon as I give it just one reasonable clue - “Tell me about CairoCarol who now lives on the Big Island of Hawai’i,” or other specific facts (“Tell me about CairoCarol who was once employed by GlurpCorp) - it is actually quite accurate (though overly flattering). The only mistake I have found is that it claims I currently live in Hilo; I do not.
To my surprise, the AI summary even added a legit qualification along the lines of, “it is possible to confuse CairoCarol with CairoCarole, whose background has various similarities but who is primarily known as an oboe player in Minnesota.” (I’m making up that oboe/Minnesota part, but you get the idea.)
I’ve done a similar exercise on some real life friends (none of whom have names as common as mine), and have found that the results are pretty accurate.
How about you? Is AI correct? Is it laughably wrong? What do you think about this?
ETA: I recommend this Pit thread, which discusses how harmful AI summaries can be, as an accompaniment to the above exercise. I’m not trying to argue that we should all be placid about AI. I’m just a bit surprised that in my case, it isn’t too off base.