Last month, Ente launched https://theyseeyourphotos.com/, a website and marketing stunt designed to turn Google’s technology against itself. People can upload any photo to the website, which is then sent to a Google Cloud computer vision program that writes a startlingly thorough three-paragraph description of it. (Ente prompts the AI model to document small details in the uploaded images.)
If you don’t want to upload your own picture, Ente gives people the option to experiment on Theyseeyourphotos using one of several stock images. Google’s computer vision is able to pick up on subtle details in them, like a person’s tattoo that appears to be of the letter G, or a child’s temporary tattoo of a leaf. “The whole point is that it is just a single photo,” Mohandas says. He hopes the website prompts people to imagine how much Google—or any AI company—can learn about them from analyzing thousands of their photos in the cloud in the same way.
Well, was the picture at least taken on a Xiaomi? Or is the AI hallucinating metadata now too
No, it reads the metadata alright!
That’s an interesting detail!
I’m not surprised this tagging system is imperfect, but in a broader context – that a company like Google probably has something a hundred times more powerful and more accurate, and it’s scanning through people’s whole photo libraries, really adds to their creepy factor.