Last week, I wrote about how frustrated I was that ChatGPT wouldn’t display the text I wanted in an image. Well, that appears to have been fixed now and I can create images full of text that looks utterly convincing. In fact, they are too convincing.
ChatGPT is the first generally available, and free, AI image creator that can do convincing text. People have already noticed that ChatGPT’s images are so good that you can use them to fake receipts.
So now we’re all going to have to be even less trusting of images we see online because it’s going to be harder than ever to tell fake images from real ones. But surely, there must be something we can do to spot the AI fakes.
All in the details
A fake receipt created in ChatGPT. (Image credit: OpenAI)
ChatGPT’s servers have been up and down like a yo-yo this week, and when it has been working, it’s been very slow. This is because of the massive increase in users since ChatGPT announced its new image-generating capabilities.
Posting on X, Sam Altman, CEO of OpenAI said “The ChatGPT launch 26 months ago was one of the craziest viral moments I’d ever seen, and we added one million users in five days. We added one million users in the last hour.”
Sam Altman described it as “biblical demand, I have never seen anything like it” in a further post on X .
It wasn’t long before everybody wanted to turn themselves and their pets into Studio Ghibli-inspired anime, causing ChatGPT’s servers to go into meltdown.
It’s not the anime capabilities of ChatGPT that really intrigued me, though, it’s the improved text rendering. Just like it’s been bad at drawing fingers, AI has always been terrible at producing text, and illegible text was one of the ways you could spot an AI-generated image.
Now that it can produce perfectly readable text, I’m not sure how to tell truth from fake anymore, which is why a little bit more digging is required.
Using Get Info on a Mac to reveal a file’s metadata. (Image credit: Apple)
Each image on your computer or phone comes with metadata. This metadata can tell you where it was created and by what app, or for a photo, it tells you what camera it was taken with. Images generated in ChatGPT are no different, and their metadata tells you everything you need to know.
To see this metadata on a Mac you download the image in question, then right-click on it in Finder and select Get Info . Images created using the ChatGPT website have “ChatGPT.com” in the “Where from:” part of their metadata.
In Windows, go to File Explorer locate the image then right-click it and select Properties . Click the Details tab and scroll down to find the metadata that tells you what app it is from.
Unfortunately, in all our tests we couldn’t get Windows to display the part of the metadata that said the file was created in ChatGPT.
On an iPhone, it says “Saved from ChatGPT” when you tap on the Information icon on an image in Photos. On Android, just like Windows, we couldn’t see anything in the metadata that said the image was created by ChatGPT.
But the annoying thing is, even if you can see it, you can’t trust the metadata anyway. It’s possible to edit this metadata. It’s not easy to do, but if somebody is determined enough, they’ll find a way.
Not to mention that something as simple as uploading an image file to an online service, and then downloading the same file seems to strip out a lot of the metadata anyway.
Who you gonna call?
Our fake receipt easily fooled an online AI image checker. (Image credit: Sightengine)
So, if you can’t trust the metadata, then what else can you do?
There are lots of online checkers that will tell you the likelihood of an image being AI-generated. Generally they work quite well, but I’ve found that the new ChatGPT images of text (like the receipt above) can be so realistic that it foxes them completely.
For example, I uploaded our “TasteRadar,” fake receipt image shown above to Sightengine , which I’ve always found reliable, and had got the results correct for every other AI image of people I’d uploaded to it. It said that it was most likely real, giving it just a 7% chance of being AI-generated.
Now that leaves me worried. If the AI image checking websites can be fooled by the new ChatGPT images we’re all in trouble.
Right now I like to think I could still spot if an image is fake. There’s a certain regularity to the text that ChatGPT produces – it’s almost too perfect to have really been printed – but I’ve got the feeling that I’m kidding myself if I said I could spot it on every image I see. And of course it’s only going to get better over time.
If AI images have got so good we can’t tell if they’re real or not then we’re going to have to question everything we see and hear from now on.
You may also like 
