Fake Image Detector--this could be useful

A fake image detection website? Purportedly.
I’ve bookmarked it, and if it does not work well, it is a step in the right direction. (LINK)

I tried to test it. I found an AI-generated image that looked pretty realistic to me and uploaded it to the site. The response was “400 Bad Request”. I tried a few images and got the same result for each. Not too promising.

A friend of mine swears by FotoForensics fotoforensics.com

I tried it (the one Bosda linked to), with one image straight from the camera and one image that I had worked on extensively in Photoshop.

It says “No error level detected” for the first image and “Looks like Computer Generated or Modified image” on the second image.

ETA: “modified” can include playing with contrast, hue, or brightness.

That site’s faq says its accuracy “hovers between 60 and 70 percent.”

Good odds if you’re operating a casino, bad odds for anything else.

Unless its ability to spot fakes depends on things that people generally don’t / can’t see. In other words, the real filter one ought to use is “Do I think it looks fake, or does the site think it looks fake? If either says “fake” then I’ll conclude it really is fake.”

Same here. I see it says it uses metadata to make its determination which seems really simple for some AI images – stuff I made locally on Stable Diffusion has the prompt, model, steps, CLIP, etc all included in the data so obviously those are fake. I wanted to test a few with the original and with the metadata stripped out.

Edit: to be clearer, it says it uses metadata as part of its determination. I was curious how heavily it relied on it.

That could also be the server choking because of trying to handle too many requests.

Granted, that is the wrong error code for that situation, so they should at least fix that if that’s the case. It should be 503 - Service Temporarily Unavailable.

I forgot about this site, thought about it tonight and tried again. The “trick” is that it only works on jpg format images and I only had luck when I used the button to select an image. Although drag and drop seems to work, it just gave me a bad gateway error when I’d hit start.

The results were… not impressive. 0% success rate unimpressive. The three non-AI images I tried were flagged as fake and the two AI images were passed as real. And that was actually the same AI image twice, once with the EXIF/Metadata stripped and once with it intact. So it couldn’t even tell that an image with the Stable Diffusion prompt/settings embedded in the metadata was a fake image.