I think there is a slight difference. For a visual illusion, there is a chance that an eagle eyed observer can figure it out, where the illusionists skill in misdirection and showmanship are put to the test to prevent just that.
Having the entire premise falsified because your confederates used a Obi-wan level cheesy cheat, nope, that’s just short of bait-and-switch.
Sure, it’s better than the earlier examples where everyone is in on it, or visual effects are used to create an illusion that would be obvious if you were one of the live observers, but as you yourself pointed out, it “took no skill beyond what any ordinary person has.” The guy isn’t quite a fraud, but he’s telling us a visual riddle that only he has the information to interpret.
He’s more conman than illusionist to try to clear up my feeling about the difference.
And that isn’t to say a conman can’t be entertaining, but it isn’t what I would want to go see.