It’s a hard problem not only because it’s difficult, but because no matter the answer it is not going to be satisfying. If consciousness (AKA qualia, a rich inner life, subjective experiences with actual heft beyond “there is heat damage to my hand”) actually exists then it’s going to be some crazy complicated computational system theory that won’t make any intuitive sense unless you’re among a select few math geniuses on the planet who can understand it. And even then it probably won’t make sense, it will just work for some reason – some sort of empirical evidence will be assembled and we will have to acknowledge it. Kinda like quantum mechanics.
The day will never come when a researcher runs a scan on someone and has an “aha!” moment. There are already tons of experiments where they show that people have internal image manipulation. That doesn’t prove the fact of subjective experiences for precisely this reason:
If the day comes when all the contents have been correlated to their respective systems and there’s no wild networking theory to explain qualia then either we’ve discovered magic or it’s an illusion. I’m going to dismiss magic, so that leaves illusion. Who’s being deceived? Isn’t the subjective feeling of being deceived qualia in and of itself?
Qualia may be a trick, but it’s a very, very persistent one. And being told that pain and pleasure are just an illusion is not satisfying. You can accept it, but it doesn’t sit right. Of course, the state of being satisfied would be an illusion as well. But at least you can slip the veil of free will and escape the illusion of the self. Good luck not experiencing qualia.