I dunno about guilt, but my cat acts weird about using the litter box (mainly after he goes poo). He won’t cover it up, he’ll just climb out and run as fast as he can (normally to my room) where he proceeds to wipe his paws on anything handy.
I finally figured out why I think he started fleeing the litter box, and it makes me feel bad. He has very stinky poo, and the litter box is right by the computer desk. So when I was at the computer, and he went poo, I would exclaim, “Vincent!” Thus, he felt like he did something wrong. I’m such a bad cat mom. 
Now I’ve taken to praising him after he uses the litter box, no matter what he does, using a cheerful voice and telling him what a good boy he is. Even if I have to hold my breath. 
I can say I don’t think he feels AT ALL guilty about biting me, which he does a few times a week. Heck, last night he wanted to lay on my pillow and was crushing my CPAP hose, so I reached to pull it out from under him. And he snapped at me! He’s also snapped at me when I’ve moved to take away his book or magazine (since he likes to lay on them, Mom and I have an ongoing joke that he likes to read).
However I think he has aggression issues due to being front declawed (he was already declawed when I adopted him). So I just work with him and try not to piss him off. At this point (he’s 11) I’m not sure how much of his behavior can be changed, really.
He’s also not at all guilty about waking me up a couple hours early, making certain I’m truly up, then curling up and going back to sleep himself. 