That phrase was common in New England where I (and Dr. Seuss) grew up. It meant that something hidden was making things not work right.
I haven’t heard it in about four decades. And I don’t use the “N-word” though I know a few people to whom it would apply.