[slight hijack]
With Big Black (the band I cited) he used a drum machine, hence that not-too-cozy sound.
With his next band, Rapeman, not only did he use a real drummer (and not only one of the finest drummers of his time) but also FWIW IMHO an amazing recording:
(From '88) (one of my top ten all time albums)
Love that one too!
Ja! Ja! NDW!
After just two hearings in 1985, I had Bruttosozialprodukt stuck in my head until I finally found it, in 2002.
Not sure it’s as deceptively simple as this thread requires, though.
Wait, there are people who don’t like simple songs? This is like hearing that some people don’t like cheeseburgers. Now, my own mother preferred a hamburger to a cheeseburger, but that fact still unsettles me. Simple songs are just a few ingredients assembled into a tasty treat.
And since I feel that way, a lot of my favorites are listed here already. Here’s three more:
Cub - Chinchilla. If you can play a blues progression, you’re almost overqualified to play this song.
The Cramps - TV Set. Same chord progression as the first song, but the bridge has been replaced with a chromatic build up. The first rock song I ever learned to actually play.
Ministry - TV Song Not so much to it, but it is quite fast. It’s basically a picking exercise with a break thrown in.
Complete nitpick: His daddy was still vice president when that was written. 
Hey, a Cub song got mentioned! Cool!
When it comes down to it, the majority of music I listen to could be categorized as “simple” and fit this thread. But I think “simple” is deceiving.
Your love is like a Rollercoaster, Baby! - the Ohio Players (at least the words are simple)
With the exception of the guitar solo, this (VERY NSFW) Alestorm tune is prety simple.
[spoiler]Fucked With an Anchor
ALESTORM - Fucked With An Anchor (Official Video) | Napalm Records - YouTube also really fun when they play it live.
Totally agree. And it’s not exactly my kind of music, on first glance.
As for me, almost anything by the Violent Femmes. Simplistic on the surface, no vocal virtuosity, but just plain fun and feeling.
(And now I’m stuck mentally comparing Kelis to Violent Femmes at 3 AM without the right background and terminology.)
Belong by REM. Probably their simplest song but one of my favourites.
Probably more for its nostalgic value than its musical value, but I submit “Louie Louie” by the Kingsman. No matter how a green a guitarist you were, this was a song you could learn easily in a day.