The first track on Rockpile’s debut (and only) album is a fun track called Teacher, Teacher. But they were together for a bit before that backing other groups.
In a similar house band vein, Booker T and the M.G.s were the house band for Stax. The first track on their debut album is probably their most famous track - Green Onions.
Interpol’s “Turn on the Bright Lights” was set up in one of the Employee’s Choice Listening Stations at my local record shop (RIP) sometime back in the fall of 2002. The first track (“Untitled”) sold me.
Fairport Convention’s debut album, Fairport Convention, opens with “Time Will Show the Wiser.” Definitely a strong introduction.
If we allowed for the subsequent debut albums for each of the members of the band (and combinations thereof, including spouses), we’d have a lot more very good contenders.
Tangential, but the podcast “Life of the Record” has a terrific episode on the making of “I Want to See the Bright Lights Tonight”, narrated by Richard and Linda (or Linda’s daughter reading her notes, IIRC, because of her misophonia).
The opening track of IWTSTBLT is a very, very strong contender for favorite opening track on a debut if we allow it to be the debut of Richard and Linda as a group. I believe one critic stated that there is no track on the album “…that is less than luminous.”
Unfortunately, this was not the first album that Richard and Linda did together. As The Bunch, Richard, Linda (Peters), Sandy Denny, and others released an earlier album, Rock On. For this reason, I’m reluctant to consider it a debut.
Chuck Berry’s first album was After School Days, released in 1957. The first track was the hit School Days. But Berry had released several singles starting in 1955, the first of which was Maybelline.