Why Do Folks Always Say Jesus H. Christ?

The Christogram (or logo of Christ’s name) IHC is an alternative for IHS, and is often found in old churches in the UK.

It is a transliteration of the Greek iota-eta-sigma, with the sigma represented by a C rather than an S.

See the following examples:
Oxford,Trinity College, Dining Hall
Orchardleigh, St Mary
Earlham Cemetery, Norwich, Norfolk
Guy’s Chapel
Bury St Edmunds, Suffolk
Byz./Medieval Lady’s Christogram Silver ring on eBay
Cross at Grace Cathedral
Church dedication: St Mary The Virgin, Long Stratton, Norfolk
Church dedication: St Peter & St Paul, Lavenham, Suffolk
Church dedication: St Mary the Virgin, Burston, Norfolk

There are probably thousands of examples in English churches.

It’s very easy to see that this could be taken as standing for Jesus H. Christ.