I live in suburban Chicago, which is the rail hub of the U.S.; we have a lot of train lines in our area.
A main line of the BNSF (Burlington Northern before the merger) is about a mile to our south. It’s a very busy line, for both freight and commuter train traffic, but we rarely hear anything from that line other than the the occasional train horn.
There’s a CN line (formerly Illinois Central about a mile and a half to our north. Again, we rarely hear anything from that direction except for the very occasional horn.
Finally, there’s a “connector” railway (Illinois Harbor Belt) which is a mile to our west. We never hear anything from that line, but it’s the one that impacts us the most, only because slow freight trains on it frequently stop traffic on a street which we drive on often.