Mister Rogers Neighborhood - where was he going at the end?

I’m pretty sure he even mentioned that it wasn’t just his television house on the show, at some point.

I know he showed off the set a bit, showing the musicians.