Where would you build your castle?

Nob Hill San Francisco.

The current site of St. Louis, MO – to control the confluence of the Missisippi and Missouri rivers and collect tolls on the traffic. No high ground, but one can always dig a moat.