"English" parts of Victoria, BC

I’ll be in Victoria, BC, with my father this weekend, and he’s always heard that parts of Victoria are “more English than England.” I’ve been there twice, but only for brief visits.

We’ll probably have lunch in the Empress Hotel, and I’ll ask him if he’s interested in the Butchart Gardens, but do any of you have any other suggestions for England-y type places in Victoria that he might enjoy?

Thanks.