Not a New Yorker, but I can speak to this, as my stepdaughter lives in Brooklyn and is a student at Columbia, fairly far uptown. She seems to have no problem getting in and out of Manhattan every day.
And my qualifications?
I can read a map (and I lived in the East Village for three years which, while not long enough to be imprinted in my genetic memory, is long enough to discover where the borders are).