It has a lot to do with the history and emphasis of the schools, as well as regional attitudes here in the northeast (and particularly in New York).
Milo mentioned Michigan, Michigan State, Penn, Penn State, Iowa and Iowa State, Oklahoma and Oklahoma State. Of those all but the University of Pennsylvania (my alma mater, GO QUAKERS!) are large state universities that are the leading public colleges in their states (though some Pitt grads might argue about Penn State). Each of these schools has a long history and great identification with the people of their states. (Penn by the way is a private university founded in 1740 by Benjamin Franklin, and is a member of the Ivy League, which is nothing more than an athletic league that has very strict rules prohibiting scholarships and the like.)
SUNY is New York State’s public education system. It was a really small, sleepy system of teachers colleges until it was significantly expanded by Governor Rockefeller in the 1960’s. It is set up with four major university campuses, Buffalo, Binghampton, Albany, and Stonybrook, and a bunch of smaller uninversity colleges (e.g. Brockport, Purchase, Geneseo, etc.) and specialized colleges (e.g. SUNY Maritime, Fashion Institute of Technology, etc.). None of these colleges has the state-wide history and appeal (nor the committed alumni base) of a Michigan or Michigan State. None of them has ever developed a strong atheletic progam, either, that not being a priority in the 1960’s.
NYU is a private university located in Greenwich Village in NYC (formerly located in the Bronx). It has never had a strong athletic focus, particularly with its emphasis in the arts and humanities and the pull of Greenwich Village to the more non-athletic countercultural types. (I believe that there was a period, however, when it was a basketball powerhouse.)
Because New York (and the northeast in general) has for the majority of this century had a full roster of professional sports teams, which became the primary spectator sports outlet for the population. Even other northeastern states that have a leading public university (e.g. UConn, UMass, Rutgers {NJ}, etc.) do not have as strong athletic programs as many of the midwestern, southern, and western states, regions in which professional sports took much longer to arrive.