The NYPD reports to the Police Commissioner, who serves at the pleasure of the mayor.
So yes, the mayor is their boss in the exact same sense that the president is the Army’s boss, and openly standing against him like this is an act of mutiny in the same sense that it would be if soldiers turned their back on the president.