FWIW, Wiki sez: The phrase predates the use of the word “spade” as an ethnic slur against African Americans, which was not recorded until 1928; however, in contemporary U.S. society, the idiom is often avoided due to potential confusion with the slur.
Now let’s do niggardly 