There were plenty of black actors on the show:
Black actors on The Dukes of Hazzard , seasons 3-7:
Ji-Tu Cumbuka, “Opening Night at the Boar’s Nest”
Kevin Peter Hall, “Opening Night at the Boar’s Nest”
Al White (one of the “jive dudes” in Airplane! ),
“Cale Yarborough Comes to Hazzard”
Hal Williams, “Cooter’s Confession”
Herb Jefferson Jr., “Undercover Dukes”
Steven Williams, “High Flyin’ Dukes”
Wally Taylor, “A Boy’s Best Friend”
John Dewey Carter, “Brotherly Love”
Ella Mae Brown, “Vance’s Lady”
Ernie Hudson, “Dear Diary”
James Reynolds, “Good Neighbors, Duke”
Woody Strode, “The Great Santa Claus Chase”
Stolen from this thread where apparently some Dopers who are black enjoyed the show: