I am a programmer and trust me, you don’t want to have computers judging you. Badly programmed computers or computers operating on faulty data can produce spectacularly bad output.
Even if we somehow perfected AI, how would we “freeze” that AI into a sort of perfect being state that is completely fair and unbiased?
Have you seen that thread about the two young females who shoulder-surfed at a baseball game and saw the person in the row ahead sexting, and published it on the web for the whole world to see? Have you seen that thread featuring (as something of a hijack) the guy who reported a bumper sticker to his HR department because he didn’t like it, and got that car, or at least the sticker, banned from the company parking lot?
And, to get to the point, did you see how many other posters – even the seemingly open-minded community of The Straight Dope, fervently defended those behaviors? (Plenty of posters blasted them too.)
The world is full of self-righteous nosy busybodies who have nothing better to do in life than patrol their neighborhoods with a ruler, measuring how tall the neighbors’ lawns are and noting whether their mailboxes are painted the wrong colors, and reporting those to the “authorities”.
Are those the people we want crowd-sourcing our justice system?
Haven’t you read about Roxxxy? (Wiki page, probably SFW, no pictures but lots of links to other articles and pages around the web.)
Well, OK, but that’s really only the same as me, not an aerospace engineer, saying that the problem with constructing a working plane is doing it in a way that it won’t just fall out of the sky. It could very easily seem quite impossible to me (except of course in the case of planes, I know it is possible because it has already been done).