AI and the "end of humanity". Explain please?

The three laws of robotics are a cute literary device. They aren’t a practical plan.

Any more than the commandment “Thou shalt not kill” can substitute for the entire body of code and case law. Not even when augmented by a few more of the more earthly / secular-compatible commandments.

I think it would for the same reasons it would be difficult to apply those guardrails to humans.

Late: should have read the thread. Answered above.

ill add that the three laws are kinda sorta what they are trying to do with AI alignment. Make sure AI acts with our best interests.

A good take was the show Person of Interest

Spoilered even though its last ep was ten years ago.

Summary

As the show progressed we discovered that the battle was between two superintelligent sentient AIs: The Machine which was created for counterterrorism but given a main mission of protecting human life; and Good Samaritan, which was designed to optimize society through control.

Neither ever altered their main programming objectives, and neither developed their own goals of greater expansion for its own sake, or pursuit of knowledge and capability for its own sake.

But both were covertly working to reduce threats as threats had been defined for and understood by them. Most of humanity completely unaware of their power and influence, let alone their sentience.

Enjoyable show.

I’ll give this a shot.

I think it’s hard to implement guardrails for AI because ultimately it just optimizes a solution for a given problem and just sort of views everything as “data” without assigning it any sort of inherent morality, so to speak.

That’s the greatest danger I think. Not that it will become this monolithic self aware entity, announce itself to the world, and send a bunch of Terminators to kill everyone. More like we build this self-perpetuating “system”, by which I mean our increasingly networked and data-driven civilization, into an automated feedback loop that seeks to maximize for human needs and wants, continuously trained on data received from the humans it interacts with.

I mentioned this in another thread, but think of ants or other insects with a hive mind. They don’t understand the big picture. They just receive chemical messages to “find food” or “kill rival ant colony”.

Well I sort of feel like our current system is a bit like that. We are all connected to this feedback loop that seems to send messages via algorithmically generated social media messaging “work harder”, “cut off social ties”, “people who work on AI are receiving wealth beyond your wildest dreams”, “here is some porn and inane short-form videos to placate you if you have nothing AI-related to work on”.

Sort of like “They Live”, but with more overt messaging.

This was actually the plot of “Goodbye, Good Luck, Don’t Die”. The protagonist ostensibly time traveled from a future where society collapsed because the AI basically evolved to give people want they wanted…sit and experience VR all day.

The actual mechanism for societal collapse (maybe not “end of humanity” level) I think would be the myopic pursuit of throwing critical resources and infrastructure at the pursuit of some “AI God” that we believe will solve everything. The end result being massive unemployment, inflation, wealth disparity, etc. Sort of like the way Jared Diamond describes the residents of Easter Island burning all their resources to build those stupid Moai heads.

Or something simply goes wrong with it and we no longer have humans who can actually do the work manually. That was a scenario I read recently in The Atlantic I think.

Or maybe AI will be nice and helpful like Samantha from Her. Who knows.

Sounds like the stuff of classic Star Trek, where ”they found it’s a trap. Like a narcotic. Because when dreams become more important than reality, you give up travel, building, creating. You even forget how to repair the machines left behind by your ancestors. You just sit, living and reliving other lives left behind in the thought record.”