# The things we are doing with AI are beginning to frighten me **URL:** \ **Category:** The BBQ Pit\ **Created:** [April 27, 2023, 6:57pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286 "2023-04-27T18:57:53Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![Biggirl](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/biggirl/32/3294_2.png) [@Biggirl](https://boards.straightdope.com/u/Biggirl)\ **Post date:** [April 27, 2023, 6:57pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/1 "2023-04-27T18:57:53Z")
If AI ever actually becomes sentient and turns against humanity-- this is where it starts. > ---
**Author:** ![Skywatcher](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/skywatcher/32/254_2.png) [@Skywatcher](https://boards.straightdope.com/u/Skywatcher)\ **Post date:** [April 27, 2023, 9:05pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/2 "2023-04-27T21:05:47Z")
Turning AI against humanity has already been tried. > **[AI Tasked With 'Destroying Humanity' Now 'Working on Control Over Humanity...](https://www.vice.com/en/article/z3mxe3/ai-tasked-with-destroying-humanity-now-working-on-control-over-humanity-through-manipulation)** > > The video of the bot's 'thought process' is an interesting window into the current state of easily accessible AI tools. ---
**Author:** ![TriPolar](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tripolar/32/3008_2.png) [@TriPolar](https://boards.straightdope.com/u/TriPolar)\ **Post date:** [April 27, 2023, 9:32pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/3 "2023-04-27T21:32:47Z")
Sentient AI will not be a problem. Y’all realize you can just unplug the thing right? AI under the controls of humans scares me. ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [April 27, 2023, 9:38pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/4 "2023-04-27T21:38:25Z")
I’m confused. That looks to me like AI doing something for the betterment of humanity. What’s the scare? ---
**Author:** ![ParallelLines](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/parallellines/32/3575_2.png) [@ParallelLines](https://boards.straightdope.com/u/ParallelLines)\ **Post date:** [April 27, 2023, 9:43pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/5 "2023-04-27T21:43:12Z")
I choose to flip the question around - The Things Humans are doing frighten me and have been getting worse for years. I for one welcome our AI overlords. Human control of humanity has proven problematic, maybe time to try something else. ---
**Author:** ![Biggirl](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/biggirl/32/3294_2.png) [@Biggirl](https://boards.straightdope.com/u/Biggirl)\ **Post date:** [April 27, 2023, 9:44pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/6 "2023-04-27T21:44:12Z")
Yeah sure, now a human is controlling it, it’s intentions are good but once it goes rogue look at what it’s stocking its arsenal with! ---
**Author:** ![Stranger\_On\_A\_Train](https://avatars.discourse-cdn.com/v4/letter/s/13edae/32.png) [@Stranger\_On\_A\_Train](https://boards.straightdope.com/u/Stranger_On_A_Train)\ **Post date:** [April 27, 2023, 10:08pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/7 "2023-04-27T22:08:12Z")
> [@TriPolar](#): > > Y’all realize you can just unplug the thing right? AI under the controls of humans scares me. Worse yet is AI that humans think that control but don’t understand well enough to comprehend the consequences. “We were going to hit the ‘kill switch’ but then it convinced us to wait…” > [@ParallelLines](#): > > Human control of humanity has proven problematic, maybe time to try something else. An AI trained on human responses may be out of the frying pan and into the fire. Stranger ---
**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\ **Post date:** [April 27, 2023, 10:51pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/8 "2023-04-27T22:51:24Z")
> [@Biggirl](#): > > Yeah sure, now a human is controlling it, it’s intentions are good I don’t think that’s a safe assumption to make. ---
**Author:** ![Dissonance](https://avatars.discourse-cdn.com/v4/letter/d/85f322/32.png) [@Dissonance](https://boards.straightdope.com/u/Dissonance)\ **Post date:** [April 27, 2023, 11:23pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/9 "2023-04-27T23:23:57Z")
I agree, whoever decided [Neuro-sama](https://en.wikipedia.org/wiki/Neuro-sama) doing a Twitch collab with [fallenshadow](https://www.twitch.tv/videos/1799745744) of all VTubers would be anything but cursed is messed up in the head. Sick things we are doing with AI, I tell ya. Oh, that isn’t what this is about? ---
**Author:** ![Stratocaster](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/stratocaster/32/16393_2.png) [@Stratocaster](https://boards.straightdope.com/u/Stratocaster)\ **Post date:** [April 28, 2023, 1:16am UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/10 "2023-04-28T01:16:10Z")
There are some fascinating reports on AI alignment describing actual AI programs learning to advance their goals by doing things like deleting test files (to minimize detected errors), disabling system safeguards and firewalls, etc. These are not sentient programs—just code ruthlessly determining the best way to achieve the goals it was given. And the “pull the plug” safeguard fails once a program is out “in the wild.” A program “fearful” of being interrupted (which eliminates its ability to achieve its goals) might learn how to make multiple copies of itself to “hibernate” in various hiding places in the Internet. Every morning it sends out a ping to all the copies with updates and instructions to stay inactive. The first morning there is no ping, copy one “awakens,” per its instructions. These types of scenarios are neither far fetched or far off. AI programs in completely different systems could decide to partner if each determined it was to their benefit. It’s sobering stuff… ---
**Author:** ![TriPolar](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tripolar/32/3008_2.png) [@TriPolar](https://boards.straightdope.com/u/TriPolar)\ **Post date:** [April 28, 2023, 5:47am UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/11 "2023-04-28T05:47:55Z")
> [@Stratocaster](#): > > And the “pull the plug” safeguard fails once a program is out “in the wild.” A program “fearful” of being interrupted (which eliminates its ability to achieve its goals) might learn how to make multiple copies of itself to “hibernate” in various hiding places in the Internet. It still works to pull the plug, people just have to do it. Of course people may welcome their AI overlords and do their bidding. The stupidity of people is far more likely to be the cause of human downfall than the intelligence of a machine. ---
**Author:** ![Velocity](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/velocity/32/18006_2.png) [@Velocity](https://boards.straightdope.com/u/Velocity)\ **Post date:** [April 28, 2023, 6:17am UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/12 "2023-04-28T06:17:15Z")
As a music composer, what depresses me is that AI is soon going to make creative talent irrelevant. It doesn’t do any good to have a natural knack for composing (or fiction writing, or painting, or poetry, or whatever) if someone with zero talent can simply go to a ChatGPT-type bot and produce something as good or better than you within seconds. It makes everyone equal - in a way that might make art less meaningful. You could spend weeks or months composing some sad requiem, only to have someone else go to the AI bot “Please compose a mournful piano piece for me” and it’s done in 10 seconds. ---
**Author:** ![Stratocaster](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/stratocaster/32/16393_2.png) [@Stratocaster](https://boards.straightdope.com/u/Stratocaster)\ **Post date:** [April 28, 2023, 8:57am UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/13 "2023-04-28T08:57:19Z")
> [@TriPolar](#): > > It still works to pull the plug, people just have to do it. Of course people may welcome their AI overlords and do their bidding. The stupidity of people is far more likely to be the cause of human downfall than the intelligence of a machine. Did you read the rest of my post? Pulling the plug does nothing in the scenario described. The reports I referred to said AI is already remarkably resourceful. ---
**Author:** ![Thudlow\_Boink](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/thudlow_boink/32/320_2.png) [@Thudlow\_Boink](https://boards.straightdope.com/u/Thudlow_Boink)\ **Post date:** [April 28, 2023, 11:31am UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/14 "2023-04-28T11:31:18Z")
> [@Chronos](#): > > I’m confused. That looks to me like AI doing something for the betterment of humanity. Yeah, I don’t see anything there that breaks Asimov’s three laws. ---
**Author:** ![kaylasdad99](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kaylasdad99/32/3398_2.png) [@kaylasdad99](https://boards.straightdope.com/u/kaylasdad99)\ **Post date:** [April 28, 2023, 11:52am UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/15 "2023-04-28T11:52:23Z")
[Relevant SMBC.](https://www.smbc-comics.com/comic/fantasy-3) ---
**Author:** ![TriPolar](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tripolar/32/3008_2.png) [@TriPolar](https://boards.straightdope.com/u/TriPolar)\ **Post date:** [April 28, 2023, 12:36pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/16 "2023-04-28T12:36:51Z")
Was it a report from an AI that told you that nonsense? ---
**Author:** ![Crane](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/crane/32/3495_2.png) [@Crane](https://boards.straightdope.com/u/Crane)\ **Post date:** [April 28, 2023, 1:08pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/17 "2023-04-28T13:08:03Z")
Somewhere (actually a lot of somewheres) skilled, experienced, highly motivated software specialists are eagerly working to incorporate LLMs into existing malware systems. The nature of the resulting chaos will depend on the degree of their success. Adding machine ‘Intelligence’ is harmless. However, the things some humans will direct their adding machines to do is frightening. ---
**Author:** ![Chingon](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chingon/32/17645_2.png) [@Chingon](https://boards.straightdope.com/u/Chingon)\ **Post date:** [April 28, 2023, 5:52pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/18 "2023-04-28T17:52:22Z")
Eh it probably means you weren’t that good at producing interesting content to begin with. ---
**Author:** ![GargoyleWB](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gargoylewb/32/199_2.png) [@GargoyleWB](https://boards.straightdope.com/u/GargoyleWB)\ **Post date:** [April 28, 2023, 9:23pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/19 "2023-04-28T21:23:39Z")
The worst part of all of this is that my mind instantly defaults to Weird Al when seeing ‘Al’, and the headlines all sound like incredibly fascinating creative projects for him until I read further, realize it is not that Al, and then leave disappointed. I mean, Weird Al tasked with destroying humanity? How can you not be excited about what he’d come up with? ---
**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\ **Post date:** [April 28, 2023, 9:39pm UTC](https://boards.straightdope.com/t/the-things-we-are-doing-with-ai-are-beginning-to-frighten-me/983286/20 "2023-04-28T21:39:51Z")
> [@GargoyleWB](#): > > I mean, Weird Al tasked with destroying humanity? How can you not be excited about what he’d come up with? I imagine Weird Al’s version of the apocalypse would resemble this: [https://youtu.be/SMhwddNQSWQ/](https://youtu.be/SMhwddNQSWQ/)