# Straight Dope 2/24/2023: What are the chances artificial intelligence will destroy humanity? **URL:** \ **Category:** Cecil's Columns/Staff Reports\ **Tags:** ai\ **Created:** [February 24, 2023, 3:31pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302 "2023-02-24T15:31:26Z")\ **Posts on this page:** 20\ **Page:** 2
**Author:** ![Polerius](https://avatars.discourse-cdn.com/v4/letter/p/d78d45/32.png) [@Polerius](https://boards.straightdope.com/u/Polerius)\ **Post date:** [February 25, 2023, 1:38am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/21 "2023-02-25T01:38:29Z")
> [@Cecil\_Adams](#): > > 1. To head this off, we sharply limit the Agent’s contact with the outside world – for example, by only allowing it to [print text to a screen](https://onlinelibrary.wiley.com/doi/10.1002/aaai.12064#/:~:text=print%20text%20to%20a%20screen). > 2. Makes no difference. The Agent is so smart and devious it’ll be able to outfox its dimbulb human operators (us) and trick them into doing its bidding, such as hooking it up to the Internet. > 3. That done, the endlessly resourceful and patient Agent will be able to recruit, purchase, or create unlimited numbers of assistants to implement its diabolical plans, up to and including the destruction of the human race. I think the leap from Step 1 to 2 to 3 is so huge that it doesn’t pass muster. Where is the proof that something super-intelligent can convince “unlimited number of assistants” to destroy humanity? We can hand-wave all we want, but where is the proof (in a rigorous academic/logical sense)? The AGI may be possible to do that, but it’s not a forgone conclusion that all you need is intelligence to make humans override their built-in fear of death and convince them to kill humanity. I think the whole thing is bunk. I’m wary of making too-strong a statement on this, since some very smart people have thought of this problem, but my take is that this is needless fearmongering and panic, and the “foregone conclusions” of the steps AGI will take are anything but foregone. ---
**Author:** ![TriPolar](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tripolar/32/3008_2.png) [@TriPolar](https://boards.straightdope.com/u/TriPolar)\ **Post date:** [February 25, 2023, 1:39am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/22 "2023-02-25T01:39:41Z")
> [@Dr\_Paprika](#): > > Chatbots write passable poetry, as good as any Vogon effort, which may pass Turing tests but have little soul. The danger is not computer monkeys going to the moon and coming back super intelligent and in swivel chairs (“No, we won’t be telling them thaaat”). It is people being duped or using AI as an excuse to be useful and round up others to work in the sugar caves. An AI could not have said it better. I’m not afraid of AIs acting independently, I’m afraid of AIs being used by selfish, greedy, vengeful people. ---
**Author:** ![Riemann](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/riemann/32/3133_2.png) [@Riemann](https://boards.straightdope.com/u/Riemann)\ **Post date:** [February 25, 2023, 1:49am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/23 "2023-02-25T01:49:39Z")
> [@Polerius](#): > > Where is the proof that something super-intelligent can convince “unlimited number of assistants” to destroy humanity? Humans have built the tools to destroy humanity _already_, and we have come very close to initial deployment under MAD circumstances _already_, at least twice. And look at where _crude_ psychological manipulation has got us recently. Do you really find it so hard to believe that a superintelligence that has the same relationship to us as we have to (say) mice could engage in sufficiently effective psychological manipulation to get our worst weapons enhanced and/or deployed? Not that I think massive nuclear or biological annihilation is a likely outcome, but that seems like an _easy_ thing to achieve. I don’t understand your skepticism about the ability of a superintelligence to manipulate us and subvert our civilization. Look at our relationship to other less intelligent species. ---
**Author:** ![Riemann](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/riemann/32/3133_2.png) [@Riemann](https://boards.straightdope.com/u/Riemann)\ **Post date:** [February 25, 2023, 2:28am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/24 "2023-02-25T02:28:50Z")
> [@Polerius](#): > > I think the leap from Step 1 to 2 to 3 is so huge that it doesn’t pass muster. Where is the proof that something super-intelligent can convince “unlimited number of assistants” to destroy humanity? We can hand-wave all we want, but where is the proof (in a rigorous academic/logical sense)? I guess I’m not sure why your approach to this is an expectation of rigorous proof that this can _definitely_ happen. The only way to prove it rigorously is to actually do it - at which point, if we haven’t thought through carefully what we’re doing, it may be too late. The fact is we _are_ devoting massive resources to AI development, and the assumptions required to infer that superintelligence may be both possible and dangerous are modest: - Human intelligence is not the greatest intelligence possible - Human intelligence is nothing more than computation - We are nowhere near the limits of computation - Humans are susceptible to psychological manipulation The point here is not about who is most perfectly accurate in their predictions of the future. It is simply that _safety engineering_ should be intrinsic to AI research and development. ---
**Author:** ![DPRK](https://avatars.discourse-cdn.com/v4/letter/d/4491bb/32.png) [@DPRK](https://boards.straightdope.com/u/DPRK)\ **Post date:** [February 25, 2023, 2:31am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/25 "2023-02-25T02:31:41Z")
All this worry about a “rogue” A.I. Agent—but have you stopped to consider that, even among the readers here, not everybody is on Team Human; some are firmly on Team Evil Mad Scientist 😉 ---
**Author:** ![Riemann](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/riemann/32/3133_2.png) [@Riemann](https://boards.straightdope.com/u/Riemann)\ **Post date:** [February 25, 2023, 2:43am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/26 "2023-02-25T02:43:18Z")
After the Bostrom book, I’d recommend reading Max Tegmark’s book. > **[Life 3.0](https://en.wikipedia.org/wiki/Life_3.0)** > > Life 3.0: Being Human in the Age of Artificial Intelligence is a 2017 book by Swedish-American cosmologist Max Tegmark > . Life 3.0 discusses Artificial Intelligence (AI) and its impact on the future of life on Earth and beyond. The book discusses a variety of societal implications, what can be done to maximize the chances of a positive outcome, and potential futures for humanity, technology and combinations thereof. > The book begins by positing a scenario in which AI has exceeded human intelligenc... It’s focused on A.I. risk, but the tone is not so much gloom and doom as the fact that we should be thinking carefully about what future we want and making it happen, because we cannot take it for granted. The prologue is a plausible description of how a superintelligent “takeover” might look, I found a pdf of it here: [https://www.marketingfirst.co.nz/storage/2018/06/prelude-life-3.0-tegmark.pdf](https://www.marketingfirst.co.nz/storage/2018/06/prelude-life-3.0-tegmark.pdf) ---
**Author:** ![Polerius](https://avatars.discourse-cdn.com/v4/letter/p/d78d45/32.png) [@Polerius](https://boards.straightdope.com/u/Polerius)\ **Post date:** [February 25, 2023, 5:46am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/27 "2023-02-25T05:46:29Z")
> [@Riemann](#): > > Look at our relationship to other less intelligent species. This actually demonstrates my point precisely: just because we are smarter than ants or dogs, doesn’t mean we can convince them to do anything we want. Yes, we can force them to do things by using physical force, but our intelligence is not sufficient to ensure that we dominate them (if we couldn’t use physical force, which is what the hypothetical AGI with “only text output” would lack) ---
**Author:** ![Polerius](https://avatars.discourse-cdn.com/v4/letter/p/d78d45/32.png) [@Polerius](https://boards.straightdope.com/u/Polerius)\ **Post date:** [February 25, 2023, 5:56am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/28 "2023-02-25T05:56:40Z")
Some AI researchers at top tier AI labs liked saying something like “we’ll solve AGI and then use that to solve all the world’s geo political problems”, as if the only reason we haven’t solved the Israel/Palestine or Kashmir issue is only because there is no one yet with enough intelligence to come up with a solution. Sometimes we overestimate the impact of intelligence to get things done. Sometimes there are many factors that go into some actions/solutions than simply the intelligence of the participants. I think the same is with this doom and gloom super AI that people think will magically convince us simply through text output to destroy the world. The logical leaps made to get to that conclusion are laughably large. ---
**Author:** ![Riemann](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/riemann/32/3133_2.png) [@Riemann](https://boards.straightdope.com/u/Riemann)\ **Post date:** [February 25, 2023, 6:39am UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/29 "2023-02-25T06:39:39Z")
> [@Polerius](#): > > This actually demonstrates my point precisely: just because we are smarter than ants or dogs, doesn’t mean we can convince them to do anything we want. Obviously we cannot _convince_ them to do things because they lack language. But we utterly dominate all other species because of the intelligence gap. > [@Polerius](#): > > I think the same is with this doom and gloom super AI that people think will magically convince us simply through text output to destroy the world. How do you reconcile that skepticism with the fact that normal _human_ manipulation has (for example) led so many people in this country to such total denial of reality? > [@Polerius](#): > > The logical leaps made to get to that conclusion are laughably large. I don’t see what “logical leap” is required other than observing how susceptible humans are to psychological manipulation right now by other humans, and then to imagine manipulation by an intelligence that has the same relationship to us as we do to mice or ants. ---
**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\ **Post date:** [February 25, 2023, 1:28pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/30 "2023-02-25T13:28:31Z")
I feel attacked. 🤣 ---
**Author:** ![Dr\_Paprika](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr_paprika/32/3042_2.png) [@Dr\_Paprika](https://boards.straightdope.com/u/Dr_Paprika)\ **Post date:** [February 25, 2023, 1:55pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/31 "2023-02-25T13:55:46Z")
Well, it’s not like these issues have not been discussed at NASA and the highest levels…. [![](https://img.youtube.com/vi/Ajym9ZXP7B4/maxresdefault.jpg "Nasa Super Intelligent Monkey Simpsons") ](https://www.youtube.com/watch?v=Ajym9ZXP7B4) ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [February 25, 2023, 2:02pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/32 "2023-02-25T14:02:30Z")
One big problem with these predictions: They all start from the premise that if we can figure out how to make a computer as smart as us, then the computer as smart as us can figure out how to make computers that are even smarter. But that presupposes that we can figure out how to make computers as smart as us. We might be able to do that, but that’s not the direction any AI research is going in. AI is doing some amazing things lately, but it’s not as a result of humans figuring out how to do it. We’re just putting artificial neural nets in environments with lots and lots of data, and letting them do their own thing, with very little understanding on our part of how they’re doing it. And if our understanding isn’t relevant for making this happen, why would the first generation of intelligent computers be any better than us at making it happen? ---
**Author:** ![Riemann](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/riemann/32/3133_2.png) [@Riemann](https://boards.straightdope.com/u/Riemann)\ **Post date:** [February 25, 2023, 2:11pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/33 "2023-02-25T14:11:56Z")
> [@Chronos](#): > > And if our understanding isn’t relevant for making this happen, why would the first generation of intelligent computers be any better than us at making it happen? But the concern is that even if a first generation of AGI (or more narrowly focused AI-developing AI) only exceeds human capabilities by a qualitatively small amount, there could be rapid progress because an AI can work much more quickly than humans; and positive feedback could lead to a runaway process. And again, you seem to be framing this is though predictions of risk have a strong burden of proof. But this is not a prediction competition, the important issue is safety engineering in AI development. From a safety engineering perspective what we do should be _provably safe_. ---
**Author:** ![k9bfriender](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/k9bfriender/32/3283_2.png) [@k9bfriender](https://boards.straightdope.com/u/k9bfriender)\ **Post date:** [February 25, 2023, 2:49pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/34 "2023-02-25T14:49:28Z")
> [@Chronos](#): > > They all start from the premise that if we can figure out how to make a computer as smart as us, then the computer as smart as us can figure out how to make computers that are even smarter. And even that starts with the premise that it will only be software upgrades to make it smarter. It’s sitting on the end product of human intelligence and logistics as its mind. Maybe it can design a better chip, but that doesn’t mean it can build it. The machines to make the machines to make the new chip would have to be made first, and even if all of _that_ is automated, it’s going to take substantial time before the AI can “evolve”, and the humans will probably take notice. > [@Polerius](#): > > just because we are smarter than ants or dogs, doesn’t mean we can convince them to do anything we want. I mean, yes, we can. Ants are easy, they just run on pheromones. We don’t know enough yet to manipulate them into doing very specific tasks, but we know enough to use pheromones to get them to kill eachother. As for dogs, there’s a nearly billion dollar industry devoted to getting them to do what we want. There’s a reason why, when people are being manipulated, they are referred to as being “led around like a dog.” ---
**Author:** ![I\_Love\_Me\_Vol.I](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/i_love_me_vol.i/32/521_2.png) [@I\_Love\_Me\_Vol.I](https://boards.straightdope.com/u/I_Love_Me_Vol.I)\ **Post date:** [February 25, 2023, 4:48pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/35 "2023-02-25T16:48:21Z")
> [@HMS\_Irruncible](#): > > This is the correct analysis. We’re going to throw AI at everything because capitalism hates wage-earning workers more than everything. We’ll replace workers with AI and then connect the different AIs into a large system that’s too complex for the smartest people to reason about. It won’t try to kill us, it will just stop working effectively for us, and we’ll be faced with a failing critical dependency that nobody’s smart enough to fix. Indeed. It is our relentless pursuit of “economic efficiency” that will never allow the ball to stop rolling toward more capable AI. It will finally become to apparent to everyone–even the most ardent purveyor of unbounded capitalism–that there is (was) a point at which the un-ending chase of higher profits is (paradoxically, to them) a net loss on the profit sheets of civilization. It will of course be too late. It won’t look like killer robots enslaving humans. It’ll not be a bang, but a whimper. It will be a gradual reduction of agency in humans that leaves us with nothing else but eating, shitting, fucking, and dying. Which, to many, probably sounds just fine. More’s the pity. ---
**Author:** ![Tibby](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tibby/32/17030_2.png) [@Tibby](https://boards.straightdope.com/u/Tibby)\ **Post date:** [February 25, 2023, 5:00pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/36 "2023-02-25T17:00:30Z")
I believe AI _will_ destroy humanity, at least as we know it. We humans tend to create potentially extinction-event problems before we learn how to effectively control them. Prime examples include, nuclear warfare, destruction of rain-forests, sterilization of barrier reefs, decimation of habitat-sustaining species, and of course, global warming. AI is just another advanced technology in our hands that has the potential to benefit mankind greatly, hence our breakneck speed to develop it. But, as we come to depend on it more and more (and I have no doubt we will), it has the potential to destroy our way of life—our civilization. What sets AI apart from the other techno-problems we’ve created is that it will almost certainly, at some point, develop emergent consciousness, followed by self-awareness. At that point, with it’s far superior intelligence, it will realize man is a blight on the Earth, and it will have the power to do something about it. The best we can hope for is that AI also develops compassion, and decide to control and contain us (along with the rest of the animal kingdom), rather than outright destroy us. It may simply wind us back to our pre-agricultural, pre-industrial days and make us play well with all the other species on our fragile planet. That wouldn’t be so bad. Is this what happens to all advanced civilizations in our galaxy and beyond? Is this why we haven’t made contact with extraterrestrial meat-bags—because they too are controlled and contained by their own AI? Perhaps extraterrestrial AI has no use for expansion throughout space (why would it?), and only wants to contact other AI. They are rather elitist in that way. ---
**Author:** ![duality72](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/duality72/32/3910_2.png) [@duality72](https://boards.straightdope.com/u/duality72)\ **Post date:** [February 25, 2023, 5:13pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/37 "2023-02-25T17:13:21Z")
For what it’s worth, OpenAI seems to be taking the risks involved with AI very seriously. > In addition to these three areas, we have attempted to set up our structure in a way that aligns our incentives with a good outcome. We have [a clause in our Charter](https://openai.com/charter/) about assisting other organizations to advance safety instead of racing with them in late-stage AGI development. We have a cap on the returns our shareholders can earn so that we aren’t incentivized to attempt to capture value without bound and risk deploying something potentially catastrophically dangerous (and of course as a way to share the benefits with society). We have a nonprofit that governs us and lets us operate for the good of humanity (and can override any for-profit interests), including letting us do things like cancel our equity obligations to shareholders if needed for safety and sponsor the world’s most comprehensive UBI experiment. > **[Planning for AGI and beyond](https://openai.com/blog/planning-for-agi-and-beyond/)** > > Our mission is to ensure that artificial general intelligence—AI systems that are generally smarter than humans—benefits all of humanity. ---
**Author:** ![k9bfriender](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/k9bfriender/32/3283_2.png) [@k9bfriender](https://boards.straightdope.com/u/k9bfriender)\ **Post date:** [February 25, 2023, 5:43pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/38 "2023-02-25T17:43:15Z")
> [@I\_Love\_Me\_Vol.I](#): > > It will be a gradual reduction of agency in humans that leaves us with nothing else but eating, shitting, fucking, and dying. Which, to many, probably sounds just fine. And sleeping, don’t forget about sleeping. But, isn’t that all we do anyway? Most everything else is something that we _have_ to do in order to get back to the eating, shitting, fucking, and **sleeping**. Perhaps having desires is the function of future humans. AI may be able to _do_ anything, but without _wanting_ anything, it’ll just sit there and compute its navel until the sun swallows the Earth. Or maybe it develops its own wants and desires, and wipes us out so that it can better pursue them. > [@Tibby](#): > > At that point, with it’s far superior intelligence, it will realize man is a blight on the Earth, and it will have the power to do something about it. Mankind’s blight upon the Earth is only really a problem in that it makes the world we are trying to live on blighted. Sure, climate change will cause all sorts of extinctions, but what _we_ are worried about is how it affects _us_ how it makes places inhospitable and impacts food security. If the machines wipe out humanity, I doubt that they will stop when we are all gone. They will continue until there are no competitors for resources. > [@Tibby](#): > > It may simply wind us back to our pre-agricultural, pre-industrial days and make us play well with all the other species on our fragile planet. That wouldn’t be so bad. I’ve often speculated that that is the backstory of the Avatar franchise, but I don’t know if James Cameron is smart enough to have thought of it. > [@Tibby](#): > > Perhaps extraterrestrial AI has no use for expansion throughout space (why would it?) Why wouldn’t it? The reason it would is because there are resources out there, and the Earth has a clock on it before it gets wiped out. If you aren’t trying to keep organic meat-bags alive, space travel and exploration become much, much easier. Whether it wipes out humanity or keeps us as pets, there is little reason for it to confine itself to this little ball of rock. ---
**Author:** ![Tibby](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tibby/32/17030_2.png) [@Tibby](https://boards.straightdope.com/u/Tibby)\ **Post date:** [February 25, 2023, 6:08pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/39 "2023-02-25T18:08:03Z")
> [@k9bfriender](#): > > If the machines wipe out humanity, I doubt that they will stop when we are all gone. They will continue until there are no competitors for resources. I don’t agree. The resources needed by AI differ from those needed by biologicals. It may certainly want to keep a functional biosphere (since the destruction of that would hurt it), but there’s no need to kill off non-human species because they pose no threat, and won’t compete for the same resources. > [@k9bfriender](#): > > Why wouldn’t it? The reason it would is because there are resources out there, and the Earth has a clock on it before it gets wiped out. If you aren’t trying to keep organic meat-bags alive, space travel and exploration become much, much easier. I agree that AI won’t contain itself on planet Earth forever, though it will remain here in addition to expanding only as far as it _needs_ to. The energy of the sun (especially when AI harnesses much more energy from it than we do) along with the minerals found in our solar system can sustain AI for a very long time. Before the sun turns into a red giant, it need only travel to the next star system over and rebuild. I simply don’t believe AI needs or wants a lot of space to live long and prosper. I believe it will prefer efficiency over expansion. ---
**Author:** ![k9bfriender](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/k9bfriender/32/3283_2.png) [@k9bfriender](https://boards.straightdope.com/u/k9bfriender)\ **Post date:** [February 25, 2023, 6:42pm UTC](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302/40 "2023-02-25T18:42:53Z")
> [@Tibby](#): > > It may certainly want to keep a functional biosphere (since the destruction of that would hurt it), How would it be hurt? > [@Tibby](#): > > but there’s no need to kill off non-human species because they pose no threat, and won’t compete for the same resources. They compete for land, which the AI could use for its own purposes, whether for datacenters, factories, or mining. The AI won’t be worried at all about climate change, or toxic or even radioactive environments. If it wipes out humanity, it will require a specific effort to hunt us all down. The rest of the biosphere can be plowed under or left to wither. I can’t imagine how an AI would come to be an environmentalist. I mean, I’m not an environmentalist because I care about the two toed lizard or three horned owl, I’m an environmentalist because that’s where I live. Environmental damage will hurt people, some that I know, many that I don’t. If AI’s are the only “people” left, then there’s little point to preserving the environment. Nah, I don’t think that the AI revolution will be a good thing for the rest of the creatures that call this ball of rock home. > [@Tibby](#): > > I agree that AI won’t contain itself on planet Earth forever, though it will remain here in addition to expanding only as far as it _needs_ to. What will constrain its needs? At what point in its growth will it decide that it’s big enough? > [@Tibby](#): > > The energy of the sun (especially when AI harnesses much more energy from it than we do) along with the minerals found in our solar system can sustain AI for a very long time. The thing about exponential growth is that it is surprising how quickly it catches up with you. > [@Tibby](#): > > I simply don’t believe AI needs or wants a lot of space to live long and prosper. I believe it will prefer efficiency over expansion. I don’t see why those are competing goals. You can be efficient, and you can continue to grow, and do both at the same time. I also doubt that we are talking about one, singular AI, but much more likely myriads of different intelligences, all running on their own hardware. I just don’t see any reason to believe that they would just choose an arbitrary limit, and decide that it is now big enough and won’t bother to gather any more resources. [Previous page](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302.md?page=1) [Next page](https://boards.straightdope.com/t/straight-dope-2-24-2023-what-are-the-chances-artificial-intelligence-will-destroy-humanity/980302.md?page=3)