Upgrade (open spoilers after 1 June 2018)

[Snowboarder_Bo]

@Bryan_Ekers

Surely there are easier ways to accomplish this goal than for STEM to put itself at risk and… what trail? How was any of this supposed to get back to STEM, if STEM wasn’t going out of its way to draw attention to Grey by, y’know, guiding him through a killspree?

But this isn’t a Joker-esque story where all of the most implausible and improbable things that the planner anticipates keep happening, thus enabling his ludicrous plan. This is STEM having a goal and seizing on opportunities in furtherance of that goal, IMO. The fact that he can’t plan very far in advance is because there’s just so much he doesn’t know yet regarding, as SenorBeef says, the loose ends that are STEM’s priority.

[Isamu]

Grey Trace - a great foreshadowing name.

[Wesley_Clark]

I wonder what STEM did after the movie ended. STEM was obviously far smarter than the humans around it, so the world was its oyster. So what did it do?

Start a multi billion dollar business creating other STEMs? Take over politics?

[SlackerInc]

Probably!

Some AI experts warn that even “boxing” a superintelligence is too risky because they could manipulate the humans they interact with.

[Wesley_Clark]

@SlackerInc

Probably!

Some AI experts warn that even “boxing” a superintelligence is too risky because they could manipulate the humans they interact with.

Yeah. The entire plot of Upgrade reminded me of this quote about ASI.

http://teddyb.org/robin/tiki-index.php?page=Post-Singularity%2BAnd%2BTranshumanist%2BFiction%2BI%2527ve%2BEnjoyed

On a related note, I once heard Stross talk about how to write superintelligences, and he gave an illustrative example, paraphrased: “When I need to take my cat to the vet, I bring out the cat carrier. The cat knows what this means, and then runs for the cat door. He is then very surprised to discover that it’s closed and locked. To him, these two events are totally coincedental. I think that it’s easy to write a story about a superintelligence: just have any humans that try to act against it constantly surprised by apparent coincidences that turn out to all have been the superintelligence’s fault in the end.”

[Isamu]

@Wesley_Clark

Yeah. The entire plot of Upgrade reminded me of this quote about ASI.

http://teddyb.org/robin/tiki-index.php?page=Post-Singularity%2BAnd%2BTranshumanist%2BFiction%2BI%2527ve%2BEnjoyed

The Sirens of Titan

[SlackerInc]

Thanks a lot for that link—I will never escape that rabbit hole! :smack:

[TPWombat]

@Wesley_Clark

Yeah. The entire plot of Upgrade reminded me of this quote about ASI.

http://teddyb.org/robin/tiki-index.php?page=Post-Singularity%2BAnd%2BTranshumanist%2BFiction%2BI%2527ve%2BEnjoyed

That link will not resolve for me.

And nitpick

On a related note, I once heard Stross talk about how to write superintelligences, and he gave an illustrative example, paraphrased: “When I need to take my cat to the vet, I bring out the cat carrier. The cat knows what this means, and then runs for the cat door. He is then very surprised to discover that it’s closed and locked. To him, these two events are totally coincedental. I think that it’s easy to write a story about a superintelligence: just have any humans that try to act against it constantly surprised by apparent coincidences that turn out to all have been the superintelligence’s fault in the end.”

He must have had a particularly stupid cat. Mine learnt VERY quickly that once the carrier comes out there is no point in trying the catflap and belts off upstairs to hide.