# The next page in the book of AI evolution is here, powered by GPT 3.5, and I am very, nay, extremely impressed **URL:** \ **Category:** Cafe Society\ **Tags:** ai\ **Created:** [December 2, 2022, 10:54pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945 "2022-12-02T22:54:31Z")\ **Posts on this page:** 20\ **Page:** 46
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [February 24, 2023, 9:42pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/901 "2023-02-24T21:42:13Z")
> [@Sam\_Stone](#): > > The language generation may be partially stochastic, but the determimation of the list of probabilities themselves is the result of that giant neural network, and it is not simple. Neural nets are universal function approximators, as it happens. They can approximate _any_ computable function, no matter how complex. Even something like the human mind. > [@Sam\_Stone](#): > > It’s the equivalent of someone with tourettes or lack of executive function, They just spit out whatever they were internally formulating without evaluation, and sometimes it’s nuts. It’s going to be an ongoing source of confusion to people where the strengths and weaknesses of machine intelligences are simply _different_ from humans, and so they’ll make false conclusions about the overall strength. ChatGPT seems to have the executive function of a small child. Kids lie _all the time_ about the stupidest things, and don’t always display awareness of the difference between fiction and reality. The problem is that ChatGPT has the mechanical writing skills of a college student, and the disparity seems weird because we expect much more from them. In any case, people focusing too much on the weird failures are going to be totally blindsided by AI capabilities in a few years for the reasons you mention. ---
**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\ **Post date:** [February 24, 2023, 9:49pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/902 "2023-02-24T21:49:23Z")
You guys are focusing on its writing capabilities, which it certainly possesses, but I’m blown away by its logical reasoning skills – like the fish question that I posted above, and lots of other successful responses to actual IQ test questions that I didn’t post here. I think it blundered on only one of them. Some of its blunders, as Steven Pinker pointed out recently, are just because its world view is still incomplete. There are facts about the world that are totally obvious to us that it doesn’t yet know about. ---
**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\ **Post date:** [February 24, 2023, 10:08pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/903 "2023-02-24T22:08:44Z")
Unfortunately, it was before I set up an OpenAI account, so it’s not in my archives. (This was back in December, and I was able to use ChatAI without logging in.) I tried to reproduce it, but no luck. ---
**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\ **Post date:** [February 24, 2023, 10:11pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/904 "2023-02-24T22:11:44Z")
Oh I thought you had written it. ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [February 24, 2023, 10:12pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/905 "2023-02-24T22:12:42Z")
> [@wolfpup](#): > > I’m blown away by its logical reasoning skills It is impressive, but then we do have to ask why it blew the 2 pounds of feathers problem so badly. I’d suggest as a possibility something that [came up in the General Aviation thread](https://boards.straightdope.com/t/the-great-ongoing-general-aviation-thread/600499/3682): expectation bias. Why would an experienced pilot put the gear down when the captain clearly called for “flaps 1”? The reason (probably) is expectation bias: the pilot really, really thought that gear down was the appropriate action in that situation, and so “heard” that as the callout, even though that wasn’t what was said. The pound of feathers riddle must appear in many thousands of places on the web and almost always in the same form (though still with differences in wording). So there must be a tremendous bias to interpret the question in that way, even when it’s actually slightly different (I actually read the modified question incorrectly myself). The LLM has to deal with a high degree of ambiguity in its inputs, and has to correct for small errors which were probably not meant. It would not be a very good tool if it wasn’t able to do this. The correction just went overboard in this case due to the strong training bias. ---
**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\ **Post date:** [February 24, 2023, 10:16pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/906 "2023-02-24T22:16:34Z")
Ah ha! Damn typo on the phone: “It did a short story” not “I did a short story.” _smack_ This wasn’t just me shamelessly plugging some of my writing in this thread, haha. 🙂 ---
**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\ **Post date:** [February 24, 2023, 10:23pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/907 "2023-02-24T22:23:57Z")
Yeah, if you do this: > what weighs more ten pounds of feathers or 3 pounds of iron? You get: > Ten pounds of feathers and 3 pounds of iron both weigh the same amount, which is 10 pounds and 3 pounds respectively. > [and some explanation how it’s a common “trick question”] But if you do this: > what weighs more a pound of pork or two pounds of beef? You get: > Two pounds of beef weigh more than one pound of pork. > [and an explanation of weight, gravity, mass, etc.] I’ve tried it with a pound of pillows, and it also messes up. So I guess anything that seems like it should be “lighter” than something that seems like it should be “heavier” will confuse it. ETA: Actually, a pound of feathers and two pounds of pillows will also confuse it. > [@](#): > > There is no definitive answer to this question because it depends on the weight of the feathers and pillows in question. > > If we assume that the feathers and pillows are of the same type and size and are measured in pounds, then a pound of feathers and two pounds of pillows would weigh the same amount because both would weigh one pound. > > However, if the feathers are very large and fluffy, and the pillows are small and dense, then a pound of feathers could weigh less than two pounds of pillows. In this case, the weight would depend on the actual weight of the feathers and pillows being compared. > > It’s important to note that weight is a measure of the force exerted on an object by gravity, and it is proportional to the mass of the object. Therefore, if the feathers and pillows have the same mass, they will weigh the same amount, regardless of their size or shape. ---
**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\ **Post date:** [February 24, 2023, 10:26pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/908 "2023-02-24T22:26:10Z")
I did a variation on that with having a ton of feathers fall on your vs a ton of iron. It got _VERY_ confused. At one both saying that the iron would kill you but the feathers wouldn’t but also that they weigh the same and both would cause fatal injuries. It then started talking about falling ONTO feathers and iron and concluded that both would kill you (depending on height, velocity, etc.). ---
**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\ **Post date:** [February 24, 2023, 10:28pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/909 "2023-02-24T22:28:11Z")
I suspect you’re right about the expectation bias, or at least it sure sounds like it. But I’m very confident that you’re right that too much is being made of mistakes like this. They will become fewer and fewer over time. I tested it on lots of other logical reasoning questions besides what I posted, and it got all of them right except one, including a couple that humans would have regarded as trick questions and that many people would have got wrong. ---
**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\ **Post date:** [February 24, 2023, 10:36pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/910 "2023-02-24T22:36:17Z")
I had a chuckle reading that, thinking about the kind of conversation you might have had with the Microsoft Bing-ified version of that bot. It probably would have told you to go sit under the falling iron, along with the horse you rode in on. 😄 I don’t know what Microsoft did to what is essentially the same engine, but that thing is a hateful psycho! 🤣 ---
**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\ **Post date:** [February 24, 2023, 10:39pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/911 "2023-02-24T22:39:26Z")
I haven’t tried Bing’s yet. I should. It sounds like a blast. I’ve been using Midjourney to make music cover art for my songs since I am VERY close to releasing a bunch of songs. The art is makes is unreal. If I were an artist, then I would be panicking (or planning on using these tools). I cannot think of a reason to hire a human artist except to touch up the stuff the AI makes. Maybe there are some edges cases the AI cannot handle, but for everything I’ve asked it has been outstanding, if perhaps somewhat time consuming. We’re definitely entering the AI age for realz I think. _Beep_ No, not yet killer robots. Soon. _Beep_ ---
**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\ **Post date:** [February 24, 2023, 10:45pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/912 "2023-02-24T22:45:54Z")
> [@BeepKillBeep](#): > > I haven’t tried Bing’s yet. I should. It sounds like a blast. In all seriousness, you probably won’t get the insults. As I think I mentioned either here or elsewhere, Microsoft recently limited access to five interactions per session and ten separate sessions per day. The drama used to happen during extended conversations, like the NYT reporter who the bot claimed to be in love with and was advised to dump his wife because she didn’t love him and didn’t make him happy, or the Associated Press reporter that Bing got mad at and compared to Hitler and accused of nefarious plots. Those were all the result of long conversations, which apparently causes the bot to lose its temper or its mind, or both. ---
**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\ **Post date:** [February 24, 2023, 10:46pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/913 "2023-02-24T22:46:57Z")
> [@BeepKillBeep](#): > > No, not yet killer robots. Soon. As my ChatGPT ominously told me in a conversation where I was looking for a one-liner to end a statement about the Singularity(and I think I mentioned dozens or more posts back): > Let’s hope the robots are more forgiving than the humans they replace. ---
**Author:** ![BeepKillBeep](https://avatars.discourse-cdn.com/v4/letter/b/9e8a1a/32.png) [@BeepKillBeep](https://boards.straightdope.com/u/BeepKillBeep)\ **Post date:** [February 24, 2023, 10:48pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/914 "2023-02-24T22:48:05Z")
Oh wow. There’s a waitlist to be able to use the Bing chatbot. ---
**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\ **Post date:** [February 24, 2023, 10:48pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/915 "2023-02-24T22:48:51Z")
Yep. I got on it a few days ago, but I suspect it will take awhile. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [February 24, 2023, 10:49pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/916 "2023-02-24T22:49:39Z")
> [@pulykamell](#): > > Samson the sentient suitcase. Love the name, and perfectly in the spirit of what I had been thinking about twenty years ago when I wrote this fragment Does it have many legs and a short temper? ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [February 24, 2023, 10:52pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/917 "2023-02-24T22:52:41Z")
> [@wolfpup](#): > > Microsoft recently limited access to five interactions per session and ten separate sessions per day. I wonder if price plays any role in that? > **[Colossal Artificial Intelligence Search Costs Pose Headwinds For Google's...](https://finance.yahoo.com/news/colossal-artificial-intelligence-search-costs-205607010.html)** > > The wildly popular chatbot from OpenAI, which can draft prose and answer search queries, has "eye-watering" computing costs of a couple or more cents per conversation, the startup's CEO Sam Altman has said on Twitter. The high costs posed a challenge... ---
**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\ **Post date:** [February 24, 2023, 11:09pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/918 "2023-02-24T23:09:16Z")
I dunno, but my understanding is that it runs on a really awesome supercomputer, which in fact is Microsoft’s primary financial contribution to OpenAI. ---
**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\ **Post date:** [February 24, 2023, 11:34pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/919 "2023-02-24T23:34:50Z")
I don’t recognize the reference, but, in the spirit of ChatGPT, it’s a very friendly and helpful sentient suitcase. (If that ends up being a HHGTTG reference, it’s been a couple plus decades since I’ve read it.) I asked about means of locomotion back then, and it did not mention legs. Either its casters, levitation, being carried about by someone, or telekenesis. > Samson has an interesting personality, he is quite philosophical, he is wise and has a good sense of humor. He has a lot of knowledge about the afterlife, and he is very curious about the world, he is always eager to learn more. He is also a very loyal companion, and he would do anything to help Harry find his way to his final destination. ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [February 24, 2023, 11:39pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/920 "2023-02-24T23:39:03Z")
> [@pulykamell](#): > > I don’t recognize the reference That would be [The Luggage](https://discworld.fandom.com/wiki/The_Luggage). Very different personality, though, aside from the loyalty (taken to a bit of an extreme with The Luggage). I’m impressed most of all with Samson’s name. Somehow I’m picturing a half-worn Samsonite logo on the suitcase that only shows the Samson part. [Previous page](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945.md?page=45) [Next page](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945.md?page=47)