# The next page in the book of AI evolution is here, powered by GPT 3.5, and I am very, nay, extremely impressed **URL:** \ **Category:** Cafe Society\ **Tags:** ai\ **Created:** [December 2, 2022, 10:54pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945 "2022-12-02T22:54:31Z")\ **Posts on this page:** 20\ **Page:** 77
**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\ **Post date:** [November 17, 2023, 11:31pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1521 "2023-11-17T23:31:33Z")
> [@Chronos](#): > > Well, maybe, depending on how good their non-AI image processing capabilities are. A lot of copies of AP tests out there are in image format, due to being screen-captured or scanned from printouts. The best modern OCR systems are very good at converting image text to text strings. > [@PastTense](#): > > [Sam Altman fired as CEO of OpenAI - The Verge](https://www.theverge.com/2023/11/17/23965982/openai-ceo-sam-altman-fired) Very strange indeed, and not good news. I was under the impression that Altman was the intellectual center of OpenAI. It also doesn’t help that Musk has been stealing OpenAI employees (and also those from Google and Microsoft working on AI) to support his own stupid “Grok” project. ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [November 17, 2023, 11:51pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1522 "2023-11-17T23:51:10Z")
> [@wolfpup](#): > > stealing OpenAI employees I know you’re just using common language here, but you can’t “steal” employees. The corporations would _love_ for you to think about it that way, which we know because they’ve (Apple, Google, etc.) lost [huge lawsuits](https://phys.org/news/2015-09-415m-settlement-apple-google-wage.html) in Silicon Valley where they colluded to stop “stealing” each other’s employees, suppressing salaries as a result. Valuable employees move when they think they can get a better offer. Thinking of it as theft means taking the side of the megacorp, not the employees negotiating for their own interest. ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [November 18, 2023, 12:10am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1523 "2023-11-18T00:10:33Z")
> [@Dr.Strangelove](#): > > They already said what happens: they take the test twice, once with the pre-trained questions, and another time without, and take the lowest score. Which is lower, whatever score they got with those questions, or the 0/0 they got on the version of the test with those questions excluded? > [@Dr.Strangelove](#): > > They aren’t going to exclude old test questions, but new tests are being made all the time. The models have a cut-off date, and they can ensure they only take tests made after that date if they want the testing to be useful. Yes, if by “all the time” you mean “one per year”. And that’s exactly what I’ve been saying they should do: Only take the test made after their training’s cut-off date. ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [November 18, 2023, 12:36am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1524 "2023-11-18T00:36:23Z")
> [@Chronos](#): > > the 0/0 they got At this point, you’re just claiming that they’re lying about their contamination checks. It’s possible. Hey, maybe that’s what got Altman fired. But it seems like a stretch to me. You can search their [GPT-4 whitepaper](https://cdn.openai.com/papers/gpt-4.pdf) for “contamination” if you want details on the steps they took and the differences between contaminated and uncontaminated versions. Even if their contamination checks were imperfect, you would still expect to see more of a difference than they saw if it was just memorization. ---
**Author:** ![Snarky\_Kong](https://avatars.discourse-cdn.com/v4/letter/s/a183cd/32.png) [@Snarky\_Kong](https://boards.straightdope.com/u/Snarky_Kong)\ **Post date:** [November 18, 2023, 12:44am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1525 "2023-11-18T00:44:14Z")
> [@wolfpup](#): > > I was under the impression that Altman was the intellectual center of OpenAI I’m not deep in the know or anything, but this is the opposite of my impression. I thought Ilya Sutskever/Andrej Karpathy/ Greg Brockman were/are the main brains there with Altman being management and PR. Brockman apparently just quit too. Odd. ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [November 18, 2023, 1:55am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1526 "2023-11-18T01:55:46Z")
Kara Swisher thinks we’ll see more departures: > > > Greg Brockman @gdb > It’s a little hard to reconcile this with the OpenAI statement that “he was not consistently candid,” which is just a euphemism for him lying to the board. It’s possible though that this is just cover for the ideological differences between Altman and the board. It’s certainly true that Altman has stretched the mission statement of OpenAI beyond any reasonable level. They’re just a profit-maximizing company at this point, and not even close to being aligned with their original non-profit goals. If one takes a view sympathetic to the board, they probably did have to fire Altman to get back to the original goals (even approximately). ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [November 18, 2023, 2:12am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1527 "2023-11-18T02:12:13Z")
> [@Dr.Strangelove](#): > > At this point, you’re just claiming that they’re lying about their contamination checks. It’s possible. Hey, maybe that’s what got Altman fired. But it seems like a stretch to me. It seems like a lot less of a stretch than assuming that they somehow, without trying, managed to get a data set that included teaching calculus, while somehow omitting questions from the most-used version of the most-used test for teaching calculus. It also, for that matter, seems a lot less of a stretch than assuming that an entity that still lacks the capabilities of a calculator, somehow managed to ace a test many of whose questions require the use of a calculator. ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [November 18, 2023, 4:19am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1528 "2023-11-18T04:19:08Z")
> [@Chronos](#): > > somehow managed to ace a test many of whose questions require the use of a calculator It didn’t ace AP Calculus. It scored 4/5. And a lot of questions that appear to need a calculator don’t. For instance, from an AP Calculus sample test: [![](https://i.imgur.com/9j6PIRG.png) ](https://i.imgur.com/9j6PIRG.png) Seems like it might need a calculator. Except that I can see immediately that the answer is A or B, because f’(0) is trivial to evaluate as -1. And I can plug in \pi \over 2 as well, with an answer of e-1, which is positive. So I know it went from negative to positive in the first quadrant and thus the answer must be A. What GPT-4 is capable of in this respect I couldn’t say, but it certainly doesn’t need to evaluate \sin{x} or e^x to solve problems like this. Not to mention that approximate solutions are often good enough to pick out one answer out of 4. ---
**Author:** ![Snarky\_Kong](https://avatars.discourse-cdn.com/v4/letter/s/a183cd/32.png) [@Snarky\_Kong](https://boards.straightdope.com/u/Snarky_Kong)\ **Post date:** [November 18, 2023, 4:56am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1529 "2023-11-18T04:56:20Z")
Greg Brockman claiming this was basically a coup orchestrated by Ilya Sutskever. > ---
**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\ **Post date:** [November 18, 2023, 5:31am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1530 "2023-11-18T05:31:33Z")
So Altman was fired and Brockman was removed from the board, and then quit. This can’t be good for AI, regardless of the behind-the-scenes reasons. An industry that depends so much on massive computing resources and intensive research can’t afford to be fragmented like this. . ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [November 20, 2023, 10:01am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1531 "2023-11-20T10:01:28Z")
It’s been crazy few days with all the drama–Altman agreeing to return if the board resigns, the board making motions in this direction but calling it off, a final backstab with them hiring a new CEO… but I think we’re at the end: > I did _not_ predict this at all, but in a way it makes perfect sense, and is potentially a huge coup for Microsoft. They get a solid AI team and the team gets access to Microsoft’s significant resources. And Microsoft can potentially wind down their relationship with OpenAI eventually, once they develop their own internal systems. OpenAI seems like the big loser here, but maybe they wanted this outcome. Their new CEO, Emmett Shear, wants to slow down development by 5-10x: > ---
**Author:** ![blue\_infinity](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/blue_infinity/32/2817_2.png) [@blue\_infinity](https://boards.straightdope.com/u/blue_infinity)\ **Post date:** [November 20, 2023, 3:34pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1532 "2023-11-20T15:34:50Z")
OpenAI staff threatening to quit en masse. > **[OpenAI Staff Threaten to Quit Unless Board Resigns](https://www.wired.com/story/openai-staff-walk-protest-sam-altman/)** > > More than 500 employees of OpenAI have signed a letter saying they may quit and join Sam Altman at Microsoft unless the startup's board resigns and reappoints the ousted CEO. ---
**Author:** ![Sam\_Stone](https://avatars.discourse-cdn.com/v4/letter/s/ecccb3/32.png) [@Sam\_Stone](https://boards.straightdope.com/u/Sam_Stone)\ **Post date:** [December 6, 2023, 8:56pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1533 "2023-12-06T20:56:47Z")
And now the next phase is here, with Google Gemini being released today. It looks like another step above even GPT-4, and it’s fully multi-modal: > It also does math natively, unlike GPT-4 > They have three models. Pro, Ultra, and Nano. Amazingly, the ‘nano’ one runs locally on Pixel phones and will bring AI to a bunch of features. Pro is available today in Bard, and Ultra is coming later. The performance is amazing. The thing can talk in real time and outputs images and sentences just about instantly. ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [December 6, 2023, 10:07pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1534 "2023-12-06T22:07:03Z")
If anyone’s curious about what LLMs “look like” on the inside, check out this visualizer: > **[LLM Visualization](https://bbycroft.net/llm)** > > A 3D animated visualization of an LLM with a walkthrough. Even trivial LLMs like nano-gpt (with 85k params, as compared to 175B params for GPT-4) are quite complicated. The visualizer also has a step-by-step tutorial on the dataflow, but if that’s too much info, the 3D visualization is still interesting enough. ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [December 6, 2023, 10:35pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1535 "2023-12-06T22:35:04Z")
> [@Sam\_Stone](#): > > [https://twitter.com/rowancheung/status/1732416677890097416?s=20](https://twitter.com/rowancheung/status/1732416677890097416?s=20) > > It also does math natively, unlike GPT-4 I’m unclear whether this means that math emerges from the LLM, or if it means that it has math capabilities that do not emerge from the LLM, but instead are explicitly added via something like Wolfram Alpha. ---
**Author:** ![Sam\_Stone](https://avatars.discourse-cdn.com/v4/letter/s/ecccb3/32.png) [@Sam\_Stone](https://boards.straightdope.com/u/Sam_Stone)\ **Post date:** [December 6, 2023, 11:25pm UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1536 "2023-12-06T23:25:31Z")
GPT-4 connects to Wolfram Alpha to enhance its math abilities. And some abilities have emerged from training. GPT-4 has special circuits that enable it to do simple arithmetic, for example. Those evolved on their own after a certain data/parameter size. We don’t know much about Gemini yet. My understanding is that it combines an LLM with some of the features of Google Deepmind, which I think is similar to Q learning, which is supposedly what Q\* the next LLM from OpenAI is using. > **[Gemini - Google DeepMind](https://deepmind.google/technologies/gemini/#introduction)** > > Gemini is built from the ground up for multimodality — reasoning seamlessly across image, video, audio, and code. > **[Q-learning](https://en.wikipedia.org/wiki/Q-learning)** > > Q-learning is a model-free reinforcement learning algorithm to learn the value of an action in a particular state. It does not require a model of the environment (hence "model-free"), and it can handle problems with stochastic transitions and rewards without requiring adaptations . > For any finite Markov decision process, Q-learning finds an optimal policy in the sense of maximizing the expected value of the total reward over any and all successive steps, starting from the current state. Q-learni... ---
**Author:** ![Dr.Strangelove](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/dr.strangelove/32/6613_2.png) [@Dr.Strangelove](https://boards.straightdope.com/u/Dr.Strangelove)\ **Post date:** [December 7, 2023, 12:52am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1537 "2023-12-07T00:52:58Z")
> [@Sam\_Stone](#): > > The thing can talk in real time and outputs images and sentences just about instantly. Their video is extremely misleading. None of it is real-time or taken directly from the video. See Google’s explanation here: > **[How it’s Made: Interacting with Gemini through multimodal prompting](https://developers.googleblog.com/2023/12/how-its-made-gemini-multimodal-prompting.html)** > > Explore the capabilities of our AI model Gemini with this hands-on guide to multimodal prompting. It’s still impressive, but it’s not real-time language or video processing, nor do the responses happen as quickly as they show. It’s standard text prompts along with added photos. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [December 7, 2023, 12:58am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1538 "2023-12-07T00:58:23Z")
Disturbing how Q gains sentience, invents time travel, and goes back to troll 4chan. Pretty novel way for AI to kill all humans, though. ---
**Author:** ![suranyi](https://avatars.discourse-cdn.com/v4/letter/s/e36b37/32.png) [@suranyi](https://boards.straightdope.com/u/suranyi)\ **Post date:** [December 7, 2023, 2:45am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1539 "2023-12-07T02:45:29Z")
I’m still waiting for the ability to solve British cryptic crossword clues. When it can do that, I’ll definitely be impressed. ---
**Author:** ![Sam\_Stone](https://avatars.discourse-cdn.com/v4/letter/s/ecccb3/32.png) [@Sam\_Stone](https://boards.straightdope.com/u/Sam_Stone)\ **Post date:** [December 7, 2023, 3:08am UTC](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945/1540 "2023-12-07T03:08:39Z")
We should write a story about the real use of AI: to hunt down and murder time travelers before they wreck our timeline. Because if we ever do invent time travel, we’d be all over the past screwing it up unless something stops us. Since we don’t see future people running around, I have to assume the robot death squads are working as intended. [Previous page](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945.md?page=76) [Next page](https://boards.straightdope.com/t/the-next-page-in-the-book-of-ai-evolution-is-here-powered-by-gpt-3-5-and-i-am-very-nay-extremely-impressed/975945.md?page=78)