# Large language model AI doesn't learn **URL:** \ **Category:** Great Debates\ **Tags:** ai\ **Created:** [May 30, 2023, 5:27pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778 "2023-05-30T17:27:52Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![Left\_Hand\_of\_Dorkness](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/left_hand_of_dorkness/32/7156_2.png) [@Left\_Hand\_of\_Dorkness](https://boards.straightdope.com/u/Left_Hand_of_Dorkness)\ **Post date:** [May 30, 2023, 5:27pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/1 "2023-05-30T17:27:52Z")
In recent discussions, there’s been some debate about whether it’s accurate to say that large language models/AI can learn things. I have strong skepticism that this is an accurate description, or even a helpful metaphor, and would like to hear from others. First, some examples. Almost definitionally, humans can learn things. If we discard the idea of humans learning things, the word “learning” becomes meaningless–or at least, it becomes a description of a fantasy process. If you’re an extreme behaviorist who denies the ability of a child to learn something, I invite you to some other conversation way over there. Some examples of learning: - A child learns to speak. - An adult learns how to play guitar. - A person learns that Olympia is the capital of Washington State. - A dog learns to sit when you say “Sit!” Some non-examples of learning: - A piece of plastic is molded into the shape of a Fisher-Price Speak-and-Say toy, and acquires the ability to make the noise, “The cow goes moo!” The plastic has not learned to speak. - My iphone downloads a Jimi Hendrix song. My iphone has not learned how to play guitar. - A bookshelf is shelved with an atlas of US maps. The shelf has not learned that the capital of Washington State is Olympia. - A couch cushion acquires the shape of your butt. It has not learned what your butt is like. Way back when I was in teacher school, we talked a lot about “[schema](https://www.edweek.org/education/opinion-what-is-schema-how-do-we-help-students-build-it/2019/10)”. A schema is a concept consisting of a cluster of smaller concepts. For example, a toddler may have a schema that we call “Cat”, and it might consist of other concepts: - Fuzzy - Smaller than me - Meow - Face - Mr. Tibbles - Tail - Scratches if you pull tail If a toddler is out in public and sees something fuzzy with a tail and a face, the toddler might point and say, “Cat!” because the thing has enough in common with its cat schema to be identified as such. Schema can be modified through addition and subtraction. “That’s not a cat,” you say, “That’s a squirrel! See how big and fluffy its tail is?” Now the schema’s “tail” concept becomes: - Tail (but not big and fluffy, that’s squirrel). Or you might say, “Look, kid, at the lion! Did you know that’s a kind of big cat?” Now the “smaller than me” subconcept becomes: - Smaller than me sometimes, but also can be bigger than me. And then you can add entirely new schema. “Kid, wanna learn about tardigrades?” you say, and now there’s a schema to fill up with concepts. The key thing is the _clusters of concepts_. Humans hold ideas in clusters, and then they connect concepts one to the other. When evaluating the truth of a new idea, they access their current schema and compare the new idea to those schema. Dog brains work fairly similarly to human brains, in this regard. Dogs develop clusters of concepts around things like “meaty bones” and “people I live with” and “things to chase.” They can add or subtract from those: when a bee stings them on the nose, “things to chase” might get a new qualifier, and when a new baby enters a household, “people I live with” is expanded. Bookshelves don’t work like that. You can load a bookshelf with new books, and it can therefore acquire new knowledge, but it doesn’t impose any concept cluster on the knowledge it acquires. It just holds that knowledge. We don’t say it “learned” the knowledge that it’s acquired. iPhones don’t work like that. When I download a Jimi Hendrix tune, my iPhone has the capability to do something it couldn’t previously do. But that doesn’t represent learning. It doesn’t build concept clusters in anything like the way that human do; at best, it has keywords that have many-to-many relationships in a database. And, as I understand it, large language models don’t work anything like that. They have an enormous database of words, and they know which words most often appear after other words; but that doesn’t involve building concept clusters around the meaning of those words. Their understanding of what the word “cat” refers to is nowhere near as sophisticated as a toddler’s. A large-language model with a new input of a million Wikipedia articles no more “learns” the information in those articles than an iPhone learns to play guitar. It is sometimes tempting to talk about what AI is learning–but I think it’s misleading. The temptation to anthropomorphize AIs is very strong, but it distracts folks from what’s actually happening. Thoughts? ---
**Author:** ![Johnny\_Bravo](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johnny_bravo/32/493_2.png) [@Johnny\_Bravo](https://boards.straightdope.com/u/Johnny_Bravo)\ **Post date:** [May 30, 2023, 6:21pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/2 "2023-05-30T18:21:35Z")
In one of the other AI threads, I fed Chat GPT a series of somewhat whimsical laws from a fictional country. I then gave it scenarios and asked it which laws, if any, were being broken. I think it got confused once, but when I prodded it with a “are you sure?” it corrected its answer. I agree that it can’t learn or understand in the way we’d use those terms as educators, but a LLM can absolutely receive wholly new data and use it to inform future output. I don’t know if it’s “synthesis” exactly, but it’s not nothing. ---
**Author:** ![Left\_Hand\_of\_Dorkness](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/left_hand_of_dorkness/32/7156_2.png) [@Left\_Hand\_of\_Dorkness](https://boards.straightdope.com/u/Left_Hand_of_Dorkness)\ **Post date:** [May 30, 2023, 6:26pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/3 "2023-05-30T18:26:43Z")
> [@Johnny\_Bravo](#): > > I agree that it can’t learn or understand in the way we’d use those terms as educators, but a LLM can absolutely receive wholly new data and use it to inform future output. I don’t know if it’s “synthesis” exactly, but it’s not nothing. Yeah–I recognize that the bookshelf analogy isn’t exactly apt, because the model is using some analytical tools on its data. But what it’s doing is so fundamentally different from what a toddler, or even a dog, does, that I think it’s misleading to call them by the same name. ---
**Author:** ![Johnny\_Bravo](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johnny_bravo/32/493_2.png) [@Johnny\_Bravo](https://boards.straightdope.com/u/Johnny_Bravo)\ **Post date:** [May 30, 2023, 6:29pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/4 "2023-05-30T18:29:26Z")
I agree. We probably need new terminology. B Saying “it’s learning!” is wrong because it invites anthropomorphism, but saying “it’s not learning!” is wrong because it’s capable of doing **something** learningish. ---
**Author:** ![Pleonast](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pleonast/32/1183_2.png) [@Pleonast](https://boards.straightdope.com/u/Pleonast)\ **Post date:** [May 30, 2023, 6:34pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/5 "2023-05-30T18:34:25Z")
> [@Left\_Hand\_of\_Dorkness](#): > > The key thing is the _clusters of concepts_. Humans hold ideas in clusters, and then they connect concepts one to the other. When evaluating the truth of a new idea, they access their current schema and compare the new idea to those schema. I don’t think trying to answer a question about learning by restricting knowledge to a particular form is useful. Instead, it’s better to explicitly list the qualities of learning. For example, to “learn”, an entity must: - have knowledge - have senses - adapt its knowledge based on its senses Using those criteria, humans and dogs can learn. Plastic pieces, bookshelves, and cushions cannot. The iPhone is trickier. It can’t learn to play guitar because the phone cannot physically pluck strings. But can it play music? My definition is not sufficient. ---
**Author:** ![Left\_Hand\_of\_Dorkness](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/left_hand_of_dorkness/32/7156_2.png) [@Left\_Hand\_of\_Dorkness](https://boards.straightdope.com/u/Left_Hand_of_Dorkness)\ **Post date:** [May 30, 2023, 6:41pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/6 "2023-05-30T18:41:17Z")
Does a film camera meet your definition? ---
**Author:** ![Thudlow\_Boink](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/thudlow_boink/32/320_2.png) [@Thudlow\_Boink](https://boards.straightdope.com/u/Thudlow_Boink)\ **Post date:** [May 30, 2023, 7:01pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/7 "2023-05-30T19:01:55Z")
> [@Left\_Hand\_of\_Dorkness](#): > > They have an enormous database of words, and they know which words most often appear after other words If that’s all they do, is that enough to really count as “artificial intelligence”? I know a _little_ about AI and how it works, but maybe not nearly enough to meaningfully participate in this discussion. Still, I’ll throw out the following questions: Does “intelligence” (“real” intelligence, not AI) necessarily involve the capacity to learn? And if so, what does that imply? That, if the term “artificial intelligence” is to be at all appropriate, AI has to be capable of learning as well? Or, that AI has to “artificially learn”—that is, it has to do something artificially that is the analog of what a natural intelligence does naturally when it learns? In that case, it seems to me that talking about AI learning is _at least_ a helpful metaphor, since it’s no more unfair or inappropriate to use the word “learn” than to use the word “intelligence.” ---
**Author:** ![Pleonast](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pleonast/32/1183_2.png) [@Pleonast](https://boards.straightdope.com/u/Pleonast)\ **Post date:** [May 30, 2023, 7:01pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/8 "2023-05-30T19:01:57Z")
> [@Left\_Hand\_of\_Dorkness](#): > > Does a film camera meet your definition? I would say a camera is like a bookshelf. They don’t have knowledge, but only records. But that’s not explicit in my definition; it really does need work. ---
**Author:** ![Buck\_Godot](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/buck_godot/32/6573_2.png) [@Buck\_Godot](https://boards.straightdope.com/u/Buck_Godot)\ **Post date:** [May 30, 2023, 11:36pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/9 "2023-05-30T23:36:19Z")
I would say that it definitely learns, and does so in a way that is much more analogous to a toddler than it is to an Iphone playing music. What makes the AI different from the Iphone is that responding to a given output with an explicit input is programmed into the Iphone directly. In an IA the output an an emergent property of the gestalt of their inputs subtly influencing each other and arriving at correct responses might not explicitly match any of their direct experiences. I would say that a definition of learning that excludes this is overly restrictive. Where I would draw the line is does it “understand” what its learned. That starts getting into the whole wooly concept of awareness which is not really fully understood by anyone, but I can feel pretty confident is saying that according to all but the most loose understanding of the word (recursion not intended) current AI’s don’t. ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [May 31, 2023, 12:29am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/10 "2023-05-31T00:29:49Z")
Can machines learn? Yes, they can. > **[What is Machine Learning? | IBM](https://www.ibm.com/topics/machine-learning)** > > This introduction to machine learning provides an overview of its history, important definitions, applications and concerns within businesses today. > **[Machine Learning and Artificial Intelligence - Amazon Web Services](https://aws.amazon.com/machine-learning/)** > > AWS offers the broadest and deepest set of artificial intelligence (AI) and machine learning (ML) services and supporting cloud infrastructure. Learn how to accelerate your machine learning journey on AWS. [https://www.sciencedirect.com/topics/computer-science/machine-learning](https://www.sciencedirect.com/topics/computer-science/machine-learning) > **[What is Machine Learning? | How it Works, Tutorials, and Examples](https://www.mathworks.com/discovery/machine-learning.html)** > > Learn the 3 things you need to know about machine learning; Resources include MATLAB examples, documentation, and code describing different machine learning algorithms. > **[What Is Machine Learning and Types of Machine Learning \[Updated\]](https://www.simplilearn.com/tutorials/machine-learning-tutorial/what-is-machine-learning)** > > This article helps you understand what is Machine Learning ✔️ the types of machine learning, its uses, and how does machine learning work✔️. Read to learn more! > **[Machine learning](https://en.wikipedia.org/wiki/Machine_learning)** > > Machine learning (ML) is a field devoted to understanding and building methods that let machines "learn" – that is, methods that leverage data to improve computer performance on some set of tasks. > Machine learning algorithms build a model based on sample data, known as training data, in order to make predictions or decisions without being explicitly programmed to do so. Machine learning algorithms are used in a wide variety of applications, such as in medicine, email filtering, speech recognitio... It is a long-established term and principle in computer science. ---
**Author:** ![RitterSport](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/rittersport/32/6326_2.png) [@RitterSport](https://boards.straightdope.com/u/RitterSport)\ **Post date:** [May 31, 2023, 12:36am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/11 "2023-05-31T00:36:23Z")
> [@Left\_Hand\_of\_Dorkness](#): > > The key thing is the _clusters of concepts_. Douglas Hofstadter wrote a book on this. I think it was Fluid Concepts and Creative Analogies. Anyway, that’s my contribution to this thread. ---
**Author:** ![BigT](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bigt/32/12044_2.png) [@BigT](https://boards.straightdope.com/u/BigT)\ **Post date:** [May 31, 2023, 12:53am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/12 "2023-05-31T00:53:04Z")
> [@Thudlow\_Boink](#): > > > [@Left\_Hand\_of\_Dorkness](#): > > > > They have an enormous database of words, and they know which words most often appear after other words ⁢ > > If that’s all they do, is that enough to really count as “artificial intelligence”? That’s an argument I’ve seen made by people who work with the technology. What the average person thinks of as “artificial intelligence” and what LLMs actually do are quite different, and that it’s unfortunate that the name “AI” has caught on for the idea. What most people envision is referred to as an AGI: an artificial general intelligence. > **[Artificial general intelligence](https://en.wikipedia.org/wiki/Artificial_general_intelligence)** > > An artificial general intelligence (AGI) is a hypothetical type of intelligent agent. If realized, an AGI could learn to accomplish any intellectual task that human beings or animals can perform. Alternatively, AGI has been defined as an autonomous system that surpasses human capabilities in the majority of economically valuable tasks.\[promotion?\] Creating AGI is a primary goal of some artificial intelligence research and of companies such as OpenAI, DeepMind, and Anthropic. AGI is The timeli... ---
**Author:** ![Darren\_Garrison](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/darren_garrison/32/92_2.png) [@Darren\_Garrison](https://boards.straightdope.com/u/Darren_Garrison)\ **Post date:** [May 31, 2023, 1:58am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/13 "2023-05-31T01:58:32Z")
> [@BigT](#): > > That’s an argument I’ve seen made by people who work with the technology. I bet those people aren’t game programmers, [where “artificial intelligence” has been used as a descriptive term for many years](https://www.google.com/search?q=artificial+intelligence+video+game&client=firefox-b-1-m&sxsrf=APwXEdeQojOsrWJbmWgbtyMAzU-084PORA:1685498153401&source=lnms&tbm=bks&sa=X&ved=0ahUKEwj2_c71uZ7_AhXmlGoFHT7KBK8Q_AUICygG). ---
**Author:** ![China\_Guy](https://avatars.discourse-cdn.com/v4/letter/c/779978/32.png) [@China\_Guy](https://boards.straightdope.com/u/China_Guy)\ **Post date:** [May 31, 2023, 2:04am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/14 "2023-05-31T02:04:32Z")
ChatGPT and these types of “AI” are at their most basic simply pattern recognition engines. And they match your request with the pattern they have. And if it doesn’t match the pattern, then it “hallucinates” or just makes stuff up. You need to check the cites for anything serious. ---
**Author:** ![Left\_Hand\_of\_Dorkness](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/left_hand_of_dorkness/32/7156_2.png) [@Left\_Hand\_of\_Dorkness](https://boards.straightdope.com/u/Left_Hand_of_Dorkness)\ **Post date:** [May 31, 2023, 4:17am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/15 "2023-05-31T04:17:16Z")
> [@Darren\_Garrison](#): > > Can machines learn? Yes, they can. It appears that, rather than reading the OP, you just Googled “Machine learning” and threw up the first five links you got. Were I unfamiliar with the term, this would be a meaningful contribution to the thread. ---
**Author:** ![penultima\_thule](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/penultima_thule/32/3833_2.png) [@penultima\_thule](https://boards.straightdope.com/u/penultima_thule)\ **Post date:** [May 31, 2023, 4:30am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/16 "2023-05-31T04:30:50Z")
> [@Pleonast](#): > > adapt its knowledge based on its senses > [@China\_Guy](#): > > ChatGPT and these types of “AI” are at their most basic simply pattern recognition engines. And they match your request with the pattern they have. Interesting. If I was to ask ChatGPT a specific question say produce a 250 word article on American progress in the 21st century in the style of Abraham Lincoln. And somebody else asked the same question, would they get an identical answer? If, after a period I asked the same question, would I get an identical answer? And if not, by what metric is ChatGPT tailoring it’s answers? ---
**Author:** ![octopus](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/octopus/32/3716_2.png) [@octopus](https://boards.straightdope.com/u/octopus)\ **Post date:** [May 31, 2023, 4:52am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/17 "2023-05-31T04:52:55Z")
As I understand the implementation of what the LLM AIs released to the public to be I wouldn’t really classify them as being able to learn to the extent that we humans do. The main difference that I perceive is that we can create novel categories and models of the world. I think implementing sensors and flexible enough programming so that the models can interact with the world, get feedback on decisions, and generate novel models would move them closer to what we do. I think the feedback and training of the model is definitely a form of learning. ---
**Author:** ![Max\_S](https://avatars.discourse-cdn.com/v4/letter/m/46a35a/32.png) [@Max\_S](https://boards.straightdope.com/u/Max_S)\ **Post date:** [May 31, 2023, 9:38am UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/18 "2023-05-31T09:38:02Z")
> [@Left\_Hand\_of\_Dorkness](#): > > An adult learns how to play guitar. This is interesting. Of course, an adult can learn how to play a particular song on guitar. I would say an adult can learn how to make a guitar produce a certain noise. A person can learn how to tell whether the noise they are making on the guitar fits with a song (i.e. learning consonance versus dissonance for a particular musical style). But a typical machine (like a guitar tuner, or guitar tutor computer program), which has the ability to tell if a noise is equivalent in pitch to another, never learned consonance and dissonance. The rules to determine which sensory inputs are “acceptable” are built into the machine for a preset number of scales, not learned. > [@Left\_Hand\_of\_Dorkness](#): > > And, as I understand it, large language models don’t work anything like that. They have an enormous database of words, and they know which words most often appear after other words; but that doesn’t involve building concept clusters around the meaning of those words. How LLM AI specifically operates, or whether it is capable of composition, I don’t know. I can, however, opine on what you’ve written. Having access to lots of sentences and taking note of which words frequently appear together does not _necessarily_ involve building concept clusters around the meaning of those words, but it certainly _could_. It’s a necessary step in learning how to recognize phrases. I think most babies learn intonation, then semantics, then grammar, but that doesn’t necessarily mean that’s the only way to learn. An illiterate person could, theoretically, learn _something_ about grammar by mechanically: 1. Pulling down a library book. 2. Tallying every word that appears in the book, as well as every combination of words. 3. Writing down a mandatory, positive, and negative rule for every possible combination of words, provided each rule is only ever written once. - B must follow A (mandatory) - B may follow A (positive) - B must not follow A (negative) 4. Writing down a numerical “weight” for every rule, equal to the tally of consistent word combinations less the tally of inconsistent word combinations. If a rule already has a weight, the existing number is crossed out and added to the new number. 5. Repeating steps 1-4 for an arbitrary number of books. 6. Writing down whether each rule is “valid” or “invalid” based on whether the ratio of the rule’s weight to B’s appearances meets an arbitrary threshold. 7. Writing down all combinations of valid positive rules that share the same subject (B) or object (A). 8. Writing down all valid negative rules that share the same subject (B) or object (A). 9. Writing down a new positive or negative rule for each combination from steps 7 and 8, with a multiple-choice subject or object as appropriate, and a weight as per step 4. - B1 or B2 or … Bn may follow A (positive) - B may follow A1 or A2 or … An (positive) - B1 or B2 or … Bn must not follow A (negative) - B must not follow A1 or A2 or … An (negative) Take the second option from the last bullet point list… eventually, he’ll have a rule that says any one of these singular nouns can follow any one of these singular adjectives, or the reverse in other languages like Spanish. There are better ways to weigh rules for usefulness and more steps to recognize more types of rules. I also ignored things like sentence structure and how to tell where words begin and end. This illiterate person won’t become literate, and won’t know what the words _mean_ without somehow associating words with sensory experience (sight, sound, equilibrioception [sense of balance], touch, smell, taste, chronoception [sense of time]). There has to be a common frame of reference to successfully communicate. The same goes for a machine. The rules being learned about the given language are - so far as I can tell - analogous to the rules of consonance and dissonance for a given musical style. You can learn how to tell what fits and what doesn’t without learning meaning, and it’s still learning. ~Max ---
**Author:** ![JKellyMap](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/jkellymap/32/15880_2.png) [@JKellyMap](https://boards.straightdope.com/u/JKellyMap)\ **Post date:** [May 31, 2023, 12:30pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/19 "2023-05-31T12:30:35Z")
> [@Buck\_Godot](#): > > . In an IA the output an an emergent property of the gestalt of their inputs subtly influencing each other and arriving at correct responses might not explicitly match any of their direct experiences. I would say that a definition of learning that excludes this is overly restrictive. > > Where I would draw the line is does it “understand” what its learned. This sounds right to me (I’m no expert). ---
**Author:** ![Cheesesteak](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cheesesteak/32/3694_2.png) [@Cheesesteak](https://boards.straightdope.com/u/Cheesesteak)\ **Post date:** [May 31, 2023, 1:16pm UTC](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778/20 "2023-05-31T13:16:54Z")
> [@penultima\_thule](#): > > And somebody else asked the same question, would they get an identical answer? Likely not, I asked ChatGPT to write me a story about a flying shoebox, and hit the “regenerate response” button a couple of times. I got 3 stories about flying shoeboxes, all different. Different themes, different reasons the shoebox was flying, all internally consistent, if vapid, stories. Is a better word “trained”? As in the LLM didn’t learn how to write things, it was trained to write things. It’s doing a great deal more than simply playing a downloaded song, or regurgitating someone else’s text. It’s applying complex contextual rules to the generation of new text, rules that the LLM developed via its analysis of large volumes of text. It’s different from a speak and spell because it wasn’t programmed with rules on how to write things, it was programmed to create it’s own writing rules without direct human intervention. [Next page](https://boards.straightdope.com/t/large-language-model-ai-doesnt-learn/984778.md?page=2)