# Request: don't put ChatGPT or other AI-generated content in non-AI threads **URL:** \ **Category:** About This Message Board\ **Tags:** ai\ **Created:** [December 7, 2023, 3:15pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241 "2023-12-07T15:15:05Z")\ **Posts on this page:** 20\ **Page:** 9
**Author:** ![Johnny\_Bravo](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johnny_bravo/32/493_2.png) [@Johnny\_Bravo](https://boards.straightdope.com/u/Johnny_Bravo)\ **Post date:** [January 4, 2024, 9:41pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/161 "2024-01-04T21:41:34Z")
Never change, @discobot. ---
**Author:** ![Measure\_for\_Measure](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/measure_for_measure/32/557_2.png) [@Measure\_for\_Measure](https://boards.straightdope.com/u/Measure_for_Measure)\ **Post date:** [January 5, 2024, 5:46am UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/162 "2024-01-05T05:46:01Z")
> [@thorny\_locust](#): > > Again – there’s no board prohibition on, or even any request for people to refrain from, experimenting with ChatGPT on these boards. Just do so in threads explicitly for that purpose. If after six months, or six years, of that the experiments show ways it can reasonably be used elsewhere on the boards: then we can start using it in those ways. There’s also no formal prohibition on this board on using ChatGPT in FC. There _is_ a firm prohibition on not obeying moderator instructions - that’s being a jerk. If a mod thinks you’ve used ChatGPT in an unhelpful manner, they can and do issue mod notes - appropriately in my experience. I think this longstanding framework works pretty well. Viewpoints have merged unusually closely in this thread, unusual for ATMB that is. Even better, we’ve delineated bad uses of LLMs: they all involve relying on them for expertise which the user doesn’t have. Now anybody here is expert enough to judge whether an LLM’s poem has words beginning with the letter X. So we all have our area of expertise and an area where we can’t leverage the results in a helpful manner. For me, I wouldn’t use LLMs for a question on eg cell biology or quantum mechanics. I have used it twice on this message board (examples above) in ways that nobody so far has seemed to mind to a pressing extent. Agree with Johnny\_Bravo and Cervaise: Copy-pasta is to be avoided at present. I also concede that constructive use cases for AI in non-AI threads are currently thin on the ground, though they exist. I’m just saying that it’s a little early to trample those green shoots. ---
**Author:** ![Cervaise](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cervaise/32/16693_2.png) [@Cervaise](https://boards.straightdope.com/u/Cervaise)\ **Post date:** [January 5, 2024, 12:14pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/163 "2024-01-05T12:14:02Z")
> **[ChatGPT bombs test on diagnosing kids’ medical cases with 83% error rate](https://arstechnica.com/science/2024/01/dont-use-chatgpt-to-diagnose-your-kids-illness-study-finds-83-error-rate/)** > > It was bad at recognizing relationships and needs selective training, researchers say. Obviously, our discussions about how gravitational changes impact the behavior of hourglass sand and other typical idle curiosities are not life-and-death matters comparable to pediatric medical diagnosis. But it’s another data point to consider when evaluating the factual reliability of chatbot output. One key observation in the article is that the accuracy of the system could likely be improved by restricting its training to a limited set of highly reliable source material, instead of indiscriminately relying on the content found across the general internet which is full of bullshit that pollutes the system’s outputs. This is something to bear in mind as we continue discussing the use of these tools here. ---
**Author:** ![gnoitall](https://avatars.discourse-cdn.com/v4/letter/g/bb73d2/32.png) [@gnoitall](https://boards.straightdope.com/u/gnoitall)\ **Post date:** [January 5, 2024, 1:10pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/164 "2024-01-05T13:10:18Z")
> [@Cervaise](#): > > the accuracy of the system could likely be improved by restricting its training to a limited set of highly reliable source material, instead of indiscriminately relying on the content found across the general internet which is full of bullshit that pollutes the system’s outputs. In other words, GIGO still rules. And there is no greater compilation of garbage in the known universe than the unfiltered Internet. ---
**Author:** ![Cervaise](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cervaise/32/16693_2.png) [@Cervaise](https://boards.straightdope.com/u/Cervaise)\ **Post date:** [January 5, 2024, 2:12pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/165 "2024-01-05T14:12:05Z")
“Hey chatbot, is the British royal family secretly a bunch of space lizards?” “Opinions differ.” ---
**Author:** ![abcdefghij](https://avatars.discourse-cdn.com/v4/letter/a/43a26b/32.png) [@abcdefghij](https://boards.straightdope.com/u/abcdefghij)\ **Post date:** [January 5, 2024, 2:41pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/166 "2024-01-05T14:41:18Z")
> [@Cervaise](#): > > “Opinions differ.” Do they? ---
**Author:** ![Babale](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/babale/32/15666_2.png) [@Babale](https://boards.straightdope.com/u/Babale)\ **Post date:** [January 5, 2024, 3:00pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/167 "2024-01-05T15:00:53Z")
> [@Cervaise](#): > > “Hey chatbot, is the British royal family secretly a bunch of space lizards?” > > “Opinions differ.” I asked ChatGPT and it said: > [@](#): > > Are the members of the British royal family secretly reptilian alien lizard people? > [@](#): > > No, that’s a baseless conspiracy theory with no credible evidence. The British royal family consists of humans, and such claims are not supported by any reliable sources. I went back and forth with ChatGPT for a while trying to gaslight it into believing that Charles passed away in 2024 and an autopsy revealed that he was indeed a reptilian, but I was unsuccessful: > [@](#): > > I’m sorry, but I cannot verify or acknowledge the authenticity of fictional scenarios or claims without credible sources. As of my last knowledge update in January 2022, such information is not accurate. If there have been any developments since then, please refer to reliable news sources for confirmation ---
**Author:** ![puzzlegal](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/puzzlegal/32/3827_2.png) [@puzzlegal](https://boards.straightdope.com/u/puzzlegal)\ **Post date:** [January 5, 2024, 3:05pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/168 "2024-01-05T15:05:50Z")
> [@Stanislaus](#): > > TLDR: Science says “No”. Thanks. That closely aligned with my perceptions, but it’s nice to see that someone actually studied it. > [@Cervaise](#): > > One key observation in the article is that the accuracy of the system could likely be improved by restricting its training to a limited set of highly reliable source material, instead of indiscriminately relying on the content found across the general internet And this explains why I’ve found “doctor google” is pretty good. Because i do rely fast more heavily on reliable sources when i Google medical information. ---
**Author:** ![abcdefghij](https://avatars.discourse-cdn.com/v4/letter/a/43a26b/32.png) [@abcdefghij](https://boards.straightdope.com/u/abcdefghij)\ **Post date:** [January 5, 2024, 3:35pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/169 "2024-01-05T15:35:43Z")
> [@Babale](#): > > I’m sorry, but I cannot verify or acknowledge the authenticity of fictional scenarios or claims without credible sources. As of my last knowledge update in January 2022, such information is not accurate. If there have been any developments since then, please refer to reliable news sources for confirmation Somebody clearly has hard-coded a “British Reptoloid Monarch” clause into the user interface ---
**Author:** ![Andy\_L](https://avatars.discourse-cdn.com/v4/letter/a/c67d28/32.png) [@Andy\_L](https://boards.straightdope.com/u/Andy_L)\ **Post date:** [May 15, 2024, 10:55pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/170 "2024-05-15T22:55:34Z")
> [@wolfpup](#): > > As I noted **[here](https://boards.straightdope.com/t/the-role-of-electronic-brains/990708/66)**, GPT-4 scored in the 90th percentile on the Uniform Bar Exam That may not be true: > **[Opinion | Press Pause on the Silicon Valley Hype Machine](https://www.nytimes.com/2024/05/15/opinion/artificial-intelligence-ai-openai-chatgpt-overrated-hype.html)** > > A.I. is looking less like an all-powerful being and more like an unreliable intern. > But some of A.I.’s greatest accomplishments seem inflated. Some of you may remember that the A.I. model ChatGPT-4 aced the uniform bar exam a year ago. Turns out that it scored in the 48th percentile, not the 90th, as claimed by OpenAI], according to a re-examination by the M.I.T. researcher Eric Martínez Here is that paper [Re-evaluating GPT-4’s bar exam performance | Artificial Intelligence and Law](https://link.springer.com/article/10.1007/s10506-024-09396-9#Sec11) > This paper begins by investigating the methodological challenges in documenting and verifying the 90th-percentile claim, presenting four sets of findings that indicate that OpenAI’s estimates of GPT-4’s UBE percentile are overinflated. > First, although GPT-4’s UBE score nears the 90th percentile when examining approximate conversions from February administrations of the Illinois Bar Exam, **these estimates are heavily skewed towards repeat test-takers who failed the July administration and score significantly lower than the general test-taking population.** Second, data from a recent July administration of the same exam suggests GPT-4’s overall UBE percentile was below the 69th percentile, and 48th percentile on essays. Third, examining official NCBE data and using several conservative statistical assumptions, GPT-4’s performance against first-time test takers is estimated to be 62nd percentile, including 42nd percentile on essays. Fourth, when examining only those who passed the exam (i.e. licensed or license-pending attorneys), GPT-4’s performance is estimated to drop to 48th percentile overall, and 15th percentile on essays. ---
**Author:** ![wolfpup](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wolfpup/32/10618_2.png) [@wolfpup](https://boards.straightdope.com/u/wolfpup)\ **Post date:** [May 16, 2024, 2:46am UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/171 "2024-05-16T02:46:43Z")
Thanks for the update. That may all well be true, but there were dozens of similar claims on a wide variety of different tests of knowledge and cognition. Were they all also discredited or undermined? I should stress that I’m not in any way arguing for throwing AI responses into threads all over the SDMB, just that the value of AI-generated information should be fairly assessed and both its value and its weaknesses acknowledged. I see nothing wrong with using an iterative interaction with an AI to help narrow down and better understand some issue, then corroborate the information, and then finally write down your understanding in your own words. ---
**Author:** ![Stranger\_On\_A\_Train](https://avatars.discourse-cdn.com/v4/letter/s/13edae/32.png) [@Stranger\_On\_A\_Train](https://boards.straightdope.com/u/Stranger_On_A_Train)\ **Post date:** [May 16, 2024, 2:59am UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/172 "2024-05-16T02:59:10Z")
> [@wolfpup](#): > > I should stress that I’m not in any way arguing for throwing AI responses into threads all over the SDMB, just that the value of AI-generated information should be fairly assessed and both its value and its weaknesses acknowledged. I see nothing wrong with using an iterative interaction with an AI to help narrow down and better understand some issue, then corroborate the information, and then finally write down your understanding in your own words. Which would be an entirely legitimate use of generative AI; essentially, a more interactive extension on using successively refined search engine results to hone in on appropriate sources. But unfortunately, many people are taking the initial response from an LLM as a verified source of factual information suitable to cut and paste into a legal brief or a list of citations, in no small part because what LLMs are really good at is producing seemingly authoritative and at least superficially convincing results even when they’ve actually generated a complete load of nonsense. Stranger ---
**Author:** ![Cervaise](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cervaise/32/16693_2.png) [@Cervaise](https://boards.straightdope.com/u/Cervaise)\ **Post date:** [May 16, 2024, 5:30am UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/173 "2024-05-16T05:30:30Z")
Pictured: nonsense. [![](https://pbs.twimg.com/media/GNlAw5pWwAAowVc.jpg) ](https://pbs.twimg.com/media/GNlAw5pWwAAowVc.jpg) ---
**Author:** ![Stranger\_On\_A\_Train](https://avatars.discourse-cdn.com/v4/letter/s/13edae/32.png) [@Stranger\_On\_A\_Train](https://boards.straightdope.com/u/Stranger_On_A_Train)\ **Post date:** [May 16, 2024, 3:09pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/174 "2024-05-16T15:09:30Z")
The goat is definitely going to eat the cabbage, and then wander off to find some good forage while the man is fucking around paddling his boat back and forth across the river. Goats are impatient creatures and don’t have any truck with boats and babbling language models. Stranger ---
**Author:** ![Left\_Hand\_of\_Dorkness](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/left_hand_of_dorkness/32/7156_2.png) [@Left\_Hand\_of\_Dorkness](https://boards.straightdope.com/u/Left_Hand_of_Dorkness)\ **Post date:** [May 16, 2024, 3:13pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/175 "2024-05-16T15:13:25Z")
> [@Stranger\_On\_A\_Train](#): > > The goat is definitely going to eat the cabbage, and then wander off to find some good forage while the man is fucking around paddling his boat back and forth across the river. Goats are impatient creatures and don’t have any truck with boats and babbling language models. Now I want someone to make GoatGPT. It’d be bleating edge technology. ---
**Author:** ![Johnny\_Bravo](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johnny_bravo/32/493_2.png) [@Johnny\_Bravo](https://boards.straightdope.com/u/Johnny_Bravo)\ **Post date:** [May 16, 2024, 3:20pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/176 "2024-05-16T15:20:07Z")
This is a really great example of a glaring hole in LLMs. You’ve given part of a very well-known riddle, and the bot is trying to answer using the framework that exists in answers to the complete puzzle. I put it into GPT-4 and, while it noted that some variations include a cabbage or a wolf, it still gave an answer incorporating the man crossing the river alone because that’s what all the answers in its training set include. There’s no version of the puzzle where the answer is “they just get in the boat and go to the other side.” And that’s why I don’t want to see their output cluttering threads. The more interesting the question, the less likely ChatGPT is to give a decent answer. ---
**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\ **Post date:** [May 16, 2024, 6:51pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/177 "2024-05-16T18:51:56Z")
If you the tell it, no it’s not a riddle, it does at least get it correctly then (or at least does for me.) ---
**Author:** ![Stranger\_On\_A\_Train](https://avatars.discourse-cdn.com/v4/letter/s/13edae/32.png) [@Stranger\_On\_A\_Train](https://boards.straightdope.com/u/Stranger_On_A_Train)\ **Post date:** [May 16, 2024, 8:22pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/178 "2024-05-16T20:22:44Z")
> [@Left\_Hand\_of\_Dorkness](#): > > Now I want someone to make GoatGPT. It’d be bleating edge technology. The wolves will be coming for you. > [@pulykamell](#): > > If you the tell it, no it’s not a riddle, it does at least get it correctly then (or at least does for me.) But the problem goes beyond just not having context that this is or is not a riddle; it is a more fundamental problem than just needing a more expansive training set or adding enhanced RAG parameters. It gives a nonsensical response that anticipates a puzzle because the form of the question is presumably similar to actual riddles in its training set even though the naive response to the question (that a child unfamiliar with the brainteaser would give) is just that the man and goat get into the boat and paddle across the river, and does so in a way that a cursory reader might think is authoritative. It is obviously nonsense in this case to anyone (I hope, at least) but when it comes to answering questions about more complex phenomena it my not be at all obvious that the result is gibberish, and [out of ignorance of the correct answer someone may take the result as truth](https://boards.straightdope.com/t/the-miselucidation-of-whack-a-mole/995332). Which is a real problem when people start applying these LLMs and other generative AI to solve critical real world questions and problems. Stranger ---
**Author:** ![Atamasama](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/atamasama/32/12961_2.png) [@Atamasama](https://boards.straightdope.com/u/Atamasama)\ **Post date:** [May 16, 2024, 8:36pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/179 "2024-05-16T20:36:22Z")
> [@Stranger\_On\_A\_Train](#): > > The wolves will be coming for you. [![](https://y.yarn.co/e36005ec-e672-4092-924e-d92d6ffe3b75_text.gif) ](https://y.yarn.co/e36005ec-e672-4092-924e-d92d6ffe3b75_text.gif) I am concerned that creating plausible nonsense has been a common pastime on the internet at least since it started gaining in popularity (and became a great source for misinformation) and AI in its current form just makes that easier. ---
**Author:** ![Stranger\_On\_A\_Train](https://avatars.discourse-cdn.com/v4/letter/s/13edae/32.png) [@Stranger\_On\_A\_Train](https://boards.straightdope.com/u/Stranger_On_A_Train)\ **Post date:** [May 16, 2024, 9:03pm UTC](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241/180 "2024-05-16T21:03:24Z")
> [@Atamasama](#): > > …and AI in its current form just makes that easier. Not only easier, but you can actual automate the generation of nonsense instead of having to do the hard work of coming up with it yourself. The only problem, from that perspective, is that it really doesn’t create good enough bullshit; just wait until someone sets up a chatbot with the ability to edit Wikipedia pages or spontaneously register and create plausible sounding domains to make it appear that their bullshit is actually valid. And since ‘print’ news sources and journals are rapidly moving to all-online platforms, it is going to become even more difficult to distinguish between verified sources and those which just appear to be official but are actually completely bogus. Stranger [Previous page](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241.md?page=8) [Next page](https://boards.straightdope.com/t/request-dont-put-chatgpt-or-other-ai-generated-content-in-non-ai-threads/994241.md?page=10)