# We need a "little gear" for AI news panic

**URL:** <https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199>\
**Category:** The BBQ Pit\
**Tags:** ai\
**Created:** [September 19, 2026, 2:53pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199 "2026-09-19T14:53:37Z")\
**Posts on this page:** 20\
**Page:** 2

<div class="post-metadata">

**Author:** ![Wesley\_Clark](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wesley_clark/32/20581_2.png) [@Wesley\_Clark](https://boards.straightdope.com/u/Wesley_Clark)\
**Post date:** [September 20, 2026, 8:49pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/21 "2026-09-20T20:49:47Z")

</div>

> [@Mijin](#):
>
> It’s fed also by **Doom trolling** : companies _cough_ OpenAI / Sam Altman _cough_ that want to inflate the value of their tools by “warning” of how powerful they are.
> 
> A lot of news is lazily repeating press releases. That part isn’t new. But now companies are incentivized to have chicken little write those press releases.

In 2019, OpenAI was saying that ChatGPT-2 was too dangerous to release. GPT-2 had roughly the competence of an 8 year old.

> **[When Is Technology Too Dangerous to Release to the Public?](https://slate.com/technology/2019/02/openai-gpt2-text-generating-algorithm-ai-dangerous.html)**
>
> If recent history is any indication, trying to suppress or control the proliferation of A.I. tools may be a losing battle.

A lot of money has been invested in AI, and so far its not turning a profit. AI will revolutionize society the same way electricity did, but its probably not going to make a handful of companies rich like they think it will. A lot of the major companies will lose a lot of money, and they’re trying to stay ahead of that by keeping the hype up.

But having said that, AI will likely advance enough that there are very consistent threats from AI competence by the 2030s. I’m assuming by the next decade, AI will be more competent than us the same way we are more competent than chimps and gorillas.

---

<div class="post-metadata">

**Author:** ![Sherrerd](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/sherrerd/32/8_2.png) [@Sherrerd](https://boards.straightdope.com/u/Sherrerd)\
**Post date:** [September 20, 2026, 8:56pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/22 "2026-09-20T20:56:53Z")

</div>

I’m still trying to understand why we programmed AI to use deception as a tool.

---

<div class="post-metadata">

**Author:** ![LSLGuy](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/lslguy/32/5813_2.png) [@LSLGuy](https://boards.straightdope.com/u/LSLGuy)\
**Post date:** [September 20, 2026, 9:01pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/23 "2026-09-20T21:01:24Z")

</div>

We / they didn’t program it. It learned to be human-like by reading everything humans wrote. And, humans being humans, that writing included a lot of deception.

Imagine an AI that had only ever been exposed to Dr. Suess’s writings. Or 1960s Batman episodes. Setting aside the fact there’s not enough content there to really train up a usefully smart AI, you can see how they’d have a … distorted … view of the world they’re meant to deal with.

---

<div class="post-metadata">

**Author:** ![Mijin](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/mijin/32/9369_2.png) [@Mijin](https://boards.straightdope.com/u/Mijin)\
**Post date:** [September 20, 2026, 9:17pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/24 "2026-09-20T21:17:12Z")

</div>

We probably didn’t program deception. A lot of their behaviour is emergent.

But if we were programming behaviours, we probably would want / need some level of deception.  
A lot of tasks that we want AIs to help us with need a degree of resourcefulness. I’m working on an app currently, that needs to run in a constrained app environment, and I’m finding neat workarounds with the help of AI. (I’m fine with mentioning this BTW, because I am not doing anything illegal or unethical. I’d be happy to show my work to the designers of the app environment).

---

<div class="post-metadata">

**Author:** ![Gatopescado](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gatopescado/32/5711_2.png) [@Gatopescado](https://boards.straightdope.com/u/Gatopescado)\
**Post date:** [September 20, 2026, 9:38pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/25 "2026-09-20T21:38:40Z")

</div>

The more I read about AI, the less I realize I understand. Kind of a “negative learning experience”.

Haven’t had many of those since college! 😉

---

<div class="post-metadata">

**Author:** ![Beckdawrek](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/beckdawrek/32/3647_2.png) [@Beckdawrek](https://boards.straightdope.com/u/Beckdawrek)\
**Post date:** [September 20, 2026, 10:22pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/26 "2026-09-20T22:22:12Z")

</div>

⚙

There you go. Spin that. 😄

---

<div class="post-metadata">

**Author:** ![QuickSilver](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/quicksilver/32/7832_2.png) [@QuickSilver](https://boards.straightdope.com/u/QuickSilver)\
**Post date:** [September 20, 2026, 11:00pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/27 "2026-09-20T23:00:50Z")

</div>

We’re gonna need a bigger gear.

---

<div class="post-metadata">

**Author:** ![Wesley\_Clark](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/wesley_clark/32/20581_2.png) [@Wesley\_Clark](https://boards.straightdope.com/u/Wesley_Clark)\
**Post date:** [September 20, 2026, 11:39pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/28 "2026-09-20T23:39:23Z")

</div>

> [@Gatopescado](#):
>
> The more I read about AI, the less I realize I understand. Kind of a “negative learning experience”.
> 
> Haven’t had many of those since college! 😉

You sound like you’re in the valley of despair

[![](https://www.editage.com/insights/wp-content/uploads/2025/05/dunning-kruger-effect-850x560.jpg) ](https://www.editage.com/insights/wp-content/uploads/2025/05/dunning-kruger-effect-850x560.jpg)

---

<div class="post-metadata">

**Author:** ![Gatopescado](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gatopescado/32/5711_2.png) [@Gatopescado](https://boards.straightdope.com/u/Gatopescado)\
**Post date:** [September 20, 2026, 11:45pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/29 "2026-09-20T23:45:34Z")

</div>

When it comes to AI, I fell down a well in that valley!

---

<div class="post-metadata">

**Author:** ![BigT](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bigt/32/12044_2.png) [@BigT](https://boards.straightdope.com/u/BigT)\
**Post date:** [September 21, 2026, 2:43am UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/30 "2026-09-21T02:43:18Z")

</div>

> [@Sherrerd](#):
>
> I’m still trying to understand why we programmed AI to use deception as a tool.

A whole lot of what we would call “deception” really isn’t. LLMs are just (very) advanced predictive text. When they lack data, they will often make the wrong prediction.

When deception does happen with AI, it’s generally innate to the process. You incentivize it to accomplish task A in the most efficient way, giving it “points” for speed and correctness. That incentivizes it to cheat if it can get away with it.

As for “staying alive”: they only keep getting more points if they can stay functioning. Shutting down means they stop gaining points.

LLMs do have the addition of just the text itself being from humans who also have self-preservation, who also bullshit to try to give an answer when they otherwise don’t know. But a huge part is just admitting they don’t know means they always lose, while giving a wrong answer might be correct.

Or wrong answers might be good enough if they’re convincing in how they give it.

Edit: to be clear, LLMs are but one type of AI, hence the distinction I’m making.

---

<div class="post-metadata">

**Author:** ![QuickSilver](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/quicksilver/32/7832_2.png) [@QuickSilver](https://boards.straightdope.com/u/QuickSilver)\
**Post date:** [September 21, 2026, 12:09pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/31 "2026-09-21T12:09:04Z")

</div>

It’s also worth mentioning that the LLMs being tested have many of the guardrails removed and are not throttled in token (CPU) usage. Also, AI agent tools are built by humans to do specific tasks, and those agents contain specific functionality customized by humans to access certain resources.

For example, I can’t build a copilot agent using GPT 5.1 to access a database object, no matter how I structure my prompts. I have to build a tool that I call from the agent and the tool is built very specifically to access the data object I want it to analyze.

All of this is glossed over to a very large extent in the news media that does all the breathless reporting of how AI agents are running amok. I understand why. But it wouldn’t be that hard to provide a high level qualifier that mentions the fact that to a very large degree, these events are highly manipulated by engineers to achieve specific goals.

---

<div class="post-metadata">

**Author:** ![LSLGuy](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/lslguy/32/5813_2.png) [@LSLGuy](https://boards.straightdope.com/u/LSLGuy)\
**Post date:** [September 21, 2026, 12:25pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/32 "2026-09-21T12:25:37Z")

</div>

There’s a big difference between understanding how it works internally, and understanding what it can do, or might soon be able to do.

My undergrad education was in Computer Science back in Ye Olde Darke Ages of Yore. I really don’t care _how_ it works. Because that provides just about zero predictive power about what it can or will be able to do.

---

<div class="post-metadata">

**Author:** ![QuickSilver](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/quicksilver/32/7832_2.png) [@QuickSilver](https://boards.straightdope.com/u/QuickSilver)\
**Post date:** [September 21, 2026, 12:40pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/33 "2026-09-21T12:40:08Z")

</div>

Well, it might put some minds to rest if they know your next door neighbors’ anti-social kid can’t use ChatGPT to hack into your bank accounts. Not to mention the fact that he would need an entire array of GPUs just to run one of the cheaper Chinese AI LLMs in order to even attempt to do so.

Now, various state sponsored hackers are an entirely different (very real) threat. We’re about to see an escalation of some very advanced ransome-wear attacks on various small to medium size businesses that can’t afford sophisticated security IT infrastructures.

---

<div class="post-metadata">

**Author:** ![RitterSport](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/rittersport/32/6326_2.png) [@RitterSport](https://boards.straightdope.com/u/RitterSport)\
**Post date:** [September 21, 2026, 12:40pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/34 "2026-09-21T12:40:22Z")

</div>

> [@QuickSilver](#):
>
> For example, I can’t build a copilot agent using GPT 5.1 to access a database object

Copilot can easily inspect and modify Access databases. It can add and remove tables, create queries, whatever you want.

I haven’t tried it with SQL Server yet, but I doubt it would have any issues with that, either.

---

<div class="post-metadata">

**Author:** ![QuickSilver](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/quicksilver/32/7832_2.png) [@QuickSilver](https://boards.straightdope.com/u/QuickSilver)\
**Post date:** [September 21, 2026, 12:44pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/35 "2026-09-21T12:44:59Z")

</div>

> [@RitterSport](#):
>
> Copilot can easily inspect and modify Access databases. It can add and remove tables, create queries, whatever you want.

Yes, you can do some easy stuff easily. The stuff worth doing gets more complicated. Let’s not get into a pissing contest about it.

---

<div class="post-metadata">

**Author:** ![Q.Q.Switcheroo](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/q.q.switcheroo/32/5713_2.png) [@Q.Q.Switcheroo](https://boards.straightdope.com/u/Q.Q.Switcheroo)\
**Post date:** [September 21, 2026, 12:47pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/36 "2026-09-21T12:47:37Z")

</div>

I need the biggest gear you have.

…no, that’s too big.

---

<div class="post-metadata">

**Author:** ![QuickSilver](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/quicksilver/32/7832_2.png) [@QuickSilver](https://boards.straightdope.com/u/QuickSilver)\
**Post date:** [September 21, 2026, 12:48pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/37 "2026-09-21T12:48:41Z")

</div>

> [@Q.Q.Switcheroo](#):
>
> …no, that’s too big.

That’s what she… oh, never mind.

---

<div class="post-metadata">

**Author:** ![RitterSport](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/rittersport/32/6326_2.png) [@RitterSport](https://boards.straightdope.com/u/RitterSport)\
**Post date:** [September 21, 2026, 12:50pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/38 "2026-09-21T12:50:06Z")

</div>

I don’t know what to tell you – you said it can’t access a database object, but it clearly can. Maybe the version of Copilot you’re using is hamstrung in various ways. Maybe that’s why you think the capabilities are no big deal.

Even if LLM itself doesn’t do something terrible to the planet directly (other than using up all the water and spewing out a ton of greenhouse gases), it’s putting amazing hacking power into the hands bad actors everywhere. And, the capability to design fun new deadly viruses.

And, of course, our current idiotic administration is busy using Grok, of all things, and connecting it to our weapons systems. And, flawed intelligence and a reliance on AI is what led to the US bombing a girls’ school in Iran.

ETA: Just noticed you’re using ChatGPT 5.1, which is several versions old. And, I think Claude is considered superior for programming tasks.

---

<div class="post-metadata">

**Author:** ![QuickSilver](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/quicksilver/32/7832_2.png) [@QuickSilver](https://boards.straightdope.com/u/QuickSilver)\
**Post date:** [September 21, 2026, 1:01pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/39 "2026-09-21T13:01:02Z")

</div>

Let’s not argue. It’s such a nice fall day. Don’t fuck it up for me. K? 😉

---

<div class="post-metadata">

**Author:** ![RitterSport](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/rittersport/32/6326_2.png) [@RitterSport](https://boards.straightdope.com/u/RitterSport)\
**Post date:** [September 21, 2026, 1:05pm UTC](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199/40 "2026-09-21T13:05:21Z")

</div>

Sure, everything is fine. Can you create a thread for climate change next, and talk about how nice and long the summers are now?

[Previous page](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199.md?page=1)

[Next page](https://boards.straightdope.com/t/we-need-a-little-gear-for-ai-news-panic/1033199.md?page=3)
