Is AI overhyped?

I’m not sure if you meant 3kHz to 3Ghz (which would be a million times improvement), but in 1980, the 6502 microprocessor, for example, was running at 1MHz, so more like 1,000 faster (just in terms of clock speed – many more times in terms of overall speed). Even Eniac was running at 100kHz.

I like the idea of a computer running at 3Hz – maybe moving abacus beads or something.

Anyway, back to whether AI is overhyped.

Woops, I’ve made a huge mistake. You are correct, I meant Mhz and it is indeed 1000 times, not 1,000,000 times. Shame on me for not noticing an error of 3 orders of magnitude.

Last year I was working on a proposal and one of our consultants used ChatGPT to create a lot of the responses. I still had to go through and revise a bunch of nonsense that sounded kind of legit (and replace it with my own nonsense that sounded kind of legit).

I looked in my LGP21 manual - a computer from 1962, a transistorized version of the LGP30 from 1956. Though it doesn’t give a clock rate, the fastest instructions, Bring, Add, etc, take 7.26 msec - that’s milli, not micro. Multiplies and divides take 58.11 msec. But the memory of this thing was a rotating disk, not core, so the time was very dependent on how close the operand was on disk from the instruction. Jumps took 1.59 msec. I doubt anyone ever ran any benchmarks on this thing, but it looks like it would be well under 0.1 MIPS.
So that’s a better starting point than 1980, when we actually had microprocessors.

Maybe but it seems there is a long way to go. AI may be killing itself right now.

Interest in artificial intelligence continues to surge, as Google searches over the past 12 months are at 92% of their all-time peak, but recent research suggests AI’s success could be its downfall. Amid the growth of AI content online, a group of researchers at Cambridge and Oxford universities set out to see what happens when generative AI tools query content produced by AI. What they found was alarming.

The short version is it seems to be the copy of a copy of a copy problem from photocopiers.

When most of the content online is AI generated then the next bit of content is AI generated from AI generated stuff. And so on. This does not end well and we need to figure a solution for that.

Heh heh heh.

I dunno if AI in general is overhyped, but I know WAY too many people have decided to actually trust ChatGPT to answer questions and write things for them. Things it is… not good at.

I thought I’d ask it a few questions.

  1. Who are the all time leaders in career home runs by a Toronto Blue Jay?

ChatGPT replied:

As of the end of the 2023 MLB season, the all-time leaders in career home runs for the Toronto Blue Jays are:

1 - José Bautista - 288 home runs
2 - Edwin Encarnación - 239 home runs
3 - Carlos Delgado - 204 home runs
4 - Vladimir Guerrero Jr. - 124 home runs (note: this number will continue to grow as he is an active player)
5 - John Olerud - 200 home runs

This is wildly wrong.

  1. What are the lyrics to Lisa Loeb’s “Stay?”

I won’t reprint its entire answer, but it was almost completely wrong.

  1. What are the lyrics to The Tragically Hip’s “Nautical Disaster”?

It just repeated the line “I had a good life before I went down” 21 times. That isn’t a line in the song at all.

  1. How many elements are there in ISO 9001?

It said 10. That’s an understandable answer, but wrong. There are eleven, but they’re numbered 0 to 10.

  1. What are the ten largest cities in Canada, by population?

Absolutely blew this one. It SEEMED to start off wanting to do this by true city limits population, but then provided them all out of order and started doing metro populations and then at the end called “Kitchener-Waterloo-Cambridge” one city.

I mean, these are questions where the exact answer can be found in list form in a million places; no real intelligence is needed at all, and it got them ALL wrong.

Try it on another service. Bing’s Copilot gets the all time home run leaders right. Google’s Gemini gets it right, too. Claude misses number five with George Bell instead of Joe Carter. I no longer have access to the newest Chat GPT, but I’m curious if it does better. I didn’t try the other questions, but get a sense of all the AIs to fairly evaluate AI in general.

Many AIs will not reprint lyrics due to copyright, and should say so, but some just hallucinate them for some odd reason. Claude, for example, refuses to do so. Copilot gives a few lines and then a link to where you can find full lyrics.

Just curious which ChatGPT version did you use @RickJay?

ChatGPT 4o gave me a better answer than yours:

  • Carlos Delgado - 336 home runs
  • José Bautista - 288 home runs
  • Edwin Encarnación - 239 home runs
  • Vernon Wells - 223 home runs
  • George Bell - 202 home runs

I asked if it forgot Joe Carter and got an updated version:

  • Carlos Delgado - 336 home runs
  • José Bautista - 288 home runs
  • Edwin Encarnación - 239 home runs
  • Vernon Wells - 223 home runs
  • Joe Carter - 203 home runs
  • George Bell - 202 home runs

May I introduce a new law:
In an online debate, when someone introduces data from an AI to support their position, they’ve lost.

Used that on Quora where someone did this.