# Jeopardy! Champs vs. Computer

**URL:** <https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340>\
**Category:** Cafe Society\
**Created:** [February 14, 2011, 6:48pm UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340 "2011-02-14T18:48:59Z")\
**Posts on this page:** 20\
**Page:** 6

<div class="post-metadata">

**Author:** ![johnpost](https://avatars.discourse-cdn.com/v4/letter/j/f17d59/32.png) [@johnpost](https://boards.straightdope.com/u/johnpost)\
**Post date:** [February 16, 2011, 12:34am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/101 "2011-02-16T00:34:51Z")

</div>

> [@Raskolnikov](#):
>
> I call B.S. Somethings not right here. Watson rings in first almost every time. There was a stretch of like 20 questions where he did that. Don’t tell me Ken and Brad didn’t know alot of those answers either.

it has them rattled.

---

<div class="post-metadata">

**Author:** ![johnpost](https://avatars.discourse-cdn.com/v4/letter/j/f17d59/32.png) [@johnpost](https://boards.straightdope.com/u/johnpost)\
**Post date:** [February 16, 2011, 12:38am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/102 "2011-02-16T00:38:25Z")

</div>

> [@Bijou\_Drains](#):
>
> Watson does seem to have an advantage on the buzzer. I wonder how he knows when Trebek stops talking since he can’t hear?

a switch is thrown turning on a light when the answer is completed. that switch also signals Watson.

---

<div class="post-metadata">

**Author:** ![Kamino\_Neko](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kamino_neko/32/34_2.png) [@Kamino\_Neko](https://boards.straightdope.com/u/Kamino_Neko)\
**Post date:** [February 16, 2011, 12:47am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/103 "2011-02-16T00:47:02Z")

</div>

> [@Jas09](#):
>
> surely he was programmed to not answer with words in the clue itself.

One hopes not, as he was programmed to play a typical game of Jeopardy (or as typical as possible with his lack of sensory apparati), and clues occasionally do include at least part of the correct answer - there’s even a whole recurring category based on it (Stupid Answers).

---

<div class="post-metadata">

**Author:** ![mcgato](https://avatars.discourse-cdn.com/v4/letter/m/ac8455/32.png) [@mcgato](https://boards.straightdope.com/u/mcgato)\
**Post date:** [February 16, 2011, 1:22am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/104 "2011-02-16T01:22:57Z")

</div>

> [@Bijou\_Drains](#):
>
> Watson does seem to have an advantage on the buzzer. I wonder how he knows when Trebek stops talking since he can’t hear?

I’m a huge track and field geek, and I think that Watson was essentially false starting on all of those questions. After Watson ran about 15 questions, I turned it to something else.

In track, the sprinters are in the blocks and they receive the signal to start which is the starting gun. They have to process the sound, tell the muscles to move, and start moving. There are sensors in the starting blocks, and if the sprinter reacts to the gun in less than 0.100 seconds it is deemed a false start. The difference is calculated by sensors in the starting gun and in the starting blocks. That difference was determined through some research about how fast a human can physically react to a stimulus.

I’ve looked over lots of data from world championship and Olympic track meets, and rarely do sprinters react faster than 0.120 seconds. Sprinters do occasionally react at less than 0.110, but a quick statistical look at all reaction times clearly indicates that it is an outlier, and the sprinter had to have anticipated the gun. And gotten lucky.

Watson, though, can react to the stimulus in much less than 0.100 seconds since it is dealing with circuitry that is much, much faster than human reflexes. So the only hope that the humans had was to anticipate the end of the question and still somehow get in under the time that Watson takes to respond. I’m guessing that that is a window of less than 0.050 seconds. So if the human correctly anticipates the end of the question in a window of about 0.050 seconds, he would beat Watson to the buzzer. Otherwise, no.

---

<div class="post-metadata">

**Author:** ![Tangent](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tangent/32/3098_2.png) [@Tangent](https://boards.straightdope.com/u/Tangent)\
**Post date:** [February 16, 2011, 1:27am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/105 "2011-02-16T01:27:33Z")

</div>

There are also occasionally multiple choice clues. I remember a category called “Not a Current National Capital.” Each clue listed three cities and the correct response was one of the three. I would be interested to see how well Watson would do in a category like that. Would he understand the “not” immediately? If not, would he learn how to play the category after seeing what a couple of correct responses are?

Also, I was disappointed that there wasn’t a wordplay category. One category yesterday involved words with alternate meanings, but that’s pretty easy. I’d like to see Watson try a Rhyme Time category, or a “before and after” or something involving puns, or anagrams, or “5-syllable words.” For the more straightforward trivia questions, it really doesn’t surprise me at all that the computer can beat the humans.

I’m still waiting for John Connor to show up and blow Watson into a thousand pieces.

---

<div class="post-metadata">

**Author:** ![Bijou\_Drains](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bijou_drains/32/2814_2.png) [@Bijou\_Drains](https://boards.straightdope.com/u/Bijou_Drains)\
**Post date:** [February 16, 2011, 1:30am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/106 "2011-02-16T01:30:25Z")

</div>

Jeopardy has always been about reaction time as well as knowledge. Some smart people probably do badly due to slow reflexes. It’s a given that a computer has a super fast reaction time.

---

<div class="post-metadata">

**Author:** ![Finagle](https://avatars.discourse-cdn.com/v4/letter/f/b19c9b/32.png) [@Finagle](https://boards.straightdope.com/u/Finagle)\
**Post date:** [February 16, 2011, 1:37am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/107 "2011-02-16T01:37:04Z")

</div>

Yeah, I have to think that they need to do something about the button mashing issue. The humans just got shut out of something like 20 questions in a row and several were pretty easy, so the computer must have just timed the button press perfectly.

The computer was very, very impressive on the question answering, though.

---

<div class="post-metadata">

**Author:** ![Rucksinator](https://avatars.discourse-cdn.com/v4/letter/r/898d66/32.png) [@Rucksinator](https://boards.straightdope.com/u/Rucksinator)\
**Post date:** [February 16, 2011, 1:47am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/108 "2011-02-16T01:47:58Z")

</div>

I, for one, call BS on Watson being fed the questions by text. It’s not a real contest if he’s not using speech recognition.

I also call BS on the timing of buzzing in.

What I thought would be interesting (and it was way more than I thought) was how he would wager on Daily Doubles and Final Jeopardy. Since he would have extra time to process an answer, and since he gets 90+% correct, it would be logical to have him bet the max on DD and trivial to figure out the most to bet on FJ that wouldn’t cause him to loose. However, they apparently programmed him with an unnecessarily complicated formula… or a random amount. Since he was obviously programmed to win, I am really curious as to how he came up with the wagers that he did.

> [@Bijou\_Drains](#):
>
> I saw on another board where someone said the Toronto answer was a joke since he was so far ahead.

I doubt it was programmed that way.

---

<div class="post-metadata">

**Author:** ![Bijou\_Drains](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bijou_drains/32/2814_2.png) [@Bijou\_Drains](https://boards.straightdope.com/u/Bijou_Drains)\
**Post date:** [February 16, 2011, 1:53am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/109 "2011-02-16T01:53:28Z")

</div>

How could Watson think Toronto is part of the US? I guess it could be some major bug that caused that. Or maybe it was fed some bad data.

Why is speech recognition needed? The humans don’t have to listen to Trebek, they can just read the clue. A deaf person could play the game if they could talk.

---

<div class="post-metadata">

**Author:** ![Kamino\_Neko](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kamino_neko/32/34_2.png) [@Kamino\_Neko](https://boards.straightdope.com/u/Kamino_Neko)\
**Post date:** [February 16, 2011, 1:57am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/110 "2011-02-16T01:57:49Z")

</div>

He probably (incorrectly) parsed the ‘US’ part as unimportant - remember the big issue with natural language inputs is that computers have a really hard time figuring out what’s important and what’s not.

---

<div class="post-metadata">

**Author:** ![Bijou\_Drains](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bijou_drains/32/2814_2.png) [@Bijou\_Drains](https://boards.straightdope.com/u/Bijou_Drains)\
**Post date:** [February 16, 2011, 2:00am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/111 "2011-02-16T02:00:20Z")

</div>

There were only 2 words in the category name - US and Cities. How could US not be important?

If the category was black musicians then black would be important.

I could see the software telling him if you are way ahead in final jeopardy , bet a low amount and if you are not sure of the answer come up with something odd like Toronto.

---

<div class="post-metadata">

**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\
**Post date:** [February 16, 2011, 2:01am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/112 "2011-02-16T02:01:22Z")

</div>

So, if it’s cheating for the computer to use its own reflexes, why isn’t it cheating for the humans to do the same? Whoever has the best reflexes has an advantage: That’s part of the game. Yeah, Watson has strengths that humans don’t have, but then again, he also has weaknesses humans don’t have. Should the human contestants not be allowed to hear other contestants’ wrong answers, since Watson can’t?

---

<div class="post-metadata">

**Author:** ![MeanOldLady](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/meanoldlady/32/10737_2.png) [@MeanOldLady](https://boards.straightdope.com/u/MeanOldLady)\
**Post date:** [February 16, 2011, 2:03am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/113 "2011-02-16T02:03:23Z")

</div>

He guessed his answer based on the clue, not the category.

Also, they’ve spent a lot of time prepping Watson to get puns and, specifically, to play Before And After. Those are obviously some of his known weaknesses, but he wouldn’t get the floor wiped with him.

---

<div class="post-metadata">

**Author:** ![notfrommensa](https://avatars.discourse-cdn.com/v4/letter/n/f14d63/32.png) [@notfrommensa](https://boards.straightdope.com/u/notfrommensa)\
**Post date:** [February 16, 2011, 2:07am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/114 "2011-02-16T02:07:48Z")

</div>

Is Watson processing the right ‘answers’ that it did not get right? It knew (after a pow-wow) that his answer of leg for the gymnast question was wrong. But does he know why it was wrong? and what the right answer was? and how is that information being transmitted to it?

---

<div class="post-metadata">

**Author:** ![Kamino\_Neko](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/kamino_neko/32/34_2.png) [@Kamino\_Neko](https://boards.straightdope.com/u/Kamino_Neko)\
**Post date:** [February 16, 2011, 2:36am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/115 "2011-02-16T02:36:37Z")

</div>

I believe he is - it might not be happening during the game (though I would assume it would be), but he’s already gone through a learning process, so I assume he’s capable of upgrading his knowledge/logic base, and unless it has to be entered by a human handler, I can’t imagine why they’d turn it off for the games, and even if it does, I can’t see any good reason not to do at least a cursory ‘remember to read the category, dude’ run between rounds.

---

<div class="post-metadata">

**Author:** ![muldoonthief](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/muldoonthief/32/3188_2.png) [@muldoonthief](https://boards.straightdope.com/u/muldoonthief)\
**Post date:** [February 16, 2011, 2:45am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/116 "2011-02-16T02:45:39Z")

</div>

I’m betting some programmer gets fired over “Toronto”. It had 30 seconds! Once you understand the question, the search algorithm is easy as hell - run a list of airport names against major WWII battles (since that’s easier than people’s names), then check the resulting list against the list of cities with 2 airports. Clearly it was spinning its wheels and had no idea what the clue meant.

---

<div class="post-metadata">

**Author:** ![Bijou\_Drains](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bijou_drains/32/2814_2.png) [@Bijou\_Drains](https://boards.straightdope.com/u/Bijou_Drains)\
**Post date:** [February 16, 2011, 2:45am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/117 "2011-02-16T02:45:45Z")

</div>

They have a guy who works on the wordplay questions.

John Prager

John Prager works in question analysis and categorization, developing algorithms for special question processing that handle such things as wordplay

---

<div class="post-metadata">

**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\
**Post date:** [February 16, 2011, 2:49am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/118 "2011-02-16T02:49:14Z")

</div>

> [@muldoonthief](#):
>
> Once you understand the question

Well, that’s the crux, ain’t it?

ETA: Still, I’m really curious how it could end up with the answer Toronto. Seems like a simple keyword search word point strongly to the right answer. Did they show the other possibilities and confidence percentages for this one?

---

<div class="post-metadata">

**Author:** ![Bijou\_Drains](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/bijou_drains/32/2814_2.png) [@Bijou\_Drains](https://boards.straightdope.com/u/Bijou_Drains)\
**Post date:** [February 16, 2011, 2:51am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/119 "2011-02-16T02:51:55Z")

</div>

At first I thought of NYC since they have 2 airports but then I realized Chicago had Midway although I did not know that was named after the WW II battle.

---

<div class="post-metadata">

**Author:** ![muldoonthief](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/muldoonthief/32/3188_2.png) [@muldoonthief](https://boards.straightdope.com/u/muldoonthief)\
**Post date:** [February 16, 2011, 2:59am UTC](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340/120 "2011-02-16T02:59:56Z")

</div>

> [@pulykamell](#):
>
> Well, that’s the crux, ain’t it?
> 
> ETA: Still, I’m really curious how it could end up with the answer Toronto. Seems like a simple keyword search word point strongly to the right answer. Did they show the other possibilities and percentages for this one?

Sure, but it seems like if it could parse the other clues, it should have been able to parse this one. Data points:

US City  
2 airports  
Named after WWII hero  
Named after WWII battle

Once you’ve got that, with 30 seconds to check databases, and given that the answer is one of the largest cities in the US, it should have been easy. Clearly it couldn’t parse that clue, which is odd considering some of the apparently trickier ones it parsed earlier. Maybe it was just too many data points for it to separate. Heck, if it had answered any other US city with 2 airports , I wouldn’t be nearly as surprised.

[Previous page](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340.md?page=5)

[Next page](https://boards.straightdope.com/t/jeopardy-champs-vs-computer/571340.md?page=7)
