Jeopardy! Champs vs. Computer

My favorite example of “appropriate answers for the specific clue, but inappropriate for the category” was the one where an American had declined to dip the flag for King George. The answers were the city in which the event had taken place ( the correct answer), the Summer Olympics, and perhaps a year? At any rate, I couldn’t help suspecting that the wrong answers would be helpful to say Google if I wanted to know more, but they’d have been funny answers to the category.

I thought one of the most interesting answers was about the gymnast with a missing leg. Watson’s answer was simply ‘leg’, so it’s clear that his programming had sorted out the right bits of information, but had failed to recognize that ‘leg’ was not, in and of itself, a defect. Since most Jeopardy answers are straight ahead nouns, it could be that he’s not that attuned to adjectives like ‘missing’.

This is what I was interested in - how does Watson’s buzzer work? They showed that he has a physical button to press, but how does he get the information about the timing of when he’s allowed to buzz in?

Being good with the buzzer is a huge advantage, and it seems that they could make Watson essentially unbeatable on the buzzer. If he’s able to get all the easy question that the other contestants also know, then they would have to be much much better on knowledge to beat him.

Art Fleming was the original Jeopardy host; none of Trebek’s condescension.

I think Watson can buzz in as soon as he gets the text with the answer.

I would presume Watson is keying off the same off-camera light the human contestants see that signal it is OK to buzz. I presume they just have a electrical circuit input into Watson for this, and Watson is not “looking” at the light with a camera, but they didn’t cover this in last night’s episode.

Interesting tidbit about that sequence:

ETA: I recall Jennings answering “hand,” but my memory isn’t what it used to be.

Also, I had no idea that they retaped portions of shows like that.

[Synthesized robotic computer voice, that somehow still slurs 's’s into 'sh’s]“That is not what your immediate maternal ancestor verbalized to me in the most recent nocturnal phase, Alex”
“Ha. Ha. Ha. Suck. It. Trebek.”
[/computer voice]

Well, what is a reasonable “Second Guess” for this question?

For a human, it’s probably something like “Mean Mr. Mustard” or “Bungalow Bill” - a person from a different Beatles song (if you mis-identified the lyrics).

But a computer is never going to mis-identify the lyrics. It was 100% sure that those words were from Hey Jude. And once you know that, there is no second answer - there are no other “people” in the lyrics for that song. Hence “Who is Jude?” with a 98% confidence, and random useless answers for 2 and 3 (likely other high-correlation matches to those lyrics, but with a negative confidence due to category mismatch).

It’s the same with the London flag-dipping question - three facts having to do with the words in the clue, sorted by appropriateness to the category. They likely found it was better to first-pass search for relevant terms and then sort by appropriateness when assigning confidence.

I did find it a bit odd that on the Athens Olympic question, where the correct answer was Greece, Watson had it’s top guess as “2004 Summer Olympics” - 2004 was in the clue, and Olympics was in the category name. Does anybody remember the exact phrasing of this question?

answers and responses to clues

[QUOTE=Jeopardy!]
In the 2004 opening ceremonies a sole member of this team opened the parade of nations; the rest of his team closed it.
[/QUOTE]
Very odd that Watson would do so poorly on this question, IMO. His top answer was “2004 Summer Olympics” - surely he was programmed to not answer with words in the clue itself. And it seems like (based on his other gueses) he knew the Games were in Athens.

I guess there really weren’t a lot of facts to go on here - 2004 Olympics, opening ceremony, parade of nations, “his team”. I guess I’d still think the host nation would be one of the top possible answers.

Here’s a blog entry on it:

It also covers the lack of video/audio questions, which is apparently an existing accommodation also offered to disabled human players.

It’s annoying that Watson answers every musical question with “what is- A Bicycle Built for 2?”

I doubt that the human players are actually listening to Alex either. They can read the question off the screen in a fraction of the time it takes Alex to read it.

I wonder if the Jeopardy system lets you buzz in before Alex finishes reading the question.

Nope. Some Jeopardy veterans will be along shortly to confirm, but you have to wait until Alex finishes reading the question before you’re allowed to buzz in. Buzzing in too early locks you out of buzzing again for a second or two.

I read you cannot buzz in before Trebek stops reading. That’s a standard Jeopardy rule.

The buzzers are locked until a fraction of a second (it feels like 0.2 seconds or so) after Alex finishes speaking. If you try to ring in before that, your buzzer is locked out for a short period of time and you’re at a disadvantage. One reason Ken was so good is that his timing with the buzzer is excellent. Watson probably has an actual timing mechanism, so like I said upthread, he’s basically perfect at that.

My opinion on Watson going straight for the Double Jeopardy is this: he knows that you get the most benefit from the DD if you have a lot of money first. I would guess he was trying to hit the $800 and $1000 clues first hoping to get the DD later and just happened to hit it early by chance. Notice once the DD had been found he basically just went across the board from the top down. At that point it doesn’t matter anymore in which order you choose the clues.

Right. And there is potentially some benefit to a machine switching from category to category rather than top-down - they don’t have the same “momentum” or “locked into a category” feelings that a human might, so denying the human players that advantage is a good idea.

I noticed this, too. What I did NOT notice was that Watson generally picked the lowest-valued clues on the board, with the exception of course with that jump right to the DD. Still, having the ability to jump from category to category without the human confusion factor is a big advantage.

So, Watson’s advantages are 1.) Never forgetting to phrase his response in the form of a question; 2.) Always being able to ring in first when he feels confident with his response; and 3.) No category confusion.

Still, he doesn’t quite seem to “get” the response that is needed each time. Regular contestants sometimes don’t, either, for example naming a book when it’s the name of the author that is needed.