Jeopardy! Champs vs. Computer

My question is, although the hardware might cost $100 someday, wouldn’t a commercial product have to license all the intellectual property – encyclopedias plus thousands if not millions of books? We’ve seen how hard and expensive it is for a TV show to get clearances to use music – I wonder if a MyWatson device would have to jump the same hurdles.

This article saws Watson usually uses public domain sources like Project Gutenberg etc, but it did have some licensed material.

http://www.infoworld.com/t/business-intelligenceanalytics/how-ibms-watson-hammered-its-jeopardy-foes-798

I notice that most of the time when you do a Google search, it has a cached copy of the page. How does Google handle the IP issues? Is there a flag that indicates the page has copyrighted material and Google shouldn’t cache it?

“I, for one, welcome our new computer overlords” - Ken Jennings

Words that will live in infamy.

Yes, the criticisms about Watson’s edge in buzzing in are entirely legitimate and probably the main flaw in this whole stunt, but that was still a pretty marvelous thing to witness. It’s an amazing time to be alive.

This cracked me up when I was watching. I know it’s an Internet meme, not an SDMB meme, but it made me wonder…

It seems like they could’ve made it more fair to the humans by feeding Watson the question, say, 2-3 seconds after the clue was revealed, roughly the same amount of time it takes for a human to read it. That way they’d all start thinking at the same time, and his buzz in time might be a little longer and give the humans a better shot.

He seemed much less dominant in today’s game though than double jeopardy of the first game.

Like so many other memes, it’s originally from The Simpsons.

But humans don’t start thinking after they read the question. A good Jeopardy player is firing all neurons while he scans each word, which is exactly what Watson does.

Actually, Watson wasn’t given other contestants’ wrong answers, he was given their *correct *answers, so he could use them to learn what kind of answer was expected. I agree with the others here who say that it should have been possible to use voice recognition to keep him from duplicating incorrect answers. But for some reason they chose not to implement that.

Made you wonder what? If Ken Jennings was a nerd that loves The Simpsons? I think that ship has sailed.

There was no risk involved - Watson bet an amount that guaranteed he would win the two-day competition by $1 even if he got Final Jeopardy wrong and Ken got it right and bet everything.

In a normal money game this would be a better strategy than betting $0 even though they both guarantee a win. In this case there is no advantage either way, but it makes sense to stick to the standard strategy.

I bet it felt good for Ken to beat Brad Rutter. He was pretty well whipped by him in the Ultimate TOC, so this had to be a nice victory, especially how he was neck and neck with Watson throughout the whole second game while Brad sat on the sidelines.

I’m sure both Brad and Ken knew 98% of the clues, but it’s amazing that Watson was able to get the answer to so many of them fast enough to be able to use that quick buzzer to beat out the best in the show’s history.

Here’s an article by Ken Jennings at slate.com.

It seemed to me that on the last day of play (yesterday) Watson was not the first to ring in to a much greater extent than the first two days, and also that on those clues he was frequently (based on what was shown on the tv screen). Is this just poor memory on my part or did something change. Perhaps his strategy was tweaked, or they chose categories they thought would be harder for him. Did anyone else think things were a little different?

Perusing Ken Jennings website, it seems that my interpretation of last night was shaded by the fact that Watson had no clue that the category “Actors as directors” required him to simply name the director of the given film. Instead of easily winning every question he was shut out. And his guesses, based on his top three considerations, seemed stupid and random.

I become more and more convinced every day that when Trebek finally retires the producers will ask Ken Jennings to become the new host of Jeopardy.

Just random variations.

As Ken said in the WashPo chat linked to above, the game material (sets of answers and questions) was randomly selected from material prepared for regular shows, except that audio and video clues were excluded.

Ever since the game show scandals of the 1950s, the handling of game show information has been regulated by Federal law, so there’s no chance in this game (or any other broadcast TV game show) that categories or questions were changed to help or hinder a contestant.

For the same reason, and because of the adverse publicity that would have been generated, I’m quite sure that IBM didn’t “tweak” Watson after they started taping the games. In any case, there wouldn’t have been time. I’m sure they taped both games in a single session, with only a short break between them.

As anyone who’s been on the show can tell you, they are very serious about making sure that contestants have no way to find out about the material in advance. The show has two classes of staffers: those who have contact with the material and those who don’t. The former are the writers, producers, directors, and the studio staff like camera operators and sound men. The others are the contestant coordinators.

As a contestant, you are only allowed to have contact with the latter group, and they make it very clear that you’re not allowed to talk to anyone but them. One of them has to be with you at all times when you’re there in the studio complex for the taping. Yes, even in the bathroom.

I was on 20 years ago (almost exactly). Can any recent Jeopardy contestant tell us if they have more stringent measures now to prevent electronic assistance? I assume they must take your cell phone away, or tell you to leave it at home. Do they frisk you to check you don’t have any hidden devices?

It did seem to me that Watson consistently did better on longer questions - probably because it had more time to come up with an answer between when the question was sent to it, and when the buzzer could be pressed. Shorted questions seemed to give the humans more of an advantage.

I also find it amusing that Watson seems to have no idea what keys are on a computer keyboard, I don’t think it got a single question from that category right.

Who, of course, will not need the podium, nor the answers ahead of time.

No, Watson did not get any of those questions right. He wasn’t able to link up the concepts. Teasing out hints and handling wordplay were a problem for him. He didn’t get any of the One Buck or Less clues either, and I remember some of his guesses were way off. He was also totally clueless on “The New Yorker’s 1959 review of this said in its brevity & clarity it is “unlike most such manuals, a book, as well as a tool.”” I didn’t know the answer, but Watson said “What is Dorothy Parker” - he didn’t get they were looking for a book.

Interesting that Ken was able to make the second game competitive, and I loved the Simpsons reference. There’s a geek I can relate to.

Right. Once again it is only my memory but I think that Watson was skunked in both the computer keyboard category and actors as directors. Each had shorter than normal clues, but the main problem for the computer was never figuring out the context of the clues.

I also think that the advantage of always being able to be the first to ring in was insurmountable. I think that if they had programmed in a human like delay to this that he would not have won.

That being said, he did do impressively.