# Google Print: "We are scanning them to be read by an AI."

**URL:** <https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791>\
**Category:** Great Debates\
**Created:** [October 31, 2005, 9:24pm UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791 "2005-10-31T21:24:41Z")\
**Posts on this page:** 14\
**Page:** 2

<div class="post-metadata">

**Author:** ![Gary\_Robson](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gary_robson/32/3448_2.png) [@Gary\_Robson](https://boards.straightdope.com/u/Gary_Robson)\
**Post date:** [November 3, 2005, 2:28pm UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/21 "2005-11-03T14:28:24Z")

</div>

> [@Dan Norder](#):
>
> That is SO not what Google is doing. If you’d go read their FAQ instead of just making kneejerk reactions you would see that.

I did actually read it, **Dan**. I’m curious which parts of my statements you disagree with.

Let’s say I’ve written a technical book about designing flammuses. Today, if you want to design flammuses, you purchase my book. In the Google Print model, you search for some particular keywords related to the part of the design you’re having trouble with. Up comes the appropriate page, containing diagrams, schematics, tables, or whatever. Each time you have a problem or question, Google Print will dutifully show you the appropriate page of the book. You have no need to buy it. I don’t get paid for my work. “But wait,” you say. “You get income from Google Ads.” Read on…

My technical books accomplish two things. First, they provide me some income when people buy them…a lot more than the few pennies that Google Print will pay. Second, they provide me with consulting income because people see from the books that I’m an expert in the field, and hire me to help with their projects. The Google Print ads provide a convenient way for Google to direct readers to one of my competitors. Right there, beneath a page of _my_ book, will be an ad for some other expert in the field. So I lose book sales _and_ I lose potential consulting work.

Explain again how this helps me.

> [@alterego](#):
>
> Suppose instead that your book is in a few libraries and used bookstores around the country, or maybe just buried deep in the stacks of the LOC.

You missed my whole point, **Alterego**. My books aren’t hidden away. I have a Web site of my own with pertinent information and excerpts, and it’s already indexed by Google. The difference is that Google today doesn’t get to decide what parts of my books are available and where to direct customers. I get to decide that.

> [@Aeschines](#):
>
> Information wants to be free.

A lovely fluffy little quote, isn’t it? But think about it for a moment. Do you really think people are going to spend a year of their life putting their knowledge and expertise into words if they don’t get paid for it? Are publishers going to be eager to pay copyeditors, proofreaders, printers, illustrators, and authors to produce a book when their revenue model is a few pennies from a Google ad? If copyright goes away, people will stop writing the books!

Sure, there will be technical articles. There will be some Web sites where people with questionable credentials post unedited and non-verified information in formats that may or may not work with your Web browser. But copyrights provide the incentive for skilled individuals to put the work and effort into producing books.

> [@emacknight](#):
>
> I think the point is that while you may be perfectly capable of creating your book, and then turning it into an eBook, nobody is reading it, so its making you nothing.

Where on Earth did _that_ come from? You have no idea what I’ve written, how it’s placed online, what it’s about, or how many people have purchased it. You don’t know how many books I’ve written, how many Web sites I have, how much money I make from them, or how well-indexed they are by Google today. How can you make a statement like that based on such staggering ignorance? Oh, wait. This is GD. Um… cite?

---

<div class="post-metadata">

**Author:** ![Alan\_Smithee](https://avatars.discourse-cdn.com/v4/letter/a/2acd7d/32.png) [@Alan\_Smithee](https://boards.straightdope.com/u/Alan_Smithee)\
**Post date:** [November 3, 2005, 3:57pm UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/22 "2005-11-03T15:57:37Z")

</div>

> [@](#):
>
> Today, if you want to design flammuses, you purchase my book. In the Google Print model, you search for some particular keywords related to the part of the design you’re having trouble with. Up comes the appropriate page, containing diagrams, schematics, tables, or whatever. Each time you have a problem or question, Google Print will dutifully show you the appropriate page of the book.

This is simply untrue. Unless the book is submitted to Google through the Google Publishers’ program or is in the public domain, all that will come is a brief paragraph stating something along the lines of:

_The term_ **flammus** _appears on the following pages of the work_ **Flammus Design and You** _by_ **InvisibleWombat** : 3, 22, 897. _The first appearance is shown below:_

**…ever again. Flammus design first came to the public’s attention…**

_To purchase a copy of the book, use one of the following links:_

That’s it. No whole pages, no diagrams, nothing. Just enough, hopefully, for someone to decide if the book is worth finding. If that’s violating copyright, so is every search engine ever invented.

---

<div class="post-metadata">

**Author:** ![Ms2001](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ms2001/32/18463_2.png) [@Ms2001](https://boards.straightdope.com/u/Ms2001)\
**Post date:** [November 4, 2005, 1:48am UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/23 "2005-11-04T01:48:35Z")

</div>

> [@InvisibleWombat](#):
>
> Let’s say I’ve written a technical book about designing flammuses. Today, if you want to design flammuses, you purchase my book.

You do? Why not just find a free reference written by someone who has purchased your book and made the _facts_ therein available to the public?

> [@](#):
>
> A lovely fluffy little quote, isn’t it? But think about it for a moment. Do you really think people are going to spend a year of their life putting their knowledge and expertise into words if they don’t get paid for it? […] But copyrights provide the incentive for skilled individuals to put the work and effort into producing books.

That reminds me of a crazy idea I had the other day… what if there were a parallel universe where people skilled in some field, like computer programming, sometimes spent hundreds or thousands of hours writing stuff just to give it away for free? What if they even gave out the source code so other people could improve on their designs?

Wait, never mind, that’s ridiculous. I mean, a world where people would actually do something like that for free would be nothing like our own. It’d probably have some kind of global computer network powered by that same free software. In that crazy upside-down world, I bet the most popular rapper would be a white guy, the best golfer would be a black guy, Apple would use Intel CPUs, Microsoft would use PowerPC chips, and the Germans would be _against_ a controversial war!

---

<div class="post-metadata">

**Author:** ![Gary\_Robson](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gary_robson/32/3448_2.png) [@Gary\_Robson](https://boards.straightdope.com/u/Gary_Robson)\
**Post date:** [November 5, 2005, 7:21pm UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/24 "2005-11-05T19:21:38Z")

</div>

> [@Mr2001](#):
>
> You do? Why not just find a free reference written by someone who has purchased your book and made the _facts_ therein available to the public? [snip] That reminds me of a crazy idea I had the other day… what if there were a parallel universe where people skilled in some field, like computer programming, sometimes spent hundreds or thousands of hours writing stuff just to give it away for free?

Sounds great. Of course, if these incredibly talented people (who are both skilled in their field _and_ capable of writing clear, understandable prose) spend all of their time writing stuff to give away, they’d need a way to eat and pay the rent, too. Do you have any fresh new ideas for that, or is it just your basic utopian socialist paradise?

---

<div class="post-metadata">

**Author:** ![Ms2001](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ms2001/32/18463_2.png) [@Ms2001](https://boards.straightdope.com/u/Ms2001)\
**Post date:** [November 6, 2005, 1:03am UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/25 "2005-11-06T01:03:41Z")

</div>

> [@InvisibleWombat](#):
>
> Sounds great. Of course, if these incredibly talented people (who are both skilled in their field _and_ capable of writing clear, understandable prose) spend all of their time writing stuff to give away, they’d need a way to eat and pay the rent, too. Do you have any fresh new ideas for that, or is it just your basic utopian socialist paradise?

Have a seat, because what I’m about to tell you just might _blow your mind_.

Ready?

The world I was talking about… is Earth!

Yes, people already do spend hundreds or thousands of hours of their own time writing stuff to give away for free. You’re using some of it right now. (Of course, most of their writing is done in languages like C, C++, and Java, not English, but the point remains.) If you want to know how they put food on the table and a roof over their head, you don’t need to ask me to speculate, you can just put the question to them directly.

---

<div class="post-metadata">

**Author:** ![Ms2001](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ms2001/32/18463_2.png) [@Ms2001](https://boards.straightdope.com/u/Ms2001)\
**Post date:** [November 6, 2005, 5:46am UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/26 "2005-11-06T05:46:41Z")

</div>

> [@Breakdancing Duck](#):
>
> You honestly believe that the majority of people would read a book online and **after** they had finished it

That is not how Google Print works.

---

<div class="post-metadata">

**Author:** ![What\_Exit](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/what_exit/32/10652_2.png) [@What\_Exit](https://boards.straightdope.com/u/What_Exit)\
**Post date:** [November 6, 2005, 3:48pm UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/27 "2005-11-06T15:48:48Z")

</div>

> [@Mr2001](#):
>
> That is not how Google Print works.

But isn’t ignorance wonderful?

---

<div class="post-metadata">

**Author:** ![Gary\_Robson](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gary_robson/32/3448_2.png) [@Gary\_Robson](https://boards.straightdope.com/u/Gary_Robson)\
**Post date:** [November 7, 2005, 1:15am UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/28 "2005-11-07T01:15:08Z")

</div>

> [@Mr2001](#):
>
> Yes, people already do spend hundreds or thousands of hours of their own time writing stuff to give away for free.

You just don’t get it, do you?

Of _course_ people write stuff for free today. Even cynics like me. I’ve written piles of technical stuff for my own Web sites and others. I contribute regularly to Wikipedia. I write free book reviews for the local newspaper. But _I get to choose_ which of my work is given away free and which I get paid for. I make a living with my writing, and the better my paid stuff sells, the more time I can afford to spend on free stuff.

If you start stealing people’s copyrighted software, books, articles, and music, then they are going to have to find a different way to make a living. You think people are going to spend tens of thousands of dollars going to college to learn to program if they can’t make a living at it? You think people are going to spend a thousand hours writing a book while they’re making below-par wages at Wal\*Mart or McDonald’s? Only being well-paid for what you do creates the kind of leisure time needed to write for free.

---

<div class="post-metadata">

**Author:** ![Alan\_Smithee](https://avatars.discourse-cdn.com/v4/letter/a/2acd7d/32.png) [@Alan\_Smithee](https://boards.straightdope.com/u/Alan_Smithee)\
**Post date:** [November 7, 2005, 1:53am UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/29 "2005-11-07T01:53:10Z")

</div>

> [@InvisibleWombat](#):
>
> But _I get to choose_ which of my work is given away free and which I get paid for.

And you still do, as has been pointed out to you. If this is just a response to the idea of a totally open-source model of creative property, fine. But if you think this has anything to do with Google Print, you’d better explain what you know about it that no one else does.

---

<div class="post-metadata">

**Author:** ![Ms2001](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ms2001/32/18463_2.png) [@Ms2001](https://boards.straightdope.com/u/Ms2001)\
**Post date:** [November 7, 2005, 5:03am UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/30 "2005-11-07T05:03:35Z")

</div>

This has indeed gotten off topic. Discussion of the merits of copyright is best suited to [another thread](http://boards.straightdope.com/sdmb/showthread.php?t=342699).

---

<div class="post-metadata">

**Author:** ![Gary\_Robson](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/gary_robson/32/3448_2.png) [@Gary\_Robson](https://boards.straightdope.com/u/Gary_Robson)\
**Post date:** [November 7, 2005, 7:52pm UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/31 "2005-11-07T19:52:31Z")

</div>

> [@Alan Smithee](#):
>
> If this is just a response to the idea of a totally open-source model of creative property, fine. But if you think this has anything to do with Google Print, you’d better explain what you know about it that no one else does.

It was a specific response to **Mr2001** ’s implication that writers shouldn’t be able to control their own work products. I know the thread has drifted, but I just couldn’t let that comment go unchallenged.

---

<div class="post-metadata">

**Author:** ![Alan\_Smithee](https://avatars.discourse-cdn.com/v4/letter/a/2acd7d/32.png) [@Alan\_Smithee](https://boards.straightdope.com/u/Alan_Smithee)\
**Post date:** [November 7, 2005, 8:35pm UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/32 "2005-11-07T20:35:23Z")

</div>

Fair enough, then. I think open-source is a great idea, but I have **no clue** how it works.

---

<div class="post-metadata">

**Author:** ![Ms2001](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ms2001/32/18463_2.png) [@Ms2001](https://boards.straightdope.com/u/Ms2001)\
**Post date:** [November 8, 2005, 12:05am UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/33 "2005-11-08T00:05:25Z")

</div>

> [@InvisibleWombat](#):
>
> It was a specific response to **Mr2001** ’s implication that writers shouldn’t be able to control their own work products. I know the thread has drifted, but I just couldn’t let that comment go unchallenged.

I made no such implication here. I was simply responding to _your_ claim, which I think was quite clear (although you seem to have backed away from it), that no one with skill would put any effort into writing if they couldn’t get paid for it.

---

<div class="post-metadata">

**Author:** ![carterba](https://avatars.discourse-cdn.com/v4/letter/c/85e7bf/32.png) [@carterba](https://boards.straightdope.com/u/carterba)\
**Post date:** [November 9, 2005, 12:50am UTC](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791/34 "2005-11-09T00:50:14Z")

</div>

> [@alterego](#):
>
> The prototype translation is done by a human, and you are essentially ranked based on the 1-1 sentence matches. The general idea is that, “_The closer a machine translation is to a professional human translation, the better it is._” ([cite](http://domino.watson.ibm.com/library/cyberdig.nsf/papers/5C651A88CB24938185256ACB0055E548/%24File/RC22176.pdf)). A reasonable interpretation of Google’s .5131 score of Arabic-to-English is that 51.31% of sentences were equally good as compared to a human translation. That’s just phenomenal.

No, this is wrong. You are graded using a function of how many of your machine translation’s n-grams (sequences of n words in a row) match n-grams in a set of human translations. The function can’t be interpreted as a percentage, and it certainly is not based on 1-to-1 sentence matches, since sentences won’t match up 1-to-1 in all cases—in fact, a big part of machine tranlsation is figuring out how to align sentences correctly. This score is in fact quite difficult to interpret, and has been the subject of some criticism as systems have achieved high scores while producing translations that are virtually unreadable. However, it is the best automatic scoring method currently available. The alternative is to have humans read and judge each machine translation separately, which is simply too expensive for NIST.

> [@](#):
>
> At a talk at my university last month Google presented a graph showing a linear correlation with the size of the web, which is their translation corpus (in addition to a boatload of UN documents), and the accuracy of their translation. It was clear that they just needed more data. Problem solver that I am, I wondered, “Why don’t you just use all those e-mails in Gmail?”. I kept my mouth shut, of course. If they’re doing it their recruiters wouldn’t know about it.

What Google has shown is that with fairly simple scalable algorithms you can score high using this automatic metric (called BLEU, for those who are interested) IF you have a ton of data. Google has a ton of data: the web. I’ve seen a couple presentations like this (one by Peter Norvig), and IIRC, it took a doubling of the amount of data to increase the BLEU score by a few hundredths. More data beyond “a ton” simply won’t get you that much further, and anyway it’s not clear that a higher BLEU score necessarily means a better translation. Other researchers have shown that better algorithms can also score high, but with a lot less training data. The trick is to figure out how to get the better algorithms to scale up to the massive amount of data out there, in the web and elsewhere.

I see from the NIST tables that Google, while impressive, is not vastly better than ISI, which I believe also uses simple algorithms with lots of data. ISI is restricted by not having easy access to the whole web as Google does.

Anyway, just wanted to correct some misconceptions.

[Previous page](https://boards.straightdope.com/t/google-print-we-are-scanning-them-to-be-read-by-an-ai/328791.md?page=1)
