# New Amazon.com feature text searches ever word in every book they sell! Wow! **URL:** \ **Category:** Cafe Society\ **Created:** [October 23, 2003, 2:49pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121 "2003-10-23T14:49:53Z")\ **Posts on this page:** 17\ **Page:** 1
**Author:** ![astro](https://avatars.discourse-cdn.com/v4/letter/a/9dc877/32.png) [@astro](https://boards.straightdope.com/u/astro)\ **Post date:** [October 23, 2003, 2:49pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/1 "2003-10-23T14:49:53Z")
Go to [amazon.com](http://amazon.com) for specs on the new feature > [@](#): > > How It Works > A significant extension of our groundbreaking Look Inside the Book feature, Search Inside the Book allows you to search millions of pages to find exactly the book you want to buy. Now instead of just displaying books whose title, author, or publisher-provided keywords match your search terms, your search results will surface titles based on every word inside the book. Using Search Inside the Book is as simple as running an [Amazon.com](http://Amazon.com) search. For example: ---
**Author:** ![davidm](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/davidm/32/225_2.png) [@davidm](https://boards.straightdope.com/u/davidm)\ **Post date:** [October 23, 2003, 3:31pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/2 "2003-10-23T15:31:46Z")
It’s not quite every book they sell, but WOW! It is _very_ cool. I wonder if dopers will be using it a lot to research and foonote their debates. ---
**Author:** ![hawthorne](https://avatars.discourse-cdn.com/v4/letter/h/c89c15/32.png) [@hawthorne](https://boards.straightdope.com/u/hawthorne)\ **Post date:** [October 23, 2003, 3:52pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/3 "2003-10-23T15:52:16Z")
Interesting. I don’t know whether they’ve got it quite right yet, but it’s powerful stuff. [Ego-search test] It found references to records I’m on, but failed to find a reference to me in a book they have that I wrote a chapter of. It did find an out-of-print biography of an ancestor and numerous references to him in appropriate places. Well worth keeping an eye on. ---
**Author:** ![randwill](https://avatars.discourse-cdn.com/v4/letter/r/a3d4f5/32.png) [@randwill](https://boards.straightdope.com/u/randwill)\ **Post date:** [October 23, 2003, 4:02pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/4 "2003-10-23T16:02:11Z")
How could this be? It would require a huge team of people transcribing every book in their inventory, from Ansel Adams photobooks to every version of the Bible. If I search “Dad, your poll numbers are down.” would I get hits for all the Calvin and Hobbes anthologies? ---
**Author:** ![MovieMogul](https://avatars.discourse-cdn.com/v4/letter/m/f08c70/32.png) [@MovieMogul](https://boards.straightdope.com/u/MovieMogul)\ **Post date:** [October 23, 2003, 4:02pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/5 "2003-10-23T16:02:18Z")
Wow, I’m impressed. I put in the search words: Norman McLaren _Begone Dull Care_) and came up with 22 entries! Very cool. There seems to be a ceiling of 120 on the search results. Plus, you can download the page in question if you have an account (a little screen comes up that says Authorizing Copyright, so maybe not all pages are eligible for this feature). ---
**Author:** ![MovieMogul](https://avatars.discourse-cdn.com/v4/letter/m/f08c70/32.png) [@MovieMogul](https://boards.straightdope.com/u/MovieMogul)\ **Post date:** [October 23, 2003, 4:10pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/6 "2003-10-23T16:10:02Z")
> [@](#): > > If I search “Dad, your poll numbers are down.” would I get hits for all the Calvin and Hobbes anthologies? Well, I put in that quote along with search terms: Calvin Hobbes And the first 10 items were all by Bill Watterson (without the C&H, none of the first 10 were; probably too many generic words). ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [October 23, 2003, 4:29pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/7 "2003-10-23T16:29:27Z")
Well, most of the books probably didn’t need to be transcribed. Nearly all books anymore are written, submitted to the publisher, and/or typeset electronically, so the electronic versions already exist. They just had to deal with the publishers to get ahold of those electronic versions. As for other books (older books, or things like comic strip anthologies where the text isn’t typeset), if they list them at all, it’s probably just unproofread OCR. You’ll get a significant number of errors that way (somewhere in the vicinity of 1 in 100?), bad enough that you probably wouldn’t enjoy reading the book through that way, but still good enough that you’re likely to hit your search results. **Archive Guy** , that seems like a mightily poorly controlled experiment, to me. It seems like putting _any_ search terms together with Calvin Hobbes would give you a good representation of Bill Watterson books. And the generic words in “Dad, your poll numbers are down” should be OK, since they’re in an exact phrase, and that phrase isn’t particularly generic. ---
**Author:** ![tanstaafl](https://avatars.discourse-cdn.com/v4/letter/t/ba8739/32.png) [@tanstaafl](https://boards.straightdope.com/u/tanstaafl)\ **Post date:** [October 23, 2003, 6:06pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/8 "2003-10-23T18:06:15Z")
“Dad, your poll numbers are down” (with quotes as shown) produces zero results. Dad, your poll numbers are down (without the quote) produces 120 results but none of them are Calvin and Hobbes. (At least, not on the first few pages.) Without quotes it seems to find results where all the words are more or less close to each other. ---
**Author:** ![AHunter3](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ahunter3/32/368_2.png) [@AHunter3](https://boards.straightdope.com/u/AHunter3)\ **Post date:** [October 24, 2003, 12:49am UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/9 "2003-10-24T00:49:35Z")
It’s a cool idea but they sorely need a boolean search engine to do useful searches on that much data. ---
**Author:** ![pokey](https://avatars.discourse-cdn.com/v4/letter/p/ebca7d/32.png) [@pokey](https://boards.straightdope.com/u/pokey)\ **Post date:** [October 24, 2003, 1:02am UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/10 "2003-10-24T01:02:24Z")
It’s hard for me to admit that first phrase that came into my head to search for was “nail in bum” and yet I am forced to admit it because it’s so cool that when I searced for it, _The Straight Dope: A Compendium of Human Knowledge_ came in number 7. ---
**Author:** ![Cardinal](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cardinal/32/4000_2.png) [@Cardinal](https://boards.straightdope.com/u/Cardinal)\ **Post date:** [October 24, 2003, 7:26am UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/11 "2003-10-24T07:26:24Z")
If you read the “Wired” article, you find that they’re not just getting the text from the publishers, they’re actually scanning the books and using OCR. Sometimes they ship the books to low-wage companies, and sometimes they chop the bindings and use automated scanners. ---
**Author:** ![Shalmanese](https://avatars.discourse-cdn.com/v4/letter/s/45deac/32.png) [@Shalmanese](https://boards.straightdope.com/u/Shalmanese)\ **Post date:** [October 24, 2003, 1:05pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/12 "2003-10-24T13:05:00Z")
Hmm… I can’t imagine the damage if someone manages to crack into the server and steal everything. Massive IP abuse. On the plus side, does this mean that Amazon could potentially open an ebook store with nearly every book they sell? that could be pretty cool. ---
**Author:** ![SmackFu](https://avatars.discourse-cdn.com/v4/letter/s/53a042/32.png) [@SmackFu](https://boards.straightdope.com/u/SmackFu)\ **Post date:** [October 24, 2003, 2:17pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/13 "2003-10-24T14:17:51Z")
The beauty of the system is that they don’t have to have perfect copies. Just good enough OCR, and full page scans to show as the results. So you have pretty good accuracy for such things as searches, without the insane work of hand-checking that real e-book making takes (see Project Guttenberg). ---
**Author:** ![Musicat](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/musicat/32/20189_2.png) [@Musicat](https://boards.straightdope.com/u/Musicat)\ **Post date:** [October 24, 2003, 2:29pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/14 "2003-10-24T14:29:17Z")
We are getting close to the ideal data world – where **everything** ever written, past or present – is online and searchable. I can easily see how publishers could provide computer data of each new book as it is published (but think of the security risk!) so Amazon can index it, but just how would entering older books work efficiently? I just can’t picture someone turning each page in a bound copy and putting it on the scanner; this would be too slow to be cost-effective. Or are there automated machines that can be fed a bound publication and they will turn and scan each page unattended? Or slice the binding off and feed single pages? ---
**Author:** ![SmackFu](https://avatars.discourse-cdn.com/v4/letter/s/53a042/32.png) [@SmackFu](https://boards.straightdope.com/u/SmackFu)\ **Post date:** [October 24, 2003, 3:10pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/15 "2003-10-24T15:10:26Z")
More info: [Publisher FAQ](http://www.amazon.com/exec/obidos/tg/feature/-/506483), which says they need a physical copy and can’t use electronic ones yet. [Wired article](http://www.wired.com/news/print/0,1294,60948,00.html), that Cardinal referenced. ---
**Author:** ![Chefguy](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chefguy/32/138_2.png) [@Chefguy](https://boards.straightdope.com/u/Chefguy)\ **Post date:** [October 24, 2003, 4:36pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/16 "2003-10-24T16:36:50Z")
Something similar to this was started a few years ago at (I think) [ancestry.com](http://ancestry.com). They have a genealogy library that has been growing at a rate of about three books a day and which includes books dating way back to the earliest writings in this country. Some of it is photocopied, but some is also transcribed. A remarkable undertaking. ---
**Author:** ![cmkeller](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/cmkeller/32/118_2.png) [@cmkeller](https://boards.straightdope.com/u/cmkeller)\ **Post date:** [October 24, 2003, 6:04pm UTC](https://boards.straightdope.com/t/new-amazon-com-feature-text-searches-ever-word-in-every-book-they-sell-wow/209121/17 "2003-10-24T18:04:53Z")
I imagine that a quote from a cartoon might not be in there, because the words of the cartoon probably have not been transcribed to computer, only words of text-only books.