# How is Google able index dynamic content? **URL:** \ **Category:** Factual Questions\ **Created:** [March 5, 2015, 9:24pm UTC](https://boards.straightdope.com/t/how-is-google-able-index-dynamic-content/714307 "2015-03-05T21:24:11Z")\ **Posts on this page:** 5\ **Page:** 1
**Author:** ![Ornery\_Bob](https://avatars.discourse-cdn.com/v4/letter/o/da6949/32.png) [@Ornery\_Bob](https://boards.straightdope.com/u/Ornery_Bob)\ **Post date:** [March 5, 2015, 9:24pm UTC](https://boards.straightdope.com/t/how-is-google-able-index-dynamic-content/714307/1 "2015-03-05T21:24:11Z")
Specifically, products that really only exist as database items until someone calls them in a search? Amazon, for example, doesn’t actually have static web pages for each of their products; the “pages” are created dynamically based on user inputs. So how does Google index these products? It seems a bit hit or miss. Sometimes I get Amazon links in search results and sometimes not, even when I know they have the particular item. The company I work for has a similar site (dynamic content) and they’re asking me if I know how it’s done… I said I would ask the Dopers! ---
**Author:** ![chrisk](https://avatars.discourse-cdn.com/v4/letter/c/6de8d8/32.png) [@chrisk](https://boards.straightdope.com/u/chrisk)\ **Post date:** [March 5, 2015, 9:31pm UTC](https://boards.straightdope.com/t/how-is-google-able-index-dynamic-content/714307/2 "2015-03-05T21:31:23Z")
Generally, they spider the site. For instance, lots of people link to the Amazon home page, so Google asks the server for the current home page content regularly to update the search engine. There’ll be links to some featured products on the home page at any time. So Google will add those “page” addresses to its list, even though they’re dynamic. And then, when it asks for product X, there’ll be links somewhere to say “Customers who viewed this item also liked products Y, Z, and Q3.” So Google will add those “pages” as well. That’s why it’s hit or miss; some products Google was able to find without using Amazon’s search box (because it has no idea what to “type in.”) Some items didn’t get spidered. Does that help? ---
**Author:** ![ZipperJJ](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/zipperjj/32/211_2.png) [@ZipperJJ](https://boards.straightdope.com/u/ZipperJJ)\ **Post date:** [March 5, 2015, 9:48pm UTC](https://boards.straightdope.com/t/how-is-google-able-index-dynamic-content/714307/3 "2015-03-05T21:48:42Z")
Spidering is how static pages are indexed too, for what it’s worth. Google doesn’t know that you have a directory called Pages and it has a.html, b.html and c.html in it. It has to go to your site and follow every link it finds. If there is absolutely no link on the Internet to [mysite.com/pages/12.html](http://mysite.com/pages/12.html), Google won’t find it. Just like it won’t find [mysite.com/pages.aspx?id=1234&t=7&x=rats](http://mysite.com/pages.aspx?id=1234&t=7&x=rats) if there’s no link to it. ETA: If your company’s full product line is not being indexed, you need to make a complete sitemap and submit it to Google. Just tell 'em what exists. ---
**Author:** ![Ornery\_Bob](https://avatars.discourse-cdn.com/v4/letter/o/da6949/32.png) [@Ornery\_Bob](https://boards.straightdope.com/u/Ornery_Bob)\ **Post date:** [March 6, 2015, 4:29am UTC](https://boards.straightdope.com/t/how-is-google-able-index-dynamic-content/714307/4 "2015-03-06T04:29:57Z")
So it’s all about links… that makes sense. My recommendation to the suits - “Make sure every item can be found by following menus and that you have a Google Site Map.” Thanks! ---
**Author:** ![The\_Joker\_and\_the\_Thief](https://avatars.discourse-cdn.com/v4/letter/t/e79b87/32.png) [@The\_Joker\_and\_the\_Thief](https://boards.straightdope.com/u/The_Joker_and_the_Thief)\ **Post date:** [March 6, 2015, 5:11am UTC](https://boards.straightdope.com/t/how-is-google-able-index-dynamic-content/714307/5 "2015-03-06T05:11:55Z")
And Amazon’s web pages are static. There’s a whole lot of crap appended to the middle and end of every URL, but the base of it–the ASIN and some other stuff–remains the same over time. All of Amazon’s products have the following basic URL format and have for some time: amazon.com/dp/B00006IFKU/