# Search does not return some results

**URL:** <https://boards.straightdope.com/t/search-does-not-return-some-results/354589>\
**Category:** About This Message Board\
**Created:** [April 28, 2006, 2:02pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589 "2006-04-28T14:02:34Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Johanna](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johanna/32/8318_2.png) [@Johanna](https://boards.straightdope.com/u/Johanna)\
**Post date:** [April 28, 2006, 2:02pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/1 "2006-04-28T14:02:34Z")

</div>

I tried searching all sorts of ways for the earliest posts I remember making, way back in 1999. I can’t find anything I posted earlier than 2000. I know there’s a limit to how many results a search can return, so I tried limiting the search to only one forum at a time, and older than 1 year. I got screens with as few as 2 hits, but cannot find any of my very earliest posts.

I wanna search like it’s 1999.

---

<div class="post-metadata">

**Author:** ![Zeldar](https://avatars.discourse-cdn.com/v4/letter/z/b77776/32.png) [@Zeldar](https://boards.straightdope.com/u/Zeldar)\
**Post date:** [April 28, 2006, 2:14pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/2 "2006-04-28T14:14:28Z")

</div>

In some cases those oldest threads may have been deleted or otherwise lost. But whenever I want to see my oldest posts I will fix the search criteria to go by “Last Posting Date” but “in **Ascending** Order.” This gets me as close as I can to the start of my posting career. You may have to use a few old Dopers’ names or some specific keywords to make it go all the way back before your own posting began, but at least the Ascending order thing bypasses the limits that going from “now” backwards imposes.

Hope that makes sense. 🙂

---

<div class="post-metadata">

**Author:** ![TubaDiva](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tubadiva/32/507_2.png) [@TubaDiva](https://boards.straightdope.com/u/TubaDiva)\
**Post date:** [April 28, 2006, 2:17pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/3 "2006-04-28T14:17:29Z")

</div>

Those earliest posts have been offloaded. We expect to return them to view in some sort of archival form in the future.

With over 6 million posts in the system we are bumping up against the limits of what the server will hold. If we continued to retain those older posts you wouldn’t be able to make new ones. Something’s got to give.

---

<div class="post-metadata">

**Author:** ![Johanna](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/johanna/32/8318_2.png) [@Johanna](https://boards.straightdope.com/u/Johanna)\
**Post date:** [April 28, 2006, 11:24pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/4 "2006-04-28T23:24:13Z")

</div>

OK, thanks, **Tuba**. I thought it was something like that. Sounds like sticky material. There must be other baffled searchers wondering as well.

---

<div class="post-metadata">

**Author:** ![Bippy\_the\_Beardless](https://avatars.discourse-cdn.com/v4/letter/b/ac8455/32.png) [@Bippy\_the\_Beardless](https://boards.straightdope.com/u/Bippy_the_Beardless)\
**Post date:** [April 28, 2006, 11:54pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/5 "2006-04-28T23:54:46Z")

</div>

> [@TubaDiva](#):
>
> Those earliest posts have been offloaded. We expect to return them to view in some sort of archival form in the future.
> 
> With over 6 million posts in the system we are bumping up against the limits of what the server will hold. If we continued to retain those older posts you wouldn’t be able to make new ones. Something’s got to give.

How is 6 million posts a problem? Even at 1K per post that is ‘only’ 6 gigabytes. Is it search speed constraints that are the problem or something else? Maybe there is enough expertise within the membership to help fix these problems. What version of MySQL are you using?

---

<div class="post-metadata">

**Author:** ![TubaDiva](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tubadiva/32/507_2.png) [@TubaDiva](https://boards.straightdope.com/u/TubaDiva)\
**Post date:** [April 29, 2006, 3:16am UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/6 "2006-04-29T03:16:40Z")

</div>

Don’t know all the details – and cannot speculate.

We appreciate the offers of assistance, but that’s not how this process works. Thanks for asking, though.

---

<div class="post-metadata">

**Author:** ![Slacker](https://avatars.discourse-cdn.com/v4/letter/s/6bbea6/32.png) [@Slacker](https://boards.straightdope.com/u/Slacker)\
**Post date:** [April 30, 2006, 2:00am UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/7 "2006-04-30T02:00:30Z")

</div>

> [@Bippy the Beardless](#):
>
> How is 6 million posts a problem? Even at 1K per post that is ‘only’ 6 gigabytes. Is it search speed constraints that are the problem or something else? Maybe there is enough expertise within the membership to help fix these problems. What version of MySQL are you using?

That’s a pretty good estimate, actually. My vBulletin board is approaching 1.2 million posts and the database takes up a little over 1GB of space at the moment.

As to why 6GB is a problem, you have to remember what hard drive sizes were like back when this server was purchased. 😃

---

<div class="post-metadata">

**Author:** ![AHunter3](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ahunter3/32/368_2.png) [@AHunter3](https://boards.straightdope.com/u/AHunter3)\
**Post date:** [April 30, 2006, 4:08am UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/8 "2006-04-30T04:08:37Z")

</div>

> [@Johanna](#):
>
> I tried searching all sorts of ways for the earliest posts I remember making, way back in 1999. I can’t find anything I posted earlier than 2000. I know there’s a limit to how many results a search can return, so I tried limiting the search to only one forum at a time, and older than 1 year. I got screens with as few as 2 hits, but cannot find any of my very earliest posts.
> 
> I wanna search like it’s 1999.

Dear **Johanna** :

The reason you can’t find those ancient posts is because the board doesn’t know that you are the one that made 'em:

[Trivial Curiosity: What caused the Era of No-Name Posts (\< late Aug 99)?](http://boards.straightdope.com/sdmb/showthread.php?t=194497)  
I can find my old ones by searching for what was (at that time) my sig line.

---

<div class="post-metadata">

**Author:** ![AHunter3](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ahunter3/32/368_2.png) [@AHunter3](https://boards.straightdope.com/u/AHunter3)\
**Post date:** [April 30, 2006, 4:18am UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/9 "2006-04-30T04:18:43Z")

</div>

> [@TubaDiva](#):
>
> Those earliest posts have been offloaded. We expect to return them to view in some sort of archival form in the future.
> 
> With over 6 million posts in the system we are bumping up against the limits of what the server will hold. If we continued to retain those older posts you wouldn’t be able to make new ones. Something’s got to give.

Hate to contradict an Administrator, but I see no signs that any vintage threads have been offloaded. My March '99 first-ever post (not counting AOL of course) is still [right here](http://boards.straightdope.com/sdmb/showthread.php?p=5251#post5251) where I put it. (I’m the “Guest” who used to use “Designated Optional signature at Bottom of Post” as a sig line)

---

<div class="post-metadata">

**Author:** ![samclem](https://avatars.discourse-cdn.com/v4/letter/s/a9a28c/32.png) [@samclem](https://boards.straightdope.com/u/samclem)\
**Post date:** [April 30, 2006, 1:26pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/10 "2006-04-30T13:26:26Z")

</div>

> [@AHunter3](#):
>
> Hate to contradict an Administrator, but I see no signs that any vintage threads have been offloaded. My March '99 first-ever post (not counting AOL of course) is still [right here](http://boards.straightdope.com/sdmb/showthread.php?p=5251#post5251) where I put it. (I’m the “Guest” who used to use “Designated Optional signature at Bottom of Post” as a sig line)

I think you’re both right.

The only threads viewable from 1999 are those posted in **ATMB**. Oh, and perhaps **CoCC**. All the rest are archived and unavailable at this time, as Jenny said.

---

<div class="post-metadata">

**Author:** ![CarnalK](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/carnalk/32/486_2.png) [@CarnalK](https://boards.straightdope.com/u/CarnalK)\
**Post date:** [April 30, 2006, 5:20pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/11 "2006-04-30T17:20:34Z")

</div>

> [@](#):
>
> _TubaDiva_:  
> Those earliest posts have been offloaded. We expect to return them to view in some sort of archival form in the future.
> 
> With over 6 million posts in the system we are bumping up against the limits of what the server will hold. If we continued to retain those older posts you wouldn’t be able to make new ones. Something’s got to give.

So how far in the future? How searchable will this “some sort of archival form” be? Because for Pete’s sake, you are using the slow server schtick to take away even the simplest things that were undoubtably promised to the membership:

[Ed once again](http://boards.straightdope.com/sdmb/showthread.php?t=253315):

> [@](#):
>
> What does a subscription get me?
> 
> ```
> * Posting privileges for one year.
> * Post count (i.e., number of messages you've posted to date appears with your username)
> ***Ability to search the massive SDMB message database**
> 
> ```

(my bold)  
As Bippy said, this is not a huge amount of info in the world of databases. I find it hard to believe offload or die are the only choices available.

But main questions: how long gone? how searchable when back?

---

<div class="post-metadata">

**Author:** ![AHunter3](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ahunter3/32/368_2.png) [@AHunter3](https://boards.straightdope.com/u/AHunter3)\
**Post date:** [April 30, 2006, 6:11pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/12 "2006-04-30T18:11:23Z")

</div>

> [@samclem](#):
>
> I think you’re both right.
> 
> The only threads viewable from 1999 are those posted in **ATMB**. Oh, and perhaps **CoCC**. All the rest are archived and unavailable at this time, as Jenny said.

😕

[Really?](http://boards.straightdope.com/sdmb/showthread.php?t=724)

[Are you sure?](http://boards.straightdope.com/sdmb/showthread.php?t=19152)

[I hate to keep contradicting Admins…](http://boards.straightdope.com/sdmb/showthread.php?t=1397)

[…and I hope this doesn’t prompt you to run out and nuke them or anything…](http://boards.straightdope.com/sdmb/showthread.php?t=2581)

[…but they all seem to still be there](http://boards.straightdope.com/sdmb/showthread.php?t=2581)

---

<div class="post-metadata">

**Author:** ![CarnalK](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/carnalk/32/486_2.png) [@CarnalK](https://boards.straightdope.com/u/CarnalK)\
**Post date:** [April 30, 2006, 6:36pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/13 "2006-04-30T18:36:57Z")

</div>

AHunter3, look at the last post in those threads. They were all bumped post-2001

---

<div class="post-metadata">

**Author:** ![AHunter3](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ahunter3/32/368_2.png) [@AHunter3](https://boards.straightdope.com/u/AHunter3)\
**Post date:** [April 30, 2006, 6:59pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/14 "2006-04-30T18:59:20Z")

</div>

Ah. So the ones that were pruned were the ones with _last activity_ prior to some point in '99? OK, that makes sense.

---

<div class="post-metadata">

**Author:** ![samclem](https://avatars.discourse-cdn.com/v4/letter/s/a9a28c/32.png) [@samclem](https://boards.straightdope.com/u/samclem)\
**Post date:** [April 30, 2006, 8:29pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/15 "2006-04-30T20:29:17Z")

</div>

> [@AHunter3](#):
>
> Ah. So the ones that were pruned were the ones with _last activity_ prior to some point in '99? OK, that makes sense.

I don’t have a personal issue in this. I was only trying to supply what I thought was correct info. Thanks to both you and **CarnalK** for your info.

---

<div class="post-metadata">

**Author:** ![AHunter3](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/ahunter3/32/368_2.png) [@AHunter3](https://boards.straightdope.com/u/AHunter3)\
**Post date:** [April 30, 2006, 9:28pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/16 "2006-04-30T21:28:11Z")

</div>

Well, it explains why I’ve never been able to find the fabled “Naughty Love Letters from Mully” thread, I guess.

---

<div class="post-metadata">

**Author:** ![CarnalK](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/carnalk/32/486_2.png) [@CarnalK](https://boards.straightdope.com/u/CarnalK)\
**Post date:** [May 1, 2006, 10:36pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/17 "2006-05-01T22:36:17Z")

</div>

So what’s the scoop?

I’m a little curious because a quick look at [bigboard’s stats](http://www.big-boards.com/board/15/) [graph](http://img411.imageshack.us/my.php?image=dopepostsyear9sd.png) makes me think whatever you’ve taken offline since January will be replaced within a month or so. Are we in for more pruning?

Could you stick them on some kind of read-only drive or something? What do I know.

---

<div class="post-metadata">

**Author:** ![SpaceDog](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/spacedog/32/9932_2.png) [@SpaceDog](https://boards.straightdope.com/u/SpaceDog)\
**Post date:** [May 2, 2006, 11:03am UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/18 "2006-05-02T11:03:56Z")

</div>

Eh, couple of quick questions …

How many posts were ‘offloaded’ and when can we expect to see them back ? Are you going to continue culling posts ?

I know you’ve been saying that this might happen for a while but was there an official announcement ? I guess those threads weren’t visited very much but still it seems a bit of a shame.

I guess the hold up is some sort of search mechanism for them, if you don’t want google to be able to search them. Just say to hell with it and archive everything older than 3 years to a static, read-only, indexed by google site. That way you’ll still provide some value-add for members (they can search three years worth of threads) and have the bonus of bringing newbies from google hits. That’s a relatively easy (and server friendly) solution.

SD

---

<div class="post-metadata">

**Author:** ![JohnBckWLD](https://avatars.discourse-cdn.com/v4/letter/j/d6d6ee/32.png) [@JohnBckWLD](https://boards.straightdope.com/u/JohnBckWLD)\
**Post date:** [May 2, 2006, 2:25pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/19 "2006-05-02T14:25:38Z")

</div>

> [@SpaceDog](#):
>
> …Just say to hell with it and archive everything older than 3 years to a static, read-only, indexed by google site. That way you’ll still provide some value-add for members (they can search three years worth of threads) and have the bonus of bringing newbies from google hits. That’s a relatively easy (and server friendly) solution.

It seems logical, but the howls of protest from posters who view and treat the boards as a private weblog would be deafening.

---

<div class="post-metadata">

**Author:** ![Slacker](https://avatars.discourse-cdn.com/v4/letter/s/6bbea6/32.png) [@Slacker](https://boards.straightdope.com/u/Slacker)\
**Post date:** [May 2, 2006, 4:21pm UTC](https://boards.straightdope.com/t/search-does-not-return-some-results/354589/20 "2006-05-02T16:21:35Z")

</div>

> [@JohnBckWLD](#):
>
> It seems logical, but the howls of protest from posters who view and treat the boards as a private weblog would be deafening.

I never understood that. This messageboard is in no way private. Anyone can come by and read to their heart’s content. So they can’t search? So what? If they’re determined to find something they’ll just keep reading until they find it. Plus, you can sort any forum by thread starter and peruse someone’s threads all you like. I found my list of MPSIMS threads within 2 minutes.

Letting Google index the site would provide a reliable search engine, bring new people to the boards, and take a load off the server. The only downside is the fact that searching the “massive” database here is the only thing they really have to offer potential subscribers.

[Next page](https://boards.straightdope.com/t/search-does-not-return-some-results/354589.md?page=2)
