Reply
 
Thread Tools Display Modes
  #1  
Old 06-14-2018, 03:41 PM
EinsteinsHund EinsteinsHund is offline
Member
 
Join Date: Jul 2009
Location: NRW, Germany
Posts: 2,203
How big is the SDMB database?

Just a thought I had. I used to program and administrate databases and am always interested, maybe a little obsessed, about such details. It's been a while (almost twenty years), many posts and other things had to be stored. So can someone tell how big the data file for the database is in bytes (or is it a trade secret )?
__________________
And if my thought-dreams could be seen
They’d probably put my head in a guillotine
  #2  
Old 06-14-2018, 03:49 PM
engineer_comp_geek engineer_comp_geek is online now
Robot Mod in Beta Testing
Moderator
 
Join Date: Mar 2001
Location: Pennsylvania
Posts: 21,374
I believe threads and posts are numbered sequentially, which would put us at roughly 21 million posts in a bit over 850,000 threads, going by the post and thread numbers of your post.
  #3  
Old 06-14-2018, 04:01 PM
bump bump is offline
Guest
 
Join Date: Jun 2000
Location: Dallas, TX
Posts: 15,261
I imagine it's really not *that* big, in the sense of you probably have somewhere on the order of 50 million records in total (about 22 million pointer records, and 21 million records containing post content, plus any additional tables that are in there)

As for size, I don't know physically how big it might be; I always let the DBAs worry about that kind of thing!
  #4  
Old 06-15-2018, 12:35 PM
Leo Bloom Leo Bloom is offline
Member
 
Join Date: Jun 2009
Location: Here
Posts: 12,623
So it fits in a breadbox.
  #5  
Old 06-15-2018, 12:58 PM
Jasmine Jasmine is offline
Member
 
Join Date: Jul 1999
Location: Chicagoland
Posts: 801
Words take very little "space". Images and videos really add up, but they are not allowed, just links to other places that hold images and videos. It may not be as huge as you might imagine.
__________________
"The greatest obstacle to discovery is not ignorance -- it is the illusion of knowledge."
--Daniel J Boorstin
  #6  
Old 06-15-2018, 01:06 PM
EinsteinsHund EinsteinsHund is offline
Member
 
Join Date: Jul 2009
Location: NRW, Germany
Posts: 2,203
Quote:
Originally Posted by Jasmine View Post
Words take very little "space". Images and videos really add up, but they are not allowed, just links to other places that hold images and videos. It may not be as huge as you might imagine.
I know, I know, I'm in IT for 25 years, I don't imagine it to be very big. But I was just interested in the actual size.
__________________
And if my thought-dreams could be seen
They’d probably put my head in a guillotine

Last edited by EinsteinsHund; 06-15-2018 at 01:06 PM.
  #7  
Old 06-15-2018, 01:12 PM
Darren Garrison Darren Garrison is offline
Guest
 
Join Date: Oct 2016
Posts: 7,480
Hm. For a very rough guess, take those 21 million posts and guess an average length of 500 8-bit characters (because, why not that number) would give a database in the range of 10 GB uncompressed. So the real size is probably within a power of 2 or so of that number.
  #8  
Old 06-15-2018, 03:14 PM
Musicat Musicat is online now
Charter Member
 
Join Date: Oct 1999
Location: Sturgeon Bay, WI USA
Posts: 20,312
10GB, eh? So I could store the whole thing in my computer just in the extra space between the disks.
  #9  
Old 06-17-2018, 01:47 PM
CCitizen CCitizen is offline
Guest
 
Join Date: Apr 2012
Posts: 1,619
I have a 64 GB memory stick in my pocket.

Text takes up very very little space -- 10 GB for the whole SDMB.
  #10  
Old 06-17-2018, 03:32 PM
Leo Bloom Leo Bloom is offline
Member
 
Join Date: Jun 2009
Location: Here
Posts: 12,623
And you are walking around with the whole SDMB in your pocket because...

"Just research for this thread?" Tell it to the judge.

ETA: Charges withdrawn. Misread a hypothetical.

Although I, for one, wouldn't even know how to actually do such a thing as put SDMB in my pocket (isn't that cute?) or hide it from Zotti under a thimble.

Last edited by Leo Bloom; 06-17-2018 at 03:36 PM.
  #11  
Old 06-17-2018, 04:01 PM
Ruken Ruken is online now
Charter Member
 
Join Date: May 2003
Location: DC
Posts: 6,108
What sort of fun modeling could you do with it? NLP to flag suspected socks comes to mind.
  #12  
Old 06-17-2018, 07:03 PM
Leo Bloom Leo Bloom is offline
Member
 
Join Date: Jun 2009
Location: Here
Posts: 12,623
"NLP?"
  #13  
Old 06-17-2018, 09:56 PM
Riemann Riemann is online now
Guest
 
Join Date: Nov 2015
Location: Santa Fe, NM, USA
Posts: 4,605
A.I. - natural language processing
  #14  
Old 06-19-2018, 09:53 AM
Spiderman Spiderman is online now
Guest
 
Join Date: Oct 2000
Location: somewhere East of there
Posts: 9,176
Quote:
Originally Posted by Leo Bloom View Post
And you are walking around with the whole SDMB in your pocket
or are you happy to see [her]?
  #15  
Old 06-19-2018, 04:51 PM
Tibby or Not Tibby Tibby or Not Tibby is offline
Guest
 
Join Date: Oct 2005
Posts: 2,538
Quote:
Originally Posted by CCitizen View Post
I have a 64 GB memory stick in my pocket.
<snip>
[Mae West] Why don’t you come up and see me sometime, big boy? [/Mae West]
  #16  
Old 06-22-2018, 06:26 AM
JKellyMap JKellyMap is online now
Member
 
Join Date: Mar 2005
Location: Wisconsin
Posts: 8,713
Quote:
Originally Posted by Tibby or Not Tibby View Post
<snip>
[Mae West] Why don’t you come up and see me sometime, big boy? [/Mae West]
It’s longer than she thought.
__________________
"All he really 'knew', he said, was the extent of his own ignorance. (This to me is still the definition of an educated person.)" -- Christopher Hitchens
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off

Forum Jump


All times are GMT -5. The time now is 09:39 PM.

Powered by vBulletin® Version 3.8.7
Copyright ©2000 - 2018, vBulletin Solutions, Inc.

Send questions for Cecil Adams to: cecil@straightdope.com

Send comments about this website to: webmaster@straightdope.com

Terms of Use / Privacy Policy

Advertise on the Straight Dope!
(Your direct line to thousands of the smartest, hippest people on the planet, plus a few total dipsticks.)

Publishers - interested in subscribing to the Straight Dope?
Write to: sdsubscriptions@chicagoreader.com.

Copyright © 2018 STM Reader, LLC.

 
Copyright © 2017