# Meta studies

**URL:** https://boards.straightdope.com/t/meta-studies/655849
**Category:** Factual Questions
**Created:** [April 16, 2013, 4:56pm UTC](https://boards.straightdope.com/t/meta-studies/655849 "2013-04-16T16:56:06Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![dauerbach](https://avatars.discourse-cdn.com/v4/letter/d/c2a13f/32.png) [@dauerbach](https://boards.straightdope.com/u/dauerbach)
#### Post date: [April 16, 2013, 4:56pm UTC](https://boards.straightdope.com/t/meta-studies/655849/1 "2013-04-16T16:56:06Z")

</div>

It seems to me that there are many more meta analysis published now than were done say 20 years ago. I assume that statistics has not evolved. I suspect that the cause might be the proliferation of predatory journals, or perhaps I am just not remembering things accurately. Has anyone done a study of this?

---

<div class="post-metadata">

### Author: ![njtt](https://avatars.discourse-cdn.com/v4/letter/n/ecd19e/32.png) [@njtt](https://boards.straightdope.com/u/njtt)
#### Post date: [April 16, 2013, 7:07pm UTC](https://boards.straightdope.com/t/meta-studies/655849/2 "2013-04-16T19:07:13Z")

</div>

So you are looking for a study of studies of studies, huh?

---

<div class="post-metadata">

### Author: ![Canadjun](https://avatars.discourse-cdn.com/v4/letter/c/76d3ee/32.png) [@Canadjun](https://boards.straightdope.com/u/Canadjun)
#### Post date: [April 16, 2013, 7:23pm UTC](https://boards.straightdope.com/t/meta-studies/655849/3 "2013-04-16T19:23:17Z")

</div>

You need to have studies before you can do studies of studies (and studies about studies of studies and…). There have been lots of studies done in the past 20 years.

---

<div class="post-metadata">

### Author: ![dauerbach](https://avatars.discourse-cdn.com/v4/letter/d/c2a13f/32.png) [@dauerbach](https://boards.straightdope.com/u/dauerbach)
#### Post date: [April 16, 2013, 7:33pm UTC](https://boards.straightdope.com/t/meta-studies/655849/4 "2013-04-16T19:33:36Z")

</div>

It is true that there has been, but honestly there were plenty before that as well. It does not explain why (assuming they truly have increased).

Another thought is that perhaps some statistical tool has become accepted in the interval to explain this increase.

---

<div class="post-metadata">

### Author: ![TriPolar](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/tripolar/32/3008_2.png) [@TriPolar](https://boards.straightdope.com/u/TriPolar)
#### Post date: [April 16, 2013, 7:34pm UTC](https://boards.straightdope.com/t/meta-studies/655849/5 "2013-04-16T19:34:31Z")

</div>

This is a very controversial subject. Properly conducted meta-studies accurately reflect the results of prior studies. Whether or not that is broadly meaningful is hotly debated. So if you are interested in characteristics of the prior studies then a meta-study can be useful. If you are drawing conclusions about the subject of the original studies you end up with a lot of arguments.

ETA: The expansion of this technique in the last 20 years has a lot to do with more readily available information and analytical tools.

---

<div class="post-metadata">

### Author: ![Buck\_Godot](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/buck_godot/32/6573_2.png) [@Buck\_Godot](https://boards.straightdope.com/u/Buck_Godot)
#### Post date: [April 16, 2013, 7:44pm UTC](https://boards.straightdope.com/t/meta-studies/655849/6 "2013-04-16T19:44:50Z")

</div>

> [@dauerbach](#):
>
> It is true that there has been, but honestly there were plenty before that as well. It does not explain why (assuming they truly have increased).
> 
> Another thought is that perhaps some statistical tool has become accepted in the interval to explain this increase.

I suspect it has to do with the advent of computers and data reporting requirements. Before in order to get data from multiple studies you would have to contact multiple authors and get them to send you their data, which would involve a great deal of effort to them with little payoff. Now days journals generally require that the data be made publicly available online so getting data from multiple studies just involves a few mouse clicks.

---

<div class="post-metadata">

### Author: ![ultrafilter](https://avatars.discourse-cdn.com/v4/letter/u/3d9bf3/32.png) [@ultrafilter](https://boards.straightdope.com/u/ultrafilter)
#### Post date: [April 16, 2013, 9:09pm UTC](https://boards.straightdope.com/t/meta-studies/655849/7 "2013-04-16T21:09:32Z")

</div>

> [@dauerbach](#):
>
> I assume that statistics has not evolved.

That’s a pretty questionable assumption.

---

<div class="post-metadata">

### Author: ![moriah](https://avatars.discourse-cdn.com/v4/letter/m/b2d939/32.png) [@moriah](https://boards.straightdope.com/u/moriah)
#### Post date: [April 17, 2013, 3:22pm UTC](https://boards.straightdope.com/t/meta-studies/655849/8 "2013-04-17T15:22:29Z")

</div>

Well, as folks like Nate Silver have shown in pooling polls and accurately predicting the last US elections, pooling the results of studies gives you a larger sample. If the original studies don’t have flaws and the aggregator doesn’t cherry pick studies, then aggregating studies should lead to better and more confident results.

It’s also a way to gather disparate studies, some of which may have never gotten the notice they deserved. It also serves to answer the question: Do we need a newer and better study on this issue, or has enough work already been done?
