# How valid is this statistical study? **URL:** \ **Category:** Factual Questions\ **Created:** [April 12, 2015, 5:53am UTC](https://boards.straightdope.com/t/how-valid-is-this-statistical-study/717476 "2015-04-12T05:53:23Z")\ **Posts on this page:** 4\ **Page:** 1
**Author:** ![rowrrbazzle](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/rowrrbazzle/32/414_2.png) [@rowrrbazzle](https://boards.straightdope.com/u/rowrrbazzle)\ **Post date:** [April 12, 2015, 5:53am UTC](https://boards.straightdope.com/t/how-valid-is-this-statistical-study/717476/1 "2015-04-12T05:53:23Z")
“Men And Women Use Different Scales To Weigh Moral Dilemmas” [Men And Women Use Different Scales To Weigh Moral Dilemmas : Shots - Health News : NPR](http://www.npr.org/blogs/health/2015/04/03/397280759/men-and-women-use-different-scales-to-weigh-moral-dilemmas) Study abstract (full paper behind paywall): [http://psp.sagepub.com/content/early/2015/03/12/0146167215575731.abstract](http://psp.sagepub.com/content/early/2015/03/12/0146167215575731.abstract) > [@](#): > > The principle of deontology states that the morality of an action depends on its consistency with moral norms; the principle of utilitarianism implies that the morality of an action depends on its consequences. Previous research suggests that deontological judgments are shaped by affective processes, whereas utilitarian judgments are guided by cognitive processes. The current research used process dissociation (PD) to independently assess deontological and utilitarian inclinations in women and men. A meta-analytic re-analysis of 40 studies with 6,100 participants indicated that men showed a stronger preference for utilitarian over deontological judgments than women when the two principles implied conflicting decisions (d = 0.52). PD further revealed that women exhibited stronger deontological inclinations than men (d = 0.57), while men exhibited only slightly stronger utilitarian inclinations than women (d = 0.10). The findings suggest that gender differences in moral dilemma judgments are due to differences in affective responses to harm rather than cognitive evaluations of outcomes. I know almost nothing about statistics. How significant is this apparent difference between men and women? ---
**Author:** ![thelurkinghorror](https://avatars.discourse-cdn.com/v4/letter/t/7c8e57/32.png) [@thelurkinghorror](https://boards.straightdope.com/u/thelurkinghorror)\ **Post date:** [April 12, 2015, 7:33am UTC](https://boards.straightdope.com/t/how-valid-is-this-statistical-study/717476/2 "2015-04-12T07:33:35Z")
Slow server ate my post, apologize if it becomes a double post. I only read the abstract, and I don’t know much about meta-analyses. But the abstract does not mention significance. That is denoted by “p.” Properly speaking, you cannot say “how significant” something is, because it either is or isn’t; you can only be more certain you made the right decision in rejecting or accepting the null hypothesis. The “d” is presumably Cohen’s d which is a measure of effect size. Significance tells you whether the means are _likely_ different (or not). Effect size tells you _how large_ the difference is. But generally speaking, reporting d means that they also found a significant difference. d ~= 0.5 is generally considered a “medium” effect size. d ~= 0.1 is small. Because it is a meta-analysis, and based upon what I expect from this type of research (one that has low power without many subjects, etc.), a medium effect size is substantial. This says nothing about the validity of the analysis, or whether this is a good study, or whether the results actually mean anything that we care about. I gather that they are saying males and females use different affective responses rather than cognitive. I’m not sure I’d use d to make that conclusion personally, but that may be better justified in the body of the paper. ---
**Author:** ![Napier](https://avatars.discourse-cdn.com/v4/letter/n/ce73a5/32.png) [@Napier](https://boards.straightdope.com/u/Napier)\ **Post date:** [April 12, 2015, 12:02pm UTC](https://boards.straightdope.com/t/how-valid-is-this-statistical-study/717476/3 "2015-04-12T12:02:52Z")
The conclusion is consistent with that of the book “In a Different Voice” by Carol Gilligan, in the early or mid 80’s, IIRC. ---
**Author:** ![lazybratsche](https://avatars.discourse-cdn.com/v4/letter/l/ba8739/32.png) [@lazybratsche](https://boards.straightdope.com/u/lazybratsche)\ **Post date:** [April 12, 2015, 1:25pm UTC](https://boards.straightdope.com/t/how-valid-is-this-statistical-study/717476/4 "2015-04-12T13:25:58Z")
The effect size _d_ is simply the difference between two group means divided by the (pooled) standard deviation. Wiki has a [handy figure](http://en.wikipedia.org/wiki/Effect_size#/media/File:Cohens_d_4panel.svg) showing what _d_ = 0.5, 1, 2, or 3 looks like. Note that at _d_ = 0.5 there is a lot of overlap between the two distributions. Going back to the study (and not knowing a damn about psychology) that there may be a real difference between the way men and women make moral judgements. However, there is still a lot of overlap: assuming a normal distribution with some “utilitarian” score on the x axis, 30% of women are at least as “utilitarian” as the the average man. (Man I love working in a field where I can say “nope too ambiguous! don’t care!” to _d_ \< 2)