# Permutation tests

**URL:** <https://boards.straightdope.com/t/permutation-tests/535450>\
**Category:** Factual Questions\
**Created:** [April 8, 2010, 7:42pm UTC](https://boards.straightdope.com/t/permutation-tests/535450 "2010-04-08T19:42:00Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Saint\_Cad](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/saint_cad/32/18907_2.png) [@Saint\_Cad](https://boards.straightdope.com/u/Saint_Cad)\
**Post date:** [April 8, 2010, 7:42pm UTC](https://boards.straightdope.com/t/permutation-tests/535450/1 "2010-04-08T19:42:00Z")

</div>

I am using a Spearman’s rho for a list of 5 items. I need to check for significance and if I understand the exhaustive permutation tests, I would calculate the rho for every possible permutation between two rankings 1-5 (120x120=14400 of them) and then calculate the cutoff for the significance level. Like on a one-tailed test, if 144 of the rho’s are bigger than 0.93, then 0.93 would be the cutoff for testing the null hypothesis at p=0.01.

Is there an easy way to do this or a value I can look up on a stats table or do I need to grind this out?

---

<div class="post-metadata">

**Author:** ![ultrafilter](https://avatars.discourse-cdn.com/v4/letter/u/3d9bf3/32.png) [@ultrafilter](https://boards.straightdope.com/u/ultrafilter)\
**Post date:** [April 8, 2010, 9:18pm UTC](https://boards.straightdope.com/t/permutation-tests/535450/2 "2010-04-08T21:18:22Z")

</div>

The R package combinat can generate the list of permutations pretty easily. After that, it’s just a little bit of code to do the correlations.

Edit: Just to be clear, there is no table of values for this one. You’ll have to do the computations yourself.
