Permutation tests

Factual Questions
1

I am using a Spearman’s rho for a list of 5 items. I need to check for significance and if I understand the exhaustive permutation tests, I would calculate the rho for every possible permutation between two rankings 1-5 (120x120=14400 of them) and then calculate the cutoff for the significance level. Like on a one-tailed test, if 144 of the rho’s are bigger than 0.93, then 0.93 would be the cutoff for testing the null hypothesis at p=0.01.

Is there an easy way to do this or a value I can look up on a stats table or do I need to grind this out?

2

The R package combinat can generate the list of permutations pretty easily. After that, it’s just a little bit of code to do the correlations.

Edit: Just to be clear, there is no table of values for this one. You’ll have to do the computations yourself.