OK, first, you’re talking about complementary colors, not complimentary.
Second, the primary colors red, blue, and yellow, while not completely arbitrary, are much more arbitrary than we were led to believe in grade school. At least, I came through grade school with the ideas that these three colors were impossible to produce by mixing and that any other color could be produced by mixing these three (possibly with the addition of black and or white). Neither of these ideas is correct. It’s also not correct to think of red, blue, and yellow as equally spaced on a conceptual color wheel. Therefore, it’s a bad assumption that the relations of red to green, blue to orange, and yellow to purple will be in any way equivalent. Basically, everything I thought I knew about color up till fairly recently was wrong. I wish I had ditched class more often.