I’m not convinced that their chief objection isn’t based on the very same principles as any cult. To keep your sheep cult members from wondering off, you need to continue to re-enforce dependence and structure. Lose control and you loose the flock. So I very much doubt it’s an objection to not being able to form a minyan for prayer. I think it’s about religious zealotry and fear of intrusion on established control by the outside world; a world they work very hard to keep at bay.
It would be very hard to convince me that these people are not every bit the brain washed cult members like WBC and Scientologists, among others.