It wasn’t so much a “problem” as a “feature.” An odd quirk, if you will. For 15 fraternity guys in a camp (which is what it really was, but could have easily been improved to a home), having fun on a weekend, it was amusing. To a family, you’d learn it’s quirks, and avoid them.
I’m certain that the quilts are plenty to break up the sound travel, especially if hung downward like “flags.” Here’s conversation giving a bit more on that.
If you’re the right kind of people, it could be fun.
I think it’s like any type of specialty housing product. If it was built well, with quality materials, it’s a fine house, with a unique set of properties. If it wasn’t… well… It’s not for someone that needs a 3800ft^2 McMansion.