Why does syntax vary with language?

Time flies, like an arrow
Time flies, arrow-like
Time, like an arrow, flies
Arrow-like, time flies
Arrow-like, flies time
Flying, arrow-like; time

So if a language becomes flexible enough to permit different syntax, it can become inflexible again, but in a different direction.

A recipe or grocery list might be similar in this regard, but I wouldn’t call any of these examples of real syntax.

But what about languages like Latin, where a complicated system of inflection allows for much greater if not total syntactic freedom? Considering that most other European languages have simultaneously moved toward rigid syntax rules while most of the inflections have disappeared, how do those languages fit into the above scenario? Is it possible that some precursor of PIE had simple morphology and rigid syntax, like English, and then acquired the seven or so declensions, four or five cases, and three grammatical genders characterize, say, Lithuanian?

I think you’re conflating syntax and word order here. Latin speakers were not constrained by a rigid word order, but that does not mean you can say that Latin is characterized by greater syntactic freedom than other languages.

A good book for learning about how and why languages change is The Unfolding of Language by Guy Deutscher.

I’ve read that the Insular Celtic languages (but not Continental Celtic) have VSO word order. Since changes in word order are rarish and often arise via contact, it is hypothesized that languages of the British Isles prior to the Celtics may have had VSO word order.

Since some Semitic and related North African languages (Berber, etc.) are the only “nearby” languages with VSO order, this leads to speculation about the prehistory of Western Europe. (With only a smallish number of plausible Afroasiatic–>Celtic/Germanic cognates, I think such speculations are considered fringish.)

Can’t speak for all of them, but Irish and Scottish Gaelic are both VSO.

Here’s an article about the VSO languages:

Here’s a list of many of them:

So examples of them are the Celtic languages, the Semitic languages, the Polynesian languages, and certain native languages of the Americas.

Fruit flies like a banana.

Sorry, just couldn’t help myself.