I used to fly fighters.
In appropriately cleared territory the USAF rules said we could operate at 100 feet above the ground. At speed. Like >600 mph speed.
Those areas don’t tend to have almost zero houses, they tend to have exacly zero houses.
In areas where there were/are occasional houses, the rules provided we had to keep 1000 feet (~1/4 mile) away, laterally or vertically or some combination. The general FAA rules for civilians are to keep >500 feet distant from people and buildings when in a sparsely populated area. We were stuck with 1000 becasue we were a hell of a lot noisier than a typical Cessna.
As a practical matter, the routes we flew when not over Gov’t-owned totally-house-free ground were set up to minimize even the occasional farmhouse and often had higher altitude restrictions in sections where there were farm houses.
So that’s the legalities.
Now the practicalities …
100 feet above the ground is only doable on really smooth terrain, *a la *Kansas or the Southwest desert. Over really smooth terrain (dry lake bed, water, etc) you could get lower than 100 ft, but at that point it took 100% of your concentration to not hit the surface. Even a moment’s attention to anything else risked tying, yet again, the record for low altitude flight in a fighter. Nobody’s ever broken that record, which stands at zero feet, and nobody since the olden days of very slow fighters has survived the attempt. So we didn’t do that.
With even gently rolling hiills of a couple hundred feet peak to trough you’d be hard-pressed to get much below 3-400’ AGL when cutting *across *the small valleys without hitting the trees on the way in or out.
You can run *along * even a narrow valley a good long way at 100 ft. But with our turn radius, we’d often have to squirt out the top when the valley turned more sharply than we could.
Finally, as to effects on the ground. The term you’re looking for is “wake” or “wake turbulence”. Some guys in my squadron did overfly a campsite at speed at pretty close to zero altitude one day. Tents went everywhere and the camper’s horses apparently didn’t stop running until they got to the next time zone. The Boss was not impressed.
I have standing out on the ground and got buzzed by somebody doing about 450 mph at about 50’ The noise was very impressive, and the wake shook the shit out of the 15’ saplings nearby. The wake made a very loud eeery whistling sound and was a strong gusty wind for 10-15 seconds. But I’ve felt far stronger just before a garden-variety thunderstorm opened up on me.
You can do some searching and come up with videos of low altitude high speed passes over water which include kicking up a bit of a water wake. same idea.