In addition to the list given in the article "Why do you see signs saying, “clean fill wanted”?:
Organic material is also rejected … no compost or branches or leaves or anything else that will decompose in the soil and create a void.
Some places accept chunks of concrete, others don’t … sometimes is depends on how much it’s broken up. Any fill has to be compacted and tested for compactness before a building’s foundation can be set on it. This tends to be expensive, so for just a couple of feet down, typically the builders will just dig out the fill until they reach “undisturbed” earth and set the foundation on that. Houses themselves aren’t god-awful heavy, but we’re subject to four foot or better snow loads and the two can and will break a foundation if there’s nothing under it to support the weight.