We do know that: it doesn’t. Physics obeys a principle of locality:
In physics, the principle of locality states that an object is influenced directly only by its immediate surroundings. A theory that includes the principle of locality is said to be a “local theory”. This is an alternative to the concept of instantaneous, or “non-local” action at a distance. Locality evolved out of the field theories of classical physics. The idea is that for a cause at one point to have an effect at another point, something in the space between those points must mediate the action. To exert an influence, something, such as a wave or particle, must travel through the space between the two points, carrying the influence.
So I don’t have to worry about what’s happening on Mars when I throw a baseball on Earth, billiard balls don’t have to worry about other balls around them, and cells (or whatever) don’t have to worry about whether they’re part of a network: they just react to what directly impinges on them in the same ways.
Even in quantum mechanics, whatever stance one might take on the issues surrounding Bell inequality violations, we have a principle known as ‘signal locality’ which ensures that what happens over here doesn’t influence processes over there; in fact it’s a theorem that can be straightforwardly proven from its basic formalism.
So, this is just not right.
Anyway, I may be guilty of leading you down a blind alley here. Ultimately, the question of locality really has nothing to do with the zombie argument; I was hoping to build some intuition for the conceivability-claim by means of the billiard ball example, but evidently, that failed. What really matters is just the causal closure of physics: it ensures that all physical processes can be conceived of—are consistently possible—without any conscious experience; so just the bare physical facts appear not to fix the facts regarding experience.
As I noted, I think this argument ultimately fails, although the reasons it does so are quite subtle. So I think I’ve spent enough of my time trying to explain an argument I don’t really think works, in the end, just to point out that trying to dismiss it for shallow reasons or based on misunderstandings is just going to mislead. If you’re interested in the current discourse on this, I think the Stanford Encyclopedia-article I linked earlier is a good starting point (although it’s a bit dated and is missing important later developments, such as Chalmer’s explication of conceivability via two-dimensional semantics).