Actually, I’d say that #1 is practically incidental. It’s just the only arena that behaves purely rationally enough to really get anywhere with #2.
I’ve known quite a few physicists and engineers who seem to know things intuitively and nabvigate “by the seat of their pants”, rather than by rigorous math. At one company I worked at I developed a reputation for being good at math, because I took the time and effort to prove things that the other scientists and engineers sort of assumed or hand-waved their way past. It’s not that they didn’t know math (I saw ample evidence to the contrary), but in some cases I thjink they felt they couldn’t be bothered, or else this particular application was in a blind spot. It was regarded as siognificant that I worked through these matters.
An awful lot of scientists have a particular blind spot in the area of probability and statristics, which I feel isn’t sufficiently well-taught at the graduate level. When I was in grad school, I had to answer the question "What is the probability that the nearest neighbor of a particle is a distance *r[/r] away, given an average uniform density of these throughout space? I was surprised at the number of incorrect answers I got, including one in a paper I dug out. To their credit, the methods of solution they all gave me gave the correct order of magnitude of the result, but most of them did not give the correrct expression. It was such an interesting and obscure problem that I devoted an appendix of my thesis to it. (There were various correct solutions. Chandrasekar gets top credit with a two-line proof of the correct formula.)
This particular example is good for illustrating one of the key differences between mathematicians and physicists. Physicists want to know how to do something, but mathematicians want to understand why that method works. To a physicist doing relativity, a covector is one for which one writes the indices “downstairs”, that is, as subscripts. Using the Einstein Summation Convention, a notation which is very useful for dealing with tensors, that’s all you need to know: Some objects have indices upstairs, some have indices downstairs, and upstairs and downstairs indices interact in particular ways. Almost everything we need to know about tensors is how to work with them, and almost everything we need about how to work with them is encoded in Einstein notation, so that’s what we learn and use. Mathematicians will learn more rigourous definitions, and we physicists generally encounter those definitions once or twice in a class, but we don’t use them, so we don’t remember them
More directly to the point, physicists seem to think that indices actually mean something, while a mathematician knows they’re completely artificial (artifactual?).