There’s a hierarchy. If you’re going up the hierarchy, you’re uploading.
The hierarchy is something like:
Cloud > anything
Datacenter server > branch office server
Server >= PC, workstation (notice the >=, here)
Server > smartphone
PC = PC
To some extent, PC > small or passive device (smartphone, iPod, router)
If you’re working at Microsoft, and you talk about an ordinary person transferring the Office installer from “your” server farm to their home computer for installation, you’ll still call it a download.
Similarly, a person transferring a new video to YouTube for publication is uploading from their point of view, but also from the point of view of someone working at YouTube.
In a peer-to-peer (=) situation, yes, it does become a question of point of view. In such cases, I think people tend to talk about copying files or transferring data, rather than uploading and downloading.
BitTorrent would count as “Cloud”, I think.