MS Outlook hijacks removable media. Why? And can I stop it?

I never seem to be able to remove removable media unless I close Outlook.

Outlook has no open emails with attachments or anything. I can’t see any reason why Outlook should stop a removable device from being removed.

Any ideas?

(To clarify - I am talking about safe removal - I get the device cannot be removed error)