Mold spores and mycotoxins in lungs

Wonder if a mycologist can chip in with some knowledge here:

So I have seen from one source that various molds, such as aspergilus and penicilium, emit mycotoxins essentially willy-nilly and these float about in the air like vapors, but then another source says that such mycotoxins aren’t emitted unless someone inhales them into the lungs AND they grow colonies in the lungs; which is right?

The whole “mold is a dire health threat” is completely overblown. Here is what the CDC says about mold: