When is it not appropriate for the POTUS to stay abroad?

When did anyone ever say this?

I believe that should be read with your tongue firmly planted in your cheek.