New neighbors [what bushes are cheap and grow fast?]

One thing for the OP to consider, make sure who owns that fence. You say you and your neighbor share it, but it’s on someone’s property. If it turns out to be his, with any room to spare on your side, he can dig up anything you plant! Make sure either the fence is yours, or know where your property ends so you can plant on your land and he can’t dig it back up. He sounds like the kind of guy who will do it if he can.

Oh–take a look at ornamental currants, too.

If your climate will support it, Bougainvillea.

Fast-growing, very colorful, needs almost no water, ruthlessly thorny. Needs frequent trimming and if cut down very low will quickly grow back. But first, check your property line location and plant a good foot and a half on your side of it. Bougainvillea is very nasty to anyone trying to pass through it, so it has a good security aspect as well.

My father used to say Hell has plenty of water for its residents, but they must cut through thick stands of bougainvillea to get at it. And Satan does not provide protective gloves.

Totally agree, which is why I’ve used them strategically in situations where I planned to take them down in ten or fewer years.

Wow you guys gave me some great ideas. I am going to a few different nurseries this weekend to get some pricing. Sound like forsythias might be the best idea.
Thank you for all your input.