I doubt that it’s any kind of official standard, but it does seem to be customary; the vast majority of the AGP slots I’ve seen have been brown. The ones that were other colors were often found on motherboards that were creatively colored in other ways (like this one, with a white AGP slot and blue PCI slots).
Like this. From what I’ve seen, no color seems to be prevalent among PCIe slots.