It depends on what you mean by “the primordial light of the Big Bang”. The furthest back we can see is to about 300,000 years after The Beginning, using microwave telescopes such as MAP (images of that first light are available on that webpage). This is not the first light that ever existed, because before that time, the Universe was essentially opaque to light: You’d have light, but it would only travel a short ways before it would be absorbed by some particle and re-emitted. At about 300,000 years, the Universe cooled down enough that it de-ionized, and at that point, abruptly became very transparent, so any light that was around at that time just kept on going and going, and some of it is reaching us now. This was significantly before the formation of galaxies and other interesting structures in the Universe, so yes, we can and do see very early galaxies being formed in telescopes.
Note that the limitations I mentioned above apply only to the various sorts of light. There are other ways to “look” at the Universe which are less limiting. Neutrinoes, for instance, interact much less with matter than light does, so the Universe became effectively transparent to neutrinoes earlier than for light. That takes us back to about 200,000 years after The Beginning. And gravity interacts far more weakly yet; we have not yet been able to directly detect gravitational radiation, but it’s believed that once we build good enough detectors, we’ll be able to “see” gravitational waves which originated a mere 10[sup]-20[/sup] seconds, or even earlier, after The Beginning. If, that is, NASA ever gets the funding to build the durned things, which at the moment looks somewhat unlikely.
