Isn’t it great? I wrote a paper on it last semester, actually, which involved a complicated network of ideas involving poetry, patronage, and the fact that purse could be Middle English slang for the scrotum (though the usual phrase when it’s used in that sense is “nether purse”). The ideas were better than the actual execution, though, and the prof was of the same mind.
Well, I can always revise it. Grad school means never being finished with anything. 
More Middle English for you: the anonymous poem Against Blacksmiths. This one’s fun. 
(This site has a bunch of Middle English poems, with translations. Look at the Middle English first, because it’s highly cool. ;))
And how about some Old English while we’re at it? Here’s the wonderfully cryptic poem Deor (also with translation; a newcomer can generally muddle through at least some Middle English but Old English requires study. I still suck at it after two semesters, but then, I didn’t study it very hard. ;))
More poetry…
The Grasshopper, Richard Lovelace
Inviting a Friend to Supper, Ben Jonson
The Flea, John Donne
I couldn’t find an e-text for John Skelton’s “Speak, Parrot,” which I’ve just encountered recently and am, perversely, beginning to like, but here’s the end of it. It’s a weird, weird poem, and extremely esoteric (you have to know quite a bit about the court of Henry VIII, and especially about Cardinal Wolsey, to follow it – in fact, you need to know rather more than I do), but the part linked is pretty comprehensible. 