Vermont.
Depending on your generation: Rudy Valee, Phish, or Grace Potter.
Hmm…I thought William Penn (it’s his sylvania, after all) predated Ben. And he’s allegedly on the Quaker Oats label. Ben’s on the $100 bill, but I’m never rich enough to be seeing those more than once per decade.
Weren’t Areosmith and Bon Jovi from New Jersey? The latter group reminded everyone of that with their third (fourth?) album title.
Weren’t the Alman brothers out of Alabama?
Texas gave us ZZtop, Stevie Ray Vaughan, and the Texas Roadhouse style of Blues.
This being California, we’ve got all sorts of celebrities connected to records (music), film (movies), television, video (porn), and so on. Just for the #e!! of it, I nominate Ginger Lynn.
–G!
The Allman Brothers Band was based out of Macon, GA, but did recording out of Muscle Shoals, AL, among other places.
The actual brothers, Duane and Gregg, were both born in Nashville.
Take your pick. 
As a native of the Old Dominion, I humbly push forth Mr Thomas Jefferson as worthy of representing Virgina as well.
I now live in Georgia, and I would put MLK ahead of Ray Charles.
I think Ripken isn’t a bad choice for Maryland, although H.L. Mencken was who popped to mind for me. Or maybe Edgar Allan Poe?
I’ve been in MD for a decade or so, but grew up in Missouri. I’d nominate Mark Twain as MO’s Elvis.
There are still a lot of states unaccounted for.
Nebraska would be a tough one. Probably William Jennings Bryan. I’d like to say Johnny Carson, since he was always unqualifiedly proud of being from Nebraska and has funded a number of things in the state, but he never came back to live and his visits were seldom (and mostly private).
In a similar fashion, Marlon Brando was born in Omaha and Henry Fonda in Grand Island. And Dick Cavett was from Gibbon.
Louisiana: I give you Louis Armstrong and Edwin Edwards.
Kansas: John Brown? L. Frank Baum?
Minnesota: Hubert Humphrey? Garrison Keillor?
New Hampshire: Daniel Webster?
Rhode Island: Even now, I’d have to think it’s Roger Williams
Massachusetts: So much history, and yet… John or Edward Kennedy may be the most iconic.
True, but they had even less to do with the state than Carson did. Carson at least got his start on Omaha television and radio, and he is well-marked on the landscape. A school of performing arts and an experimental theater are named for him at the University, and his childhood home is something of a tourist attraction (well, at least there’s a sign). There are zero monuments or markers to Brando in Omaha. Fonda’s home is kept on a museum campus, but otherwise…zilch. Cavett did a spot for the state art museum years ago, but it didn’t seem like that chore had his full attention.
Wisconsin: Vince Lombardi?
North Carolina: Dean Smith or Mlke Kryszewski?
Another Kansas icon: Wyatt Earp?
William Jennings Bryan is a very good choice. Willa Cather would be another strong contender.
Interesting choice, but to outsiders, Daniel Boone is still the first guy picture when thinking of Kentucky (Abe Lincoln may be second).
As a complete and utter outsider to Kansas, the first person who comes to mind for me is definitely John Brown. Well, and a certain Dorothy, but I’m assuming fictional characters aren’t allowed. 
Iowa is tough, but how about Meredith Willson?