May 2020 probabilistic senate prediction competition

To check my understanding of the scoring, I compared Calavera’s score to mine in three cases.

Case a) Calavera’s predictions are all correct
Case b) Calavera’s except Collins wins in Maine
Case c) Calavera’s except Collins wins and Tillis is defeated

Calavera’s score
a) 0 (perfect)
b) -1
c) -2

Septimus’ score
a) -.8275
b) -.9275
c) -1.0275

Arithmetic to compute Septimus’ score
a) 0 -0 -.04 -.01 -.04 -.09 -.04 -.04 -0 -.2025 -.04 -.1225 -.2025
b) 0 -0 -.04 -.01 -.04 -.09 -.04 -.04 -0 -.3025 -.04 -.1225 -.2025
c) 0 -0 -.04 -.01 -.04 -.09 -.04 -.04 -0 -.3025 -.04 -.1225 -.3025

If several people enter the contest, presumably some will take the opportunity to play for perfect scores in cases b and/or c. I’m not sure that splitting the prize money among all those tied for best score is the right approach here.

@ Lance – Does this look correct?

Your calculations are not correct. It’s mean squared error.


Scenario	Lance Turbo	septimus	Calavera
a		0.0889		0.0637		**0.0000**
b		0.1232		**0.0713**		0.0769
c		0.0933		**0.0790**		0.1538

How did prediction markets do for Clinton vs. Trump? I know most “experts” predicted Clinton to win easily. Including many UK bookies. Nate Silver was a rare case where he gave Trump about 1/3 chance of winning.

I’ll bet you $100 to charity of your choice if Tillis loses.

I won’t bet you for two reasons…

If you don’t wish to participate in this competition, just don’t participate.

I think your numbers become almost[sup]*[/sup] identical to mine if you multiply by (-13) but you’ve come to the right message-board to practice pedantry! :slight_smile:

[sup]*[/sup] - Only almost identical because my numbers are exact; yours are rounded.

No, you won’t. It’s specifically against the rules as of Jan 1 for posters to bet.

Please don’t do so again.

No warning issued.

Still waiting to hear how betting markets did on Trump v Clinton in 2016?

Why?

This thread is about probabilistic forecasts.

In other words, they did badly.

No.

If you’d like to discuss the effectiveness of betting markets at predicting political outcomes, start a thread. I think you’ll be surprised at what you learn.

If you’d like to participate in the competition in this thread, submit an entry.

Hey, maybe you guys that want to argue about how good or how useful polls are- can start another thread, and leave us to discuss the Op and senate predictions? Please? We know polls arent always accurate. Thankyouverymuch.

IIRC they did MUCH better than most pundits. Pundits — and Dopers — thought Hillary was a shoo-in. Prediction markets, however, were giving Trump a big chance (though not more than 50% IIRC).

I can predict races in October. For now I predict most incumbents will win with a few possible exceptions such as Colorado and Maine and Alabama.

Great. I’ll probably do another competition or two as the election gets closer. You’re welcome to participate in those.

In the meantime, this thread is not for you.

Let’s dial it back a bit, people. We’re all friends, here.

And see this earlier thread on U.S. Senate races nationwide in 2020: https://boards.straightdope.com/sdmb/showthread.php?t=895277

There’s about a week left and there are only three entries thus far, although a couple of other posters dropped in to concede defeat by stating that they could not possibly enter such a contest until October.

Here’s where we stand now including some minor updates to my entry. Others are free to update their entries as well.


Race			Lance Turbo	septimus	Calavera
Alabama			2.7%		0.0%		0.0%
Alaska			7.3%		0.0%		0.0%
Arizona (special)	89.6%		80.0%		100.0%
Colorado		96.2%		90.0%		100.0%
Georgia			26.0%		20.0%		0.0%
Georgia (special)	30.9%		30.0%		0.0%
Iowa			25.2%		20.0%		0.0%
Kansas			19.3%		20.0%		0.0%
Kentucky		9.0%		0.0%		0.0%
Maine			71.0%		55.0%		100.0%
Michigan		87.2%		80.0%		100.0%
Montana			44.6%		35.0%		0.0%
North Carolina		67.1%		45.0%		0.0%

So we have prediction market, pessimistic prediction market, and pessimistic prediction market rounded to the nearest integer ;).

It looks like some form of prediction market derived entry is going to win this thing unless we get some poll or pundit based entries.

Deadline is May 31 11:59:59 PM CDT.

If we get a surge of new entries before month’s end, I will probably move to an all-integer submission, like Calavera. I’ll want whichever such submission seems most likely among the all-integer cases which have not been submitted by anyone else.

@ Lance — I’m not sure what your approach is here, but even supposing prediction perfection — that your submission minimizes expected total squared error — that is NOT the solution contestants should seek, given the Winner-Take-All scoring.

Alabama 1
Alaska 0
Arizona (special) 1
Colorado 1
Georgia 0
Georgia (special) 0
Iowa 0
Kansas 0
Kentucky 1
Maine 1
Michigan 1
Montana 1
North Carolina 1

I’m taking a differently course since you guys are all clustered. I’ll finish either first or last. Still the Dem odds though.

There’s nothing to take (per board rules) so there’s no reason to treat this contest as winner take all.

Integer solutions aren’t really in the spirit of the contest, but I’m not going to disallow them. However, we don’t really learn anything from integer solutions. Sure guessing each race correctly would result in a Brier score of zero, but is that a reproducible method? Is picking the integer solution that you find most likely and hasn’t been picked by anyone else something that something that can be applied to future elections if it wins this contest?

My goal for this thread (and future threads like it) is to determine which probabilistic forecasts produced by the SDMB were most accurate 5 months out, 4 months out, etc. But it’s beginning to look like my PredictIt derived forecast will win that distinction by being the only probabilistic forecast produced.

There’s nothing wrong with a contest to see who can pick the most winners, but that wasn’t the intent of this thread.

If everyone but me picks distinct integer solutions, I’ll probably finish either first or second. That’s a perfectly fine result for my method as far as I’m concerned. If it’s only competition is guessing everything correctly, I’ll be happy.