# How to optimize a constant in an algorithm with multiple constants? **URL:** \ **Category:** Factual Questions\ **Created:** [July 23, 2015, 6:37pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977 "2015-07-23T18:37:31Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![Incensed](https://avatars.discourse-cdn.com/v4/letter/i/eb8c5e/32.png) [@Incensed](https://boards.straightdope.com/u/Incensed)\ **Post date:** [July 23, 2015, 6:37pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/1 "2015-07-23T18:37:31Z")
First off, I’m an interested amateur, obviously not a mathematician or statistician, so I apologize for making mistakes in terminology, and if you could please keep the replies as simplistic as possible, I’d appreciate it. Also, I find I’m having a hard time expressing the problem, so bear with me. A few years ago, I went down the [Sabermetric](https://en.wikipedia.org/wiki/Sabermetrics) rabbit hole, to the point of creating my own run estimator based on [Base runs](https://en.wikipedia.org/wiki/Base_runs), only much, much more complicated. The gist of the problem that I’m having is this- Say that Singles = S, Doubles = D, Triples = T, Homeruns = HR and that - RUNS = (S \* X) + (D \* Y) + (T \* Z) + (HR \* W) Previously in order to optimize the constants (S, D, T, HR), I would have tweaked one of them, then used Root Square Mean Error to determine whether the tweak rendered the formula more or less accurate with regard to the given RUNS. Simple enough in one spreadsheet, but when you have to change the formula and record the results for multiple leagues across multiple years in multiple spreadsheets, you obviously run into a big efficiency problem. So, how does one go about optimizing each of these constants for multiple data sets efficiently, without having to resort to a brute force method of, ‘make a change, record the result, repeat two dozen times,’ as I have previously done? Put another way, is there a way calculate the value of ‘X’ that’s the most accurate across all the data sets combined, but not necessarily the most accurate for each individual data set, without physically combining the data into one spreadsheet? Again, apologies for the lack of clarity. I’ll explain as I’m able. ---
**Author:** ![ddunn801](https://avatars.discourse-cdn.com/v4/letter/d/71c47a/32.png) [@ddunn801](https://boards.straightdope.com/u/ddunn801)\ **Post date:** [July 23, 2015, 8:30pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/2 "2015-07-23T20:30:10Z")
I believe what you are seeking is called multivariable regression. This is a piece of cake for statistical packages such as R. There is an Excel add-in that will do the trick as well. [Link](http://cameron.econ.ucdavis.edu/excel/ex61multipleregression.html) The output of the model is the set of coefficients that will minimize the difference between the actual and the predicted number of runs. As you requested, it is the overall best fit for your data. ---
**Author:** ![Incensed](https://avatars.discourse-cdn.com/v4/letter/i/eb8c5e/32.png) [@Incensed](https://boards.straightdope.com/u/Incensed)\ **Post date:** [July 23, 2015, 8:45pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/3 "2015-07-23T20:45:45Z")
> [@ddunn801](#): > > I believe what you are seeking is called multivariable regression. This is a piece of cake for statistical packages such as R. There is an Excel add-in that will do the trick as well. [Link](http://cameron.econ.ucdavis.edu/excel/ex61multipleregression.html) > > The output of the model is the set of coefficients that will minimize the difference between the actual and the predicted number of runs. As you requested, it is the overall best fit for your data. Sweet. Unfortunately, I’m on a Mac, so I’ll have to look around for an alternative or do some other software finagling. I was wondering if this was more of a math question or a process/software question anyway. Thanks for the input, and any other insight you can give me into the practical side of performing a multivariable regression would be much appreciated. ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [July 23, 2015, 11:16pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/4 "2015-07-23T23:16:57Z")
Your particular optimization problem is quite simple, but others can be far more complicated. For many problems, you can end up with multiple local maxima, and while it’s easy to find one (or more) of those local maxima, it’s nearly impossible to be certain that you’ve found the best of them. ---
**Author:** ![Incensed](https://avatars.discourse-cdn.com/v4/letter/i/eb8c5e/32.png) [@Incensed](https://boards.straightdope.com/u/Incensed)\ **Post date:** [July 24, 2015, 12:48am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/5 "2015-07-24T00:48:47Z")
> [@Chronos](#): > > Your particular optimization problem is quite simple… Is it though? After a bit more consideration, it seems like a multiple regression approach would optimize each variable for the _data set it was run upon_, but I would need to perform the same analysis for each data set and then come up with a weighted average of the results. Does that sound correct? Since we’re into regression, would anyone care to explain the concept of performing a multivariable regression? Or a regression for variable X when there are multiple variables are in play? And since this seems so dead easy to those in the know, exactly what sort of professional would I be able to speak to in order to get a hands on demonstration? Sounds like a statistician, but again, I’m out of my depth here. Thanks all. ---
**Author:** ![DataX](https://avatars.discourse-cdn.com/v4/letter/d/e99b99/32.png) [@DataX](https://boards.straightdope.com/u/DataX)\ **Post date:** [July 24, 2015, 1:18am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/6 "2015-07-24T01:18:34Z")
You can do it in two lines of code in R dataset \<- read.csv(baseball.csv) model \<- lm(RUNS ~ (S \* X) + (D \* Y) + (T \* Z) + (HR \* W), data=dataset) To get summary stats use summary(model) And print(model) I usually don’t use LM as much - and I wouldn’t ever write the formula the way you did - so I might have the syntax wrong - to test you can use: Model \<- lm(RUNS ~ ., data=dataset) You might have to add: ,header=TRUE AFTER “dataset” can’t remember default off hand. r is great for this stuff and you can easily use different types of machine learning models by treating a line or two of code To predict on an unknown dataset you load that in as a csv file as the original (but use say - “newdataset” instead of dataset )and simply do: mypred \<- predict(model, newdataset) Then mypred To see The book “R in a nutshell” is pretty good And it has specific examples - including baseball examples (I’m guessing there is at least three in there on baseball - but don’t hold me to that - I know it’s at least one) It pretty fun to be able to do your own machine learning - and was way easier than I expected ---
**Author:** ![DataX](https://avatars.discourse-cdn.com/v4/letter/d/e99b99/32.png) [@DataX](https://boards.straightdope.com/u/DataX)\ **Post date:** [July 24, 2015, 1:27am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/7 "2015-07-24T01:27:05Z")
Oh wait - you don’t put the x y and z in there - I thought they were extra columns - drop them and make it RUNS ~. The dot means “everything else” ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [July 24, 2015, 2:17am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/8 "2015-07-24T02:17:24Z")
> [@](#): > > Is it though? After a bit more consideration, it seems like a multiple regression approach would optimize each variable for the data set it was run upon, but I would need to perform the same analysis for each data set and then come up with a weighted average of the results. Does that sound correct? I’m not sure what you mean by “multiple data sets”. If you have reason to believe that the values would be different for Little League and for professionals (for one thing, Little Leaguers hit a lot more triples than pros do), then you do the analyses separately, and get separate conclusions from them, and ne’er the twain shall meet. If, however, you want a single set of numbers for baseball as a whole, across all leagues, then you lump all of your data together into a single data set. But no matter what data set you’re working with, your problem is still going to be pretty simple. ---
**Author:** ![bump](https://avatars.discourse-cdn.com/v4/letter/b/7c8e57/32.png) [@bump](https://boards.straightdope.com/u/bump)\ **Post date:** [July 24, 2015, 2:19am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/9 "2015-07-24T02:19:05Z")
> [@Incensed](#): > > Is it though? After a bit more consideration, it seems like a multiple regression approach would optimize each variable for the _data set it was run upon_, but I would need to perform the same analysis for each data set and then come up with a weighted average of the results. Does that sound correct? Or just a data set that’s sufficiently representative of what you’re trying to model. ---
**Author:** ![Incensed](https://avatars.discourse-cdn.com/v4/letter/i/eb8c5e/32.png) [@Incensed](https://boards.straightdope.com/u/Incensed)\ **Post date:** [July 24, 2015, 2:27am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/10 "2015-07-24T02:27:46Z")
> [@DataX](#): > > …The book “R in a nutshell” is pretty good > > And it has specific examples - including baseball examples (I’m guessing there is at least three in there on baseball - but don’t hold me to that - I know it’s at least one) > > It pretty fun to be able to do your own machine learning - and was way easier than I expected Thanks for the insight, **DataX**. Frankly, the particulars went right over my head. I’m not even familiar with the concept of ‘Machine Learning’, nor coding for that matter, but I do find myself trying to generate algorithms that explain reality much more often than I have any business doing. So is that what I need to look into? Machine learning? Would you recommend college courses or is it something a dedicated amateur could pick up on their own? Keep in mind I’m not trying to become an expert, just be able to defend myself and optimize the occasional algorithm… Thanks, **bump**. Representative sampling, eh? It looks more and more like I need to have a pow-wow with a Stats guy at the local college, huh? ---
**Author:** ![DataX](https://avatars.discourse-cdn.com/v4/letter/d/e99b99/32.png) [@DataX](https://boards.straightdope.com/u/DataX)\ **Post date:** [July 24, 2015, 2:32am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/11 "2015-07-24T02:32:16Z")
In theory you want to hold out a set of data and do stuff like cross validation - this is why I don’t like linear regression as I have to set up multiple fold cross validation and it has some problems generalizing. A method like random forest gets rid of all these problems as you can use what is known as the “out of bag” trees to make predictions on data it hasn’t seen. You can do what chronos said - and lump them together - but you can also add another column for that - say “year” if that is the difference between your sets. There’s gotta be something different. You can record these as a “factor” in R, but usually it isn’t going to matter. I have tried to get this to matter - many, many, many times - but very rarely does it make any real discernible difference - even though it seems like it should. Don’t make it more complicated than it needs to be. I could get that model up and working in like three minutes - get something working first - then add stuff. That’s where the fun begins (although I don’t wanna ruin your enthusiasm - your not gonna get very far down that path) But it’s still fun to try. ---
**Author:** ![DataX](https://avatars.discourse-cdn.com/v4/letter/d/e99b99/32.png) [@DataX](https://boards.straightdope.com/u/DataX)\ **Post date:** [July 24, 2015, 2:39am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/12 "2015-07-24T02:39:35Z")
I have no statistical training or math background. It takes a special way of thinking, but it is possible, but you have to be able to pick up on stuff to compensate for the lack of statistics - how to do cross food validation for example. As far as what you should read: > **[Machine Learning](http://openclassroom.stanford.edu/MainFolder/CoursePage.php?course=MachineLearning)** > > K-12 Free Education. They have videos somewhere - not sure if it’s there, but it wouldn’t do those first as they make it more technical than it needs to be. That book I mentioned has at least a chapter on machine learning. It is written for people like us. It just tries to teach you how to do it - no math needed. If your promise not to reveal my secret identity I’ll send you the link to a video presentation I gave on R and Machine Learning at a place you probably have heard of 🙂 ---
**Author:** ![Incensed](https://avatars.discourse-cdn.com/v4/letter/i/eb8c5e/32.png) [@Incensed](https://boards.straightdope.com/u/Incensed)\ **Post date:** [July 24, 2015, 2:53am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/13 "2015-07-24T02:53:24Z")
> [@DataX](#): > > …Don’t make it more complicated than it needs to be. I could get that model up and working in like three minutes - get something working first - then add stuff. > > That’s where the fun begins (although I don’t wanna ruin your enthusiasm - your not gonna get very far down that path) > > But it’s still fun to try. The example I gave was monstrously simple compared to the actual algorithm I’ve got, but it all basically boils down to needing to optimize about 6-12 variables (constants?) across a number of data sets. I’ll look into that book when I have a chance… ---
**Author:** ![DataX](https://avatars.discourse-cdn.com/v4/letter/d/e99b99/32.png) [@DataX](https://boards.straightdope.com/u/DataX)\ **Post date:** [July 24, 2015, 2:58am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/14 "2015-07-24T02:58:37Z")
I’m familiar with saber metrics and Nate silver is my hero 🙂 I’ve got a couple books on saber metrics and find them good for inspiration. I think you’ll enjoy it - it gives you power! I never could program before R ---
**Author:** ![Incensed](https://avatars.discourse-cdn.com/v4/letter/i/eb8c5e/32.png) [@Incensed](https://boards.straightdope.com/u/Incensed)\ **Post date:** [July 24, 2015, 3:09am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/15 "2015-07-24T03:09:45Z")
> [@DataX](#): > > I’m familiar with saber metrics and Nate silver is my hero :)… Sweet, yeah I like Nate, but I think I like him more for 538 than his Saber contributions. Most of his work seems to have been based on predicting player development and decline, where I’m more interested in the backwater of sabermetrics, namely ranking historical players accurately. ---
**Author:** ![ddunn801](https://avatars.discourse-cdn.com/v4/letter/d/71c47a/32.png) [@ddunn801](https://boards.straightdope.com/u/ddunn801)\ **Post date:** [July 24, 2015, 2:57pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/16 "2015-07-24T14:57:58Z")
Are your dataset(s) laid out like this?: Runs; Singles; Doubles; Triples; Homers; Yadda1; Yadda2; etc If so, you’ve done all the hard work already. I’m happy to get you started with some R code that will work on your exact dataset if you want to email me a link to the data via Dropbox or GoogleDocs or whatever. R is a free program, by the way. ---
**Author:** ![Incensed](https://avatars.discourse-cdn.com/v4/letter/i/eb8c5e/32.png) [@Incensed](https://boards.straightdope.com/u/Incensed)\ **Post date:** [July 24, 2015, 3:27pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/17 "2015-07-24T15:27:57Z")
> [@ddunn801](#): > > Are your dataset(s) laid out like this?: Runs; Singles; Doubles; Triples; Homers; Yadda1; Yadda2; etc > If so, you’ve done all the hard work already. I’m happy to get you started with some R code that will work on your exact dataset if you want to email me a link to the data via Dropbox or GoogleDocs or whatever. > > R is a free program, by the way. No the data isn’t set up nearly so neatly. I’m in a spreadsheet, so the variables I’m trying to optimize are embedded within formulas that are performing calculations, referencing other cells, etc. I could dig them all out into stand alone cells fairly easily, but it would take some time. Yeah, thanks to your and **DataX’s** recommendations, I’m definitely planning on getting into R for future models. Speaking of, right now, the variables I want to optimize are defined as numbers within those formulas, so lets say Singles = 0.75. Now, if I pull it out into its own cell, would the fact that it is concretely defined mess with R or a similar programs ability to adjust/optimize it? IOW, is the fact that it is a concrete number interfere with the programs ability to see it as a variable, or is that something that’s taken care of by the code/command I would enter? ---
**Author:** ![Learjeff](https://avatars.discourse-cdn.com/v4/letter/l/94ad74/32.png) [@Learjeff](https://boards.straightdope.com/u/Learjeff)\ **Post date:** [July 24, 2015, 6:18pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/18 "2015-07-24T18:18:49Z")
> [@Incensed](#): > > Sweet. Unfortunately, I’m on a Mac… Excel (part of MS Office) is available for Mac. So is LibreOffice, which is free. However, I don’t know whether it has an equivalent feature. It’s generally pretty close to Excel in feature parity. ---
**Author:** ![pulykamell](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/pulykamell/32/3166_2.png) [@pulykamell](https://boards.straightdope.com/u/pulykamell)\ **Post date:** [July 24, 2015, 7:14pm UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/19 "2015-07-24T19:14:16Z")
> [@ddunn801](#): > > R is a free program, by the way. Yep, and it’s available for Mac. I’ve never used it, but my wife uses R and SAS (proprietary software similar to R in terms of functionality) in her line of work. It shouldn’t be too difficult to set up. ---
**Author:** ![Chronos](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/chronos/32/134_2.png) [@Chronos](https://boards.straightdope.com/u/Chronos)\ **Post date:** [July 25, 2015, 2:31am UTC](https://boards.straightdope.com/t/how-to-optimize-a-constant-in-an-algorithm-with-multiple-constants/725977/20 "2015-07-25T02:31:37Z")
In fact, it’s probably easier to set up R on a Mac than on a PC, owing to OSX’s Unix underpinnings.