# Math/physics-first order/second order

**URL:** <https://boards.straightdope.com/t/math-physics-first-order-second-order/138196>\
**Category:** Factual Questions\
**Created:** [November 22, 2002, 6:22pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196 "2002-11-22T18:22:24Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sacroiliac](https://avatars.discourse-cdn.com/v4/letter/s/ecb155/32.png) [@Sacroiliac](https://boards.straightdope.com/u/Sacroiliac)\
**Post date:** [November 22, 2002, 6:22pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/1 "2002-11-22T18:22:24Z")

</div>

Feynman says

“One of the properties of a minimum (of a function) is that if we go away from the minimum in the _first order_, the deviation of the function from its minimum value is only _second order_. At any place else on the curve, if we move a small distance the value of the function changes to the _first order_.”

What does he mean by first order and second order?

For instance if f(x) = x[sup]2[/sup] the minimum is at x = 0. How would first order/second order apply to this?

---

<div class="post-metadata">

**Author:** ![ZenBeam](https://avatars.discourse-cdn.com/v4/letter/z/3ab097/32.png) [@ZenBeam](https://boards.straightdope.com/u/ZenBeam)\
**Post date:** [November 22, 2002, 7:05pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/2 "2002-11-22T19:05:12Z")

</div>

> [@](#):
>
> For instance if f(x) = x[sup]2[/sup] the minimum is at x = 0. How would first order/second order apply to this?

In this case, first order means proportional to x, second order means proportional to x[sup]2[/sup]. In general, it’s whether the change in the function is linear (first order) or quadratic (second order) in distance from the point.

---

<div class="post-metadata">

**Author:** ![andymurph64](https://avatars.discourse-cdn.com/v4/letter/a/a88e57/32.png) [@andymurph64](https://boards.straightdope.com/u/andymurph64)\
**Post date:** [November 22, 2002, 9:36pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/3 "2002-11-22T21:36:26Z")

</div>

I think ZenBeam has it right. I have seen that terminology used for non-polynomials however.

---

<div class="post-metadata">

**Author:** ![hajario](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/hajario/32/171_2.png) [@hajario](https://boards.straightdope.com/u/hajario)\
**Post date:** [November 22, 2002, 9:45pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/4 "2002-11-22T21:45:09Z")

</div>

The more orders, the more accurate but eventually you’ll see diminishing returns.

Haj

---

<div class="post-metadata">

**Author:** ![andymurph64](https://avatars.discourse-cdn.com/v4/letter/a/a88e57/32.png) [@andymurph64](https://boards.straightdope.com/u/andymurph64)\
**Post date:** [November 22, 2002, 9:49pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/5 "2002-11-22T21:49:18Z")

</div>

> [@](#):
>
> The more orders, the more accurate but eventually you’ll see diminishing returns.

In addition, try explaining a model to non-math people that goes beyond second order or even, heaven forbid, doesn’t use polynomials.

Their heads explode.

I even had one executive force me to use a linear model though it wasn’t nearly as good the further you went from the defining point. I guess it was his money…

---

<div class="post-metadata">

**Author:** ![Hari\_Seldon](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/hari_seldon/32/5173_2.png) [@Hari\_Seldon](https://boards.straightdope.com/u/Hari_Seldon)\
**Post date:** [November 22, 2002, 9:53pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/6 "2002-11-22T21:53:44Z")

</div>

Feynman is right but only for analytic functions. And if more than one derivates vanish, the order goes up. If the first and second derivative vanish, then the deviation is third order.

Suppose the function is a power series (that is what analytic means, BTW) at a point x\_0, say f(x) = \sum\_{i=0}^\infty a\_i(x - x\_0)^i. Then a\_1 = f’(x\_0) and that is 0 if and only if the function grows away from a\_0 at a rate proportional to x^2 (plus higher powers of x). And the second derivative is 2a\_2 and this is 0 if and only if the function grows away from a\_0 at a rate proportional to x^3 plus higher powers. And so on. That is what Feynman meant.

---

<div class="post-metadata">

**Author:** ![Sacroiliac](https://avatars.discourse-cdn.com/v4/letter/s/ecb155/32.png) [@Sacroiliac](https://boards.straightdope.com/u/Sacroiliac)\
**Post date:** [November 22, 2002, 10:02pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/7 "2002-11-22T22:02:42Z")

</div>

After some web searching I found something that I might understand. If you expand f(x) in a Taylors series about the point (x0 + epsilon) where x0 is a minimum and the slope is 0 then epsilon shouldn’t change f(x) _to first order._ It won’t start having an effect until you get to 1/2 f’’(x) eps[sup]2[/sup] or second order. Does this make any sense?

---

<div class="post-metadata">

**Author:** ![Sacroiliac](https://avatars.discourse-cdn.com/v4/letter/s/ecb155/32.png) [@Sacroiliac](https://boards.straightdope.com/u/Sacroiliac)\
**Post date:** [November 22, 2002, 10:08pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/8 "2002-11-22T22:08:15Z")

</div>

Hari Seldon I didn’t see your post. But I’m having trouble understanding the ascii representations.

---

<div class="post-metadata">

**Author:** ![Jabba](https://avatars.discourse-cdn.com/v4/letter/j/b5e925/32.png) [@Jabba](https://boards.straightdope.com/u/Jabba)\
**Post date:** [November 23, 2002, 12:23am UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/9 "2002-11-23T00:23:12Z")

</div>

Take, as an example, f(x) = x[sup]2[/sup] - 2x.  
Then f’(x) = 2x - 2 and f’’(x) = 2.  
Thus, f has a minimum at x = 1. Replace x with 1+[symbol]e[/symbol], so we are considering points near the minimum. Then  
f(1+[symbol]e[/symbol]) = (1+[symbol]e[/symbol])[sup]2[/sup] - 2(1+[symbol]e[/symbol])  
= (1+2[symbol]e[/symbol]+[symbol]e[/symbol][sup]2[/sup]) - 2(1+[symbol]e[/symbol])  
= -1 + 2[symbol]e[/symbol][sup]2[/sup]

The difference between f(1) and f(1+[symbol]e[/symbol]) is second order in [symbol]e[/symbol], i.e. it depends on [symbol]e[/symbol][sup]2[/sup] and higher powers of [symbol]e[/symbol]. As an exercise, try the same procedure but work with 2 and 2+[symbol]e[/symbol]. You should find that the difference includes terms in [symbol]e[/symbol] this time. This is the difference between first and second order.

---

<div class="post-metadata">

**Author:** ![Hari\_Seldon](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/hari_seldon/32/5173_2.png) [@Hari\_Seldon](https://boards.straightdope.com/u/Hari_Seldon)\
**Post date:** [November 23, 2002, 2:16am UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/10 "2002-11-23T02:16:14Z")

</div>

Well, I don’t know how to get displays like Jabba’s. I used the near-universal markup language that all mathematicians use. It is called tex (or TeX). \sum is a summation sign, \_ marks subscripts and ^ superscripts. \infty is infinity and the rest ought to be clear.

I should have added that the function x^{3/2} (the 3/2 power of x) has a minimum at 0, but has degree only 3/2. It does not have a power series expansion at x = 0 (although it does everywhere else).

---

<div class="post-metadata">

**Author:** ![jnglmassiv](https://avatars.discourse-cdn.com/v4/letter/j/f07891/32.png) [@jnglmassiv](https://boards.straightdope.com/u/jnglmassiv)\
**Post date:** [November 23, 2002, 2:52am UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/11 "2002-11-23T02:52:46Z")

</div>

Second order linear differential equations are solvable by the Laplace transform also, as a cross reference hit word.

---

<div class="post-metadata">

**Author:** ![hajario](https://sea3.discourse-cdn.com/straightdope/user_avatar/boards.straightdope.com/hajario/32/171_2.png) [@hajario](https://boards.straightdope.com/u/hajario)\
**Post date:** [November 23, 2002, 3:09am UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/12 "2002-11-23T03:09:14Z")

</div>

> [@](#):
>
> \*Originally posted by andymurph64 \*  
> \*\*In addition, try explaining a model to non-math people that goes beyond second order or even, heaven forbid, doesn’t use polynomials.
> 
> Their heads explode.
> 
> I even had one executive force me to use a linear model though it wasn’t nearly as good the further you went from the defining point. I guess it was his money… \*\*

The other side of the coin is when I (as an engineer) worked for a theoretical physicist. He wanted to use all sorts of exotic functions when a linear model worked just fine (r[sup]2[/sup]=.9995)

Haj

---

<div class="post-metadata">

**Author:** ![andymurph64](https://avatars.discourse-cdn.com/v4/letter/a/a88e57/32.png) [@andymurph64](https://boards.straightdope.com/u/andymurph64)\
**Post date:** [November 25, 2002, 2:58pm UTC](https://boards.straightdope.com/t/math-physics-first-order-second-order/138196/13 "2002-11-25T14:58:33Z")

</div>

> [@](#):
>
> He wanted to use all sorts of exotic functions when a linear model worked just fine (r2=.9995)

Oh to meet people like that…sigh. Hasn’t happened yet.

The only time I’ve met someone who does this is when I hire someone with little or no experience. We try to use linear whenever possible unless non-linear is much better. Sometimes not even then ☹
