What should I do with extra money that's piling up?

You can’t forget the mortgage interest deduction. Depending on how early in the mortgage you are, your tax rate, whether whether you take the standard deduction, etc., that 3.5% may be equivalent to more like 2.5%. My mortgage is at 2.75%, and taking the deduction into account brings it to under 2% equivalent.