Q&A: Here’s a case where taking retirement funds early might make sense

Dear Liz: My wife and I are both retired and receiving annuity payments. In addition, we have about $1.3 million in traditional IRAs and $350,000 in another annuity that will pay us each about $1,000 per month. We are moving from Texas to Arkansas sometime in the next year. Texas has no state income tax and pretty high property taxes, while Arkansas has lower property taxes but about 6% income tax. We plan to put down about $200,000 on a new home and obtain a mortgage for about $350,000 at about 4% interest.

Does it make sense to withdraw money from the IRA to pay down the amount we need to borrow for the mortgage? I can withdraw about $90,000 without putting us into the next higher federal tax bracket, if that makes any difference, and end up saving $5,400 in Arkansas income tax at the same time.

By my calculations, the return on the $90,000 would be almost $8,000 every year in reduced mortgage payments if we took out a 15-year mortgage. If we did the 30-year loan, that savings would be over $5,000. I don’t think we’ll achieve the same returns on $90,000 leaving those funds invested as they are in bonds or cash.

Answer: It usually doesn’t make sense to tap retirement funds to pay down a mortgage, but your case may be one of the exceptions. You have enough saved that the withdrawal won’t claim a big chunk of your available funds and leave you cash-poor.

We’ll assume you’re over 59½ and won’t face penalties for early withdrawal. If that’s the case, then you’ll also be facing required minimum distributions within a few years. These mandatory withdrawals, which must start after you turn 70½, would subject at least some of this money to taxation. The question is whether you want to pay those taxes now or later, and you’re making a pretty good case for now.

Before you withdraw any money from a retirement fund, however, you should consult with a tax pro or a fee-only financial planner, or both. Mistakes made in early retirement often have irreversible consequences, so you want an objective second opinion before you proceed.