You can have more than enough money to retire and still pay more in taxes than you expected.

The problem often isn’t how much you’ve saved. Instead, it’s how you decide to turn those savings into income.

During your working years, that decision was mostly made for you. Your paycheck arrived, taxes were withheld, and the remaining money funded your lifestyle.

Retirement changes that.

Now, you may have a traditional IRA, a taxable investment account, Roth assets, cash reserves, Social Security, a pension, and perhaps other sources of income available to you. The question is no longer simply whether you have enough.

You have to decide which dollars should fund each year of retirement.

And that’s where tax planning and financial planning begin to overlap.

Retirement income shouldn’t be pulled randomly from whichever account is most convenient. Before the paycheck stops, you need a retirement income map that shows where your cash flow will come from, when you’ll take it, and what each decision may do to the rest of your financial plan.

Your Accounts Don’t All Spend the Same on Your Tax Return

At first glance, a dollar is a dollar.

If you need $200,000 from your portfolio this year, you might assume it doesn’t particularly matter whether the money comes from an IRA, a brokerage account, cash, or a Roth IRA.

But the tax return sees those dollars differently.

Generally, taxable distributions from a traditional IRA are included in ordinary income. Meanwhile, when you sell an investment in a taxable brokerage account, you’re generally taxed on the gain relative to your adjusted cost basis rather than simply on the entire amount of cash you receive. Qualified Roth IRA distributions generally aren’t included in taxable income.

Pension income can create another layer. Depending on how the pension was funded, payments may be fully taxable or may include a nontaxable return of after-tax contributions.

Then there’s Social Security.

Depending on your other income, as much as 85% of your Social Security benefits can become included in taxable income. That doesn’t mean you’re paying an 85% tax rate on Social Security. Instead, it means other income can cause a greater portion of the benefit to become subject to federal income tax.

For retirees on Medicare, higher income can have another consequence. Modified adjusted gross income is also used to determine whether Medicare’s income-related monthly adjustment amount, or IRMAA, applies to Part B and Part D premiums. In general, those calculations rely on tax-return information from two years earlier.

So, one large IRA withdrawal may do more than create taxable income.

It can affect the taxation of Social Security. It can influence Medicare premiums in a future year. It can change the tax treatment of investment income. And, depending on what you don’t withdraw today, it can influence the size of future required distributions from tax-deferred accounts.

That’s why I don’t think retirement-income planning should begin with the question, “Which account has the money?”

The better question is, “What income do we want to create this year, and which accounts should create it?”

Consider a Couple With $5 Million Saved for Retirement

Imagine a recently retired couple in their late sixties with approximately $5.2 million in investable assets.

They have $3.1 million in traditional IRAs and retirement accounts, $1.3 million in a taxable investment portfolio, $500,000 in Roth accounts, and $300,000 in cash and short-term reserves.

Between Social Security and a small pension, they receive roughly $100,000 of annual income. However, their lifestyle, travel, charitable giving, family support, taxes, and other expenses require another $200,000 from their portfolio.

That’s a much more realistic retirement-income question for a high-net-worth household.

They need $200,000.

Where should it come from?

The simplest answer might be the IRA.

After all, that’s what the IRA was built for. So, they could call their custodian, withdraw $200,000, have taxes withheld, and move on.

Operationally, that works.

From a planning perspective, however, we haven’t answered nearly enough questions.

Assuming the entire distribution is taxable, that $200,000 IRA withdrawal would add substantially more ordinary income to their tax return. It may also cause more of their Social Security benefits to become taxable and could affect future Medicare premiums.

Now consider that their taxable investment account contains securities with significant cost basis.

Instead of taking the entire $200,000 from the IRA, perhaps the retirement income map calls for $90,000 from the IRA, $80,000 from selected taxable investments, and $30,000 from existing cash reserves.

They still receive the same $200,000 needed to fund their lifestyle.

However, the tax result could be very different.

The $80,000 brokerage withdrawal isn’t automatically $80,000 of taxable income. If, for example, the investments sold have a relatively high cost basis, only the realized gain is generally considered when calculating the capital gain from the sale.

Meanwhile, the cash reserve itself doesn’t create income simply because it’s transferred from a savings account into checking, although interest earned on that cash may already be taxable.

The important point isn’t that this particular combination is the “right” answer.

It may not be.

The point is that the decision should be intentional.

Sometimes the Right Answer Is to Pay More Tax Today

This is also where retirement-income planning can easily become too simplistic.

If the goal were merely to minimize this year’s taxable income, you could conclude that retirees should avoid traditional IRA distributions whenever cash, high-basis investments, or qualified Roth distributions are available.

I don’t think that’s the right way to look at it.

Sometimes intentionally creating taxable income today can improve the long-term plan.

For example, the years after retirement but before required minimum distributions begin may give a household more control over its taxable income than it will have later. If most of a couple’s wealth is sitting inside traditional retirement accounts, taking additional distributions or completing Roth conversions during lower-income years may reduce the amount left in those accounts later.

So, the goal of a retirement income map isn’t necessarily to pay the least tax this year.

The goal is to make informed decisions about when the family pays tax, which assets create the tax, and how today’s decision affects the years ahead.

That’s an important distinction.

Tax minimization looks at one return.

Retirement-income planning looks at the timeline.

A Retirement Income Map Connects the Years

When we think about retirement planning, it’s tempting to divide everything into separate decisions.

When should I claim Social Security?

How much should I take from my IRA?

Should I sell investments from my brokerage account?

Should I convert money to a Roth?

How much cash should I keep?

Individually, those are reasonable questions.

However, they’re really pieces of the same decision.

A retirement income map brings them together.

Before retirement, I want that retirement income map to show what the household expects to spend, which income sources turn on automatically, which sources we control, how much taxable income we’re intentionally creating, and what the decision may mean several years down the road.

For example, one year may call for heavier taxable-account withdrawals.

Another may be an attractive year to recognize more IRA income.

Another may offer room for a Roth conversion.

Later, Social Security, pensions, required distributions, or other income sources may reduce that flexibility.

The strategy can also change as tax laws, portfolio values, spending needs, and family circumstances change.

That’s why a retirement income map isn’t a one-time withdrawal schedule.

It’s a framework for making better annual decisions.

The Details Matter

This is also where experience and careful tax analysis matter.

Not every traditional IRA dollar is necessarily taxable if the account owner has nondeductible basis. Not every brokerage withdrawal creates the same capital gain because cost basis and holding periods differ. Pension taxation can vary depending on after-tax contributions. Capital losses may offset certain gains. State taxation may differ from the federal rules discussed here.

That’s why broad rules of thumb such as “spend taxable accounts first” or “always delay IRA withdrawals” can be misleading.

There isn’t one universally correct withdrawal order.

The right sequence depends on the household’s balance sheet, tax return, age, income sources, spending needs, estate goals, and what you’re trying to accomplish over the next several years.

That coordination is the work.

Build the Retirement Income Map Before You Need the Money

Retirement shouldn’t begin with a series of disconnected withdrawal decisions.

If you wait until you need cash and simply pull money from whichever account is easiest, you’re allowing convenience to make a tax decision for you.

Instead, start before retirement.

Look at the next several years. Identify the income that will arrive automatically. Estimate the cash flow you’ll need from your portfolio. Then determine which accounts can provide that money and how those withdrawals may affect the rest of the plan.

Some years, the answer may be the IRA.

Other years, it may be the brokerage account, cash reserves, Roth assets, or a combination of several sources.

What matters is that you’ve made the decision deliberately.

Because once you retire, your portfolio isn’t simply a collection of accounts anymore.

It’s your paycheck.

And if you’re going to be responsible for creating that paycheck for the next 20 or 30 years, you should know where each year’s income is coming from before you spend it.

That’s the purpose of a retirement income map.

Sources

Internal Revenue Service, Publication 590-B: Distributions from Individual Retirement Arrangements (IRAs);
https://www.irs.gov/publications/p590b

Internal Revenue Service, Publication 915: Social Security and Equivalent Railroad Retirement Benefits;
https://www.irs.gov/publications/p915

Internal Revenue Service, Topic No. 409: Capital Gains and Losses;
https://www.irs.gov/taxtopics/tc409

Internal Revenue Service, Publication 575: Pension and Annuity Income;
https://www.irs.gov/publications/p575

Social Security Administration, Modified Adjusted Gross Income and Medicare IRMAA;
https://secure.ssa.gov/poms.nsf/lnx/0601101010