What Index Fund Investors Get Wrong About Diversification

The Comfortable Lie

There is a story the passive-investing movement tells itself, and it goes like this: buy a low-cost S&P 500 index fund, hold it for 30 years, and you own a diversified slice of the American economy. The story is half right. You will own a slice. Whether it is diversified depends on a definition of the word that most index fund investors have never examined.

As of mid-2026, the top 10 holdings in the S&P 500 account for roughly 37 percent of the entire index. Apple, Microsoft, Nvidia, Amazon, Alphabet, Meta, Berkshire Hathaway, Broadcom, Eli Lilly, and Tesla. Seven of those ten are technology or technology-adjacent companies. If you own a single S&P 500 index fund and nothing else, more than a third of your retirement is a concentrated bet on a handful of very large technology companies continuing to outperform everything else in the economy. That is a bet you can make. It is not a bet you should make by accident.

How Concentration Got Here

The S&P 500 is a market-cap-weighted index. Bigger companies occupy more of the index. That is the design, and for most of its history it worked as a reasonable proxy for broad market exposure because no single sector so thoroughly dominated the rest. The top 10 holdings represented about 18 to 22 percent of the index through most of the 1990s and 2000s. That number began climbing after 2015 and accelerated sharply during the pandemic as big tech pulled away from the rest of the market.

The last time concentration was this extreme was the early 1970s. The "Nifty Fifty" era, when a handful of large-cap growth stocks (Xerox, Polaroid, Avon, McDonald's, IBM) attracted so much capital that their valuations disconnected from their earnings. The subsequent correction from 1973 to 1974 wiped out 40 to 60 percent of the Nifty Fifty's value while the broader market dropped 45 percent. Investors who thought they owned "the market" actually owned a group of popular large-caps, and the distinction proved expensive.

I am not predicting a repeat. Nvidia is not Polaroid. But the structural dynamic, where passive inflows mechanically push the most money into the largest stocks and make them even larger, is the same dynamic that inflated the Nifty Fifty. It is worth understanding, particularly if your entire retirement sits in a single fund that replicates it.

What You Actually Own in an S&P 500 Fund

Pull up the holdings of Vanguard's VOO, Fidelity's FXAIX, or Schwab's SWPPX. Same index, same stocks, nearly identical weights. Here is what the sector breakdown looks like as of Q2 2026:

• Information technology: 31 percent
• Communication services: 9 percent
• Consumer discretionary: 10 percent (Amazon and Tesla account for most of this)

Add those together and roughly half of your "diversified" index fund is in technology and technology-dependent businesses. Healthcare is 12 percent. Financials are 13 percent. Industrials, energy, materials, utilities, real estate, and consumer staples split the remaining quarter.

If you are comfortable with that allocation, fine. But most people who own an S&P 500 fund could not tell you that half of it is tech. They bought diversification. They got sector concentration. Those are different things.

The International Gap

The S&P 500 covers exactly one country. The United States accounts for roughly 63 percent of global equity market capitalization. That means 37 percent of the investable world, including every publicly traded company in Europe, Asia, Latin America, and the rest of the developed and emerging markets, is absent from your portfolio if you hold only U.S. index funds.

The last decade has trained a generation of investors to believe international diversification is unnecessary because the U.S. has outperformed nearly everything else since 2010. That is recency bias dressed up as strategy. From 2000 to 2009, the S&P 500 returned negative 0.95 percent annualized. International developed markets returned 1.17 percent. Emerging markets returned 9.78 percent. The investor who skipped international allocation in 2000 because "the U.S. always wins" went an entire decade underwater while the rest of the world earned positive returns.

Vanguard's own research has consistently recommended 20 to 40 percent international allocation in an equity portfolio. Most American index fund investors hold zero. That is not a strategy. It is a home bias they have not noticed.

Total Market vs. S&P 500

A total U.S. stock market fund (VTI, FSKAX, SWTSX) holds roughly 3,500 to 4,000 stocks instead of 500. The additional names are mid-cap and small-cap companies the S&P 500 excludes. Historically, small-cap stocks have delivered a premium over large-caps of roughly 1.5 to 2 percentage points annualized over long horizons, though that premium has been inconsistent and nonexistent in several recent stretches.

In practice, a total market fund and an S&P 500 fund have tracked each other closely since 2010, because large-cap dominance has compressed the difference. But "closely" is not "identically," and the structural benefit of owning mid-caps and small-caps is that they are less correlated with the mega-cap names at the top. When the top 10 stumble, the other 3,500 provide a cushion that 490 more large-caps do not.

The expense ratios are nearly identical. Vanguard's VTI and VOO both charge 0.03 percent. There is no cost reason to prefer the narrower index. There is a diversification reason to prefer the broader one.

The Expense Ratio You Are Not Checking

Most index fund investors have internalized the message that low fees matter. Good. What many have not done is check the specific fee on the specific fund in their specific 401(k). The Vanguard Target Retirement 2055 charges 0.08 percent. The T. Rowe Price equivalent charges 0.56 percent. On a $500,000 portfolio over 25 years at 7 percent nominal return, that difference is roughly $150,000 in fees. Not a rounding error. A house.

Employer-sponsored plans are where the damage concentrates, because the fund menu is chosen by your employer, not by you, and plenty of employers have selected institutional share classes with expense ratios two to five times higher than what you would pay in a retail brokerage account. Pull your 401(k) statement. Find the expense ratio. Compare it to the equivalent Vanguard or Fidelity fund. If the gap is more than 0.15 percent, the math on maxing out a Roth IRA before contributing beyond the employer match becomes compelling.

Building Actual Diversification

Real diversification is not one fund. It is exposure to assets that do not all move in the same direction at the same time. For an equity portfolio, that means at minimum:

• U.S. total market (not just S&P 500): VTI, FSKAX, or SWTSX
• International developed markets: VXUS, FTIHX, or IXUS
• A small allocation to bonds or TIPS if you are within 15 years of needing the money

A 60/40 split between U.S. and international equity, held in two or three index funds with expense ratios under 0.10 percent, gets you genuine diversification across roughly 10,000 stocks in 40-plus countries. That portfolio does not guarantee better returns. It guarantees that you are not unknowingly betting your retirement on seven companies continuing to outrun the global economy.

For a comparison of where this portfolio is cheapest to build and hold, our Fidelity vs. Vanguard breakdown covers fees, fund selection, and account minimums. If you are choosing between a robo-advisor and building it yourself, Betterment vs. Vanguard and Wealthfront vs. Betterment walk through what you are paying for the automation and whether it is worth it.

The Portfolio You Think You Have

Log in to your brokerage account or your 401(k) this week. Look at the actual holdings, not the fund name. Count how much of your money sits in the same ten companies. Check whether you own anything outside the United States. Compare the expense ratio on your funds to what you would pay at Vanguard or Fidelity for the same exposure.

If the answers surprise you, they were supposed to. Most index fund investors are well-intentioned, disciplined savers who believe they are diversified because they were told that index funds are diversified. The index funds are fine. The mistake is owning one of them and calling it a portfolio.