Wrong comparison.

The right comparison is "For people who can spend $500 on a pair of pants, what is the financial difference between $100 and $500?"

For most of that subpopulation, not much.