Because if you were wealthy you could get out of fighting.
Basically, if
- you had more than 20 slaves
- were willing to pay $300
- and had enough money to hire someone to go in your place
you didn't need to fight.
Hope this answers your question, and May the Force Be With You!
-Jabba