Why do handymen charge MORE in poorer neighborhoods?

I would think that they charge more because they wont get more work from that person...Where as rich people they could earn their business and potentially make even more money???