What's the problem with agents charging fees?

I would be glad to pay an agent a (reasonable, affordable) fee if he gets my book published!