Prostitution

I can easily see why people trafficking, violence and the public nuisance of street prostitution are wrong and are, therefore, matters of legitimate government concern. I cannot see, though, why it is wrong when A and B could lawfully have sex for it to become a crime only for the reason that A agreed because B offered payment.