I'm afraid, you can't forbid spammers to use your e-mail address as the one in Reply-to field of spam messages. But you can decrease the number of such mails rejected to your mail accounts. Just don't use catch-all e-mail account and keep your SpamAssasin enabled. Custom filtering rules also can help in this situation.