Yea, you are going to want to turn that off
Go to General Settings/E-mail options and uncheck this box:
Include order details (credit card information) into admin order notification message (it is recommended to use PGP encryption with this option enabled):