If you are already on version 5.X you must be from the future.
Under Settings > Appearance "Enable buttons "Buy Now" and "Add to wish list" in the products list" -is this checked?
Unchecking it should remove the Buy Now button from the category pages. Is this the behavior you want?