White spots are often caused by an infection from sap-sucking insects called Cochineal Bugs. These insects are not toxic; but they certainly will harm the cactus over time. They can be removed by a strong blast of water; but it is likely that they will return (eggs have been laid), so you will need to repeat the treatment as needed. It is unlikely that they will harm a tortoise.