It is illegal to have a CA Desert Tortoise without a permit. Permits are easy to get, BTW.
There are a few very rare species that require a Captive Bred Wildlife Permit, but only if you cross state line with them. As in, if you bring them to CA from another state.