You can, but it is usually not good to do so. Store bought soil is made by grinding up yard waste and trimmings. The trimmings could be toxic plants, like oleander or azalea. It can also irritate eyes and skin, and if dusty, torts can inhale it.
If you use your own yard dirt that has nothing toxic and no chemicals in it, you can use it. But again, it can be an irritant, and turns to mud when wet.