Hello and Welcome If your tort is an adult, it should live outside 24/7 when temps are warm enough. If a hatchling, a couple hours a day would be good.
Your question should be reversed..."When should I bring my tortoise inside?" Tortoises belong outside. You should bring them in during inclement weather and at night (if a baby).
May we know what kind of tortoise you have and how old it is?