You need to be the detective here. Try to figure out why he's not happy in there. My GUESS is it's not big enough, it's too bare and he doesn't feel safe, there isn't a steady supply of food all day long, it isn't warm enough, there are no hiding places, there's no water, etc. etc. etc!
Is there a reason this tortoise can't live outside? That's really where he belongs.