My three-toed is super shy as well. Pretty much the only thing he'll eat when I'm around is an earthworm, and even then its gotta be really wiggling hard.
Mine wasn't that shy when he was inside, but thats likely because he was in my bedroom and saw me several times a day. Ever since I moved him outside at my new house about 2 years ago he has been much more shy. Hes mostly in one of his burrows/hides when I go out to check on him and so I don't see him that often unless I pull him out to make sure he is eating/soaking.