hates me

I have had my Russian Tortoise for about 3 years now. Unfortunately, I have not been properly caring for him, but I am determined to make his life better. On this note, my tortoise is VERY opposed to the idea of me at all. I think he hates me. I try to pet him but he just gets mad and jerks...