Does my Cat hate me?

I got this cat since he was 4 weeks old and he has never been very affectionate apart from when he was a kitten. He was the only cat for a good 3 years until we got another one and started fostering. He's always been kinda a loner but I think he's bonded with the other cat. He's never been a lap cat and that's ok, but i'm just wondering does he hate having me as an owner? I don't want to rehome him but I don't want him to be unhappy

Anyway, this is his behaviour to me:

Runs away and hides under the bed or somewhere when I come home (often about 8 times out of ten)

Stays in his little cat tree/doesn't come out to see me

He USED to sleep on top of me every night but then we both experienced some DV/moving houses 3 times in a year and he's stopped doing that since

Never rubs his head on me or wraps his tail around my leg unless he wants something

He always and only sleeps at the foot of my bed now and very occasionally he'd come and sit/sleep right next to me (doing so as I'm typing)

Always faces away from me & it doesnt seem like he wants scratches but he really does enjoy his head scratches which is confusing

I have lots of cat toys but he doesn't like to play with any (maybe for a minute or so before losing interest) & he doesn't like catnip