Also just out of the blue, unprompted, talking about you not wanting to have sex with someone, is pretty rude and if you're bringing that up like that to that person when they haven't asked, its honestly a form of harassment.
Imagine, (and this may have happened to you before so think of how that felt) having someone, loudly and unprompted, talking about how they find you, personally unattractive and don't want to fuck you. You never asked, you have made no indication you want anything to do with them sexually, and yet they just keep talking about it, then say you are harrassing *them* when you tell them to shut up.
Now, not finding you attractive is well within their rights, but they're being incredibly rude and hurtful to say that to your face without any reason to.
Idk, as a cis queer person who also has a lot of other aspects of my identity such as being mixed race and disabled that some people take issue with, who has been on the same recieving end of strangers not shutting up about disliking your body for one reason or another when you're just trying to survive, and having to take the constant harassment on the chin and deal with it constany chipping away of self esteem just for daring to *exist*; I agree that it does get to a point where you're just being transphobic. (Or in the cases of myself, ableist or racist)
You are not required to find anyone attractive. You however *ARE* required to treat people with some basic level of human respect.