so you're fine with the physical attraction, but not like mental/emotional? it's just a matter of who and how they act that makes them attractive to you tbh, whether it be they like the same things as you etc.. everyone is different and nobody expects you to instantly be interested in the next gay dude flaunting his stuff.
the only big difference is the physical attraction, overcoming features that you might percieve as too masculine, e.g. male jawline (because of stereotypes, some people being worried about their image being with that person). at the end of the day just don't think "man/woman", think "is this person someone I'd naturally be interested in?" if not, they're not the one for you lmao