Well, I am a fully white male and not especially muscular. Sporty maybe, I've let myself slip a bit but not even close to fat or obese. Not in 6-pack shape tho but have ok muscle mass by default (active sports from childhood to adulthood).
My current long-time girlfriend gets pissed if I plan to shave my hair. She adores them. So have earlier flings/dates/partners. I used to not like them myself when I was young and awkward. After that I realized that everyone only sees their view and decided to be proud of my body. Doesn't even require you to be in shape as long as you're realistic and proud of what you got, you'll be fine and chicks won't mind - most likely they'll dig it.
I even had a chick who with clothes on in our social group was saying how disgusting body hair is but later on when we tossed our clothes, she found out that she actually was really in to them and got extremely turned on by them.
Whatever you please, just telling you that if you're not okay with yourself, most likely removing the hairs won't even fully remedy the issue - there'll be something else wrong anyhow.