Are calluses on my palms unattractive?

I've alwayas thought that some calluse are kind of manly. From sword practice and weight lifting I have calluse on like ten places on my hands. Is that unattractive or something? why do people want to get rid of them?