Men generally have a more positive body image than women. However, the extent to which scars negatively influence men’s body image is uncertain. The aim of the current study was to assess body image in men with and without scars while taking scar origin into account (nonsuicidal self-harming injuries [NSSI] vs. accidents or surgery). One hundred and nine men (n = 19 with NSSI) and 185 women (n = 96 with NSSI) filled in multidimensional body image questionnaires. Results indicate that on most clinical subscales women had a significantly more negative body image compared with men. However, within a subsample whose scars resulted from NSSI, gender differences vanished. Among men, scar origin was significantly associated with negative body image after partialling out scar characteristics, age, and borderline symptomatology. The visibility of scars was not associated with more severe body image disturbances. The results of our study indicate that self-inflicted scars adversely affect body image. Although women generally reported having a more negative body image, disturbances in body image should not be neglected among men, especially in those who have self-inflicted scars.