Although the majority of adulthood sexual violence involves a male perpetrator and a female victim, there is also substantial evidence that members of both genders can be victims and perpetrators of sexual violence. As an alternative to viewing sexual violence within gender-specific terms, we advocate for the use of a gender inclusive conceptualization of sexual aggression that takes into account the factors that contribute to sexual victimization of, and victimization by, both men and women. The goal of the current review is to examine the need and importance of a gender inclusive conceptualization of sexual violence and to discuss how compatible our current theories are with this conceptualization. First, we examine evidence of how a gender-specific conceptualization of sexual violence aids in obscuring assault experiences that are not male to female and how this impacts victims of such violence. We specifically discuss this impact regarding research, law, public awareness, advocacy, and available victim treatment and resources. Next, we provide an overview of a number of major sexual violence theories that are relevant for adult perpetrators and adult victims, including neurobiological and integrated biological theories, evolutionary psychology theory, routine activity theory, feminist theory, social learning and related theories, typology approaches, and integrated theories. We critically examine these theories’ applicability to thinking about sexual violence through a gender inclusive lens. Finally, we discuss further directions for research, clinical interventions, and advocacy in this area. Specifically, we encourage sexual violence researchers and clinicians to identify and utilize appropriate theoretical frameworks and to apply these frameworks in ways that incorporate a full range of sexual violence.