Maybe the police aren’t beating me for being a woman, but my husband/boyfriend/friend/date/someone I met at a party is.

Violence against women (and members of the LGBTQA community) is a societal problem, promoted by rape culture.

From http://en.wikipedia.org/wiki/Rape_culture

According to the rape culture theory, acts of sexism are commonly employed to validate and rationalize normative misogynistic practices. For instance, sexist jokes may be told to foster disrespect for women and an accompanying disregard for their well-being. An example would be a female rape victim being blamed for her being raped because of how she dressed or acted. In rape culture, sexualized violence towards women is regarded as a continuum in a society that regards women’s bodies as sexually available by default.^[6]

The root cause of rape culture is generally agreed to be the “domination and objectification of women”.^[7] However, academic theory holds that rape culture does not necessarily have a single cause, and causes may be localized based on other social aspects of culture.^[8] For example, in South Africa the overriding “war culture” which emphasized masculinity and violence led to a culture in which rape was normalized.^[7][5] A University of California Davis public document alleged that the enforcement of the following of social rules by women and the conditioning of gender roles were major causes.^[9] In a study of date rape, gender-based miscommunications were held to be a major factor supporting a campus rape culture.^[10] The general unwillingness of police and district attorneys to prosecute rapes where force was not involved or where the victim had some sort of relationship with the aggressor is also cited as a motivation for date rape and campus rape.^[8] Rape culture is also closely related to slut-shaming and victim blaming, where rape victims are considered at fault for being raped, and it is argued that this connection is due to the presence of a culture that shames all female sexuality.^[8] That some rapes are not reported to the police due to fear that they would not be believed is often cited as a symptom of a rape culture,^[11][8] that they thought the police would not believe them is cited as a reason by 6% of women who did not report rape.^[12]

Although its use as a theory to explain the occurrence of rape and domestic violence was focused on the rape of women, rape culture has been described as detrimental to men as well as women. Some writers and speakers, such as Jackson Katz, Michael Kimmel, and Don McPherson, have said that it is intrinsically linked to gender roles that limit male self-expression and cause psychological harm to men

Rape DOES have to do with patriarchal values in SOCIETY, and the rapist lives in and has been socialized in a society that promotes rape culture. The feminist movement is working to bring awareness to this, and create a more equal culture. Cultures in which men and women are more equal have less partner and domestic violence.

From The Truth about Rape
 By Robert N. Golden, Fred L. Peterson, Ph.D., Kathryn Hilgenkamp, Judith Harper, Elizabeth Boskey

The classic study of the effect of culture on rape was performed by the anthropologist Peggy Reeves Sanday in 1981. In her book Female Power and Male Dominance: On the Origins of Sexual Inequality, Sanday classified societies as either rape-free or rape-prone. Rape-free societies tended to be those in which women and men contributed equally to the community. They also tended to encourage children to value nurturing emotions and avoid aggression. In contrast, Sanday found that rape-prone societies had more separation of sex roles and that they tended to respect, or at least tolerate, male violence and aggression. These results have been confirmed by other scientists. The 2005 World Health Organization (WHO) multicountry report on domestic violence and women’s health found several societal factors that increased a woman’s risk of gender-based violence. These include how equal men and women are economically, as well as confirming most of the other factors identified by Sanday in her groundbreaking work…In the words on the WHO report, “Challenging the social norms that condone and therefore perpetuate violence against women is a responsibility for us all.” Rape, sexual assault, and all forms of violence against women may be crimes committed by individuals, but they are crimes shaped by society. Changing the way that societies view, and treat, women would be a more effective way of preventing gender-based violence than any amount of criminal prosecution.

(bolding is mine)

Patriarchy is a problem, and it is hurting men just as it is hurting women.

http://www.safercampus.org/blog/2011/03/essential-concepts-how-patriarchy-and-rape-culture-hurt-men/

This is a great list of ways in which patriarchy hurts men, and I suggest you give it a read.