Aggression-related sexual fantasies (ASF) have been related to various forms of harmful sexual behavior in both sex offender and community samples. However, more research is needed to fully understand this relation, particularly whether ASF is associated with harmful sexual behavior beyond hostile sexism against women and a sexual preference for violence and sexual violence. In the present study, N = 428 participants (61.9% women) between 18 and 83 years of age (M = 28.17, SD = 9.7) reported their ASF and hostile sexism. They rated their sexual arousal by erotic, violent, and sexually violent pictures as a direct measure of sexual preference. Response latencies between stimulus presentation and arousal ratings were used as an indirect measure of sexual preference. ASF and the directly and indirectly assessed sexual preference for violent and sexually violent stimuli were positively correlated. They were unrelated to hostile sexism against women. ASF showed the strongest associations with self-reported sexually sadistic behavior and presumably non-consensual sexual sadism beyond these preferences and hostile sexism in the total group and separately among men and women. The findings indicate that ASF and sexual preference are not equivalent constructs and further underscore the potential relevance of ASF for harmful sexual behavior.