The comprehension of dynamically unfolding social situations is made possible by the seamless integration of multimodal information merged with rich intuitions about the thoughts and behaviors of others. We examined how high-functioning adults with autism spectrum disorder and neurotypical controls made a complex social judgment (i.e. rating the social awkwardness of scenes from a television sitcom) across three conditions that manipulated presentation modality—visual alone, transcribed text alone, or visual and auditory together. The autism spectrum disorder and control groups collectively assigned similar mean awkwardness ratings to individual scenes. However, individual participants with autism spectrum disorder tended to respond more idiosyncratically than controls, assigning ratings that were less correlated with the ratings of the other participants in the sample. We found no evidence that this group difference was isolated to any specific presentation modality. In a comparison condition, we found no group differences when participants instead rated the happiness of characters (a more basic social judgment) in full audiovisual format. Thus, although we observed differences in the manner with which high-functioning adults with autism spectrum disorder make social judgments compared to controls, these group differences may be dependent on the social dimension being judged, rather than the specific modality of presentation.