Sensory processing alterations are highly prevalent in autism spectrum disorder (ASD). Neurobiologically‐based theories of ASD propose that abnormalities in the processing of temporal aspects of sensory input could underlie core symptoms of ASD. For example, rapid auditory temporal processing is critical for speech perception, and language difficulties are central to the social communication deficits defining the disorder. This study assessed visual and auditory temporal processing abilities and tested their relation to core ASD symptoms. 53 children (26 ASD, 27 TD) completed visual and auditory psychophysical gap detection tasks to measure gap detection thresholds (i.e., the minimum interval between sequential stimuli needed for individuals to perceive an interruption between the stimuli) in each domain. Children were also administered standardized language assessments such that the relation between individual differences in auditory gap detection thresholds and degree of language and communication difficulties among children with ASD could be assessed. Children with ASD had substantially higher auditory gap detection thresholds compared to children with TD, and auditory gap detection thresholds were correlated significantly with several measures of language processing in this population. No group differences were observed in the visual temporal processing. Results indicate a domain‐specific impairment in rapid auditory temporal processing in ASD that is associated with greater difficulties in language processing. Findings provide qualified support for temporal processing theories of ASD and highlight the need for future research testing the nature, extent, and universality of auditory temporal processing deficits in this population. Autism Res 2017. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.