This study investigated the relationship among working memory, processing speed, math performance, and reactivity to stress in 83 Grade 1 children. Specifically, 39 children with math disability (MD) were compared to 44 children who are typically achieving (TA) in mathematics. It is the first study to use a physiological index of stress (salivary cortisol levels) to measure children’s reactivity while completing tasks that assess the core components of MD: working memory for numbers, working memory for words, digits backward, letter number sequence, digit span forward, processing speed for numbers and words, block rotation, and math tasks. Grade 1 children with MD obtained significantly lower scores on the letter number sequence and quantitative concepts tasks. Higher levels of reactivity significantly predicted poorer performance on the working memory for numbers, working memory for words, and quantitative concepts tasks for Grade 1 children, regardless of math ability. Grade 1 children with MD and higher reactivity had significantly lower scores on the letter number sequence task than the children with MD and low reactivity. The findings suggest that high reactivity impairs performance in working memory and math tasks in Grade 1 children, and young children with high reactivity may benefit from interventions aimed at lowering anxiety in stressful situations, which may improve learning.