Older adults tend to have lower emotion-perception accuracy compared to younger adults. Previous studies have centered on individual characteristics, including cognitive decline and positive attentional preferences, as possible mechanisms underlying these age differences in emotion perception; however, thus far, no perceiver-focused factor has accounted for the age differences. The present study focuses on perceived social-context factors and uses the Social Input Model as the framework for investigating the relation between the expressivity of the social environment and emotion-perception accuracy in younger and older adults. Younger (n = 32) and older adults (n = 29) reported on the make-up of their social circles and the expressivity of their three closest social partners and then completed a static facial emotion-perception task. Older adults reported greater positive and negative expressivity in their social partners compared to younger adults. Moreover, older adults were marginally less accurate than younger adults when perceiving emotions. Positive expressivity of the social partners predicted lower emotion-perception accuracy in younger but not older adults. Our findings mark the first step to identifying possible characteristics of the social environment that may contribute to the age difference in emotion-perception accuracy.