This study investigated the structural relationships among destination social responsibility (DSR), tourism impacts (i.e., positive and negative impacts), residents’ support for tourism, and their perceived quality of life. A structural model was empirically tested with a sample of 272 residents living in the Phoenix Ancient Town in China. The results indicated that DSR enhanced residents’ perception of positive tourism impacts but did not influence their perception of negative impacts. Concurrently, DSR was found to have direct and positive effects on residents’ support for tourism and perceived quality of life. It also had indirect and positive effects on residents’ support for tourism and perceived quality of life, mediated by positive tourism impacts. While residents’ perceived positive tourism impacts increased their support for tourism and perceived quality of life, negative impacts would undermine support for tourism and proved to be disruptive to quality of life.