Aim The association between sarcopenia diagnosed according to the criteria of the Asian Working Group for Sarcopenia and increased mortality risk is currently unknown. The present study assessed the longitudinal relationship between sarcopenia and mortality risk in an elderly Japanese population. Methods Participants were 720 community‐dwelling Japanese individuals aged 65–79 years at baseline (November 1997 to April 2000). The participants were followed from baseline to 31 December 2014 (mean duration 11.0 years). Sarcopenia was diagnosed according to the Asian Working Group for Sarcopenia criteria, using extremity muscle mass assessed by dual‐energy X‐ray absorptiometry, grip strength and gait speed. A population dynamics survey was used to obtain information on deaths. The relationship between sarcopenia and mortality was assessed using Kaplan–Meier survival curves and Cox proportional hazards regression. The Cox proportional hazards model was used to control for potential confounders, including age at baseline, body mass index, total caloric intake, alcohol intake, current smoking habits, leisure‐time physical activity and the number of current diseases. Results The fully adjusted hazard ratio for all‐cause mortality among men in the sarcopenia group was 1.95 (95% confidence interval 1.04–3.67) compared with that in the normal group. No significant association between sarcopenia and all‐cause mortality was observed among women. Conclusion The complications of sarcopenia, including low muscle mass, low grip strength and low gait speed, appear to be significant risks for mortality in older Japanese men. Geriatr Gerontol Int 2016; ••: ••–••.