Using panel data from two surveys in Japan and Europe, we examine the comparability of the self‐rated health of the middle‐aged and elderly across Japan and European countries and across the survey periods. We find that a person's own health is evaluated using different standards (thresholds) across the different countries and survey waves. When evaluated using common thresholds, the Japanese elderly are found to be healthier than their counterparts in the European countries. Reporting biases causing discrepancies between the changes in individuals' self‐rated health and their actual health over the survey waves are associated with education and country of residence.