We aimed to identify leisure activity (LA) trajectories and examined the association among baseline characteristics, LA trajectories, and the later disability among older Taiwanese adults. Data were from the Taiwan Longitudinal Study on Aging Survey for the years 1996-2007 (N = 3,186). LA trajectories were identified by using latent class growth curve modeling. Regression analyses were applied to predict the relationships among baseline characteristics, LA trajectories, and disability. Four LA trajectories—consistent high, consistent low, increasing, and decreasing—were identified. Lower depressive symptom was related to consistently active in LAs. Younger age and fewer comorbidities were related to develop an increasing LA trajectory. Participants in the consistent-high or increasing LA trajectories were more likely to be functionally independent, but those in the decreasing LA subgroup were more at risk of developing disability. The findings suggested that long-term changes in LA over time have benefits on physical health in older population.