This study analyzes the validity of Gough's Creative Personality Scale (CPS) for the Adjective Check List (ACL) by using 1773 Swiss, South Korean, and Mainland Chinese students as a sample. Four sources of potential bias were identified in Gough's CPS, two of which are general and two cultural in nature. The two general biases were investigated by conducting correlation analyses and evaluating alternative scoring methods for the CPS. As a result of the first bias, checking a large number of adjectives was found to be more important for achieving a high score than checking the relevant ones. Due to the second bias, the CPS score mostly depends on the number of positive adjectives checked while negative items have little impact. The two cultural biases were analyzed using an implicit version of the CPS (iCPS) and factor analysis. The latter revealed three different clusters of creativity type: exploratory‐type, socially responsible‐type, and intellectual‐type creativity. Based on cultural background, they are all weighted differently, causing a potential experiential bias in the CPS. Findings indicate that in South Korea and Mainland China socially responsible‐type creativity dominates whereas in Switzerland exploratory‐type creativity prevails. Findings from the iCPS suggest the second cultural bias, the socially desirable responding bias arising from differences in responding styles among the three cultures.