This article describes an empirical refinement of the Runco Ideational Behavior Scale (RIBS). The RIBS seems to be associated with divergent thinking, and the potential for creative thinking, but it was possible that its validity could be improved. With this in mind, three new scales were developed and the unique benefit (or “incremental validity”) of each was assessed. The three validity scales contained (a) distractor items, (b) contraindicative items, or (c) items constituting a lie scale. Step‐wise analyses using the three validity scales indicated very little incremental validity: They were interpreted in the light of psychometric theory, which suggests that their contribution may have been on a behavioral rather than on a statistical level. One additional analysis explored the possibility that a short form could be constructed. The short form of the RIBS was highly correlated with the long form (r = .94). Thus, most decisions made by the short form will be entirely compatible with decisions that would have been reached using the long form. A second significant result was that the RIBS was highly correlated with a check list of creative activities, supporting its concurrent validity.