Simple decisions require the processing and evaluation of perceptual and cognitive information, the formation of a decision, and often the execution of a motor response. This process involves the accumulation of evidence over time until a particular choice reaches a decision threshold. Using a random-dot-motion stimulus, we showed that simply delaying responses after the stimulus offset can almost double accuracy, even in the absence of new incoming visual information. However, under conditions in which the otherwise blank interval was filled with a sensory mask or concurrent working memory load was high, performance gains were lost. Further, memory and perception showed equivalent rates of evidence accumulation, suggesting a high-capacity memory store. We propose an account of continued evidence accumulation by sequential sampling from a simultaneously decaying memory trace. Memories typically decay with time, hence immediate inquiry trumps later recall from memory. However, the results we report here show the inverse: Inspecting a memory trumps viewing the actual object.