Three experiments investigated views on modulation of visual selectivity that involve hemisphere‐dependence and conflict frequency based views for a whole display. In each experiment, 16 participants completed a flanker task with compatible/incompatible stimulus arrays presented in the left, center, or right visual fields. The relative frequency of the compatible stimulus‐arrays within a trial block was varied as a function of the visual field. In Experiment 1, the relative compatibility frequency in the lateral visual fields was varied (75% / 25%) but not in the center visual field (50%). The results showed that in the lateral visual fields, the performance between the compatible and incompatible trials differed more in conditions with few (vs. many) compatibility trials. Experiments 2 and 3 validated these findings. In Experiment 2, the compatibility frequency varied in the center visual field but not in the lateral fields, resulting in performance effects in all three visual fields. Experiment 3 varied the magnitude of the differences between the compatibility and incompatibility frequencies. Together, the findings showed that participants adjusted to the frequencies of compatible stimuli in all visual fields, indicating conflict adaptation that depends on the relative frequencies of compatible stimuli. The results also suggest that this adaptation is associated with hemisphere‐dependent and location‐specific mechanisms.