Missing the dog that failed to bark in the nighttime: on the overestimation of occurrences over non-occurrences in hypothesis testing

In three studies, we investigated whether and to what extent the evaluation of two mutually exclusive hypotheses is affected by a feature-positive effect, wherein present clues are weighted more than absent clues. Participants (N = 126) were presented with abstract problems concerning the most likely provenance of a card that was drawn from one of two decks. We factored the correct response (the hypothesis favored by the consideration of all clues) and the ratio of present-to-absent features in each set of observations. Furthermore, across the studies, we manipulated the presentation format of the features’ probabilities by providing the probability distributions of occurrences (Study 1), non-occurrences (Study 3) or both (Study 2). In all studies, both participant preference and accuracy were mostly determined by an over-reliance on present features. Moreover, across participants, both confidence in the responses and the informativeness of the present clues correlated positively with the number of responses given in line with an exclusive consideration of present features. These results were mostly independent of both the rarity of the absent clues and the presentation format. We concluded that the feature-positive effect influences hypothesis evaluation, and we discussed the implications for confirmation bias.