Relevance theory explains the selection task

Vagueness as an implicit-encoding persuasive strategy: an experimental approach

The paper provides novel theoretical and experimental perspectives on the functioning of linguistic vagueness as an implicit persuasive strategy. It presents an operative definition of pragmatically marked vagueness, referring to vague expressions whose interpretation is not retrievable by recipients. The phenomenon is illustrated via numerous examples of its use in predominantly persuasive texts (i.e., advertising and political propaganda) in different languages. The psycholinguistic functioning of vague expressions is then illustrated by the results of a self-paced reading task experiment. Data showing shorter reading times associated with markedly vague expressions as compared to expressions that are either (a) lexically more precise or (b) made precise by the context suggest that the former are interpreted in a shallow way, without searching for and/or retrieving exact referents. These results support the validity of a differentiation between context-supported vs. non-supported vague expressions. Furthermore, validation of using marked vagueness as a persuasive implicit strategy which reduces epistemic vigilance is provided.

The impact of problem domain on Bayesian inferences: A systematic investigation

Sparse (and occasionally contradictory) evidence exists regarding the impact of domain on probabilistic updating, some of which suggests that Bayesian word problems with medical content may be especially challenging. The present research aims to address this gap in knowledge through three pre-registered online studies, which involved a total of 2,238 participants. Bayesian word problems were related to one of three domains: medical, daily-life, and abstract. In the first two cases, problems presented realistic content and plausible numerical information, while in the latter, problems contained explicitly imaginary elements. Problems across domains were matched in terms of all relevant statistical values and, as much as possible, wording. Studies 1 and 2 utilized the same set of problems, but different response elicitation methods (i.e., an open-ended and a multiple-choice question, respectively). Study 3 involved a larger number of participants per condition and a smaller set of problems to more thoroughly investigate the magnitude of differences between the domains. There was a generally low rate of correct responses (17.2%, 17.4%, and 14.3% in Studies 1, 2, and 3, respectively), consistent with accuracy levels commonly observed in the literature for this specific task with online samples. Nonetheless, a small but significant difference between domains was observed: participants' accuracy did not differ between medical and daily-life problems, while it was significantly higher in corresponding abstract problems. These results suggest that medical problems are not inherently more difficult to solve, but rather that performance is improved with abstract problems for which participants cannot draw from their background knowledge.

How people reason with counterfactual and causal explanations for Artificial Intelligence decisions in familiar and unfamiliar domains

Few empirical studies have examined how people understand counterfactual explanations for other people's decisions, for example, "if you had asked for a lower amount, your loan application would have been approved". Yet many current Artificial Intelligence (AI) decision support systems rely on counterfactual explanations to improve human understanding and trust. We compared counterfactual explanations to causal ones, i.e., "because you asked for a high amount, your loan application was not approved", for an AI's decisions in a familiar domain (alcohol and driving) and an unfamiliar one (chemical safety) in four experiments (n = 731). Participants were shown inputs to an AI system, its decisions, and an explanation for each decision; they attempted to predict the AI's decisions, or to make their own decisions. Participants judged counterfactual explanations more helpful than causal ones, but counterfactuals did not improve the accuracy of their predictions of the AI's decisions more than causals (Experiment 1). However, counterfactuals improved the accuracy of participants' own decisions more than causals (Experiment 2). When the AI's decisions were correct (Experiments 1 and 2), participants considered explanations more helpful and made more accurate judgements in the familiar domain than in the unfamiliar one; but when the AI's decisions were incorrect, they considered explanations less helpful and made fewer accurate judgements in the familiar domain than the unfamiliar one, whether they predicted the AI's decisions (Experiment 3a) or made their own decisions (Experiment 3b). The results corroborate the proposal that counterfactuals provide richer information than causals, because their mental representation includes more possibilities.

Being ostensive (reply to commentaries on "Expression unleashed")

One of our main goals with "Expression unleashed" was to highlight the distinctive, ostensive nature of human communication, and the many roles that ostension can play in human behavior and society. The commentaries we received forced us to be more precise about several aspects of this thesis. At the same time, no commentary challenged the central idea that the manifest diversity of human expression is underpinned by a common cognitive unity. Our reply is organized around six issues: (1) languages and their cultural evolution; (2) the pervasiveness of expression in human behavior; (3) artificial intelligence and ostensive communication; (4) communication in other animals; (5) the ecology and evolution of ostensive communication; and (6) biolinguistics and pragmatics.

A Pragmatic Account of the Weak Evidence Effect

Language is not only used for neutral information; we often seek to persuade by arguing in favor of a particular view. Persuasion raises a number of challenges for classical accounts of belief updating, as information cannot be taken at face value. How should listeners account for a speaker’s “hidden agenda” when incorporating new information? Here, we extend recent probabilistic models of recursive social reasoning to allow for persuasive goals and show that our model provides a pragmatic account for why weakly favorable arguments may backfire, a phenomenon known as the weak evidence effect. Critically, this model predicts a systematic relationship between belief updates and expectations about the information source: weak evidence should only backfire when speakers are expected to act under persuasive goals and prefer the strongest evidence. We introduce a simple experimental paradigm called the Stick Contest to measure the extent to which the weak evidence effect depends on speaker expectations, and show that a pragmatic listener model accounts for the empirical data better than alternative models. Our findings suggest further avenues for rational models of social reasoning to illuminate classical decision-making phenomena.

How the Custom Suppresses the Endowment Effect: Exchange Paradigm in Kanak Country

In this paper, Knetsch's exchange paradigm is analyzed from the perspective of pragmatics and social norms. In this paradigm the participant, at the beginning of the experiment, receives an object from the experimenter and at the end, the same experimenter offers to exchange the received object for an equivalent object. The observed refusal to exchange is called the endowment effect. We argue that this effect comes from an implicature made by the participant about the experimenter's own expectations. The participant perceives the received item as a gift, or as a present, from the experimenter that cannot be exchanged as stipulated by the social norms of western politeness common to both the experimenter and the participant. This implicature, however, should not be produced by participants from Kanak culture for whom the perceived gift of a good will be interpreted as a first act of exchange based on gift and counter-gift. This exchange is a natural, frequent, balanced, and indispensable act for all Kanak social bonds whether private or public. Kanak people also know the French social norms that they apply in their interactions with French people living in New Caledonia. In our experiment, we show that when the exchange paradigm takes place in a French context, with a French experimenter and in French, the Kanak participant is subject to the endowment effect in the same way as a French participant. On the other hand, when the paradigm is carried out in a Kanak context, with a Kanak experimenter and in the vernacular language, or in a Kanak context that approaches the ceremonial of the custom, the endowment effect is no longer observed. The same number of Kanak participants accept or refuse to exchange the endowed item. These results, in addition to providing a new explanation for the endowment effect, highlight the great flexibility of decisions according to social-cultural context.

Opposites in Reasoning Processes: Do We Use Them More Than We Think, but Less Than We Could?

Our aim in this paper is to contribute toward acknowledging the general role of opposites as an organizing principle in the human mind. We support this claim in relation to human reasoning by collecting evidence from various studies which shows that "thinking in opposites" is not only involved in formal logical thinking, but can also be applied in both deductive and inductive reasoning, as well as in problem solving. We also describe the results of a series of studies which, although they have been developed within a number of different theoretical frameworks based on various methodologies, all demonstrate that giving hints or training reasoners to think in terms of opposites improves their performance in tasks in which spontaneous thinking may lead to classic biases and impasses. Since we all possess an intuitive idea of what opposites are, prompting people to "think in opposites" is something which is undoubtedly within everyone's reach and in the final section, we discuss the potential of this strategy and suggest possible future research directions of systematic testing the benefits that might arise from the use of this technique in contexts beyond those tested thus far. Ascertaining the conditions in which reasoners might benefit will also help in terms of clarifying the underlying mechanisms from the point of view, for instance, of analytical, conscious processing vs. automatic, unconscious processing.

Numbers do not add up! The pragmatic approach to the framing of medical treatments

The risky choice framing effect disclosed that presenting data in a loss scenario lead decision-makers towards risky choices. Conversely, a gain scenario prevents them from taking a risk. Framing effect robustness has been widely confirmed by psychological literature. However, the framing of medical treatments, based on McNeil et al. (1982) paradigm, raised both methodological doubts and contrasting evidence. Our research aimed to investigate the presence and the nature of the framing effect in the McNeil et al. (1982) paradigm. In particular, we thought that the obtained switch of preferences across frames was due to a misleading formulation of the data given in a negative cumulative frequency format. We conducted three studies: (1) we replicated McNeil et al.’s (1982) original study (N=150) with medicine (n=50), statistics (n=50) and lay (n=50) students; (2) we tested (N=180) our hypothesis by comparing a cumulative frequency format with an alternative version, namely a linear progression one; (3) we compared (N=430) the effect of different formats (cumulative frequency, linear progression and interval frequency) on choices. Our results showed that, while the framing effect is present when employing a cumulative frequency format, it disappears when using a linear progression one. Moreover, our results show that decision-makers better understand information when given in a linear progression and an interval frequency format. In the current paper, we argue that the way in which a problem is formulated plays a relevant role in the representation of the decisional task and the decision-making.

Pragmatics in the False-Belief Task: Let the Robot Ask the Question!

The poor performances of typically developing children younger than 4 in the first-order false-belief task "Maxi and the chocolate" is analyzed from the perspective of conversational pragmatics. An ambiguous question asked by an adult experimenter (perceived as a teacher) can receive different interpretations based on a search for relevance, by which children according to their age attribute different intentions to the questioner, within the limits of their own meta-cognitive knowledge. The adult experimenter tells the child the following story of object-transfer: "Maxi puts his chocolate into the green cupboard before going out to play. In his absence, his mother moves the chocolate from the green cupboard to the blue one." The child must then predict where Maxi will pick up the chocolate when he returns. To the child, the question from an adult (a knowledgeable person) may seem surprising and can be understood as a question of his own knowledge of the world, rather than on Maxi's mental representations. In our study, without any modification of the initial task, we disambiguate the context of the question by (1) replacing the adult experimenter with a humanoid robot presented as "ignorant" and "slow" but trying to learn and (2) placing the child in the role of a "mentor" (the knowledgeable person). Sixty-two typical children of 3 years-old completed the first-order false belief task "Maxi and the chocolate," either with a human or with a robot. Results revealed a significantly higher success rate in the robot condition than in the human condition. Thus, young children seem to fail because of the pragmatic difficulty of the first-order task, which causes a difference of interpretation between the young child and the experimenter.

Task relevance effect on number/shape conflict detection in the number-matching task: An ERP study

It is debatable whether the task relevance effect on a conflict occurs in the detection or in the inhibition underlying sequential matching. To explore this issue, three types of number pairs, identical (e.g., 12, 12), conserved (e.g., 12, ), and non-conserved (e.g., 12, 15) pairs, were displayed to be judged as perceptually (identical shape condition) or quantitatively (identical value condition) the same. Both error rates and RTs for the three types of number pairs showed different patterns to detect perceptual mismatch in the identical shape condition and number inequivalence in the identical value conditions. The event-related potential (ERP) results showed that increased N200 and N400 as well as decreased P300 were triggered by the conserved and non-conserved pairs in contrast to identical pairs in the identical shape condition and by the non-conserved pairs relative to the conserved and identical pairs in the identical value condition. These results showed that task-relevant mismatches were attended to and detected in both conditions. Therefore, for the task-relevance effect on a conflict, attention is selectively directed to task-relevant features rather than inhibiting task-irrelevant conflict.

Cross-linguistic frequency and the learnability of semantics: Artificial language learning studies of evidentiality

It is often assumed that cross-linguistically more prevalent distinctions are easier to learn (Typological Prevalence Hypothesis; TPH). Prior work supports this idea in phonology, morphology and syntax but has not addressed semantics. Using Artificial Language Learning experiments with adults, we test predictions made by the TPH about the relative learnability of semantic distinctions in the domain of evidentiality, i.e., the linguistic encoding of information source. As the TPH predicted, when exposed to miniature evidential morphological systems, adult speakers of English whose language does not encode evidentiality grammatically learned the typologically most prevalent system (marking indirect, reportative information) better compared to less-attested systems (Experiments 1-2). Similar patterns were observed when non-linguistic symbols were used to encode evidential distinctions (Experiment 3). Our data support the conjecture that some semantic distinctions are marked preferentially and acquired more easily compared to others in both language and other symbolic systems.

Immunising' physicians against availability bias in diagnostic reasoning: a randomised controlled experiment

Background

Diagnostic errors have often been attributed to biases in physicians’ reasoning. Interventions to ‘immunise’ physicians against bias have focused on improving reasoning processes and have largely failed.

Objective

To investigate the effect of increasing physicians’ relevant knowledge on their susceptibility to availability bias.

Design, settings and participants

Three-phase multicentre randomised experiment with second-year internal medicine residents from eight teaching hospitals in Brazil.

Interventions

Immunisation: Physicians diagnosed one of two sets of vignettes (either diseases associated with chronic diarrhoea or with jaundice) and compared/contrasted alternative diagnoses with feedback. Biasing phase (1 week later): Physicians were biased towards either inflammatory bowel disease or viral hepatitis. Diagnostic performance test: All physicians diagnosed three vignettes resembling inflammatory bowel disease, three resembling hepatitis (however, all with different diagnoses). Physicians who increased their knowledge of either chronic diarrhoea or jaundice 1 week earlier were expected to resist the bias attempt.

Main outcome measurements

Diagnostic accuracy, measured by test score (range 0–1), computed for subjected-to-bias and not-subjected-to-bias vignettes diagnosed by immunised and not-immunised physicians.

Results

Ninety-one residents participated in the experiment. Diagnostic accuracy differed on subjected-to-bias vignettes, with immunised physicians performing better than non-immunised physicians (0.40 vs 0.24; difference in accuracy 0.16 (95% CI 0.05 to 0.27); p=0.004), but not on not-subjected-to-bias vignettes (0.36 vs 0.41; difference −0.05 (95% CI −0.17 to 0.08); p=0.45). Bias only hampered non-immunised physicians, who performed worse on subjected-to-bias than not-subjected-to-bias vignettes (difference −0.17 (95% CI −0.28 to −0.05); p=0.005); immunised physicians’ accuracy did not differ (p=0.56).

Conclusions

An intervention directed at increasing knowledge of clinical findings that discriminate between similar-looking diseases decreased physicians’ susceptibility to availability bias, reducing diagnostic errors, in a simulated setting. Future research needs to examine the degree to which the intervention benefits other disease clusters and performance in clinical practice.

Trial registration number

68745917.1.1001.0068.

How to Get Rid of the Belief Bias: Boosting Analytical Thinking via Pragmatics

The previous research attempts to reduce the influence of the belief bias on deductive thinking have often been unsuccessful and, when they succeeded, they failed to replicate. In this paper, we propose a new way to see an old problem. Instead of considering the analytical abilities of the respondent, we focus on the communicative characteristics of the experimental task. By changing the pragmatics into play through a subtle manipulation of the instruction of the syllogism problem, we obtained a strong improvement in the accuracy of the performance in both untrained and trained in logic respondents. We suggest that current models of deductive thinking should be broadened to consider also communicative understanding as part of the processing of the problem.

Cooperation in Online Conversations: The Response Times as a Window Into the Cognition of Language Processing

Measuring the cognitive cost of interpreting the meaning of sentences in a conversation is a complex task, but it is also at the core of Sperber and Wilson's Relevance Theory. In cognitive sciences, the delay between a stimulus and its response is often used as an approximation of the cognitive cost. We have noticed that such a tool had not yet been used to measure the cognitive cost of interpreting the meaning of sentences in a free-flowing and interactive conversation. The following experiment tests the ability to discriminate between sentences with a high cognitive cost and sentences with a low cognitive cost using the response time of the participants during an online conversation in a protocol inspired by the Turing Test. We have used violations of Grice's Cooperative Principle to create conditions in which sentences with a high cognitive cost would be produced. We hypothesized that response times are directly correlated to the cognitive cost required to generate implicatures from a statement. Our results are coherent with the literature in the field and shed some new light on the effect of violations on the humanness of a conversational agent. We show that violations of the maxim of Relation had a particularly important impact on response times and the perceived humanness of a conversation partner. Violations of the first maxim of Quantity and the fourth maxim of Manner had a lesser impact, and only on male participants.

The Truth of Conditional Assertions

Given a basic conditional of the form, If A then C, individuals usually list three cases as possible: A and C, not-A and not-C, not-A and C. This result corroborates the theory of mental models. By contrast, individuals often judge that the conditional is true only in the case of A and C, and that cases of not-A are irrelevant to its truth or falsity. This result corroborates other theories of conditionals. To resolve the discrepancy, we devised two new tasks: the "collective" truth task, in which participants judged whether sets of assertions about a specific individual, such as: If A then C, not-A, C, could all be true at the same time; and one in which participants judged the truth of conditional predictions about specific future events. The results consistently matched the three possibilities, thereby corroborating the model theory. They also showed a massive violation of the probability calculus in estimates of the probabilities of the four cases in the partition of conditionals (A and C, A and not-C, not-A and C, and not-A and not-C), which summed to over 200%.

Domains of deontic reasoning: Resolving the discrepancy between the cognitive and moral reasoning literatures

Deontic reasoning has been studied in two subfields of psychology: the cognitive and moral reasoning literatures. These literatures have drawn different conclusions about the nature of deontic reasoning. The consensus within the cognitive reasoning literature is that deontic reasoning is a unitary phenomenon, whereas the consensus within the moral reasoning literature is that there are different subdomains of deontic reasoning. We present evidence from a series of experiments employing the methods of both literatures suggesting that people make a systematic distinction between two types of deontic rule: social contracts and precautions. The results call into question the prevailing opinion in the cognitive reasoning literature and provide further support for both an evolutionary view of deontic reasoning and the more domain-specific perspective found in the moral reasoning literature.

Inspection Times and the Selection Task: Are They Relevant?

Five experiments are reported based upon Evans'(1996) inspection time paradigm in which subjects are required to solve computer-presented Wason Selection Task problems while simultaneously using a mouse to indicate which card is currently under consideration. It had previously been found that selected cards were inspected for considerably longer than were non-selected cards, and this was taken as support for the existence of pre-conscious heuristics that direct attention towards relevant aspects of a problem. The first experiment reported here fully replicated this effect. However, by systematically varying the task format in subsequent experiments, the effect was found to diminish, disappear, or even reverse. The change in effect size and direction was not accompanied by any systematic variations in the subjects’ card choices, indicating that the changes in taskformat had not altered the operation of the relevance-determining heuristics. On balance, it is suggested that the inspection time effect appears to be artefactual, and the inspection time paradigm therefore does not constitute satisfactory evidence for the existence of pre-conscious heuristics.

The Influence of Linguistic Form on Reasoning: The Case of Matching Bias

A well-established phenomenon in reasoning research is matching bias: a tendency to select information that matches the lexical content of propositional statements, regardless of the logically critical presence of negations. Previous research suggested, however, that the effect might be restricted to reasoning with conditional statements. This paper reports two experiments in which participants were required to construct or identify true and false cases of propositional rules of several kinds, including universal statements, disjunctions, and negated conjunctions. Matching bias was observed across all rule types but largely restricted to problems where participants were required to falsify rather than to verify the rules. A third experiment showed a similar generalization across linguistic forms in the Wason selection task with only if conditionals substituted for universals. The results are discussed with reference to contemporary theories of propositional reasoning.