Quantitative Indices of Student Social Media Engagement in Tertiary Education: A Systematic Review and a Taxonomy

Recent studies have evaluated the use of social media as learning aids in tertiary education. Emerging research in this area has focused primarily on non-quantitative approaches to student social media engagement. However, quantitative engagement outcomes may be extracted from student posts, comments, likes, and views. The goal of the present review was to provide a research-informed taxonomy of quantitative and behavior-based metrics of student social media engagement. We selected 75 empirical studies comprising a pooled sample of 11,605 tertiary education students. Included studies used social media for educational purposes and reported student social media engagement outcomes (source databases: PsycInfo and ERIC). We used independent raters and stringent interrater agreement and data extraction processes to mitigate bias during the screening of references. Over half of the studies (52%, n = 39) utilized ad hoc interviews and surveys to estimate student social media engagement, whereas thirty-three studies (44%) used some form of quantitative analysis of engagement. Based on this literature, we present a selection of count-based, time-based, and text-analysis metrics. The proposed taxonomy of engagement metrics resulting provides the methodological basis for the analysis of social media behavior in educational settings, particularly, for human operant and behavioral education studies. Implications for future research are discussed.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10864-023-09516-6.

Verbal Behavior Analysis of Expert and Inexperienced Therapists Applying the Socratic Method

The Socratic method, as an eminently verbal procedure, will be analyzed from a behavioral perspective in order to clarify how verbal conditioning works within. This work compares the verbalizations that expert and inexperienced therapists emit during Socratic method to find out which and why certain therapist verbalizations are most successful in changing client responses. The sample consisted of 113 Socratic method fragments from 18 cases, analyzed by observational methodology. The expert therapists had more than 6 years of experience, the inexperienced less than 2. Experts had fewer failure Socratic method fragments, but there were no differences in successful ones. The way of questioning had a different pattern: Inexperienced therapists suggested more the response, experts used more didactic verbalizations; also, experts used the aversive component more and contingently. The creation of guidelines based on functional description of verbal interaction and the need for novice psychologists training are some implications of these results.

Toward an experimental analysis of verbal shaping in psychotherapy

AbstractObjective. Some authors have suggested that verbal shaping is an active component in cognitive restructuring. The goal of the current study was to provide experimental evidence in support of the shaping hypothesis.

METHOD

Three consecutively admitted adults with symptoms of anxiety and depression participated in the study. Participants underwent baseline, treatment comparison, crossover, and follow-up phases as part of an experimental single-case study. We selected two target irrational beliefs and praised either the client's approximations to a terminal (more adaptive) class of verbalizations (differential reinforcement of approximations) or just the terminal class of verbalizations (terminal reinforcement).

RESULTS

Irrational beliefs exposed to differential reinforcement of approximations was a more effective approach to reducing irrational beliefs.

CONCLUSION

The study provides experimental evidence in support of the verbal shaping hypothesis. Our findings suggest that it may be possible to enhance clinical outcomes by actively engaging in verbal shaping during client-therapist verbal interaction.

Studying the Therapeutic Process by Observing Clinicians' In-Session Behaviour

This paper presents a further step in the use and validation of a systematic, functional-analytic method of describing psychologists' verbal behaviour during therapy. We observed recordings from 92 clinical sessions of 19 adults (14 women and 5 men of Caucasian origin, with ages ranging from 19 to 51 years) treated by nine cognitive-behavioural therapists (eight women and one man, Caucasian as well, with ages ranging from 25 to 48 years). The therapists' verbal behaviour was codified and then classified according to its possible functionality. A cluster analysis of the data, followed by a discriminant analysis, showed that the therapists' verbal behaviour tended to aggregate around four types of session differentiated by their clinical objective (assessment, explanation, treatment and consolidation). These results confirm the validity of our method and enable us to further describe clinical phenomena by distinguishing psychologists' classes of clinically relevant activities. Specific learning mechanisms may be responsible for clinical change within each class. These issues should be analysed more closely when explaining therapeutic phenomena and when developing more effective forms of clinical intervention.

KEY PRACTITIONER MESSAGE

We described therapists' verbal behaviour in a focused fashion so as to develop new research methods that evaluate psychological work moment by moment. We performed a cluster analysis in order to evaluate how the therapists' verbal behaviour was distributed throughout the intervention. A discriminant analysis gave us further information about the statistical significance and possible nature of the clusters we observed. The therapists' verbal behaviour depended on current clinical objectives and could be classified into four classes of clinically relevant activities: evaluation, explanation, treatment and consolidation. Some of the therapist's verbalizations were more important than others when carrying out these clinically relevant activities. The distribution of the therapists' verbal behaviour across classes may provide us with clues regarding the functionality of their in-session verbal behaviour.

Descriptive study of the Socratic method: evidence for verbal shaping

In this study we analyzed 65 fragments of session recordings in which a cognitive behavioral therapist employed the Socratic method with her patients. Specialized coding instruments were used to categorize the verbal behavior of the psychologist and the patients. First the fragments were classified as more or less successful depending on the overall degree of concordance between the patient's verbal behavior and the therapeutic objectives. Then the fragments were submitted to sequential analysis so as to discover regularities linking the patient's verbal behavior and the therapist's responses to it. Important differences between the more and the less successful fragments involved the therapist's approval or disapproval of verbalizations that approximated therapeutic goals. These approvals and disapprovals were associated with increases and decreases, respectively, in the patient's behavior. These results are consistent with the existence, in this particular case, of a process of shaping through which the therapist modifies the patient's verbal behavior in the overall direction of his or her chosen therapeutic objectives.

Functional Analysis of the Verbal Interaction Between Psychologist and Client During the Therapeutic Process

The goal of this study is to analyze the verbal interaction that takes place between client and therapist over the course of a clinical intervention so as to analyze the potential learning processes that may be responsible for changes in the client’s behavior. A total of 92 sessions were analyzed, corresponding to 19 clinical cases treated by 9 therapists specializing in behavioral therapy. The variables considered were therapist and client verbal behaviors, and these were categorized according to their possible functions and/or morphologies. The Observer XT software was used as a tool for the observational analysis. The results led to the conclusion that the therapist responds differentially to client verbalizations, modifying the verbal contingencies as his or her client content approaches or becomes more distant from therapeutic objectives. These results suggest the possible existence of verbal “shaping” processes through which the therapist guides the client’s verbal behavior toward more adaptive forms. In addition, this study proposes an alternative to the traditional controversy regarding the relevance of the therapeutic relationship versus the treatment techniques used to explain clinical change. This article suggests that such differentiation is unnecessary because the therapeutic relationship and the treatment techniques should act in the same manner, this is, in providing the context for the occurrence of what is truly therapeutic, namely, the learning processes.