A citation analysis of the influence on research of Skinner's verbal behavior

Citation Analysis of The Analysis of Verbal Behavior (2008-2018)

Recent articles by the editorial board of The Analysis of Verbal Behavior (TAVB) include calls for greater integration, collaboration, and inclusion. In so doing, it may be helpful to consider TAVB's current reach. Previously, Petursdottir, Peterson, and Peters (The Analysis of Verbal Behavior, 25, 109-121, 2009) described the number of citations of articles published in TAVB from 1983 to 2007. The authors found that the greatest number of references to TAVB were self-citations, followed predominantly by other behavior-analytic outlets, such as the Journal of Applied Behavior Analysis. Here, we replicate and extend the work of Petursdottir et al. (The Analysis of Verbal Behavior, 25, 109-121, 2009) by conducting a citation analysis of references included in TAVB publications from 2008 to 2018 and also report citations by these venues to TAVB. This citation analysis allows for a more recent review of those outlets that articles published in TAVB commonly reference and those that cite TAVB. Generally, self-citations predominated, with articles published in TAVB commonly referencing books and chapters. The implications of these practices on the impact of TAVB and suggestions for moving forward are considered.

The impact of Verbal Behavior on the scholarly literature from 2005 to 2016

B. F. Skinner's (1957) Verbal Behavior had a limited influence on empirical research in the first few decades following its publication, but an increase in empirical activity has been evident in recent years. The purpose of this article is to update previous analyses that have quantified the influence of Verbal Behavior on the scholarly literature, with an emphasis on its impact on empirical research. Study 1 was a citation analysis that showed an increase in citations to Verbal Behavior from 2005 to 2016 relative to earlier time periods. In particular, there was a large increase in citations from empirical articles. Study 2 identified empirical studies in which a verbal operant was manipulated or measured, regardless of whether or not Verbal Behavior was cited, and demonstrated a large increase in publication rate, with an increasing trend in the publication of both basic and applied experimental analyses throughout the review period. A majority of the studies were concerned with teaching verbal behavior to children with autism spectrum disorder and other developmental disabilities, but a variety of other basic and applied research topics were also represented. The results suggest a clearly increasing impact of Verbal Behavior on the experimental analysis of behavior on the 60th anniversary of the book's publication.

Empirical Investigations of the Intraverbal: 2005-2015

Several papers have reviewed the literature based on Skinner's conceptual framework presented in his 1957 book, Verbal Behavior. These reviews have called for more research on the topic of verbal behavior generally and often for more research on particular verbal operants. For example, Sautter and LeBlanc (2006) urged the behavior-analytic community to conduct more research on the intraverbal because of the scant existing literature base at that time. In the current review, we replicate the procedures used by Sautter and LeBlanc focusing specifically on the intraverbal relation and on the literature published in the 10 years since their call for research. We summarize the publication themes, provide graphs of the trends and types of published articles, and offer ideas for future research specific to the intraverbal.

Publication trends in The Analysis of Verbal Behavior: 1982-1998

Every article published in The Analysis of Verbal Behavior (TAVB) from its inception as a newsletter through 1998 was rated along several dimensions. Results indicated that the journal has grown substantially over time. Most articles (overall, 73%) published in TAVB did not describe experiments. The experiments that were described characteristically used within-subject designs and direct measures of behavior. They were conducted mostly by researchers in academic settings, using students as participants. Several authors have recently suggested that the journal should publish more experimental articles, covering a wider range of topics. The present results show that there is indeed room for more experimental articles, although they also underscore that the Journal has played, and continues to play, a major role as an outlet for both empirical and theoretical analyses of verbal behavior.

On the relation between radical behaviorism and the science of verbal behavior

A fully-developed "science of verbal behavior" may depend upon a recognition of the implications of Skinner's scientific system, radical behaviorism, particularly as it relates to the nature of scientific research. An examination of the system and Skinner's own research practices imply, for example, that samples of vocal or written verbal behavior collected under controlling conditions may be observed as directly for the effects of controlling contingencies as in the traditional practice involving cumulative response records. Such practices may be defended on the basis of the pragmatic epistemology which characterizes radical behaviorism. An example of one type of exploratory method is described.

Rule-governed behavior: Unifying radical and paradigmatic behaviorism

Commonalities and differences between Skinner's analysis of verbal behavior and the paradigmatic behaviorism (PB) approach are described as a means of introducing the latter to behavior analysis. The focus is on treating the topic of rule-governed behavior-a topic of current interest in behavior analysis in addressing the challenge of cognitive psychology-within the PB framework. Dealing behaviorally with traditional psychology interests is considered important in PB, and this article aims to advance toward that goal. PB has presented a framework that deals with not only the behavioral description of language but also with language function as well as language acquisition. This includes a treatment of the manner in which verbal stimuli generally can control motor behavior. This framework includes analyses in addition to those present in the behavior analytic framework, along with empirical developments, and these can be used to enhance a behavioral understanding of important parts of verbal behavior and the effects of verbal stimuli on behavior, including rule-governed phenomena. Our purpose is to use the particular topic of rule-governed behavior to argue that a more explicit interaction between radical and paradigmatic behaviorism would advance behaviorism and also enable it to have a stronger impact upon psychology and the scientific community.

The Case Against B. F. Skinner 45 years Later: An Encounter with N. Chomsky

Chomsky's (1959) review of Verbal Behavior (Skinner, 1957) has been hailed as the most influential document in the history of psychology. Although many rejoinders to Chomsky's review have been published, their impact has been minimal. Moreover, Chomsky has not answered them in detail. To invite Chomsky to revisit a number of matters concerning the review, he was interviewed. The principal topics addressed by Chomsky were (a) historical factors associated with behaviorism after World War II; (b) circumstances surrounding the preparation of the review; (c) likely compatibility between formal and functional analyses of language; and (d) Chomsky's current point of view on aspects of the content of his review and on the evolution of behavior analysis.

Extended Analysis of Empirical Citations with Skinner's Verbal Behavior: 1984-2004

The present paper comments on and extends the citation analysis of verbal operant publications based on Skinner's Verbal Behavior (1957) by Dymond, O'Hora, Whelan, and O'Donovan (2006). Variations in population parameters were evaluated for only those studies that Dymond et al. categorized as empirical. Preliminary results indicate that the majority of empirical research in the area of verbal behavior has been conducted with the younger developmentally disabled population and has focused on verbal operants from the introductory chapters of Skinner's book. It is clear that Verbal Behavior has influenced empirical research over the past 50 years. We believe, however, that there are many underdeveloped research areas originating from Verbal Behavior that have not yet been addressed. Suggestions for extended areas of research are provided.

The history of behavior analysis: Some historiography and a bibliography

This article has two main purposes. First, it introduces the discipline of historiography and, second, it provides a selected bibliography on the history of behavior analysis. In introducing the former in the context of the latter, four important methodological considerations involved in the process and product of historiography are described: The sources from which historical materials are drawn (i.e., primary, secondary, and tertiary) and three dimensions along which historiography is conducted and evaluated-internalist vs. externalist, great person vs. Zeitgeist, and presentist vs. historicist. Integrated throughout are four purposes for the historiography of behavior analysis, as well as an overview of the topics covered in the extant literature. The manuscript concludes with a listing of current bibliographic material by publication type and topic.

Verbal behavior: The other reviews

The extensive attention devoted to Noam Chomsky's review of Verbal Behavior by B.F. Skinner has resulted in a neglect of more than a dozen other rewiews of the work. These are surveyed and found to be positive and congenial in tone, with many of the reviewers advancing his/her own analysis of speech and language. The dominant criticism of the book was its disregard of central or implicit processes and its lack of experimental data. An examination of the receptive history of Verbal Behavior offers a more balanced historical account than those which rely excessively on Chomsky's commentary.

Whither the muse: What influences empirical research on verbal behavior?

To identify some of the published works that have helped to inspire empirical verbal behavior research, we searched for patterns in the sources cited in empirical studies published in The Analysis of Verbal Behavior between 1990 and 1999. Not unexpectedly, Skinner's (1957) Verbal Behavior was the most cited source, although a variety of more recent sources explicating verbal relations as conceptualized by Skinner also were frequently cited. About one third of the most frequently cited sources were fairly recent primary empirical papers. These outcomes suggest that scholars who are interested in a behavior-analytic approach to studying verbal behavior are beginning to generate a critical mass of work that renders Verbal Behavior no longer monolithic in its influence. Nevertheless, some aspects of the citation data could be interpreted as evidence of insularity, and we argue for the importance of a broad-based analysis of verbal behavior that can have substantial impact outside of behavior analysis.

Teaching verbal behavior to pigeons

Pigeons were taught simple analogs of verbal behavior by replicating and extending the procedures presented by Michael, Whitley, and Hesse (1983). A student lab, connected to a course on the experimental analysis of behavior, was used to teach both the students and the pigeons new behavioral repertoires. Most of the 18 birds learned a simple stimulus-selection-based tact, as well as 2-3 topography-based tacts. Several pigeons learned to mand for reinforcers, and a few acquired some simple intraverbal responses. The student's learned the basic features of Skinner's analysis of verbal behavior, as well as several laboratory skills. Further work in this area is encouraged due to its potential contributions to the experimental analysis of verbal behavior, and to teaching language to the developmentally disabled, and other speech and language impaired individuals.

Quantified trends in the history of verbal behavior research

The history of scientific research about verbal behavior research, especially that based on Verbal Behavior (Skinner, 1957), can be assessed on the basis of a frequency and celeration analysis of the published and presented literature. In order to discover these quantified trends, a comprehensive bibliographical database was developed. Based on several literature searches, the bibliographic database included papers pertaining to verbal behavior that were published in the Journal of the Experimental Analysis of Behavior, the Journal of Applied Behavior Analysis, Behaviorism, The Behavior Analyst, and The Analysis of Verbal Behavior. A nonbehavioral journal, the Journal of Verbal Learning and Verbal Behavior was assessed as a nonexample comparison. The bibliographic database also included a listing of verbal behavior papers presented at the meetings of the Association for Behavior Analysis. Papers were added to the database if they (a) were about verbal behavior, (b) referenced B.F. Skinner's (1957) book Verbal Behavior, or (c) did both. Because the references indicated the year of publication or presentation, a count per year of them was measured. These yearly frequencies were plotted on Standard Celeration Charts. Once plotted, various celeration trends in the literature became visible, not the least of which was the greater quantity of verbal behavior research than is generally acknowledged. The data clearly show an acceleration of research across the past decade. The data also question the notion that a "paucity" of research based on Verbal Behavior currently exists. Explanations of the acceleration of verbal behavior research are suggested, and plausible reasons are offered as to why a relative lack of verbal behavior research extended through the mid 1960s to the latter 1970s.

301 research topics from Skinner's book verbal behavior

Skinner's (1957) analysis of verbal behavior addresses some of the most important issues in human behavior. However, relatively few of the analyses presented by Skinner in Verbal Behavior have been subjected to an experimental analysis. The current list of topics was assembled in an effort to stimulate empirical research on verbal behavior. The list contains thirty research areas with ten topics suggested for each area. A final topic, education, is presented as a challenge to behavior analysts.

A review of empirical studies of verbal behavior

This paper reviews empirical research which has been directly influenced by Skinner's Verbal Behavior. Despite the importance of this subject matter, the book has generated relatively little empirical research. Most studies have focused on Skinner's mand and tact relations while research focused on the other elementary verbal operants has been limited. However, the results of empirical research that exist support Skinner's analysis of the distinction between elementary verbal operants and his distinction between the speaker's and listener's repertoires. Further, research suggests that language training programs may not be successful if they do not provide explicit training of each elementary verbal operant and independent training of speaker's and listener's repertoires.

Analyzing the reinforcement process at the human level: can application and behavioristic interpretation replace laboratory research?

Critics have questioned the value of human operant conditioning experiments in the study of fundamental processes of reinforcement. Contradictory results from human and animal experiments have been attributed to the complex social and verbal history of the human subject. On these grounds, it has been contended that procedures that mimic those conventionally used with animal subjects represent a "poor analytic preparation" for the explication of reinforcement principles. In defending the use of conventional operant methods for human research, we make three points: (a) Historical variables play a critical role in research on processes of reinforcement, regardless of whether the subjects are humans or animals. (b) Techniques are available for detecting, analyzing, and counteracting such historical and extra-experimental influences; these include long-term observations, steady state designs, and, when variables are not amenable to direct control (e.g., age, gender, species), selection of subjects with common characteristics. (c) Other forms of evidence that might be used to validate conditioning principles-applied behavior analysis and behavioristic interpretation-have inherent limitations and cannot substitute for experimental analysis. We conclude that human operant conditioning experiments are essential for the analysis of the reinforcement process at the human level, but caution that their value depends on the extent to which the traditional methods of the experimental analysis of behavior are properly applied.

B. F. Skinner: the writer and his definition of verbal behavior

Skinner's definition of verbal behavior, with its brief and refined versions, has recently become a point of controversy among behavior analysts. Some of the arguments presented in this controversy might be based on a misreading of Skinner's (1957a) writings. An examination of Skinner's correspondence with editors of scientific journals shows his sophisticated mastery of English and his knowledge of contemporary approaches of linguistics, and might help to settle the meaning of the passages involved in the controversy. A more precise definition of verbal behavior, deduced from Skinner's distinction between verbal and nonverbal operants, is suggested, and a possible reason why Skinner did not define verbal behavior in the terms proposed by this alternative definition is discussed. The alternative definition is more compatible with a functional approach to behavior and highlights what is specific to verbal behavior by pointing to the conventions of the verbal community. Some possible consequences of adopting this alternative definition are described.

A quarter century of the analysis of verbal behavior: an analysis of impact

The Analysis of Verbal Behavior (TAVB) has been published since 1982, and during this time, interest in verbal behavior research appears to have increased substantially within behavior analysis. The purpose of the present analysis was to assess the influence of TAVB on the field by (a) counting citations of TAVB articles in the Journal of the Experimental Analysis of Behavior (JEAB) and the Journal of Applied Behavior Analysis (JABA) from 1983 through 2007, (b) examining which other journals cite TAVB, and (c) calculating impact-factor estimates for 2003 through 2007. Citations of TAVB articles began to appear in JEAB and JABA in the late 1980s to early 1990s, and by the end of 2007, almost a third of all articles published in TAVB had been cited in either JEAB or JABA. Other journals that cite TAVB include The Behavior Analyst and The Psychological Record. The estimated impact factor ranged from 0.267 to 0.600. Strategies for increasing the impact of TAVB are discussed.

Indirekte Kommunikation durch Zitierungen und Referenzen in der Psychologie

Zusammenfassung. Inhaltsanalytische Befunde zu Häufigkeiten und Arten der indirekten Kommunikation innerhalb der Psychologie durch das Zitieren anderer Autoren in monographisch versus editorisch verfassten Lehrbüchern, Enzyklopädien und Testmanualen werden dargestellt. Wegen der wachsenden Bedeutung von Zitationshäufigkeiten für die Produktivitätsbewertung von Wissenschaftlern und Hochschulinstituten sowie für historiographische Analysen wurde empirisch ermittelt, was wie häufig und in welcher Form in der deutschsprachigen Psychologie zitiert wird. Für eine nach sechs psychologischen Teildisziplinen (Sozial-, Entwicklungs-, Persönlichkeits-, Biologische, Pädagogische und Klinische Psychologie) sowie die genannten Literaturgattungen geschichtete Zufallsstichprobe von 28 Publikationen wurden Literaturangaben nach der Publikationssprache der zitierten Quellen, der Anzahl der Fremd- versus Selbstreferenzen, der Gattung der zitierten Literatur und der Zitierungsarten im Text untersucht. Die Ergebnisse zeigen, dass (1) über 50% der Literaturangaben Zeitschriftenbeiträge, 10%-20% Monographien und 10%-20% Buchbeiträge sind, (2) Selbstreferenzen der Autoren etwa 10% der Literaturangaben ausmachen, (3) englischsprachige Literaturangaben mit über 60% dominieren, (4) in gut 70% der Zitationen deutliche Bezüge zu Theorien, Methoden oder Befunden aus den Quellen hergestellt werden, (5) etwa 25% der Zitierungen vage, global, flüchtig oder oberflächlich bleiben, (6) mit knapp 3% selten wörtlich zitiert wird und (7) kritische Auseinandersetzungen mit zitierten Arbeiten mit 2% der Zitierungen sehr selten sind. Sowohl in den Gesamtzahlen der Literaturangaben und Zitierungen im Text als auch in den Zitierungsarten zeigen sich nur geringe Unterschiede zwischen den psychologischen Teildisziplinen. Dieses Befundmuster stimmt mit dem einer früheren Inhaltsanalyse der Zitierungshäufigkeiten und -arten in deutsch- versus englischsprachigen Zeitschriftenbeiträgen überein und belegt für die indirekte wissenschaftliche Kommunikation in der Psychologie relativ stark ausgeprägte Gemeinsamkeiten und Normierungen. Die Implikationen der Befunde für die Repräsentativität und Validität von Zitations-Datenbanken für Evaluationszwecke werden diskutiert.

Empirical Applications of Skinner's Analysis of Verbal Behavior with Humans

In Verbal Behavior,Skinner (1957) provided a conceptual framework and taxonomy for the controlling variables of language that defined independent verbal operants by their functional relations to antecedents and consequences (rather than by topography or meaning). Although professional interest in this area has recently increased within the behavior analytic community, Skinner's conceptual framework may not yet have fully impacted the experimental literature. This quantitative review of the literature examined the studies on verbal behavior that were empirical in nature, concerned with human verbal behavior, and addressed at least one verbal operant (e.g., mand, tact, echoic, autoclitic, and/or intraverbal behavior) within the experiment. The results of this review suggest that a growing body of research exists to support many of the tenets of Skinner's conceptualization and taxonomy but many areas of verbal behavior research have yet to be addressed. Continued research in this area is crucial for the development and implementation of effective verbal behavior interventions for people with disabilities.

Citation Analysis of Skinner's Verbal Behavior: 1984-2004

The present study undertook an updated citation analysis of Skinner's (1957)Verbal Behavior. All articles that cited Verbal Behavior between 1984 and 2004 were recorded and content analyzed into one of five categories; four empirical and one nonempirical. Of the empirical categories, studies that employed a verbal operant from Skinner's analysis were assigned to either basic, applied, or observational categories. Empirical studies that did not employ a verbal operant were categorized as other-empirical. The total number of citations remained stable across the review period and averaged just over 52 per year. Of these, 80% were from nonempirical articles, 13.7% were from other-empirical articles, 4% were from applied articles, 1.4% were from basic articles, and 0.9% were from observational articles. An "obliteration" analysis was also conducted to identify articles that employed Skinner's verbal operant terms but did not cite Verbal Behavior. This analysis identified 44 additional articles, suggesting that a degree of obliteration had occurred in the half century since the publication of Verbal Behavior. In particular, the analysis suggests that the verbal operant of manding has sufficient presence in the applied empirical literature to render citation of Verbal Behavior redundant. Overall, Verbal Behavior continues to make an important contribution to the psychological literature.

Beyond Skinner? A review of relational frame theory: A post-skinnerian account of human language and cognition by Hayes, Barnes-Holmes, and Roche

In their book, Relational Frame Theory: A Post-Skinnerian Account of Human Language and Cognition (2001), Hayes, Barnes-Holmes and Roche challenge behavior analysts to put aside Skinner and Verbal Behavior in favor of relational frame theory's approach to human language and cognition. However, when viewed from the contexts of behavior analysis, the principles of behavior analysis, and the principles of the founder of behavior analysis, Relational Frame Theory fits squarely in the Skinnerian, behavior analytic tradition. As with Verbal Behavior, Relational Frame Theory and its theses may be thought of as logical and empirical extensions of that which precedes them.

Staffing the empirical analysis of verbal behavior

Empirical articles in The Analysis of Verbal Behavior were inspected to evaluate the contributions of new and repeat investigators. The journal has attracted a steady stream of new empirical authors from early in its history. In recent years, repeat authors have begun to have a substantial impact on the journal. These outcomes suggest a maturing research community and provide cause for optimism about the future of empirical verbal behavior research.

Differential latency and selective nondisclosure in verbal self-reports

Several previous studies have examined the correspondence between self-reports and the delayed identity match-to-sample performance they supposedly described. The present two experiments used similar procedures to explore different characteristics of the self-reports. In both studies, match-to-sample responses were successful (earned points) if they were both correct and faster than a time limit. Following each response, a computer-presented query asked whether the response had been successful, and subjects replied by pressing a "Yes" or "No" button. Experiment 1 analyzed self-report latencies from a previously-published study (Critchfield, 1993a). Latencies generally were longer for self-reports of failure than for self-reports of success. In Experiment 1, a "Yes" or "No" self-report was required to advance the session. In Experiment 2, self-reports were optional. In addition to "Yes" and "No" buttons, subjects could press a third button (a "nondisclosure" option) to remove the self-report query without providing a "Yes" or "No" answer. Across a range of conditions, nondisclosures always occurred more frequently after match-to-sample failures than after successes (i.e., under conditions in which a self-report of failure would be appropriate). The effects observed in the two experiments are consistent with a history of differential punishment for uncomplimentary self-reports, which casual observation and some descriptive studies suggest is a common experience in United States culture. The research necessary to explore this notion should produce data that are of interest to psychologists both within and outside of Behavior Analysis.

Signal-detection properties of verbal self-reports

The bias (B'H) and discriminability (A') of college students' self-reports about choices made in a delayed identity matching-to-sample task were studied as a function of characteristics of the response about which they reported. Each matching-to-sample trial consisted of two, three, or four simultaneously presented sample stimuli, a 1-s retention interval, and two, three, or four comparison stimuli. One sample stimulus was always reproduced among the comparisons, and choice of the matching comparison in less than 800 ms produced points worth chances in a drawing for money. After each choice, subjects pressed either a "yes" or a "no" button to answer a computer-generated query about whether the choice met the point contingency. The number of sample and comparison stimuli was manipulated across experimental conditions. Rates of successful matching-to-sample choices were negatively correlated with the number of matching-to-sample stimuli, regardless of whether samples or comparisons were manipulated. As in previous studies, subjects exhibited a pronounced bias for reporting successful responses. Self-report bias tended to become less pronounced as matching-to-sample success became less frequent, an outcome consistent with signal-frequency effects in psychophysical research. The bias was also resistant to change, suggesting influences other than signal frequency that remain to be identified. Self-report discriminability tended to decrease with the number of sample stimuli and increase with the number of comparison stimuli, an effect not attributable to differential effects of the two manipulations on matching-to-sample performance. Overall, bias and discriminability indices revealed effects that were not evident in self-report accuracy scores. The results indicate that analyses based on signal-detection theory can improve the description of correspondence between self-reports and their referents and thus contribute to the identification of environmental sources of control over verbal self-reports.

A standard methodology for the analysis, recording, and control of verbal behavior

Lack of a standard methodology has been one of the major obstacles preventing advancement of behavior analytic research in verbal behavior. This article presents a standard method for the analysis, recording, and control of verbal behavior that overcomes several major methodological problems that have hindered operant research in verbal behavior. The system divides all verbal behavior into four functional response classes, correct, error, no response, and inappropriate behavior, from which all vocal responses of a subject may be classified and consequated. The effects of contingencies of reinforcement on verbal operants within each category are made immediately visible to the researcher as changes in frequency of response. Incorporating frequency of response within each category as the unit of response allows both rate and probability of verbal response to be utilized as basic dependent variables. This method makes it possible to record and consequate verbal behavior in essentially the same way as any other operant response. It may also facilitate an experimental investigation of Skinner's verbal response categories.

Acquisition, maintenance, and generalization of productive intraverbal behavior through transfer of stimulus control procedures

The acquisition of productive intraverbal behavior involving the emission of thematically related responses was evaluated. Three mentally retarded children participated in this study and a multiple-probe design was used in training productive intraverbal behavior (three stimulus classes). Training was conducted using an errorless discrimination procedure (prompt delay) and a variation of this to transfer vocal responses from control of visual stimuli (tact behavior) to verbal stimuli (intraverbal behavior). Reinforcement probability was equal for correct responses prior to and following a prompt and incorrect responses were ignored. Acquisition criteria were reached when subjects emitted 80-100% correct responses and more than four different responses per session during three consecutive sessions. These criteria were achieved in all three subjects. Prompt delay procedure produced no incorrect responses, decreased acquisition criteria slightly over time, produced responses generalization during training, and increased comprehensive intraverbal behavior after training productive intraverbals. Variations in prompt delay procedure produced the same results except a low rate of errors and chaining of different responses per trial appeared when an additional prompt was implemented.