Post-vision and change: do we know how to change?

Charting a new vision: lessons on Vision & Change from a network of biology educators

The 2011 Vision & Change report outlined several recommendations for transforming undergraduate biology education, sparking multiple pedagogical reform efforts. Among these was the Promoting Active Learning and Mentoring (PALM) network, an NSF-funded program that provided mentorship and training to instructors on implementing active learning in the classroom. Here, we provide a perspective on how members of the biology education community in PALM view the recommendations of Vision & Change, drawing upon our experiences both as members of PALM and as leaders of an associated project funded by another NSF grant that hosted PALM alumni at various conferences. These efforts have allowed us to gain insight into how our alumni think of Vision & Change, including how they interpret its recommendations, the challenges and opportunities that they view for implementing these recommendations, and the areas they see as critical to be addressed in future national reports for supporting undergraduate biology education. We synthesize these voices here, providing perspectives from a diverse group of biology instructors on what they think about Vision & Change, and provide recommendations for the biology education community based upon these PALM community voices.

Developing a faculty support program for fostering enriching undergraduate laboratory experiences under limited resource conditions

Meaningful pedagogical reform requires good faculty training and support programs. Such support is particularly valuable when colleges and universities are trying to bring research and inquiry into the laboratory curricula under resource-limited conditions. In this situation, it may help to extend the scope of the faculty support program to include training for practicing experimental techniques, sustainable networking opportunities, and a space to learn about pedagogical reforms. From this perspective, we share our experience about building a faculty development program for public college teachers who teach undergraduate biology in India. Though we designed the program for low-resource settings, the experiments curated could very well represent core biological concepts typically identified by the international community. The activities and overall design of the program can be useful for initiating pedagogical reform in any college/university where the traditional approach to biology laboratory instruction predominates, and high-end research is not easy to access.

Faculty Experiences during the Implementation of an Introductory Biology Course-Based Undergraduate Research Experience (CURE)

Course-based undergraduate research experiences (CUREs) integrate an authentic research experience for students into a laboratory course. CUREs provide many of the same benefits to students as individual faculty-mentored research experiences. However, faculty experiences in teaching CUREs are not as well understood. There are no studies that compare faculty's anticipated experiences to actual experiences, and little comparison of the faculty experience by institution. Through interviews with eight biology faculty from four institutions, the faculty experience in implementing a CURE in an introductory biology laboratory was explored using qualitative analysis. Institutions included: a small, minority-serving, women's, primarily undergraduate university; a small, residential, primarily undergraduate college; a midsized doctoral university; and a large community college. Interviews were conducted at three time points: before professional development (PD), after the initial semester of teaching the CURE, and after teaching the CURE at least twice (1 year later). Faculty described resources, benefits, challenges, and feelings about teaching the CURE. However, anticipated experiences were often not the same as those actually experienced. There were also institutional differences in resources, benefits, challenges, and feelings. Implications for CURE PD include specific content such as strategies for teaching effective research group work, development of student proposals, and student time management.

Student Thinking in the Professional Development of College Biology Instructors: An Analysis through the Lens of Sociocultural Theory

An important facet of inclusive, student-centered science teaching is for college instructors to reveal and respond to student thinking. Professional development (PD) provides formal settings for instructors to develop skills attending and responding to student ideas in their teaching. Using the lens of sociocultural theory, the purpose of this study was to explore the learning experiences of college instructors in long-term faculty learning communities (FLCs) that focused on student thinking. This study employed a qualitative design using semistructured interviews, analyzed through qualitative thematic analysis. We investigated the ways that social interactions focused on artifacts of student learning facilitated college instructors' internalization of knowledge about teaching and learning. We found that participants valued the social space of the FLC for the camaraderie and diverse perspectives it facilitated and that participants internalized the discussions from their FLCs in the form of new insights into student thinking and plans for improving teaching. Our data support the idea that PD for college science teaching that includes social space focused on artifacts of student learning will lead to instructor learning. Further, our data point to the fruitfulness of new research to expand our knowledge of the implications of sociocultural theory for college science PD.

OUP accepted manuscript

What motivates faculty teaching gateway courses to consider adopting an evidence-based classroom intervention? In this nationally representative study of biology faculty members in the United States (N = 422), we used expectancy–value–cost theory to understand three convergent motivational processes the faculty members’ underlying intentions to adopt an exemplar evidence-based classroom intervention: the utility value intervention (UVI). Although the faculty members perceived the intervention as valuable, self-reported intentions to implement it were degraded by concerns about costs and lower expectancies for successful implementation. Structural equation modeling revealed that the faculty members reporting lower intentions to adopt it tended to be White and to identify as male and had many years of teaching or were from a more research-focused university. These personal, departmental, and institutional factors mapped onto value, expectancies, and cost perceptions uniquely, showing that each process was a necessary but insufficient way to inspire intentions to adopt the UVI. Our findings suggest multifaceted, context-responsive appeals to support faculty member motivation to scale up adoption of evidence-based classroom interventions.

Facilitating Long-Term Mentoring To Effectively Implement Active Learning Instruction: Formation of the Promoting Active Learning and Mentoring (PALM) Network

A large body of data suggests that implementing active learning practices in a STEM classroom contributes to increased success in both achievement of student learning outcomes and retention of students. Despite these findings, significant barriers exist for instructors implementing active learning strategies in their undergraduate classrooms. These barriers can be effectively addressed by providing sustained support to instructors and postdoctoral trainees interested in implementing active learning strategies in their teaching practice. The Promoting Active Learning and Mentoring (PALM) network attains this objective by connecting instructors interested in learning more about active learning (Fellows) with individuals who have extensive expertise related to this practice (mentors). These facilitated connections occur in the form of active mentorship for a year or more, virtual journal clubs, and biannual gatherings of PALM Fellows and mentors. Here, we describe the foundation on which PALM was built and explain how a successful mentorship program can pave the way for educators to adapt and implement evidence-based practices like active learning in a college classroom.

A Model for an Intensive Hands-On Faculty Development Workshop To Foster Change in Laboratory Teaching

Faculty development workshops are frequently used to bring about change in faculty teaching. Yet, the characteristics of successful faculty professional development in the context of laboratory teaching are unclear. In this Perspective, we describe our approach to intensive hands-on faculty development workshops for fostering change in laboratory teaching and present evidence for the effectiveness of the approach. The outcomes from our workshops and feedback from past participants support the following recommendations: 1) faculty should attend workshops in teams from their institutions, 2) workshops should allow participants to develop curricula that can be implemented with relatively little additional work after the workshop, 3) workshops should allow faculty time to "work" on tangible products and should involve hands-on activities, 4) workshops should be of sufficient duration to allow for faculty to develop expertise and tangible products but short enough that faculty do not "burn out," and 5) a structure for ongoing and systematic follow-up with participants is essential.

Student Learning in an Accelerated Introductory Biology Course Is Significantly Enhanced by a Flipped-Learning Environment

A flipped-classroom environment generally strives to create more in-class time for activities that enhance student learning, while shifting some content delivery to outside the classroom through the use of short didactic videos. We compared a flipped-classroom setting with the traditional ("control") setting for an accelerated lower-division general biology course. Student self-reporting and video analytics functions showed ample and variable video viewing among individual students. Student learning was evaluated through quizzes administered after a set of concepts were covered (post 1) and at the end of the course (post 2). Students in the flipped sections had significantly higher quiz scores than students in the control sections for both post 1 and post 2. Analyses of variance analyzing the effect of and interactions between type of instruction, in-class activities, time, and Bloom's level of the quiz questions found significant differences in the overall model and all the factors, except for the presence and level of activities. Significant differences between students in the flipped and control sections were observed for low-level Bloom's questions only. Thus, the positive effect of the flipped-classroom approach on student learning may be due to improvements in recall of basic concepts and a better understanding of biology vocabulary in their first biology course.

Building a Sustainable National Infrastructure to Expand Research Mentor Training

An evidence-based research mentor training (RMT) curricular series has been shown to improve the knowledge and skills of research mentors across disciplines and career stages. A train-the-trainer model was used in the context of several targeted approaches aimed at sustainability to support national dissemination of RMT and expand the network of facilitators prepared to implement the curricula. These infrastructure elements included 1) an expansion initiative to increase the number of trained facilitators able to deliver train-the-trainer workshops nationwide; 2) adaptation of RMT curricula for multiple audiences and career stages to increase accessibility; 3) implementation resources to support facilitators and help them overcome implementation barriers; and 4) standardized evaluation of training. This approach to dissemination and implementation has resulted in the preparation of nearly 600 trained facilitators, a large percentage of whom have implemented mentor training for more than 4000 graduate student, junior faculty, and senior faculty mentors. Implications for and challenges to building and sustaining the national dissemination of RMT are discussed.

Course-based undergraduate research experiences in molecular biosciences-patterns, trends, and faculty support

Inquiry-driven learning, research internships and course-based undergraduate research experiences all represent mechanisms through which educators can engage undergraduate students in scientific research. In life sciences education, the benefits of undergraduate research have been thoroughly evaluated, but limitations in infrastructure and training can prevent widespread uptake of these practices. It is not clear how faculty members can integrate complex laboratory techniques and equipment into their unique context, while finding the time and resources to implement undergraduate research according to best practice guidelines. This review will go through the trends and patterns in inquiry-based undergraduate life science projects with particular emphasis on molecular biosciences-the research-aligned disciplines of biochemistry, molecular cell biology, microbiology, and genomics and bioinformatics. This will provide instructors with an overview of the model organisms, laboratory techniques and research questions that are adaptable for semester-long projects, and serve as starting guidelines for course-based undergraduate research.

CREATE Two-Year/Four-Year Faculty Workshops: A Focus on Practice, Reflection, and Novel Curricular Design Leads to Diverse Gains for Faculty at Two-Year and Four-Year Institutions

Improving STEM education through the propagation of highly effective teaching strategies is a major goal of national reform movements. CREATE (Consider, Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) is a transformative teaching and learning strategy grounded in evidence-based science pedagogy. CREATE courses promote both cognitive (e.g., critical thinking) and affective (e.g., attitudinal and epistemological) student gains in diverse settings. In this study, we look more deeply into the faculty development workshop used to disseminate CREATE pedagogy to instructors at two-year and four-year institutions. We hypothesized that an immersive experience would positively shift faculty participants' views on teaching/learning, build their understanding of CREATE pedagogy and develop their confidence for course implementation. Internal and external assessments indicate that faculty participants did achieve gains within the timeframe of the CREATE workshop. We discuss the workshop training outcomes in the context of designing effective dissemination models for innovative practices.

Improving undergraduate STEM education: The efficacy of discipline-based professional development

We sought to determine whether instructional practices used by undergraduate faculty in the geosciences have shifted from traditional teacher-centered lecture toward student-engaged teaching practices and to evaluate whether the national professional development program On the Cutting Edge (hereinafter Cutting Edge) has been a contributing factor in this change. We surveyed geoscience faculty across the United States in 2004, 2009, and 2012 and asked about teaching practices as well as levels of engagement in education research, scientific research, and professional development related to teaching. We tested these self-reported survey results with direct observations of teaching using the Reformed Teaching Observation Protocol, and we conducted interviews to understand what aspects of Cutting Edge have supported change. Survey data show that teaching strategies involving active learning have become more common, that these practices are concentrated in faculty who invest in learning about teaching, and that faculty investment in learning about teaching has increased. Regression analysis shows that, after controlling for other key influences, faculty who have participated in Cutting Edge programs and who regularly use resources on the Cutting Edge website are statistically more likely to use active learning teaching strategies. Cutting Edge participants also report that learning about teaching, the availability of teaching resources, and interactions with peers have supported changes in their teaching practice. Our data suggest that even one-time participation in a workshop with peers can lead to improved teaching by supporting a combination of affective and cognitive learning outcomes.

STEM Faculty as Learners in Pedagogical Reform and the Role of Research Articles as Professional Development Opportunities

Discipline-based education research (DBER) publications are opportunities for professional development around science, technology, engineering, and mathematics (STEM) education reform. Learning theory tells us these publications could be more impactful if authors, reviewers, and editors pay greater attention to linking principles and practice. This approach, which considers faculty as learners and STEM education reform as content, has the potential to better support faculty members because it promotes a deeper understanding of the reasons why a pedagogical change is effective. This depth of understanding is necessary for faculty members to successfully transfer new knowledge to their own contexts. A challenge ahead for the emergent learning sciences is to better integrate findings from across sister disciplines; DBER reports can take a step in that direction while improving their usefulness for instructors.

The PULSE Vision & Change Rubrics, Version 1.0: A Valid and Equitable Tool to Measure Transformation of Life Sciences Departments at All Institution Types

The PULSE Vision & Change Rubrics, version 1.0, assess life sciences departments' progress toward implementation of the principles of the Vision and Change report. This paper reports on the development of the rubrics, their validation, and their reliability in measuring departmental change aligned with the Vision and Change recommendations. The rubrics assess 66 different criteria across five areas: Curriculum Alignment, Assessment, Faculty Practice/Faculty Support, Infrastructure, and Climate for Change. The results from this work demonstrate the rubrics can be used to evaluate departmental transformation equitably across institution types and represent baseline data about the adoption of the Vision and Change recommendations by life sciences programs across the United States. While all institution types have made progress, liberal arts institutions are farther along in implementing these recommendations. Generally, institutions earned the highest scores on the Curriculum Alignment rubric and the lowest scores on the Assessment rubric. The results of this study clearly indicate that the Vision & Change Rubrics, version 1.0, are valid and equitable and can track long-term progress of the transformation of life sciences departments. In addition, four of the five rubrics have broad applicability and can be used to evaluate departmental transformation by other science, technology, engineering, and mathematics disciplines.

Development of a Lac Operon Concept Inventory (LOCI)

Concept inventories (CIs) are valuable tools for educators that assess student achievement and identify misconceptions held by students. Results of student responses can be used to adjust or develop new instructional methods for a given topic. The regulation of gene expression in both prokaryotes and eukaryotes is an important concept in genetics and one that is particularly challenging for undergraduate students. As part of a larger study examining instructional methods related to gene regulation, the authors developed a 12-item CI assessing student knowledge of the lac operon. Using an established protocol, the authors wrote open-ended questions and conducted in-class testing with undergraduate microbiology and genetics students to discover common errors made by students about the lac operon and to determine aspects of item validity. Using these results, we constructed a 12-item multiple-choice lac operon CI called the Lac Operon Concept Inventory (LOCI), The LOCI was reviewed by two experts in the field for content validity. The LOCI underwent item analysis and was assessed for reliability with a sample of undergraduate genetics students (n = 115). The data obtained were found to be valid and reliable (coefficient alpha = 0.994) with adequate discriminatory power and item difficulty.

Testing CREATE at Community Colleges: An Examination of Faculty Perspectives and Diverse Student Gains

CREATE (Consider, Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) is an innovative pedagogy for teaching science through the intensive analysis of scientific literature. Initiated at the City College of New York, a minority-serving institution, and regionally expanded in the New York/New Jersey/Pennsylvania area, this methodology has had multiple positive impacts on faculty and students in science, technology, engineering, and mathematics courses. To determine whether the CREATE strategy is effective at the community college (2-yr) level, we prepared 2-yr faculty to use CREATE methodologies and investigated CREATE implementation at community colleges in seven regions of the United States. We used outside evaluation combined with pre/postcourse assessments of students to test related hypotheses: 1) workshop-trained 2-yr faculty teach effectively with the CREATE strategy in their first attempt, and 2) 2-yr students in CREATE courses make cognitive and affective gains during their CREATE quarter or semester. Community college students demonstrated positive shifts in experimental design and critical-thinking ability concurrent with gains in attitudes/self-rated learning and maturation of epistemological beliefs about science.

Building national capacity for research mentor training: an evidence-based approach to training the trainers

Research mentor training (RMT), based on the published Entering Mentoring curricula series, has been shown to improve the knowledge and skills of research mentors across career stages, as self-reported by both the mentors engaged in training and their mentees. To promote widespread dissemination and empower others to implement this evidence-based training at their home institutions, we developed an extensive, interactive, multifaceted train-the-trainer workshop. The specific goals of these workshops are to 1) increase facilitator knowledge of an RMT curriculum, 2) increase facilitator confidence in implementing the curriculum, 3) provide a safe environment to practice facilitation of curricular activities, and 4) review implementation strategies and evaluation tools. Data indicate that our approach results in high satisfaction and significant confidence gains among attendees. Of the 195 diverse attendees trained in our workshops since Fall 2010, 44% report implementation at 39 different institutions, collectively training more than 500 mentors. Further, mentors who participated in the RMT sessions led by our trained facilitators report high facilitator effectiveness in guiding discussion. Implications and challenges to building the national capacity needed for improved research mentoring relationships are discussed.

The CREATE Strategy for Intensive Analysis of Primary Literature Can Be Used Effectively by Newly Trained Faculty to Produce Multiple Gains in Diverse Students

The CREATE (Consider Read, Elucidate the hypotheses, Analyze and interpret the data, and Think of the next Experiment) strategy aims to demystify scientific research and scientists while building critical thinking, reading/analytical skills, and improved science attitudes through intensive analysis of primary literature. CREATE was developed and piloted at the City College of New York (CCNY), a 4-yr, minority-serving institution, with both upper-level biology majors and first-year students interested in science, technology, engineering, and mathematics. To test the extent to which CREATE strategies are broadly applicable to students at private, public, research-intensive, and/or primarily undergraduate colleges/universities, we trained a cohort of faculty from the New York/New Jersey/Pennsylvania area in CREATE pedagogies, then followed a subset, the CREATE implementers (CIs), as they taught all or part of an existing course on their home campuses using CREATE approaches. Evaluation of the workshops, the CIs, and their students was carried out both by the principal investigators and by an outside evaluator working independently. Our data indicate that: intensive workshops change aspects of faculty attitudes about teaching/learning; workshop-trained faculty can effectively design and teach CREATE courses; and students taught by such faculty on multiple campuses make significant cognitive and affective gains that parallel the changes documented previously at CCNY.

Identifying key features of effective active learning: the effects of writing and peer discussion

We investigated some of the key features of effective active learning by comparing the outcomes of three different methods of implementing active-learning exercises in a majors introductory biology course. Students completed activities in one of three treatments: discussion, writing, and discussion + writing. Treatments were rotated weekly between three sections taught by three different instructors in a full factorial design. The data set was analyzed by generalized linear mixed-effect models with three independent variables: student aptitude, treatment, and instructor, and three dependent (assessment) variables: change in score on pre- and postactivity clicker questions, and coding scores on in-class writing and exam essays. All independent variables had significant effects on student performance for at least one of the dependent variables. Students with higher aptitude scored higher on all assessments. Student scores were higher on exam essay questions when the activity was implemented with a writing component compared with peer discussion only. There was a significant effect of instructor, with instructors showing different degrees of effectiveness with active-learning techniques. We suggest that individual writing should be implemented as part of active learning whenever possible and that instructors may need training and practice to become effective with active learning.