Bioinformatics core competencies for undergraduate life sciences education

A bioinformatics-driven CURE extension increases student self-efficacy and interest in biomedical research

The biology workforce has a need for undergraduate students trained in bioinformatics. Although bioinformatics is a critical sub-discipline of biology, it is not required in all biology degree programs. In parallel, there is a need to increase student access to research experiences. To address these needs, we offer a one-credit bioinformatics-focused and computational biology course-based undergraduate research experience (CURE), here called the CB-CURE. Preliminary data suggest the CB-CURE increased student interest, knowledge, and self-efficacy, but also reveal a shortage of access to undergraduate research experiences (UREs) in faculty labs at our large institution. To provide a more URE-like experience for a class setting, we developed a one-semester extension to the CB-CURE, called CURE+. In CURE+, students execute individual bioinformatics-driven research projects and obtain additional career development and mentoring. To evaluate CURE+, we measured students' bioinformatics and research self-efficacy, interest in bioinformatics and research, and emotions toward their project. Additionally, we evaluated student mastery of the CURE+ learning outcomes to determine if the experience successfully enabled students to develop their research skills. Our data show significant increases in (i) student self-efficacy in various bioinformatics and research skills and (ii) student interest in bioinformatics-related activities and in biomedical research. Students had positive emotions toward their research project, and a majority of students mastered the CURE+ learning outcomes. Our data suggest that an intensive CURE extension can provide a potentially transformative research experience that helps fill a void in access to research at institutions with a high student-to-faculty ratio.

Monitoring environmental microbiomes: Alignment of microbiology and computational biology competencies within a culturally integrated curriculum and research framework

We have developed a flexible undergraduate curriculum that leverages the place-based research of environmental microbiomes to increase the number of Indigenous researchers in microbiology, data science and scientific computing. Monitoring Environmental Microbiomes (MEM) provides a curriculum and research framework designed to integrate an Indigenous approach when conducting authentic scientific research and to build interest and confidence at the undergraduate level. MEM has been successfully implemented as a short summer workshop to introduce computing practices in microbiome analysis. Based on self-assessed student knowledge of topics and skills, increased scientific confidence and interest in genomics careers were observed. We propose MEM be incorporated in a scalable course-based research experience for undergraduate institutions, including tribal colleges and universities, community colleges and other minority serving institutions. This coupled curricular and research framework explicitly considers cultural perspectives, access and equity to train a diverse future workforce that is more informed to engage in microbiome research and to translate microbiome science to benefit community and environmental health.

A genomics learning framework for undergraduates

Genomics is an increasingly important part of biology research. However, educating undergraduates in genomics is not yet a standard part of life sciences curricula. We believe this is, in part, due to a lack of standard concepts for the teaching of genomics. To address this deficit, the members of the Genomics Education Alliance created a set of genomics concepts that was then further refined by input from a community of undergraduate educators who engage in genomics instruction. The final genomics concepts list was compared to existing learning frameworks, including the Vision and Change initiative (V&C), as well as ones for genetics, biochemistry and molecular biology, and bioinformatics. Our results demonstrate that the new genomics framework fills a niche not addressed by previous inventories. This new framework should be useful to educators seeking to design stand-alone courses in genomics as well as those seeking to incorporate genomics into existing coursework. Future work will involve designing curriculum and assessments to go along with this genomics learning framework.

Galaxy as a gateway to bioinformatics: Multi-Interface Galaxy Hands-on Training Suite (MIGHTS) for scRNA-seq

BACKGROUND

Bioinformatics is fundamental to biomedical sciences, but its mastery presents a steep learning curve for bench biologists and clinicians. Learning to code while analyzing data is difficult. The curve may be flattened by separating these two aspects and providing intermediate steps for budding bioinformaticians. Single-cell analysis is in great demand from biologists and biomedical scientists, as evidenced by the proliferation of training events, materials, and collaborative global efforts like the Human Cell Atlas. However, iterative analyses lacking reinstantiation, coupled with unstandardized pipelines, have made effective single-cell training a moving target.

FINDINGS

To address these challenges, we present a Multi-Interface Galaxy Hands-on Training Suite (MIGHTS) for single-cell RNA sequencing (scRNA-seq) analysis, which offers parallel analytical methods using a graphical interface (buttons) or code. With clear, interoperable materials, MIGHTS facilitates smooth transitions between environments. Bridging the biologist-programmer gap, MIGHTS emphasizes interdisciplinary communication for effective learning at all levels. Real-world data analysis in MIGHTS promotes critical thinking and best practices, while FAIR data principles ensure validation of results. MIGHTS is freely available, hosted on the Galaxy Training Network, and leverages Galaxy interfaces for analyses in both settings. Given the ongoing popularity of Python-based (Scanpy) and R-based (Seurat & Monocle) scRNA-seq analyses, MIGHTS enables analyses using both.

CONCLUSIONS

MIGHTS consists of 11 tutorials, including recordings, slide decks, and interactive visualizations, and a demonstrated track record of sustainability via regular updates and community collaborations. Parallel pathways in MIGHTS enable concurrent training of scientists at any programming level, addressing the heterogeneous needs of novice bioinformaticians.

The ImmunoSkills Guide: Competencies for undergraduate immunology curricula

Immune literacy garnered significant attention in recent years due to the threat posed by emerging infectious diseases. The pace of immunological discoveries and their relevance to society are substantial yet coordinated educational efforts have been rare. This motivated us to create a task force of educators to reflect on pedagogical approaches to teaching immunology and to draft, develop, and evaluate key competencies for undergraduate immunology education. The research questions addressed include: 1) Which competencies are considered important by educators? 2) Are the illustrative skills clear, accurate and well aligned with the core competencies listed in the Vision and Change report?; 3) What are the concerns of immunology educators about competencies and skills? We collected data on the draft competencies using surveys, focus groups, and interviews. The iterative revision phase followed the community review phase before finalizing the framework. Here, we report a hierarchical learning framework, with six core competencies, twenty illustrative skills, and companion immunology-specific example learning outcomes. Predominant themes from interviews and focus groups, which informed revisions of this framework are shared. With the growing need for immunology education across the sciences, the ImmunoSkills Guide and accompanying discussion can be used as a resource for educators, administrators and policymakers.

Design and implementation of an asynchronous online course-based undergraduate research experience (CURE) in computational genomics

As genomics technologies advance, there is a growing demand for computational biologists trained for genomics analysis but instructors face significant hurdles in providing formal training in computer programming, statistics, and genomics to biology students. Fully online learners represent a significant and growing community that can contribute to meet this need, but they are frequently excluded from valuable research opportunities which mostly do not offer the flexibility they need. To address these opportunity gaps, we developed an asynchronous course-based undergraduate research experience (CURE) for computational genomics specifically for fully online biology students. We generated custom learning materials and leveraged remotely accessible computational tools to address 2 novel research questions over 2 iterations of the genomics CURE, one testing bioinformatics approaches and one mining cancer genomics data. Here, we present how the instructional team distributed analysis needed to address these questions between students over a 7.5-week CURE and provided concurrent training in biology and statistics, computer programming, and professional development. Scores from identical learning assessments administered before and after completion of each CURE showed significant learning gains across biology and coding course objectives. Open-response progress reports were submitted weekly and identified self-reported adaptive coping strategies for challenges encountered throughout the course. Progress reports identified problems that could be resolved through collaboration with instructors and peers via messaging platforms and virtual meetings. We implemented asynchronous communication using the Slack messaging platform and an asynchronous journal club where students discussed relevant publications using the Perusall social annotation platform. The online genomics CURE resulted in unanticipated positive outcomes, including students voluntarily discussing plans to continue research after the course. These outcomes underscore the effectiveness of this genomics CURE for scientific training, recruitment and student-mentor relationships, and student successes. Asynchronous genomics CUREs can contribute to a more skilled, diverse, and inclusive workforce for the advancement of biomedical science.

Cracking AlphaFold2: Leveraging the power of artificial intelligence in undergraduate biochemistry curriculums

AlphaFold2 is an Artificial Intelligence-based program developed to predict the 3D structure of proteins given only their amino acid sequence at atomic resolution. Due to the accuracy and efficiency at which AlphaFold2 can generate 3D structure predictions and its widespread adoption into various aspects of biochemical research, the technique of protein structure prediction should be considered for incorporation into the undergraduate biochemistry curriculum. A module for introducing AlphaFold2 into a senior-level biochemistry laboratory classroom was developed. The module's focus was to have students predict the structures of proteins from the MPOX 22 global outbreak virus isolate genome, which had no structures elucidated at that time. The goal of this study was to both determine the impact the module had on students and to develop a framework for introducing AlphaFold2 into the undergraduate curriculum so that instructors for biochemistry courses, regardless of their background in bioinformatics, could adapt the module into their classrooms.

Pairing a bioinformatics-focused course-based undergraduate research experience with specifications grading in an introductory biology classroom

Introducing bioinformatics-focused concepts and skills in a biology classroom is difficult, especially in introductory biology classrooms. Course-based Undergraduate Research Experiences (CUREs) facilitate this process, introducing genomics and bioinformatics through authentic research experiences, but the many learning objectives needed in scientific research and communication, foundational biology concepts, and bioinformatics-focused concepts and skills can make the process challenging. Here, the pairing of specifications grading with a bioinformatics-focused CURE developed by the Genomics Education Partnership is described. The study examines how the course structure with specifications grading facilitated scaffolding of writing assignments, group work, and metacognitive activities; and describes the synergies between CUREs and specifications grading. CUREs require mastery of related concepts and skills for working through the research process, utilize common research practices of revision and iteration, and encourage a growth mindset to learning-all of which are heavily incentivized in assessment practices focused on specifications grading.

No-boundary thinking for artificial intelligence in bioinformatics and education

No-boundary thinking enables the scientific community to reflect in a thoughtful manner and discover new opportunities, create innovative solutions, and break through barriers that might have otherwise constrained their progress. This concept encourages thinking without being confined by traditional rules, limitations, or established norms, and a mindset that is not limited by previous work, leading to fresh perspectives and innovative outcomes. So, where do we see the field of artificial intelligence (AI) in bioinformatics going in the next 30 years? That was the theme of a "No-Boundary Thinking" Session as part of the Mid-South Computational Bioinformatics Society's (MCBIOS) 19th annual meeting in Irving, Texas. This session addressed various areas of AI in an open discussion and raised some perspectives on how popular tools like ChatGPT can be integrated into bioinformatics, communicating with scientists in different fields to properly utilize the potential of these algorithms, and how to continue educational outreach to further interest of data science and informatics to the next-generation of scientists.

Computational reproducibility of Jupyter notebooks from biomedical publications

BACKGROUND

Jupyter notebooks facilitate the bundling of executable code with its documentation and output in one interactive environment, and they represent a popular mechanism to document and share computational workflows, including for research publications. The reproducibility of computational aspects of research is a key component of scientific reproducibility but has not yet been assessed at scale for Jupyter notebooks associated with biomedical publications.

APPROACH

We address computational reproducibility at 2 levels: (i) using fully automated workflows, we analyzed the computational reproducibility of Jupyter notebooks associated with publications indexed in the biomedical literature repository PubMed Central. We identified such notebooks by mining the article's full text, trying to locate them on GitHub, and attempting to rerun them in an environment as close to the original as possible. We documented reproduction success and exceptions and explored relationships between notebook reproducibility and variables related to the notebooks or publications. (ii) This study represents a reproducibility attempt in and of itself, using essentially the same methodology twice on PubMed Central over the course of 2 years, during which the corpus of Jupyter notebooks from articles indexed in PubMed Central has grown in a highly dynamic fashion.

RESULTS

Out of 27,271 Jupyter notebooks from 2,660 GitHub repositories associated with 3,467 publications, 22,578 notebooks were written in Python, including 15,817 that had their dependencies declared in standard requirement files and that we attempted to rerun automatically. For 10,388 of these, all declared dependencies could be installed successfully, and we reran them to assess reproducibility. Of these, 1,203 notebooks ran through without any errors, including 879 that produced results identical to those reported in the original notebook and 324 for which our results differed from the originally reported ones. Running the other notebooks resulted in exceptions.

CONCLUSIONS

We zoom in on common problems and practices, highlight trends, and discuss potential improvements to Jupyter-related workflows associated with biomedical publications.

Evaluating a large language model's ability to solve programming exercises from an introductory bioinformatics course

Computer programming is a fundamental tool for life scientists, allowing them to carry out essential research tasks. However, despite various educational efforts, learning to write code can be a challenging endeavor for students and researchers in life-sciences disciplines. Recent advances in artificial intelligence have made it possible to translate human-language prompts to functional code, raising questions about whether these technologies can aid (or replace) life scientists' efforts to write code. Using 184 programming exercises from an introductory-bioinformatics course, we evaluated the extent to which one such tool-OpenAI's ChatGPT-could successfully complete programming tasks. ChatGPT solved 139 (75.5%) of the exercises on its first attempt. For the remaining exercises, we provided natural-language feedback to the model, prompting it to try different approaches. Within 7 or fewer attempts, ChatGPT solved 179 (97.3%) of the exercises. These findings have implications for life-sciences education and research. Instructors may need to adapt their pedagogical approaches and assessment techniques to account for these new capabilities that are available to the general public. For some programming tasks, researchers may be able to work in collaboration with machine-learning models to produce functional code.

A Bioinformatic Approach to Enhance Undergraduate Student Understanding of the Cancer-Immunity Cycle

Recent advances in tumor immunology and cancer immunotherapy have generated significant interest in the field of immuno-oncology. With the promise of these advances comes an increasing need to train the next generation of scientists who will support ongoing basic and clinical research efforts in this field. At this time, however, there remains a documented underrepresentation of tumor immunology as a core content area in many undergraduate science curricula. This study introduces a novel pedagogical strategy that aimed to promote undergraduate student interest in tumor immunology in ways that support recent education guidelines published by the American Association of Immunologists, and it highlights the efficacy of this approach in enhancing student understanding of concepts relevant to the Cancer-Immunity Cycle. Using RNA-sequencing data obtained from clinical specimens catalogued in The Cancer Genome Atlas, students performed Kaplan-Meier survival analyses to identify Cancer-Immunity Cycle genes with prognostic significance. After correlating expression of such genes with tumor-infiltrating immune cell populations using a bioinformatic tool to deconvolute whole tumor-transcriptome data, students undertook an exercise that requires integration of course content and findings from the primary literature to generate hypotheses about the influence of genetic factors and immune cell types on the Cancer-Immunity Cycle and overall patient outcome. A pre-/post-project assessment instrument demonstrated the efficacy of this approach as a means of improving undergraduate student understanding of core cancer immunology concepts. This report describes these data and discusses potential ways in which the project can be adapted to extend its utility to broad and diverse student populations.

Building awareness and capacity of bioinformatics and open science skills in Kenya: a sensitize, train, hack, and collaborate model

We have applied the sensitize-train-hack-community model to build awareness of and capacity in bioinformatics in Kenya. Open science is the practice of science openly and collaboratively, with tools, techniques, and data freely shared to facilitate reuse and collaboration. Open science is not a mandatory curriculum course in schools, whereas bioinformatics is relatively new in some African regions. Open science tools can significantly enhance bioinformatics, leading to increased reproducibility. However, open science and bioinformatics skills, especially blended, are still lacking among students and researchers in resource-constrained regions. We note the need to be aware of the power of open science among the bioinformatics community and a clear strategy to learn bioinformatics and open science skills for use in research. Using the OpenScienceKE framework-Sensitize, Train, Hack, Collaborate/Community-the BOSS (Bioinformatics and Open Science Skills) virtual events built awareness and empowered researchers with the skills and tools in open science and bioinformatics. Sensitization was achieved through a symposium, training through a workshop and train-the-trainer program, hack through mini-projects, community through conferences, and continuous meet-ups. In this paper, we discuss how we applied the framework during the BOSS events and highlight lessons learnt in planning and executing the events and their impact on the outcome of each phase. We evaluate the impact of the events through anonymous surveys. We show that sensitizing and empowering researchers with the skills works best when the participants apply the skills to real-world problems: project-based learning. Furthermore, we have demonstrated how to implement virtual events in resource-constrained settings by providing Internet and equipment support to participants, thus improving accessibility and diversity.

Open-loop lab-on-a-chip technology enables remote computer science training in Latinx life sciences students

Despite many interventions, science education remains highly inequitable throughout the world. Among all life sciences fields, Bioinformatics and Computational Biology suffer from the strongest underrepresentation of racial and gender minorities. Internet-enabled project-based learning (PBL) has the potential to reach underserved communities and increase the diversity of the scientific workforce. Here, we demonstrate the use of lab-on-a-chip (LoC) technologies to train Latinx life science undergraduate students in concepts of computer programming by taking advantage of open-loop cloud-integrated LoCs. We developed a context-aware curriculum to train students at over 8,000 km from the experimental site. We showed that this approach was sufficient to develop programming skills and increase the interest of students in continuing careers in Bioinformatics. Altogether, we conclude that LoC-based Internet-enabled PBL can become a powerful tool to train Latinx students and increase the diversity in STEM.

A mentorship and incubation program using project-based learning to build a professional bioinformatics pipeline in Kenya

The demand for well-trained bioinformaticians to support genomics research continues to rise. Unfortunately, undergraduate training in Kenya does not prepare students for specialization in bioinformatics. Graduates are often unaware of the career opportunities in bioinformatics, and those who are may lack mentors to help them choose a specialization. The Bioinformatics Mentorship and Incubation Program seeks to bridge the gap by laying the foundation for a bioinformatics training pipeline using project-based learning. The program selects six participants through an intensive open recruitment exercise for highly competitive students to join the program for four months. The six interns undergo intensive training within the first one and a half months before being assigned to mini-projects. We track the progress of the interns weekly through code review sessions and a final presentation at the end of the four months. We have trained five cohorts, most of whom have secured master's scholarships within and outside the country and job opportunities. We demonstrate the benefit of structured mentorship using project-based learning in filling the training gap after undergraduate programs to generate well-trained bioinformaticians who are competitive in graduate programs and bioinformatics jobs.

A course-based undergraduate research experience for bioinformatics education in undergraduate students

With rapid development of sequencing technology and the continuous accumulation of biological big data, people who are capable of using bioinformatic skills to analyze omics data and work out biological problems are urgently needed in the workforce, which highlights the importance of developing bioinformatics skills early in the undergraduate curriculum. Meanwhile, course-based undergraduate research experience (CURE) courses have been proved to be an effective teaching format that have many advantages over traditional labs and lectures. Here we introduced an implementation of CURE course of bioinformatics data analysis and visualization for undergraduate students in major of bioinformatics and evaluated the learning outcomes. We were able to address 10 out of 15 core competencies identified by Network for Integrating Bioinformatics into Life Sciences Education. Besides, results evaluated by Laboratory Course Assessment Survey demonstrated the goals of collaboration, discovery and relevance, and iteration were accomplished in our course. Meanwhile, a significant increase in scores of final examinations and a long-term improvement on students' research ability on bioinformatics data analysis and visualization were also observed. In summary, this CURE course is useful for undergraduate students learning related knowledge and participate in authentic research in the field of bioinformatics.

Diversifying the genomic data science research community

Over the past 20 years, the explosion of genomic data collection and the cloud computing revolution have made computational and data science research accessible to anyone with a web browser and an internet connection. However, students at institutions with limited resources have received relatively little exposure to curricula or professional development opportunities that lead to careers in genomic data science. To broaden participation in genomics research, the scientific community needs to support these programs in local education and research at underserved institutions (UIs). These include community colleges, historically Black colleges and universities, Hispanic-serving institutions, and tribal colleges and universities that support ethnically, racially, and socioeconomically underrepresented students in the United States. We have formed the Genomic Data Science Community Network to support students, faculty, and their networks to identify opportunities and broaden access to genomic data science. These opportunities include expanding access to infrastructure and data, providing UI faculty development opportunities, strengthening collaborations among faculty, recognizing UI teaching and research excellence, fostering student awareness, developing modular and open-source resources, expanding course-based undergraduate research experiences (CUREs), building curriculum, supporting student professional development and research, and removing financial barriers through funding programs and collaborator support.

Ten simple rules for designing and running a computing minor for bio/chem students

Science students increasingly need programming and data science skills to be competitive in the modern workforce. However, at our university (San Francisco State University), until recently, almost no biology, biochemistry, and chemistry students (from here bio/chem students) completed a minor in computer science. To change this, a new minor in computing applications, which is informally known as the Promoting Inclusivity in Computing (PINC) minor, was established in 2016. Here, we present the lessons we learned from our experience in a set of 10 rules. The first 3 rules focus on setting up the program so that it interests students in biology, chemistry, and biochemistry. Rules 4 through 8 focus on how the classes of the program are taught to make them interesting for our students and to provide the students with the support they need. The last 2 rules are about what happens “behind the scenes” of running a program with many people from several departments involved.

Undergraduate R Programming Anxiety in Ecology: Persistent Gender Gaps and Coping Strategies

The ability to program in R, an open-source statistical program, is increasingly valued across job markets, including ecology. The benefits of teaching R to undergraduates are abundant, but learning to code in R may induce anxiety for students, potentially leading to negative learning outcomes and disengagement. Anecdotes suggest a gender differential in programming anxiety, with women experiencing greater anxiety. Currently, we do not know the extent to which programming anxiety exists in our undergraduate biology classrooms, whether it differs by gender, and what instructors can do to alleviate it. Instructor immediacy has been shown to mediate related anxieties such as quantitative and computer anxiety. Likewise, students' use of adaptive coping strategies may mitigate anxieties. We investigated students' R anxiety within a lower-division ecology course and explored its relationships with gender, instructor immediacy, classroom engagement, and reported coping strategies. Women reported significantly higher R anxiety than men, a gap that narrowed, yet persisted over the semester. In addition, several specific coping skills were associated with decreases in R anxiety and increases in self-concept and sense of control; these differed by gender identity. Our findings can guide future work to identify interventions that lessen programming anxiety in biology classes, especially for women.

The Development of Core Concepts for Neuroscience Higher Education: From Beginning to Summer Virtual Meeting Satellite Session

Neuroscience curricula vary widely across higher education institutions due to the lack of an accrediting body or a set of unified educational concepts or outcomes. Each institution has developed a unique set of fundamental knowledge, topical subdisciplines, and core competencies to be delivered in a neuroscience program. Core concepts would provide neuroscience departments and programs with a generally agreed upon set of overarching principles that organize knowledge and can be applied to all sub-disciplines of the field, providing a useful framework from which to approach neuroscience education. We set out to develop a consensus set of neuroscience core concepts to aid in higher education curricular development and assessment. Suggestions for neuroscience core concepts were solicited from neuroscience faculty in a nationwide survey and analyzed using an inductive, independent coding model to identify eight core concepts based upon survey responses. Accompanying explanatory paragraphs for each core concept were developed through an iterative process. We presented the resulting core concepts to 134 neuroscience educators at a satellite session of the Faculty for Undergraduate Neuroscience 2020 Summer Virtual Meeting (SVM). Individuals and groups of faculty provided feedback regarding the accuracy, comprehensiveness, and clarity of each concept and explanatory paragraph, as well as the structure of the document as a whole. We continue to refine the core concepts based upon this feedback and will distribute the final document in a subsequent publication. Following publication of the finalized list of core concepts, we will develop tools to help educators incorporate the core concepts into their curricula.

E-learning strategies from a bioinformatics postgraduate programme to improve student engagement and completion rate

Motivation

E-learning is the standard solution adopted in transnational study programmes for which multiple face-to-face learning places are not an option. Bioinformatics is compatible with e-learning because its resource requirements are low. Online learning, however, is usually associated with high dropout rates because students start from a very low computational level and/or they need support to conduct practical analyses on their own.

Results

In this article, we analyse the academic results of an online bioinformatics educational programme based on learning communities. The programme has been offered by the Spanish Pablo de Olavide University for more than 5 years with a completion rate of close to 90%. Learning bioinformatics requires technical and operational competencies that can only be acquired through a practical methodology. We have thus developed a student-centred and problem-based constructivist learning model; the model uses faculty and peer mentoring to drive individual work and retain students. Regarding our innovative learning model, the recruitment level (i.e. the number of applicants per available places and international origin), the results obtained (i.e. the retention index and learning outcomes) as well as the satisfaction index expressed by students and faculty lead us to regard this programme as a successful strategy for online graduate learning in bioinformatics.

Availability and implementation

All data and results for this article are available in the figures and supplementary files. The current syllabus (Supplementary File S7) and other details of the course are available at: https://www.upo.es/postgrado/Diploma-de-Especializacion-Analisis-Bioinformatico and https://www.upo.es/postgrado/Master-Analisis-Bioinformatico-Avanzado.

Supplementary information

Supplementary data are available at Bioinformatics Advances online.

Development of a Remote, Course-Based Undergraduate Experience to Facilitate In Silico Study of Microbial Metabolic Pathways

Course-based undergraduate research experiences (CUREs) often occur in a physical lab space, but they can also be offered remotely while maintaining course expectations and providing opportunity for authentic student engagement in research. Using a novel framework, remote Microbial Ecology CURE students used microbes isolated via antimicrobial-challenged Winogradsky columns to investigate phylogeny and metabolism through a hypothesis-driven meta-analysis (MA). Students used 16S rRNA and key metabolic enzymes to compare phylogeny; enzymes were modeled and evaluated for putative conserved domains, culminating in primer design and analysis. Using in silico tools facilitated student development of bioinformatics skills. The MA was subdivided into discrete sections in order to (i) provide a timeline for students to remain on schedule throughout a remote-learning lab experience, (ii) encourage feedback throughout the project, and (iii) facilitate student understanding of the experimental design. MA deliverables were designed to be specific figures with individual titles, legends, and analyses to enable their feedback for subsequent presentations. The six key formative deliverables included a word cloud (used to develop the works cited list and hypothesis), a 16S rRNA phylogenetic tree, an annotated metabolic pathway and three-dimensional model of the key metabolic enzyme, a phylogenetic tree based on the key metabolic enzyme, design and analysis of a primer set for the key metabolic enzyme, and a summative poster and graphical abstract. The MA project yielded poster presentations at virtual conferences, lab presentations, and written reports. Using the hypothesis-based MA model encouraged an authentic research experience, enabling students to develop, discuss, and progress in meaningful experiments.

Data Science in Undergraduate Life Science Education: A Need for Instructor Skills Training

There is a clear demand for quantitative literacy in the life sciences, necessitating competent instructors in higher education. However, not all instructors are versed in data science skills or research-based teaching practices. We surveyed biological and environmental science instructors (n = 106) about the teaching of data science in higher education, identifying instructor needs and illuminating barriers to instruction. Our results indicate that instructors use, teach, and view data management, analysis, and visualization as important data science skills. Coding, modeling, and reproducibility were less valued by the instructors, although this differed according to institution type and career stage. The greatest barriers were instructor and student background and space in the curriculum. The instructors were most interested in training on how to teach coding and data analysis. Our study provides an important window into how data science is taught in higher education biology programs and how we can best move forward to empower instructors across disciplines.

There Is More than Multiple Choice: Crowd-Sourced Assessment Tips for Online, Hybrid, and Face-to-Face Environments

Developing effective assessments of student learning is a challenging task for faculty and even more difficult for those in emerging disciplines that lack readily available resources and standards. With the power of technology-enhanced education and accessible digital learning platforms, instructors are also looking for assessments that work in an online format. This article will be useful for all teachers, but especially for entry-level instructors, in addition to more mature instructors who are looking to become more well versed in assessment, who seek a succinct summary of assessment types to springboard the integration of new forms of assessment of student learning into their courses. In this paper, ten assessment types, all appropriate for face-to-face, blended, and online modalities, are discussed. The assessments are mapped to a set of bioinformatics core competencies with examples of how they have been used to assess student learning. Although bioinformatics is used as the focus of the assessment types, the question types are relevant to many disciplines.

Principles of resilient coding for plant ecophysiologists

Plant ecophysiology is founded on a rich body of physical and chemical theory, but it is challenging to connect theory with data in unambiguous, analytically rigorous and reproducible ways. Custom scripts written in computer programming languages (coding) enable plant ecophysiologists to model plant processes and fit models to data reproducibly using advanced statistical techniques. Since many ecophysiologists lack formal programming education, we have yet to adopt a unified set of coding principles and standards that could make coding easier to learn, use and modify. We identify eight principles to help in plant ecophysiologists without much programming experience to write resilient code: (i) standardized nomenclature, (ii) consistency in style, (iii) increased modularity/extensibility for easier editing and understanding, (iv) code scalability for application to large data sets, (v) documented contingencies for code maintenance, (vi) documentation to facilitate user understanding; (vii) extensive tutorials and (viii) unit testing and benchmarking. We illustrate these principles using a new R package, {photosynthesis}, which provides a set of analytical and simulation tools for plant ecophysiology. Our goal with these principles is to advance scientific discovery in plant ecophysiology by making it easier to use code for simulation and data analysis, reproduce results and rapidly incorporate new biological understanding and analytical tools.

Medical Data Mining Course Development in Postgraduate Medical Education: Web-Based Survey and Case Study

BACKGROUND

Medical postgraduates' demand for data capabilities is growing, as biomedical research becomes more data driven, integrative, and computational. In the context of the application of big data in health and medicine, the integration of data mining skills into postgraduate medical education becomes important.

OBJECTIVE

This study aimed to demonstrate the design and implementation of a medical data mining course for medical postgraduates with diverse backgrounds in a medical school.

METHODS

We developed a medical data mining course called "Practical Techniques of Medical Data Mining" for postgraduate medical education and taught the course online at Peking Union Medical College (PUMC). To identify the background knowledge, programming skills, and expectations of targeted learners, we conducted a web-based questionnaire survey. After determining the instructional methods to be used in the course, three technical platforms-Rain Classroom, Tencent Meeting, and WeChat-were chosen for online teaching. A medical data mining platform called Medical Data Mining - R Programming Hub (MedHub) was developed for self-learning, which could support the development and comprehensive testing of data mining algorithms. Finally, we carried out a postcourse survey and a case study to demonstrate that our online course could accommodate a diverse group of medical students with a wide range of academic backgrounds and programming experience.

RESULTS

In total, 200 postgraduates from 30 disciplines participated in the precourse survey. Based on the analysis of students' characteristics and expectations, we designed an optimized course structured into nine logical teaching units (one 4-hour unit per week for 9 weeks). The course covered basic knowledge of R programming, machine learning models, clinical data mining, and omics data mining, among other topics, as well as diversified health care analysis scenarios. Finally, this 9-week course was successfully implemented in an online format from May to July in the spring semester of 2020 at PUMC. A total of 6 faculty members and 317 students participated in the course. Postcourse survey data showed that our course was considered to be very practical (83/83, 100% indicated "very positive" or "positive"), and MedHub received the best feedback, both in function (80/83, 96% chose "satisfied") and teaching effect (80/83, 96% chose "satisfied"). The case study showed that our course was able to fill the gap between student expectations and learning outcomes.

CONCLUSIONS

We developed content for a data mining course, with online instructional methods to accommodate the diversified characteristics of students. Our optimized course could improve the data mining skills of medical students with a wide range of academic backgrounds and programming experience.

Community development, implementation, and assessment of a NIBLSE bioinformatics sequence similarity learning resource

As powerful computational tools and 'big data' transform the biological sciences, bioinformatics training is becoming necessary to prepare the next generation of life scientists. Furthermore, because the tools and resources employed in bioinformatics are constantly evolving, bioinformatics learning materials must be continuously improved. In addition, these learning materials need to move beyond today's typical step-by-step guides to promote deeper conceptual understanding by students. One of the goals of the Network for Integrating Bioinformatics into Life Sciences Education (NIBSLE) is to create, curate, disseminate, and assess appropriate open-access bioinformatics learning resources. Here we describe the evolution, integration, and assessment of a learning resource that explores essential concepts of biological sequence similarity. Pre/post student assessment data from diverse life science courses show significant learning gains. These results indicate that the learning resource is a beneficial educational product for the integration of bioinformatics across curricula.

From In-Person to the Online World: Insights Into Organizing Events in Bioinformatics

Bioinformatics is a fast-evolving research field, requiring effective educational initiatives to bring computational knowledge to Life Sciences. Since 2017, an organizing committee composed of graduate students and postdoctoral researchers from the Universidade Federal de Minas Gerais (Brazil) promotes a week-long event named Summer Course in Bioinformatics (CVBioinfo). This event aims to diffuse bioinformatic principles, news, and methods mainly focused on audiences of undergraduate students. Furthermore, as the advent of the COVID-19 global pandemic has precluded in-person events, we offered the event in online mode, using free video transmission platforms. Herein, we present and discuss the insights obtained from promoting the Online Workshop in Bioinformatics (WOB) organized in November 2020, comparing it to our experience in previous in-person editions of the same event.

Online Tools for Teaching Cancer Bioinformatics

The rise of deep molecular characterization with omics data as a standard in biological sciences has highlighted a need for expanded instruction in bioinformatics curricula. Many large biology data sets are publicly available and offer an incredible opportunity for educators to help students explore biological phenomena with computational tools, including data manipulation, visualization, and statistical assessment. However, logistical barriers to data access and integration often complicate their use in undergraduate education. Here, we present a cancer bioinformatics module that is designed to overcome these barriers through six exercises containing authentic, biologically motivated computational exercises that demonstrate how modern omics data are used in precision oncology. Upper-division undergraduate students develop advanced Python programming and data analysis skills with real-world oncology data which integrates proteomics and genomics. The module is publicly available and open source at https://paynelab.github.io/biograder/bio462. These hands-on activities include explanatory text, code demonstrations, and practice problems and are ready to implement in bioinformatics courses.

Graphery: interactive tutorials for biological network algorithms

Networks have been an excellent framework for modeling complex biological information, but the methodological details of network-based tools are often described for a technical audience. We have developed Graphery, an interactive tutorial webserver that illustrates foundational graph concepts frequently used in network-based methods. Each tutorial describes a graph concept along with executable Python code that can be interactively run on a graph. Users navigate each tutorial using their choice of real-world biological networks that highlight the diverse applications of network algorithms. Graphery also allows users to modify the code within each tutorial or write new programs, which all can be executed without requiring an account. Graphery accepts ideas for new tutorials and datasets that will be shaped by both computational and biological researchers, growing into a community-contributed learning platform. Graphery is available at https://graphery.reedcompbio.org/.

Integrating Bioinformatics Tools Into Inquiry-Based Molecular Biology Laboratory Education Modules

The accelerating expansion of online bioinformatics tools has profoundly impacted molecular biology, with such tools becoming integral to the modern life sciences. As a result, molecular biology laboratory education must train students to leverage bioinformatics in meaningful ways to be prepared for a spectrum of careers. Institutions of higher learning can benefit from a flexible and dynamic instructional paradigm that blends up-to-date bioinformatics training with best practices in molecular biology laboratory pedagogy. At North Carolina State University, the campus-wide interdisciplinary Biotechnology (BIT) Program has developed cutting-edge, flexible, inquiry-based Molecular Biology Laboratory Education Modules (MBLEMs). MBLEMs incorporate relevant online bioinformatics tools using evidenced-based pedagogical practices and in alignment with national learning frameworks. Students in MBLEMs engage in the most recent experimental developments in modern biology (e.g., CRISPR, metagenomics) through the strategic use of bioinformatics, in combination with wet-lab experiments, to address research questions. MBLEMs are flexible educational units that provide a menu of inquiry-based laboratory exercises that can be used as complete courses or as parts of existing courses. As such, MBLEMs are designed to serve as resources for institutions ranging from community colleges to research-intensive universities, involving a diverse range of learners. Herein, we describe this new paradigm for biology laboratory education that embraces bioinformatics as a critical component of inquiry-based learning for undergraduate and graduate students representing the life sciences, the physical sciences, and engineering.

Development of the Organonitrogen Biodegradation Database: Teaching Bioinformatics and Collaborative Skills to Undergraduates during a Pandemic

Physical distancing and inaccessibility to laboratory facilities created an opportunity to transition undergraduate research experiences to remote, digital platforms, adding another level of pedagogy to their training. Basic bioinformatics skills together with critical analysis of scientific literature are essential for addressing research questions in modern biology. The work presented here describes a fully online, collaborative research experience created to allow undergraduate students to learn those skills. The research experience was focused on the development and implementation of the Organonitrogen Biodegradation Database (ONDB, z.umn.edu/ondb). The ONDB was developed to catalog information about the cost, chemical properties, and biodegradation potential of commonly used organonitrogen compounds. A cross-institutional team of undergraduate researchers worked in collaboration with two faculty members and a postdoctoral fellow to develop the database. Students carried out extensive online literature searches and used a biodegradation prediction website to research and represent the microbial catabolism of different organonitrogen compounds. Participants employed computational tools such as R, Shiny, and flexdashboard to construct the database pages and interactive web interface for the ONDB. Worksheets and forms were created to encourage other students and researchers to gather information about organonitrogen compounds and expand the database. Student progress was evaluated through biweekly project meetings, presentations, and a final reflection. The ONDB undergraduate research experience provided a platform for students to learn bioinformatics skills while simultaneously developing a teaching and research tool for others.

Resequencing of Microbial Isolates: A Lab Module to Introduce Novices to Command-Line Bioinformatics

Familiarity with genome-scale data and the bioinformatic skills to analyze it have become essential for understanding and advancing modern biology and human health, yet many undergraduate biology majors are never exposed to hands-on bioinformatics. This paper presents a module that introduces students to applied bioinformatic analysis within the context of a research-based microbiology lab course. One of the most commonly used genomic analyses in biology is resequencing: determining the sequence of DNA bases in a derived strain of some organism, and comparing it to the known ancestral genome of that organism to better understand the phenotypic differences between them. Many existing CUREs - Course Based Undergraduate Research Experiences - evolve or select new strains of bacteria and compare them phenotypically to ancestral strains. This paper covers standardized strategies and procedures, accessible to undergraduates, for preparing and analyzing microbial whole-genome resequencing data to examine the genotypic differences between such strains. Wet-lab protocols and computational tutorials are provided, along with additional guidelines for educators, providing instructors without a next-generation sequencing or bioinformatics background the necessary information to incorporate whole-genome sequencing and command-line analysis into their class. This module introduces novice students to running software at the command-line, giving them exposure and familiarity with the types of tools that make up the vast majority of open-source scientific software used in contemporary biology. Completion of the module improves student attitudes toward computing, which may make them more likely to pursue further bioinformatics study.

An instructional definition and assessment rubric for bioinformatics instruction

The lack of an instructional definition of bioinformatics delays its effective integration into biology coursework. Using an iterative process, our team of biologists, a mathematician/computer scientist, and a bioinformatician together with an educational evaluation and assessment specialist, developed an instructional definition of the discipline: Bioinformatics is "an interdisciplinary field that is concerned with the development and application of algorithms that analyze biological data to investigate the structure and function of biological polymers and their relationships to living systems." The field is defined in terms of its two primary foundational disciplines, biology and computer science, and its interdisciplinary nature. At the same time, we also created a rubric for assessing open-ended responses to a prompt about what bioinformatics is and how it is used. The rubric has been shown to be reliable in successive rounds of testing using both common percent agreement (89.7%) and intraclass correlation coefficient (0.620) calculations. We offer the definition and rubric to life sciences instructors to help further integrate bioinformatics into biology instruction, as well as for fostering further educational research projects.

The student-centered classroom: the new gut feeling

A student-centered, interactive course-based undergraduate research experience (CURE) was implemented in a microbiology course in order to provide an authentic research experience and to stimulate student interest and improve understanding of fermentation, probiotics, the human microbiome and related topics. Students were immersed in the scientific process as they used fundamental techniques to investigate the probiotic composition of a fermented milk beverage, kefir-an unknown question with no predetermined outcomes. In order to assess the benefits and effect of this learning experience on the students, pre- and post-study surveys were administered using Qualtrics. Post-study, 93% of participants agreed that fermented foods are beneficial to human health (compared to 52% pre-study), and notably, 100% of participants indicated that they plan to apply this material in both their personal and professional lives and would suggest consuming probiotics or fermented products to alleviate gastrointestinal issues. As evidenced by demographic data, this CURE is suitable for implementation at both large and small institutions with diverse student populations. Collectively, these data indicate that this collaborative, discovery-based learning experience is a powerful educational tool, encouraging students to make real-life connections between microbiology, medicine and their own health.

BioSkills Guide: Development and National Validation of a Tool for Interpreting the Vision and Change Core Competencies

To excel in modern science, technology, engineering, and mathematics careers, biology majors need a range of transferable skills, yet competency development is often a relatively underdeveloped facet of the undergraduate curriculum. We have elaborated the Vision and Change core competency framework into a resource called the BioSkills Guide, a set of measurable learning outcomes that can be more readily implemented by faculty. Following an iterative review process including more than 200 educators, we gathered evidence of the BioSkills Guide's content validity using a national survey of more than 400 educators. Rates of respondent support were high (74.3-99.6%) across the 77 outcomes in the final draft. Our national sample during the development and validation phases included college biology educators representing more than 250 institutions, including 73 community colleges, and a range of course levels and biology subdisciplines. Comparison of the BioSkills Guide with other science competency frameworks reveals significant overlap but some gaps and ambiguities. These differences may reflect areas where understandings of competencies are still evolving in the undergraduate biology community, warranting future research. We envision the BioSkills Guide supporting a variety of applications in undergraduate biology, including backward design of individual lessons and courses, competency assessment development, and curriculum mapping and planning.

Microbiomes for All

Microbiome research projects are often interdisciplinary, involving fields such as microbiology, genetics, ecology, evolution, bioinformatics, and statistics. These research projects can be an excellent fit for undergraduate courses ranging from introductory biology labs to upper-level capstone courses. Microbiome research projects can attract the interest of students majoring in health and medical sciences, environmental sciences, and agriculture, and there are meaningful ties to real-world issues relating to human health, climate change, and environmental sustainability and resilience in pristine, fragile ecosystems to bustling urban centers. In this review, we will discuss the potential of microbiome research integrated into classes using a number of different modalities. Our experience scaling-up and implementing microbiome projects at a range of institutions across the US has provided us with insight and strategies for what works well and how to diminish common hurdles that are encountered when implementing undergraduate microbiome research projects. We will discuss how course-based microbiome research can be leveraged to help faculty make advances in their own research and professional development and the resources that are available to support faculty interested in integrating microbiome research into their courses.

Teaching Microbiome Analysis: From Design to Computation Through Inquiry

In this article, we present our three-class course sequence to educate students about microbiome analysis and metagenomics through experiential learning by taking them from inquiry to analysis of the microbiome: Molecular Ecology Lab, Bioinformatics, and Computational Microbiome Analysis. Students developed hypotheses, designed lab experiments, sequenced the DNA from microbiomes, learned basic python/R scripting, became proficient in at least one microbiome analysis software, and were able to analyze data generated from the microbiome experiments. While over 150 students (graduate and undergraduate) were impacted by the development of the series of courses, our assessment was only on undergraduate learning, where 45 students enrolled in at least one of the three courses and 4 students took all three. Students gained skills in bioinformatics through the courses, and several positive comments were received through surveys and private correspondence. Through a summative assessment, general trends show that students became more proficient in comparative genomic techniques and had positive attitudes toward their abilities to bridge biology and bioinformatics. While most students took individual or 2 of the courses, we show that pre- and post-surveys of these individual classes still showed progress toward learning objectives. It is expected that students trained will enter the workforce with skills needed to innovate in the biotechnology, health, and environmental industries. Students are trained to maximize impact and tackle real world problems in biology and medicine with their learned knowledge of data science and machine learning. The course materials for the new microbiome analysis course are available on Github: https://github.com/EESI/Comp_Metagenomics_resources.

PUMAA: A Platform for Accessible Microbiome Analysis in the Undergraduate Classroom

Improvements in high-throughput sequencing makes targeted amplicon analysis an ideal method for the study of human and environmental microbiomes by undergraduates. Multiple bioinformatics programs are available to process and interpret raw microbial diversity datasets, and the choice of programs to use in curricula is largely determined by student learning goals. Many of the most commonly used microbiome bioinformatics platforms offer end-to-end data processing and data analysis using a command line interface (CLI), but the downside for novice microbiome researchers is the steep learning curve often required. Alternatively, some sequencing providers include processing of raw data and taxonomy assignments as part of their pipelines. This, when coupled with available web-based or graphical user interface (GUI) analysis and visualization tools, eliminates the need for students or instructors to have extensive CLI experience. However, lack of universal data formats can make integration of these tools challenging. For example, tools for upstream and downstream analyses frequently use multiple different data formats which then require writing custom scripts or hours of manual work to make the files compatible. Here, we describe a microbial ecology bioinformatics curriculum that focuses on data analysis, visualization, and statistical reasoning by taking advantage of existing web-based and GUI tools. We created the Program for Unifying Microbiome Analysis Applications (PUMAA), which solves the problem of inconsistent files by formatting the output files from several raw data processing programs to seamlessly transition to a suite of GUI programs for analysis and visualization of microbiome taxonomic and inferred functional profiles. Additionally, we created a series of tutorials to accompany each of the microbiome analysis curricular modules. From pre- and post-course surveys, students in this curriculum self-reported conceptual and confidence gains in bioinformatics and data analysis skills. Students also demonstrated gains in biologically relevant statistical reasoning based on rubric-guided evaluations of open-ended survey questions and the Statistical Reasoning in Biology Concept Inventory. The PUMAA program and associated analysis tutorials enable students and researchers with no computational experience to effectively analyze real microbiome datasets to investigate real-world research questions.

In silico Phage Hunting: Bioinformatics Exercises to Identify and Explore Bacteriophage Genomes

Bioinformatics skills are increasingly relevant to research in most areas of the life sciences. The availability of genome sequences and large data sets provide unique opportunities to incorporate bioinformatics exercises into undergraduate microbiology courses. The goal of this project was to develop a teaching module to investigate the abundance and phylogenetic relationships amongst bacteriophages using a set of freely available bioinformatics tools. Computational identification and examination of bacteriophage genomes, followed by phylogenetic analyses, provides opportunities to incorporate core bioinformatics competencies in microbiology courses and enhance students' bioinformatics skills. The first activity consisted of using PHASTER (PHAge Search Tool Enhanced Release), a bioinformatics tool that identifies bacteriophage sequences within bacterial chromosomes. Further computational analyses were conducted to align bacteriophage proteins, genomes, and determine phylogenetic relationships amongst these viruses. This part of the project was carried out using the Clustal omega, MAFFT (Multiple Alignment using Fast Fourier Transform), and Interactive Tree of Life (iTOL) programs for sequence alignments and phylogenetic analyses. The laboratory activities were field tested in undergraduate directed research, and microbiology classes. The learning objectives were assessed by comparing the scores of pre and post-tests and grading final presentations. Post-tests were higher than pre-test scores at or below p = 0.002. The data suggest in silico phage hunting improves students' ability to search databases, interpret phylogenetic trees, and use bioinformatics tools to examine genome structure. This activity allows instructors to integrate key bioinformatic concepts in their curriculums and gives students the opportunity to participate in a research-directed learning environment in the classroom.

A Curricular Bioinformatics Approach to Teaching Undergraduates to Analyze Metagenomic Datasets Using R

Biologists with bioinformatic skills will be better prepared for the job market, but relatively few biology programs require bioinformatics courses. Inclusion in the curriculum may be hindered by several barriers, including lack of faculty expertise, student resistance to computational work, and few examples in the pedagogical literature. An 8-week wet-lab and in silico research experience for undergraduates was implemented. Students performed DNA purification and metagenomics analysis to compare the diversity and abundance of microbes in two samples. Students sampled snow from sites in northern Minnesota and purified genomic DNA from the microbes, followed by metagenomic analysis. Students used an existing metagenomic dataset to practice analysis skills, including comparing the use of Excel versus R for analysis and visualization of a large dataset. Upon receipt of the snow data, students applied their recently acquired skills to their new dataset and reported their results via a poster. Several outcomes were achieved as a result of this module. First, YouTube videos demonstrating hands-on metagenomics and R techniques were used as professional development for faculty, leading to broadened research capabilities and comfort with bioinformatics. Second, students were introduced to computational skills in a manner that was intentional, with time for both introduction and reinforcement of skills. Finally, the module was effectively included in a biology curriculum because it could function as either a stand-alone course or a module within another course such as microbiology. This module, developed with Course-based Undergraduate Research Experience guidelines in mind, introduces students and faculty to bioinformatics in biology research.

Core competencies for clinical informaticians: A systematic review

BACKGROUND

Building on initial work carried out by the Faculty of Clinical Informatics (FCI) in the UK, the creation of a national competency framework for Clinical Informatics is required for the definition of clinical informaticians' professional attributes and skills. We aimed to systematically review the academic literature relating to competencies, skills and existing course curricula in the clinical and health related informatics domains.

METHODS

Two independent reviewers searched Web of Science, EMBASE, ERIC, PubMed and CINAHL. Publications were included if they reported details of relevant competencies, skills and existing course curricula. We report findings using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement.

RESULTS

A total of 82 publications were included. The most frequently used method was surveys (30 %) followed by narrative descriptions (28 %). Most of the publications describe curriculum design (23 %) followed by competency definition (18 %) and skills, qualifications & training (18 %). Core skills surrounding data, information systems and information management appear to be cross-cutting across the various informatics disciplines with Bioinformatics and Pharmacy Informatics expressing the most unique competency requirements.

CONCLUSION

We identified eight key domains that cut across the different sub-disciplines of health informatics, including data, information management, human factors, project management, research skills/knowledge, leadership and management, systems development and evaluation, and health/healthcare. Some informatics disciplines such as Nursing Informatics appear to be further ahead at achieving widespread competency standardisation. Attempts at standardisation for competencies should be tempered with flexibility to allow for local variation and requirements.

Incubators: Building community networks and developing open educational resources to integrate bioinformatics into life science education

While it is essential for life science students to be trained in modern techniques and approaches, rapidly developing, interdisciplinary fields such as bioinformatics present distinct challenges to undergraduate educators. In particular, many educators lack training in new fields, and high-quality teaching and learning materials may be sparse. To address this challenge with respect to bioinformatics, the Network for the Integration of Bioinformatics into Life Science Education (NIBLSE), in partnership with Quantitative Undergraduate Biology Education and Synthesis (QUBES), developed incubators, a novel collaborative process for the development of open educational resources (OER). Incubators are short-term, online communities that refine unpublished teaching lessons into more polished and widely usable learning resources. The resulting products are published and made freely available in the NIBLSE Resource Collection, providing recognition of scholarly work by incubator participants. In addition to producing accessible, high-quality resources, incubators also provide opportunities for faculty development. Because participants are intentionally chosen to represent a range of expertise in bioinformatics and pedagogy, incubators also build professional connections among educators with diverse backgrounds and perspectives and promote the discussion of practical issues involved in deploying a resource in the classroom. Here we describe the incubator process and provide examples of beneficial outcomes. Our experience indicates that incubators are a low cost, short-term, flexible method for the development of OERs and professional community that could be adapted to a variety of disciplinary and pedagogical contexts.

The Mastery Rubric for Bioinformatics: A tool to support design and evaluation of career-spanning education and training

As the life sciences have become more data intensive, the pressure to incorporate the requisite training into life-science education and training programs has increased. To facilitate curriculum development, various sets of (bio)informatics competencies have been articulated; however, these have proved difficult to implement in practice. Addressing this issue, we have created a curriculum-design and -evaluation tool to support the development of specific Knowledge, Skills and Abilities (KSAs) that reflect the scientific method and promote both bioinformatics practice and the achievement of competencies. Twelve KSAs were extracted via formal analysis, and stages along a developmental trajectory, from uninitiated student to independent practitioner, were identified. Demonstration of each KSA by a performer at each stage was initially described (Performance Level Descriptors, PLDs), evaluated, and revised at an international workshop. This work was subsequently extended and further refined to yield the Mastery Rubric for Bioinformatics (MR-Bi). The MR-Bi was validated by demonstrating alignment between the KSAs and competencies, and its consistency with principles of adult learning. The MR-Bi tool provides a formal framework to support curriculum building, training, and self-directed learning. It prioritizes the development of independence and scientific reasoning, and is structured to allow individuals (regardless of career stage, disciplinary background, or skill level) to locate themselves within the framework. The KSAs and their PLDs promote scientific problem formulation and problem solving, lending the MR-Bi durability and flexibility. With its explicit developmental trajectory, the tool can be used by developing or practicing scientists to direct their (and their team's) acquisition of new, or to deepen existing, bioinformatics KSAs. The MR-Bi is a tool that can contribute to the cultivation of a next generation of bioinformaticians who are able to design reproducible and rigorous research, and to critically analyze results from their own, and others', work.

Barriers to integration of bioinformatics into undergraduate life sciences education: A national study of US life sciences faculty uncover significant barriers to integrating bioinformatics into undergraduate instruction

Bioinformatics, a discipline that combines aspects of biology, statistics, mathematics, and computer science, is becoming increasingly important for biological research. However, bioinformatics instruction is not yet generally integrated into undergraduate life sciences curricula. To understand why we studied how bioinformatics is being included in biology education in the US by conducting a nationwide survey of faculty at two- and four-year institutions. The survey asked several open-ended questions that probed barriers to integration, the answers to which were analyzed using a mixed-methods approach. The barrier most frequently reported by the 1,260 respondents was lack of faculty expertise/training, but other deterrents—lack of student interest, overly-full curricula, and lack of student preparation—were also common. Interestingly, the barriers faculty face depended strongly on whether they are members of an underrepresented group and on the Carnegie Classification of their home institution. We were surprised to discover that the cohort of faculty who were awarded their terminal degree most recently reported the most preparation in bioinformatics but teach it at the lowest rate.

The why, when, and how of computing in biology classrooms

Many biologists are interested in teaching computing skills or using computing in the classroom, despite not being formally trained in these skills themselves. Thus biologists may find themselves researching how to teach these skills, and therefore many individuals are individually attempting to discover resources and methods to do so. Recent years have seen an expansion of new technologies to assist in delivering course content interactively. Educational research provides insights into how learners absorb and process information during interactive learning. In this review, we discuss the value of teaching foundational computing skills to biologists, and strategies and tools to do so. Additionally, we review the literature on teaching practices to support the development of these skills. We pay special attention to meeting the needs of diverse learners, and consider how different ways of delivering course content can be leveraged to provide a more inclusive classroom experience. Our goal is to enable biologists to teach computational skills and use computing in the classroom successfully.