Peerspectives: Difference between revisions

From Peerspectives-Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(33 intermediate revisions by the same user not shown)
Line 1: Line 1:
{| class="wikitable mw-collapsible"
!<big>About this Wiki</big>
|-
|This Wiki was designed and intended to provide a template for educators to integrate Peerspectives into their own academic program. In addition to details regarding the purpose, learning objectives, and structure of the course, we also provide the following:
* Modifiable lecture slides
*Email templates used to run the course
*Suggestions for adapting the course to other disciplines or career stages
*Lessons learned from previous iterations of the course, tested via trial-and-error


__FORCETOC__


'''<big>What is Peerspectives?</big>'''
Please use the left side panel for navigation, in addition to the search bar at the top of this page.
|}
[[File:Peerspectives logo.png|alt=Logo for the Peerspectives peer-review training initiative|center|300x300px]]
==<big>Overview</big>==


Peerspectives is a highly interactive and engaging course that was designed to provide researchers with modern training and insights into the structure, purpose, and conduct of the peer-review and editing processes in scientific journals. Scientific peer review is a crucial pillar of scientific quality control and academic publishing; yet, most scientists never receive formal training on its purpose or conduct.
=== What is Peerspectives? ===
Peerspectives is a highly interactive and engaging '''course''' that provides researchers with modern training and insights into the '''structure, purpose, and conduct of the scholarly peer review and editing processes at scientific journals.'''


'''<big>Structure of the Peerspectives course</big>'''
=== How did Peerspectives start? ===
Peerspectives was originally conceptualized as a semester-long course that offered as an elective course in the structured PhD program in Health Data Sciences at the Charité. Soon after, we expanded our content to suit a wider audience of early career biomedical scientists.


Peerspectives was designed to be a semester-long course developed for integration into biomedical sciences curricula. It is possibly to run this course entirely online. This course was also designed with flexibility in mind, making it easy to adapt to various resource levels, time frames, and scientific disciplines.
This course can be hosted entirely online and was created with flexibility in mind, making it adaptable to various resource levels, time frames, career stages, and scientific disciplines.


'''<big>About this Wiki</big>'''
=== Why should you run Peerspectives? ===
Scientific journals publish scholarly articles and provide an important platform for transparent presentation, exchange, and discussion of scientific findings and developments. Peer review plays a fundamental role in ensuring integrity and quality in scientific processes. While the scientific peer review process is not without flaws, learning how to conduct high-quality peer review is an invaluable skill for early career researchers (ECRs). In sharp contrast to the enormous emphasis on scientific publications in cumulative publication-based dissertations, peer review training is rarely, if ever, included in graduate training curricula. '''Peerspectives seeks to address this training gap.'''


This page was designed to provide a template for educators to integrate Peerspectives into their own academic program. In addition to details regarding the purpose, learning objectives, and structure of the course, we also provide the following:
Peerspectives introduces participants to the modern scientific publishing landscape and the actors within this system. The course allows participants to refine their skills in drafting peer review reports and learn about transparency, reproducibility, and the use of modern methods. Additionally, it simultaneously serves to increase awareness of critical systemic issues including biases, favoritism, and scientific misconduct.


* Modifiable lecture slides
Peerspectives strives to equip early-stage researchers with vital career-related skills and provide them with the chance to reflect on quality control and the role of the professional publishing business in science.
* Email templates used to run the course
* Adaptation suggestions
* Lessons learned...


==Purpose==
=== Target audience ===
'''About Peer Review'''
Peerspectives originated as a training course for doctoral students in the domains of biomedical sciences and population health with prior epidemiology or biostatistics training. Over time, the course expanded to welcome other early career researchers, such as advanced master’s students, and early-stage postdocs.


Scientific journals publish scholarly articles and provide an important platform for transparent presentation, exchange, and discussion of scientific findings and developments. Peer review plays a fundamental role in ensuring integrity and quality in scientific processes.
The course is '''flexible''' and can be adapted to different career stages and scientific disciplines. However, for successful implementation, '''it is important to customize the content and structure to fit the specific needs of the participants'''. A generic, one-size-fits-all approach may be impractical and could affect the course’s overall quality.


Despite a lack of formal training in peer review, scientists are expected to contribute to,  Peerspectives is an initiative that addresses this training gap.
=== Course objectives ===
* Explain the role of scientific journals, editors, and peer reviewers as parts of the scientific process in the field of biomedical sciences
* Promote clear communication and efficiency in the peer review process
* Stimulate critical thinking and constructive, scientific critique
* Encourage transparency and adherence to ethical and methodological guidelines
* Introduce and explore concepts around open science, open-access publishing, and open peer review
* Participants will develop an understanding of what peer reviewers and editors are looking for in scientific writing and improve the quality of participants’ future submission


While the scientific peer review process is not without flaws, learning how to conduct high-quality peer review is an invaluable skill for early career researchers (ECRs). In sharp contrast to the enormous (albeit controversial) emphasis on scientific publications in cumulative publication-based dissertations, university incentive structures and in career trajectories in academia, peer review training opportunities are rarely, if ever, including in graduate training curricula. This motivation drove us to create the Peerspectives peer review training program for PhD students and other ECRs in the biomedical sciences. Peerspectives introduces participants to the modern scientific publishing landscape and the actors within this system. The course allows students to refine their skills in drafting peer review reports and learn about transparency, reproducibility, and the use of modern methods. Additionally, it simultaneously serves to increase awareness of critical systemic issues including biases, favoritism, and scientific misconduct
==<big>Course Structure</big>==
Our complete semester-long hybrid approach to training combines a series of interactive lectures with reflection assignments to promote fruitful group discussions. Once the lecture series has concluded, the course moves onto a series of peer review workshops.  During these workshops, the participants – under the guidance of an experienced editorial mentor –  collaborate in small groups to peer review “live” manuscripts that are currently under consideration at a partnering scientific journal. The Peerspectives approach uniquely allows participants to engage in collaborative peer review in a mentored environment.


Peerspectives strives to equip early-stage researchers with vital career-related skills and provide them with the chance to reflect on quality control and the role of the professional publishing business in science.
=== Component 1: [[Lectures]] ===
==Target Audience==
Peerspectives opens with a series of interactive lectures aimed at equipping participants with essential knowledge of editorial processes and the development of scientific peer review. The lecture component of the course spans over four sessions, with each lecture lasting three hours. However, the number of sessions, their duration, and the topics covered can be modified to align with the target audience, lecturer availability, and scheduling needs.
Peerspectives originated as a training course for doctoral students in the domains of (bio)medical sciences and population health with prior epidemiology or biostatistics training. Over time, the course expanded to welcome other early career researchers, such as advanced master’s students and early-stage postdocs, who have also been very successful and valuable contributors to the course.


The course can be readily adapted to other scientific disciplines or career stages. However, when tailoring it for a new context, it is essential to align the content and structure with the specific needs of the target audience.
==== Take-home assignments ====
Between lectures, participants complete small exercises designed to reinforce concepts from the previous session and engage in preparatory brainstorming for the next lecture’s topics. These take-home assignments are revisited in the following lecture and serve as a foundation for group discussions.


'''Adapting the course to other scientific disciplines'''
===Component 2: [[Workshops]]===
The second component of Peerspectives consists of workshops, during which participants collaboratively draft and finalize a peer review report under the supervision of a mentor with peer review and (ideally) editorial experience. Workshops are designed to be participant-led, with the role of workshop leader rotating between participants each week. While the mentor provides guidance and can steer the discussion if needed, participants hold the responsibility for reading the manuscript and drafting a review prior to the workshop.  Participants are expected to shape the peer review (1) in line with their individual scientific expertise, and (2) to apply the peer review knowledge developed in the lectures.


'''Adapting the course to other career stages'''
=== Component 3: Reflection ===
To maximise learning outcomes, we recommend some kind of reflection activity. This can be in the form of a self-assessment of skills, de-briefing with the mentor after the last workshop, or listening in to an editorial meeting or requesting a meeting with the handling editor to inquire about the submitted peer review reports.


Must tailor the course to a discipline. One-size fits all solutions would be difficult to work with and would make the quality of the course suffer
===Component 4: [[Pre- and Post-Course Assignments]]===
==Learning Outcomes of the Course==
These assignments serve to gauge the peer review experience and knowledge of participants before and after formal instruction.
*Explain the role of scientific journals, editors, and peer reviewers as parts of the scientific process in biomedical fields
*Promote clear communication and efficiency in the review process
*Stimulate critical thinking and constructive, scientific critique
*Encourage transparency and adherence to ethical and methodological guidelines
*Introduce and explore open-access, open science, and open review concepts
*Develop an understanding of what reviewers and editors are looking for in scientific writing and improve the quality of participants’ future submission
==Course Structure==
Our semester-long hybrid approach to training combines a series of interactive lectures with reflection assignments to promote fruitful group discussions followed by hands-on workshops, in which students work together in small groups to review “live” manuscripts from a partnering scientific journal under the guidance of an experienced mentor with editing experience. Unlike existing peer review training workshops, our approach integrates participants into collaborative peer review in a mentored environment.
===Pre-Course Assignment (optional)===
*good exercise for people to realize what they dont know, see growth
===Lectures===
The course begins with 4, three-hour long lectures


Homework assignments + rationale
__NOTOC__
*4x à 3 hours (with breaks)
__NOINDEX__
*On Zoom, includes interactive polls, discussions & take-home assignment
{| class="wikitable mw-collapsible"
|+Lecture Topics (+ slides)
!
!Title '''(+ slides in hyperlink)'''
!Topics Covered
|-
|'''Lecture 1'''
|Introduction to the roles of journals, editors, and peer review(ers)
|
*Getting to know you
*Role of scientific journals
*Role of editors
*Peer review: history & practice
*Role of peer review (ers)
*Take-home Assignment 1
|-
|'''Lecture 2'''
|Peer review conduct and how to write a helpful, useful review
|
*Sex, gender, & diversity: Considerations & guidelines
*Wrap up: Lecture 1 & Take-home Assignment 1
*Peer review conduct
*Writing tips
*Writing a useful peer review, helpful for both authors and editors
|-
|'''Lecture 3'''
|Publish or perish? A cornucopia of contributions and credit, productivity, publication ethics, and open science
|
*Discussion of take-home assignment #2
*Credit for research contributions
*Measures of scientific productivity
*Predatory journals
*Ethical guidelines for peer review
*Open science
|-
|'''Lecture 4'''
|From theory to practice - Review procedure & walk-through
|
*Peer review: Live walk-through
*Go through homework #3
*Process of being a reviewer
*Manuscript submission systems
*Final workshop preparations, incl. editor-mentor introductions, PaperHive intro & scheduling
*Time permitting: Generative AI in peer review
|}
===Workshops===
Narrative, rationale
*4x à 3 hours (with breaks)
*4 participants per EM
*online
*student-led
*other students contribute in the preparation
*mentor provides guidance while students drive the discussion
*cleanish report at the end
*EM submits to the journal
===Post-Course Assignment (optional)===
==How to Plan a Peerspectives Course==
===Requirements to Run Peerspectives===
==Peerspectives in the Public Eye==
===Publications===
===Talks===
{| class="wikitable"
!Date
!Title (and link, if available)
!Event
!Link(s)
|-
|
|
|
|
|-
|11 Dec, 2024
|
|
|
|-
|01 Nov, 2024
|Berlin Science Week Panel Discussion
Evaluating Researchers: Ambitions and Realities This was a joint event by the Einstein Foundation Award for Promoting Quality in Research, the BIH QUEST Center for Responsible Research, and the Berlin University Alliance, and it was hosted by Dr. Jess Rohmann.
|
|
|-
|18 June, 2024
|Peerspectives on peer review: A crash course on peer review for major biomedical journals for students and early career researchers
Workshop given by Dr. Tobias Kurth, Dr. Jessica Rohmann, Dr. Toivo Glatz, and Timothy Feeney at the 2024 Society for Epidemiologic Research Conference in Austin, Texas
|
|
|-
|03 June, 2024
|Publishing Causal Inference Methods in Applied Clinical Journals - Following the Yellow Brick Road
Turing CIIG Seminar: Dr. Jessica Rohmann
|
|
|-
|22 Feb, 2024
|Peer Review as a Vehicle to Explore the Scientific Publishing Landscape, Improve Quality, and Strengthen Methods Competencies
Stanford METRICS talk by Dr. Jessica Rohmann
|
|
|-
|23 Jan. 2024
|In this interactive workshop, students and early career researchers were introduced to concepts of research quality and open science/access.
Workshop by Noel Kronenberg, Till Adam, Dr. Jessica Rohmann, and Dr. Toivo Glatz.
|
|
|-
|06 Dec. 2022
|Improving quality of peer review reports and strengthening epidemiological methods competencies: perspectives from the Peerspectives program.
Talk by Jess Rohmann at CausaLAB Methods Series
|
|
|-
|06 Dec, 2022
|Perspectives from Peerspectives: Peer review and biomedical editing training initiative for PhD Students
Talk by Dr. Toivo Glatz at the QUEST Seminar on Responsible Research
|
|
|-
|22 Sept, 2022
|Peerspectives: Pe(e)rspectives on Peer-review
Talk given by Jess Rohmann
|
|
|-
|08 Jul, 2022
|Peerspectives: Peer-review training initiative for the biomedical sciences
Poster by Dr. Toivo Glatz for the Open X Conference of the Berlin University Alliance
|
|
|-
|21 Feb, 2020
|Peerspectives: Hands-on peer-review training for PhD students in health data sciences
Poster by Jess Rohmann for the Reward Equator Conference 2020 in Berlin
|
|
|}
==other content==
Given that scientific publications are a primary means of disseminating knowledge and are used to assess research productivity and impact and for the purposes of academic qualifications and hiring decisions (despite many known drawbacks),

Latest revision as of 10:00, 28 August 2025

About this Wiki
This Wiki was designed and intended to provide a template for educators to integrate Peerspectives into their own academic program. In addition to details regarding the purpose, learning objectives, and structure of the course, we also provide the following:
  • Modifiable lecture slides
  • Email templates used to run the course
  • Suggestions for adapting the course to other disciplines or career stages
  • Lessons learned from previous iterations of the course, tested via trial-and-error


Please use the left side panel for navigation, in addition to the search bar at the top of this page.

Logo for the Peerspectives peer-review training initiative

Overview

What is Peerspectives?

Peerspectives is a highly interactive and engaging course that provides researchers with modern training and insights into the structure, purpose, and conduct of the scholarly peer review and editing processes at scientific journals.

How did Peerspectives start?

Peerspectives was originally conceptualized as a semester-long course that offered as an elective course in the structured PhD program in Health Data Sciences at the Charité. Soon after, we expanded our content to suit a wider audience of early career biomedical scientists.

This course can be hosted entirely online and was created with flexibility in mind, making it adaptable to various resource levels, time frames, career stages, and scientific disciplines.

Why should you run Peerspectives?

Scientific journals publish scholarly articles and provide an important platform for transparent presentation, exchange, and discussion of scientific findings and developments. Peer review plays a fundamental role in ensuring integrity and quality in scientific processes. While the scientific peer review process is not without flaws, learning how to conduct high-quality peer review is an invaluable skill for early career researchers (ECRs). In sharp contrast to the enormous emphasis on scientific publications in cumulative publication-based dissertations, peer review training is rarely, if ever, included in graduate training curricula. Peerspectives seeks to address this training gap.

Peerspectives introduces participants to the modern scientific publishing landscape and the actors within this system. The course allows participants to refine their skills in drafting peer review reports and learn about transparency, reproducibility, and the use of modern methods. Additionally, it simultaneously serves to increase awareness of critical systemic issues including biases, favoritism, and scientific misconduct.

Peerspectives strives to equip early-stage researchers with vital career-related skills and provide them with the chance to reflect on quality control and the role of the professional publishing business in science.

Target audience

Peerspectives originated as a training course for doctoral students in the domains of biomedical sciences and population health with prior epidemiology or biostatistics training. Over time, the course expanded to welcome other early career researchers, such as advanced master’s students, and early-stage postdocs.

The course is flexible and can be adapted to different career stages and scientific disciplines. However, for successful implementation, it is important to customize the content and structure to fit the specific needs of the participants. A generic, one-size-fits-all approach may be impractical and could affect the course’s overall quality.

Course objectives

  • Explain the role of scientific journals, editors, and peer reviewers as parts of the scientific process in the field of biomedical sciences
  • Promote clear communication and efficiency in the peer review process
  • Stimulate critical thinking and constructive, scientific critique
  • Encourage transparency and adherence to ethical and methodological guidelines
  • Introduce and explore concepts around open science, open-access publishing, and open peer review
  • Participants will develop an understanding of what peer reviewers and editors are looking for in scientific writing and improve the quality of participants’ future submission

Course Structure

Our complete semester-long hybrid approach to training combines a series of interactive lectures with reflection assignments to promote fruitful group discussions. Once the lecture series has concluded, the course moves onto a series of peer review workshops.  During these workshops, the participants – under the guidance of an experienced editorial mentor –  collaborate in small groups to peer review “live” manuscripts that are currently under consideration at a partnering scientific journal. The Peerspectives approach uniquely allows participants to engage in collaborative peer review in a mentored environment.

Component 1: Lectures

Peerspectives opens with a series of interactive lectures aimed at equipping participants with essential knowledge of editorial processes and the development of scientific peer review. The lecture component of the course spans over four sessions, with each lecture lasting three hours. However, the number of sessions, their duration, and the topics covered can be modified to align with the target audience, lecturer availability, and scheduling needs.

Take-home assignments

Between lectures, participants complete small exercises designed to reinforce concepts from the previous session and engage in preparatory brainstorming for the next lecture’s topics. These take-home assignments are revisited in the following lecture and serve as a foundation for group discussions.

Component 2: Workshops

The second component of Peerspectives consists of workshops, during which participants collaboratively draft and finalize a peer review report under the supervision of a mentor with peer review and (ideally) editorial experience. Workshops are designed to be participant-led, with the role of workshop leader rotating between participants each week. While the mentor provides guidance and can steer the discussion if needed, participants hold the responsibility for reading the manuscript and drafting a review prior to the workshop.  Participants are expected to shape the peer review (1) in line with their individual scientific expertise, and (2) to apply the peer review knowledge developed in the lectures.

Component 3: Reflection

To maximise learning outcomes, we recommend some kind of reflection activity. This can be in the form of a self-assessment of skills, de-briefing with the mentor after the last workshop, or listening in to an editorial meeting or requesting a meeting with the handling editor to inquire about the submitted peer review reports.

Component 4: Pre- and Post-Course Assignments

These assignments serve to gauge the peer review experience and knowledge of participants before and after formal instruction.