Peerspectives: Difference between revisions

From Peerspectives-Wiki
Jump to navigation Jump to search
No edit summary
No edit summary
 
(20 intermediate revisions by the same user not shown)
Line 1: Line 1:
{| class="wikitable mw-collapsible"
!'''<big>About this Wiki</big>'''
|-
|This page was designed to provide a template for educators to integrate Peerspectives into their own academic program. In addition to details regarding the purpose, learning objectives, and structure of the course, we also provide the following:
* Modifiable lecture slides
*Email templates used to run the course
*Suggestions for adapting the course to other disciplines or career stages
*Lessons learned from previous iterations of the course, tested via trial-and-error


__FORCETOC__


'''<big>What is Peerspectives?</big>'''
Please use the left side panel for navigation, in addition to the search bar at the top of this page.
 
|}
Peerspectives is a highly interactive and engaging course that was designed to provide researchers with modern training and insights into the structure, purpose, and conduct of the peer-review and editing processes in scientific journals. Scientific peer review is a crucial pillar of scientific quality control and academic publishing; yet, most scientists never receive formal training on its purpose or conduct.
[[File:Peerspectives logo.png|alt=Logo for the Peerspectives peer-review training initiative|center|300x300px]]
 
==<big>Overview</big>==
'''<big>Structure of the Peerspectives course</big>'''


Peerspectives was designed to be a semester-long course developed for integration into biomedical sciences curricula. It is possibly to run this course entirely online. This course was also designed with flexibility in mind, making it easy to adapt to various resource levels, time frames, and scientific disciplines.
=== '''<big>What is Peerspectives?</big>''' ===
Peerspectives is a highly interactive and engaging '''course''' that was designed to provide researchers with modern training and insights into the '''structure, purpose, and conduct of the peer-review and editing processes in scientific journals'''.  


'''<big>About this Wiki</big>'''
Scientific peer review is a crucial pillar of scientific quality control and academic publishing; yet, most scientists never receive formal training on its purpose or conduct.


This page was designed to provide a template for educators to integrate Peerspectives into their own academic program. In addition to details regarding the purpose, learning objectives, and structure of the course, we also provide the following:
=== '''<big>Structure of the Peerspectives course</big>''' ===
* Modifiable lecture slides
Peerspectives was designed to be a semester-long course developed for integration into graduate biomedical sciences curricula. This course can be hosted entirely online and was designed with flexibility in mind, making it adaptable to various resource levels, time frames, and scientific disciplines.
*Email templates used to run the course
*Adaptation suggestions
*Lessons learned...
==Purpose==
'''About Peer Review'''


=== '''<big>Why should you run Peerspectives?</big>''' ===
Scientific journals publish scholarly articles and provide an important platform for transparent presentation, exchange, and discussion of scientific findings and developments. Peer review plays a fundamental role in ensuring integrity and quality in scientific processes.
Scientific journals publish scholarly articles and provide an important platform for transparent presentation, exchange, and discussion of scientific findings and developments. Peer review plays a fundamental role in ensuring integrity and quality in scientific processes.


Line 32: Line 35:
The course can be readily adapted to other scientific disciplines or career stages. However, when tailoring it for a new context, it is essential to align the content and structure with the specific needs of the target audience.
The course can be readily adapted to other scientific disciplines or career stages. However, when tailoring it for a new context, it is essential to align the content and structure with the specific needs of the target audience.


'''Adapting the course to other scientific disciplines'''
* ''Must tailor the course to a discipline. One-size fits all solutions would be difficult to work with and would make the quality of the course suffer''
 
'''Adapting the course to other career stages'''


Must tailor the course to a discipline. One-size fits all solutions would be difficult to work with and would make the quality of the course suffer
==Learning Outcomes of the Course==
==Learning Outcomes of the Course==
*Explain the role of scientific journals, editors, and peer reviewers as parts of the scientific process in biomedical fields
*Explain the role of scientific journals, editors, and peer reviewers as parts of the scientific process in biomedical fields
Line 45: Line 45:
* Develop an understanding of what reviewers and editors are looking for in scientific writing and improve the quality of participants’ future submission
* Develop an understanding of what reviewers and editors are looking for in scientific writing and improve the quality of participants’ future submission
==Course Structure==
==Course Structure==
Our semester-long hybrid approach to training combines a series of interactive lectures with reflection assignments to promote fruitful group discussions followed by hands-on workshops, in which students work together in small groups to review “live” manuscripts from a partnering scientific journal under the guidance of an experienced mentor with editing experience. Unlike existing peer review training workshops, our approach integrates participants into collaborative peer review in a mentored environment.
Our semester-long hybrid approach to training combines a series of interactive lectures with reflection assignments to promote fruitful group discussions. Once the lectures are complete, students attend workshops, where they collaborate in small groups to review “live” manuscripts from a partnering scientific journal under the guidance of an experienced mentor with editing experience. The Peerspectives approach uniquely integrates participants into collaborative peer review in a mentored environment.
===Pre-Course Assignment (optional)===*good exercise for people to realize what they dont know, see growth
===Block 1: [[Lectures]]===
===Lectures===
Narrative + rationale
The course begins with 4, three-hour long lectures
 
==== Homework assignments ====
Narrative + rationale


Homework assignments + rationale
Homework assignments are discussed and reviewed during each lecture.  
*4x à 3 hours (with breaks)
===Block 2: [[Workshops]]===
*On Zoom, includes interactive polls, discussions & take-home assignment
{| class="wikitable mw-collapsible"
|+Lecture Topics (+ slides)
!
!Title '''(+ slides in hyperlink)'''
!Topics Covered
|-
|'''Lecture 1'''
|Introduction to the roles of journals, editors, and peer review(ers)
|
*Getting to know you
*Role of scientific journals
*Role of editors
*Peer review: history & practice
*Role of peer review (ers)
*Take-home Assignment 1
|-
| '''Lecture 2'''
|Peer review conduct and how to write a helpful, useful review
|
*Sex, gender, & diversity: Considerations & guidelines
*Wrap up: Lecture 1 & Take-home Assignment 1
*Peer review conduct
*Writing tips
* Writing a useful peer review, helpful for both authors and editors
|-
|'''Lecture 3'''
|Publish or perish? A cornucopia of contributions and credit, productivity, publication ethics, and open science
|
*Discussion of take-home assignment #2
*Credit for research contributions
*Measures of scientific productivity
* Predatory journals
*Ethical guidelines for peer review
*Open science
|-
|'''Lecture 4'''
|From theory to practice - Review procedure & walk-through
|
*Peer review: Live walk-through
*Go through homework #3
*Process of being a reviewer
*Manuscript submission systems
*Final workshop preparations, incl. editor-mentor introductions, PaperHive intro & scheduling
*Time permitting: Generative AI in peer review
|}
===Workshops===
Narrative, rationale
Narrative, rationale
*4x à 3 hours (with breaks)
*4x à 3 hours (with breaks)
Line 108: Line 63:
*cleanish report at the end
*cleanish report at the end
*EM submits to the journal
*EM submits to the journal
===Post-Course Assignment (optional)===
===[[Pre- and Post-Course Assignments]] (optional)===
==How to Plan a Peerspectives Course==
These assignments are a good exercise for participants to understand the complexity of a peer review before formal instruction, and see growth from the beginning to the end of the course.
=== Requirements to Run Peerspectives===
__NOTOC__
== Peerspectives in the Public Eye==
===Publications===
===Talks===
{| class="wikitable"
!Date
! Title (and link, if available)
! Event
!Link(s)
|-
|
|
|
|
|-
|11 Dec, 2024
|
|
|
|-
|01 Nov, 2024
|Berlin Science Week Panel Discussion
Evaluating Researchers: Ambitions and Realities This was a joint event by the Einstein Foundation Award for Promoting Quality in Research, the BIH QUEST Center for Responsible Research, and the Berlin University Alliance, and it was hosted by Dr. Jess Rohmann.
|
|
|-
|18 June, 2024
|Peerspectives on peer review: A crash course on peer review for major biomedical journals for students and early career researchers
Workshop given by Dr. Tobias Kurth, Dr. Jessica Rohmann, Dr. Toivo Glatz, and Timothy Feeney at the 2024 Society for Epidemiologic Research Conference in Austin, Texas
|
|
|-
|03 June, 2024
|Publishing Causal Inference Methods in Applied Clinical Journals - Following the Yellow Brick Road
Turing CIIG Seminar: Dr. Jessica Rohmann
|
|
|-
|22 Feb, 2024
|Peer Review as a Vehicle to Explore the Scientific Publishing Landscape, Improve Quality, and Strengthen Methods Competencies
Stanford METRICS talk by Dr. Jessica Rohmann
|
|
|-
|23 Jan. 2024
|In this interactive workshop, students and early career researchers were introduced to concepts of research quality and open science/access.
Workshop by Noel Kronenberg, Till Adam, Dr. Jessica Rohmann, and Dr. Toivo Glatz.
|
|
|-
| 06 Dec. 2022
|Improving quality of peer review reports and strengthening epidemiological methods competencies: perspectives from the Peerspectives program.
Talk by Jess Rohmann at CausaLAB Methods Series
|
|
|-
|06 Dec, 2022
|Perspectives from Peerspectives: Peer review and biomedical editing training initiative for PhD Students
Talk by Dr. Toivo Glatz at the QUEST Seminar on Responsible Research
|
|
|-
|22 Sept, 2022
|Peerspectives: Pe(e)rspectives on Peer-review
Talk given by Jess Rohmann
|
|
|-
|08 Jul, 2022
|Peerspectives: Peer-review training initiative for the biomedical sciences
Poster by Dr. Toivo Glatz for the Open X Conference of the Berlin University Alliance
|
|
|-
|21 Feb, 2020
|Peerspectives: Hands-on peer-review training for PhD students in health data sciences
Poster by Jess Rohmann for the Reward Equator Conference 2020 in Berlin
|
|
|}
==other content==
Given that scientific publications are a primary means of disseminating knowledge and are used to assess research productivity and impact and for the purposes of academic qualifications and hiring decisions (despite many known drawbacks),

Latest revision as of 16:23, 17 February 2025

About this Wiki
This page was designed to provide a template for educators to integrate Peerspectives into their own academic program. In addition to details regarding the purpose, learning objectives, and structure of the course, we also provide the following:
  • Modifiable lecture slides
  • Email templates used to run the course
  • Suggestions for adapting the course to other disciplines or career stages
  • Lessons learned from previous iterations of the course, tested via trial-and-error


Please use the left side panel for navigation, in addition to the search bar at the top of this page.

Logo for the Peerspectives peer-review training initiative

Overview

What is Peerspectives?

Peerspectives is a highly interactive and engaging course that was designed to provide researchers with modern training and insights into the structure, purpose, and conduct of the peer-review and editing processes in scientific journals.

Scientific peer review is a crucial pillar of scientific quality control and academic publishing; yet, most scientists never receive formal training on its purpose or conduct.

Structure of the Peerspectives course

Peerspectives was designed to be a semester-long course developed for integration into graduate biomedical sciences curricula. This course can be hosted entirely online and was designed with flexibility in mind, making it adaptable to various resource levels, time frames, and scientific disciplines.

Why should you run Peerspectives?

Scientific journals publish scholarly articles and provide an important platform for transparent presentation, exchange, and discussion of scientific findings and developments. Peer review plays a fundamental role in ensuring integrity and quality in scientific processes.

Despite a lack of formal training in peer review, scientists are expected to contribute to,  Peerspectives is an initiative that addresses this training gap.

While the scientific peer review process is not without flaws, learning how to conduct high-quality peer review is an invaluable skill for early career researchers (ECRs). In sharp contrast to the enormous (albeit controversial) emphasis on scientific publications in cumulative publication-based dissertations, university incentive structures and in career trajectories in academia, peer review training opportunities are rarely, if ever, including in graduate training curricula. This motivation drove us to create the Peerspectives peer review training program for PhD students and other ECRs in the biomedical sciences. Peerspectives introduces participants to the modern scientific publishing landscape and the actors within this system. The course allows students to refine their skills in drafting peer review reports and learn about transparency, reproducibility, and the use of modern methods. Additionally, it simultaneously serves to increase awareness of critical systemic issues including biases, favoritism, and scientific misconduct

Peerspectives strives to equip early-stage researchers with vital career-related skills and provide them with the chance to reflect on quality control and the role of the professional publishing business in science.

Target Audience

Peerspectives originated as a training course for doctoral students in the domains of (bio)medical sciences and population health with prior epidemiology or biostatistics training. Over time, the course expanded to welcome other early career researchers, such as advanced master’s students and early-stage postdocs, who have also been very successful and valuable contributors to the course.

The course can be readily adapted to other scientific disciplines or career stages. However, when tailoring it for a new context, it is essential to align the content and structure with the specific needs of the target audience.

  • Must tailor the course to a discipline. One-size fits all solutions would be difficult to work with and would make the quality of the course suffer

Learning Outcomes of the Course

  • Explain the role of scientific journals, editors, and peer reviewers as parts of the scientific process in biomedical fields
  • Promote clear communication and efficiency in the review process
  • Stimulate critical thinking and constructive, scientific critique
  • Encourage transparency and adherence to ethical and methodological guidelines
  • Introduce and explore open-access, open science, and open review concepts
  • Develop an understanding of what reviewers and editors are looking for in scientific writing and improve the quality of participants’ future submission

Course Structure

Our semester-long hybrid approach to training combines a series of interactive lectures with reflection assignments to promote fruitful group discussions. Once the lectures are complete, students attend workshops, where they collaborate in small groups to review “live” manuscripts from a partnering scientific journal under the guidance of an experienced mentor with editing experience. The Peerspectives approach uniquely integrates participants into collaborative peer review in a mentored environment.

Block 1: Lectures

Narrative + rationale

Homework assignments

Narrative + rationale

Homework assignments are discussed and reviewed during each lecture.

Block 2: Workshops

Narrative, rationale

  • 4x à 3 hours (with breaks)
  • 4 participants per EM
  • online
  • student-led
  • other students contribute in the preparation
  • mentor provides guidance while students drive the discussion
  • cleanish report at the end
  • EM submits to the journal

Pre- and Post-Course Assignments (optional)

These assignments are a good exercise for participants to understand the complexity of a peer review before formal instruction, and see growth from the beginning to the end of the course.