WorldWideScience

Sample records for high-quality peer-reviewed research

  1. Understanding Peer Review of Scientific Research

    Science.gov (United States)

    Association of American Universities, 2011

    2011-01-01

    An important factor in the success of America's national research system is that federal funds for university-based research are awarded primarily through peer review, which uses panels of scientific experts, or "peers," to evaluate the quality of grant proposals. In this competitive process, proposals compete for resources based on their…

  2. Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals.

    Science.gov (United States)

    Wicherts, Jelte M

    2016-01-01

    Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process. Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals' websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors' ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal's impact factors. In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well. In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar. The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

  3. Research Integrity and Peer Review-past highlights and future directions.

    Science.gov (United States)

    Boughton, Stephanie L; Kowalczuk, Maria K; Meerpohl, Joerg J; Wager, Elizabeth; Moylan, Elizabeth C

    2018-01-01

    In May 2016, we launched Research Integrity and Peer Review , an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions.

  4. Does mentoring new peer reviewers improve review quality? A randomized trial

    Directory of Open Access Journals (Sweden)

    Houry Debra

    2012-08-01

    Full Text Available Abstract Background Prior efforts to train medical journal peer reviewers have not improved subsequent review quality, although such interventions were general and brief. We hypothesized that a manuscript-specific and more extended intervention pairing new reviewers with high-quality senior reviewers as mentors would improve subsequent review quality. Methods Over a four-year period we randomly assigned all new reviewers for Annals of Emergency Medicine to receive our standard written informational materials alone, or these materials plus a new mentoring intervention. For this program we paired new reviewers with a high-quality senior reviewer for each of their first three manuscript reviews, and asked mentees to discuss their review with their mentor by email or phone. We then compared the quality of subsequent reviews between the control and intervention groups, using linear mixed effects models of the slopes of review quality scores over time. Results We studied 490 manuscript reviews, with similar baseline characteristics between the 24 mentees who completed the trial and the 22 control reviewers. Mean quality scores for the first 3 reviews on our 1 to 5 point scale were similar between control and mentee groups (3.4 versus 3.5, as were slopes of change of review scores (-0.229 versus -0.549 and all other secondary measures of reviewer performance. Conclusions A structured training intervention of pairing newly recruited medical journal peer reviewers with senior reviewer mentors did not improve the quality of their subsequent reviews.

  5. Same review quality in open versus blinded peer review in "Ugeskrift for Læger"

    DEFF Research Database (Denmark)

    Vinther, Siri; Nielsen, Ole Haagen; Rosenberg, Jacob

    2012-01-01

    Research into the peer review process has previously been conducted in English-language journals. This study deals with a Danish general medical journal with a relatively small pool of both reviewers and readers. The aim of the study was to compare the quality of reviews produced by identifiable...... and anonymous reviewers, and further to characterize authors' and reviewers' attitudes towards different peer review systems....

  6. Quality assurance in radiology: peer review and peer feedback

    International Nuclear Information System (INIS)

    Strickland, N.H.

    2015-01-01

    Peer review in radiology means an assessment of the accuracy of a report issued by another radiologist. Inevitably, this involves a judgement opinion from the reviewing radiologist. Peer feedback is the means by which any form of peer review is communicated back to the original author of the report. This article defines terms, discusses the current status, identifies problems, and provides some recommendations as to the way forward, concentrating upon the software requirements for efficient peer review and peer feedback of reported imaging studies. Radiologists undertake routine peer review in their everyday clinical practice, particularly when reporting and preparing for multidisciplinary team meetings. More formal peer review of reported imaging studies has been advocated as a quality assurance measure to promote good clinical practice. It is also a way of assessing the competency of reporting radiologists referred for investigation to bodies such as the General Medical Council (GMC). The literature shows, firstly, that there is a very wide reported range of discrepancy rates in many studies, which have used a variety of non-comparable methodologies; and secondly, that applying scoring systems in formal peer review is often meaningless, unhelpful, and can even be detrimental. There is currently a lack of electronic peer feedback system software on the market to inform radiologists of any review of their work that has occurred or to provide them with clinical outcome information on cases they have previously reported. Learning opportunities are therefore missed. Radiologists should actively engage with the medical informatics industry to design optimal peer review and feedback software with features to meet their needs. Such a system should be easy to use, be fully integrated with the radiological information and picture archiving systems used clinically, and contain a free-text comment box, without a numerical scoring system. It should form a temporary record

  7. Quality Control and Peer Review of Data Sets: Mapping Data Archiving Processes to Data Publication Requirements

    Science.gov (United States)

    Mayernik, M. S.; Daniels, M.; Eaker, C.; Strand, G.; Williams, S. F.; Worley, S. J.

    2012-12-01

    Data sets exist within scientific research and knowledge networks as both technical and non-technical entities. Establishing the quality of data sets is a multi-faceted task that encompasses many automated and manual processes. Data sets have always been essential for science research, but now need to be more visible as first-class scholarly objects at national, international, and local levels. Many initiatives are establishing procedures to publish and curate data sets, as well as to promote professional rewards for researchers that collect, create, manage, and preserve data sets. Traditionally, research quality has been assessed by peer review of textual publications, e.g. journal articles, conference proceedings, and books. Citation indices then provide standard measures of productivity used to reward individuals for their peer-reviewed work. Whether a similar peer review process is appropriate for assessing and ensuring the quality of data sets remains as an open question. How does the traditional process of peer review apply to data sets? This presentation will describe current work being done at the National Center for Atmospheric Research (NCAR) in the context of the Peer REview for Publication & Accreditation of Research Data in the Earth sciences (PREPARDE) project. PREPARDE is assessing practices and processes for data peer review, with the goal of developing recommendations. NCAR data management teams perform various kinds of quality assessment and review of data sets prior to making them publicly available. The poster will investigate how notions of peer review relate to the types of data review already in place at NCAR. We highlight the data set characteristics and management/archiving processes that challenge the traditional peer review processes by using a number of questions as probes, including: Who is qualified to review data sets? What formal and informal documentation is necessary to allow someone outside of a research team to review a data set

  8. The relationship of previous training and experience of journal peer reviewers to subsequent review quality.

    Directory of Open Access Journals (Sweden)

    Michael L Callaham

    2007-01-01

    Full Text Available BACKGROUND: Peer review is considered crucial to the selection and publication of quality science, but very little is known about the previous experiences and training that might identify high-quality peer reviewers. The reviewer selection processes of most journals, and thus the qualifications of their reviewers, are ill defined. More objective selection of peer reviewers might improve the journal peer review process and thus the quality of published science. METHODS AND FINDINGS: 306 experienced reviewers (71% of all those associated with a specialty journal completed a survey of past training and experiences postulated to improve peer review skills. Reviewers performed 2,856 reviews of 1,484 separate manuscripts during a four-year study period, all prospectively rated on a standardized quality scale by editors. Multivariable analysis revealed that most variables, including academic rank, formal training in critical appraisal or statistics, or status as principal investigator of a grant, failed to predict performance of higher-quality reviews. The only significant predictors of quality were working in a university-operated hospital versus other teaching environment and relative youth (under ten years of experience after finishing training. Being on an editorial board and doing formal grant (study section review were each predictors for only one of our two comparisons. However, the predictive power of all variables was weak. CONCLUSIONS: Our study confirms that there are no easily identifiable types of formal training or experience that predict reviewer performance. Skill in scientific peer review may be as ill defined and hard to impart as is "common sense." Without a better understanding of those skills, it seems unlikely journals and editors will be successful in systematically improving their selection of reviewers. This inability to predict performance makes it imperative that all but the smallest journals implement routine review ratings

  9. Quality assurance in radiology: peer review and peer feedback.

    Science.gov (United States)

    Strickland, N H

    2015-11-01

    Peer review in radiology means an assessment of the accuracy of a report issued by another radiologist. Inevitably, this involves a judgement opinion from the reviewing radiologist. Peer feedback is the means by which any form of peer review is communicated back to the original author of the report. This article defines terms, discusses the current status, identifies problems, and provides some recommendations as to the way forward, concentrating upon the software requirements for efficient peer review and peer feedback of reported imaging studies. Radiologists undertake routine peer review in their everyday clinical practice, particularly when reporting and preparing for multidisciplinary team meetings. More formal peer review of reported imaging studies has been advocated as a quality assurance measure to promote good clinical practice. It is also a way of assessing the competency of reporting radiologists referred for investigation to bodies such as the General Medical Council (GMC). The literature shows, firstly, that there is a very wide reported range of discrepancy rates in many studies, which have used a variety of non-comparable methodologies; and secondly, that applying scoring systems in formal peer review is often meaningless, unhelpful, and can even be detrimental. There is currently a lack of electronic peer feedback system software on the market to inform radiologists of any review of their work that has occurred or to provide them with clinical outcome information on cases they have previously reported. Learning opportunities are therefore missed. Radiologists should actively engage with the medical informatics industry to design optimal peer review and feedback software with features to meet their needs. Such a system should be easy to use, be fully integrated with the radiological information and picture archiving systems used clinically, and contain a free-text comment box, without a numerical scoring system. It should form a temporary record

  10. Peer Review Improves the Quality of MCQ Examinations

    Science.gov (United States)

    Malau-Aduli, Bunmi S.; Zimitat, Craig

    2012-01-01

    The aim of this study was to assess the effect of the introduction of peer review processes on the quality of multiple-choice examinations in the first three years of an Australian medical course. The impact of the peer review process and overall quality assurance (QA) processes were evaluated by comparing the examination data generated in earlier…

  11. Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency.

    Science.gov (United States)

    Shepherd, Jonathan; Frampton, Geoff K; Pickett, Karen; Wyatt, Jeremy C

    2018-01-01

    To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review 'innovations'. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact on effectiveness, efficiency and quality.

  12. Peer review of health research funding proposals: A systematic map and systematic review of innovations for effectiveness and efficiency

    Science.gov (United States)

    Frampton, Geoff K.; Pickett, Karen; Wyatt, Jeremy C.

    2018-01-01

    Objective To investigate methods and processes for timely, efficient and good quality peer review of research funding proposals in health. Methods A two-stage evidence synthesis: (1) a systematic map to describe the key characteristics of the evidence base, followed by (2) a systematic review of the studies stakeholders prioritised as relevant from the map on the effectiveness and efficiency of peer review ‘innovations’. Standard processes included literature searching, duplicate inclusion criteria screening, study keyword coding, data extraction, critical appraisal and study synthesis. Results A total of 83 studies from 15 countries were included in the systematic map. The evidence base is diverse, investigating many aspects of the systems for, and processes of, peer review. The systematic review included eight studies from Australia, Canada, and the USA, evaluating a broad range of peer review innovations. These studies showed that simplifying the process by shortening proposal forms, using smaller reviewer panels, or expediting processes can speed up the review process and reduce costs, but this might come at the expense of peer review quality, a key aspect that has not been assessed. Virtual peer review using videoconferencing or teleconferencing appears promising for reducing costs by avoiding the need for reviewers to travel, but again any consequences for quality have not been adequately assessed. Conclusions There is increasing international research activity into the peer review of health research funding. The studies reviewed had methodological limitations and variable generalisability to research funders. Given these limitations it is not currently possible to recommend immediate implementation of these innovations. However, many appear promising based on existing evidence, and could be adapted as necessary by funders and evaluated. Where feasible, experimental evaluation, including randomised controlled trials, should be conducted, evaluating impact

  13. Peer review quality and transparency of the peer-review process in open access and subscription journals

    NARCIS (Netherlands)

    Wicherts, J.M.

    2016-01-01

    Background Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the

  14. Improving the peer review skills of young rheumatologists and researchers in rheumatology: the EMEUNET Peer Review Mentoring Program.

    Science.gov (United States)

    Rodríguez-Carrio, Javier; Putrik, Polina; Sepriano, Alexandre; Moltó, Anna; Nikiphorou, Elena; Gossec, Laure; Kvien, Tore K; Ramiro, Sofia

    2018-01-01

    Although peer review plays a central role in the maintenance of high standards in scientific research, training of reviewing skills is not included in the common education programmes. The Emerging EULAR (European League Against Rheumatism) Network (EMEUNET) developed a programme to address this unmet need. The EMEUNET Peer Review Mentoring Program for Rheumatology Journals promotes a systematic training of reviewing skills by engaging mentees in a 'real world' peer review experience supervised by experienced mentors with support from rheumatology journals. This viewpoint provides an overview of this initiative and its outcomes, and discusses its potential limitations. Over 4 years, 18 mentors and 86 mentees have participated. Among the 33 participants who have completed the programme, 13 (39.3%) have become independent reviewers for Annals of the Rheumatic Diseases after the training. This programme has been recently evaluated by a survey and qualitative interviews, revealing a high interest in this initiative. The main strengths (involvement of a top journal and learning opportunities) and weaknesses of the programme (limited number of places and insufficient dissemination) were identified. Overall, this programme represents an innovative and successful approach to peer review training. Continuous evaluation and improvement are key to its functioning. The EMEUNET Peer Review Mentoring Program may be used as a reference for peer review training in areas outside rheumatology.

  15. Research funding. Big names or big ideas: do peer-review panels select the best science proposals?

    Science.gov (United States)

    Li, Danielle; Agha, Leila

    2015-04-24

    This paper examines the success of peer-review panels in predicting the future quality of proposed research. We construct new data to track publication, citation, and patenting outcomes associated with more than 130,000 research project (R01) grants funded by the U.S. National Institutes of Health from 1980 to 2008. We find that better peer-review scores are consistently associated with better research outcomes and that this relationship persists even when we include detailed controls for an investigator's publication history, grant history, institutional affiliations, career stage, and degree types. A one-standard deviation worse peer-review score among awarded grants is associated with 15% fewer citations, 7% fewer publications, 19% fewer high-impact publications, and 14% fewer follow-on patents. Copyright © 2015, American Association for the Advancement of Science.

  16. The "peer" in "peer review"

    Science.gov (United States)

    Perry, Gad; Bertoluci, Jaime; Bury, R. Bruce; Hansen, Robert W.; Jehle, Robert; Measey, John; Moon, Brad R.; Muths, Erin L.; Zuffi, Marco A.L.

    2011-01-01

    Peer review is the best available mechanism for assessing and improving the quality of scientific work. As herpetology broadens its disciplinary and geographic boundaries, high-quality external review is ever more essential. We are writing this editorial jointly because the review process has become increasingly difficult. The resulting delays slow publication times, negatively affect performance reviews, tenure, promotions, and grant proposal success. It harms authors, agencies, and institutions (Ware 2011).

  17. 7 CFR 3400.21 - Scientific peer review for research activities.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Scientific peer review for research activities. 3400... STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Peer and Merit Review Arranged by Grantees § 3400.21 Scientific peer review for research...

  18. Quality Assurance for Distance Education: A Faculty Peer Review Process.

    Science.gov (United States)

    Ross, Kathryn R.; Batzer, Lyn; Bennington, Elaine

    2002-01-01

    Discusses the need for quality assurance in distance education; describes evaluation criteria; and reports how Ivy Tech State College (Indiana) created a peer review process as a formative evaluation tool to assure the quality of its distance education courses. Explains roles of the participants and evaluation of the peer review prototype. (LRW)

  19. The Peer Review Process: An Expanded Role for Repositories

    Directory of Open Access Journals (Sweden)

    Joanna Richardson

    2014-02-01

    Full Text Available Peer review has been regarded as a cornerstone of scientific research for a considerable time. Journals seeking to attract high quality scholarship rely on peer review to maintain their credentials in the publishing industry. However, over a period of time—and especially given the advent of the Internet—complaints have arisen from authors, reviewers and even editors as to the efficacy of the system. The authors outline a range of models which have evolved that either complement or replace evaluation processes which characterise traditional peer review. Research data is presented in the context of quality assessment. The authors introduce several approaches which are utilising repositories to support the process. Consideration is given as to how this might change the current institutional repository environment.

  20. Qualitative Study to improve integrity of NET : Perspectives of Peer review and Authorship in research ethics

    International Nuclear Information System (INIS)

    Kwon, Hyuk; Min, Byung Joo

    2007-01-01

    After Dr. Hwang's Human embryonic stem cell scandal, research ethics stood out as the hot issue in both Korean scientific circles and general public. Science Publishing Group referred the limitation of peer review system and the absence of responsibility of author to one of the causes for the scandal. In order to prevent a similar fraud, Ministry of Science and Technology(MOST) established guidelines for research ethics and integrity in 2006. The guidelines included fabrication, falsification, and plagiarism(FFP) and unfair authorship. MOST committed the authority of administration and supervision to the society and the institutes of research to preserve the research integrity. The society and institute are charged with overseeing the implementation of enacted ethics guidelines. SCI(Scientific Citation Index) holds the guideline of research ethics and canon of the society which were crafted in order to guaranty the integrity and quality of the research. The publication policy pertains submission of articles, authorship and responsibilities of a reviewer. Societies pay attention to the peer review policy because the quality of articles is strongly dependent on the peer review. Nuclear Engineering and Technology (NET) is the journal of Korea Nuclear Society(KNS). NET is registered with SCIE(Science Citation Index Expanded), recently. In addition to the growth in external circulation, the improvement of quality requires the effort of the society to establish a strict peer review system and a fair authorship. The qualitative study on peer review and authorship of NET was put into force to improve the quality of NET. Based on studies and suggestions, the policy focuses on research ethics to improve the integrity of NET

  1. Qualitative Study to improve integrity of NET : Perspectives of Peer review and Authorship in research ethics

    Energy Technology Data Exchange (ETDEWEB)

    Kwon, Hyuk; Min, Byung Joo [Korea Atomic Energy Research Institute, Daejeon (Korea, Republic of)

    2007-10-15

    After Dr. Hwang's Human embryonic stem cell scandal, research ethics stood out as the hot issue in both Korean scientific circles and general public. Science Publishing Group referred the limitation of peer review system and the absence of responsibility of author to one of the causes for the scandal. In order to prevent a similar fraud, Ministry of Science and Technology(MOST) established guidelines for research ethics and integrity in 2006. The guidelines included fabrication, falsification, and plagiarism(FFP) and unfair authorship. MOST committed the authority of administration and supervision to the society and the institutes of research to preserve the research integrity. The society and institute are charged with overseeing the implementation of enacted ethics guidelines. SCI(Scientific Citation Index) holds the guideline of research ethics and canon of the society which were crafted in order to guaranty the integrity and quality of the research. The publication policy pertains submission of articles, authorship and responsibilities of a reviewer. Societies pay attention to the peer review policy because the quality of articles is strongly dependent on the peer review. Nuclear Engineering and Technology (NET) is the journal of Korea Nuclear Society(KNS). NET is registered with SCIE(Science Citation Index Expanded), recently. In addition to the growth in external circulation, the improvement of quality requires the effort of the society to establish a strict peer review system and a fair authorship. The qualitative study on peer review and authorship of NET was put into force to improve the quality of NET. Based on studies and suggestions, the policy focuses on research ethics to improve the integrity of NET.

  2. Peer review for high-level nuclear waste repositories: Generic technical position

    International Nuclear Information System (INIS)

    Altman, W.D.; Donnelly, J.P.; Kennedy, J.E.

    1988-02-01

    This document provides guidance on the use of the peer review process in the high-level nuclear waste repository program. The applicant must demonstrate in the license application that the applicable health, safety, and environmental regulations in 10 CFR Part 60 have been met. Confidence in the data used to support the license application is obtained through a quality assurance (AQ) program. Peer reviews may be used as part of the QA actions necessary to provide adequate confidence in the work being reviewed. Because of several unique conditions inherent to the geologic repository program, expert judgment will need to be utilized in assessing the adequacy of work. Peer reviews are a mechanism by which these judgments may be made. This document provides guidance on areas where a peer review is appropriate, the acceptability of peers, and the conduct and documentation of a peer review

  3. Peer Portal: Quality Enhancement in Thesis Writing Using Self-Managed Peer Review on a Mass Scale

    Science.gov (United States)

    Aghaee, Naghmeh; Hansson, Henrik

    2013-01-01

    This paper describes a specially developed online peer-review system, the Peer Portal, and the first results of its use for quality enhancement of bachelor's and master's thesis manuscripts. The peer-review system is completely student driven and therefore saves time for supervisors and creates a direct interaction between students without…

  4. Information Quality in Regulatory Decision Making: Peer Review versus Good Laboratory Practice.

    Science.gov (United States)

    McCarty, Lynn S; Borgert, Christopher J; Mihaich, Ellen M

    2012-07-01

    There is an ongoing discussion on the provenance of toxicity testing data regarding how best to ensure its validity and credibility. A central argument is whether journal peer-review procedures are superior to Good Laboratory Practice (GLP) standards employed for compliance with regulatory mandates. We sought to evaluate the rationale for regulatory decision making based on peer-review procedures versus GLP standards. We examined pertinent published literature regarding how scientific data quality and validity are evaluated for peer review, GLP compliance, and development of regulations. Some contend that peer review is a coherent, consistent evaluative procedure providing quality control for experimental data generation, analysis, and reporting sufficient to reliably establish relative merit, whereas GLP is seen as merely a tracking process designed to thwart investigator corruption. This view is not supported by published analyses pointing to subjectivity and variability in peer-review processes. Although GLP is not designed to establish relative merit, it is an internationally accepted quality assurance, quality control method for documenting experimental conduct and data. Neither process is completely sufficient for establishing relative scientific soundness. However, changes occurring both in peer-review processes and in regulatory guidance resulting in clearer, more transparent communication of scientific information point to an emerging convergence in ensuring information quality. The solution to determining relative merit lies in developing a well-documented, generally accepted weight-of-evidence scheme to evaluate both peer-reviewed and GLP information used in regulatory decision making where both merit and specific relevance inform the process.

  5. Training Effects on Computer-Mediated Peer Review

    Science.gov (United States)

    Liou, Hsien-Chin; Peng, Zhong-Yan

    2009-01-01

    The interactive functions of weblogs facilitate computer-mediated peer reviews for collaborative writing. As limited research has been conducted on examining the training effects of peer reviews on students' peer comments, their revision quality, and their perceptions when composing in weblogs, the present case study aims to fill the gap. Thirteen…

  6. Random Versus Nonrandom Peer Review: A Case for More Meaningful Peer Review.

    Science.gov (United States)

    Itri, Jason N; Donithan, Adam; Patel, Sohil H

    2018-05-10

    Random peer review programs are not optimized to discover cases with diagnostic error and thus have inherent limitations with respect to educational and quality improvement value. Nonrandom peer review offers an alternative approach in which diagnostic error cases are targeted for collection during routine clinical practice. The objective of this study was to compare error cases identified through random and nonrandom peer review approaches at an academic center. During the 1-year study period, the number of discrepancy cases and score of discrepancy were determined from each approach. The nonrandom peer review process collected 190 cases, of which 60 were scored as 2 (minor discrepancy), 94 as 3 (significant discrepancy), and 36 as 4 (major discrepancy). In the random peer review process, 1,690 cases were reviewed, of which 1,646 were scored as 1 (no discrepancy), 44 were scored as 2 (minor discrepancy), and none were scored as 3 or 4. Several teaching lessons and quality improvement measures were developed as a result of analysis of error cases collected through the nonrandom peer review process. Our experience supports the implementation of nonrandom peer review as a replacement to random peer review, with nonrandom peer review serving as a more effective method for collecting diagnostic error cases with educational and quality improvement value. Copyright © 2018 American College of Radiology. Published by Elsevier Inc. All rights reserved.

  7. Researcher perspectives on publication and peer review of data.

    Directory of Open Access Journals (Sweden)

    John Ernest Kratz

    Full Text Available Data "publication" seeks to appropriate the prestige of authorship in the peer-reviewed literature to reward researchers who create useful and well-documented datasets. The scholarly communication community has embraced data publication as an incentive to document and share data. But, numerous new and ongoing experiments in implementation have not yet resolved what a data publication should be, when data should be peer-reviewed, or how data peer review should work. While researchers have been surveyed extensively regarding data management and sharing, their perceptions and expectations of data publication are largely unknown. To bring this important yet neglected perspective into the conversation, we surveyed ∼ 250 researchers across the sciences and social sciences- asking what expectations"data publication" raises and what features would be useful to evaluate the trustworthiness, evaluate the impact, and enhance the prestige of a data publication. We found that researcher expectations of data publication center on availability, generally through an open database or repository. Few respondents expected published data to be peer-reviewed, but peer-reviewed data enjoyed much greater trust and prestige. The importance of adequate metadata was acknowledged, in that almost all respondents expected data peer review to include evaluation of the data's documentation. Formal citation in the reference list was affirmed by most respondents as the proper way to credit dataset creators. Citation count was viewed as the most useful measure of impact, but download count was seen as nearly as valuable. These results offer practical guidance for data publishers seeking to meet researcher expectations and enhance the value of published data.

  8. Application of project design peer review to improve quality assurance

    International Nuclear Information System (INIS)

    McClure, F.E.

    1989-01-01

    DOE ORDER 5481.1B Safety Analysis and Review Systems and DOE ORDER 6430.1A General Design Criteria require that the design of facilities shall incorporate the necessary Quality Assurance review requirements to assure that the established program quality assurance objectives are met in the design criteria and the construction documents. The use of Project Design Peer Review to satisfy these requirements is presented. The University of California manages the Lawrence Berkeley Laboratory, the Lawrence Livermore National Laboratory, and the Los Alamos National Scientific Laboratory. The 1988 University Seismic Safety Policy requires the use of independent Project Design Peer Review in its capital improvement and seismic reconstruction program

  9. Using Calibrated Peer Review to Teach Basic Research Skills

    Science.gov (United States)

    Bracke, Marianne S.; Graveel, John G.

    2014-01-01

    Calibrated Peer Review (CPR) is an online tool being used in the class Introduction to Agriculture and Purdue University (AGR 10100) to integrate a writing and research component (http://cpr.molsci.ucla.edu/Home.aspx). Calibrated Peer Review combines the ability to create writing intensive assignments with an introduction to the peer-review…

  10. How peer-review constrains cognition

    DEFF Research Database (Denmark)

    Cowley, Stephen

    2015-01-01

    Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as ‘cognit......Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far...

  11. Telemedicine-based system for quality management and peer review in radiology.

    Science.gov (United States)

    Morozov, Sergey; Guseva, Ekaterina; Ledikhova, Natalya; Vladzymyrskyy, Anton; Safronov, Dmitry

    2018-06-01

    Quality assurance is the key component of modern radiology. A telemedicine-based quality assurance system helps to overcome the "scoring" approach and makes the quality control more accessible and objective. A concept for quality assurance in radiology is developed. Its realization is a set of strategies, actions, and tools. The latter is based on telemedicine-based peer review of 23,199 computed tomography (CT) and magnetic resonance imaging (MRI) images. The conception of the system for quality management in radiology represents a chain of actions: "discrepancies evaluation - routine support - quality improvement activity - discrepancies evaluation". It is realized by an audit methodology, telemedicine, elearning, and other technologies. After a year of systemic telemedicine-based peer reviews, the authors have estimated that clinically significant discrepancies were detected in 6% of all cases, while clinically insignificant ones were found in 19% of cases. Most often, problems appear in musculoskeletal records; 80% of the examinations have diagnostic or technical imperfections. The presence of routine telemedicine support and personalized elearning allowed improving the diagnostics quality. The level of discrepancies has decreased significantly (p elearning significantly decrease the number of discrepancies. • Teleradiology allows linking all primary-level hospitals to a common peer review network.

  12. [Quality Assurance in Sociomedical Evaluation by Peer Review: A Pilot Project of the German Statutory Pension Insurance].

    Science.gov (United States)

    Strahl, A; Gerlich, C; Wolf, H-D; Gehrke, J; Müller-Garnn, A; Vogel, H

    2016-03-01

    The sociomedical evaluation by the German Pension Insurance serves the purpose of determining entitlement to disability pensions. A quality assurance concept for the sociomedical evaluation was developed, which is based on a peer Review process. Peer review is an established process of external quality assurance in health care. The review is based on a hierarchically constructed manual that was evaluated in this pilot project. The database consists of 260 medical reports for disability pension of 12 pension insurance agencies. 771 reviews from 19 peers were included in the evaluation of the inter-rater reliability. Kendall's coefficient of concordance W for more than 2 raters is used as primary measure of inter-rater reliability. Reliability appeared to be heterogeneous. Kendalls W varies for the particular criteria from 0.09 to 0.88 and reached for primary criterion reproducibility a value of 0.37. The reliability of the manual seemed acceptable in the context of existing research data and is in line with existing peer review research outcomes. Nevertheless, the concordance is limited and requires optimisation. Starting points for improvement can be seen in a systematic training and regular user meetings of the peers involved. © Georg Thieme Verlag KG Stuttgart · New York.

  13. Peer review in forensic science.

    Science.gov (United States)

    Ballantyne, Kaye N; Edmond, Gary; Found, Bryan

    2017-08-01

    Peer review features prominently in the forensic sciences. Drawing on recent research and studies, this article examines different types of peer review, specifically: editorial peer review; peer review by the scientific community; technical and administrative review; and verification (and replication). The article reviews the different meanings of these quite disparate activities and their utility in relation to enhancing performance and reducing error. It explains how forensic practitioners should approach and use peer review, as well as how it should be described in expert reports and oral testimony. While peer review has considerable potential, and is a key component of modern quality management systems, its actual value in most forensic science settings has yet to be determined. In consequence, forensic practitioners should reflect on why they use specific review procedures and endeavour to make their actual practices and their potential value transparent to consumers; whether investigators, lawyers, jurors or judges. Claims that review increases the validity of a scientific technique or accuracy of opinions within a particular case should be avoided until empirical evidence is available to support such assertions. Copyright © 2017 Elsevier B.V. All rights reserved.

  14. Pre-university Chemistry Students in a Mimicked Scholarly Peer Review

    NARCIS (Netherlands)

    van Rens, L.; Hermarij, P.; Pilot, A.; Beishuizen, J.J.; Hofman, H.; van der Wal, M.

    2014-01-01

    Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry

  15. Imbalance in individual researcher's peer review activities quantified for four British Ecological Society journals, 2003-2010.

    Science.gov (United States)

    Petchey, Owen L; Fox, Jeremy W; Haddon, Lindsay

    2014-01-01

    Researchers contribute to the scientific peer review system by providing reviews, and "withdraw" from it by submitting manuscripts that are subsequently reviewed. So far as we are aware, there has been no quantification of the balance of individual's contributions and withdrawals. We compared the number of reviews provided by individual researchers (i.e., their contribution) to the number required by their submissions (i.e. their withdrawals) in a large and anonymised database provided by the British Ecological Society. The database covered the Journal of Ecology, Journal of Animal Ecology, Journal of Applied Ecology, and Functional Ecology from 2003-2010. The majority of researchers (64%) did not have balanced contributions and withdrawals. Depending on assumptions, 12% to 44% contributed more than twice as much as required; 20% to 52% contributed less than half as much as required. Balance, or lack thereof, varied little in relation to the number of years a researcher had been active (reviewing or submitting). Researchers who contributed less than required did not lack the opportunity to review. Researchers who submitted more were more likely to accept invitations to review. These finding suggest overall that peer review of the four analysed journals is not in crisis, but only due to the favourable balance of over- and under-contributing researchers. These findings are limited to the four journals analysed, and therefore cannot include researcher's other peer review activities, which if included might change the proportions reported. Relatively low effort was required to assemble, check, and analyse the data. Broader analyses of individual researcher's peer review activities would contribute to greater quality, efficiency, and fairness in the peer review system.

  16. Group consensus peer review in radiation oncology: commitment to quality.

    Science.gov (United States)

    Duggar, W Neil; Bhandari, Rahul; Yang, Chunli Claus; Vijayakumar, Srinivasan

    2018-03-27

    Peer review, especially prospective peer review, has been supported by professional organizations as an important element in optimal Radiation Oncology practice based on its demonstration of efficacy at detecting and preventing errors prior to patient treatment. Implementation of peer review is not without barriers, but solutions do exist to mitigate or eliminate some of those barriers. Peer review practice at our institution involves three key elements: new patient conference, treatment planning conference, and chart rounds. The treatment planning conference is an adaptation of the group consensus peer review model from radiology which utilizes a group of peers reviewing each treatment plan prior to implementation. The peer group in radiation oncology includes Radiation Oncologists, Physician Residents, Medical Physicists, Dosimetrists, and Therapists. Thus, technical and clinical aspects of each plan are evaluated simultaneously. Though peer review is held in high regard in Radiation Oncology, many barriers commonly exist preventing optimal implementation such as time intensiveness, repetition, and distraction from clinic time with patients. Through the use of automated review tools and commitment by individuals and administration in regards to staffing, scheduling, and responsibilities, these barriers have been mitigated to implement this Group Consensus Peer Review model into a Radiation Oncology Clinic. A Group Consensus Peer Review model has been implemented with strategies to address common barriers to effective and efficient peer review.

  17. Multi-stage open peer review: scientific evaluation integrating the strengths of traditional peer review with the virtues of transparency and self-regulation

    Directory of Open Access Journals (Sweden)

    Ulrich ePöschl

    2012-07-01

    Full Text Available The traditional forms of scientific publishing and peer review do not live up to the demands of efficient communication and quality assurance in today’s highly diverse and rapidly evolving world of science. They need to be advanced and complemented by interactive and transparent forms of review, publication, and discussion that are open to the scientific community and to the public.The advantages of open access, public peer review and interactive discussion can be efficiently and flexibly combined with the strengths of traditional scientific peer review. Since 2001 the benefits and viability of this approach are clearly demonstrated by the highly successful interactive open access journal Atmo¬sphe¬ric Chemistry and Physics (ACP and a growing number of sister journals launched and operated by the European Geosciences Union (EGU and the open access publisher Copernicus.The interactive open access journals are practicing an integrative multi-stage process of publication and peer review combined with interactive public discussion, which effectively resolves the dilemma between rapid scientific exchange and thorough quality assurance. The high efficiency and predictive validity of multi-stage open peer review have been confirmed in a series of dedicated studies by evaluation experts from the social sciences, and the same or similar concepts have recently also been adopted in other disciplines, including the life sciences and economics. Multi-stage open peer review can be flexibly adjusted to the needs and peculiarities of different scientific communities. Due to the flexibility and compatibility with traditional structures of scientific publishing and peer review, the multi-stage open peer review concept enables efficient evolution in scientific communication and quality assurance. It has the potential for swift replacement of hidden peer review as the standard of scientific quality assurance, and it provides a basis for open evaluation in

  18. Peer Review in Scientific Publications: Benefits, Critiques, & A Survival Guide

    Science.gov (United States)

    Kelly, Jacalyn; Sadeghieh, Tara

    2014-01-01

    Peer review has been defined as a process of subjecting an author’s scholarly work, research or ideas to the scrutiny of others who are experts in the same field. It functions to encourage authors to meet the accepted high standards of their discipline and to control the dissemination of research data to ensure that unwarranted claims, unacceptable interpretations or personal views are not published without prior expert review. Despite its wide-spread use by most journals, the peer review process has also been widely criticised due to the slowness of the process to publish new findings and due to perceived bias by the editors and/or reviewers. Within the scientific community, peer review has become an essential component of the academic writing process. It helps ensure that papers published in scientific journals answer meaningful research questions and draw accurate conclusions based on professionally executed experimentation. Submission of low quality manuscripts has become increasingly prevalent, and peer review acts as a filter to prevent this work from reaching the scientific community. The major advantage of a peer review process is that peer-reviewed articles provide a trusted form of scientific communication. Since scientific knowledge is cumulative and builds on itself, this trust is particularly important. Despite the positive impacts of peer review, critics argue that the peer review process stifles innovation in experimentation, and acts as a poor screen against plagiarism. Despite its downfalls, there has not yet been a foolproof system developed to take the place of peer review, however, researchers have been looking into electronic means of improving the peer review process. Unfortunately, the recent explosion in online only/electronic journals has led to mass publication of a large number of scientific articles with little or no peer review. This poses significant risk to advances in scientific knowledge and its future potential. The current

  19. SU-E-T-211: Peer Review System for Ensuring Quality of Radiation Therapy Treatments.

    Science.gov (United States)

    Kapoor, R; Kapur, P; Kumar, S A; Alex, D; Ranka, S; Palta, J

    2012-06-01

    To demonstrate a Web-based electronic peer review system that has the potential to improve quality of care for radiation therapy patients. The system provides tools that allow radiation oncologists to seek peer review of target and critical structure delineation, treatment plans, and share clinical data with peers to optimize radiation therapy treatments. Peer review of radiation therapy treatment planning data prior to its initiation improves the quality of radiation therapy and clinical outcomes. Web-based access to radiation therapy treatment planning data and medical records mitigate existing geographical and temporal constraints. With internet access, the healthcare provider can access the data from any location and review it in an interactive and collaborative manner. Interoperability standard like DICOM-RT and IHE-RO compliant RT Systems have facilitated the design and implementation of PRS with Silverlight Web technology, .net Framework and SQL Server. Local DICOM-RT archive and cloud based services are deployed to facilitate remote peer reviews. To validate the PRS system, we tested the system for 100 patients with Philips Pinnacle v 9.0 and Varian Eclipse v 8.9 treatment planning system (TPS). We transmitted the DICOM RT data from the TPS to the cloud based services via the PRS local DICOM RT Archive. Various CT simulation based parameters such as orientation of CT, properties of RT structures etc. were compared between the TPS and PRS system. Data integrity of other parameters such as patient demographics (patient name, ID, attending physician etc.) and dose volume related parameters were also evaluated. Such rigorous testing allowed us to optimize the functionalities and clinical implementation of the PRS. We believe that the PRS will improve the quality and safety of a broad spectrum of radiation therapy patients treated in underserved areas while discouraging the overutilization of expensive radiation treatment modalities. This research and

  20. Analysis of Peer Review Comments: QM Recommendations and Feedback Intervention Theory

    Science.gov (United States)

    Schwegler, Andria F.; Altman, Barbara W.

    2015-01-01

    Because feedback is a critical component of the continuous improvement cycle of the Quality Matters (QM) peer review process, the present research analyzed the feedback that peer reviewers provided to course developers after a voluntary, nonofficial QM peer review of online courses. Previous research reveals that the effects of feedback on…

  1. Re-Viewing Peer Review

    Science.gov (United States)

    Flynn, Elizabeth A.

    2011-01-01

    In this article, the author revisits her essay, "Students as Readers of Their Classmates' Writing," by providing a review of the literature on peer review over the past three decades and comments on patterns she sees in waves of peer review research and theorizing. She describes her subsequent experience with peer review in her own classes, and…

  2. Using simplified peer review processes to fund research: a prospective study

    Science.gov (United States)

    Herbert, Danielle L; Graves, Nicholas; Clarke, Philip; Barnett, Adrian G

    2015-01-01

    Objective To prospectively test two simplified peer review processes, estimate the agreement between the simplified and official processes, and compare the costs of peer review. Design, participants and setting A prospective parallel study of Project Grant proposals submitted in 2013 to the National Health and Medical Research Council (NHMRC) of Australia. The official funding outcomes were compared with two simplified processes using proposals in Public Health and Basic Science. The two simplified processes were: panels of 7 reviewers who met face-to-face and reviewed only the nine-page research proposal and track record (simplified panel); and 2 reviewers who independently reviewed only the nine-page research proposal (journal panel). The official process used panels of 12 reviewers who met face-to-face and reviewed longer proposals of around 100 pages. We compared the funding outcomes of 72 proposals that were peer reviewed by the simplified and official processes. Main outcome measures Agreement in funding outcomes; costs of peer review based on reviewers’ time and travel costs. Results The agreement between the simplified and official panels (72%, 95% CI 61% to 82%), and the journal and official panels (74%, 62% to 83%), was just below the acceptable threshold of 75%. Using the simplified processes would save $A2.1–$A4.9 million per year in peer review costs. Conclusions Using shorter applications and simpler peer review processes gave reasonable agreement with the more complex official process. Simplified processes save time and money that could be reallocated to actual research. Funding agencies should consider streamlining their application processes. PMID:26137884

  3. Predatory Journals, Peer Review, and Education Research

    Science.gov (United States)

    Beall, Jeffrey

    2017-01-01

    This commentary examines the problem of predatory journals, low-quality open-access journals that seek to earn revenue from scholarly authors without following scholarly publishing best practices. Seeking to accept as many papers as possible, they typically do not perform a standard peer review, leading to the publication of improperly vetted…

  4. QA REVIEWS: HOW THEY DIFFER FROM PEER REVIEWS

    Science.gov (United States)

    Research papers and reports written by scientists and engineers in the United States Environmental Protection Agency are reviewed by the agency's quality assurance staff. EPA papers and reports are subjected to peer reviews that check for the validity of conclusions and the gener...

  5. Advancing Kinesiology through Improved Peer Review

    Science.gov (United States)

    Knudson, Duane V.; Morrow, James R., Jr.; Thomas, Jerry R.

    2014-01-01

    Peer review of scholarship is essential to journal quality, evidence, knowledge advancement, and application of that knowledge in any field. This commentary summarizes recent literature on issues related to peer-review quality and current review practice in kinesiology and provides recommendations to improve peer review in kinesiology journals. We…

  6. Practical epistemology: the role of peer review in organizing scientific research

    Directory of Open Access Journals (Sweden)

    Alexei V. Shestopal

    2014-01-01

    Full Text Available The article considers peer review as the main procedure for demarcating scientific knowledge from other kinds thereof, which do not meet the criteria set for research results. The authors examine the history of peer review, which has first been used in early scientific journals and then has become one of the key approaches to distributing funds for research in science foundations, such as the U.S. National Science Foundation. The article also considers the role of peer review in the legal process, wherein observance of this procedure can be seen as the main criteria, which separates scientific evidence from mere testimony. The description of the main elements of the peer review procedure is based on the "Statement of principles for scientific merit review" the summary of the results of the Global Summit on Merit Review, which brought together heads of science funding organizations from more than 50 countries. The Statement listed the following principles: expert assessment, transparency, impartiality, appropriateness, confidentiality, integrity and ethical considerations. Although these principles are seen as a way to guarantee efficient peer review one has to consider the peculiarities of a particular research area, first of all the differences between social and natural sciences. Accordingly the article gives an overview of key traits of peer review in the social sciences and humanities. The authors also consider the main procedural elements - preparation of individual reviews, consideration by panels, anonymity of reviewers. Finally the article addresses the problems of peer review such as non-transparent process, elitism in selecting reviewers, conservativeness of decisions, and possible ways of handling these problems.

  7. Practical epistemology: the role of peer review in organizing scientific research

    OpenAIRE

    Alexei V. Shestopal; Vladimir I. Konnov

    2014-01-01

    The article considers peer review as the main procedure for demarcating scientific knowledge from other kinds thereof, which do not meet the criteria set for research results. The authors examine the history of peer review, which has first been used in early scientific journals and then has become one of the key approaches to distributing funds for research in science foundations, such as the U.S. National Science Foundation. The article also considers the role of peer review in the legal pro...

  8. Mentored peer reviewing for PhD faculty and students.

    Science.gov (United States)

    Xu, Jiayun; Kim, Kyounghae; Kurtz, Melissa; Nolan, Marie T

    2016-02-01

    There is a need for scholars to be prepared as peer reviewers in order to ensure the continual publication of quality science. However, developing the skills to craft a constructive critique can be difficult. In this commentary, we discuss the use of a group peer review mentoring model for PhD students to gain experience in peer review from a faculty member who is experienced in peer review. Central to this model, was the opportunity for each student and faculty mentor to openly discuss their critique of the manuscript. Through this enriching experience, novice researchers were able to learn the elements of a good peer review, better determine a manuscript's substantive contribution to science, and advance the quality of their own manuscript writing. Copyright © 2015 Elsevier Ltd. All rights reserved.

  9. Multi-Stage Open Peer Review: Scientific Evaluation Integrating the Strengths of Traditional Peer Review with the Virtues of Transparency and Self-Regulation

    Science.gov (United States)

    Pöschl, Ulrich

    2012-01-01

    The traditional forms of scientific publishing and peer review do not live up to all demands of efficient communication and quality assurance in today’s highly diverse and rapidly evolving world of science. They need to be advanced and complemented by interactive and transparent forms of review, publication, and discussion that are open to the scientific community and to the public. The advantages of open access, public peer review, and interactive discussion can be efficiently and flexibly combined with the strengths of traditional scientific peer review. Since 2001 the benefits and viability of this approach are clearly demonstrated by the highly successful interactive open access journal Atmospheric Chemistry and Physics (ACP, www.atmos-chem-phys.net) and a growing number of sister journals launched and operated by the European Geosciences Union (EGU, www.egu.eu) and the open access publisher Copernicus (www.copernicus.org). The interactive open access journals are practicing an integrative multi-stage process of publication and peer review combined with interactive public discussion, which effectively resolves the dilemma between rapid scientific exchange and thorough quality assurance. Key features and achievements of this approach are: top quality and impact, efficient self-regulation and low rejection rates, high attractivity and rapid growth, low costs, and financial sustainability. In fact, ACP and the EGU interactive open access sister journals are by most if not all standards more successful than comparable scientific journals with traditional or alternative forms of peer review (editorial statistics, publication statistics, citation statistics, economic costs, and sustainability). The high efficiency and predictive validity of multi-stage open peer review have been confirmed in a series of dedicated studies by evaluation experts from the social sciences, and the same or similar concepts have recently also been adopted in other disciplines, including

  10. Pre-University Chemistry Students in a Mimicked Scholarly Peer Review

    Science.gov (United States)

    van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

    2014-01-01

    Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a…

  11. Peer reviewing e-learning: opportunities, challenges, and solutions.

    Science.gov (United States)

    Ruiz, Jorge G; Candler, Chris; Teasdale, Thomas A

    2007-05-01

    Peer review is the foundation of academic publication and a necessary step in the scrutiny of any scholarly work. Simply defined, peer review is the attentive, unbiased assessment of any scholarly work that is submitted for formal scrutiny. Although medical school faculty increasingly use technology in clinical teaching, e-learning materials are often not subjected to a rigorous peer review process. The authors contrast peer review of e-learning materials with that of print materials, describe peer review issues regarding e-learning materials, propose approaches to address the challenges of peer review of e-learning materials, and outline directions for refinement of the e-learning peer review process. At its core, the peer review of e-learning materials should not differ substantially from that of traditional manuscripts. However, e-learning introduces new demands that impel reviewers to consider aspects that are unique to educational technology, including pedagogy, format, usability, navigation, interactivity, delivery, ease of updating, distribution, and access. Four approaches are offered to ease the burden and improve the quality of e-learning peer review: develop peer review training, embrace multidisciplinary peer review, develop guidelines, and provide incentives and compensation. The authors conclude with suggestions about peer review research.

  12. Peer Review as a Strategy for Improving Students' Writing Process

    Science.gov (United States)

    Baker, Kimberly M.

    2016-01-01

    Peer review is an established strategy for improving the quality of students' writing. This study moves beyond the focus on outcomes to assess the peer-review process. In particular, this study focuses on the timing of the peer review, a highly structured feedback form, and student writers' revisions after engaging in peer review. This study draws…

  13. NIH Peer Review: Scored Review Criteria and Overall Impact

    Science.gov (United States)

    Lindner, Mark D.; Vancea, Adrian; Chen, Mei-Ching; Chacko, George

    2016-01-01

    The National Institutes of Health (NIH) is the largest source of funding for biomedical research in the world. Funding decisions are made largely based on the outcome of a peer review process that is intended to provide a fair, equitable, timely, and unbiased review of the quality, scientific merit, and potential impact of the research. There have…

  14. The Validation of Peer Review through Research Impact Measures and the Implications for Funding Strategies

    Science.gov (United States)

    Gallo, Stephen A.; Carpenter, Afton S.; Irwin, David; McPartland, Caitlin D.; Travis, Joseph; Reynders, Sofie; Thompson, Lisa A.; Glisson, Scott R.

    2014-01-01

    There is a paucity of data in the literature concerning the validation of the grant application peer review process, which is used to help direct billions of dollars in research funds. Ultimately, this validation will hinge upon empirical data relating the output of funded projects to the predictions implicit in the overall scientific merit scores from the peer review of submitted applications. In an effort to address this need, the American Institute of Biological Sciences (AIBS) conducted a retrospective analysis of peer review data of 2,063 applications submitted to a particular research program and the bibliometric output of the resultant 227 funded projects over an 8-year period. Peer review scores associated with applications were found to be moderately correlated with the total time-adjusted citation output of funded projects, although a high degree of variability existed in the data. Analysis over time revealed that as average annual scores of all applications (both funded and unfunded) submitted to this program improved with time, the average annual citation output per application increased. Citation impact did not correlate with the amount of funds awarded per application or with the total annual programmatic budget. However, the number of funded applications per year was found to correlate well with total annual citation impact, suggesting that improving funding success rates by reducing the size of awards may be an efficient strategy to optimize the scientific impact of research program portfolios. This strategy must be weighed against the need for a balanced research portfolio and the inherent high costs of some areas of research. The relationship observed between peer review scores and bibliometric output lays the groundwork for establishing a model system for future prospective testing of the validity of peer review formats and procedures. PMID:25184367

  15. The validation of peer review through research impact measures and the implications for funding strategies.

    Directory of Open Access Journals (Sweden)

    Stephen A Gallo

    Full Text Available There is a paucity of data in the literature concerning the validation of the grant application peer review process, which is used to help direct billions of dollars in research funds. Ultimately, this validation will hinge upon empirical data relating the output of funded projects to the predictions implicit in the overall scientific merit scores from the peer review of submitted applications. In an effort to address this need, the American Institute of Biological Sciences (AIBS conducted a retrospective analysis of peer review data of 2,063 applications submitted to a particular research program and the bibliometric output of the resultant 227 funded projects over an 8-year period. Peer review scores associated with applications were found to be moderately correlated with the total time-adjusted citation output of funded projects, although a high degree of variability existed in the data. Analysis over time revealed that as average annual scores of all applications (both funded and unfunded submitted to this program improved with time, the average annual citation output per application increased. Citation impact did not correlate with the amount of funds awarded per application or with the total annual programmatic budget. However, the number of funded applications per year was found to correlate well with total annual citation impact, suggesting that improving funding success rates by reducing the size of awards may be an efficient strategy to optimize the scientific impact of research program portfolios. This strategy must be weighed against the need for a balanced research portfolio and the inherent high costs of some areas of research. The relationship observed between peer review scores and bibliometric output lays the groundwork for establishing a model system for future prospective testing of the validity of peer review formats and procedures.

  16. The validation of peer review through research impact measures and the implications for funding strategies.

    Science.gov (United States)

    Gallo, Stephen A; Carpenter, Afton S; Irwin, David; McPartland, Caitlin D; Travis, Joseph; Reynders, Sofie; Thompson, Lisa A; Glisson, Scott R

    2014-01-01

    There is a paucity of data in the literature concerning the validation of the grant application peer review process, which is used to help direct billions of dollars in research funds. Ultimately, this validation will hinge upon empirical data relating the output of funded projects to the predictions implicit in the overall scientific merit scores from the peer review of submitted applications. In an effort to address this need, the American Institute of Biological Sciences (AIBS) conducted a retrospective analysis of peer review data of 2,063 applications submitted to a particular research program and the bibliometric output of the resultant 227 funded projects over an 8-year period. Peer review scores associated with applications were found to be moderately correlated with the total time-adjusted citation output of funded projects, although a high degree of variability existed in the data. Analysis over time revealed that as average annual scores of all applications (both funded and unfunded) submitted to this program improved with time, the average annual citation output per application increased. Citation impact did not correlate with the amount of funds awarded per application or with the total annual programmatic budget. However, the number of funded applications per year was found to correlate well with total annual citation impact, suggesting that improving funding success rates by reducing the size of awards may be an efficient strategy to optimize the scientific impact of research program portfolios. This strategy must be weighed against the need for a balanced research portfolio and the inherent high costs of some areas of research. The relationship observed between peer review scores and bibliometric output lays the groundwork for establishing a model system for future prospective testing of the validity of peer review formats and procedures.

  17. The peer review process for awarding funds to international science research consortia: a qualitative developmental evaluation.

    Science.gov (United States)

    Gregorius, Stefanie; Dean, Laura; Cole, Donald C; Bates, Imelda

    2017-01-01

    Background:  Evaluating applications for multi-national, multi-disciplinary, dual-purpose research consortia is highly complex. There has been little research on the peer review process for evaluating grant applications and almost none on how applications for multi-national consortia are reviewed. Overseas development investments are increasingly being channelled into international science consortia to generate high-quality research while simultaneously strengthening multi-disciplinary research capacity. We need a better understanding of how such decisions are made and their effectiveness. Methods:  An award-making institution planned to fund 10 UK-Africa research consortia. Over two annual rounds, 34 out of 78 eligible applications were shortlisted and reviewed by at least five external reviewers before final selections were made by a face-to-face panel. We used an innovative approach involving structured, overt observations of award-making panel meetings and semi-structured interviews with panel members to explore how assessment criteria concerning research quality and capacity strengthening were applied during the peer review process. Data were coded and analysed using pre-designed matrices which incorporated categories relating to the assessment criteria. Results:  In general the process was rigorous and well-managed. However, lack of clarity about differential weighting of criteria and variations in the panel's understanding of research capacity strengthening resulted in some inconsistencies in use of the assessment criteria. Using the same panel for both rounds had advantages, in that during the second round consensus was achieved more quickly and the panel had increased focus on development aspects. Conclusion:  Grant assessment panels for such complex research applications need to have topic- and context-specific expertise. They must also understand research capacity issues and have a flexible but equitable and transparent approach. This study has

  18. Retrospective analysis of the quality of reports by author-suggested and non-author-suggested reviewers in journals operating on open or single-blind peer review models.

    Science.gov (United States)

    Kowalczuk, Maria K; Dudbridge, Frank; Nanda, Shreeya; Harriman, Stephanie L; Patel, Jigisha; Moylan, Elizabeth C

    2015-09-29

    To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations. Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys. BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models. Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation. For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (previewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used. Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a

  19. Peer-reviewed articles on inclusive research: Do co-researchers with intellectual disabilities have a voice?

    Science.gov (United States)

    Strnadová, Iva; Walmsley, Jan

    2018-01-01

    Inclusive research is increasingly common in intellectual disabilities research, but ways in which voice of co-researchers with intellectual disabilities is presented remain underexplored in the literature. The authors conducted a literature review and analysis of peer-reviewed journal articles reporting on inclusive research. The aim was to explore the ways the voices of co-researchers with intellectual disabilities are represented in published peer-reviewed journal articles. The findings indicate that there are a wide range of ways in which inclusive research projects are reported in peer-reviewed journals. However, the experiences, views and opinions of co-researchers are often either absent or very selectively reported. The article concludes that although inclusive research has proliferated in the 21st century, more attention needs to be paid to the ways in which the voices of co-researchers with intellectual disabilities are heard in formal academic contexts. Guidelines for future practice are offered. © 2017 John Wiley & Sons Ltd.

  20. Qualitative Research and Community-Based Participatory Research: Considerations for Effective Dissemination in the Peer-Reviewed Literature.

    Science.gov (United States)

    Grieb, Suzanne Dolwick; Eder, Milton Mickey; Smith, Katherine C; Calhoun, Karen; Tandon, Darius

    2015-01-01

    Qualitative research is appearing with increasing frequency in the public health and medical literature. Qualitative research in combination with a community-based participatory research (CBPR) approach can be powerful. However little guidance is available on how to present qualitative research within a CBPR framework for peer-review publications. This article provides a brief overview of how qualitative research can advance CBPR partnerships and outlines practical guidelines for writing for publication about qualitative research within a CBPR framework to (1) guide partners with little experience publishing in peer-reviewed journals and/or (2) facilitate effective preparation of manuscripts grounded in qualitative research for peer-reviewed journals. We provide information regarding the specific benefits of qualitative inquiry in CBPR, tips for organizing the manuscript, questions to consider in preparing the manuscript, common mistakes in the presentation of qualitative research, and examples of peer-reviewed manuscripts presenting qualitative research conducted within a CBPR framework. Qualitative research approaches have tremendous potential to integrate community and researcher perspectives to inform community health research findings. Effective dissemination of CBPR informed qualitative research findings is crucial to advancing health disparities research.

  1. A multi-disciplinary perspective on emergent and future innovations in peer review.

    Science.gov (United States)

    Tennant, Jonathan P; Dugan, Jonathan M; Graziotin, Daniel; Jacques, Damien C; Waldner, François; Mietchen, Daniel; Elkhatib, Yehia; B Collister, Lauren; Pikas, Christina K; Crick, Tom; Masuzzo, Paola; Caravaggi, Anthony; Berg, Devin R; Niemeyer, Kyle E; Ross-Hellauer, Tony; Mannheimer, Sara; Rigling, Lillian; Katz, Daniel S; Greshake Tzovaras, Bastian; Pacheco-Mendoza, Josmel; Fatima, Nazeefa; Poblet, Marta; Isaakidis, Marios; Irawan, Dasapta Erwin; Renaut, Sébastien; Madan, Christopher R; Matthias, Lisa; Nørgaard Kjær, Jesper; O'Donnell, Daniel Paul; Neylon, Cameron; Kearns, Sarah; Selvaraju, Manojkumar; Colomb, Julien

    2017-01-01

    Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.

  2. Clinical peer review in the United States: history, legal development and subsequent abuse.

    Science.gov (United States)

    Vyas, Dinesh; Hozain, Ahmed E

    2014-06-07

    The Joint Commission on Accreditation requires hospitals to conduct peer review to retain accreditation. Despite the intended purpose of improving quality medical care, the peer review process has suffered several setbacks throughout its tenure. In the 1980s, abuse of peer review for personal economic interest led to a highly publicized multimillion-dollar verdict by the United States Supreme Court against the perpetrating physicians and hospital. The verdict led to decreased physician participation for fear of possible litigation. Believing that peer review was critical to quality medical care, Congress subsequently enacted the Health Care Quality Improvement Act (HCQIA) granting comprehensive legal immunity for peer reviewers to increase participation. While serving its intended goal, HCQIA has also granted peer reviewers significant immunity likely emboldening abuses resulting in Sham Peer Reviews. While legal reform of HCQIA is necessary to reduce sham peer reviews, further measures including the need for standardization of the peer review process alongside external organizational monitoring are critical to improving peer review and reducing the prevalence of sham peer reviews.

  3. Comparison of self-citation by peer reviewers in a journal with single-blind peer review versus a journal with open peer review.

    Science.gov (United States)

    Levis, Alexander W; Leentjens, Albert F G; Levenson, James L; Lumley, Mark A; Thombs, Brett D

    2015-12-01

    Some peer reviewers may inappropriately, or coercively request that authors include references to the reviewers' own work. The objective of this study was to evaluate whether, compared to reviews for a journal with single-blind peer review, reviews for a journal with open peer review included (1) fewer self-citations; (2) a lower proportion of self-citations without a rationale; and (3) a lower ratio of proportions of citations without a rationale in self-citations versus citations to others' work. Peer reviews for published manuscripts submitted in 2012 to a single-blind peer review journal, the Journal of Psychosomatic Research, were previously evaluated (Thombs et al., 2015). These were compared to publically available peer reviews of manuscripts published in 2012 in an open review journal, BMC Psychiatry. Two investigators independently extracted data for both journals. There were no significant differences between journals in the proportion of all reviewer citations that were self-citations (Journal of Psychosomatic Research: 71/225, 32%; BMC Psychiatry: 90/315, 29%; p=.50), or in the proportion of self-citations without a rationale (Journal of Psychosomatic Research: 15/71, 21%; BMC Psychiatry: 12/90, 13%; p=.21). There was no significant difference between journals in the proportion of self-citations versus citations to others' work without a rationale (p=.31). Blind and open peer review methodologies have distinct advantages and disadvantages. The present study found that, in reasonably similar journals that use single-blind and open review, there were no substantive differences in the pattern of peer reviewer self-citations. Copyright © 2015 Elsevier Inc. All rights reserved.

  4. Was Muller's 1946 Nobel Prize research for radiation-induced gene mutations peer-reviewed?

    Science.gov (United States)

    Calabrese, Edward J

    2018-06-06

    This historical analysis indicates that it is highly unlikely that the Nobel Prize winning research of Hermann J. Muller was peer-reviewed. The published paper of Muller lacked a research methods section, cited no references, and failed to acknowledge and discuss the work of Gager and Blakeslee (PNAS 13:75-79, 1927) that claimed to have induced gene mutation via ionizing radiation six months prior to Muller's non-data Science paper (Muller, Science 66(1699):84-87, 1927a). Despite being well acclimated into the scientific world of peer-review, Muller choose to avoid the peer-review process on his most significant publication. It appears that Muller's actions were strongly influenced by his desire to claim primacy for the discovery of gene mutation. The actions of Muller have important ethical lessons and implications today, when self-interest trumps one's obligations to society and the scientific culture that supports the quest for new knowledge and discovery.

  5. Peer Review Practices for Evaluating Biomedical Research Grants: A Scientific Statement From the American Heart Association.

    Science.gov (United States)

    Liaw, Lucy; Freedman, Jane E; Becker, Lance B; Mehta, Nehal N; Liscum, Laura

    2017-08-04

    The biomedical research enterprise depends on the fair and objective peer review of research grants, leading to the distribution of resources through efficient and robust competitive methods. In the United States, federal funding agencies and foundations collectively distribute billions of dollars annually to support biomedical research. For the American Heart Association, a Peer Review Subcommittee is charged with establishing the highest standards for peer review. This scientific statement reviews the current literature on peer review practices, describes the current American Heart Association peer review process and those of other agencies, analyzes the strengths and weaknesses of American Heart Association peer review practices, and recommends best practices for the future. © 2017 American Heart Association, Inc.

  6. Ethical Issues in Radiology Journalism, Peer Review, and Research.

    Science.gov (United States)

    Katz, Douglas S; Gardner, James B; Hoffmann, Jason C; Patlas, Michael N; Bhargava, Puneet; Moshiri, Mariam; Remer, Erick M; Gould, Elaine S; Smith, Stacy

    2016-08-17

    Although some research and publication practices are clearly unethical, including fraud and plagiarism, other areas of research and publication, such as informed consent and conflicts of interest, fall into grayer areas. The purposes of this article are, therefore, to review a variety of relevant ethical issues in radiology-related journalism, peer review, and research; to review the radiology literature to date that has addressed these issues; and to present position statements and potential solutions to these problems.

  7. Pre-university Chemistry Students in a Mimicked Scholarly Peer Review

    Science.gov (United States)

    van Rens, Lisette; Hermarij, Philip; Pilot, Albert; Beishuizen, Jos; Hofman, Herman; Wal, Marjolein

    2014-10-01

    Peer review is a significant component in scientific research. Introducing peer review into inquiry processes may be regarded as an aim to develop student understanding regarding quality in inquiries. This study examines student understanding in inquiry peer reviews among pre-university chemistry students, aged 16-17, when they enact a design of a mimicked scholarly peer review. This design is based on a model of a human activity system. Twenty-five different schools in Brazil, Germany, Poland and The Netherlands participated. The students (n = 880) conducted in small groups (n = 428) open inquiries on fermentation. All groups prepared an inquiry report for peer review. These reports were published on a website. Groups were randomly paired in an internet symposium, where they posted review comments to their peers. These responses were qualitatively analyzed on small groups' level of understanding regarding seven categories: inquiry question, hypothesis, management of control variables, accurate measurement, presenting results, reliability of results, discussion and conclusion. The mimicked scholarly review prompted a collective practice. Student understanding was significantly well on presenting results, discussion and conclusion, and significantly less on inquiry question and reliability of results. An enacted design, based on a model of a human activity system, created student understanding of quality in inquiries as well as an insight in a peer-reviewing practice. To what extent this model can be applied in a broader context of design research in science education needs further study.

  8. [Improving patient safety through voluntary peer review].

    Science.gov (United States)

    Kluge, S; Bause, H

    2015-01-01

    The intensive care unit (ICU) is one area of the hospital in which processes and communication are of primary importance. Errors in intensive care units can lead to serious adverse events with significant consequences for patients. Therefore quality and risk-management are important measures when treating critically ill patients. A pragmatic approach to support quality and safety in intensive care is peer review. This approach has gained significant acceptance over the past years. It consists of mutual visits by colleagues who conduct standardised peer reviews. These reviews focus on the systematic evaluation of the quality of an ICU's structure, its processes and outcome. Together with different associations, the State Chambers of Physicians and the German Medical Association have developed peer review as a standardized tool for quality improvement. The common goal of all stakeholders is the continuous and sustainable improvement in intensive care with peer reviews significantly increasing and improving communication between professions and disciplines. Peer reviews secure the sustainability of planned change processes and consequently lead the way to an improved culture of quality and safety.

  9. Voluntary peer review as innovative tool for quality improvement in the intensive care unit--a retrospective descriptive cohort study in German intensive care units.

    Science.gov (United States)

    Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

    2014-01-01

    Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs - representing over 300 patient beds - had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators.

  10. Peer review of human studies run amok: a break in the fiduciary relation between scientists and the public.

    Science.gov (United States)

    Feldstein Ewing, Sarah W; Saitz, Richard

    2015-02-01

    Peer review aims to ensure the quality and credibility of research reporting. Conducted by volunteer scientists who receive no guidance or direction, peer review widely varies from fast and facilitative, to unclear and obstructive. Poor quality is an issue because most science research is publicly funded, whereby scientists must make an effort to quickly disseminate their findings back to the public. An unfortunately not uncommon barrier in this process is ineffective peer review. Most scientists agree that when done well, editors and reviewers drive and maintain the high standards of science. At the same time, ineffective peer review can cause great delay with no introduced improvement in final product. These delays and requests interfere with the path of communication between scientist and public, at a great cost to editors, reviewers, authors and those who stand to benefit from application of the results of the studies. We offer a series of concrete recommendations to improve this process.

  11. Peer Review of Best Practices

    Science.gov (United States)

    Pearlman, J.; Buttigieg, P. L.; Simpson, P.; Munoz, C.; Dufois, F.; Heslop, E. E.

    2017-12-01

    To ensure the quality of oceanographic data, there is a clear need to employ best practices (BPs) for ocean observation and information management. However, effectively discovering these BPs is a challenge, hindering harmonized quality assurance across projects and programmes. To remedy this, we are prototyping a resource for the stable archiving and efficient discovery of BPs through a granular, semantically indexed, and consistently formatted web resource. While these technical advances have value, they cannot ensure improved oceanographic data quality without effective and inclusive peer review processes. Peer review of digitized best practices can take a number of forms from traditional (blind) peer review as practiced by journal publishers through to the evolving "open" approach where community reviews have both the authors and reviewers identified. This presentation will discuss the options for peer review mechanisms for best practices, including a hybrid approach where both expert panels and open community review are used to improve methodologies and thus downstream data quality. It is not yet clear if the ocean community prefers open versus blind reviews for best practices. It is also unclear the extent to which innovation versus solid technical base should have a higher priority in the reviews. Further, it is not clear whether the reviews should use an internal expert panel of the IODE OceanBestPractices Repository (http://www.oceanbestpractices.net/) or should be done as part of a journal publications process or both, as mentioned above. Thus, we will also describe our future approach to `field test' these review models on a multi-stakeholder compendium of digitized best practice documents.

  12. Open Peer Review: Collective Intelligence as a Framework for Theorizing Approaches to Peer Review in the Humanities

    Directory of Open Access Journals (Sweden)

    Jenna Pack Sheffield

    2013-06-01

    Full Text Available This article takes a moderate approach, balancing suggestions for when open peer review can benefit scholarship in the humanities, while offering important concerns authors and editors must consider before deciding to implement the process. I focus on online commenting functions and how they have been—and can be—used for open peer review to help improve the quality of an author’s scholarly work and change the way publishers go about their peer review processes. While open peer review is not necessarily digital, digital technologies allow for a broader range of participants and faster dissemination of knowledge, which is why this article focuses on online open peer review. Open Peer Review: Collective Intelligence as a Framework for Theorizing Approaches to Peer Review in the Humanities, by Jenna Pack Sheffield

  13. Maximising Benefit from Defence Research: A Review of Defence Research and Technology for Alignment, Quality and Exploitation

    National Research Council Canada - National Science Library

    2006-01-01

    .... We announced in the Strategy that we had set in place an evidence-based peer review of research alignment, quality and exploitation, net as a one-off exercise, but to set a benchmark for future...

  14. Open Peer Review in Scientific Publishing: A Web Mining Study of PeerJ Authors and Reviewers

    Directory of Open Access Journals (Sweden)

    Peiling Wang

    2016-11-01

    Full Text Available Purpose: To understand how authors and reviewers are accepting and embracing Open Peer Review (OPR, one of the newest innovations in the Open Science movement. Design/methodology/approach: This research collected and analyzed data from the Open Access journal PeerJ over its first three years (2013-2016. Web data were scraped, cleaned, and structured using several Web tools and programs. The structured data were imported into a relational database. Data analyses were conducted using analytical tools as well as programs developed by the researchers. Findings: PeerJ, which supports optional OPR, has a broad international representation of authors and referees. Approximately 73.89% of articles provide full review histories. Of the articles with published review histories, 17.61% had identities of all reviewers and 52.57% had at least one signed reviewer. In total, 43.23% of all reviews were signed. The observed proportions of signed reviews have been relatively stable over the period since the Journal's inception. Research limitations: This research is constrained by the availability of the peer review history data. Some peer reviews were not available when the authors opted out of publishing their review histories. The anonymity of reviewers made it impossible to give an accurate count of reviewers who contributed to the review process. Practical implications: These findings shed light on the current characteristics of OPR. Given the policy that authors are encouraged to make their articles' review history public and referees are encouraged to sign their review reports, the three years of PeerJ review data demonstrate that there is still some reluctance by authors to make their reviews public and by reviewers to identify themselves. Originality/value: This is the first study to closely examine PeerJ as an example of an OPR model journal. As Open Science moves further towards open research, OPR is a final and critical component. Research in this

  15. Peer review and competition in the Art Exhibition Game.

    Science.gov (United States)

    Balietti, Stefano; Goldstone, Robert L; Helbing, Dirk

    2016-07-26

    To investigate the effect of competitive incentives under peer review, we designed a novel experimental setup called the Art Exhibition Game. We present experimental evidence of how competition introduces both positive and negative effects when creative artifacts are evaluated and selected by peer review. Competition proved to be a double-edged sword: on the one hand, it fosters innovation and product diversity, but on the other hand, it also leads to more unfair reviews and to a lower level of agreement between reviewers. Moreover, an external validation of the quality of peer reviews during the laboratory experiment, based on 23,627 online evaluations on Amazon Mechanical Turk, shows that competition does not significantly increase the level of creativity. Furthermore, the higher rejection rate under competitive conditions does not improve the average quality of published contributions, because more high-quality work is also rejected. Overall, our results could explain why many ground-breaking studies in science end up in lower-tier journals. Differences and similarities between the Art Exhibition Game and scholarly peer review are discussed and the implications for the design of new incentive systems for scientists are explained.

  16. 45 CFR 96.136 - Independent peer review.

    Science.gov (United States)

    2010-10-01

    ... influence the quality of the services provided. (d) As part of the independent peer review, the reviewers... 45 Public Welfare 1 2010-10-01 2010-10-01 false Independent peer review. 96.136 Section 96.136... Abuse Prevention and Treatment Block Grant § 96.136 Independent peer review. (a) The State shall for the...

  17. 77 FR 58802 - Notice of Intent To Seek OMB Approval To Collect Information: Forms Pertaining to the Peer Review...

    Science.gov (United States)

    2012-09-24

    ... Collect Information: Forms Pertaining to the Peer Review of ARS Research Projects AGENCY: Agricultural... S. Strauss, Peer Review Program Coordinator, Office of Scientific Quality Review; Agricultural... allow the ARS to efficiently manage data associated with the peer review of agricultural research. All...

  18. Daily peer review of abnormal cervical smears in the assessment of individual practice as an additional method of internal quality control.

    Science.gov (United States)

    Confortini, M; Di Stefano, C; Biggeri, A; Bulgaresi, P; Di Claudio, G; Grisotto, L; Maddau, C; Matucci, M; Petreschi, C; Troni, G M; Turco, P; Foxi, P

    2016-02-01

    An important internal quality control system used in the Cancer Prevention and Research Institute cytopathology laboratory in Florence is the peer review procedure, based on the review of all abnormal cytological smears which routinely emerge. Peer review is an important training opportunity for all cytologists, especially for those with less experience. This article shows the results of the peer review procedure. Of the 63 754 Papanicolaou (Pap) smears screened in 2011, 1086 were considered to be abnormal [at least atypical squamous cells of undetermined significance (ASC-US+)] on primary screening (selected by a single cytologist) and were subjected to the peer review procedure. The overall performance of the laboratory's cytologists was evaluated using a multiple rater analysis and the comparison of each cytologist with the final diagnosis. Further, the agreement was assessed by means of Cohen's kappa and weighted kappa statistics. In general, a moderate/substantial level of agreement between the ten cytologists and the final diagnoses was evident. Kappa values for each reader compared with the final diagnosis ranged from 0.54 to 0.69. The overall kappa value was 0.62 [95% confidence interval (CI), 0.58-0.66] and overall weighted kappa value was 0.76 (95% CI, 0.74-0.79). The category-specific agreement showed the lowest values for atypical squamous cells, cannot exclude high-grade squamous intraepithelial lesion (ASC-H). In summary, peer review represents an important internal quality control in the evaluation and improvement of inter-observer agreement and of the functioning of the laboratory as a whole. Multi-head microscope sessions may improve particularly the reproducibility of borderline diagnoses and, above all, can be an important training contribution for cytologists. © 2014 John Wiley & Sons Ltd.

  19. Do peers matter? A review of peer and/or friends' influence on physical activity among American adolescents.

    Science.gov (United States)

    Fitzgerald, Amanda; Fitzgerald, Noelle; Aherne, Cian

    2012-08-01

    This systematic review investigated the relationship between peer and/or friend variables and physical activity among adolescents by synthesising cross-sectional, longitudinal, and experimental research conducted in the US. Seven electronic databases were searched to identify related articles published within the last 10 years and the articles reviewed included adolescents between 10 and 18 years. Studies reporting a measure of physical activity for adolescents and at least one potential peer and/or friend variable were included. Research demonstrated that peers and friends have an important role to play in the physical activity behavior of adolescents. Six processes were identified through which peers and/or friends may have an influence on physical activity including: peer and/or friend support, presence of peers and friends, peer norms, friendship quality and acceptance, peer crowds, and peer victimization. The theoretical significance of these results is assessed and the development of peer-related physical activity programs for adolescents is discussed. Copyright © 2012 The Foundation for Professionals in Services for Adolescents. Published by Elsevier Ltd. All rights reserved.

  20. Peer-Reviewed Articles on Inclusive Research: Do Co-Researchers with Intellectual Disabilities Have a Voice?

    Science.gov (United States)

    Strnadová, Iva; Walmsley, Jan

    2018-01-01

    Background: Inclusive research is increasingly common in intellectual disabilities research, but ways in which voice of co-researchers with intellectual disabilities is presented remain underexplored in the literature. Materials and Method: The authors conducted a literature review and analysis of peer-reviewed journal articles reporting on…

  1. VoiceThread as a Peer Review and Dissemination Tool for Undergraduate Research

    Science.gov (United States)

    Guertin, L. A.

    2012-12-01

    VoiceThread has been utilized in an undergraduate research methods course for peer review and final research project dissemination. VoiceThread (http://www.voicethread.com) can be considered a social media tool, as it is a web-based technology with the capacity to enable interactive dialogue. VoiceThread is an application that allows a user to place a media collection online containing images, audio, videos, documents, and/or presentations in an interface that facilitates asynchronous communication. Participants in a VoiceThread can be passive viewers of the online content or engaged commenters via text, audio, video, with slide annotations via a doodle tool. The VoiceThread, which runs across browsers and operating systems, can be public or private for viewing and commenting and can be embedded into any website. Although few university students are aware of the VoiceThread platform (only 10% of the students surveyed by Ng (2012)), the 2009 K-12 edition of The Horizon Report (Johnson et al., 2009) lists VoiceThread as a tool to watch because of the opportunities it provides as a collaborative learning environment. In Fall 2011, eleven students enrolled in an undergraduate research methods course at Penn State Brandywine each conducted their own small-scale research project. Upon conclusion of the projects, students were required to create a poster summarizing their work for peer review. To facilitate the peer review process outside of class, each student-created PowerPoint file was placed in a VoiceThread with private access to only the class members and instructor. Each student was assigned to peer review five different student posters (i.e., VoiceThread images) with the audio and doodle tools to comment on formatting, clarity of content, etc. After the peer reviews were complete, the students were allowed to edit their PowerPoint poster files for a new VoiceThread. In the new VoiceThread, students were required to video record themselves describing their research

  2. Automated Assessment of the Quality of Peer Reviews Using Natural Language Processing Techniques

    Science.gov (United States)

    Ramachandran, Lakshmi; Gehringer, Edward F.; Yadav, Ravi K.

    2017-01-01

    A "review" is textual feedback provided by a reviewer to the author of a submitted version. Peer reviews are used in academic publishing and in education to assess student work. While reviews are important to e-commerce sites like Amazon and e-bay, which use them to assess the quality of products and services, our work focuses on…

  3. Voluntary peer review as innovative tool for quality improvement in the intensive care unit – a retrospective descriptive cohort study in German intensive care units

    Science.gov (United States)

    Kumpf, Oliver; Bloos, Frank; Bause, Hanswerner; Brinkmann, Alexander; Deja, Maria; Marx, Gernot; Kaltwasser, Arnold; Dubb, Rolf; Muhl, Elke; Greim, Clemens-A.; Weiler, Norbert; Chop, Ines; Jonitz, Günther; Schaefer, Henning; Felsenstein, Matthias; Liebeskind, Ursula; Leffmann, Carsten; Jungbluth, Annemarie; Waydhas, Christian; Pronovost, Peter; Spies, Claudia; Braun, Jan-Peter

    2014-01-01

    Introduction: Quality improvement and safety in intensive care are rapidly evolving topics. However, there is no gold standard for assessing quality improvement in intensive care medicine yet. In 2007 a pilot project in German intensive care units (ICUs) started using voluntary peer reviews as an innovative tool for quality assessment and improvement. We describe the method of voluntary peer review and assessed its feasibility by evaluating anonymized peer review reports and analysed the thematic clusters highlighted in these reports. Methods: Retrospective data analysis from 22 anonymous reports of peer reviews. All ICUs – representing over 300 patient beds – had undergone voluntary peer review. Data were retrieved from reports of peers of the review teams and representatives of visited ICUs. Data were analysed with regard to number of topics addressed and results of assessment questionnaires. Reports of strengths, weaknesses, opportunities and threats (SWOT reports) of these ICUs are presented. Results: External assessment of structure, process and outcome indicators revealed high percentages of adherence to predefined quality goals. In the SWOT reports 11 main thematic clusters were identified representative for common ICUs. 58.1% of mentioned topics covered personnel issues, team and communication issues as well as organisation and treatment standards. The most mentioned weaknesses were observed in the issues documentation/reporting, hygiene and ethics. We identified several unique patterns regarding quality in the ICU of which long-term personnel problems und lack of good reporting methods were most interesting Conclusion: Voluntary peer review could be established as a feasible and valuable tool for quality improvement. Peer reports addressed common areas of interest in intensive care medicine in more detail compared to other methods like measurement of quality indicators. PMID:25587245

  4. Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review.

    Science.gov (United States)

    Ali, Kathina; Farrer, Louise; Gulliver, Amelia; Griffiths, Kathleen M

    2015-01-01

    studies, peer-to-peer support was not found to be effective. This systematic review identified an overall lack of high-quality studies examining online peer-to-peer support for young people. Given that peer support is frequently used as an adjunct to Internet interventions for a variety of mental health conditions, there is an urgent need to determine the effectiveness of peer support alone as an active intervention.

  5. Peer-review for selection of oral presentations for conferences: Are we reliable?

    Science.gov (United States)

    Deveugele, Myriam; Silverman, Jonathan

    2017-11-01

    Although peer-review for journal submission, grant-applications and conference submissions has been called 'a counter- stone of science', and even 'the gold standard for evaluating scientific merit', publications on this topic remain scares. Research that has investigated peer-review reveals several issues and criticisms concerning bias, poor quality review, unreliability and inefficiency. The most important weakness of the peer review process is the inconsistency between reviewers leading to inadequate inter-rater reliability. To report the reliability of ratings for a large international conference and to suggest possible solutions to overcome the problem. In 2016 during the International Conference on Communication in Healthcare, organized by EACH: International Association for Communication in Healthcare, a calibration exercise was proposed and feedback was reported back to the participants of the exercise. Most abstracts, as well as most peer-reviewers, receive and give scores around the median. Contrary to the general assumption that there are high and low scorers, in this group only 3 peer-reviewers could be identified with a high mean, while 7 has a low mean score. Only 2 reviewers gave only high ratings (4 and 5). Of the eight abstracts included in this exercise, only one abstract received a high mean score and one a low mean score. Nevertheless, both these abstracts received both low and high scores; all other abstracts received all possible scores. Peer-review of submissions for conferences are, in accordance with the literature, unreliable. New and creative methods will be needed to give the participants of a conference what they really deserve: a more reliable selection of the best abstracts. More raters per abstract improves the inter-rater reliability; training of reviewers could be helpful; providing feedback to reviewers can lead to less inter-rater disagreement; fostering negative peer-review (rejecting the inappropriate submissions) rather than a

  6. Demystifying the peer-review process - workshop

    Science.gov (United States)

    Scientific writing and peer-review are integral parts of the publishing process. This workshop aims to demystify the peer-review process for early career scientists and provide insightful tips for streamlining the submission and peer review process for all researchers. Providing ...

  7. Expanding Group Peer Review: A Proposal for Medical Education Scholarship.

    Science.gov (United States)

    Dumenco, Luba; Engle, Deborah L; Goodell, Kristen; Nagler, Alisa; Ovitsh, Robin K; Whicker, Shari A

    2017-02-01

    After participating in a group peer-review exercise at a workshop presented by Academic Medicine and MedEdPORTAL editors at the 2015 Association of American Medical Colleges Medical Education Meeting, the authors realized that the way their work group reviewed a manuscript was very different from the way by which they each would have reviewed the paper as an individual. Further, the group peer-review process yielded more robust feedback for the manuscript's authors than did the traditional individual peer-review process. This realization motivated the authors to reconvene and collaborate to write this Commentary to share their experience and propose the expanded use of group peer review in medical education scholarship.The authors consider the benefits of a peer-review process for reviewers, including learning how to improve their own manuscripts. They suggest that the benefits of a team review model may be similar to those of teamwork and team-based learning in medicine and medical education. They call for research to investigate this, to provide evidence to support group review, and to determine whether specific paper types would benefit most from team review (e.g., particularly complex manuscripts, those receiving widely disparate initial individual reviews). In addition, the authors propose ways in which a team-based approach to peer review could be expanded by journals and institutions. They believe that exploring the use of group peer review potentially could create a new methodology for skill development in research and scholarly writing and could enhance the quality of medical education scholarship.

  8. A workstation-integrated peer review quality assurance program: pilot study

    International Nuclear Information System (INIS)

    O’Keeffe, Margaret M; Davis, Todd M; Siminoski, Kerry

    2013-01-01

    The surrogate indicator of radiological excellence that has become accepted is consistency of assessments between radiologists, and the technique that has become the standard for evaluating concordance is peer review. This study describes the results of a workstation-integrated peer review program in a busy outpatient radiology practice. Workstation-based peer review was performed using the software program Intelerad Peer Review. Cases for review were randomly chosen from those being actively reported. If an appropriate prior study was available, and if the reviewing radiologist and the original interpreting radiologist had not exceeded review targets, the case was scored using the modified RADPEER system. There were 2,241 cases randomly assigned for peer review. Of selected cases, 1,705 (76%) were interpreted. Reviewing radiologists agreed with prior reports in 99.1% of assessments. Positive feedback (score 0) was given in three cases (0.2%) and concordance (scores of 0 to 2) was assigned in 99.4%, similar to reported rates of 97.0% to 99.8%. Clinically significant discrepancies (scores of 3 or 4) were identified in 10 cases (0.6%). Eighty-eight percent of reviewed radiologists found the reviews worthwhile, 79% found scores appropriate, and 65% felt feedback was appropriate. Two-thirds of radiologists found case rounds discussing significant discrepancies to be valuable. The workstation-based computerized peer review process used in this pilot project was seamlessly incorporated into the normal workday and met most criteria for an ideal peer review system. Clinically significant discrepancies were identified in 0.6% of cases, similar to published outcomes using the RADPEER system. Reviewed radiologists felt the process was worthwhile

  9. A workstation-integrated peer review quality assurance program: pilot study

    Science.gov (United States)

    2013-01-01

    Background The surrogate indicator of radiological excellence that has become accepted is consistency of assessments between radiologists, and the technique that has become the standard for evaluating concordance is peer review. This study describes the results of a workstation-integrated peer review program in a busy outpatient radiology practice. Methods Workstation-based peer review was performed using the software program Intelerad Peer Review. Cases for review were randomly chosen from those being actively reported. If an appropriate prior study was available, and if the reviewing radiologist and the original interpreting radiologist had not exceeded review targets, the case was scored using the modified RADPEER system. Results There were 2,241 cases randomly assigned for peer review. Of selected cases, 1,705 (76%) were interpreted. Reviewing radiologists agreed with prior reports in 99.1% of assessments. Positive feedback (score 0) was given in three cases (0.2%) and concordance (scores of 0 to 2) was assigned in 99.4%, similar to reported rates of 97.0% to 99.8%. Clinically significant discrepancies (scores of 3 or 4) were identified in 10 cases (0.6%). Eighty-eight percent of reviewed radiologists found the reviews worthwhile, 79% found scores appropriate, and 65% felt feedback was appropriate. Two-thirds of radiologists found case rounds discussing significant discrepancies to be valuable. Conclusions The workstation-based computerized peer review process used in this pilot project was seamlessly incorporated into the normal workday and met most criteria for an ideal peer review system. Clinically significant discrepancies were identified in 0.6% of cases, similar to published outcomes using the RADPEER system. Reviewed radiologists felt the process was worthwhile. PMID:23822583

  10. A Study of Technical Engineering Peer Reviews at NASA

    Science.gov (United States)

    Chao, Lawrence P.; Tumer, Irem Y.; Bell, David G.

    2003-01-01

    This report describes the state of practices of design reviews at NASA and research into what can be done to improve peer review practices. There are many types of reviews at NASA: required and not, formalized and informal, programmatic and technical. Standing project formal reviews such as the Preliminary Design Review and Critical Design Review are a required part of every project and mission development. However, the technical, engineering peer reviews that support teams' work on such projects are informal, some times ad hoc, and inconsistent across the organization. The goal of this work is to identify best practices and lessons learned from NASA's experience, supported by academic research and methodologies to ultimately improve the process. This research has determined that the organization, composition, scope, and approach of the reviews impact their success. Failure Modes and Effects Analysis (FMEA) can identify key areas of concern before or in the reviews. Product definition tools like the Project Priority Matrix, engineering-focused Customer Value Chain Analysis (CVCA), and project or system-based Quality Function Deployment (QFD) help prioritize resources in reviews. The use of information technology and structured design methodologies can strengthen the engineering peer review process to help NASA work towards error-proofing the design process.

  11. "I sleep better at night:" How peer review of radiation treatment plans indirectly improves quality of care across radiation treatment programs.

    Science.gov (United States)

    Brundage, Michael D; Hart, Margaret; O'Donnell, Jennifer; Reddeman, Lindsay; Gutierrez, Eric; Foxcroft, Sophie; Warde, Padraig

    Peer review of radiation oncology treatment plans is increasingly recognized as an important component of quality assurance in radiation treatment planning and delivery. Peer review of treatment plans can directly improve the quality of those plans and can also have indirect effects on radiation treatment programs. We undertook a systematic, qualitative approach to describing the indirect benefits of peer review, factors that were seen to facilitate or act as barriers to the implementation of peer review, and strategies to address these barriers across a provincial jurisdiction of radiation oncology programs (ROPs). Semistructured qualitative interviews were held with radiation oncology department heads and radiation therapy managers (or delegates) in all 14 ROPs in Ontario, Canada. We used a theoretically guided phenomenological qualitative approach to design and analyze the interview content. Themes were recorded by 2 independent reviewers, and any discordance was resolved by consensus. A total of 28 interviews were completed with 32 interviewees. Twenty-two unique themes addressed perceived benefits of peer review, relating to either peer review structure (n = 3), process (n = 9), or outcome (n = 10). Of these 22 themes, 19 related to indirect benefits to ROPs. In addition, 18 themes related to factors that facilitated peer review activities and 30 themes related to key barriers to implementing peer review were identified. Findings were consistent with, and enhanced the understanding of, previous survey-based assessments of the benefits and challenges of implementing peer review programs. Although challenges and concerns regarding the implementation of peer review were evident, the indirect benefits to radiation programs are numerous, far outweigh the implementation challenges, and strongly complement the direct individual-patient benefits that result from peer review quality assurance of radiation treatment plans. Copyright © 2016. Published by Elsevier Inc.

  12. Most Courses Are Not Born Digital: An Overview of the Quality Matters Peer Review Process for Online Course Design

    Science.gov (United States)

    Varonis, Evageline Marlos

    2014-01-01

    Purpose: The purpose of this paper is to discuss benefits of and barriers to online learning and describe utilization of the Quality Matters (QM) peer review process as a method to assure the quality of online courses. It outlines the QM higher education rubric, explains how the collaborative QM peer review process facilitates online course design…

  13. A multi-disciplinary perspective on emergent and future innovations in peer review [version 3; referees: 2 approved

    Directory of Open Access Journals (Sweden)

    Jonathan P. Tennant

    2017-11-01

    Full Text Available Peer review of research articles is a core part of our scholarly communication system. In spite of its importance, the status and purpose of peer review is often contested. What is its role in our modern digital research and communications infrastructure? Does it perform to the high standards with which it is generally regarded? Studies of peer review have shown that it is prone to bias and abuse in numerous dimensions, frequently unreliable, and can fail to detect even fraudulent research. With the advent of web technologies, we are now witnessing a phase of innovation and experimentation in our approaches to peer review. These developments prompted us to examine emerging models of peer review from a range of disciplines and venues, and to ask how they might address some of the issues with our current systems of peer review. We examine the functionality of a range of social Web platforms, and compare these with the traits underlying a viable peer review system: quality control, quantified performance metrics as engagement incentives, and certification and reputation. Ideally, any new systems will demonstrate that they out-perform and reduce the biases of existing models as much as possible. We conclude that there is considerable scope for new peer review initiatives to be developed, each with their own potential issues and advantages. We also propose a novel hybrid platform model that could, at least partially, resolve many of the socio-technical issues associated with peer review, and potentially disrupt the entire scholarly communication system. Success for any such development relies on reaching a critical threshold of research community engagement with both the process and the platform, and therefore cannot be achieved without a significant change of incentives in research environments.

  14. Bibliometric analysis of poison center-related research published in peer-review journals.

    Science.gov (United States)

    Forrester, M B

    2016-07-01

    Poison centers advance knowledge in the field of toxicology through publication in peer-review journals. This investigation describes the pattern of poison center-related publications. Cases were poison center-related research published in peer-review journals during 1995-2014. These were identified through searching the PubMed database, reviewing the tables of contents of selected toxicology journals, and reviewing abstracts of various national and international meetings. The following variables for each publication were identified: year of publication, journal, type of publication (meeting abstract vs. other, i.e. full article or letter to the editor), and the country(ies) of the poison center(s) included in the research. Of the 3147 total publications, 62.1% were meeting abstracts. There were 263 publications in 1995-1999, 536 in 2000-2004, 999 in 2005-2009, and 1349 in 2010-2014. The publications were in 234 different journals. The journals in which the highest number of research was published were Clinical Toxicology (69.7%), Journal of Medical Toxicology (2.2%), and Veterinary and Human Toxicology (2.1%). The research was reported from 62 different countries. The countries with the highest number of publications were the United States (67.9%), United Kingdom (6.5%), Germany (3.9%), France (2.5%), and Italy (2.4%). The number of publications increased greatly over the 20 years. Although the publications were in a large number of journals, a high proportion of the publications were in one journal. While the research came from a large number of countries, the preponderance came from the United States. © The Author(s) 2015.

  15. Strategies to Prevent or Reduce Gender Bias in Peer Review of Research Grants: A Rapid Scoping Review.

    Directory of Open Access Journals (Sweden)

    Andrea C Tricco

    Full Text Available To review the literature on strategies implemented or identified to prevent or reduce gender bias in peer review of research grants.Studies of any type of qualitative or quantitative design examining interventions to reduce or prevent gender bias during the peer review of health-related research grants were included. Electronic databases including MEDLINE, EMBASE, Education Resources Information Center (ERIC, PsycINFO, Joanna Briggs, the Cochrane Library, Evidence Based Medicine (EBM Reviews, and the Campbell Library were searched from 2005 to April 2016. A search for grey (i.e., difficult to locate or unpublished literature was conducted and experts in the field were consulted to identify additional potentially relevant articles. Two individuals screened titles and abstracts, full-text articles, and abstracted data with discrepancies resolved by a third person consistently.After screening 5524 citations and 170 full-text articles, one article evaluating gender-blinding of grant applications using an uncontrolled before-after study design was included. In this study, 891 applications for long-term fellowships in 2006 were included and 47% of the applicants were women. These were scored by 13 peer reviewers (38% were women. The intervention included eliminating references to gender from the applications, letters of recommendations, and interview reports that were sent to the committee members for evaluation. The proportion of successful applications led by women did not change with gender-blinding, although the number of successful applications that were led by men increased slightly.There is limited research on interventions to mitigate gender bias in the peer review of grants. Only one study was identified and no difference in the proportion of women who were successful in receiving grant funding was observed. Our results suggest that interventions to prevent gender bias should be adapted and tested in the context of grant peer review to

  16. 7 CFR 3400.11 - Composition of peer review groups.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Composition of peer review groups. 3400.11 Section..., EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE SPECIAL RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.11 Composition of peer review groups. (a) Peer review group...

  17. Peer Review in Controversial Topics—A Case Study of 9/11

    Directory of Open Access Journals (Sweden)

    John D. Wyndham

    2017-06-01

    Full Text Available Beginning with an historical reminiscence, this paper examines the peer review process as experienced by authors currently seeking publication of their research in a highly controversial area. A case study of research into the events of 9/11 (11 September 2001 illustrates some of the problems in peer review arising from undue influences based on financial and political considerations. The paper suggests that ethical failures, rather than flaws in the process itself, are mainly responsible for perceived problems. The way forward lies in improved ethics and a more open process. In addition, editorial review boards and peer review strategies would help to improve the ethics of peer review in general.

  18. The Effect of Peer Review on Student Learning Outcomes in a Research Methods Course

    Science.gov (United States)

    Crowe, Jessica A.; Silva, Tony; Ceresola, Ryan

    2015-01-01

    In this study, we test the effect of in-class student peer review on student learning outcomes using a quasiexperimental design. We provide an assessment of peer review in a quantitative research methods course, which is a traditionally difficult and technical course. Data were collected from 170 students enrolled in four sections of a…

  19. Subspecialty Influence on Scientific Peer Review for an Obstetrics and Gynecology Journal With a High Impact Factor.

    Science.gov (United States)

    Parikh, Laura I; Benner, Rebecca S; Riggs, Thomas W; Hazen, Nicholas; Chescheir, Nancy C

    2017-02-01

    To evaluate whether quality of peer review and reviewer recommendation differ based on reviewer subspecialty in obstetrics and gynecology and to determine the role of experience on reviewer recommendation. We performed a retrospective cohort study of reviews submitted to Obstetrics & Gynecology between January 2010 and December 2014. Subspecialties were determined based on classification terms selected by each reviewer and included all major obstetrics and gynecology subspecialties, general obstetrics and gynecology, and nonobstetrics and gynecology categories. Review quality (graded on a 5-point Likert scale by the journal's editors) and reviewer recommendation of "reject" were compared across subspecialties using χ, analysis of variance, and multivariate logistic regression. There were 20,027 reviews from 1,889 individual reviewers. Reviewers with family planning subspecialty provided higher-quality peer reviews compared with reviewers with gynecology only, reproductive endocrinology and infertility, gynecologic oncology, and general obstetrics and gynecology specialties (3.61±0.75 compared with 3.44±0.78, 3.42±0.72, 3.35±0.75, and 3.32±0.81, respectively, Ppeer reviews (greater than 195) compared with the lowest quintile (one to seven) (adjusted OR 2.85 [2.60-3.12]). Peer review quality differs based on obstetrics and gynecology subspecialty. Obstetrics and gynecology subspecialty and reviewer experience have implications for manuscript rejection recommendation. Reviewer assignment is pivotal to maintaining a rigorous manuscript selection process.

  20. Peer Review in a Social Policy Course: Lessons Learned

    Directory of Open Access Journals (Sweden)

    Shauna P. Acquavita

    2013-04-01

    Full Text Available Peer review is a tool that provides students with a sense of how their work is perceived by others. Built on refection and feedback, peer review assesses the quality of academic processes and products based on well-understood criteria. Peer review was implemented in a baccalaureate social work policy course to enhance writing and critical thinking skills. Students were surveyed on their experiences and indicated that peer review activities provided beneficial learning exercises. The information gathered suggests methods for future implementation of peer review in social work education.

  1. On the Need for Quantitative Bias Analysis in the Peer-Review Process.

    Science.gov (United States)

    Fox, Matthew P; Lash, Timothy L

    2017-05-15

    Peer review is central to the process through which epidemiologists generate evidence to inform public health and medical interventions. Reviewers thereby act as critical gatekeepers to high-quality research. They are asked to carefully consider the validity of the proposed work or research findings by paying careful attention to the methodology and critiquing the importance of the insight gained. However, although many have noted problems with the peer-review system for both manuscripts and grant submissions, few solutions have been proposed to improve the process. Quantitative bias analysis encompasses all methods used to quantify the impact of systematic error on estimates of effect in epidemiologic research. Reviewers who insist that quantitative bias analysis be incorporated into the design, conduct, presentation, and interpretation of epidemiologic research could substantially strengthen the process. In the present commentary, we demonstrate how quantitative bias analysis can be used by investigators and authors, reviewers, funding agencies, and editors. By utilizing quantitative bias analysis in the peer-review process, editors can potentially avoid unnecessary rejections, identify key areas for improvement, and improve discussion sections by shifting from speculation on the impact of sources of error to quantification of the impact those sources of bias may have had. © The Author 2017. Published by Oxford University Press on behalf of the Johns Hopkins Bloomberg School of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

  2. SU-F-T-231: Improving the Efficiency of a Radiotherapy Peer-Review System for Quality Assurance

    Energy Technology Data Exchange (ETDEWEB)

    Hsu, S; Basavatia, A; Garg, M; Kalnicki, S; Tome, W [Montefiore Medical Center, Bronx, NY (United States)

    2016-06-15

    Purpose: To improve the efficiency of a radiotherapy peer-review system using a commercially available software application for plan quality evaluation and documentation. Methods: A commercial application, FullAccess (Radialogica LLC, Version 1.4.4), was implemented in a Citrix platform for peer-review process and patient documentation. This application can display images, isodose lines, and dose-volume histograms and create plan reports for peer-review process. Dose metrics in the report can also be benchmarked for plan quality evaluation. Site-specific templates were generated based on departmental treatment planning policies and procedures for each disease site, which generally follow RTOG protocols as well as published prospective clinical trial data, including both conventional fractionation and hypo-fractionation schema. Once a plan is ready for review, the planner exports the plan to FullAccess, applies the site-specific template, and presents the report for plan review. The plan is still reviewed in the treatment planning system, as that is the legal record. Upon physician’s approval of a plan, the plan is packaged for peer review with the plan report and dose metrics are saved to the database. Results: The reports show dose metrics of PTVs and critical organs for the plans and also indicate whether or not the metrics are within tolerance. Graphical results with green, yellow, and red lights are displayed of whether planning objectives have been met. In addition, benchmarking statistics are collected to see where the current plan falls compared to all historical plans on each metric. All physicians in peer review can easily verify constraints by these reports. Conclusion: We have demonstrated the improvement in a radiotherapy peer-review system, which allows physicians to easily verify planning constraints for different disease sites and fractionation schema, allows for standardization in the clinic to ensure that departmental policies are maintained, and

  3. SU-F-T-231: Improving the Efficiency of a Radiotherapy Peer-Review System for Quality Assurance

    International Nuclear Information System (INIS)

    Hsu, S; Basavatia, A; Garg, M; Kalnicki, S; Tome, W

    2016-01-01

    Purpose: To improve the efficiency of a radiotherapy peer-review system using a commercially available software application for plan quality evaluation and documentation. Methods: A commercial application, FullAccess (Radialogica LLC, Version 1.4.4), was implemented in a Citrix platform for peer-review process and patient documentation. This application can display images, isodose lines, and dose-volume histograms and create plan reports for peer-review process. Dose metrics in the report can also be benchmarked for plan quality evaluation. Site-specific templates were generated based on departmental treatment planning policies and procedures for each disease site, which generally follow RTOG protocols as well as published prospective clinical trial data, including both conventional fractionation and hypo-fractionation schema. Once a plan is ready for review, the planner exports the plan to FullAccess, applies the site-specific template, and presents the report for plan review. The plan is still reviewed in the treatment planning system, as that is the legal record. Upon physician’s approval of a plan, the plan is packaged for peer review with the plan report and dose metrics are saved to the database. Results: The reports show dose metrics of PTVs and critical organs for the plans and also indicate whether or not the metrics are within tolerance. Graphical results with green, yellow, and red lights are displayed of whether planning objectives have been met. In addition, benchmarking statistics are collected to see where the current plan falls compared to all historical plans on each metric. All physicians in peer review can easily verify constraints by these reports. Conclusion: We have demonstrated the improvement in a radiotherapy peer-review system, which allows physicians to easily verify planning constraints for different disease sites and fractionation schema, allows for standardization in the clinic to ensure that departmental policies are maintained, and

  4. Peer-review: An IOP Publishing Perspective

    Science.gov (United States)

    Smith, Timothy

    2015-03-01

    Online publishing is challenging, and potentially changing, the role of publishers in both managing the peer-review process and disseminating the work that they publish in meeting contrasting needs from diverse groups of research communities. Recognizing the value of peer-review as a fundamental service to authors and the research community, the underlying principles of managing the process for journals published by IOP Publishing remain unchanged and yet the potential and demand for alternative models exists. This talk will discuss the traditional approach to peer-review placed in the context of this changing demand.

  5. Online physician ratings fail to predict actual performance on measures of quality, value, and peer review.

    Science.gov (United States)

    Daskivich, Timothy J; Houman, Justin; Fuller, Garth; Black, Jeanne T; Kim, Hyung L; Spiegel, Brennan

    2018-04-01

    Patients use online consumer ratings to identify high-performing physicians, but it is unclear if ratings are valid measures of clinical performance. We sought to determine whether online ratings of specialist physicians from 5 platforms predict quality of care, value of care, and peer-assessed physician performance. We conducted an observational study of 78 physicians representing 8 medical and surgical specialties. We assessed the association of consumer ratings with specialty-specific performance scores (metrics including adherence to Choosing Wisely measures, 30-day readmissions, length of stay, and adjusted cost of care), primary care physician peer-review scores, and administrator peer-review scores. Across ratings platforms, multivariable models showed no significant association between mean consumer ratings and specialty-specific performance scores (β-coefficient range, -0.04, 0.04), primary care physician scores (β-coefficient range, -0.01, 0.3), and administrator scores (β-coefficient range, -0.2, 0.1). There was no association between ratings and score subdomains addressing quality or value-based care. Among physicians in the lowest quartile of specialty-specific performance scores, only 5%-32% had consumer ratings in the lowest quartile across platforms. Ratings were consistent across platforms; a physician's score on one platform significantly predicted his/her score on another in 5 of 10 comparisons. Online ratings of specialist physicians do not predict objective measures of quality of care or peer assessment of clinical performance. Scores are consistent across platforms, suggesting that they jointly measure a latent construct that is unrelated to performance. Online consumer ratings should not be used in isolation to select physicians, given their poor association with clinical performance.

  6. Using Peer Review to Support Development of Community Resources for Research Data Management

    Directory of Open Access Journals (Sweden)

    Heather Soyka

    2017-09-01

    Full Text Available Objective: To ensure that resources designed to teach skills and best practices for scientific research data sharing and management are useful, the maintainers of those materials need to evaluate and update them to ensure their accuracy, currency, and quality. This paper advances the use and process of outside peer review for community resources in addressing ongoing accuracy, quality, and currency issues. It further describes the next step of moving the updated materials to an online collaborative community platform for future iterative review in order to build upon mechanisms for open science, ongoing iteration, participation, and transparent community engagement. Setting: Research data management resources were developed in support of the DataONE (Data Observation Network for Earth project, which has deployed a sustainable, long-term network to ensure the preservation and access to multi-scale, multi-discipline, and multi-national environmental and biological science data (Michener et al. 2012. Created by members of the Community Engagement and Education (CEE Working Group in 2011-2012, the freely available Educational Modules included three complementary components (slides, handouts, and exercises that were designed to be adaptable for use in classrooms as well as for research data management training. Methods: Because the modules were initially created and launched in 2011-2012, the current members of the (renamed Community Engagement and Outreach (CEO Working Group were concerned that the materials could be and / or quickly become outdated and should be reviewed for accuracy, currency, and quality. In November 2015, the Working Group developed an evaluation rubric for use by outside reviewers. Review criteria were developed based on surveys and usage scenarios from previous DataONE projects. Peer reviewers were selected from the DataONE community network for their expertise in the areas covered by one of the 11 educational modules

  7. Rating the Quality of Open Textbooks: How Reviewer and Text Characteristics Predict Ratings

    Science.gov (United States)

    Fischer, Lane; Ernst, David; Mason, Stacie

    2017-01-01

    Using data collected from peer reviews for Open Textbook Library titles, this paper explores questions about rating the quality of open textbooks. The five research questions addressed the relationship between textbook and reviewer characteristics and ratings. Although reviewers gave textbooks high ratings generally, reviewers identified…

  8. The evolution of peer review as a basis for scientific publication: directional selection towards a robust discipline?

    Science.gov (United States)

    Ferreira, Catarina; Bastille-Rousseau, Guillaume; Bennett, Amanda M; Ellington, E Hance; Terwissen, Christine; Austin, Cayla; Borlestean, Adrian; Boudreau, Melanie R; Chan, Kevin; Forsythe, Adrian; Hossie, Thomas J; Landolt, Kristen; Longhi, Jessica; Otis, Josée-Anne; Peers, Michael J L; Rae, Jason; Seguin, Jacob; Watt, Cristen; Wehtje, Morgan; Murray, Dennis L

    2016-08-01

    Peer review is pivotal to science and academia, as it represents a widely accepted strategy for ensuring quality control in scientific research. Yet, the peer-review system is poorly adapted to recent changes in the discipline and current societal needs. We provide historical context for the cultural lag that governs peer review that has eventually led to the system's current structural weaknesses (voluntary review, unstandardized review criteria, decentralized process). We argue that some current attempts to upgrade or otherwise modify the peer-review system are merely sticking-plaster solutions to these fundamental flaws, and therefore are unlikely to resolve them in the long term. We claim that for peer review to be relevant, effective, and contemporary with today's publishing demands across scientific disciplines, its main components need to be redesigned. We propose directional changes that are likely to improve the quality, rigour, and timeliness of peer review, and thereby ensure that this critical process serves the community it was created for. © 2015 Cambridge Philosophical Society.

  9. Quality Assurance Peer Review Chart Rounds in 2011: A Survey of Academic Institutions in the United States

    International Nuclear Information System (INIS)

    Lawrence, Yaacov Richard; Whiton, Michal A.; Symon, Zvi; Wuthrick, Evan J.; Doyle, Laura; Harrison, Amy S.; Dicker, Adam P.

    2012-01-01

    Purpose: In light of concerns regarding the quality of radiation treatment delivery, we surveyed the practice of quality assurance peer review chart rounds at American academic institutions. Methods and Materials: An anonymous web-based survey was sent to the chief resident of each institution across the United States. Results: The response rate was 80% (57/71). The median amount of time spent per patient was 2.7 minutes (range, 0.6–14.4). The mean attendance by senior physicians and residents was 73% and 93%, respectively. A physicist was consistently present at peer review rounds in 66% of departments. There was a close association between attendance by senior physicians and departmental organization: in departments with protected time policies, good attendance was 81% vs. 31% without protected time (p = 0.001), and in departments that documented attendance, attending presence was 69% vs. 29% in departments without documentation (p 75% of institutions, whereas dosimetric details (beams, wedges), isodose coverage, intensity-modulated radiation therapy constraints, and dose–volume histograms were always peer reviewed in 63%, 59%, 42%, and 50% of cases, respectively. Chart rounds led to both minor (defined as a small multileaf collimator change/repeated port film) and major (change to dose prescription or replan with dosimetry) treatment changes. Whereas at the majority of institutions changes were rare (<10% of cases), 39% and 11% of institutions reported that minor and major changes, respectively, were made to more than 10% of cases. Conclusion: The implementation of peer review chart rounds seems inconsistent across American academic institutions. Brachytherapy and radiosurgical procedures are rarely reviewed. Attendance by senior physicians is variable, but it improves when scheduling clashes are avoided. The potential effect of a more thorough quality assurance peer review on patient outcomes is not known.

  10. An OAI repository centric peer-review model

    CERN Multimedia

    CERN. Geneva

    2005-01-01

    Pre-print repositories have seen a significant increase in use over the past fifteen years across multiple research domains. Researchers are beginning to develop applications capable of using these repositories to assist the scientific community above and beyond the pure dissemination of information. The contributions set forth by this paper emphasize a deconstructed publication model where in which the peer-review certification phase of a pre-print is mediated by an OAI-compliant peer-review service. This peer-review service uses a social-network algorithm for determining potential reviewers for a submitted manuscript and for weighting the influence of each participating reviewer’s evaluations. The paper also provides a set of peer-review specific metadata tags that can accompany a pre-prints existing metadata record. The combinations of these contributions provide a unique repository-centric peer-review model within the framework of the current OAI standards existing today.

  11. Citation ranking versus peer evaluation of senior faculty research performance

    DEFF Research Database (Denmark)

    Meho, Lokman I.; Sonnenwald, Diane H.

    2000-01-01

    The purpose of this study is to analyze the relationship between citation ranking and peer evaluation in assessing senior faculty research performance. Other studies typically derive their peer evaluation data directly from referees, often in the form of ranking. This study uses two additional...... indicator of research performance of senior faculty members? Citation data, book reviews, and peer ranking were compiled and examined for faculty members specializing in Kurdish studies. Analysis shows that normalized citation ranking and citation content analysis data yield identical ranking results....... Analysis also shows that normalized citation ranking and citation content analysis, book reviews, and peer ranking perform similarly (i.e., are highly correlated) for high-ranked and low-ranked senior scholars. Additional evaluation methods and measures that take into account the context and content...

  12. Peering into peer review: Galileo, ESP, Dr Scott Reuben, and advancing our professional evolution.

    Science.gov (United States)

    Biddle, Chuck

    2011-10-01

    The fundamental purpose of peer review is quality control that facilitates the introduction of information into our discipline; information that is essential to the care of patients who require anesthesia services. While the AANA Journal relies heavily on this process to maintain the overall quality of our scholarly literature, it may fail that objective under certain conditions. This editorial serves to inform readers of the nature and goals of the peer review process.

  13. 7 CFR 3415.11 - Composition of peer review groups.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Composition of peer review groups. 3415.11 Section... PROGRAM Scientific Peer Review of Research Grant Applications § 3415.11 Composition of peer review groups. (a) Peer review group members and ad hoc reviewers will be selected based upon their training and...

  14. 7 CFR 3411.11 - Composition of peer review groups.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Composition of peer review groups. 3411.11 Section... PROGRAM Scientific Peer Review of Research Grant Applications § 3411.11 Composition of peer review groups. (a) Peer review group members and ad hoc reviewers will be selected based upon their training and...

  15. The mechanisms underpinning peer support: a literature review.

    Science.gov (United States)

    Watson, Emma

    2017-12-20

    The employment of Peer Support Workers, who themselves have experience of significant emotional distress, can promote recovery at an individual and organisational level. While research examining the benefits of peer support within mental health services continues to grow, an understanding of how, and through what processes, these benefits are reached remains under-developed. To review the published research literature relating to the process of peer support and its underpinning mechanisms to better understand how and why it works. A scoping review of published literature identified studies relating to peer support mechanisms, processes and relationships. Studies were summarised and findings analysed. Five mechanisms were found to underpin peer support relationships (lived experience, love labour, the liminal position of the peer worker, strengths-focussed social and practical support, and the helper role). The identified mechanisms can underpin both the success and difficulties associated with peer support relationships. Further research should review a broader range of literature and clarify how these mechanisms contribute to peer support in different contexts.

  16. Fire protection assessment in a WANO peer review

    International Nuclear Information System (INIS)

    Vella, R.

    1998-01-01

    The peer review programme is becoming the key programme of WANO. The reviews are conducted to assess the performance of plant personnel, the conditions of systems and equipment, the quality of programmes and procedures, and the effectiveness of plant management. The review team consists of highly qualified staff from other WANO members throughout the world who have extensive practical experience in the area the review. At the request of Paris Centre Members, the fire protection area has been added to the scope of WANO peer reviews. Relevant performance objectives and criteria have been developed to cover this area, these are written guidances upon which review of plant performance can be based. They are supported by criteria, more narrow in scope, to help further define what attributes of the fire protection management area contribute to the achievement of the associated performance objective. (author)

  17. Quality Assurance Program: Argonne peer review activities for the salt host-rock portion of the Civilian Radioactive Waste Management Program

    International Nuclear Information System (INIS)

    Edgar, D.E.

    1986-01-01

    This Quality Assurance (QA) Program sets forth the methods, controls, and procedures used to ensure that the results of Argonne National Laboratory's peer review activities are consistently of the highest quality and responsive to Salt Repository Project Office's needs and directives. Implementation of the QA procedures described herein establishes an operational framework so that task activities are traceable and the activities and decisions that influence the overall quality of the peer review process and results are fully documented. 56 refs., 5 figs., 6 tabs

  18. 7 CFR 3401.13 - Composition of peer review groups.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Composition of peer review groups. 3401.13 Section... Peer Review of Research Applications for Funding § 3401.13 Composition of peer review groups. Peer review group members will be selected based upon their training or experience in relevant scientific or...

  19. Redefining the Practice of Peer Review Through Intelligent Automation Part 2: Data-Driven Peer Review Selection and Assignment.

    Science.gov (United States)

    Reiner, Bruce I

    2017-12-01

    In conventional radiology peer review practice, a small number of exams (routinely 5% of the total volume) is randomly selected, which may significantly underestimate the true error rate within a given radiology practice. An alternative and preferable approach would be to create a data-driven model which mathematically quantifies a peer review risk score for each individual exam and uses this data to identify high risk exams and readers, and selectively target these exams for peer review. An analogous model can also be created to assist in the assignment of these peer review cases in keeping with specific priorities of the service provider. An additional option to enhance the peer review process would be to assign the peer review cases in a truly blinded fashion. In addition to eliminating traditional peer review bias, this approach has the potential to better define exam-specific standard of care, particularly when multiple readers participate in the peer review process.

  20. Negotiation on the Assessment of Research Articles with Academic Reviewers: Application of Peer-Review Approach of Teaching

    Science.gov (United States)

    Kumar, Prashant; Rafiq, Imran; Imam, Boulent

    2011-01-01

    This study provides an insight into the dominant negotiation processes that occur between the authors of research articles and academic reviewers at the peer reviewing stage. Data of reviewers comments and authors responses on 32 science and engineering based journal articles covering four decision categories (accept as is, accept with minor…

  1. Psychosocial and career outcomes of peer mentorship in medical resident education: a systematic review protocol.

    Science.gov (United States)

    Pethrick, Helen; Nowell, Lorelli; Oddone Paolucci, Elizabeth; Lorenzetti, Liza; Jacobsen, Michele; Clancy, Tracey; Lorenzetti, Diane L

    2017-08-31

    Many medical residents lack ready access to social and emotional supports that enable them to successfully cope with the challenges associated with medical residency. This absence of support has been shown to lead to high levels of burnout, decreased mental wellbeing, and difficulty mastering professional competencies in this population. While there is emerging evidence that peer mentoring can be an important source of psychosocial and career-related support for many individuals, the extent of the evidence regarding the benefits of peer mentorship in medical residency education has not yet been established. We describe a protocol for a systematic review to assess the effects of peer mentoring on medical residents' mental wellbeing, social connectedness, and professional competencies. Studies included in this review will be those that report on peer-mentoring relationships among medical residents. Quantitative, qualitative, and mixed-methods studies will be eligible for inclusion. No date or language limits will be applied. We will search EMBASE, MEDLINE, PsychINFO, Web of Science, Scopus, ERIC, Education Research Complete, and Academic Research Complete databases to identify relevant studies. Two authors will independently assess all abstracts and full-text studies for inclusion and study quality and extract study data in duplicate. This is the first systematic review to explicitly explore the role of peer mentoring in the context of medical residency education. We anticipate that the findings from this review will raise awareness of the benefits and challenges associated with peer-mentoring relationships, further the development and implementation of formal peer-mentoring programs for medical residents, and, through identifying gaps in the existing literature, inform future research efforts. This protocol has not been registered in PROSPERO or any other publicly accessible registry.

  2. Online Peer Review: Learning Science as It's Practiced.

    Science.gov (United States)

    Trautmann, Nancy M.; Carlsen, William S.; Eick, Charles J.; Gardner, Francis E., Jr.; Kenyon, Lisa; Moscovici, Hedy; Moore, John C.; Thompson, Mark; West, Sandra

    2003-01-01

    Describes a cooperative project that integrates the internet into the peer-review process to enhance student understanding of the nature of science through engagement in socially authentic scientific research and the double-blinded peer review process. Reports the ratings of faculty and students of the online peer review. (Author/YDS)

  3. Optimal allocation of reviewers for peer feedback

    DEFF Research Database (Denmark)

    Wind, David Kofoed; Jensen, Ulf Aslak; Jørgensen, Rasmus Malthe

    2017-01-01

    feedback to be effective students should give and receive useful feedback. A key challenge in peer feedback is allocating the feedback givers in a good way. It is important that reviewers are allocated to submissions such that the feedback distribution is fair - meaning that all students receive good......Peer feedback is the act of letting students give feedback to each other on submitted work. There are multiple reasons to use peer feedback, including students getting more feedback, time saving for teachers and increased learning by letting students reflect on work by others. In order for peer...... indicated the quality of the feedback. Using this model together with historical data we calculate the feedback-giving skill of each student and uses that as input to an allocation algorithm that assigns submissions to reviewers, in order to optimize the feedback quality for all students. We test...

  4. The use of citation indicators to identify and support high-quality research in Poland.

    Science.gov (United States)

    Pilc, Andrzej

    2008-01-01

    In large, mostly English-speaking countries, where the "critical mass" of scientists working in different subfields of science is achieved, the peer review system may be sufficient to assess the quality of scientific research. However, in smaller countries, outside the Anglo-American circle, it is important to introduce different systems to identify research of high quality. In Poland, a parametric system for assessing the quality of research has been introduced. It was largely based on the impact factor of scientific journals. While the use of this indicator to assess research quality is highly questionable, the implementation of the system in the Polish reality is even worse. Therefore it is important to change and improve the system currently used by the Ministry of Science and Higher Education to both evaluate and, more importantly, finance science in Poland. Here, a system based on three factors, i.e. the impact factor, the institutional h-index, and the institutional number of citations, is proposed. The scientific quality of institutions in Division VI: Medical Sciences of the Polish Academy of Sciences were evaluated and the results were compared with the existing system. Moreover, a method to identify high-quality researchers and institutions at the national level based on the quantity of highly cited papers is shown. Additionally, an attempt to identify the highest quality Polish research on an international level is proposed. This is based on the number of individual citations, the individual h-index, the number of publications, and the priority of the discovery.

  5. Working in Triads: A Case Study of a Peer Review Process

    Science.gov (United States)

    Grainger, Peter; Bridgstock, Martin; Houston, Todd; Drew, Steve

    2015-01-01

    Peer review of teaching has become an accepted educational procedure in Australia to quality assure the quality of teaching practices. The institutional implementation of the peer review process can be viewed as genuine desire to improve teaching quality or an imposition from above as a measure of accountability and performativity. One approach is…

  6. A Peer-Reviewed Research Assignment for Large Classes.

    Science.gov (United States)

    Henderson, LaRhee; Buising, Charisse

    2000-01-01

    Introduces a writing exercise students work on in collaborative groups. Aims to enhance students' scientific research paper writing skills and provide experience working in collaborative groups. Presents evaluation criteria for peer-group evaluation of a poster presentation, intra-group evaluation of peer performance, and peer-group evaluation of…

  7. Pulsed Power Peer Review Committee Report

    International Nuclear Information System (INIS)

    Bloomquist, Douglas D.

    2000-01-01

    In 1993, the Government Performance and Results Act (GPRA, PL 103-62) was enacted. GPRA, which applies to all federal programs, has three components: strategic plans, annual performance plans, and metrics to show how well annual plans are being followed. As part of meeting the GRPA requirement in FY2000, a 14-member external peer review panel (the Garwin Committee) was convened on May 17-19, 2000 to review Sandia National Laboratories' Pulsed Power Programs as a component of the Performance Appraisal Process negotiated with the Department of Energy (DOE). The scope of the review included activities in inertial confinement fission (ICF), weapon physics, development of radiation sources for weapons effects simulation, x-ray radiography, basic research in high energy density physics (HEDP), and pulsed power technology research and development. In his charge to the committee, Jeffrey Quintenz, Director of Pulsed Power Sciences (1600) asked that the review be based on four criteria (1) quality of science, technology, and engineering, (2) programmatic performance, management, and planning, (3) relevance to national needs and agency missions, and (4) performance in the operation and construction of major research facilities. In addition, specific programmatic questions were posed by the director and by the DOE-Defense Programs (DP). The accompanying report, produced as a SAND document, is the report of the committee's findings

  8. Changing the Peer Review or Changing the Peers--Recent Development in Assessment of Large Research Collaborations

    Science.gov (United States)

    Hansson, Finn; Monsted, Mette

    2012-01-01

    Peer review of research programmes is changing. The problem is discussed through detailed study of a selection process to a call for collaborations in the energy sector for the European Institute of Innovation and Technology. The authors were involved in the application for a Knowledge Innovation Community. Through the analysis of the case the…

  9. Timely deposition of macromolecular structures is necessary for peer review

    International Nuclear Information System (INIS)

    Joosten, Robbie P.; Soueidan, Hayssam; Wessels, Lodewyk F. A.; Perrakis, Anastassis

    2013-01-01

    Deposition of crystallographic structures should be concurrent with or prior to manuscript submission for peer review, enabling validation and increasing reliability of the PDB. Most of the macromolecular structures in the Protein Data Bank (PDB), which are used daily by thousands of educators and scientists alike, are determined by X-ray crystallography. It was examined whether the crystallographic models and data were deposited to the PDB at the same time as the publications that describe them were submitted for peer review. This condition is necessary to ensure pre-publication validation and the quality of the PDB public archive. It was found that a significant proportion of PDB entries were submitted to the PDB after peer review of the corresponding publication started, and many were only submitted after peer review had ended. It is argued that clear description of journal policies and effective policing is important for pre-publication validation, which is key in ensuring the quality of the PDB and of peer-reviewed literature

  10. Timely deposition of macromolecular structures is necessary for peer review

    Energy Technology Data Exchange (ETDEWEB)

    Joosten, Robbie P. [Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam (Netherlands); Soueidan, Hayssam; Wessels, Lodewyk F. A. [Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX, Amsterdam (Netherlands); Perrakis, Anastassis, E-mail: a.perrakis@nki.nl [Netherlands Cancer Institute, Plesmanlaan 121, 1066 CX Amsterdam (Netherlands)

    2013-12-01

    Deposition of crystallographic structures should be concurrent with or prior to manuscript submission for peer review, enabling validation and increasing reliability of the PDB. Most of the macromolecular structures in the Protein Data Bank (PDB), which are used daily by thousands of educators and scientists alike, are determined by X-ray crystallography. It was examined whether the crystallographic models and data were deposited to the PDB at the same time as the publications that describe them were submitted for peer review. This condition is necessary to ensure pre-publication validation and the quality of the PDB public archive. It was found that a significant proportion of PDB entries were submitted to the PDB after peer review of the corresponding publication started, and many were only submitted after peer review had ended. It is argued that clear description of journal policies and effective policing is important for pre-publication validation, which is key in ensuring the quality of the PDB and of peer-reviewed literature.

  11. The Association between Four Citation Metrics and Peer Rankings of Research Influence of Australian Researchers in Six Fields of Public Health

    Science.gov (United States)

    Derrick, Gemma Elizabeth; Haynes, Abby; Chapman, Simon; Hall, Wayne D.

    2011-01-01

    Doubt about the relevance, appropriateness and transparency of peer review has promoted the use of citation metrics as a viable adjunct or alternative in the assessment of research impact. It is also commonly acknowledged that research metrics will not replace peer review unless they are shown to correspond with the assessment of peers. This paper evaluates the relationship between researchers' influence as evaluated by their peers and various citation metrics representing different aspects of research output in 6 fields of public health in Australia. For four fields, the results showed a modest positive correlation between different research metrics and peer assessments of research influence. However, for two fields, tobacco and injury, negative or no correlations were found. This suggests a peer understanding of research influence within these fields differed from visibility in the mainstream, peer-reviewed scientific literature. This research therefore recommends the use of both peer review and metrics in a combined approach in assessing research influence. Future research evaluation frameworks intent on incorporating metrics should first analyse each field closely to determine what measures of research influence are valued highly by members of that research community. This will aid the development of comprehensive and relevant frameworks with which to fairly and transparently distribute research funds or approve promotion applications. PMID:21494691

  12. The association between four citation metrics and peer rankings of research influence of Australian researchers in six fields of public health.

    Directory of Open Access Journals (Sweden)

    Gemma Elizabeth Derrick

    Full Text Available Doubt about the relevance, appropriateness and transparency of peer review has promoted the use of citation metrics as a viable adjunct or alternative in the assessment of research impact. It is also commonly acknowledged that research metrics will not replace peer review unless they are shown to correspond with the assessment of peers. This paper evaluates the relationship between researchers' influence as evaluated by their peers and various citation metrics representing different aspects of research output in 6 fields of public health in Australia. For four fields, the results showed a modest positive correlation between different research metrics and peer assessments of research influence. However, for two fields, tobacco and injury, negative or no correlations were found. This suggests a peer understanding of research influence within these fields differed from visibility in the mainstream, peer-reviewed scientific literature. This research therefore recommends the use of both peer review and metrics in a combined approach in assessing research influence. Future research evaluation frameworks intent on incorporating metrics should first analyse each field closely to determine what measures of research influence are valued highly by members of that research community. This will aid the development of comprehensive and relevant frameworks with which to fairly and transparently distribute research funds or approve promotion applications.

  13. The association between four citation metrics and peer rankings of research influence of Australian researchers in six fields of public health.

    Science.gov (United States)

    Derrick, Gemma Elizabeth; Haynes, Abby; Chapman, Simon; Hall, Wayne D

    2011-04-06

    Doubt about the relevance, appropriateness and transparency of peer review has promoted the use of citation metrics as a viable adjunct or alternative in the assessment of research impact. It is also commonly acknowledged that research metrics will not replace peer review unless they are shown to correspond with the assessment of peers. This paper evaluates the relationship between researchers' influence as evaluated by their peers and various citation metrics representing different aspects of research output in 6 fields of public health in Australia. For four fields, the results showed a modest positive correlation between different research metrics and peer assessments of research influence. However, for two fields, tobacco and injury, negative or no correlations were found. This suggests a peer understanding of research influence within these fields differed from visibility in the mainstream, peer-reviewed scientific literature. This research therefore recommends the use of both peer review and metrics in a combined approach in assessing research influence. Future research evaluation frameworks intent on incorporating metrics should first analyse each field closely to determine what measures of research influence are valued highly by members of that research community. This will aid the development of comprehensive and relevant frameworks with which to fairly and transparently distribute research funds or approve promotion applications.

  14. NASA Product Peer Review Process

    Science.gov (United States)

    Jenks, Ken

    2009-01-01

    This viewgraph presentation describes NASA's product peer review process. The contents include: 1) Inspection/Peer Review at NASA; 2) Reasons for product peer reviews; 3) Different types of peer reviews; and 4) NASA requirements for peer reviews. This presentation also includes a demonstration of an actual product peer review.

  15. Appreciation of the 2015 JGR Space Physics Peer Reviewers

    Science.gov (United States)

    Liemohn, Michael W.; Balikhin, Michael; Kepko, Larry; Rodger, Alan; Wang, Yuming

    2016-01-01

    The Editors of the Journal of Geophysical Research Space Physics are deeply indebted to the many people among the research community that serve this journal through peer review. The journal could not exist without the time and effort invested by the community through this voluntary activity, providing expert evaluations and thoughtful assessments of the work of others. In 2015, the journal had 1506 scientists contribute to the process with at least one peer review, for a total of 3575 reviews completed, including additional reviews of resubmitted manuscripts. There were 277 reviewers that contributed four or more reports in 2015. The average number of reviews per referee in 2015 was, therefore, 2.4. Note that the total number of manuscript final decisions (i.e., accept or reject) for Journal of Geophysical Research (JGR) Space Physics was 1147 in 2015. Of this, 774 were accepted and 373 were declined, for an acceptance rate of 67% last year. If the 1334 "revision" decisions are included in the tally, then the total number of decisions made in 2015 was 2481. Working out the arithmetic, it means that on average, a manuscript gets about 1.2 revision decisions before a final accept-or-reject decision. This explains the 3.1 average number of reviews per manuscript throughout each paper's lifetime in the submission-revision editorial process. We are pleased and happy that the research community is willing and able to devote their resources toward this service endeavor. We appreciate each and every one of you that helped maintain the high quality of papers in JGR Space Physics last year. We look forward to another excellent year working with all of you through the year ahead.

  16. Partnering with insiders: A review of peer models across community-engaged research, education and social care.

    Science.gov (United States)

    Vaughn, Lisa M; Whetstone, Crystal; Boards, Alicia; Busch, Melida D; Magnusson, Maria; Määttä, Sylvia

    2018-03-07

    Within community-engaged research, education and social care, peer models that partner with local "insiders" are increasingly common. Peer models are composed of insider "lay" community members who often share similarities or background with a project's target population. Peers are not academically trained, but work alongside researchers and professionals to carry out specific tasks within a project, or in the truest sense of partnership, peers collaborate throughout the project from start to finish as an equal member of the team. Although peer models are used widely, the literature lacks consistency and clarity. This systematic review of literature used a qualitative thematic synthesis to examine and report how, where and why peer models have been used in research, education and social care. We examined the language and titles used to describe the peers, details of their involvement in community-engaged projects, the setting, content/topic of study, level of engagement and related benefits/outcomes of such models. Focusing on the last 10 years, we conducted a comprehensive literature search twice between September 2016 and June 2017. The search resulted in 814 articles which were assessed for eligibility. Overall, 251 articles met our inclusion criteria and were categorised into three categories: empirical (n = 115); process/descriptive (n = 93); and "about" peers (n = 43). Findings suggest that there is a wide variety of peers, titles and terminology associated with peer models. There is inconsistency in how these models are used and implemented in research studies and projects. The majority of articles used an employment peer model, while only a handful involved peers in all phases of the project. The results of this literature review contribute to understanding the use, development and evolution of peer models. We highlight potential benefits of peer models for peers, their communities and community-engaged work, and we offer recommendations for future

  17. What has Science’s open-access sting taught us about the quality of peer review?

    Directory of Open Access Journals (Sweden)

    Mićo Tatalović

    2013-11-01

    Full Text Available In October this year, Science published a journalistic investigation into quality of peer review in open access journals [1]. The results were sobering. Around 60% of all journals accepted to publish a research paper with most obvious and basic mistakes - in fact the whole paper, its data, authors and their affiliations were entirely made up by the journalist, John Bohannon, to expose poor peer review. The article has provoked a lot of media attention as well as a backlash from open-access publishers and supporters, who called it unethical, unsound and even accused the journalist of being racist (for making up authors with African names. But regardless of the criticisms, the paper’s surprising findings stand and should be a cause of grave concern for science and science publishing: it shows that many - if not most - open access journals do not have a strict enough editorial and peer review process to catch poor research and flawed papers. The article intrigued me especially, as I commissioned a similar feature article for the website where I edit new and feature, SciDev.Net, which we published earlier this year [2]. I also had the idea of sending out fake and flawed papers to catch ’bad journals’ who accept it, but the time and money needed to do this meant we ended up skipping the investigative part, and we based our article only on reporting interviews with people affected. The key findings were that this is a global problem with some journals prey on researchers going for their money but not providing proper peer review, and that pressure to publish draws scientists, especially in developing countries, to publish in such journals. Experts suggested investigation and regulation is needed to ensure proper peer review, but there was little indication that this regulation will happen any time soon. Another key reason for not sending out fake papers were concerns over how to do this ethically and legally - in fact, the prospects of being

  18. Assessing RN-to-RN peer review on clinical units.

    Science.gov (United States)

    Pfeiffer, Judith A; Wickline, Mary A; Deetz, Jill; Berry, Elise S

    2012-04-01

    The primary purpose of this study was to measure informal registered nurse (RN)-to-RN peer review (defined as collegial communication about the quality of nursing care) at the work-unit level. Survey design with cluster sampling of 28 hospital or ambulatory care units (n = 541 respondents). Results were compared with existing patient safety and satisfaction data. A chi-squared test was used to compare responses against nurse characteristics. Nurses agreed that RN-to-RN peer review takes place on their units, but no correlation with patient safety and satisfaction data was found. Misunderstandings about the meaning of peer review were evident. Open-ended comments revealed barriers to peer review: fear of retribution, language barriers and lack of professionalism. Nurses need clarification of peer review. Issues with common language in a professional environment need to be addressed and nurses can learn collaboration from each other's cultures. Managers should support RN-to-RN peer review on clinical units. Methods used here may be useful to assess current departmental nurse peer review. © 2011 Blackwell Publishing Ltd.

  19. 42 CFR 52h.4 - Composition of peer review groups.

    Science.gov (United States)

    2010-10-01

    ... 42 Public Health 1 2010-10-01 2010-10-01 false Composition of peer review groups. 52h.4 Section... PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT PROJECTS § 52h.4 Composition of peer review groups. (a) To the extent applicable, the selection and appointment of members of...

  20. The Problem of Humiliation in Peer Review

    Science.gov (United States)

    Comer, Debra R.; Schwartz, Michael

    2014-01-01

    This paper examines the problem of vituperative feedback from peer reviewers. We argue that such feedback is morally unacceptable, insofar as it humiliates authors and damages their dignity. We draw from social-psychological research to explore those aspects of the peer-review process in general and the anonymity of blind reviewing in particular…

  1. Holiday review. Snappy answers to stupid questions: an evidence-based framework for responding to peer-review feedback.

    Science.gov (United States)

    Rosenfield, Daniel; Hoffman, Steven J

    2009-12-08

    Authors are inundated with feedback from peer reviewers. Although this feedback is usually helpful, it can also be incomprehensible, rude or plain silly. Inspired by Al Jaffe's classic comic from Mad Magazine, we sought to develop an evidenced-based framework for providing "snappy answers to stupid questions," in the hope of aiding emerging academics in responding appropriately to feedback from peer review. We solicited, categorized and analyzed examples of silly feedback from peer reviewers using the grounded theory qualitative research paradigm from 50 key informants. The informants represented 15 different professions, 33 institutions and 11 countries (i.e., Australia, Barbados, Canada, Germany, Japan, New Zealand, South Africa, Sweden, Switzerland, UK and USA). We developed a Scale of Silliness (SOS) and a Scale of Belligerence (SOB) to facilitate the assessment of inadequate peer-review feedback and guide users in preparing suitable responses to it. The SOB score is tempered by users' current mood, as captured by the Mood Reflective Index (MRI), and dictates the Appropriate Degree of Response (ADR) for the particular situation. Designed using the highest quality of (most easily accessible anecdotal) evidence available, this framework may fill a significant gap in the research literature by helping emerging academics respond to silly feedback from peer reviewers. Although use of the framework to its full extent may have negative consequences (e.g., loss of promotion), its therapeutic value cannot be understated.

  2. Lessons learned from a rigorous peer-review process for building the Climate Literacy and Energy Awareness (CLEAN) collection of high-quality digital teaching materials

    Science.gov (United States)

    Gold, A. U.; Ledley, T. S.; McCaffrey, M. S.; Buhr, S. M.; Manduca, C. A.; Niepold, F.; Fox, S.; Howell, C. D.; Lynds, S. E.

    2010-12-01

    The topic of climate change permeates all aspects of our society: the news, household debates, scientific conferences, etc. To provide students with accurate information about climate science and energy awareness, educators require scientifically and pedagogically robust teaching materials. To address this need, the NSF-funded Climate Literacy & Energy Awareness Network (CLEAN) Pathway has assembled a new peer-reviewed digital collection as part of the National Science Digital Library (NSDL) featuring teaching materials centered on climate and energy science for grades 6 through 16. The scope and framework of the collection is defined by the Essential Principles of Climate Science (CCSP 2009) and a set of energy awareness principles developed in the project. The collection provides trustworthy teaching materials on these socially relevant topics and prepares students to become responsible decision-makers. While a peer-review process is desirable for curriculum developer as well as collection builder to ensure quality, its implementation is non-trivial. We have designed a rigorous and transparent peer-review process for the CLEAN collection, and our experiences provide general guidelines that can be used to judge the quality of digital teaching materials across disciplines. Our multi-stage review process ensures that only resources with teaching goals relevant to developing climate literacy and energy awareness are considered. Each relevant resource is reviewed by two individuals to assess the i) scientific accuracy, ii) pedagogic effectiveness, and iii) usability/technical quality. A science review by an expert ensures the scientific quality and accuracy. Resources that pass all review steps are forwarded to a review panel of educators and scientists who make a final decision regarding inclusion of the materials in the CLEAN collection. Results from the first panel review show that about 20% (~100) of the resources that were initially considered for inclusion

  3. The validity of peer review in a general medicine journal.

    Science.gov (United States)

    Jackson, Jeffrey L; Srinivasan, Malathi; Rea, Joanna; Fletcher, Kathlyn E; Kravitz, Richard L

    2011-01-01

    All the opinions in this article are those of the authors and should not be construed to reflect, in any way, those of the Department of Veterans Affairs. Our study purpose was to assess the predictive validity of reviewer quality ratings and editorial decisions in a general medicine journal. Submissions to the Journal of General Internal Medicine (JGIM) between July 2004 and June 2005 were included. We abstracted JGIM peer review quality ratings, verified the publication status of all articles and calculated an impact factor for published articles (Rw) by dividing the 3-year citation rate by the average for this group of papers; an Rw>1 indicates a greater than average impact. Of 507 submissions, 128 (25%) were published in JGIM, 331 rejected (128 with review) and 48 were either not resubmitted after revision was requested or were withdrawn by the author. Of 331 rejections, 243 were published elsewhere. Articles published in JGIM had a higher citation rate than those published elsewhere (Rw: 1.6 vs. 1.1, p = 0.002). Reviewer quality ratings of article quality had good internal consistency and reviewer recommendations markedly influenced publication decisions. There was no quality rating cutpoint that accurately distinguished high from low impact articles. There was a stepwise increase in Rw for articles rejected without review, rejected after review or accepted by JGIM (Rw 0.60 vs. 0.87 vs. 1.56, p<0.0005). However, there was low agreement between reviewers for quality ratings and publication recommendations. The editorial publication decision accurately discriminated high and low impact articles in 68% of submissions. We found evidence of better accuracy with a greater number of reviewers. The peer review process largely succeeds in selecting high impact articles and dispatching lower impact ones, but the process is far from perfect. While the inter-rater reliability between individual reviewers is low, the accuracy of sorting is improved with a greater

  4. Words Matter: Peer Review as a Failing Safeguard

    Directory of Open Access Journals (Sweden)

    Tom Quiggin

    2013-04-01

    Full Text Available Peer review is intended to support the quality and standards of academic work.  The peer review process has been questioned recently in a number of different arenas.  Source reliability and information credibility can be a problem when an academic scholar or an academic product steps into the public realm through a court case.  In these circumstances, it is not just the credibility of the academic community that is being tested: lives and liberty can be at stake.  Peer-reviewed article must provide a basic standard of trustworthiness.  At a minimum, the peer review process, though a fact checking process, should be able to assure the reader that the sources of the information are reliable and the information provided is credible.

  5. Peer Review in Class: Metrics and Variations in a Senior Course

    Science.gov (United States)

    Yankulov, Krassimir; Couto, Richard

    2012-01-01

    Peer reviews are the generally accepted mode of quality assessment in scholarly communities; however, they are rarely used for evaluation at college levels. Over a period of 5 years, we have performed a peer review simulation at a senior level course in molecular genetics at the University of Guelph and have accumulated 393 student peer reviews.…

  6. Journal peer review: a bar or bridge? An analysis of a paper's revision history and turnaround time, and the effect on citation.

    Science.gov (United States)

    Rigby, J; Cox, D; Julian, K

    2018-01-01

    Journal peer review lies at the heart of academic quality control. This article explores the journal peer review process and seeks to examine how the reviewing process might itself contribute to papers, leading them to be more highly cited and to achieve greater recognition. Our work builds on previous observations and views expressed in the literature about (a) the role of actors involved in the research and publication process that suggest that peer review is inherent in the research process and (b) on the contribution reviewers themselves might make to the content and increased citation of papers. Using data from the journal peer review process of a single journal in the Social Sciences field (Business, Management and Accounting), we examine the effects of peer review on papers submitted to that journal including the effect upon citation, a novel step in the study of the outcome of peer review. Our detailed analysis suggests, contrary to initial assumptions, that it is not the time taken to revise papers but the actual number of revisions that leads to greater recognition for papers in terms of citation impact. Our study provides evidence, albeit limited to the case of a single journal, that the peer review process may constitute a form of knowledge production and is not the simple correction of errors contained in submitted papers.

  7. U.S. EPA. 2000. Science Policy Council Handbook: Peer Review

    Science.gov (United States)

    The goal of the Peer Review Policy and this Handbook is to enhance the quality and credibility of Agency decisions by ensuring that the scientific and technical work products underlying these decisions receive appropriate levels of peer review by independe

  8. Peer review, basic research, and engineering: Defining a role for QA professionals in basic research environments

    Energy Technology Data Exchange (ETDEWEB)

    Bodnarczuk, M.

    1989-02-01

    Within the context of doing basic research, this paper seeks to answer four major questions: (1) What is the authority structure of science. (2) What is peer review. (3) Where is the interface between basic physics research and standard engineering. and (4) Given the conclusions to the first three questions, what is the role of the QA professional in a basic research environment like Fermilab. 23 refs.

  9. A prospective study on an innovative online forum for peer reviewing of surgical science.

    Directory of Open Access Journals (Sweden)

    Martin Almquist

    Full Text Available Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS, after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process.In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale.The survey was sent to 6635 reviewers. In all, 1454 (21.9% responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%. Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40% received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75 versus 2.84 (± 0.71, P<0.001.Open online peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

  10. A prospective study on an innovative online forum for peer reviewing of surgical science.

    Science.gov (United States)

    Almquist, Martin; von Allmen, Regula S; Carradice, Dan; Oosterling, Steven J; McFarlane, Kirsty; Wijnhoven, Bas

    2017-01-01

    Peer review is important to the scientific process. However, the present system has been criticised and accused of bias, lack of transparency, failure to detect significant breakthrough and error. At the British Journal of Surgery (BJS), after surveying authors' and reviewers' opinions on peer review, we piloted an open online forum with the aim of improving the peer review process. In December 2014, a web-based survey assessing attitudes towards open online review was sent to reviewers with a BJS account in Scholar One. From April to June 2015, authors were invited to allow their manuscripts to undergo online peer review in addition to the standard peer review process. The quality of each review was evaluated by editors and editorial assistants using a validated instrument based on a Likert scale. The survey was sent to 6635 reviewers. In all, 1454 (21.9%) responded. Support for online peer review was strong, with only 10% stating that they would not subject their manuscripts to online peer review. The most prevalent concern was about intellectual property, being highlighted in 118 of 284 comments (41.5%). Out of 265 eligible manuscripts, 110 were included in the online peer review trial. Around 7000 potential reviewers were invited to review each manuscript. In all, 44 of 110 manuscripts (40%) received 100 reviews from 59 reviewers, alongside 115 conventional reviews. The quality of the open forum reviews was lower than for conventional reviews (2.13 (± 0.75) versus 2.84 (± 0.71), Ponline peer review is feasible in this setting, but it attracts few reviews, of lower quality than conventional peer reviews.

  11. The Importance of Peer Review: Thoughts on Knudson, Morrow, and Thomas (2014)

    Science.gov (United States)

    Fischman, Mark G.

    2014-01-01

    Knudson, Morrow, and Thomas (2014) recently summarized a number of important issues related to the quality of peer review and current peer-review practice in kinesiology. This writer endorses their six recommendations for improving peer review in kinesiology journals. The purpose of this commentary is to further highlight the importance of…

  12. Peer Review and Reflective Teaching Practices: An Effective Mechanism for Quality Enhancement in Higher Education

    OpenAIRE

    Raj, Sony Jalarajan; Massey, Susan R.; Jose, Soumya

    2017-01-01

    Quality education and teacher accountability are predominant issues generating apprehension in higher education. Traditional methods of evaluation are giving way to more contemporary methods. One technique that is being implemented in many universities throughout the world that provides feedback and improves pedagogical approaches is a formative and collaborative process known as peer review of teaching (PRT). Review of the literature included 34 studies which identified five themes that offe...

  13. Open peer review at four STEM journals: an observational overview.

    Science.gov (United States)

    Ford, Emily

    2015-01-01

    Open peer review, peer review where authors' and reviewers' identities are disclosed to one another, is a growing trend in scholarly publishing. Through observation of four journals in STEM disciplines, PLOS One, Atmospheric Chemistry & Physics, PeerJ, and F1000Research, an observational overview is conducted. The overview relies on defined characteristics of open peer review. Results show that despite differing open peer review implementations, each journal retains editorial involvement in scholarly publishing. Further, the analysis shows that only one of these implementations is fully transparent in its peer review and decision making process. Finally, the overview contends that journals should clearly outline peer review and editorial processes in order to allow for open peer review to be better understood and adopted by authors, reviewers, editors, and readers of science communications.

  14. Enhancing research quality and reporting: why the Journal of Comorbidity is now publishing study protocols

    Directory of Open Access Journals (Sweden)

    Susan Smith

    2014-08-01

    Full Text Available The Journal of Comorbidity was launched in 2011 and has since become established as a high-quality journal that publishes open-access, peer-reviewed articles, with a focus on advancing the clinical management of patients with comorbidity/multimorbidity. To further enhance research quality and reporting of studies in this field, the journal is now offering authors the opportunity to publish a summary of their study protocols – a move designed to generate interest and raise awareness in ongoing clinical research and to enable researchers to detail their methodologies in order that replication by scientific peers is possible.

  15. Peer review: a view based on recent experience as an author and reviewer.

    Science.gov (United States)

    Clark, R K F

    2012-08-01

    Peer review is an important stage in academic publishing, as a form of quality control to maintain the integrity of both the articles and the journals they appear in. However, the confidential nature of the relationship between reviewer and author does not necessarily benefit the system; with some reviewers using their anonymity to give unnecessary, injudicious comment. This paper explores the motives behind the reviewer's comments and how peer review could be improved by openness and honesty.

  16. 2009 Biomass Program Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    Ferrell, John [Office of Energy Efficiency and Renewable Energy (EERE), Washington, DC (United States)

    2009-12-01

    This document summarizes the recommendations and evaluations provided by an independent external panel of experts at the U.S. Department of Energy Biomass Program‘s 2009 peer review meeting, held on July 14–15, 2009, in Arlington, Virginia. The document also includes summary information from the six separate platform reviews conducted between March and April 2009 in the Washington, D.C., and Denver, Colorado, areas. The platform reviews provide evaluations of the program‘s projects in applied research, development, and demonstration as well as analysis and deployment activities. The July program peer review was an evaluation of the program‘s overall strategic planning, management approach, priorities across research areas, and resource allocation.

  17. Mentored peer review of standardized manuscripts as a teaching tool for residents: a pilot randomized controlled multi-center study.

    Science.gov (United States)

    Wong, Victoria S S; Strowd, Roy E; Aragón-García, Rebeca; Moon, Yeseon Park; Ford, Blair; Haut, Sheryl R; Kass, Joseph S; London, Zachary N; Mays, MaryAnn; Milligan, Tracey A; Price, Raymond S; Reynolds, Patrick S; Selwa, Linda M; Spencer, David C; Elkind, Mitchell S V

    2017-01-01

    There is increasing need for peer reviewers as the scientific literature grows. Formal education in biostatistics and research methodology during residency training is lacking. In this pilot study, we addressed these issues by evaluating a novel method of teaching residents about biostatistics and research methodology using peer review of standardized manuscripts. We hypothesized that mentored peer review would improve resident knowledge and perception of these concepts more than non-mentored peer review, while improving review quality. A partially blinded, randomized, controlled multi-center study was performed. Seventy-eight neurology residents from nine US neurology programs were randomized to receive mentoring from a local faculty member or not. Within a year, residents reviewed a baseline manuscript and four subsequent manuscripts, all with introduced errors designed to teach fundamental review concepts. In the mentored group, mentors discussed completed reviews with residents. Primary outcome measure was change in knowledge score between pre- and post-tests, measuring epidemiology and biostatistics knowledge. Secondary outcome measures included level of confidence in the use and interpretation of statistical concepts before and after intervention, and RQI score for baseline and final manuscripts. Sixty-four residents (82%) completed initial review with gradual decline in completion on subsequent reviews. Change in primary outcome, the difference between pre- and post-test knowledge scores, did not differ between mentored (-8.5%) and non-mentored (-13.9%) residents ( p  = 0.48). Significant differences in secondary outcomes (using 5-point Likert scale, 5 = strongly agree) included mentored residents reporting enhanced understanding of research methodology (3.69 vs 2.61; p  = 0.001), understanding of manuscripts (3.73 vs 2.87; p  = 0.006), and application of study results to clinical practice (3.65 vs 2.78; p  = 0.005) compared to non

  18. 7 CFR 3415.10 - Establishment and operation of peer review groups.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... ASSESSMENT RESEARCH GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3415.10 Establishment and operation of peer review groups. Subject to § 3415.5, the Administrator shall adopt procedures...

  19. Peer-supported review of teaching: an evaluation.

    Science.gov (United States)

    Thampy, Harish; Bourke, Michael; Naran, Prasheena

    2015-09-01

    Peer-supported review (also called peer observation) of teaching is a commonly implemented method of ascertaining teaching quality that supplements student feedback. A large variety of scheme formats with rather differing purposes are described in the literature. They range from purely formative, developmental formats that facilitate a tutor's reflection of their own teaching to reaffirm strengths and identify potential areas for development through to faculty- or institution-driven summative quality assurance-based schemes. Much of the current literature in this field focuses within general higher education and on the development of rating scales, checklists or observation tools to help guide the process. This study reports findings from a qualitative evaluation of a purely formative peer-supported review of teaching scheme that was implemented for general practice clinical tutors at our medical school and describes tutors' attitudes and perceived benefits and challenges when undergoing observation.

  20. Peer review: a tool to enhance clinical teaching.

    Science.gov (United States)

    Gusic, Maryellen; Hageman, Heather; Zenni, Elisa

    2013-10-01

    The system used by academic health centres to evaluate teaching must be valued by the large number of faculty staff that teach in clinical settings. Peer review can be used to evaluate and enhance clinical teaching. The objective of this study was to determine the perceptions of clinical faculty about the effects of participating in peer review. Faculty members were observed teaching in a clinical setting by trained peer observers. Feedback was provided using a checklist of behaviours and descriptive comments. Afterwards, semi-structured interviews were conducted to assess the faculty member's perception about the process. Notes from the interviews were analysed using a grounded theory approach. The study was approved by the institutional review boards of all the institutions involved. Three themes emerged from the interviews with faculty members: (1) they found the process to be valuable - they received information that affirmed "good" teaching behaviours, and were prompted to be more focused on their teaching; (2) they were motivated to enhance their teaching by being more deliberate, interactive and learner-centred; and (3) they were inspired to explore other opportunities to improve their teaching skills. Peer review is a process that promotes the open discussion and exchange of ideas. This conversation advances clinical teaching skills and allows high-quality teaching behaviours to be strengthened. © 2013 John Wiley & Sons Ltd.

  1. An automated electronic system for managing radiation treatment plan peer review reduces missed reviews at a large, high-volume academic center.

    Science.gov (United States)

    Gabriel, Peter E; Woodhouse, Kristina D; Lin, Alexander; Finlay, Jarod C; Young, Richard B; Volz, Edna; Hahn, Stephen M; Metz, James M; Maity, Amit

    Assuring quality in cancer care through peer review has become increasingly important in radiation oncology. In 2012, our department implemented an automated electronic system for managing radiation treatment plan peer review. The purpose of this study was to compare the overall impact of this electronic system to our previous manual, paper-based system. In an effort to improve management, an automated electronic system for case finding and documentation of review was developed and implemented. The rates of missed initial reviews, late reviews, and missed re-reviews were compared for the pre- versus postelectronic system cohorts using Pearson χ 2 test and relative risk. Major and minor changes or recommendations were documented and shared with the assigned clinical provider. The overall rate of missed reviews was 7.6% (38/500) before system implementation versus 0.4% (28/6985) under the electronic system (P automated system. Missed re-reviews occurred in 23.1% (3/13) of courses in the preelectronic system cohort and 6.6% (10/152) of courses in the postelectronic system cohort (P = .034). Late reviews were more frequent during high travel or major holiday periods. Major changes were recommended in 2.2% and 2.8% in the pre- versus postelectronic systems, respectively. Minor changes were recommended in 5.3% of all postelectronic cases. The implementation of an automated electronic system for managing peer review in a large, complex department was effective in significantly reducing the number of missed reviews and missed re-reviews when compared to our previous manual system. Copyright © 2016 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

  2. Privileging Peer Review: Implications for Undergraduates

    Directory of Open Access Journals (Sweden)

    Amy E. Mark

    2011-11-01

    Full Text Available Librarians and teaching faculty privilege peer review articles out of ideals rooted in academic culture more then for pedagogical reasons. Undergraduates would find greater benefit in the opportunity to search and critique sources related to their personal and creative interests as well as relevant to academic research projects. Librarians can adopt the role of change-agents by engaging relevant teaching faculty in discussions about the goal of research assignments relative to peer review literature. Framing this discussion is Paulo Freire’s theory of banking information discussed in Pedagogy of the Oppressed (2000.

  3. Research Program Peer Review: Purposes, Principles, Practices, Protocols

    Science.gov (United States)

    2004-06-01

    Statement 1994-95. Canberra: AGPS. Cook- Deegan , R.M. Merit Review for Federally Funded Science and Technology: A White Paper for the Council of the...18p. Craig -B, "SPE Peer-Review Critique", JOURNAL OF PETROLEUM TECHNOLOGY, 1994, Vol 46, Iss 7, pp 563-563 Cram-DL Stebbins-M Eom-HS Ratto-N

  4. Biomass Program 2007 Program Peer Review - Full Report

    Energy Technology Data Exchange (ETDEWEB)

    none,

    2009-10-27

    This document summarizes the comments provided by the peer reviewers at the U.S. Department of Energy (DOE) Biomass Program’s Peer Review meeting, held on November 14-15, 2007 in Baltimore, MD and Platform Reviews conducted over the summer of 2007. The Platform Reviews provide evaluations of the Program’s projects in applied research, development, and demonstration.

  5. Rethinking Feedback Practices in Higher Education: A Peer Review Perspective

    Science.gov (United States)

    Nicol, David; Thomson, Avril; Breslin, Caroline

    2014-01-01

    Peer review is a reciprocal process whereby students produce feedback reviews on the work of peers and receive feedback reviews from peers on their own work. Prior research has primarily examined the learning benefits that result from the receipt of feedback reviews, with few studies specifically exploring the merits of producing feedback reviews…

  6. Adapting Peer Review to an Online Course: An Exploratory Case Study

    Science.gov (United States)

    Knight, Linda V.; Steinbach, Theresa A.

    2011-01-01

    With demonstrated benefits to higher level learning, peer review in the classroom has been well researched and popular since at least the 1990s. However, little or no prior studies exist into the peer review process for online courses. Further, we found no prior research specifically addressing the operational aspects of online peer review. This…

  7. Peer review in design: Understanding the impact of collaboration on the review process and student perception

    Science.gov (United States)

    Mandala, Mahender Arjun

    A cornerstone of design and design education is frequent situated feedback. With increasing class sizes, and shrinking financial and human resources, providing rich feedback to students becomes increasingly difficult. In the field of writing, web-based peer review--the process of utilizing equal status learners within a class to provide feedback to each other on their work using networked computing systems--has been shown to be a reliable and valid source of feedback in addition to improving student learning. Designers communicate in myriad ways, using the many languages of design and combining visual and descriptive information. This complex discourse of design intent makes peer reviews by design students ambiguous and often not helpful to the receivers of this feedback. Furthermore, engaging students in the review process itself is often difficult. Teams can complement individual diversity and may assist novice designers collectively resolve complex task. However, teams often incur production losses and may be impacted by individual biases. In the current work, we look at utilizing a collaborative team of reviewers, working collectively and synchronously, in generating web based peer reviews in a sophomore engineering design class. Students participated in a cross-over design, conducting peer reviews as individuals and collaborative teams in parallel sequences. Raters coded the feedback generated on the basis of their appropriateness and accuracy. Self-report surveys and passive observation of teams conducting reviews captured student opinion on the process, its value, and the contrasting experience they had conducting team and individual reviews. We found team reviews generated better quality feedback in comparison to individual reviews. Furthermore, students preferred conducting reviews in teams, finding the process 'fun' and engaging. We observed several learning benefits of using collaboration in reviewing including improved understanding of the assessment

  8. Innovations in scholarly peer review at Nature Publishing Group and Palgrave Macmillan

    Directory of Open Access Journals (Sweden)

    Amy Bourke-Waite

    2015-07-01

    Full Text Available The peer-review system is one of the cornerstones of quality, integrity and reproducibility in research, and its existence has enabled the scholarly publishing system to function for hundreds of years. Yet, it is beset by challenges ranging from perceived bias to lack of transparency, and the system is groaning beneath the weight of the vastly increasing quantity of research being published every year. This article lays out some of the challenges, reports on a survey of Nature Publishing Group and Palgrave Macmillan authors, and examines a number of pilots. The community feedback gained should ultimately help to improve the experience and service provided in future to the authors, peer reviewers and editorial board members of its journals.

  9. The MELCOR peer review process and findings

    International Nuclear Information System (INIS)

    Boyack, B.E.; Dhir, V.K.; Haste, T.J.; Gieseke, J.A.; Viskanta, R.; Kenton, M.A.; Khatib-Rahbar, M.; Leonard, M.T.

    1991-01-01

    MELCOR is a fully integrated, engineering-level computer code the models the progression of severe accidents in light water reactor nuclear power plants. MELCOR is being developed at Sandia National Laboratories for the US Nuclear Regulatory Commission (NRC) as a second-generation plant risk assessment tool and as the successor to the Source Term Code Package. MELCOR has been under development since 1982. The code has now reached sufficient maturity that a number of organizations inside and outside the NRC are using or are planning to use the code. Although the quality control and validation efforts are in progress, the NRC identified the need to have a broad technical review of recognized experts to determine or confirm the technical adequacy of the code for the serious and complex analyses it is expected to perform. A peer review committee was organized using recognized experts from the national laboratories, universities, MELCOR user community, and independent contractors to perform this assessment. The objective of this paper is to summarize the peer review process and to summarize the findings of the MELCOR Peer Review Committee formed to conduct the MELCOR peer review

  10. Randomised controlled trials of veterinary homeopathy: characterising the peer-reviewed research literature for systematic review.

    Science.gov (United States)

    Mathie, Robert T; Hacke, Daniela; Clausen, Jürgen

    2012-10-01

    Systematic review of the research evidence in veterinary homeopathy has never previously been carried out. This paper presents the search methods, together with categorised lists of retrieved records, that enable us to identify the literature that is acceptable for future systematic review of randomised controlled trials (RCTs) in veterinary homeopathy. All randomised and controlled trials of homeopathic intervention (prophylaxis and/or treatment of disease, in any species except man) were appraised according to pre-specified criteria. The following databases were systematically searched from their inception up to and including March 2011: AMED; Carstens-Stiftung Homeopathic Veterinary Clinical Research (HomVetCR) database; CINAHL; Cochrane Central Register of Controlled Trials; Embase; Hom-Inform; LILACS; PubMed; Science Citation Index; Scopus. One hundred and fifty records were retrieved; 38 satisfied the acceptance criteria (substantive report of a clinical treatment or prophylaxis trial in veterinary homeopathic medicine randomised and controlled and published in a peer-reviewed journal), and were thus eligible for future planned systematic review. Approximately half of the rejected records were theses. Seven species and 27 different species-specific medical conditions were represented in the 38 papers. Similar numbers of papers reported trials of treatment and prophylaxis (n=21 and n=17 respectively) and were controlled against placebo or other than placebo (n=18, n=20 respectively). Most research focused on non-individualised homeopathy (n=35 papers) compared with individualised homeopathy (n=3). The results provide a complete and clarified view of the RCT literature in veterinary homeopathy. We will systematically review the 38 substantive peer-reviewed journal articles under the main headings: treatment trials; prophylaxis trials. Copyright © 2012 The Faculty of Homeopathy. Published by Elsevier Ltd. All rights reserved.

  11. How are we assessing near-peer teaching in undergraduate health professional education? A systematic review.

    Science.gov (United States)

    Irvine, Susan; Williams, Brett; McKenna, Lisa

    2017-03-01

    Near Peer teaching (NPT) is reported as an effective pedagogical approach to student learning and performance. Studies in medicine, nursing and health sciences have relied mainly on self-reports to describe its benefits, focusing on psychomotor and cognitive aspects of learning. Despite increasing research reports on peer teaching internationally, little is known about the various domains of learning used in assessment of performance and objective learning outcomes of NPT. To determine the domains of learning and assessment outcomes used in NPT in undergraduate health professional education. Quantitative systematic review was conducted in accord with the PRISMA protocol and the Joanna Briggs Institute processes. A wide literature search was conducted for the period 1990-November 2015 of fourteen databases. Grey literature was undertaken from all key research articles. Studies meeting the inclusion criteria were eligible for consideration, including measured learning outcomes of near-peer teaching in undergraduate education in nursing, medicine and health sciences. Set limitations included publications after 1990 (2015 inclusive), English language and objective learning outcomes. A quality appraisal process involving two independent reviewers was used to analyse the data. Of 212 selected articles, 26 were included in the review. Terminology was confusing and found to be a barrier to the review process. Although some studies demonstrated effective learning outcomes resulting from near-peer teaching, others were inconclusive. Studies focused on cognitive and psychomotor abilities of learners with none assessing metacognition, affective behaviours or learning outcomes from quality of understanding. The studies reviewed focused on cognitive and psychomotor abilities of learners. Even though evidence clearly indicates that metacognition and affective behaviours have direct influence on learning and performance, indicating more research around this topic is warranted

  12. Science, Policy, and Peer Review

    Science.gov (United States)

    Kennedy, D.

    2006-12-01

    These are intense times at the convergence between science and public policy. Because issues like climate change, stem cell research and environmental protection are being contested in choppy political water, political interests are being deployed to challenge science and researchers, and also to generate pseudo- scientific claims made in the interest of particular policy ends. In a number of cases reported in Science, administration officials have silenced their own employees, or withheld data selectively from draft reports. Added to that challenge to integrity, there is a new statutory environment that adds some complexity of its own. Beginning with the Data Quality Act, more familiarly the "Shelby Amendment," research results with significant economic impacts through regulation are now available through the Freedom of Information Act. Its successor, the Data Quality Act -- which opens a route of challenge to information released by government or gathered by others and used in advice or regulation has exposed scientists not only to having their primary data reanalyzed for the purposes of others, but to charges of research misconduct. These influences have made journal peer review more challenging in several ways, and I will outline some case examples.

  13. 42 CFR 52h.3 - Establishment and operation of peer review groups.

    Science.gov (United States)

    2010-10-01

    ... 42 Public Health 1 2010-10-01 2010-10-01 false Establishment and operation of peer review groups... GRANTS SCIENTIFIC PEER REVIEW OF RESEARCH GRANT APPLICATIONS AND RESEARCH AND DEVELOPMENT CONTRACT PROJECTS § 52h.3 Establishment and operation of peer review groups. (a) To the extent applicable, the...

  14. Ladies First? Not So Fast: Linguistic Sexism in Peer-Reviewed Research.

    Science.gov (United States)

    Willis, Malachi; Jozkowski, Kristen N

    2018-02-01

    The words we use reflect and influence our interpretation of the world. The role of gender within a language varies; biases based on social gender are referred to as linguistic sexism. Male firstness is the practice of persistently ordering masculine terms before feminine terms. Because academic writing is mandated to be free of bias, peer-reviewed research should not contain any form of linguistic sexism. To assess the presence of male firstness in academic writing, we examined 862 contemporary articles from 10 social science journals across three disciplines: sexuality, health, and psychology. To assess male firstness, we tallied common gendered pairs (e.g., "women and men"; "male and female") and calculated percentages indicating how often men were presented before women. We found that male firstness bias was present in each of the 10 journals. For individual journals, the percentage of gendered phrases that presented masculine terms first ranged from 57.7% to 88.8%. Sexuality and health journals demonstrated less linguistic sexism than psychology; however, there were no consistent trends between journals within each discipline. We discuss the current presence of male firstness in academic journals and the issues this bias triggers. Recommendations for reducing linguistic sexism in peer-reviewed research are also discussed.

  15. On the evolving open peer review culture for chemical information science.

    Science.gov (United States)

    Walters, W Patrick; Bajorath, Jürgen

    2015-01-01

    Compared to the traditional anonymous peer review process, open post-publication peer review provides additional opportunities -and challenges- for reviewers to judge scientific studies. In this editorial, we comment on the open peer review culture and provide some guidance for reviewers of manuscripts submitted to the Chemical Information Science channel of F1000Research.

  16. Technology and peer review: the open and participatory dimension

    Directory of Open Access Journals (Sweden)

    Fedeli Laura

    2015-12-01

    Full Text Available Peer review is a consolidated procedure in the academic context and its process affects various range of research outputs from project funding applications to manuscript publication. Peer review can be developed through modalities that imply a different level of transparency in the relationship between anonymity of the author and the reviewer/s.

  17. How do I peer-review a scientific article?-a personal perspective.

    Science.gov (United States)

    Lippi, Giuseppe

    2018-02-01

    Peer-review is an essential activity for the vast majority of credited scientific journals and represents the cornerstone for assessing the quality of potential publications, since it is substantially aimed to identify drawbacks or inaccuracies that may flaw the outcome or the presentation of scientific research. Since the importance of this activity is seldom underestimated by some referees, the purpose of this article is to present a personal and arbitrary perspective on how a scientific article should be peer-reviewed, offering a tentative checklist aimed to describe the most important criteria that should be considered. These basically include accepting the assignment only when the topic is in accordance with referee's background, disclosing potential conflicts of interest, checking availability and time according to size and complexity of the article, identifying the innovative value of the manuscript, providing exhaustive and clear comments, expressing disagreement with a fair and balanced approach, weighting revisions according to the importance of the journal, summarizing recommendations according to previous comments, maintaining confidentiality throughout and after the peer-review process. I really hope that some notions reported in this dissertation may be a guide or a help, especially for young scientists, who are willing to be engaged in peer-review activity for scientific journals.

  18. Medicare program; acquisition, protection and disclosure of utilization and quality control peer review organization (PRO) information--HCFA. Proposed rule.

    Science.gov (United States)

    1984-04-16

    This proposal would govern the acquisition, protection and disclosure of information obtained or generated by Utilization and Quality Control Peer Review Organizations (PROs). The Peer Review Improvement Act of 1982 authorizes PROs to acquire information necessary to fulfill their duties and functions, places limits on the disclosure of PRO information, and establishes penalties for unauthorized disclosure. These regulations would implement the PROs' statutory right of access to necessary information and set forth their responsibilities to assure that information once acquired is adequately safeguarded, and used only for proper purposes.

  19. DOE EERE Standard Operating Procedure Peer Review Best Practice and Procedures

    Energy Technology Data Exchange (ETDEWEB)

    None

    2009-01-18

    Objective review and advice from peers - peer review - provides managers, staff, and researchers with a powerful and effective tool for enhancing the management, relevance, effectiveness, and productivity of all of the EERE research, development

  20. 2015 Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    None, None

    2016-03-01

    In the spring and summer of 2015, the Bioenergy Technologies Office (BETO or the Office) of the U.S. Department of Energy (DOE) implemented an external peer review of the projects in its research, development and demonstration (RD&D) portfolio. The Office manages a diverse portfolio of technologies across the spectrum of applied RD&D within the dynamic context of changing budgets and Administration priorities. The Office portfolio is organized according to the biomass-to-bioenergy supply chain—from the feedstock source to the end user (see Figure 1)—with major focus on feedstock supply and biomass conversion. The 2015 Project Peer Review took place March 23-27, 2015, outside of Washington, D.C., in Alexandria, Virginia, and evaluated most of the publicly funded projects in BETO’s portfolio. The subsequent Program Management Review took place on June 25, 2015, in Washington, D.C., and provided an Office- level assessment of strategic planning and programmatic initiatives. The peer review process enables external stakeholders to provide feedback on the responsible use of taxpayer funding and develop recommendations for the most efficient and effective ways to accelerate the development of an advanced bioenergy industry. The planning and execution of these reviews was completed over the course of 10 months, and this report includes the results of both events.

  1. A quick guide to writing a solid peer review

    Science.gov (United States)

    Nicholas, Kimberly A.; Gordon, Wendy S.

    2011-07-01

    Scientific integrity and consensus rely on the peer review process, a defining feature of scientific discourse that subjects the literature forming the foundation of credible knowledge in a scientific field to rigorous scrutiny. However, there is surprisingly little training in graduate school on how to develop this essential skill [Zimmerman et al., 2011] or discussion of best practices to ensure that reviewers at all levels efficiently provide the most useful review. Even more challenging for the novice peer reviewer is that journals also vary widely in their review guidelines. Nonetheless, the goals of peer review are crystal clear: to ensure the accuracy and improve the quality of published literature through constructive criticism. To make the peer review process as efficient and productive as possible, you may want to consider a few useful approaches to tackling major steps throughout your review, from contemplating a review request and reading and assessing the manuscript to writing the review and interacting with the journal's editors (see Figure 1). These tips are particularly relevant for graduate students or other first-time reviewers, but they may also be useful to experienced reviewers and to journal editors seeking to enhance their publication's processes.

  2. Music research with children and youth with disabilities and typically developing peers: a systematic review.

    Science.gov (United States)

    Brown, Laura S; Jellison, Judith A

    2012-01-01

    Systematic reviews of research provide pertinent information to both practitioners and researchers. While there are several recent reviews of music research and children with specific disabilities (primarily autism), there is no current review of music research with children with a wide variety of disabilities. The aim of the current study is to identify and systematically review music research with children and youth published in peer reviewed journals for the years 1999 through 2009. Research questions focused on participant characteristics; research purposes, methodologies, and findings; as well as the presence of ideas from special education policies, and practices. We also asked how results have changed from those from an earlier review (Jellison, 2000). Using computer and hand-searches, we identified 45 articles that met our criteria for inclusion. Once identified, through a process of consensus we analyzed articles based on criteria, categories, and codes used in the earlier review. Additionally we analyzed measurement instruments and effectiveness of interventions as reported by the authors. Primary findings show a large majority of studies were experimental with most reporting effective or partially effective interventions, particularly for social variables. Compared to the earlier review, increases were found for participants with autism and for reports including ideas from special education. Percentages of articles measuring generalization and examining high-incident disability populations (specific learning disabilities) were low. The findings from this review and comparisons to the earlier review reveal important implications for practices with children with autism and preparation of researchers to design and conduct studies in inclusive music settings.

  3. Biomass Program 2007 Program Peer Review - Program Summary Section

    Energy Technology Data Exchange (ETDEWEB)

    none,

    2009-10-27

    This document summarizes the comments provided by the peer reviewers at the U.S. Department of Energy (DOE) Biomass Program’s Peer Review meeting, held on November 14-15, 2007 in Baltimore, MD and Platform Reviews conducted over the summer of 2007. The Platform Reviews provide evaluations of the Program’s projects in applied research, development, and demonstration.

  4. Policy, Practice, and Research Agenda for Emergency Medical Services Oversight: A Systematic Review and Environmental Scan.

    Science.gov (United States)

    Taymour, Rekar K; Abir, Mahshid; Chamberlin, Margaret; Dunne, Robert B; Lowell, Mark; Wahl, Kathy; Scott, Jacqueline

    2018-02-01

    Introduction In a 2015 report, the Institute of Medicine (IOM; Washington, DC USA), now the National Academy of Medicine (NAM; Washington, DC USA), stated that the field of Emergency Medical Services (EMS) exhibits signs of fragmentation; an absence of system-wide coordination and planning; and a lack of federal, state, and local accountability. The NAM recommended clarifying what roles the federal government, state governments, and local communities play in the oversight and evaluation of EMS system performance, and how they may better work together to improve care. This systematic literature review and environmental scan addresses NAM's recommendations by answering two research questions: (1) what aspects of EMS systems are most measured in the peer-reviewed and grey literatures, and (2) what do these measures and studies suggest for high-quality EMS oversight? To answer these questions, a systematic literature review was conducted in the PubMed (National Center for Biotechnology Information, National Institutes of Health; Bethesda, Maryland USA), Web of Science (Thomson Reuters; New York, New York USA), SCOPUS (Elsevier; Amsterdam, Netherlands), and EMBASE (Elsevier; Amsterdam, Netherlands) databases for peer-reviewed literature and for grey literature; targeted web searches of 10 EMS-related government agencies and professional organizations were performed. Inclusion criteria required peer-reviewed literature to be published between 1966-2016 and grey literature to be published between 1996-2016. A total of 1,476 peer-reviewed titles were reviewed, 76 were retrieved for full-text review, and 58 were retained and coded in the qualitative software Dedoose (Manhattan Beach, California USA) using a codebook of themes. Categorizations of measure type and level of application were assigned to the extracted data. Targeted websites were systematically reviewed and 115 relevant grey literature documents were retrieved. A total of 58 peer-reviewed articles met inclusion

  5. The Power of Peer Reviewing to Enhance Writing in Horticulture: Greenhouse Management

    Science.gov (United States)

    Anderson, Neil O.; Flash, Pamela

    2014-01-01

    Peer review is not included in undergraduate horticultural curricula. Our research objectives in an 8- year study, which ranged from 2000 to 2007 in two sections (2000-2002 non-peer reviewed and 2003-2007 peer-reviewed) of Greenhouse Management students at the University of Minnesota were to determine whether iterative peer reviews would result in…

  6. A Method for Improving the Integrity of Peer Review.

    Science.gov (United States)

    Dadkhah, Mehdi; Kahani, Mohsen; Borchardt, Glenn

    2017-08-15

    Peer review is the most important aspect of reputable journals. Without it, we would be unsure about whether the material published was as valid and reliable as is possible. However, with the advent of the Internet, scientific literature has now become subject to a relatively new phenomenon: fake peer reviews. Some dishonest researchers have been manipulating the peer review process to publish what are often inferior papers. There are even papers that explain how to do it. This paper discusses one of those methods and how editors can defeat it by using a special review ID. This method is easy to understand and can be added to current peer review systems easily.

  7. Improving the peer review process: an examination of commonalities between scholarly societies and knowledge networks

    Directory of Open Access Journals (Sweden)

    Susu Nousala

    2011-08-01

    Full Text Available Whilst peer review is the common form of scholarly refereeing, there are many differing aspects to this process. There is a view that the system is not without its faults and this has given rise to increasing discussion and examination of the process as a whole. Since the importance of peer review is based on the primary way in which quality control is asserted within the academic world, the concern is what impact this is having on an ever increasing diversity of scholarship, in particular, within and between science and engineering disciplines. The peer review process as is commonly understood, and increasingly considered as a conservative approach which is failing to adequately deal with the challenges of assessing interdisciplinary research, publications and outputs.

  8. Potentially coercive self-citation by peer reviewers: a cross-sectional study.

    Science.gov (United States)

    Thombs, Brett D; Levis, Alexander W; Razykov, Ilya; Syamchandra, Achyuth; Leentjens, Albert F G; Levenson, James L; Lumley, Mark A

    2015-01-01

    Peer reviewers sometimes request that authors cite their work, either appropriately or via coercive self-citation to highlight the reviewers' work. The objective of this study was to determine in peer reviews submitted to one biomedical journal (1) the extent of peer reviewer self-citation; (2) the proportion of reviews recommending revision or acceptance versus rejection that included reviewer self-citations; and (3) the proportion of reviewer self-citations versus citations to others that included a rationale. Peer reviews for manuscripts submitted in 2012 to the Journal of Psychosomatic Research were evaluated. Data extraction was performed independently by two investigators. There were 616 peer reviews (526 reviewers; 276 manuscripts), of which 444 recommended revision or acceptance and 172 rejection. Of 428 total citations, there were 122 peer reviewer self-citations (29%) and 306 citations to others' work (71%). Self-citations were more common in reviews recommending revision or acceptance (105 of 316 citations; 33%) versus rejection (17/112; 15%; pcitations with no rationale (26 of 122; 21%) was higher than for citations to others' work (15 of 306; 5%; pcitation in peer reviews is common and may reflect a combination of appropriate citation to research that should be cited in published articles and inappropriate citation intended to highlight the work of the peer reviewer. Providing instructions to peer reviewers about self-citation and asking them to indicate when and why they have self-cited may help to limit self-citation to appropriate, constructive recommendations. Copyright © 2014 Elsevier Inc. All rights reserved.

  9. 7 CFR 3400.10 - Establishment and operation of peer review groups.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3400.10 Establishment and operation of peer review groups. Subject to § 3400.5, the Administrator will adopt procedures for the...

  10. 7 CFR 3401.12 - Establishment and operation of peer review groups.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... GRANTS PROGRAM Scientific Peer Review of Research Applications for Funding § 3401.12 Establishment and operation of peer review groups. Subject to § 3401.7, the Administrator will adopt procedures for the...

  11. 7 CFR 3411.10 - Establishment and operation of peer review groups.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 15 2010-01-01 2010-01-01 false Establishment and operation of peer review groups... INITIATIVE COMPETITIVE GRANTS PROGRAM Scientific Peer Review of Research Grant Applications § 3411.10 Establishment and operation of peer review groups. Subject to § 3411.5, the Administrator shall adopt procedures...

  12. Survey of faculty perceptions regarding a peer review system.

    Science.gov (United States)

    Eisenberg, Ronald L; Cunningham, Meredith L; Siewert, Bettina; Kruskal, Jonathan B

    2014-04-01

    Virtually all radiologists participate in peer review, but to our knowledge, this is the first detailed study of their opinions toward various aspects of the process. The study qualified for quality assurance exemption from the institutional review board. A questionnaire sent to all radiology faculty at our institution assessed their views about peer review in general, as well as case selection and scoring, consensus section review for rating and presentation of errors, and impact on radiologist performance. Of 52 questionnaires sent, 50 were completed (response rate, 96.2%). Of these, 44% agreed that our RADPEER-like system is a waste of time, and 58% believed it is done merely to meet hospital/regulatory requirements. Conversely, 46% agreed that peer review improves radiologist performance, 32% agreed that it decreases medical error, and 42% believed that peer review results are valuable to protect radiologists in cases referred to the medical board. A large majority perform all peer reviews close to the deadline, and substantial minorities frequently or almost always select more than one previous examination for a single medical record number (28%), consciously select "less time intensive" cases (22%), and intentionally avoid cases requiring more time to peer review (30%). Almost one-half of respondents agreed that peer review has value, but as currently performed is a waste of time. The method for selecting cases raises serious questions regarding selection bias. A new approach is needed that stresses education of all radiologists by learning from the mistakes of others. Copyright © 2014 American College of Radiology. Published by Elsevier Inc. All rights reserved.

  13. Peer Review

    DEFF Research Database (Denmark)

    Avital, Michel

    2018-01-01

    that the community’s hunger for publication accompanies only a modest appetite for providing the necessary support to sustain the consequent increase in peer-review load. The advent of blockchain technologies and the proliferation of cryptocurrencies presents an opportunity to develop a token-based peer...

  14. Peer Mentoring and Peer Tutoring among K-12 Students: A Literature Review

    Science.gov (United States)

    Goodrich, Andrew

    2018-01-01

    The purpose of this literature review is to examine research on peer mentoring among K-12 students to assist practitioners with how to incorporate these instructional techniques into their own music programs. Primary themes across the music education literature of peer mentoring include the role of music teachers, the role of students as they…

  15. Academic Primer Series: Key Papers About Peer Review.

    Science.gov (United States)

    Yarris, Lalena M; Gottlieb, Michael; Scott, Kevin; Sampson, Christopher; Rose, Emily; Chan, Teresa M; Ilgen, Jonathan

    2017-06-01

    Peer review, a cornerstone of academia, promotes rigor and relevance in scientific publishing. As educators are encouraged to adopt a more scholarly approach to medical education, peer review is becoming increasingly important. Junior educators both receive the reviews of their peers, and are also asked to participate as reviewers themselves. As such, it is imperative for junior clinician educators to be well-versed in the art of peer reviewing their colleagues' work. In this article, our goal was to identify and summarize key papers that may be helpful for faculty members interested in learning more about the peer-review process and how to improve their reviewing skills. The online discussions of the 2016-17 Academic Life in Emergency Medicine (ALiEM) Faculty Incubator program included a robust discussion about peer review, which highlighted a number of papers on that topic. We sought to augment this list with further suggestions by guest experts and by an open call on Twitter for other important papers. Via this process, we created a list of 24 total papers on the topic of peer review. After gathering these papers, our authorship group engaged in a consensus-building process incorporating Delphi methods to identify the papers that best described peer review, and also highlighted important tips for new reviewers. We found and reviewed 24 papers. In our results section, we present our authorship group's top five most highly rated papers on the topic of peer review. We also summarize these papers with respect to their relevance to junior faculty members and to faculty developers. We present five key papers on peer review that can be used for faculty development for novice writers and reviewers. These papers represent a mix of foundational and explanatory papers that may provide some basis from which junior faculty members might build upon as they both undergo the peer-review process and act as reviewers in turn.

  16. Readers' evaluation of effect of peer review and editing on quality of articles in the Nederlands Tijdschrift voor Geneeskunde.

    Science.gov (United States)

    Pierie, J P; Walvoort, H C; Overbeke, A J

    1996-11-30

    Academic biomedical journals use peer review and editing to help to select and improve the quality of articles. We have investigated whether articles accepted by the Nederlands Tijdschrift voor Geneeskunde, the Dutch Journal of Medicine, were improved after peer review and editing (post-acceptance scientific and copy editing). 400 readers of the journal (100 each of medical students, recent medical graduates, general practitioners, and specialists) were invited to participate in a questionnaire survey. The first 25 from each group who agreed to participate were included. We posted a pack containing a set of identically appearing typescripts (ie, blinding) of the submitted, accepted, and published versions of 50 articles that had been published in Ned Tijdschr Geneeskd. Each evaluator received two of the sets of versions, and each set was evaluated by one person from each group. The package also included two questionnaires: the first was used to compare the submitted with the accepted version (25 questions), the second compared the accepted with the published version (17 questions). The questions were answered on five-point scales, and were about the quality of the articles or were general/overall scores. We analysed the data as scores of 3-5 (ie, improvement) versus 1-2. After peer review, the quality in 14 of 23 questions (61%) was significantly improved (p = 0.03 or smaller). In particular, the overall score and general medical value were significantly improved (p = 0.00001 for each). Editing led to significant improvement in 11 of 16 questions (69%, p = 0.017 or smaller), and especially in style and readability (p = 0.001 and p = 0.004). Generally, we found no differences between the scores of the four categories of evaluators. 72% of the evaluators correctly identified which version was which. Evaluations by readers of the Ned Tijdschr Geneeskd indicated significant improvement of published articles after both peer review and editing. We think that peer review

  17. o'Peer: open peer review

    Science.gov (United States)

    Brewer, J. H.

    2014-12-01

    I have built a "demonstration" website at http://oPeer.org to illustrate how peer review and publication might be improved relative to the current model, which was designed and implemented in an era when scientific communication was either face-to-face or relied upon human delivery of ink marks on dead trees.

  18. MATIN: a random network coding based framework for high quality peer-to-peer live video streaming.

    Science.gov (United States)

    Barekatain, Behrang; Khezrimotlagh, Dariush; Aizaini Maarof, Mohd; Ghaeini, Hamid Reza; Salleh, Shaharuddin; Quintana, Alfonso Ariza; Akbari, Behzad; Cabrera, Alicia Triviño

    2013-01-01

    In recent years, Random Network Coding (RNC) has emerged as a promising solution for efficient Peer-to-Peer (P2P) video multicasting over the Internet. This probably refers to this fact that RNC noticeably increases the error resiliency and throughput of the network. However, high transmission overhead arising from sending large coefficients vector as header has been the most important challenge of the RNC. Moreover, due to employing the Gauss-Jordan elimination method, considerable computational complexity can be imposed on peers in decoding the encoded blocks and checking linear dependency among the coefficients vectors. In order to address these challenges, this study introduces MATIN which is a random network coding based framework for efficient P2P video streaming. The MATIN includes a novel coefficients matrix generation method so that there is no linear dependency in the generated coefficients matrix. Using the proposed framework, each peer encapsulates one instead of n coefficients entries into the generated encoded packet which results in very low transmission overhead. It is also possible to obtain the inverted coefficients matrix using a bit number of simple arithmetic operations. In this regard, peers sustain very low computational complexities. As a result, the MATIN permits random network coding to be more efficient in P2P video streaming systems. The results obtained from simulation using OMNET++ show that it substantially outperforms the RNC which uses the Gauss-Jordan elimination method by providing better video quality on peers in terms of the four important performance metrics including video distortion, dependency distortion, End-to-End delay and Initial Startup delay.

  19. Social Peer Interactions in Persons with Profound Intellectual and Multiple Disabilities: A Literature Review

    Science.gov (United States)

    Nijs, Sara; Maes, Bea

    2014-01-01

    Social interactions may positively influence developmental and quality of life outcomes. Research in persons with profound intellectual and multiple disabilities (PIMD) mostly investigated interactions with caregivers. This literature review focuses on peer interactions of persons with PIMD. A computerized literature search of three databases was…

  20. The Dedisciplining of Peer Review

    Science.gov (United States)

    Frodeman, Robert; Briggle, Adam

    2012-01-01

    The demand for greater public accountability is changing the nature of ex ante peer review at public science agencies worldwide. Based on a four year research project, this essay examines these changes through an analysis of the process of grant proposal review at two US public science agencies, the National Institutes of Health (NIH) and the…

  1. 28 CFR 34.102 - Peer review procedures.

    Science.gov (United States)

    2010-07-01

    ... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Peer review procedures. 34.102 Section 34.102 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34.102 Peer review procedures. The OJJDP peer review process is contained in an OJJDP “Peer...

  2. Proposals for the writing of peer reviews in lexicography

    DEFF Research Database (Denmark)

    Bergenholtz, Henning; Gouws, Rufus

    2015-01-01

    In lexicography a good review is important for the dictionary maker(s), the publishing house and the whole lexicographical community. It is also important for the reviewers because it can expand their research record. Up to a few years ago reviews were still acknowledged in research databases...... regarding ethical aspects. But there are essential differences. These issues are discussed in this paper and some methodological and ethical proposals for peer reviews are made. One of the proposals could create a debate because it argues for an open peer review process and not for the so-called double...

  3. Clinical Nurse Specialists Guide Staff Nurses to Promote Practice Accountability Through Peer Review.

    Science.gov (United States)

    Semper, Julie; Halvorson, Betty; Hersh, Mary; Torres, Clare; Lillington, Linda

    2016-01-01

    The aim of the study was to describe the clinical nurse specialist role in developing and implementing a staff nurse education program to promote practice accountability using peer review principles. Peer review is essential for professional nursing practice demanding a significant culture change. Clinical nurse specialists in a Magnet-designated community hospital were charged with developing a staff nurse peer review education program. Peer review is a recognized mechanism of professional self-regulation to ensure delivery of quality care. The American Nurses Association strongly urges incorporating peer review in professional nursing practice models. Clinical nurse specialists play a critical role in educating staff nurses about practice accountability. Clinical nurse specialists developed an education program guided by the American Nurses Association's principles of peer review. A baseline needs assessment identified potential barriers and learning needs. Content incorporated tools and strategies to build communication skills, collaboration, practice change, and peer accountability. The education program resulted in increased staff nurse knowledge about peer review and application of peer review principles in practice. Clinical nurse specialists played a critical role in helping staff nurses understand peer review and its application to practice. The clinical nurse specialist role will continue to be important in sustaining the application of peer review principles in practice.

  4. Online Peer-to-Peer Communities in the Daily Lives of People With Chronic Illness: A Qualitative Systematic Review.

    Science.gov (United States)

    Kingod, Natasja; Cleal, Bryan; Wahlberg, Ayo; Husted, Gitte R

    2017-01-01

    This qualitative systematic review investigated how individuals with chronic illness experience online peer-to-peer support and how their experiences influence daily life with illness. Selected studies were appraised by quality criteria focused upon research questions and study design, participant selection, methods of data collection, and methods of analysis. Four themes were identified: (a) illness-associated identity work, (b) social support and connectivity, (c) experiential knowledge sharing, and (d) collective voice and mobilization. Findings indicate that online peer-to-peer communities provide a supportive space for daily self-care related to chronic illness. Online communities provided a valued space to strengthen social ties and exchange knowledge that supported offline ties and patient-doctor relationships. Individuals used online communities to exchange experiential knowledge about everyday life with illness. This type of knowledge was perceived as extending far beyond medical care. Online communities were also used to mobilize and raise collective awareness about illness-specific concerns. © The Author(s) 2016.

  5. How do I peer-review a scientific article?—a personal perspective

    Science.gov (United States)

    2018-01-01

    Peer-review is an essential activity for the vast majority of credited scientific journals and represents the cornerstone for assessing the quality of potential publications, since it is substantially aimed to identify drawbacks or inaccuracies that may flaw the outcome or the presentation of scientific research. Since the importance of this activity is seldom underestimated by some referees, the purpose of this article is to present a personal and arbitrary perspective on how a scientific article should be peer-reviewed, offering a tentative checklist aimed to describe the most important criteria that should be considered. These basically include accepting the assignment only when the topic is in accordance with referee’s background, disclosing potential conflicts of interest, checking availability and time according to size and complexity of the article, identifying the innovative value of the manuscript, providing exhaustive and clear comments, expressing disagreement with a fair and balanced approach, weighting revisions according to the importance of the journal, summarizing recommendations according to previous comments, maintaining confidentiality throughout and after the peer-review process. I really hope that some notions reported in this dissertation may be a guide or a help, especially for young scientists, who are willing to be engaged in peer-review activity for scientific journals. PMID:29610756

  6. EERE Peer Review Guide - August 2004

    Energy Technology Data Exchange (ETDEWEB)

    None

    2009-01-18

    Provides guidance in establishing formal in-progress peer review that provides intellectually fair expert evaluation of EERE research, development, demonstration, & deployment (supporting business administration) programs, both retrospective and pr

  7. Cyberbullying Prevalence among United States Middle and High School Aged Adolescents: A Systematic Review and Quality Assessment

    Science.gov (United States)

    Selkie, Ellen M.; Fales, Jessica L.; Moreno, Megan A.

    2015-01-01

    Background Cyberbullying has established links to physical and mental health problems including depression, suicidality, substance use, and somatic symptoms. Quality reporting of cyberbullying prevalence is essential to guide evidence-based policy and prevention priorities. The purpose of this systematic review was to investigate study quality and reported prevalence among cyberbullying research studies conducted in populations of US adolescents of middle and high school age. Methods Searches of peer-reviewed literature published through June 2015 for “cyberbullying” and related terms were conducted using PubMed, PsycINFO, CINAHL Plus, and Web of Science. Included manuscripts reported cyberbullying prevalence in general populations of U.S. adolescents between the ages of 10 and 19. Using a review tool based on the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement, reviewers independently scored study quality on study methods, results reporting, and reported prevalence. Results Search results yielded 1,447 manuscripts; 81 manuscripts representing 58 unique studies were identified as meeting inclusion criteria. Quality scores ranged between 12 and 37 total points out of a possible 42 points (M = 26.7, SD = 4.6). Prevalence rates of cyberbullying ranged as follows: perpetration, 1% to 41%; victimization, 3% to 72%; and overlapping perpetration and victimization, 2.3% to 16.7%. Conclusions Literature on cyberbullying in US middle and high school aged students is robust in quantity but inconsistent in quality and reported prevalence. Consistent definitions and evidence-based measurement tools are needed. PMID:26576821

  8. A Review of Peer Social Development in Early Childhood.

    Science.gov (United States)

    Goin, Robin P.

    1998-01-01

    Reviews the literature on young children's peer social development. Addresses implications of social learning theory and empirical research. Discusses recurring themes, including child/peer versus child/adult interactions, incorporation of toys and games, influence of mothers, and gender peer preferences. Considers areas lacking empirical support…

  9. 40 CFR 194.27 - Peer review.

    Science.gov (United States)

    2010-07-01

    ... 40 Protection of Environment 24 2010-07-01 2010-07-01 false Peer review. 194.27 Section 194.27... § 194.27 Peer review. (a) Any compliance application shall include documentation of peer review that has... barrier evaluation as required in § 194.44. (b) Peer review processes required in paragraph (a) of this...

  10. 45 CFR 1388.9 - Peer review.

    Science.gov (United States)

    2010-10-01

    ... 45 Public Welfare 4 2010-10-01 2010-10-01 false Peer review. 1388.9 Section 1388.9 Public Welfare... PROGRAM THE UNIVERSITY AFFILIATED PROGRAMS § 1388.9 Peer review. (a) The purpose of the peer review... D, Section 152 of the Act, must be evaluated through the peer review process. (c) Panels must be...

  11. The Potential of Peer Review

    Science.gov (United States)

    Johnson, Susan Moore; Fiarman, Sarah E.

    2012-01-01

    Peer review of teachers is controversial for several reasons. Some say peer reviewers encroach on the rightful domain of the principal as instructional leader. Others argue that, because peer evaluators are fellow teachers, they may be biased or unwilling to make hard decisions. Many teachers find the prospect of peer evaluation unsettling because…

  12. Peer Review: Has It a Future?

    Science.gov (United States)

    Soh, Kay Cheng

    2013-01-01

    Although its history is short, peer review has fast become a fixture of journal publications acquiring the status of a ritual in the academia. Many relevant and important issues have been raised leading to doubts about the value of peer review. The advent of electronic publishing further threatens the future of peer review. For peer review to…

  13. MATIN: a random network coding based framework for high quality peer-to-peer live video streaming.

    Directory of Open Access Journals (Sweden)

    Behrang Barekatain

    Full Text Available In recent years, Random Network Coding (RNC has emerged as a promising solution for efficient Peer-to-Peer (P2P video multicasting over the Internet. This probably refers to this fact that RNC noticeably increases the error resiliency and throughput of the network. However, high transmission overhead arising from sending large coefficients vector as header has been the most important challenge of the RNC. Moreover, due to employing the Gauss-Jordan elimination method, considerable computational complexity can be imposed on peers in decoding the encoded blocks and checking linear dependency among the coefficients vectors. In order to address these challenges, this study introduces MATIN which is a random network coding based framework for efficient P2P video streaming. The MATIN includes a novel coefficients matrix generation method so that there is no linear dependency in the generated coefficients matrix. Using the proposed framework, each peer encapsulates one instead of n coefficients entries into the generated encoded packet which results in very low transmission overhead. It is also possible to obtain the inverted coefficients matrix using a bit number of simple arithmetic operations. In this regard, peers sustain very low computational complexities. As a result, the MATIN permits random network coding to be more efficient in P2P video streaming systems. The results obtained from simulation using OMNET++ show that it substantially outperforms the RNC which uses the Gauss-Jordan elimination method by providing better video quality on peers in terms of the four important performance metrics including video distortion, dependency distortion, End-to-End delay and Initial Startup delay.

  14. Revised White House Peer Review Guidelines Draw Generally Favorable Respons

    Science.gov (United States)

    Showstack, Randy

    2004-04-01

    A new bulletin from the White House Office of Management and Budget outlines minimum standards for peer review of scientific information that includes findings representing an official position of a department or agency of the federal government. The OMB Revised Information Quality Bulletin for Peer Review, released on 15 April, substantially modifies a previous draft issued on 15 September 2003, which some had criticized as restrictive and imbalanced.

  15. Scholarly publishing depends on peer reviewers.

    Science.gov (United States)

    Fernandez-Llimos, Fernando

    2018-01-01

    The peer-review crisis is posing a risk to the scholarly peer-reviewed journal system. Journals have to ask many potential peer reviewers to obtain a minimum acceptable number of peers accepting reviewing a manuscript. Several solutions have been suggested to overcome this shortage. From reimbursing for the job, to eliminating pre-publication reviews, one cannot predict which is more dangerous for the future of scholarly publishing. And, why not acknowledging their contribution to the final version of the article published? PubMed created two categories of contributors: authors [AU] and collaborators [IR]. Why not a third category for the peer-reviewer?

  16. Navigating manuscript assessment: The new practitioner's guide to primary literature peer review.

    Science.gov (United States)

    Smith, Devlin V; Stokes, Laura B; Marx, Kayleigh; Aitken, Samuel L

    2018-01-01

    For pharmacists, the first years after graduation are spent developing their knowledge base, advancing as a practitioner, and honing their abilities as healthcare providers and drug information experts. New practitioners encounter many challenges during this time, which for many include publishing original research or reviewing manuscripts for colleagues and medical journals. Inexperience navigating the publication process, from submission to receipt of (and response to) peer review commentary, is often cited as a major barrier to timely publication of resident and new practitioner research. Serving as a peer reviewer in turn provides the new practitioner with insight on this process and can be an enlightening experience used to garner confidence in subsequently submitting their own formal manuscripts. A number of publications describing steps for peer review are available, however, many of these articles address more experienced reviewers or critique the peer review process itself. No definitive resource exists for new pharmacy practitioners interested in developing their peer review skills. The information presented in this summative guide should be used in conjunction with practice opportunities to help new practitioners develop proficiency at peer review.

  17. Blinding Applicants in a First-Stage Peer-Review Process of Biomedical Research Grants: An Observational Study

    Science.gov (United States)

    Solans-Domènech, Maite; Guillamón, Imma; Ribera, Aida; Ferreira-González, Ignacio; Carrion, Carme; Permanyer-Miralda, Gaietà; Pons, Joan M. V.

    2017-01-01

    To blind or not researcher's identity has often been a topic of debate in the context of peer-review process for scientific publication and research grant application. This article reports on how knowing the name and experience of researchers/institutions influences the qualification of a proposal. We present our experience of managing the…

  18. State technical review of the HLNW program and the peer review process

    International Nuclear Information System (INIS)

    Jacob, G.R.

    1986-01-01

    Millions of dollars are being spent on state governments' review of the Department of Energy (DOE) high level waste (HLW) repository program. A significant portion of the review efforts focus on technical issues surrounding the development and installment of HLW disposal technologies. Some view the states' technical review efforts as part of a peer review process. However, this interpretation reveals a misunderstanding of the concept of peer review and the purposes of state technical review

  19. Snappy answers to stupid questions: an evidence-based framework for responding to peer-review feedback

    Science.gov (United States)

    Rosenfield, Daniel; Hoffman, Steven J.

    2009-01-01

    Background Authors are inundated with feedback from peer reviewers. Although this feedback is usually helpful, it can also be incomprehensible, rude or plain silly. Inspired by Al Jaffe’s classic comic from Mad Magazine, we sought to develop an evidenced-based framework for providing “snappy answers to stupid questions,” in the hope of aiding emerging academics in responding appropriately to feedback from peer review. Methods We solicited, categorized and analyzed examples of silly feedback from peer reviewers using the grounded theory qualitative research paradigm from 50 key informants. The informants represented 15 different professions, 33 institutions and 11 countries (i.e., Australia, Barbados, Canada, Germany, Japan, New Zealand, South Africa, Sweden, Switzerland, UK and USA). Results We developed a Scale of Silliness (SOS) and a Scale of Belligerence (SOB) to facilitate the assessment of inadequate peer-review feedback and guide users in preparing suitable responses to it. The SOB score is tempered by users’ current mood, as captured by the Mood Reflective Index (MRI), and dictates the Appropriate Degree of Response (ADR) for the particular situation. Conclusion Designed using the highest quality of (most easily accessible anecdotal) evidence available, this framework may fill a significant gap in the research literature by helping emerging academics respond to silly feedback from peer reviewers. Although use of the framework to its full extent may have negative consequences (e.g., loss of promotion), its therapeutic value cannot be understated. PMID:19969574

  20. The effects of an editor serving as one of the reviewers during the peer-review process.

    Science.gov (United States)

    Giordan, Marco; Csikasz-Nagy, Attila; Collings, Andrew M; Vaggi, Federico

    2016-01-01

    Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications. Methods Here we examine an element of the editorial process at eLife , in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail.   Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405) and five days faster for papers that were rejected after peer review (n=1,099). Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant) effect on citation rates. Conclusions An important aspect of eLife 's peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.

  1. Scholarly publishing depends on peer reviewers

    Directory of Open Access Journals (Sweden)

    Fernandez-Llimos F

    2018-03-01

    Full Text Available The peer-review crisis is posing a risk to the scholarly peer-reviewed journal system. Journals have to ask many potential peer reviewers to obtain a minimum acceptable number of peers accepting reviewing a manuscript. Several solutions have been suggested to overcome this shortage. From reimbursing for the job, to eliminating pre-publication reviews, one cannot predict which is more dangerous for the future of scholarly publishing. And, why not acknowledging their contribution to the final version of the article published? PubMed created two categories of contributors: authors [AU] and collaborators [IR]. Why not a third category for the peer-reviewer?

  2. Peer-review Platform for Astronomy Education Activities

    Science.gov (United States)

    Heenatigala, Thilina; Russo, Pedro; Gomez, Edward; Strubbe, Linda

    2015-08-01

    Astronomy educators and teachers worldwide commonly request and search for high-quality astronomy activities to do with their students. Hundreds of astronomy education activities exist, as well as many resource repositories to find them. However, the quality of such resources is highly variable as they are not updated regularly or limited with content review. Since its launch in 2013, astroEDU has been addressing these issues and more by following a peer-review process. Each activity submitted is reviewed by an educator and a professional astronomer, balancing both the scientific and educational value of the content. Moreover, the majority of the reviewers are invited from IAU commissions related to the field of the activity, as an effort to get IAU members actively involved in the project. The website code, activities and layout design are open-access in order to make them accessible and adoptable for educators around the world. Furthermore the platform harnesses the OAD volunteer database to develop existing astronomy education activities into the astroEDU activity format. Published activities are also pushed to partner repositories and each activity is registered for DOI, allowing authors to cite their work. To further test the activities and improve the platform, astroEDU editorial team organises workshops.

  3. NCI Consumers Guide to Peer Review

    Science.gov (United States)

    To define the role consumer advocate in the peer review of applications that support extramural clinical and population-based research and clinical career development and training by various grant and cooperative agreement mechanisms.

  4. Improving the Quality of Constructive Peer Feedback

    Science.gov (United States)

    Waggoner Denton, Ashley

    2018-01-01

    This article presents some simple strategies that instructors can use to improve the quality of the feedback students provide each other during a peer review activity. Briefly, I recommend that emphasis be placed solely on the provision of constructive comments, and that in order to qualify as constructive, a comment must: (1) identify a specific…

  5. Fragments of peer review: A quantitative analysis of the literature (1969-2015)

    Science.gov (United States)

    Grimaldo, Francisco; Marušić, Ana

    2018-01-01

    This paper examines research on peer review between 1969 and 2015 by looking at records indexed from the Scopus database. Although it is often argued that peer review has been poorly investigated, we found that the number of publications in this field doubled from 2005. A half of this work was indexed as research articles, a third as editorial notes and literature reviews and the rest were book chapters or letters. We identified the most prolific and influential scholars, the most cited publications and the most important journals in the field. Co-authorship network analysis showed that research on peer review is fragmented, with the largest group of co-authors including only 2.1% of the whole community. Co-citation network analysis indicated a fragmented structure also in terms of knowledge. This shows that despite its central role in research, peer review has been examined only through small-scale research projects. Our findings would suggest that there is need to encourage collaboration and knowledge sharing across different research communities. PMID:29466467

  6. Rewarding peer reviewers: maintaining the integrity of science communication.

    Science.gov (United States)

    Gasparyan, Armen Yuri; Gerasimov, Alexey N; Voronov, Alexander A; Kitas, George D

    2015-04-01

    This article overviews currently available options for rewarding peer reviewers. Rewards and incentives may help maintain the quality and integrity of scholarly publications. Publishers around the world implemented a variety of financial and nonfinancial mechanisms for incentivizing their best reviewers. None of these is proved effective on its own. A strategy of combined rewards and credits for the reviewers1 creative contributions seems a workable solution. Opening access to reviews and assigning publication credits to the best reviews is one of the latest achievements of digitization. Reviews, posted on academic networking platforms, such as Publons, add to the transparency of the whole system of peer review. Reviewer credits, properly counted and displayed on individual digital profiles, help distinguish the best contributors, invite them to review and offer responsible editorial posts.

  7. Technology-Enhanced Peer Review: Benefits and Implications of Providing Multiple Reviews

    DEFF Research Database (Denmark)

    Papadopoulos, Pantelis M.; Lagkas, Thomas D.; Demetriadis, Stavros N.

    2017-01-01

    This study analyses the impact of self and peer feedback in technology-enhanced peer review settings. The impact of receiving peer comments (“receiver” perspective) is compared to that of reaching own insights by reviewing others’ work (“giver” perspective). In this study, 38 sophomore students...... were randomly assigned in two conditions and engaged in peer review activity facilitated by a web-based learning environment asking them to provide multiple reviews. In the Peer Reviewed (PR) condition students both reviewed peer work and received peer comments for their own work. By contrast......, in the Self Reviewed (SR) condition students provided peer reviews, but did not receive any. Instead, they were asked to perform self reviewing, before proceeding to any revisions of their work. Result showed that the two groups were comparable in all aspects, suggesting that the lack of getting peer reviews...

  8. How peer-review constrains cognition: on the frontline in the knowledge sector.

    Science.gov (United States)

    Cowley, Stephen J

    2015-01-01

    Peer-review is neither reliable, fair, nor a valid basis for predicting 'impact': as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as 'cognition' describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as 'symbolizations', replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper's own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper's knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered 'real' science but also its 'post-academic' counterparts.

  9. Turnitin and Peer Review in ESL Academic Writing Classrooms

    Science.gov (United States)

    Li, Jinrong; Li, Mimi

    2018-01-01

    Despite the benefits of peer review, there are still challenges that need to be addressed to make it more effective for L2 students. With the development of technology, computer-mediated peer review has captured increasing attention from L2 writing researchers and instructors. While Turnitin is known for its use in detecting plagiarism, its newly…

  10. "Are you gonna publish that?" Peer-reviewed publication outcomes of doctoral dissertations in psychology.

    Science.gov (United States)

    Evans, Spencer C; Amaro, Christina M; Herbert, Robyn; Blossom, Jennifer B; Roberts, Michael C

    2018-01-01

    If a doctoral dissertation represents an original investigation that makes a contribution to one's field, then dissertation research could, and arguably should, be disseminated into the scientific literature. However, the extent and nature of dissertation publication remains largely unknown within psychology. The present study investigated the peer-reviewed publication outcomes of psychology dissertation research in the United States. Additionally, we examined publication lag, scientific impact, and variations across subfields. To investigate these questions, we first drew a stratified random cohort sample of 910 psychology Ph.D. dissertations from ProQuest Dissertations & Theses. Next, we conducted comprehensive literature searches for peer-reviewed journal articles derived from these dissertations published 0-7 years thereafter. Published dissertation articles were coded for their bibliographic details, citation rates, and journal impact metrics. Results showed that only one-quarter (25.6% [95% CI: 23.0, 28.4]) of dissertations were ultimately published in peer-reviewed journals, with significant variations across subfields (range: 10.1 to 59.4%). Rates of dissertation publication were lower in professional/applied subfields (e.g., clinical, counseling) compared to research/academic subfields (e.g., experimental, cognitive). When dissertations were published, however, they often appeared in influential journals (e.g., Thomson Reuters Impact Factor M = 2.84 [2.45, 3.23], 5-year Impact Factor M = 3.49 [3.07, 3.90]) and were cited numerous times (Web of Science citations per year M = 3.65 [2.88, 4.42]). Publication typically occurred within 2-3 years after the dissertation year. Overall, these results indicate that the large majority of Ph.D. dissertation research in psychology does not get disseminated into the peer-reviewed literature. The non-publication of dissertation research appears to be a systemic problem affecting both research and training in psychology

  11. Peer reviewing – a responsibility and a power of the university?

    OpenAIRE

    Smedsrød, Bård; Reierth, Eirik; Moksness, Lars; Longva, Leif

    2016-01-01

    Watch the VIDEO of the presentation.Journal coordinated peer reviewing, a hallmark of scholarly publishing, is also a pivotal part of other central academic processes, such as evaluation of research grant applications, and ranking of applicants for faculty/research positions. Hence, journal coordinated peer reviewing may be viewed as “the mother of academic peer reviewing”. On this background, it is astonishing that universities and other public R&D institutions take only a very limited inter...

  12. Peer Review of Teaching

    OpenAIRE

    Fernandez, Charles E.; Yu, Jenny

    2007-01-01

    This article provides an overview and description of peer review of teaching for faculty members and administrators who would like to implement a peer review program. This may include classroom and clinical settings. A brief overview, procedure, and a teaching competence evaluation rubric are provided

  13. On the Nature and Role of Peer Review in Mathematics.

    Science.gov (United States)

    Andersen, Line Edslev

    2017-01-01

    For the past three decades, peer review practices have received much attention in the literature. But although this literature covers many research fields, only one previous systematic study has been devoted to the practice of peer review in mathematics, namely a study by Geist, Löwe, and Van Kerkhove from 2010. This lack of attention may be due to a view that peer review in mathematics is more reliable, and therefore less interesting as an object of study, than peer review in other fields. In fact, Geist, Löwe, and Van Kerkhove argue that peer review in mathematics is relatively reliable. At the same time, peer review in mathematics differs from peer review in most, if not all, other fields in that papers submitted to mathematical journals are usually only reviewed by a single referee. Furthermore, recent empirical studies indicate that the referees do not check the papers line by line. I argue that, in spite of this, mathematical practice in general and refereeing practices in particular are such that the common practice of mathematical journals of using just one referee is justified from the point of view of proof validity assessment. The argument is based on interviews I conducted with seven mathematicians.

  14. Scientometric analysis: A technical need for medical science researchers either as authors or as peer reviewers.

    Science.gov (United States)

    Masic, Izet

    2016-01-01

    The nature of performing a scientific research is a process that has several different components which consist of identifying the key research question(s), choices of scientific approach for the study and data collection, data analysis, and finally reporting on results. Generally, peer review is a series of procedures in the evaluation of a creative work or performance by other people, who work in the same or related field, with the aim of maintaining and improving the quality of work or performance in that field. The assessment of the achievement of every scientist, and thus indirectly determining his reputation in the scientific community of these publications, especially journals, is done through the so-called impact factor index. The impact factor predicts or estimates that how many annual citations article may receive after its publication. Evaluation of scientific productivity and assessment of the published articles of researchers and scientists can be made through the so-called H-index. The quality of published results of scientific work largely depends on knowledge sources that are used in the preparation, which means that it should be considered to serve the purpose and the very relevance of the information used. Scientometrics as a field of science covers all aforementioned issues, and scientometric analysis is obligatory for quality assessment of the scientific validity of published articles and other type of publications.

  15. The ethics of peer review in bioethics

    Science.gov (United States)

    Wendler, David; Miller, Franklin

    2014-01-01

    A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. PMID:24131903

  16. Transformation of Adolescent Peer Relations in the Social Media Context: Part 2-Application to Peer Group Processes and Future Directions for Research.

    Science.gov (United States)

    Nesi, Jacqueline; Choukas-Bradley, Sophia; Prinstein, Mitchell J

    2018-04-07

    As social media use becomes increasingly widespread among adolescents, research in this area has accumulated rapidly. Researchers have shown a growing interest in the impact of social media on adolescents' peer experiences, including the ways that the social media context shapes a variety of peer relations constructs. This paper represents Part 2 of a two-part theoretical review. In this review, we offer a new model for understanding the transformative role of social media in adolescents' peer experiences, with the goal of stimulating future empirical work that is grounded in theory. The transformation framework suggests that the features of the social media context transform adolescents' peer experiences by changing their frequency or immediacy, amplifying demands, altering their qualitative nature, and/or offering new opportunities for compensatory or novel behaviors. In the current paper, we consider the ways that social media may transform peer relations constructs that often occur at the group level. Our review focuses on three key constructs: peer victimization, peer status, and peer influence. We selectively review and highlight existing evidence for the transformation of these domains through social media. In addition, we discuss methodological considerations and key conceptual principles for future work. The current framework offers a new theoretical perspective through which peer relations researchers may consider adolescent social media use.

  17. Maintaining Live Discussion in Two-Stage Open Peer Review

    Science.gov (United States)

    Sandewall, Erik

    2011-01-01

    Open peer review has been proposed for a number of reasons, in particular, for increasing the transparency of the article selection process for a journal, and for obtaining a broader basis for feedback to the authors and for the acceptance decision. The review discussion may also in itself have a value for the research community. These goals rely on the existence of a lively review discussion, but several experiments with open-process peer review in recent years have encountered the problem of faltering review discussions. The present article addresses the question of how lively review discussion may be fostered by relating the experience of the journal Electronic Transactions on Artificial Intelligence (ETAI) which was an early experiment with open peer review. Factors influencing the discussion activity are identified. It is observed that it is more difficult to obtain lively discussion when the number of contributed articles increases, which implies difficulties for scaling up the open peer review model. Suggestions are made for how this difficulty may be overcome. PMID:22363282

  18. 42 CFR 24.5 - Peer review.

    Science.gov (United States)

    2010-10-01

    ... 42 Public Health 1 2010-10-01 2010-10-01 false Peer review. 24.5 Section 24.5 Public Health PUBLIC....5 Peer review. An individual may not be considered for appointment into the SBRS unless his/her qualifications have been reviewed by a PHS peer review committee and the committee has recommended appointment to...

  19. The changing face of peer review

    Directory of Open Access Journals (Sweden)

    Irene Hames

    2014-02-01

    Full Text Available It is a time of great innovation in peer review. Traditional models are being adapted and completely new ones introduced. Independent peer-review services are also starting to be offered by organizations outside the traditional journal ecosphere. In both new and established systems, the importance of increasing openness, transparency, and interaction between peer-review participants is being recognized, and these are being introduced to varying degrees. Concern with the ‘wastage’ of review effort in traditional peer review, where manuscripts often go from journal to journal, being reviewed afresh at each, before being accepted for publication, is also being addressed. Reviews are being transferred (‘cascaded’ and shared between some journals. The separation of the two basic functions of peer review—critical review and selection—as originally introduced by the journal PLOS ONE has been a major innovation, leading to the publication of sound work irrespective of its perceived novelty, interest, or importance. Post-publication review is also becoming more important and is another growth area. The concept of ‘portable’ reviews has been introduced, where authors can take reviews with them—either after they have obtained them from a peer-review provider in return for a fee or had their manuscript reviewed and declined at some journals—and include them with submissions to journals. The dynamics of publication are changing alongside, with journals able to ‘bid’ for papers that have been reviewed by independent organizations and make publishing offers to the authors. A number of innovations and ‘alternative’ peer-review models are described. They all, however, face many of the same issues as traditional peer review, and the same basic principles of good and ethical practice apply.

  20. Peer reviews: taking on new meanings.

    Science.gov (United States)

    Raia, Lucille

    2011-01-01

    Peer reviews in nursing are historically used to gauge performance within an individual's scope of practice or as a tool to evaluate a sentinel or adverse event. Quality of care measures, clinical pertinence, and evaluating standards of care have begun as parallel strategies to replace the former uses in assuring the right care at the right time in the right setting.

  1. o'Peer: open peer review

    International Nuclear Information System (INIS)

    Brewer, J H

    2014-01-01

    I have built a ''demonstration'' website at http://oPeer.org to illustrate how peer review and publication might be improved relative to the current model, which was designed and implemented in an era when scientific communication was either face-to-face or relied upon human delivery of ink marks on dead trees

  2. Peer Observation and Evaluation Tool (POET: A Formative Peer Review Supporting Scholarly Teaching

    Directory of Open Access Journals (Sweden)

    Jeffrey L. Crabtree

    2016-07-01

    Full Text Available The Peer Observation and Evaluation Tool (POET is a valid and reliable measure developed for formative peer evaluation of pharmacy faculty. The authors replicated a study conducted on the POET in pharmacy in order to report the instrument’s validity and reliability in occupational therapy and to explore its potential as a formative teaching evaluation for occupational therapy educators. To verify item importance, seven participants from the faculty in an occupational therapy department rated each item. To establish inter-rater reliability, the participants evaluated one videotaped 55 min lecture. The POET was reliable with ICC at 0.93. There were high levels of agreement with the importance ratings among the participants with all scales. The POET appears to be a valid and reliable formative measure of teaching. At a time of significant change in the level of occupational therapy education, this measure may be an important support for scholarly teaching in two ways: First, this measure offers several opportunities to document the instructor’s strengths and, second, it offers the instructor suggestions about ways to improve teaching quality. Finally, the POET may facilitate faculty professional growth and development through systematic, strategic, and constructive peer review feedback.

  3. Gender bias in scholarly peer review.

    Science.gov (United States)

    Helmer, Markus; Schottdorf, Manuel; Neef, Andreas; Battaglia, Demian

    2017-03-21

    Peer review is the cornerstone of scholarly publishing and it is essential that peer reviewers are appointed on the basis of their expertise alone. However, it is difficult to check for any bias in the peer-review process because the identity of peer reviewers generally remains confidential. Here, using public information about the identities of 9000 editors and 43000 reviewers from the Frontiers series of journals, we show that women are underrepresented in the peer-review process, that editors of both genders operate with substantial same-gender preference (homophily), and that the mechanisms of this homophily are gender-dependent. We also show that homophily will persist even if numerical parity between genders is reached, highlighting the need for increased efforts to combat subtler forms of gender bias in scholarly publishing.

  4. How peer-review constrains cognition: on the frontline in the knowledge sector

    Science.gov (United States)

    Cowley, Stephen J.

    2015-01-01

    Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Endorsing the consensus, I offer a reframing: while a normative social process, peer-review also shapes the writing of a scientific paper. In so far as ‘cognition’ describes enabling conditions for flexible behavior, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as ‘symbolizations’, replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper’s own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper’s knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered ‘real’ science but also its ‘post-academic’ counterparts. PMID:26579064

  5. How peer review constrains cognition: on the frontline in the knowledge sector

    Directory of Open Access Journals (Sweden)

    Stephen John Cowley

    2015-11-01

    Full Text Available Peer-review is neither reliable, fair, nor a valid basis for predicting ‘impact’: as quality control, peer-review is not fit for purpose. Given this consensus, I propose another framing: while a normative social process, peer-review also shapes the flexible behavior called ‘writing’ a scientific paper. In so far as ‘cognition’ describes the enabling conditions for flexible behaviour, the practices of peer-review thus constrain knowledge-making. To pursue cognitive functions of peer-review, however, manuscripts must be seen as ‘symbolizations’, replicable patterns that use technologically enabled activity. On this bio-cognitive view, peer-review constrains knowledge-making by writers, editors, reviewers. Authors are prompted to recursively re-aggregate symbolizations to present what are deemed acceptable knowledge claims. How, then, can recursive re-embodiment be explored? In illustration, I sketch how the paper’s own content came to be re-aggregated: agonistic review drove reformatting of argument structure, changes in rhetorical ploys and careful choice of wordings. For this reason, the paper’s knowledge-claims can be traced to human activity that occurs in distributed cognitive systems. Peer-review is on the frontline in the knowledge sector in that it delimits what can count as knowing. Its systemic nature is therefore crucial to not only discipline-centered ‘real’ science but also its ‘post-academic’ counterparts.

  6. Systematic review of peer support for breastfeeding continuation: metaregression analysis of the effect of setting, intensity, and timing.

    Science.gov (United States)

    Jolly, Kate; Ingram, Lucy; Khan, Khalid S; Deeks, Jonathan J; Freemantle, Nick; MacArthur, Christine

    2012-01-25

    To examine the effect of setting, intensity, and timing of peer support on breast feeding. Systematic review and metaregression analysis of randomised controlled trials. Cochrane Library, Medline, CINAHL, the National Research Register, and British Nursing Index were searched from inception or from 1980 to 2011. Review methods Study selection, data abstraction, and quality assessment were carried out independently and in duplicate. Risk ratios and 95% confidence intervals were calculated for individual studies and pooled. Effects were estimated for studies grouped according to setting (high income countries, low or middle income countries, and the United Kingdom), intensity (services in high income countries need to undergo concurrent evaluation.

  7. Inuit Elderly: A Systematic Review of Peer Reviewed Journal Articles.

    Science.gov (United States)

    Somogyi, Balvinder K; Barker, Melanie; MacLean, Calvin; Grischkan, Pamela

    2015-01-01

    Over the last century, Inuit have experienced rapid social changes that have greatly impacted their way of life, health, and intergenerational traditions. Although there is a growing body of research concerning Inuit youth, relatively little is known about elderly Inuit. In an effort to bridge this knowledge gap, a systematic review of peer-reviewed journal articles was conducted. This review identified a dearth of research on older Inuit, and highlighted limitations in service provision to this primarily rural and isolated population. Implications for policy and practice and recommendations for future research are also discussed.

  8. The ethics of peer review in bioethics.

    Science.gov (United States)

    Wendler, David; Miller, Franklin

    2014-10-01

    A good deal has been written on the ethics of peer review, especially in the scientific and medical literatures. In contrast, we are unaware of any articles on the ethics of peer review in bioethics. Recognising this gap, we evaluate the extant proposals regarding ethical standards for peer review in general and consider how they apply to bioethics. We argue that scholars have an obligation to perform peer review based on the extent to which they personally benefit from the peer review process. We also argue, contrary to existing proposals and guidelines, that it can be appropriate for peer reviewers to benefit in their own scholarship from the manuscripts they review. With respect to bioethics in particular, we endorse double-blind review and suggest several ways in which the peer review process might be improved. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

  9. Implementation and evaluation of a peer review process for advanced practice nurses in a university hospital setting.

    Science.gov (United States)

    Bergum, Shelly K; Canaan, Talitha; Delemos, Christi; Gall, Elizabeth Funke; McCracken, Bonnie; Rowen, Dave; Salvemini, Steve; Wiens, Kimberly

    2017-07-01

    Over the past decade, implementation of the peer review process for the development of the advanced practice nurse (APN) has been emphasized. However, little exists in the literature regarding APN peer review. The peer review process is intended to help demonstrate competency of care, enhance quality improvement measures, and foster the professional growth of the APN. APNs serving on a professional governance council within a university teaching hospital developed a model of peer review for APNs. Nine months after the tool was implemented, an anonymous follow-up survey was conducted. A follow-up request was sent 4 weeks later to increase the number of respondents. Likert scales were used to elicit subjective data regarding the process. Of 81 APNs who participated in the survey, more than half (52%) felt that the process would directly improve their professional practice. Survey results show that the peer review process affected APN professional practice positively. Additional research might include pathways for remediation and education of staff, evaluation of alternate methods to improve application to clinical practice, and collection of outcome data. The models presented provide a foundation for future refinement to accommodate different APN practice settings. ©2017 American Association of Nurse Practitioners.

  10. 2012 Wind Program Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    Zayas, Jose [Energy Efficiencey and Renewable Energy (EERE), Washington, DC (United States); Higgins, Mark [Energy Efficiencey and Renewable Energy (EERE), Washington, DC (United States)

    2012-06-01

    This report summarizes the proceedings of the 2012 Wind Program Peer Review, the goals of which were to review and evaluate the strategy and goals of the Wind Program; review and evaluate the progress and accomplishments of the program's projects funded in fiscal year (FY) 2010 and FY 2011; and foster interactions among the national laboratories, industry, and academic institutions conducting research and development on behalf of the program.

  11. Impact of peer review audit on occupational health report quality.

    Science.gov (United States)

    Lalloo, D; Demou, E; Macdonald, E B

    2015-08-01

    In a previous report, we described the implementation of a formal process for peer review of occupational health (OH) reports and a method of assessment of the outcomes of this process. The initial audit identified that 27% of OH reports required modifications. To assess formally, following implementation of this process, if changes in practice had occurred, i.e. whether fewer deficiencies were being identified in reports. We repeated a prospective internal audit of all peer reviewed OH reports between September and November 2011. We used an abbreviated assessment form, based on questions 4-8 and 10-12 of the modified SAIL (Sheffield Assessment Instrument for Letters), with four possible outcomes: no action, no changes made to report following discussion with author, changes made without discussion with author and changes made following discussion with author. One hundred seventy-three reports by 10 clinicians were audited. The audit identified a 13% reduction in OH reports requiring modifications (from 27 to 14%) compared with the previous cycle. Where modifications were required, 8% of these were related to minor typographical, spelling and grammar errors and 6% were for more complex reasons. Implementation of this process also produced a reduction in clinical complaints about OH reports from customers, from three in the preceding year to none 2 years later. Peer review improved the standard of OH reports and was associated with a reduction in customer complaints about reports. © The Author 2015. Published by Oxford University Press on behalf of the Society of Occupational Medicine.

  12. Detailed prospective peer review in a community radiation oncology clinic.

    Science.gov (United States)

    Mitchell, James D; Chesnut, Thomas J; Eastham, David V; Demandante, Carlo N; Hoopes, David J

    In 2012, we instituted detailed prospective peer review of new cases. We present the outcomes of peer review on patient management and time required for peer review. Peer review rounds were held 3 to 4 days weekly and required 2 physicians to review pertinent information from the electronic medical record and treatment planning system. Eight aspects were reviewed for each case: 1) workup and staging; 2) treatment intent and prescription; 3) position, immobilization, and simulation; 4) motion assessment and management; 5) target contours; 6) normal tissue contours; 7) target dosimetry; and 8) normal tissue dosimetry. Cases were marked as, "Meets standard of care," "Variation," or "Major deviation." Changes in treatment plan were noted. As our process evolved, we recorded the time spent reviewing each case. From 2012 to 2014, we collected peer review data on 442 of 465 (95%) radiation therapy patients treated in our hospital-based clinic. Overall, 91 (20.6%) of the cases were marked as having a variation, and 3 (0.7%) as major deviation. Forty-two (9.5%) of the cases were altered after peer review. An overall peer review score of "Variation" or "Major deviation" was highly associated with a change in treatment plan (P peer review. Indicators on position, immobilization, simulation, target contours, target dosimetry, motion management, normal tissue contours, and normal tissue dosimetry were significantly associated with a change in treatment plan. The mean time spent on each case was 7 minutes. Prospective peer review is feasible in a community radiation oncology practice. Our process led to changes in 9.5% of cases. Peer review should focus on technical factors such as target contours and dosimetry. Peer review required 7 minutes per case. Published by Elsevier Inc.

  13. The Influence of Peers on Diet and Exercise Among Adolescents: A Systematic Review.

    Science.gov (United States)

    Chung, Sophia Jihey; Ersig, Anne L; McCarthy, Ann Marie

    Adolescents' diet and exercise are modifiable factors contributing to high rates of adolescent obesity. Diverse contextual factors, including family, social environment, and peers, affect adolescents' diet and exercise behaviors. Because peer influence increases during adolescence, peers' contributions to adolescents' diet and exercise behaviors should be examined as potential targets for intervention to reduce the prevalence of adolescent obesity. The purpose of this systematic review is to identify research examining the contribution of peers to diet and exercise of adolescents. The electronic databases PubMed, CINAHL, Web of Science, and SCOPUS were searched. A total of 24 unique articles were included: seven examined diet only, fourteen studied exercise only, and three explored diet and exercise. This review provided evidence that diet and exercise of adolescents were significantly associated with those of their peers. However, these associations differed depending on gender, the type of diet and exercise, and closeness of friends. Findings from this review suggest that peers could be possible targets for interventions to promote healthier diet and exercise among adolescents; however, more studies are needed to identify specific peer influences and develop tailored interventions. Copyright © 2017 Elsevier Inc. All rights reserved.

  14. A systematic review of peer teaching and learning in clinical education.

    Science.gov (United States)

    Secomb, Jacinta

    2008-03-01

    The purpose of this review is to provide a framework for peer teaching and learning in the clinical education of undergraduate health science students in clinical practice settings and make clear the positive and negative aspects of this teaching and learning strategy. The practice of using peers incidentally or purposefully in the clinical education of apprentice or undergraduate health science students is a well-established tradition and commonly practiced, but lacks definition in its implementation. The author conducted a search of health science and educational electronic databases using the terms peer, clinical education and undergraduate. The set limitations were publications after 1980 (2005 inclusive), English language and research papers. Selection of studies occurred: based on participant, intervention, research method and learning outcomes, following a rigorous critical and quality appraisal with a purposefully developed tool. The results have been both tabled and collated in a narrative summary. Twelve articles met the inclusion criteria, representing five countries and four health science disciplines. This review reported mostly positive outcomes on the effectiveness of peer teaching and learning; it can increase student's confidence in clinical practice and improve learning in the psychomotor and cognitive domains. Negative aspects were also identified; these include poor student learning if personalities or learning styles are not compatible and students spending less individualized time with the clinical instructor. Peer teaching and learning is an effective educational intervention for health science students on clinical placements. Preclinical education of students congruent with the academic timetable increases student educational outcomes from peer teaching and learning. Strategies are required prior to clinical placement to accommodate incompatible students or poor student learning. The findings from this systematic review, although not

  15. Peer-Review Writing Workshops in College Courses: Students’ Perspectives about Online and Classroom Based Workshops

    Directory of Open Access Journals (Sweden)

    Erin B. Jensen

    2016-11-01

    Full Text Available Peer-review workshops are commonly used in writing courses as a way for students to give their peers feedback as well as help their own writing. Most of the research on peer-review workshops focuses on workshops held in traditional in-person courses, with less research on peer-review workshops held online. Students in a freshman writing course experienced both a classroom based writing workshop and an online workshop and then took a survey about their experiences. The majority of the students preferred the online writing workshop because of the convenience of the workshop and being able to post anonymous reviews. Students whom preferred the traditional in-person writing workshop liked being able to talk with their peers about their papers. This research article focuses on the students’ responses and experiences with traditional and online peer-reviews.

  16. 7 CFR 550.17 - Peer review.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 6 2010-01-01 2010-01-01 false Peer review. 550.17 Section 550.17 Agriculture... § 550.17 Peer review. Upon request of the REE Agency, cooperators may be requested to provide documentation in support of peer review activities and cooperator personnel may be requested to participate in...

  17. Problems with traditional science publishing and finding a wider niche for post-publication peer review.

    Science.gov (United States)

    Teixeira da Silva, Jaime A; Dobránszki, Judit

    2015-01-01

    Science affects multiple basic sectors of society. Therefore, the findings made in science impact what takes place at a commercial level. More specifically, errors in the literature, incorrect findings, fraudulent data, poorly written scientific reports, or studies that cannot be reproduced not only serve as a burden on tax-payers' money, but they also serve to diminish public trust in science and its findings. Therefore, there is every need to fortify the validity of data that exists in the science literature, not only to build trust among peers, and to sustain that trust, but to reestablish trust in the public and private academic sectors that are witnessing a veritable battle-ground in the world of science publishing, in some ways spurred by the rapid evolution of the open access (OA) movement. Even though many science journals, traditional and OA, claim to be peer reviewed, the truth is that different levels of peer review occur, and in some cases no, insufficient, or pseudo-peer review takes place. This ultimately leads to the erosion of quality and importance of science, allowing essentially anything to become published, provided that an outlet can be found. In some cases, predatory OA journals serve this purpose, allowing papers to be published, often without any peer review or quality control. In the light of an explosion of such cases in predatory OA publishing, and in severe inefficiencies and possible bias in the peer review of even respectable science journals, as evidenced by the increasing attention given to retractions, there is an urgent need to reform the way in which authors, editors, and publishers conduct the first line of quality control, the peer review. One way to address the problem is through post-publication peer review (PPPR), an efficient complement to traditional peer-review that allows for the continuous improvement and strengthening of the quality of science publishing. PPPR may also serve as a way to renew trust in scientific

  18. Academic Excellence: A Commentary and Reflections on the Inherent Value of Peer Review

    Science.gov (United States)

    Roberts, Thomas J.; Shambrook, Jennifer

    2012-01-01

    Academic peer review is widely viewed as fair, equitable, and essential to academic quality. Successfully completing the process through publication or award is widely deemed as one of the most rigorous and prestigious forms of scholarly accomplishment. Despite this sentiment the academic peer review process is not without fault. It is criticized…

  19. Predicting Academics' Willingness to Participate in Peer Review of Teaching: A Quantitative Investigation

    Science.gov (United States)

    White, Kiri; Boehm, Emilia; Chester, Andrea

    2014-01-01

    Peer review of teaching is a collegial process designed to help academics reflect on and improve their teaching practice. Considerable research supports the value of peer review of teaching. However, uptake of voluntary programs is typically low. Few studies have examined the predictors of engagement in voluntary peer review. This study surveyed…

  20. Views on the peer review system of biomedical journals: an online survey of academics from high-ranking universities

    Science.gov (United States)

    2013-01-01

    Background Peer review is the major method used by biomedical journals for making the decision of publishing an article. This cross-sectional survey assesses views concerning the review system of biomedical journals among academics globally. Methods A total of 28,009 biomedical academics from high-ranking universities listed by the 2009 Times Higher Education Quacquarelli Symonds (THE-QS) World University Rankings were contacted by email between March 2010 and August 2010. 1,340 completed an online survey which focused on their academic background, negative experiences and views on biomedical journal peer review and the results were compared among basic scientists, clinicians and clinician scientists. Results Fewer than half of the respondents agreed that the peer review systems of biomedical journals were fair (48.4%), scientific (47.5%), or transparent (25.1%). Nevertheless, 58.2% of the respondents agreed that authors should remain anonymous and 64.4% agreed that reviewers should not be disclosed. Most, (67.7%) agreed to the establishment of an appeal system. The proportion of native English-speaking respondents who agreed that the “peer review system is fair” was significantly higher than for non-native respondents (p = 0.02). Similarly, the proportion of clinicians stating that the “peer review system is fair” was significantly higher than that for basic scientists and clinician-scientists (p = 0.004). For females, (β = −0.1, p = 0.03), the frequency of encountering personal attacks in reviewers’ comments (β = −0.1, p = 0.002) and the frequency of imposition of unnecessary references by reviewers (β = −0.06, p = 0.04) were independently and inversely associated with agreement that “the peer review system is fair”. Conclusion Academics are divided on the issue of whether the biomedical journal peer review system is fair, scientific and transparent. A majority of academics agreed with the double-blind peer

  1. Does Peer Review of Radiation Plans Affect Clinical Care? A Systematic Review of the Literature

    International Nuclear Information System (INIS)

    Brunskill, Kelsey; Nguyen, Timothy K.; Boldt, R. Gabriel; Louie, Alexander V.; Warner, Andrew; Marks, Lawrence B.; Palma, David A.

    2017-01-01

    Purpose: Peer review is a recommended component of quality assurance in radiation oncology; however, it is resource-intensive and its effect on patient care is not well understood. We conducted a systematic review of the published data to assess the reported clinical impact of peer review on radiation treatment plans. Methods and Materials: A systematic review of published English studies was performed in accordance with the PRISMA guidelines using the MEDLINE and EMBASE databases and abstracts published from major radiation oncology scientific meeting proceedings. For inclusion, the studies were required to report the effect of peer review on ≥1 element of treatment planning (eg, target volume or organ-at-risk delineation, dose prescription or dosimetry). Results: The initial search strategy identified 882 potentially eligible studies, with 11 meeting the inclusion criteria for full-text review and final analysis. Across a total of 11,491 patient cases, peer review programs led to modifications in a weighted mean of 10.8% of radiation treatment plans. Five studies differentiated between major and minor changes and reported weighted mean rates of change of 1.8% and 7.3%, respectively. The most common changes were related to target volume delineation (45.2% of changed plans), dose prescription or written directives (24.4%), and non-target volume delineation or normal tissue sparing (7.5%). Conclusions: Our findings suggest that peer review leads to changes in clinical care in approximately 1 of every 9 cases overall. This is similar to the reported rates of change in peer review studies from other oncology-related specialties, such as radiology and pathology.

  2. Directly Improving the Quality of Radiation Treatment Through Peer Review: A Cross-sectional Analysis of Cancer Centers Across a Provincial Cancer Program.

    Science.gov (United States)

    Rouette, Julie; Gutierrez, Eric; O'Donnell, Jennifer; Reddeman, Lindsay; Hart, Margaret; Foxcroft, Sophie; Mitera, Gunita; Warde, Padraig; Brundage, Michael D

    2017-07-01

    To describe the outcomes of peer review across all 14 cancer centers in Ontario. We identified all peer-reviewed, curative treatment plans delivered in Ontario within a 3-month study period from 2013 to 2014 using a provincial cancer treatment database and collected additional data on the peer-review outcomes. Considerable variation was found in the proportion of peer-reviewed plans across the centers (average 70.2%, range 40.8%-99.2%). During the study period, 5561 curative plans underwent peer review. Of those, 184 plans (3.3%) had changes recommended. Of the 184 plans, the changes were major (defined as requiring repeat planning or having a major effect on planning or clinical outcomes, or both) in 40.2% and minor in 47.8%. For the remaining 12.0%, data were missing. The proportions of recommended changes varied among disease sites (0.0%-7.0%). The disease sites with the most recommended changes to treatment plans after peer review and with the greatest potential for benefit were the esophagus (7.0%), uterus (6.7%), upper limb (6.3%), cervix and lower limb (both 6.0%), head and neck and bilateral lung (both 5.9%), right supraclavicular lymph nodes (5.7%), rectum (5.3%), and spine (5.0%). Although the heart is an organ at risk in left-sided breast treatment plans, the proportions of recommended changes did not significantly differ between the left breast treatment plans (3.0%, 95% confidence interval 2.0%-4.5%) and right breast treatment plans (2.4%, 95% confidence interval 1.5%-3.8%). The recommended changes were more frequently made when peer review occurred before radiation therapy (3.8%) than during treatment (1.4%-2.8%; P=.0048). The proportion of plans with recommended changes was not significantly associated with patient volume (P=.23), peer-review performance (P=.36), or center academic status (P=.75). Peer review of treatment plans directly affects the quality of care by identifying important clinical and planning changes. Provincial strategies are

  3. Attitudes Toward Blinding of Peer Review and Perceptions of Efficacy Within a Small Biomedical Specialty

    Energy Technology Data Exchange (ETDEWEB)

    Jagsi, Reshma, E-mail: rjagsi@med.umich.edu [Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan (United States); Bennett, Katherine Egan [Scientific Publications, American Society for Radiation Oncology (ASTRO), Fairfax, Virginia (United States); Griffith, Kent A. [Center for Cancer Biostatistics, University of Michigan School of Public Health, Ann Arbor, Michigan (United States); DeCastro, Rochelle [Center for Bioethics and Social Science in Medicine and Department of Radiation Oncology, University of Michigan, Ann Arbor, Michigan (United States); Grace, Calley [Scientific Publications, American Society for Radiation Oncology (ASTRO), Fairfax, Virginia (United States); Holliday, Emma [University of Texas MD Anderson Cancer Center, Houston, Texas (United States); Zietman, Anthony L. [Department of Radiation Oncology, Massachusetts General Hospital, Boston, Massachusetts (United States)

    2014-08-01

    Purpose: Peer reviewers' knowledge of author identity may influence review content, quality, and recommendations. Therefore, the International Journal of Radiation Oncology, Biology, Physics (“Red Journal”) implemented double-blinded peer review in 2011. Given the relatively small size of the specialty and the high frequency of preliminary abstract presentations, we sought to evaluate attitudes, the efficacy of blinding, and the potential impact on the disposition of submissions. Methods and Materials: In May through August 2012, all Red Journal reviewers and 1 author per manuscript completed questionnaires regarding demographics, attitudes, and perceptions of success of blinding. We also evaluated correlates of the outcomes of peer review. Results: Questionnaires were received from 408 authors and 519 reviewers (100%). The majority of respondents favored double blinding; 6% of authors and 13% of reviewers disagreed that double blinding should continue in the Red Journal. In all, 50% of the reviewers did not suspect the identity of the author of the paper that they reviewed; 19% of reviewers believed that they could identify the author(s), and 31% suspected that they could. Similarly, 23% believed that they knew the institution(s) from which the paper originated, and 34% suspected that they did. Among those who at least suspected author identity, 42% indicated that prior presentations served as a clue, and 57% indicated that literature referenced did so. Of those who at least suspected origin and provided details (n=133), 13% were entirely incorrect. Rejection was more common in 2012 than 2011, and submissions from last authors with higher H-indices (>21) were more likely to survive initial review, without evidence of interactions between submission year and author gender or H-index. Conclusions: In a relatively small specialty in which preliminary research presentations are common and occur in a limited number of venues, reviewers are often familiar with

  4. Attitudes Toward Blinding of Peer Review and Perceptions of Efficacy Within a Small Biomedical Specialty

    International Nuclear Information System (INIS)

    Jagsi, Reshma; Bennett, Katherine Egan; Griffith, Kent A.; DeCastro, Rochelle; Grace, Calley; Holliday, Emma; Zietman, Anthony L.

    2014-01-01

    Purpose: Peer reviewers' knowledge of author identity may influence review content, quality, and recommendations. Therefore, the International Journal of Radiation Oncology, Biology, Physics (“Red Journal”) implemented double-blinded peer review in 2011. Given the relatively small size of the specialty and the high frequency of preliminary abstract presentations, we sought to evaluate attitudes, the efficacy of blinding, and the potential impact on the disposition of submissions. Methods and Materials: In May through August 2012, all Red Journal reviewers and 1 author per manuscript completed questionnaires regarding demographics, attitudes, and perceptions of success of blinding. We also evaluated correlates of the outcomes of peer review. Results: Questionnaires were received from 408 authors and 519 reviewers (100%). The majority of respondents favored double blinding; 6% of authors and 13% of reviewers disagreed that double blinding should continue in the Red Journal. In all, 50% of the reviewers did not suspect the identity of the author of the paper that they reviewed; 19% of reviewers believed that they could identify the author(s), and 31% suspected that they could. Similarly, 23% believed that they knew the institution(s) from which the paper originated, and 34% suspected that they did. Among those who at least suspected author identity, 42% indicated that prior presentations served as a clue, and 57% indicated that literature referenced did so. Of those who at least suspected origin and provided details (n=133), 13% were entirely incorrect. Rejection was more common in 2012 than 2011, and submissions from last authors with higher H-indices (>21) were more likely to survive initial review, without evidence of interactions between submission year and author gender or H-index. Conclusions: In a relatively small specialty in which preliminary research presentations are common and occur in a limited number of venues, reviewers are often familiar with

  5. Appreciation of peer reviewers for 2014

    Science.gov (United States)

    Montanari, Alberto; Bahr, Jean; Blöschl, Günter; Cai, Ximing; Mackay, D. Scott; Michalak, Anna; Rajaram, Harihar; Sander, Graham

    2015-08-01

    During 2014 Water Resources Research benefited from the voluntary effort of 2103 reviewers. Their constructive and professional effort was instrumental for publishing high-quality contributions thereby supporting the development of our knowledge of water resources. The contribution of the reviewers is instrumental to science for reaching the target of benefiting humanity. Editors and Associate Editors of Water Resources Research are grateful to the reviewers for their talented, unselfish, and continuous support to the journal.

  6. Paired peer review of university classroom teaching in a school of nursing and midwifery.

    Science.gov (United States)

    Bennett, Paul N; Parker, Steve; Smigiel, Heather

    2012-08-01

    Peer review of university classroom teaching can increase the quality of teaching but is not universally practiced in Australian universities. To report an evaluation of paired peer-review process using both paper and web based teaching evaluation tools. Twenty university teachers in one metropolitan Australian School of Nursing and Midwifery were randomly paired and then randomly assigned to a paper based or web-based peer review tool. Each teacher reviewed each other's classroom teaching as part of a peer review program. The participants then completed an 18 question survey evaluating the peer review tool and paired evaluation process. Responses were analyzed using frequencies and percentages. Regardless of the tool used, participants found this process of peer review positive (75%), collegial (78%), supportive (61%) and non-threatening (71%). Participants reported that the peer review will improve their own classroom delivery (61%), teaching evaluation (61%) and planning (53%). The web-based tool was found to be easier to use and allowed more space than the paper-based tool. Implementation of a web-based paired peer review system can be a positive method of peer review of university classroom teaching. Pairing of teachers to review each other's classroom teaching is a promising strategy and has the potential to improve teaching in teaching universities. Copyright © 2011 Elsevier Ltd. All rights reserved.

  7. Systematic review of the effectiveness of training programs in writing for scholarly publication, journal editing, and manuscript peer review (protocol).

    Science.gov (United States)

    Galipeau, James; Moher, David; Skidmore, Becky; Campbell, Craig; Hendry, Paul; Cameron, D William; Hébert, Paul C; Palepu, Anita

    2013-06-17

    An estimated $100 billion is lost to 'waste' in biomedical research globally, annually, much of which comes from the poor quality of published research. One area of waste involves bias in reporting research, which compromises the usability of published reports. In response, there has been an upsurge in interest and research in the scientific process of writing, editing, peer reviewing, and publishing (that is, journalology) of biomedical research. One reason for bias in reporting and the problem of unusable reports could be due to authors lacking knowledge or engaging in questionable practices while designing, conducting, or reporting their research. Another might be that the peer review process for journal publication has serious flaws, including possibly being ineffective, and having poorly trained and poorly motivated reviewers. Similarly, many journal editors have limited knowledge related to publication ethics. This can ultimately have a negative impact on the healthcare system. There have been repeated calls for better, more numerous training opportunities in writing for publication, peer review, and publishing. However, little research has taken stock of journalology training opportunities or evaluations of their effectiveness. We will conduct a systematic review to synthesize studies that evaluate the effectiveness of training programs in journalology. A comprehensive three-phase search approach will be employed to identify evaluations of training opportunities, involving: 1) forward-searching using the Scopus citation database, 2) a search of the MEDLINE In-Process and Non-Indexed Citations, MEDLINE, Embase, ERIC, and PsycINFO databases, as well as the databases of the Cochrane Library, and 3) a grey literature search. This project aims to provide evidence to help guide the journalological training of authors, peer reviewers, and editors. While there is ample evidence that many members of these groups are not getting the necessary training needed to excel

  8. The role of peer review on the improvement of the articles published in the Journal of Birjand University of Medical Sciences

    Directory of Open Access Journals (Sweden)

    Hossein Beydokhti

    2014-11-01

    Conclusion: Peer review improved the quality of articles, particularly in the titles, editing and findings. Since accurate medical research reports in the correct information transfer to professionals and researchers, what JBUMS has done can be useful and valuable.

  9. Research quality and efficiency: An analysis of assessments and management issues in Dutch economics and business research programs

    NARCIS (Netherlands)

    Groot, T.L.C.M.; Garcia Valderrama, T.

    2006-01-01

    Assessments of quality and productivity of academic research programs become more and more important in gaining financial support, in hiring and promoting research staff, and in building academic reputation. Most assessments are based on peer review or on bibliometric information. In this paper we

  10. TU-EF-BRD-01: Topics in Quality and Safety Research and Level of Evidence

    Energy Technology Data Exchange (ETDEWEB)

    Pawlicki, T. [UCSD Medical Center (United States)

    2015-06-15

    Research related to quality and safety has been a staple of medical physics academic activities for a long time. From very early on, medical physicists have developed new radiation measurement equipment and analysis techniques, created ever increasingly accurate dose calculation models, and have vastly improved imaging, planning, and delivery techniques. These and other areas of interest have improved the quality and safety of radiotherapy for our patients. With the advent of TG-100, quality and safety is an area that will garner even more research interest in the future. As medical physicists pursue quality and safety research in greater numbers, it is worthwhile to consider what actually constitutes research on quality and safety. For example, should the development of algorithms for real-time EPID-based in-vivo dosimetry be defined as “quality and safety” research? How about the clinical implementation of such as system? Surely the application of failure modes and effects analysis to a clinical process would be considered quality and safety research, but is this type of research that should be included in the medical physics peer-reviewed literature? The answers to such questions are of critical importance to set researchers in a direction that will provide the greatest benefit to our field and the patients we serve. The purpose of this symposium is to consider what constitutes research in the arena of quality and safety and differentiate it from other research directions. The key distinction here is developing the tool itself (e.g. algorithms for EPID dosimetry) vs. studying the impact of the tool with some quantitative metric. Only the latter would I call quality and safety research. Issues of ‘basic’ versus ‘applied’ quality and safety research will be covered as well as how the research results should be structured to provide increasing levels of support that a quality and safety intervention is effective and sustainable. Examples from existing

  11. TU-EF-BRD-04: Summing It Up: The Future of Quality and Safety Research

    Energy Technology Data Exchange (ETDEWEB)

    Ford, E. [University of Washington (United States)

    2015-06-15

    Research related to quality and safety has been a staple of medical physics academic activities for a long time. From very early on, medical physicists have developed new radiation measurement equipment and analysis techniques, created ever increasingly accurate dose calculation models, and have vastly improved imaging, planning, and delivery techniques. These and other areas of interest have improved the quality and safety of radiotherapy for our patients. With the advent of TG-100, quality and safety is an area that will garner even more research interest in the future. As medical physicists pursue quality and safety research in greater numbers, it is worthwhile to consider what actually constitutes research on quality and safety. For example, should the development of algorithms for real-time EPID-based in-vivo dosimetry be defined as “quality and safety” research? How about the clinical implementation of such as system? Surely the application of failure modes and effects analysis to a clinical process would be considered quality and safety research, but is this type of research that should be included in the medical physics peer-reviewed literature? The answers to such questions are of critical importance to set researchers in a direction that will provide the greatest benefit to our field and the patients we serve. The purpose of this symposium is to consider what constitutes research in the arena of quality and safety and differentiate it from other research directions. The key distinction here is developing the tool itself (e.g. algorithms for EPID dosimetry) vs. studying the impact of the tool with some quantitative metric. Only the latter would I call quality and safety research. Issues of ‘basic’ versus ‘applied’ quality and safety research will be covered as well as how the research results should be structured to provide increasing levels of support that a quality and safety intervention is effective and sustainable. Examples from existing

  12. TU-EF-BRD-04: Summing It Up: The Future of Quality and Safety Research

    International Nuclear Information System (INIS)

    Ford, E.

    2015-01-01

    Research related to quality and safety has been a staple of medical physics academic activities for a long time. From very early on, medical physicists have developed new radiation measurement equipment and analysis techniques, created ever increasingly accurate dose calculation models, and have vastly improved imaging, planning, and delivery techniques. These and other areas of interest have improved the quality and safety of radiotherapy for our patients. With the advent of TG-100, quality and safety is an area that will garner even more research interest in the future. As medical physicists pursue quality and safety research in greater numbers, it is worthwhile to consider what actually constitutes research on quality and safety. For example, should the development of algorithms for real-time EPID-based in-vivo dosimetry be defined as “quality and safety” research? How about the clinical implementation of such as system? Surely the application of failure modes and effects analysis to a clinical process would be considered quality and safety research, but is this type of research that should be included in the medical physics peer-reviewed literature? The answers to such questions are of critical importance to set researchers in a direction that will provide the greatest benefit to our field and the patients we serve. The purpose of this symposium is to consider what constitutes research in the arena of quality and safety and differentiate it from other research directions. The key distinction here is developing the tool itself (e.g. algorithms for EPID dosimetry) vs. studying the impact of the tool with some quantitative metric. Only the latter would I call quality and safety research. Issues of ‘basic’ versus ‘applied’ quality and safety research will be covered as well as how the research results should be structured to provide increasing levels of support that a quality and safety intervention is effective and sustainable. Examples from existing

  13. Peer Reviewer

    OpenAIRE

    Baru Mansjur, Mansjur

    2016-01-01

    - Peer Reviewer Effects Of Histomorohometric, Bone Tu Implant Contac and Asseointegration On a novel Hybrid Micro/Nano Topografhy Modfie Dental Implant in The Mandibular Canine Premolar Area Of The Mini Pigs

  14. "Are you gonna publish that?" Peer-reviewed publication outcomes of doctoral dissertations in psychology.

    Directory of Open Access Journals (Sweden)

    Spencer C Evans

    Full Text Available If a doctoral dissertation represents an original investigation that makes a contribution to one's field, then dissertation research could, and arguably should, be disseminated into the scientific literature. However, the extent and nature of dissertation publication remains largely unknown within psychology. The present study investigated the peer-reviewed publication outcomes of psychology dissertation research in the United States. Additionally, we examined publication lag, scientific impact, and variations across subfields. To investigate these questions, we first drew a stratified random cohort sample of 910 psychology Ph.D. dissertations from ProQuest Dissertations & Theses. Next, we conducted comprehensive literature searches for peer-reviewed journal articles derived from these dissertations published 0-7 years thereafter. Published dissertation articles were coded for their bibliographic details, citation rates, and journal impact metrics. Results showed that only one-quarter (25.6% [95% CI: 23.0, 28.4] of dissertations were ultimately published in peer-reviewed journals, with significant variations across subfields (range: 10.1 to 59.4%. Rates of dissertation publication were lower in professional/applied subfields (e.g., clinical, counseling compared to research/academic subfields (e.g., experimental, cognitive. When dissertations were published, however, they often appeared in influential journals (e.g., Thomson Reuters Impact Factor M = 2.84 [2.45, 3.23], 5-year Impact Factor M = 3.49 [3.07, 3.90] and were cited numerous times (Web of Science citations per year M = 3.65 [2.88, 4.42]. Publication typically occurred within 2-3 years after the dissertation year. Overall, these results indicate that the large majority of Ph.D. dissertation research in psychology does not get disseminated into the peer-reviewed literature. The non-publication of dissertation research appears to be a systemic problem affecting both research and training

  15. "Are you gonna publish that?" Peer-reviewed publication outcomes of doctoral dissertations in psychology

    Science.gov (United States)

    Amaro, Christina M.; Herbert, Robyn; Blossom, Jennifer B.; Roberts, Michael C.

    2018-01-01

    If a doctoral dissertation represents an original investigation that makes a contribution to one’s field, then dissertation research could, and arguably should, be disseminated into the scientific literature. However, the extent and nature of dissertation publication remains largely unknown within psychology. The present study investigated the peer-reviewed publication outcomes of psychology dissertation research in the United States. Additionally, we examined publication lag, scientific impact, and variations across subfields. To investigate these questions, we first drew a stratified random cohort sample of 910 psychology Ph.D. dissertations from ProQuest Dissertations & Theses. Next, we conducted comprehensive literature searches for peer-reviewed journal articles derived from these dissertations published 0–7 years thereafter. Published dissertation articles were coded for their bibliographic details, citation rates, and journal impact metrics. Results showed that only one-quarter (25.6% [95% CI: 23.0, 28.4]) of dissertations were ultimately published in peer-reviewed journals, with significant variations across subfields (range: 10.1 to 59.4%). Rates of dissertation publication were lower in professional/applied subfields (e.g., clinical, counseling) compared to research/academic subfields (e.g., experimental, cognitive). When dissertations were published, however, they often appeared in influential journals (e.g., Thomson Reuters Impact Factor M = 2.84 [2.45, 3.23], 5-year Impact Factor M = 3.49 [3.07, 3.90]) and were cited numerous times (Web of Science citations per year M = 3.65 [2.88, 4.42]). Publication typically occurred within 2–3 years after the dissertation year. Overall, these results indicate that the large majority of Ph.D. dissertation research in psychology does not get disseminated into the peer-reviewed literature. The non-publication of dissertation research appears to be a systemic problem affecting both research and training in

  16. Factors Associated with Social Interactions between Deaf Children and Their Hearing Peers: A Systematic Literature Review

    Science.gov (United States)

    Batten, Georgina; Oakes, Peter M.; Alexander, Tim

    2014-01-01

    Research indicates that deaf children can have marked social difficulties compared with their hearing peers. Factors that influence these social interactions need to be reviewed to inform interventions. A systematic search of 5 key databases and 3 specialized journals identified 14 papers that met the inclusion criteria. Methodological quality of…

  17. How Does Student Peer Review Influence Perceptions, Engagement and Academic Outcomes? A Case Study

    Science.gov (United States)

    Mulder, Raoul; Baik, Chi; Naylor, Ryan; Pearce, Jon

    2014-01-01

    Involving students in peer review has many pedagogical benefits, but few studies have explicitly investigated relationships between the content of peer reviews, student perceptions and assessment outcomes. We conducted a case study of peer review within a third-year undergraduate subject at a research-intensive Australian university, in which we…

  18. Nevada Nuclear Waste Storage Investigations. FY 1979 peer review summaries and related documentation

    International Nuclear Information System (INIS)

    1980-06-01

    The NNWSI FY 1979 Project Plan (NVO-196-9) describes the accomplishment plan and objectives of the FY 1979 investigations. Three critical tasks and one critical subtask were selected by Project management for in-depth external peer review at meetings held at the DOE/NV in Las Vegas. The four technical peer review meetings held during FY 1979 were conducted to obtain an external assessment of the sufficiency and quality of the four selected critical investigative segments of the NNWSI. Peer reviewers representing appropriate fields of expertise were invited to attend each meeting. Within about two weeks of each meeting, the invited reviewers summarized their impressions of the technical activities presented to them and transmitted their summaries and recommendations to DOE/NV by letter. This document is a compilation, according to the individual meetings, of all correspondence between reviewers and Project personnel that is relevant to the technical activities of the NNWSI. The section for each meeting briefly summarizes the major activities of the NNWSI being reviewed and the effects of the reviewers comments and recommendations on Project planning. Each section also includes a list of the invited peer reviewers, a meeting agenda, and a copy of all technical correspondence relating to the review meeting. General impressions of the overall peer review process and improvements to be incorporated into future peer review activities are discussed in the next section as an introduction to the four subsequent sections which are devoted to the individual FY 1979 peer reviews

  19. Peer Review of Teaching: Sharing Best Practices

    Science.gov (United States)

    Golparian, Shaya; Chan, Judy; Cassidy, Alice

    2015-01-01

    In this paper, we share examples of best peer review of teaching practices, drawing on our involvement in the design and implementation of the Peer Review of Teaching program at the Centre for Teaching, Learning and Technology. We review the history of the Peer Review of Teaching Initiative at the University of British Columbia and explain key…

  20. A Scoping Review of Empirical Research Relating to Quality and Effectiveness of Research Ethics Review.

    Science.gov (United States)

    Nicholls, Stuart G; Hayes, Tavis P; Brehaut, Jamie C; McDonald, Michael; Weijer, Charles; Saginur, Raphael; Fergusson, Dean

    2015-01-01

    To date there is no established consensus of assessment criteria for evaluating research ethics review. We conducted a scoping review of empirical research assessing ethics review processes in order to identify common elements assessed, research foci, and research gaps to aid in the development of assessment criteria. Electronic searches of Ovid Medline, PsychInfo, and the Cochrane DSR, ACP Journal Club, DARE, CCTR, CMR, HTA, and NHSEED, were conducted. After de-duplication, 4234 titles and abstracts were reviewed. Altogether 4036 articles were excluded following screening of titles, abstracts and full text. A total of 198 articles included for final data extraction. Few studies originated from outside North America and Europe. No study reported using an underlying theory or framework of quality/effectiveness to guide study design or analyses. We did not identify any studies that had involved a controlled trial--randomised or otherwise--of ethics review procedures or processes. Studies varied substantially with respect to outcomes assessed, although tended to focus on structure and timeliness of ethics review. Our findings indicate a lack of consensus on appropriate assessment criteria, exemplified by the varied study outcomes identified, but also a fragmented body of research. To date research has been largely quantitative, with little attention given to stakeholder experiences, and is largely cross sectional. A lack of longitudinal research to date precludes analyses of change or assessment of quality improvement in ethics review.

  1. Quality assurance of qualitative research: a review of the discourse.

    Science.gov (United States)

    Reynolds, Joanna; Kizito, James; Ezumah, Nkoli; Mangesho, Peter; Allen, Elizabeth; Chandler, Clare

    2011-12-19

    Increasing demand for qualitative research within global health has emerged alongside increasing demand for demonstration of quality of research, in line with the evidence-based model of medicine. In quantitative health sciences research, in particular clinical trials, there exist clear and widely-recognised guidelines for conducting quality assurance of research. However, no comparable guidelines exist for qualitative research and although there are long-standing debates on what constitutes 'quality' in qualitative research, the concept of 'quality assurance' has not been explored widely. In acknowledgement of this gap, we sought to review discourses around quality assurance of qualitative research, as a first step towards developing guidance. A range of databases, journals and grey literature sources were searched, and papers were included if they explicitly addressed quality assurance within a qualitative paradigm. A meta-narrative approach was used to review and synthesise the literature. Among the 37 papers included in the review, two dominant narratives were interpreted from the literature, reflecting contrasting approaches to quality assurance. The first focuses on demonstrating quality within research outputs; the second focuses on principles for quality practice throughout the research process. The second narrative appears to offer an approach to quality assurance that befits the values of qualitative research, emphasising the need to consider quality throughout the research process. The paper identifies the strengths of the approaches represented in each narrative and recommend these are brought together in the development of a flexible framework to help qualitative researchers to define, apply and demonstrate principles of quality in their research. © 2011 Reynolds et al; licensee BioMed Central Ltd.

  2. Quality assurance of qualitative research: a review of the discourse

    Directory of Open Access Journals (Sweden)

    Reynolds Joanna

    2011-12-01

    Full Text Available Abstract Background Increasing demand for qualitative research within global health has emerged alongside increasing demand for demonstration of quality of research, in line with the evidence-based model of medicine. In quantitative health sciences research, in particular clinical trials, there exist clear and widely-recognised guidelines for conducting quality assurance of research. However, no comparable guidelines exist for qualitative research and although there are long-standing debates on what constitutes 'quality' in qualitative research, the concept of 'quality assurance' has not been explored widely. In acknowledgement of this gap, we sought to review discourses around quality assurance of qualitative research, as a first step towards developing guidance. Methods A range of databases, journals and grey literature sources were searched, and papers were included if they explicitly addressed quality assurance within a qualitative paradigm. A meta-narrative approach was used to review and synthesise the literature. Results Among the 37 papers included in the review, two dominant narratives were interpreted from the literature, reflecting contrasting approaches to quality assurance. The first focuses on demonstrating quality within research outputs; the second focuses on principles for quality practice throughout the research process. The second narrative appears to offer an approach to quality assurance that befits the values of qualitative research, emphasising the need to consider quality throughout the research process. Conclusions The paper identifies the strengths of the approaches represented in each narrative and recommend these are brought together in the development of a flexible framework to help qualitative researchers to define, apply and demonstrate principles of quality in their research.

  3. Quality assurance of qualitative research: a review of the discourse

    Science.gov (United States)

    2011-01-01

    Background Increasing demand for qualitative research within global health has emerged alongside increasing demand for demonstration of quality of research, in line with the evidence-based model of medicine. In quantitative health sciences research, in particular clinical trials, there exist clear and widely-recognised guidelines for conducting quality assurance of research. However, no comparable guidelines exist for qualitative research and although there are long-standing debates on what constitutes 'quality' in qualitative research, the concept of 'quality assurance' has not been explored widely. In acknowledgement of this gap, we sought to review discourses around quality assurance of qualitative research, as a first step towards developing guidance. Methods A range of databases, journals and grey literature sources were searched, and papers were included if they explicitly addressed quality assurance within a qualitative paradigm. A meta-narrative approach was used to review and synthesise the literature. Results Among the 37 papers included in the review, two dominant narratives were interpreted from the literature, reflecting contrasting approaches to quality assurance. The first focuses on demonstrating quality within research outputs; the second focuses on principles for quality practice throughout the research process. The second narrative appears to offer an approach to quality assurance that befits the values of qualitative research, emphasising the need to consider quality throughout the research process. Conclusions The paper identifies the strengths of the approaches represented in each narrative and recommend these are brought together in the development of a flexible framework to help qualitative researchers to define, apply and demonstrate principles of quality in their research. PMID:22182674

  4. 28 CFR 34.105 - Peer review methods.

    Science.gov (United States)

    2010-07-01

    ... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Peer review methods. 34.105 Section 34... Review § 34.105 Peer review methods. (a) For both competitive and noncompetitive applications, peer... announcement or otherwise established by the Administrator, together with the assignment of numerical values...

  5. Problematic Peer Functioning in Girls with ADHD: A Systematic Literature Review.

    Directory of Open Access Journals (Sweden)

    Francien M Kok

    Full Text Available Children with attention deficit hyperactivity disorder (ADHD experience many peer interaction problems and are at risk of peer rejection and victimisation. Although many studies have investigated problematic peer functioning in children with ADHD, this research has predominantly focused on boys and studies investigating girls are scant. Those studies that did examine girls, often used a male comparison sample, disregarding the inherent gender differences between girls and boys. Previous studies have highlighted this limitation and recommended the need for comparisons between ADHD females and typical females, in order to elucidate the picture of female ADHD with regards to problematic peer functioning. The aim of this literature review was to gain insight into peer functioning difficulties in school-aged girls with ADHD.PsychINFO, PubMed, and Web of Knowledge were searched for relevant literature comparing school-aged girls with ADHD to typically developing girls (TDs in relation to peer functioning. The peer relationship domains were grouped into 'friendship', 'peer status', 'social skills/competence', and 'peer victimisation and bullying'. In total, thirteen studies were included in the review.All of the thirteen studies included reported that girls with ADHD, compared to TD girls, demonstrated increased difficulties in the domains of friendship, peer interaction, social skills and functioning, peer victimization and externalising behaviour. Studies consistently showed small to medium effects for lower rates of friendship participation and stability in girls with ADHD relative to TD girls. Higher levels of peer rejection with small to large effect sizes were reported in all studies, which were predicted by girls' conduct problems. Peer rejection in turn predicted poor social adjustment and a host of problem behaviours. Very high levels of peer victimisation were present in girls with ADHD with large effect sizes. Further, very high levels of

  6. MELCOR Peer Review

    International Nuclear Information System (INIS)

    Boyack, B.E.; Dhir, V.K.; Gieseke, J.A.; Haste, T.J.; Kenton, M.A.; Khatib-Rahbar, M.; Leonard, M.T.; Viskanta, R.

    1992-03-01

    MELCOR is a fully integrated, engineering-level computer code that models the progression of severe accidents in light water reactor nuclear power plants. The newest version of MELCOR is Version 1.8.1, July 1991. MELCOR development has reached the point that the United States Nuclear Regulatory Commission sponsored a broad technical review by recognized experts to determine or confirm the technical adequacy of the code for the serious and complex analyses it is expected to perform. For this purpose, an eight-member MELCOR Peer Review Committee was organized. The Committee has completed its review of the MELCOR code: the review process and findings of the MELCOR Peer Review Committee are documented in this report. The Committee has determined that recommendations in five areas are appropriate: (1) MELCOR numerics, (2) models missing from MELCOR Version 1.8.1, (3) existing MELCOR models needing revision, (4) the need for expanded MELCOR assessment, and (5) documentation

  7. Organising a manuscript reporting quality improvement or patient safety research.

    Science.gov (United States)

    Holzmueller, Christine G; Pronovost, Peter J

    2013-09-01

    Peer-reviewed publication plays important roles in disseminating research findings, developing generalisable knowledge and garnering recognition for authors and institutions. Nonetheless, many bemoan the whole manuscript writing process, intimidated by the arbitrary and somewhat opaque conventions. This paper offers practical advice about organising and writing a manuscript reporting quality improvement or patient safety research for submission to a peer-reviewed journal. Each section of the paper discusses a specific manuscript component-from title, abstract and each section of the manuscript body, through to reference list and tables and figures-explaining key principles, offering content organisation tips and providing an example of how this section may read. The paper also offers a checklist of common mistakes to avoid in a manuscript.

  8. 2014 Wind Program Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    none,

    2014-10-01

    The Wind Program Peer Review Meeting was held March 24-28, 2014 in Arlington, VA. Principle investigators from the Energy Department, National Laboratories, academic, and industry representatives presented the progress of their DOE-funded research. This report documents the formal, rigorous evaluation process and findings of nine independent reviewers who examined the technical, scientific, and business results of Wind Program funded projects, as well as the productivity and management effectiveness of the Wind Program itself.

  9. 7 CFR 205.509 - Peer review panel.

    Science.gov (United States)

    2010-01-01

    ... 7 Agriculture 3 2010-01-01 2010-01-01 false Peer review panel. 205.509 Section 205.509 Agriculture... PROVISIONS NATIONAL ORGANIC PROGRAM Accreditation of Certifying Agents § 205.509 Peer review panel. The Administrator shall establish a peer review panel pursuant to the Federal Advisory Committee Act (FACA) (5 U.S.C...

  10. Submission of scientifically sound and ethical manuscripts to peer-reviewed journals - a reviewer's personal perspective on bioanalytical publications.

    Science.gov (United States)

    Weng, Naidong

    2012-11-01

    In the pharmaceutical industry, bioanalysis is very dynamic and is probably one of the few fields of research covering the entire drug discovery, development and post-marketing process. Important decisions on drug safety can partially rely on bioanalytical data, which therefore can be subject to regulatory scrutiny. Bioanalytical scientists have historically contributed significant numbers of scientific manuscripts in many peer-reviewed analytical journals. All of these journals provide some high-level instructions, but they also leave sufficient flexibility for reviewers to perform independent critique and offer recommendations for each submitted manuscript. Reviewers play a pivotal role in the process of bioanalytical publication to ensure the publication of high-quality manuscripts in a timely fashion. Their efforts usually lead to improved manuscripts. However, it has to be a joint effort among authors, reviewers and editors to promote scientifically sound and ethically fair bioanalytical publications. Most of the submitted manuscripts were well written with only minor or moderate revisions required for further improvement. Nevertheless, there were small numbers of submitted manuscripts that did not meet the requirements for publications because of scientific or ethical deficiencies, which are discussed in this Letter to the Editor. Copyright © 2012 John Wiley & Sons, Ltd.

  11. A Scoping Review of Empirical Research Relating to Quality and Effectiveness of Research Ethics Review.

    Directory of Open Access Journals (Sweden)

    Stuart G Nicholls

    Full Text Available To date there is no established consensus of assessment criteria for evaluating research ethics review.We conducted a scoping review of empirical research assessing ethics review processes in order to identify common elements assessed, research foci, and research gaps to aid in the development of assessment criteria. Electronic searches of Ovid Medline, PsychInfo, and the Cochrane DSR, ACP Journal Club, DARE, CCTR, CMR, HTA, and NHSEED, were conducted. After de-duplication, 4234 titles and abstracts were reviewed. Altogether 4036 articles were excluded following screening of titles, abstracts and full text. A total of 198 articles included for final data extraction.Few studies originated from outside North America and Europe. No study reported using an underlying theory or framework of quality/effectiveness to guide study design or analyses. We did not identify any studies that had involved a controlled trial--randomised or otherwise--of ethics review procedures or processes. Studies varied substantially with respect to outcomes assessed, although tended to focus on structure and timeliness of ethics review.Our findings indicate a lack of consensus on appropriate assessment criteria, exemplified by the varied study outcomes identified, but also a fragmented body of research. To date research has been largely quantitative, with little attention given to stakeholder experiences, and is largely cross sectional. A lack of longitudinal research to date precludes analyses of change or assessment of quality improvement in ethics review.

  12. A Scoping Review of Empirical Research Relating to Quality and Effectiveness of Research Ethics Review

    Science.gov (United States)

    Nicholls, Stuart G.; Hayes, Tavis P.; Brehaut, Jamie C.; McDonald, Michael; Weijer, Charles; Saginur, Raphael; Fergusson, Dean

    2015-01-01

    Background To date there is no established consensus of assessment criteria for evaluating research ethics review. Methods We conducted a scoping review of empirical research assessing ethics review processes in order to identify common elements assessed, research foci, and research gaps to aid in the development of assessment criteria. Electronic searches of Ovid Medline, PsychInfo, and the Cochrane DSR, ACP Journal Club, DARE, CCTR, CMR, HTA, and NHSEED, were conducted. After de-duplication, 4234 titles and abstracts were reviewed. Altogether 4036 articles were excluded following screening of titles, abstracts and full text. A total of 198 articles included for final data extraction. Results Few studies originated from outside North America and Europe. No study reported using an underlying theory or framework of quality/effectiveness to guide study design or analyses. We did not identify any studies that had involved a controlled trial - randomised or otherwise – of ethics review procedures or processes. Studies varied substantially with respect to outcomes assessed, although tended to focus on structure and timeliness of ethics review. Discussion Our findings indicate a lack of consensus on appropriate assessment criteria, exemplified by the varied study outcomes identified, but also a fragmented body of research. To date research has been largely quantitative, with little attention given to stakeholder experiences, and is largely cross sectional. A lack of longitudinal research to date precludes analyses of change or assessment of quality improvement in ethics review. PMID:26225553

  13. A peer review process as part of the implementation of clinical pathways in radiation oncology: Does it improve compliance?

    Science.gov (United States)

    Gebhardt, Brian J; Heron, Dwight E; Beriwal, Sushil

    Clinical pathways are patient management plans that standardize evidence-based practices to ensure high-quality and cost-effective medical care. Implementation of a pathway is a collaborative process in our network, requiring the active involvement of physicians. This approach promotes acceptance of pathway recommendations, although a peer review process is necessary to ensure compliance and to capture and approve off-pathway selections. We investigated the peer review process and factors associated with time to completion of peer review. Our cancer center implemented radiation oncology pathways for every disease site throughout a large, integrated network. Recommendations are written based upon national guidelines, published literature, and institutional experience with evidence evaluated hierarchically in order of efficacy, toxicity, and then cost. Physicians enter decisions into an online, menu-driven decision support tool that integrates with medical records. Data were collected from the support tool and included the rate of on- and off-pathway selections, peer review decisions performed by disease site directors, and time to complete peer review. A total of 6965 treatment decisions were entered in 2015, and 605 (8.7%) were made off-pathway and were subject to peer review. The median time to peer review decision was 2 days (interquartile range, 0.2-6.8). Factors associated with time to peer review decision >48 hours on univariate analysis include disease site (P peer review (P 48 hours. Clinical pathways are an integral tool for standardizing evidence-based care throughout our large, integrated network, with 91.3% of all treatment decisions being made as per pathway. The peer review process was feasible, with peer review of treatment decisions encourages compliance with clinical pathway recommendations. Copyright © 2017 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved.

  14. Peer review statement

    Science.gov (United States)

    2018-03-01

    All papers published in this volume of Journal of Physics: Conference Series have been peer reviewed through processes administered by the proceedings Editors. Reviews were conducted by expert referees to the professional and scientific standards expected of a proceedings journal published by IOP Publishing.

  15. Evaluating Management Information Systems, A Protocol for Automated Peer Review Systems

    Science.gov (United States)

    Black, Gordon C.

    1980-01-01

    This paper discusses key issues in evaluating an automated Peer Review System. Included are the conceptual base, design, steps in planning structural components, operation parameters, criteria, costs and a detailed outline or protocol for use in the evaluation. At the heart of the Peer Review System is the criteria utilized for measuring quality. Criteria evaluation should embrace, as a minimum, appropriateness, validity and reliability, and completemess or comprehensiveness of content. Such an evaluation is not complete without determining the impact (clinical outcome) of the service system or the patient and the population served.

  16. Positive Peer Support or Negative Peer Influence? the Role of Peers among Adolescents in Recovery High Schools

    Science.gov (United States)

    Karakos, Holly L.

    2014-01-01

    Evidence from previous research suggests that peers at times exert negative influence and at other times exert positive influence on drug and alcohol use among adolescents in recovery. This study explores recovery high school staff members' perceptions of peer support among students in recovery high schools using qualitative interview data. Themes…

  17. The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise.

    Science.gov (United States)

    Kovanis, Michail; Porcher, Raphaël; Ravaud, Philippe; Trinquart, Ludovic

    2016-01-01

    The growth in scientific production may threaten the capacity for the scientific community to handle the ever-increasing demand for peer review of scientific publications. There is little evidence regarding the sustainability of the peer-review system and how the scientific community copes with the burden it poses. We used mathematical modeling to estimate the overall quantitative annual demand for peer review and the supply in biomedical research. The modeling was informed by empirical data from various sources in the biomedical domain, including all articles indexed at MEDLINE. We found that for 2015, across a range of scenarios, the supply exceeded by 15% to 249% the demand for reviewers and reviews. However, 20% of the researchers performed 69% to 94% of the reviews. Among researchers actually contributing to peer review, 70% dedicated 1% or less of their research work-time to peer review while 5% dedicated 13% or more of it. An estimated 63.4 million hours were devoted to peer review in 2015, among which 18.9 million hours were provided by the top 5% contributing reviewers. Our results support that the system is sustainable in terms of volume but emphasizes a considerable imbalance in the distribution of the peer-review effort across the scientific community. Finally, various individual interactions between authors, editors and reviewers may reduce to some extent the number of reviewers who are available to editors at any point.

  18. Impartial judgment by the "gatekeepers" of science: fallibility and accountability in the peer review process.

    Science.gov (United States)

    Hojat, Mohammadreza; Gonnella, Joseph S; Caelleigh, Addeane S

    2003-01-01

    High publication demands and the low acceptance rate of peer review journals place the journal editors and their reviewers in a powerful position. Journal reviewers have a vital role not only in influencing the journal editor's publication decisions, but also in the very nature and direction of scientific research. Because of their influence in peer review outcomes, journal reviewers are aptly described as the "gatekeepers of science." In this article we describe several pitfalls that can impede reviewers' impartial judgement. These include such issues as confirmatory bias, the negative results bias (the file drawer problem), the Matthew effect, the Doctor Fox effect, and gender, race, theoretical orientation, and "political correctness." We argue that procedures currently used by many professional journals, such as blind or masked review, may not completely alleviate the effects of these pitfalls. Instead, we suggest that increasing reviewers' awareness of the pitfalls, accountability, and vigilance can improve fairness in the peer review process. The ultimate responsibilities belong to the journal editors who are confronted with the difficult task of satisfying journal readers, contributors, reviewers, and owners. We recommend that the journal editors conduct periodic internal and external evaluations of their journals' peer review process and outcomes, with participation of reviewers, contributors, readers and owners.

  19. SALTO Peer Review Guidelines. Guidelines for Peer Review of Safety Aspects of Long Term Operation of Nuclear Power Plants

    International Nuclear Information System (INIS)

    2014-01-01

    International peer review is a useful tool for Member States to exchange experiences, learn from each other and apply good practices in the long term operation (LTO) of nuclear power plants (NPPs). The peer review is also an important mechanism through which the IAEA supports Member States in enhancing the safety of NPPs. The IAEA has conducted various types of safety review that indirectly address aspects of LTO, including safety reviews for design, engineering, operation and external hazards. Operational Safety Review Team (OSART) services include review of ageing management programmes. In addition, several Member States have requested Ageing Management Assessment Team (AMAT) missions. Through these experiences, it was recognized that a comprehensive peer review on LTO would be very useful to Member States. The Safety Aspects of Long Term Operation (SALTO) peer review addresses strategy and key elements for the safe LTO of NPPs, which includes AMAT objectives and complements OSART reviews. The SALTO peer review is designed to assist operating organizations in adopting a proper approach to LTP including implementing appropriate activities to ensure that plant safety will be maintained during the LTO period. The SALTO peer review can be tailored to focus on ageing management programmes (AMPs) or on other activities related to LTO to support the Member State in enhancing the safety of its NPPs. The SALTO peer review can also support regulators in establishing or improving regulatory and licensing strategies for the LTO of NPPs. The guidelines in this publication are primarily intended for members of a SALTO review team and provide a basic structure and common reference for peer reviews of LTO. Additionally, the guidelines also provide useful information to the operating organizations of NPPs (or technical support organizations) for carrying out their own self-assessments or comprehensive programme reviews. The guidelines are intended to be generic, as there are

  20. Extent, quality and impact of patient and public involvement in antimicrobial drug development research: A systematic review.

    Science.gov (United States)

    Evans, David; Bird, Emma; Gibson, Andy; Grier, Sally; Chin, Teh Li; Stoddart, Margaret; MacGowan, Alasdair

    2018-02-01

    Patient and public involvement (PPI) is increasingly recognized as bringing a range of benefits to clinical and health services research. Recent systematic reviews have identified and synthesized many benefits (eg higher recruitment rates) and some costs (eg extra time need). Much of the literature focuses on PPI in long-term conditions rather than more acute health care in which the majority of microbiological research is undertaken. The aim was to identify the extent, quality and impact of PPI in antimicrobial drug development research. Objectives were to identify any relevant reporting of PPI in antimicrobial research; appraise the quality of reporting on PPI using recognized PPI reporting and critical appraisal tools; and extract and synthesize data on the impact of PPI. A systematic review was undertaken with a search strategy based on four word groups (PPI, patients, antimicrobial drug development and outcomes). Eight online databases were searched. English language publication, publication between 1996 and 2016 and studies describing PPI in antimicrobial drug development research. No studies were found through online searching that met the search strategy and inclusion criteria. One relevant protocol paper with a brief mention of PPI was identified through expert recommendation. Commentary papers recommending PPI were identified through website searching and expert opinion. Despite strong policy guidance encouraging PPI at the international and national levels, and anecdotal accounts of PPI taking place, evidence for the extent, quality and impact of PPI in antimicrobial drug development research has not yet appeared in the peer-reviewed literature. © 2017 The Authors Health Expectations Published by John Wiley & Sons Ltd.

  1. 75 FR 4062 - Peer Review Best Practices Workshop

    Science.gov (United States)

    2010-01-26

    ... DEPARTMENT OF ENERGY Peer Review Best Practices Workshop AGENCY: Department of Energy, Office of..., demonstration and deployment programs and has used a variety of peer review approaches to select the best...'' for reviewing and selecting project proposals. The workshop will explore classic peer review processes...

  2. 28 CFR 34.110 - Management of peer reviews.

    Science.gov (United States)

    2010-07-01

    ... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Management of peer reviews. 34.110 Section 34.110 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES... the peer review process. ...

  3. Idaho Transportation Department : 2010 research program peer exchange.

    Science.gov (United States)

    2010-05-01

    The objectives of the peer exchange were to: : 1. Identify strengths, challenges, and opportunities for program and project management; : 2. Understand management expectations of the ITD Research Program; : 3. Review processes for project selection a...

  4. Effectiveness of Guided Peer Review of Student Essays in a Large Undergraduate Biology Course

    Science.gov (United States)

    Kelly, Lauren

    2015-01-01

    Instructors and researchers often consider peer review an integral part of the writing process, providing myriad benefits for both writers and reviewers. Few empirical studies, however, directly address the relationship between specific methodological changes and peer review effectiveness, especially outside the composition classroom. To…

  5. Peer Collaboration: Improving Teaching through Comprehensive Peer Review

    Science.gov (United States)

    Smith, Shelley L.

    2014-01-01

    This article includes a brief rationale and review of the literature on peer review of teaching (PRT). Based on that literature review, it offers a proposal for an optimal formative review process that results in a teaching portfolio that would reflect a faculty member's efforts and successes in a critically reflective PRT process, and contributes…

  6. Bound by Tradition? Peer Review and New Scholarship: An Institutional Case Study

    Science.gov (United States)

    White, Barbara Jo; Cruz, Laura; Ellern, Jill; Ford, George; Moss, Hollye

    2012-01-01

    Peer review is by no means a routine process for traditional, or basic, research. Even so, peer review is even less routinized for other forms of scholarship. In 1990, Ernest Boyer called for a reconsideration of scholarship and extended the definition to be inclusive of non-traditional modes of scholarly production and delivery. However, peer…

  7. Addressing Clinical Faculty Need: Creating a Process and Evaluation for Peer Review of Practice

    Directory of Open Access Journals (Sweden)

    Jean Y. Moon

    2014-01-01

    Full Text Available Objectives: To describe the evolving process and evaluate the perceived value of peer review for clinical faculty. Methods: Using a 5-point Likert scale, clinical faculty rated the value of an electronic peer review process by completing an electronic 30 item survey across six areas of clinical faculty practice-related activity. Based on feedback, modifications were made and faculty were re-surveyed the following year. Results: Initially, 78% of faculty found peer review to be beneficial, mostly in the area of practice development and portions of practice dissemination. After modifications, 45% found peer review to be beneficial. Conclusions: Clinical faculty are challenged to leverage their practice into teaching and scholarly activities; however, clinical faculty often need feedback to accomplish this. Although the peer review process was designed to address perceived needs of clinical faculty, the process is dynamic and needs further refinement. Overall, clinical faculty find value in a peer review process. This evaluation of peer review illustrates the challenges to provide feedback across six key areas of clinical faculty activity.   Type: Original Research

  8. Don't Tell It Like It Is: Preserving Collegiality in the Summative Peer Review of Teaching

    Science.gov (United States)

    Iqbal, Isabeau A.

    2014-01-01

    While much literature has considered feedback and professional growth in formative peer reviews of teaching, there has been little empirical research conducted on these issues in the context of summative peer reviews. This article explores faculty members' perceptions of feedback practices in the summative peer review of teaching and reports on…

  9. Evidence-based Peer Review for Radiation Therapy - Updated Review of the Literature with a Focus on Tumour Subsite and Treatment Modality.

    Science.gov (United States)

    Huo, M; Gorayski, P; Poulsen, M; Thompson, K; Pinkham, M B

    2017-10-01

    Technological advances in radiation therapy permit steep dose gradients from the target to spare normal tissue, but increase the risk of geographic miss. Suboptimal target delineation adversely affects clinical outcomes. Prospective peer review is a method for quality assurance of oncologists' radiotherapy plans. Published surveys suggest it is widely implemented. However, it may not be feasible to review every case before commencement of radiation therapy in all departments. The rate of plan changes following peer review of cases without a specific subsite or modality is typically around 10%. Stereotactic body radiation therapy, head and neck, gynaecological, gastrointestinal, haematological and lung cases are associated with higher rates of change of around 25%. These cases could thus be prioritised for peer review. Other factors may limit peer review efficacy including organisational culture, time constraints and the physical environment in which sessions are held. Recommendations for peer review endorsed by the American Society for Radiation Oncology were made available in 2013, but a number of relevant studies have been published since. Here we review and update the literature, and provide an updated suggestion for the implementation of peer review to serve as an adjunct to published guidelines. This may help practitioners evaluate their current processes and maximise the utility and effectiveness of peer review sessions. Copyright © 2017 The Royal College of Radiologists. Published by Elsevier Ltd. All rights reserved.

  10. Characteristics of retractions related to faked peer reviews: an overview.

    Science.gov (United States)

    Qi, Xingshun; Deng, Han; Guo, Xiaozhong

    2017-08-01

    A faked peer review is a novel cause for retraction. We reviewed the characteristics of papers retracted due to a faked peer review. All papers retracted due to faked peer reviews were identified by searching the Retraction Watch website and by conducting a manual search. All identified papers were confirmed in published journals. The information of retracted papers was collected, which primarily included publisher, journal, journal impact factor, country, as well as publication and retraction year. Overall, 250 retracted papers were identified. They were published in 48 journals by six publishers. The top 5 journals included the Journal of Vibration and Control (24.8%), Molecular Biology Reports (11.6%), Immunopharmacology and Immunotoxicology (8.0%), Tumour Biology (6.8%) and European Journal of Medical Research (6.4%). The publishers included SAGE (31%), Springer (26%), BioMed Central (18%), Elsevier (13%), Informa (11%) and LWW (1%). A minority (4%) of retracted papers were published in Science Citation Index (SCI) journals with an impact factor of >5. A majority (74.8%) of retracted papers were written by Chinese researchers. In terms of the publication year, the retracted papers were published since 2010, and the number of retracted papers peaked in 2014 (40.8%). In terms of the retraction year, the retractions started in 2012, and the number of retractions peaked in 2015 (59.6%). The number of papers retracted due to faked peer reviews differs largely among journals and countries. With the improvement of the peer review mechanism and increased education about publishing ethics, such academic misconduct may gradually disappear in future. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

  11. ROAST: Peer Review as a Learning and Assessment Tool in Graduate Education

    Science.gov (United States)

    Somerville, R. C.

    2003-12-01

    Constructivist learning theory and inquiry-based educational practice stress the parallels between learning and research. Although peer review has long been a central feature of the working lives of research scientists, it has rarely found its way into the classroom. Motivated by this thought, an imaginary journal, Reviews of Atmospheric Science Topics (ROAST), has been integrated into a graduate-level course in atmospheric thermodynamics. The instructor acts as editor of ROAST. Students in the class are divided into teams and assigned topics on which to write survey papers and give in-class presentations, using the text, the Internet, the library, and other resources. The assigned topics range over the subject matter of the course. The submitted survey papers are sent by the ROAST editor to other members of the class, acting as anonymous reviewers. Just as in the case of real research journals, the editor asks the authors to respond to criticisms of reviewers and then sends the revised papers back to the reviewers. Each student is thus a researcher and co-author of one paper as well as an anonymous reviewer of several others. ROAST has proven to be not only a useful means of fostering learning, but also a natural and effective assessment tool. The peer review mechanism allows the student authors to address the defects in their papers, and hence in their learning, as pointed out not by an authority figure or an examination but by their own peers. As an important side benefit, the students gain experience with the peer review process itself and come to appreciate its strengths and weaknesses in evaluating scientific papers.

  12. The Role of the Anonymous Voice in Post-Publication Peer Review Versus Traditional Peer Review

    Directory of Open Access Journals (Sweden)

    Jaime A. Teixeira da Silva

    2015-12-01

    Full Text Available Traditional peer review (TPR has several limitations and weaknesses. Post-publication peer review is one practical way to repair the ills of TPR and reinforce it. A literature that is marked by errors is unhealthy and should, if given the opportunity, be corrected or further improved. The anonymous voice is one source of critique and differs from the blind peer review in TPR in which the reviewer remains anonymous to the authors and/or vice versa, but the identity is known to the editor. If unregulated, the anonymous voice can pose a threat to established editorial norms in TPR, to one of the most important criteria of science publishing, i.e., transparency, and to worthwhile discussion. Yet, if the anonymous voice is not heard, then a vast and potentially valuable pool of untapped opinions may be lost, opinions that may provide valuable solutions to improving TPR.

  13. Implementing Head and Neck Contouring Peer Review without Pathway Delay: The On-demand Approach.

    Science.gov (United States)

    Fong, C; Sanghera, P; Good, J; Nightingale, P; Hartley, A

    2017-12-01

    Peer review of contour volume is a priority in the radiotherapy treatment quality assurance process for head and neck cancer. It is essential that incorporation of peer review activity does not introduce additional delays. An on-demand peer review process was piloted to assess the feasibility and efficiency of this approach, as compared with a historic scheduled weekly approach. Between November 2016 and April 2017 four head and neck clinicians in one centre took part in an on-demand peer review process. Cases were of radical or adjuvant intent of any histology and submitted on a voluntary basis. The outcome of contour peer review would be one of unchanged (UC), unchanged with variation or discretion noted (UV), minor change (M) or significant change (S). The time difference between the completion of the on-demand peer review was compared with the time difference to a hypothetical next Monday or Tuesday weekly peer review meeting. The time taken to review each case was also documented in the latter period of the pilot project. In total, 62 cases underwent peer review. Peer review on-demand provided dosimetrists with an average of an extra two working days available per case to meet treatment start dates. The proportion of cases with outcomes UC, UV, M and S were 45%, 16%, 26% and 13%, respectively. The mean peer review time spent per case was 17 min (12 cases). The main reason for S was discrepancy in imaging interpretation (4/8 cases). A lower proportion of oropharyngeal cases were submitted and had S outcomes. A higher proportion of complex cases, e.g. sinonasal/nasopharynx location or previous downstaging chemotherapy had S outcomes. The distribution of S outcomes appears to be similar regardless of clinician experience. The level of peer review activity among individuals differed by workload and job timetable. On-demand peer review of the head and neck contour volume is feasible, reduces delay to the start of dosimetry planning and bypasses the logistical

  14. Peer-led training and assessment in basic life support for healthcare students: synthesis of literature review and fifteen years practical experience.

    Science.gov (United States)

    Harvey, P R; Higenbottam, C V; Owen, A; Hulme, J; Bion, J F

    2012-07-01

    In 1995, the University of Birmingham, UK, School of Medicine and Dentistry replaced lecture-based basic life support (BLS) teaching with a peer-led, practical programme. We present our 15-yr experience of peer-led healthcare undergraduate training and examination with a literature review. A literature review of healthcare undergraduate peer-led practical skills teaching was performed though Pubmed. The development of the Birmingham course is described, from its inception in 1995-2011. Training methods include peer-led training and assessment by senior students who complete an European Resuscitation Council-endorsed instructor course. Student assessors additionally undergo training in assessment and communication skills. The course has been developed by parallel research evaluation and peer-reviewed publication. Course administration is by an experienced student committee with senior clinician support. Anonymous feedback from the most recent courses and the current annual pass rates are reported. The literature review identified 369 publications of which 28 met our criteria for inclusion. Largely descriptive, these are highly positive about peer involvement in practical skills teaching using similar, albeit smaller, courses to that described below. Currently approximately 600 first year healthcare undergraduates complete the Birmingham course; participant numbers increase annually. Successful completion is mandatory for students to proceed to the second year of studies. First attempt pass rate is 86%, and close to 100% (565/566 students, 99.8%) following re-assessment the same day. 97% of participants enjoyed the course, 99% preferred peer-tutors to clinicians, 99% perceived teaching quality as "good" or "excellent", and felt they had sufficient practice. Course organisation was rated "good" or "excellent" by 91%. Each year 3-4 student projects have been published or presented internationally. The annual cost of providing the course is currently £15,594.70 (Eur 18

  15. Peer Review: Promoting Efficient School District Operations

    Science.gov (United States)

    Hale, Jason S.

    2010-01-01

    Many professions recognize the benefits of peer reviews to assess processes and operations because peers can more easily identify one another's inefficiencies and provide some kind of intervention. Generally, the goal of the peer review process is to verify whether the work satisfies the standards set by the industry. A number of states have begun…

  16. An open science peer review oath

    DEFF Research Database (Denmark)

    Aleksic, Jelena; Adrian Alexa, Adrian Alexa; Attwood, Teresa K.

    2015-01-01

    One of the foundations of the scientific method is to be able to reproduce experiments and corroborate the results of research that has been done before. However, with the increasing complexities of new technologies and techniques, coupled with the specialisation of experiments, reproducing......: specifically, we introduce a peer-review oath and accompanying manifesto. These have been designed to offer guidelines to enable reviewers (with the minimum friction or bias) to follow and apply open science principles, and support the ideas of transparency, reproducibility and ultimately greater societal...... research findings has become a growing challenge. Clearly, scientific methods must be conveyed succinctly, and with clarity and rigour, in order for research to be reproducible. Here, we propose steps to help increase the transparency of the scientific method and the reproducibility of research results...

  17. Quality research in healthcare: are researchers getting enough statistical support?

    Directory of Open Access Journals (Sweden)

    Ambler Gareth

    2006-01-01

    Full Text Available Abstract Background Reviews of peer-reviewed health studies have highlighted problems with their methodological quality. As published health studies form the basis of many clinical decisions including evaluation and provisions of health services, this has scientific and ethical implications. The lack of involvement of methodologists (defined as statisticians or quantitative epidemiologists has been suggested as one key reason for this problem and this has been linked to the lack of access to methodologists. This issue was highlighted several years ago and it was suggested that more investments were needed from health care organisations and Universities to alleviate this problem. Methods To assess the current level of methodological support available for health researchers in England, we surveyed the 25 National Health Services Trusts in England, that are the major recipients of the Department of Health's research and development (R&D support funding. Results and discussion The survey shows that the earmarking of resources to provide appropriate methodological support to health researchers in these organisations is not widespread. Neither the level of R&D support funding received nor the volume of research undertaken by these organisations showed any association with the amount they spent in providing a central resource for methodological support for their researchers. Conclusion The promotion and delivery of high quality health research requires that organisations hosting health research and their academic partners put in place funding and systems to provide appropriate methodological support to ensure valid research findings. If resources are limited, health researchers may have to rely on short courses and/or a limited number of advisory sessions which may not always produce satisfactory results.

  18. 28 CFR 34.104 - Use of peer review.

    Science.gov (United States)

    2010-07-01

    ... 28 Judicial Administration 1 2010-07-01 2010-07-01 false Use of peer review. 34.104 Section 34.104 Judicial Administration DEPARTMENT OF JUSTICE OJJDP COMPETITION AND PEER REVIEW PROCEDURES Peer Review § 34... programs for which a large number of applications is expected, preapplications (concept papers) may be...

  19. Systematic review of peer education intervention programmes among individuals with type 2 diabetes.

    Science.gov (United States)

    Gatlin, Tricia K; Serafica, Reimund; Johnson, Michael

    2017-12-01

    To systematically review published randomised controlled trials of peer education interventions among adults with type 2 diabetes. Systematic reviews have shown mixed results for peer support interventions to improve diabetes self-management. Given the effectiveness of diabetes education by healthcare professionals, peer education interventions may be a useful alternative approach. This review addressed that gap. Systematic review. A systematic search of published randomised controlled trials between 2006-2016 was conducted using the keywords diabetes, type 2 diabetes, randomised controlled trials, self-management, peer education and peer support. The methodological quality of each study was assessed using the Jadad scale. Seven studies were included in the final review, and the Jadad scores ranged from 8-10 of a possible 13 points. There was no consistent design, setting, or outcome measurement among the studies. There were two types of peer education interventions compared to traditional diabetes education: face-to-face or a combination of face-to-face and telephone/texting. The most common clinical outcome measure was HbA1c. Two of six studies showed statistically significant improvement in HbA1c between intervention and control groups. An increase in diabetes knowledge was also statistically significant in two of five studies. Peer education could be successful in improving clinical outcomes. No evidence was found indicating that healthcare provider education was superior in regard to clinical knowledge or behavioural or psychological outcome measures than peer education. HbA1c was statistically significantly lower in some peer education groups compared to control groups. There is evidence that peer education can be useful in achieving positive clinical outcomes such as decreasing HbA1c levels and increasing diabetes knowledge. A certified diabetes educator or a trained healthcare professional should not be overlooked though when using peer educators. © 2017

  20. Drinking water quality in Indigenous communities in Canada and health outcomes: a scoping review.

    Science.gov (United States)

    Bradford, Lori E A; Okpalauwaekwe, Udoka; Waldner, Cheryl L; Bharadwaj, Lalita A

    2016-01-01

    Many Indigenous communities in Canada live with high-risk drinking water systems and drinking water advisories and experience health status and water quality below that of the general population. A scoping review of research examining drinking water quality and its relationship to Indigenous health was conducted. The study was undertaken to identify the extent of the literature, summarize current reports and identify research needs. A scoping review was designed to identify peer-reviewed literature that examined challenges related to drinking water and health in Indigenous communities in Canada. Key search terms were developed and mapped on five bibliographic databases (MEDLINE/PubMED, Web of Knowledge, SciVerse Scopus, Taylor and Francis online journal and Google Scholar). Online searches for grey literature using relevant government websites were completed. Sixteen articles (of 518; 156 bibliographic search engines, 362 grey literature) met criteria for inclusion (contained keywords; publication year 2000-2015; peer-reviewed and from Canada). Studies were quantitative (8), qualitative (5) or mixed (3) and included case, cohort, cross-sectional and participatory designs. In most articles, no definition of "health" was given (14/16), and the primary health issue described was gastrointestinal illness (12/16). Challenges to the study of health and well-being with respect to drinking water in Indigenous communities included irregular funding, remote locations, ethical approval processes, small sample sizes and missing data. Research on drinking water and health outcomes in Indigenous communities in Canada is limited and occurs on an opportunistic basis. There is a need for more research funding, and inquiry to inform policy decisions for improvements of water quality and health-related outcomes in Indigenous communities. A coordinated network looking at First Nations water and health outcomes, a database to store and create access to research findings, increased

  1. Drinking water quality in Indigenous communities in Canada and health outcomes: a scoping review

    Directory of Open Access Journals (Sweden)

    Lori E. A. Bradford

    2016-07-01

    Full Text Available Background: Many Indigenous communities in Canada live with high-risk drinking water systems and drinking water advisories and experience health status and water quality below that of the general population. A scoping review of research examining drinking water quality and its relationship to Indigenous health was conducted. Objective: The study was undertaken to identify the extent of the literature, summarize current reports and identify research needs. Design: A scoping review was designed to identify peer-reviewed literature that examined challenges related to drinking water and health in Indigenous communities in Canada. Key search terms were developed and mapped on five bibliographic databases (MEDLINE/PubMED, Web of Knowledge, SciVerse Scopus, Taylor and Francis online journal and Google Scholar. Online searches for grey literature using relevant government websites were completed. Results: Sixteen articles (of 518; 156 bibliographic search engines, 362 grey literature met criteria for inclusion (contained keywords; publication year 2000–2015; peer-reviewed and from Canada. Studies were quantitative (8, qualitative (5 or mixed (3 and included case, cohort, cross-sectional and participatory designs. In most articles, no definition of “health” was given (14/16, and the primary health issue described was gastrointestinal illness (12/16. Challenges to the study of health and well-being with respect to drinking water in Indigenous communities included irregular funding, remote locations, ethical approval processes, small sample sizes and missing data. Conclusions: Research on drinking water and health outcomes in Indigenous communities in Canada is limited and occurs on an opportunistic basis. There is a need for more research funding, and inquiry to inform policy decisions for improvements of water quality and health-related outcomes in Indigenous communities. A coordinated network looking at First Nations water and health outcomes, a

  2. The Role of Peer Group Aggression in Predicting Adolescent Dating Violence and Relationship Quality

    Science.gov (United States)

    Ellis, Wendy E.; Chung-Hall, Janet; Dumas, Tara M.

    2013-01-01

    Past research has shown that adolescent peer groups make a significant contribution to shaping behavior but less is known about the role of peer groups in adolescent dating relationships. This longitudinal study examined the contribution of aggressive peer group norms on relationship quality and dating violence among dating adolescents. At the…

  3. Experiences of undergraduate nursing students in peer assisted learning in clinical practice: a qualitative systematic review.

    Science.gov (United States)

    Carey, Matthew C; Kent, Bridie; Latour, Jos M

    2018-05-01

    methodological quality independently by two reviewers, using the Joanna Briggs Institute Critical Appraisal Form for Interpretive and Critical Research. Qualitative data was extracted using the standardized JBI qualitative data extraction tool. Qualitative research findings were synthesized using JBI methodology. From the eight included studies, 37 findings were extracted. These findings were further aggregated into seven categories, and then into three synthesized findings. These three synthesized findings are: 1) Challenges of clinical practice are mitigated by peer support; 2) Peers are role models for enhancing clinical knowledge; and 3) Support and feedback develop competence and confidence, and reduce stress and anxiety. Peer-assisted learning exists in clinical practice in both formal and informal circumstances. Friendship and community are often expressed as occurring when peers work together. Support and feedback help students develop in their clinical role and enhance clinical knowledge. Outcomes include enhancing the competency and confidence of peers, and reducing stress and anxiety. Challenges of clinical practice are mitigated through PAL.

  4. Lessons Learned about Post-Tenure Review from the AAHE Peer Review of Teaching Project.

    Science.gov (United States)

    Taylor, James W.

    1999-01-01

    Describes use of a strategy adapted from the American Association for Higher Education's Peer Review of Teaching Project, the "reflective memo," to provide backward and forward view of post-tenure reviews in the chemistry department of the University of Wisconsin (Madison). The approach served as a guide in review of research, teaching,…

  5. Emerging trends in peer review—a survey

    Science.gov (United States)

    Walker, Richard; Rocha da Silva, Pascal

    2015-01-01

    “Classical peer review” has been subject to intense criticism for slowing down the publication process, bias against specific categories of paper and author, unreliability, inability to detect errors and fraud, unethical practices, and the lack of recognition for unpaid reviewers. This paper surveys innovative forms of peer review that attempt to address these issues. Based on an initial literature review, we construct a sample of 82 channels of scientific communication covering all forms of review identified by the survey, and analyze the review mechanisms used by each channel. We identify two major trends: the rapidly expanding role of preprint servers (e.g., ArXiv) that dispense with traditional peer review altogether, and the growth of “non-selective review,” focusing on papers' scientific quality rather than their perceived importance and novelty. Other potentially important developments include forms of “open review,” which remove reviewer anonymity, and interactive review, as well as new mechanisms for post-publication review and out-of-channel reader commentary, especially critical commentary targeting high profile papers. One of the strongest findings of the survey is the persistence of major differences between the peer review processes used by different disciplines. None of these differences is likely to disappear in the foreseeable future. The most likely scenario for the coming years is thus continued diversification, in which different review mechanisms serve different author, reader, and publisher needs. Relatively little is known about the impact of these innovations on the problems they address. These are important questions for future quantitative research. PMID:26074753

  6. Early Citability of Data vs Peer-Review like Data Publishing Procedures

    Science.gov (United States)

    Stockhause, Martina; Höck, Heinke; Toussaint, Frank; Lautenschlager, Michael

    2014-05-01

    The World Data Center for Climate (WDCC) hosted at the German Climate Computing Center (DKRZ) was one of the first data centers, which established a peer-review like data publication procedure resulting in DataCite DOIs. Data in the long-term archive (LTA) is diligently reviewed by data managers and data authors to grant high quality and widely reusability of the published data. This traditional data publication procedure for LTA data bearing DOIs is very time consuming especially for WDCC's high data volumes of climate model data in the order of multiple TBytes. Data is shared with project members and selected scientists months before the data is long-term archived. The scientific community analyses and thus reviews the data leading to data quality improvements. Scientists wish to cite these unstable data in scientific publications before the long-term archiving and the thorough data review process are finalized. A concept for early preprint DOIs for shared but not yet long-term archived data is presented. Requirements on data documentation, persistence and quality and use cases for preprint DOIs within the data life-cycle are discussed as well as questions of how to document the differences of the two DOI types and how to relate them to each other with the recommendation to use LTA DOIs in citations. WDCC wants to offer an additional user service for early citations of data of basic quality without compromising the LTA DOIs, i.e. WDCC's standard DOIs, as trustworthy indicator for high quality data. Referencing Links: World Data Center for Climate (WDCC): http://www.wdc-climate.de German Climate Computing Center (DKRZ): http://www.dkrz.de DataCite: http://datacite.org

  7. Implementation and Outcomes of a Faculty-Based, Peer Review Manuscript Writing Workshop.

    Science.gov (United States)

    Kulage, Kristine M; Larson, Elaine L

    2016-01-01

    The publication of scholarly work and research findings is an important expectation for nursing faculty; however, academic writing is often neglected, leaving dissemination through manuscript writing an area of concern for the nursing profession. Writing initiatives have been utilized to promote scholarly dissemination in schools of nursing, but those described in the literature have been primarily non-United States based and student focused. This article describes a faculty-based manuscript writing workshop, assesses participants' impressions, and describes its impact on scholarly output. The workshop is a collaborative learning process utilizing peer review to improve manuscript quality and model behaviors for improving writing and peer-reviewing skills. Seventeen workshop participants including three predoctoral students, 6 postdoctoral fellows, and 8 faculty members completed an anonymous workshop survey (81% response rate). All but 1 of 17 manuscripts reviewed in the workshop are published, accepted, or in the review process. All participants indicated that the workshop was a valuable use of time and would recommend it to colleagues. The greatest reported workshop benefit was its function as an impetus to complete and submit manuscripts. We recommend the manuscript writing workshop model for other schools of nursing seeking ways to expand their scholarly output and create accountability for dissemination through manuscript writing. Copyright © 2016 Elsevier Inc. All rights reserved.

  8. 33 CFR 385.22 - Independent scientific review and external peer review.

    Science.gov (United States)

    2010-07-01

    ... external peer review. 385.22 Section 385.22 Navigation and Navigable Waters CORPS OF ENGINEERS, DEPARTMENT... RESTORATION PLAN CERP Implementation Processes § 385.22 Independent scientific review and external peer review... members, shall not attempt to influence the panel's review or assign this panel any other tasks, nor...

  9. Teleconference versus face-to-face scientific peer review of grant application: effects on review outcomes.

    Directory of Open Access Journals (Sweden)

    Stephen A Gallo

    Full Text Available Teleconferencing as a setting for scientific peer review is an attractive option for funding agencies, given the substantial environmental and cost savings. Despite this, there is a paucity of published data validating teleconference-based peer review compared to the face-to-face process. Our aim was to conduct a retrospective analysis of scientific peer review data to investigate whether review setting has an effect on review process and outcome measures. We analyzed reviewer scoring data from a research program that had recently modified the review setting from face-to-face to a teleconference format with minimal changes to the overall review procedures. This analysis included approximately 1600 applications over a 4-year period: two years of face-to-face panel meetings compared to two years of teleconference meetings. The average overall scientific merit scores, score distribution, standard deviations and reviewer inter-rater reliability statistics were measured, as well as reviewer demographics and length of time discussing applications. The data indicate that few differences are evident between face-to-face and teleconference settings with regard to average overall scientific merit score, scoring distribution, standard deviation, reviewer demographics or inter-rater reliability. However, some difference was found in the discussion time. These findings suggest that most review outcome measures are unaffected by review setting, which would support the trend of using teleconference reviews rather than face-to-face meetings. However, further studies are needed to assess any correlations among discussion time, application funding and the productivity of funded research projects.

  10. Teleconference versus Face-to-Face Scientific Peer Review of Grant Application: Effects on Review Outcomes

    Science.gov (United States)

    Gallo, Stephen A.; Carpenter, Afton S.; Glisson, Scott R.

    2013-01-01

    Teleconferencing as a setting for scientific peer review is an attractive option for funding agencies, given the substantial environmental and cost savings. Despite this, there is a paucity of published data validating teleconference-based peer review compared to the face-to-face process. Our aim was to conduct a retrospective analysis of scientific peer review data to investigate whether review setting has an effect on review process and outcome measures. We analyzed reviewer scoring data from a research program that had recently modified the review setting from face-to-face to a teleconference format with minimal changes to the overall review procedures. This analysis included approximately 1600 applications over a 4-year period: two years of face-to-face panel meetings compared to two years of teleconference meetings. The average overall scientific merit scores, score distribution, standard deviations and reviewer inter-rater reliability statistics were measured, as well as reviewer demographics and length of time discussing applications. The data indicate that few differences are evident between face-to-face and teleconference settings with regard to average overall scientific merit score, scoring distribution, standard deviation, reviewer demographics or inter-rater reliability. However, some difference was found in the discussion time. These findings suggest that most review outcome measures are unaffected by review setting, which would support the trend of using teleconference reviews rather than face-to-face meetings. However, further studies are needed to assess any correlations among discussion time, application funding and the productivity of funded research projects. PMID:23951223

  11. A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research.

    Science.gov (United States)

    Concannon, Thomas W; Fuster, Melissa; Saunders, Tully; Patel, Kamal; Wong, John B; Leslie, Laurel K; Lau, Joseph

    2014-12-01

    We conducted a review of the peer-reviewed literature since 2003 to catalogue reported methods of stakeholder engagement in comparative effectiveness research and patient-centered outcomes research. We worked with stakeholders before, during and after the review was conducted to: define the primary and key research questions; conduct the literature search; screen titles, abstracts and articles; abstract data from the articles; and analyze the data. The literature search yielded 2,062 abstracts. The review was conducted on 70 articles that reported on stakeholder engagement in individual research projects or programs. Reports of stakeholder engagement are highly variable in content and quality. We found frequent engagement with patients, modestly frequent engagement with clinicians, and infrequent engagement with stakeholders in other key decision-making groups across the healthcare system. Stakeholder engagement was more common in earlier (prioritization) than in later (implementation and dissemination) stages of research. The roles and activities of stakeholders were highly variable across research and program reports. To improve on the quality and content of reporting, we developed a 7-Item Stakeholder Engagement Reporting Questionnaire. We recommend three directions for future research: 1) descriptive research on stakeholder-engagement in research; 2) evaluative research on the impact of stakeholder engagement on the relevance, transparency and adoption of research; and 3) development and validation of tools that can be used to support stakeholder engagement in future work.

  12. Commercial Lighting Solutions, Webtool Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    Jones, Carol C.; Meyer, Tracy A.

    2009-06-17

    The Commercial Lighting Solutions (CLS) project directly supports the U.S. Department of Energy’s Commercial Building Energy Alliance efforts to design high performance buildings. CLS creates energy efficient best practice lighting designs for widespread use, and they are made available to users via an interactive webtool that both educates and guides the end user through the application of the Lighting Solutions. This report summarizes the peer review of the beta version of the CLS webtool, which contains retail box lighting solutions. The methodology for the peer review process included data collection (stakeholder input), analysis of the comments, and organization of the input into categories for prioritization of the comments against a set of criteria. Based on this process, recommendations were developed about which feedback should be addressed for the release of version 1.0 of the webtool at the Lightfair conference in New York City in May 2009. Due to the volume of data (~500 comments) the methodology for addressing the peer review comments was central to the success of the ultimate goal of improving the tool. The comments were first imported into a master spreadsheet, and then grouped and organized in several layers. Solutions to each comment were then rated by importance and feasibility to determine the practicality of resolving the concerns of the commenter in the short-term or long-term. The rating system was used as an analytical tool, but the results were viewed thoughtfully to ensure that they were not the sole the factor in determining which comments were recommended for near-term resolution. The report provides a list of the top ten most significant and relevant improvements that will be made within the webtool for version 1.0 as well as appendices containing the short-term priorities in additional detail. Peer review comments that are considered high priority by the reviewers and the CLS team but cannot be completed for Version 1.0 are listed as

  13. 2014 Water Power Program Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    none,

    2014-08-18

    The Water Power Peer Review Meeting was held February 24-28, 2014 in Arlington, VA. Principle investigators from the Energy Department National Laboratories, academic, and industry representatives presented the progress of their DOE-funded research. This report documents the formal, rigorous evaluation process and findings of nine independent reviewers who examined the technical, scientific, and business results of 96 projects of the Water Power Program, as well as the productivity and management effectiveness of the Water Power Program itself.

  14. Mechanism change in a simulation of peer review: from junk support to elitism.

    Science.gov (United States)

    Paolucci, Mario; Grimaldo, Francisco

    2014-01-01

    Peer review works as the hinge of the scientific process, mediating between research and the awareness/acceptance of its results. While it might seem obvious that science would regulate itself scientifically, the consensus on peer review is eroding; a deeper understanding of its workings and potential alternatives is sorely needed. Employing a theoretical approach supported by agent-based simulation, we examined computational models of peer review, performing what we propose to call redesign , that is, the replication of simulations using different mechanisms . Here, we show that we are able to obtain the high sensitivity to rational cheating that is present in literature. In addition, we also show how this result appears to be fragile against small variations in mechanisms. Therefore, we argue that exploration of the parameter space is not enough if we want to support theoretical statements with simulation, and that exploration at the level of mechanisms is needed. These findings also support prudence in the application of simulation results based on single mechanisms, and endorse the use of complex agent platforms that encourage experimentation of diverse mechanisms.

  15. A proposal for an 'equal peer-review' statement.

    Science.gov (United States)

    Moustafa, Khaled

    2015-08-01

    To make the peer-review process as objective as possible, I suggest the introduction of an 'equal peer-review' statement that preserves author anonymity across the board, thus removing any potential bias related to nominal or institutional 'prestige'; this would guarantee an equal peer-review process for all authors and grant applicants. Copyright © 2015 Elsevier Ltd. All rights reserved.

  16. Online Peer-to-Peer Communities in the Daily Lives of People With Chronic Illness

    DEFF Research Database (Denmark)

    Kingod, Natasja; Cleal, Bryan; Wahlberg, Ayo

    2017-01-01

    This qualitative systematic review investigated how individuals with chronic illness experience online peer-to-peer support and how their experiences influence daily life with illness. Selected studies were appraised by quality criteria focused upon research questions and study design, participant...... selection, methods of data collection, and methods of analysis. Four themes were identified: (a) illness-associated identity work, (b) social support and connectivity, (c) experiential knowledge sharing, and (d) collective voice and mobilization. Findings indicate that online peer-to-peer communities...... everyday life with illness. This type of knowledge was perceived as extending far beyond medical care. Online communities were also used to mobilize and raise collective awareness about illness-specific concerns....

  17. When reviews attack: ethics, free speech, and the peer review process.

    Science.gov (United States)

    Hadjistavropoulos, T; Bieling, P J

    2000-08-01

    The peer review process, whether formally applied in publication and grant review, or informally, such as exchange of ideas in scientific and professional newsgroups, has sparked controversy. Writers in this area agree that scholarly reviews that are inappropriate in tone are not uncommon. Indeed, commentators have suggested rules and guidelines that can be used to improve the review process and to make reviewers more accountable. In this paper, we examine the relevance and impact of ethical codes on the conduct of peer review. It is our contention that the peer review process can be improved, not by a new set of rules but through closer attention to the ethical principles to which we, as psychologists, already subscribe.

  18. IAU astroEDU: an open-access platform for peer-reviewed astronomy education activities

    Science.gov (United States)

    Heenatigala, Thilina; Russo, Pedro; Strubbe, Linda; Gomez, Edward

    2015-08-01

    astroEDU is an open access platform for peer-reviewed astronomy education activities. It addresses key problems in educational repositories such as variability in quality, not maintained or updated regularly, limited content review, and more. This is achieved through a peer-review process similar to what scholarly articles are based on. Activities submitted are peer-reviewed by an educator and a professional astronomer which gives the credibility to the activities. astroEDU activities are open-access in order to make the activities accessible to educators around the world while letting them discover, review, distribute and remix the activities. The activity submission process allows authors to learn how to apply enquiry-based learning into the activity, identify the process skills required, how to develop core goals and objectives, and how to evaluate the activity to determine the outcome. astroEDU is endorsed by the International Astronomical Union meaning each activity is given an official stamp by the international organisation for professional astronomers.

  19. A scoping review protocol on the roles and tasks of peer reviewers in the manuscript review process in biomedical journals.

    Science.gov (United States)

    Glonti, Ketevan; Cauchi, Daniel; Cobo, Erik; Boutron, Isabelle; Moher, David; Hren, Darko

    2017-10-22

    The primary functions of peer reviewers are poorly defined. Thus far no body of literature has systematically identified the roles and tasks of peer reviewers of biomedical journals. A clear establishment of these can lead to improvements in the peer review process. The purpose of this scoping review is to determine what is known on the roles and tasks of peer reviewers. We will use the methodological framework first proposed by Arksey and O'Malley and subsequently adapted by Levac et al and the Joanna Briggs Institute. The scoping review will include all study designs, as well as editorials, commentaries and grey literature. The following eight electronic databases will be searched (from inception to May 2017): Cochrane Library, Cumulative Index to Nursing and Allied Health Literature, Educational Resources Information Center, EMBASE, MEDLINE, PsycINFO, Scopus and Web of Science. Two reviewers will use inclusion and exclusion criteria based on the 'Population-Concept-Context' framework to independently screen titles and abstracts of articles considered for inclusion. Full-text screening of relevant eligible articles will also be carried out by two reviewers. The search strategy for grey literature will include searching in websites of existing networks, biomedical journal publishers and organisations that offer resources for peer reviewers. In addition we will review journal guidelines to peer reviewers on how to perform the manuscript review. Journals will be selected using the 2016 journal impact factor. We will identify and assess the top five, middle five and lowest-ranking five journals across all medical specialties. This scoping review will undertake a secondary analysis of data already collected and does not require ethical approval. The results will be disseminated through journals and conferences targeting stakeholders involved in peer review in biomedical research. © Article author(s) (or their employer(s) unless otherwise stated in the text of the

  20. A probabilistic safety assessment PEER review: Case study on the use of probabilistic safety assessment for safety decisions

    International Nuclear Information System (INIS)

    1989-10-01

    The purpose of this case study is to illustrate, using an actual example, the organizing and carrying out of an independent peer review of a draft full-scope (level 3) probabilistic safety assessment. The specific findings of the peer review are of less importance than the approach taken, the interaction between sponsor and study team, and the technical and administrative issues that can arise during a peer review. This case study will examine the following issues: how the scope of the peer review was established, based on how it was to be used by the review sponsoring body; how the level of effort was determined, and what this determination meant for the technical quality of the review; how the team of peer reviewers was selected; how the review itself was carried out; what findings were made; what was done with these findings by both the review sponsoring body and the PSA analysis team. 9 refs, 2 figs, 1 tab

  1. Peer Review in Radiology: A Resident and Fellow Perspective.

    Science.gov (United States)

    Grenville, Jeffrey; Doucette-Preville, David; Vlachou, Paraskevi A; Mnatzakanian, Gevork N; Raikhlin, Antony; Colak, Errol

    2016-02-01

    The purpose of this study was to explore Canadian radiology residents' and fellows' understanding, attitudes, opinions, and preferences toward peer review. An Internet-based anonymous questionnaire designed to understand one's familiarity, attitudes, opinions, and preferences toward peer review was distributed to radiology residents and fellows across Canada. Data were analyzed using descriptive statistics, and answers were stratified by level of training. A total of 136 trainees responded to the survey with 92 completed survey responses available for descriptive statistics. Approximately half of respondents are familiar with peer review (49%), and 39% of trainees are involved in peer review. Most respondents (92%) expressed an interest in learning more about peer review; believe that it should be incorporated into the residency training curriculum (86%), be mandatory (72%), and that current participation will increase odds of future participation (91%). Most trainees (80%) are comfortable advising one another about errors, but less comfortable advising staff (21%). Residents and fellows welcome the opportunity to learn more about peer review and believe it should be incorporated into the residency training curriculum. Understanding the attitudes and perceptions held by trainees regarding peer review is important, as a means to optimize education and maximize current and future participation in peer review. Copyright © 2016 American College of Radiology. Published by Elsevier Inc. All rights reserved.

  2. NEA international peer reviews of post-accident protection policy

    International Nuclear Information System (INIS)

    Lazo, T.

    2011-01-01

    For many years, the NEA has offered international peer reviews of national, high-level radioactive waste management policies and approaches. Until recently, this service had not been requested in the area of radiological protection. However, the 3. International Nuclear Emergency Exercise (INEX-3, 2005-2006) addressed post-accident consequence management for the first time in a broad, international sense, and helped generate significant national reflections in this area. In particular, in 2005 the French government began an extensive programme of post-emergency consequence management planning, resulting in a draft national policy to address such situations. The Finnish government used the INEX-3 exercise as a vehicle to discuss post-emergency consequence management with a broad group of governmental and private stakeholders, and also began to develop national policy in this area. In order to further refine national efforts, the French Nuclear Safety Authority (ASN) invited the NEA to perform in April 2011 its first international peer review in the radiological protection area focusing on its post-emergency consequence management policy under development. Finnish experts participated in this peer review team, and as a result, subsequently invited the NEA to perform an international peer review of its developing policy in this area in September 2011. These draft national policies and their international peer reviews are briefly presented in this paper. Feedback from both the French ASN and the Finnish STUK suggests that the detailed, external input provided by the international peer review teams have been extremely valuable in refining the content of the guides so that they are more clear, concise, understandable and implementable. It should be recalled that both national policy documents reviewed are far more detailed and extensive than described here. The intent of this article was not to provide a review of the national policies themselves, but rather to give an

  3. ORD Water Quality Research Program Mid-Cycle Review - June 2009

    Science.gov (United States)

    The Board of Scientific Counselors (BOSC) completed a mid-cycle review of the Office of Research and Development’s (ORD) Water Quality Research Program (WQRP), focusing on Agency efforts to enhance the program following the 2006 BOSC program review.

  4. Technology enhanced peer learning and peer assessment

    DEFF Research Database (Denmark)

    Henriksen, Christian Bugge; Bregnhøj, Henrik; Rosthøj, Susanne

    2016-01-01

    This paper explores the application of learning designs featuring formalised and structured technology enhanced peer learning. These include student produced learning elements, peer review discussions and peer assessment in the BSc/MSc level summer course Restoration of European Ecosystems...... and Freshwaters (REEF), the Master thesis preparation seminars for the Master of Public Health (MPH) and the MOOC course Global Environmental Management (GEM). The application of student produced learning elements and peer review discussions is investigated by analyzing quotes from course evaluations...... and performing focus group interviews. The application of peer assessment is investigated by analyzing the agreement of peer assessment between students assessing the same assignment. Our analyses confirm previous research on the value of peer learning and peer assessment and we argue that there could also...

  5. An integrated literature review of undergraduate peer teaching in ...

    African Journals Online (AJOL)

    2017-03-10

    Mar 10, 2017 ... For the purpose of this literature review, planned PAL is defined as peer ... PAL can be considered to address gaps in learning after assessment, and new ... National Institutes of Health on Appraising Quantitative Research in ...

  6. Factor Analysis in Assessing the Research Methodology Quality of Systematic Reviews

    Directory of Open Access Journals (Sweden)

    Andrada Elena URDA-CÎMPEAN

    2011-12-01

    Full Text Available Introduction: Many high quality systematic reviews available from medical journals, data bases and other electronic sources differ in quality and provide different answers to the same question. The literature recommended the use of a checklist type approach, which exceeds many of the problems associated with measurements. Aim: This study proposes to identify in a checklist type approach the most commonly used factors (from a methodological point of view in assessing the quality of systematic reviews, and then mirror the actual stage of medical writing. We want to analyze the factors’ occurrence and / or their development in the text and in the abstract of systematic reviews published in 2011. Methods: The present study randomly selected only free full text systematic reviews published in 2011, systematic reviews found in Pubmed and in Cochrane Database. The most commonly used factors were identified in PRISMA statement and quality measurement tools. Results: The evaluated systematic reviews mentioned or developed several of the factors studied. Only 78% of the papers surveyed have used the correct IMRAD format and 59% of them have mentioned the sample size used. The correspondence between the content of the paper and its abstract is summarized in the proportion of 54.63% and 51.85% for the two sets of factors, and it can lead to scarce appreciation of the article provided that only abstracts are read. Conclusions: Researchers do not properly take into consideration scientific articles and assessment tools used for quality evaluation. They should place more value over methodological factors which help assess systematic review quality, while journals form the only party who can enforce quality standards in medical writing.

  7. Cooperation between referees and authors increases peer review accuracy.

    Directory of Open Access Journals (Sweden)

    Jeffrey T Leek

    Full Text Available Peer review is fundamentally a cooperative process between scientists in a community who agree to review each other's work in an unbiased fashion. Peer review is the foundation for decisions concerning publication in journals, awarding of grants, and academic promotion. Here we perform a laboratory study of open and closed peer review based on an online game. We show that when reviewer behavior was made public under open review, reviewers were rewarded for refereeing and formed significantly more cooperative interactions (13% increase in cooperation, P = 0.018. We also show that referees and authors who participated in cooperative interactions had an 11% higher reviewing accuracy rate (P = 0.016. Our results suggest that increasing cooperation in the peer review process can lead to a decreased risk of reviewing errors.

  8. Commercial Lighting Solutions Webtool Peer Review Report, Office Solutions

    Energy Technology Data Exchange (ETDEWEB)

    Beeson, Tracy A.; Jones, Carol C.

    2010-02-01

    The Commercial Lighting Solutions (CLS) project directly supports the U.S. Department of Energy’s Commercial Building Energy Alliance efforts to design high performance buildings. CLS creates energy efficient best practice lighting designs for widespread use, and they are made available to users via an interactive webtool that both educates and guides the end user through the application of the Lighting Solutions. This report summarizes the peer review of the CLS webtool for offices. The methodology for the peer review process included data collection (stakeholder input), analysis of the comments, and organization of the input into categories for prioritization of the comments against a set of criteria. Based on this process, recommendations were developed for the release of version 2.0 of the webtool at the Lightfair conference in Las Vegas in May 2010. The report provides a list of the top ten most significant and relevant improvements that will be made within the webtool for version 2.0 as well as appendices containing the comments and short-term priorities in additional detail. Peer review comments that are considered high priority by the reviewers and the CLS team but cannot be completed for Version 2.0 are listed as long-term recommendations.

  9. The Potential of Dual-Language Cross-Cultural Peer Review

    Science.gov (United States)

    Ruecker, Todd

    2011-01-01

    This article explores the potential of dual-language cross-cultural peer review and how it improves on traditional monolingual and monocultural peer review. Drawing on scholarship related to international exchange programmes, peer review, and two-way immersion programmes in the United States as well as data collected while facilitating the…

  10. The value of peer reviews to nuclear plant safety

    International Nuclear Information System (INIS)

    Subalusky, W.T. Jr.

    1994-01-01

    On a global basis, the nuclear utility industry has clearly demonstrated the value of peer reviews for improving nuclear safety and overall plant performance. Peer reviews are conducted by small teams of technical experts who review various aspects of plant operation, recognize strengths and recommend improvements, thereby stimulating a positive response to the recommendations. U.S. nuclear utilities initiated the operator-to-operator peer review process first through the Institute of Nuclear Power Operations (INPO). Now, voluntary peer reviews are an important activity of the World Association of Nuclear Operators (WANO). Formed just five years ago. WANO has made significant progress in its key activities of the operator-to-operator exchanges, operating experience exchange, monitoring of plant performance indicators and sharing of good practices worldwide. A fifth activity, peer review on a strictly voluntary basis, is pertinent to this paper

  11. Online Peer-to-Peer Support for Young People With Mental Health Problems: A Systematic Review

    OpenAIRE

    Ali, Kathina; Farrer, Louise; Gulliver, Amelia; Griffiths, Kathleen M

    2015-01-01

    Background Adolescence and early adulthood are critical periods for the development of mental disorders. Online peer-to-peer communication is popular among young people and may improve mental health by providing social support. Previous systematic reviews have targeted Internet support groups for adults with mental health problems, including depression. However, there have been no systematic reviews examining the effectiveness of online peer-to-peer support in improving the mental health of a...

  12. Funding source and research report quality in nutrition practice-related research.

    Science.gov (United States)

    Myers, Esther F; Parrott, J Scott; Cummins, Deborah S; Splett, Patricia

    2011-01-01

    The source of funding is one of many possible causes of bias in scientific research. One method of detecting potential for bias is to evaluate the quality of research reports. Research exploring the relationship between funding source and nutrition-related research report quality is limited and in other disciplines the findings are mixed. The purpose of this study is to determine whether types of funding sources of nutrition research are associated with differences in research report quality. A retrospective study of research reporting quality, research design and funding source was conducted on 2539 peer reviewed research articles from the American Dietetic Association's Evidence Analysis Library® database. Quality rating frequency distributions indicate 43.3% of research reports were rated as positive, 50.1% neutral, and 6.6% as negative. Multinomial logistic regression results showed that while both funding source and type of research design are significant predictors of quality ratings (χ2 = 118.99, p≤0.001), the model's usefulness in predicting overall research report quality is little better than chance. Compared to research reports with government funding, those not acknowledging any funding sources, followed by studies with University/hospital funding were more likely to receive neutral vs positive quality ratings, OR = 1.85, P funding were more likely to receive negative quality ratings (OR = 4.97, Pfunded research reports were no more likely to receive a neutral or negative quality rating than those funded by government sources. Research report quality cannot be accurately predicted from the funding source after controlling for research design. Continued vigilance to evaluate the quality of all research regardless of the funding source and to further understand other factors that affect quality ratings are warranted.

  13. 2016 Building Technologies Office Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    Building Technologies Office

    2016-12-01

    The 2016 Building Technologies Office Peer Review Report summarizes the feedback submitted by reviewers of the 67 BTO projects presented at the 2016 BTO Peer Review. The report presents an overview of the goals and activities under each technology program area, a summary of project scores for each program, and a brief analysis of general evaluation trends within each program area or its constituent subprograms.

  14. The impact of peer review on paediatric forensic reports.

    Science.gov (United States)

    Kariyawasam, Uditha

    2016-10-01

    To retrospectively evaluate the common grammar and spelling errors of the medico-legal reports written by the doctors at the Victorian Forensic Paediatric Medical Service (VFPMS) in both Royal Children's Hospital (RCH) and Monash Medical Centre. The reports were evaluated at two points in time; before and after peer review. The aim of the study was to ascertain whether peer review improved the grammar and spelling in VFPMS medico-legal reports. Draft VFPMS reports are sent to the VFPMS medical director for peer review. The current study sampled 50 reports that were sent consecutively to Dr. Anne Smith from 1st of May 2015. The 50 corresponding final reports were then retrieved from the VFPMS database. The 50 pairs of draft and final reports were scored using a 50-point scoring system. The scores of the draft reports were compared to the scores of the final report to assess if there was a change in quality as measured using an explicit criteria audit of report structure, simple grammar, jargon use and spelling. The audit did not include evaluation of the validity of forensic opinions. The overall scores were statistically analysed using descriptive statistics and a paired T-test. The scores of the reports improved by 2.24% when the final reports were compared to the draft reports (p audit. Crown Copyright © 2016. Published by Elsevier Ltd. All rights reserved.

  15. The effects of an editor serving as one of the reviewers during the peer-review process [version 1; referees: 1 approved, 2 approved with reservations

    Directory of Open Access Journals (Sweden)

    Marco Giordan

    2016-04-01

    Full Text Available Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications.   Methods Here we examine an element of the editorial process at eLife, in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,750 were sent for peer review, using R and Python to perform the statistical analysis.   Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405 and 5 days faster for papers that were rejected after peer review (n=1,099. There was no effect on whether submissions were accepted or rejected, and a very small (but significant effect on citation rates for published articles where the Reviewing Editor served as one of the peer reviewers.   Conclusions An important aspect of eLife’s peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.

  16. Open Peer Review by a Selected-Papers Network

    Science.gov (United States)

    Lee, Christopher

    2011-01-01

    A selected-papers (SP) network is a network in which researchers who read, write, and review articles subscribe to each other based on common interests. Instead of reviewing a manuscript in secret for the Editor of a journal, each reviewer simply publishes his review (typically of a paper he wishes to recommend) to his SP network subscribers. Once the SP network reviewers complete their review decisions, the authors can invite any journal editor they want to consider these reviews and initial audience size, and make a publication decision. Since all impact assessment, reviews, and revisions are complete, this decision process should be short. I show how the SP network can provide a new way of measuring impact, catalyze the emergence of new subfields, and accelerate discovery in existing fields, by providing each reader a fine-grained filter for high-impact. I present a three phase plan for building a basic SP network, and making it an effective peer review platform that can be used by journals, conferences, users of repositories such as arXiv, and users of search engines such as PubMed. I show how the SP network can greatly improve review and dissemination of research articles in areas that are not well-supported by existing journals. Finally, I illustrate how the SP network concept can work well with existing publication services such as journals, conferences, arXiv, PubMed, and online citation management sites. PMID:22291635

  17. A Brief Introduction on Peer Review: New Possibilities

    Directory of Open Access Journals (Sweden)

    Sean Scanlan

    2013-06-01

    Full Text Available From the classroom, to the lab, to the studio, to industry, and to the academy, evaluating work is part of everyday life. Whether we call it critiquing, refereeing, or peer reviewing, the goals are the same: to make the object under review better, to verify that its claims are not false, or at the very least, to ascertain that the object has some merit. Jenna Pack Sheffield’s note "Open Peer Review: Collective Intelligence as a Framework for Theorizing Approaches to Peer Review in the Humanities" discusses the definition of “open peer review” and looks at various ways it’s been used to highlight the advantages and disadvantages of the process. This issue of NANO includes interviews with three editors who share their ideas about the shape of current peer review problems and what the future might look like for academics, tenure review boards, and publishers. First, Sean Scanlan conducted an email interview with Masoud Yazdani, the editor of Intellect Books, an independent academic publisher in the fields of creative practice and popular culture, whose aim is to publish scholarly books and journals that provide a vital space for widening critical debate in new and emerging subjects. Second, Sean Scanlan interviews Aaron Barlow, of New York City College of Technology, who shares his views on the problems of traditional peer review. Third, NANO assistant editor Rebecca Devers interviews Martha J. Cutter, the former editor of MELUS, about the complexities of processing, reviewing, and publishing a journal that receives in over 300 submissions each year.

  18. Peer Relationships in Undergraduates With ADHD Symptomatology: Selection and Quality of Friendships.

    Science.gov (United States)

    McKee, Tara E

    2017-10-01

    This study investigated the relationships between ADHD symptomatology and friendship formation, social skills, and the quality of specific friendships in college students. A total of 156 students, 75 of whom had high self-reported ADHD symptomatology, participated. Friends of 68 participants completed measures of friendship quality. Students had more positive first impressions of and reported being friends with others whose ADHD symptom severity matched their own. Participants with high ADHD symptoms reported greater difficulty providing emotional support and managing interpersonal conflict than their low-symptom peers. Greater ADHD symptoms in participants and friends were related to reduced quality of specific relationships, but similarity of severity of symptomatology in the dyad benefited the relationship. These findings have implications for the kind of support offered to students with high ADHD symptomatology when they transition to college. Future longitudinal research examining relationships of varying levels of closeness should be conducted.

  19. Peer Review in Higher Education: Student Perceptions before and after Participation

    Science.gov (United States)

    Mulder, Raoul A.; Pearce, Jon M.; Baik, Chi

    2014-01-01

    Peer review is integral to academic endeavour, but opportunities for students to benefit from peer review in higher education remain limited, and relatively little is known about how student perceptions influence their appreciation of peer review. University student perceptions were examined before and after experiencing student peer review in…

  20. A systematic review of peer mentoring interventions for people with traumatic brain injury.

    Science.gov (United States)

    Morris, Richard Pg; Fletcher-Smith, Joanna C; Radford, Kathryn A

    2017-08-01

    This systematic review sought evidence concerning the effectiveness of peer mentoring for people with traumatic brain injury. Fourteen electronic databases were searched, including PsycINFO, MEDLINE, CINAHL, EMBASE and the Cochrane Library, from inception to September 21 2016. Ten grey literature databases, PROSPERO, two trials registers, reference lists and author citations were also searched. Studies which employed a model of one-to-one peer mentoring between traumatic brain injury survivors were included. Two reviewers independently screened all titles and abstracts before screening full texts of shortlisted studies. A third reviewer resolved disagreements. Two reviewers independently extracted data and assessed studies for quality and risk of bias. The search returned 753 records, including one identified through hand searching. 495 records remained after removal of duplicates and 459 were excluded after screening. Full texts were assessed for the remaining 36 studies and six met the inclusion criteria. All were conducted in the United States between 1996 and 2012 and employed a variety of designs including two randomised controlled trials. A total of 288 people with traumatic brain injury participated in the studies. No significant improvements in social activity level or social network size were found, but significant improvements were shown in areas including behavioural control, mood, coping and quality of life. There is limited evidence for the effectiveness of peer mentoring after traumatic brain injury. The available evidence comes from small-scale studies, of variable quality, without detailed information on the content of sessions or the 'active ingredient' of the interventions.

  1. 2017 Building Technologies Office Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    None, None

    2017-11-01

    The 2017 Building Technologies Office Peer Review Report summarizes the feedback submitted by reviewers for the 109 Building Technologies Office (BTO) projects presented at the 2017 BTO Peer Review. The report presents an overview of the goals and activities under each technology program area, a summary of project scores for each program, and a brief analysis of general evaluation trends within each program area or its constituent subprograms.

  2. A critical review of published research literature reviews on nursing and healthcare ageism.

    Science.gov (United States)

    Wilson, Donna M; Nam, Mavis A; Murphy, Jill; Victorino, João P; Gondim, Ellen C; Low, Gail

    2017-12-01

    To establish how common and impactful nursing and healthcare ageism is and whether proven interventions or prevention methods exist. Ageism has been a concern since 1969 when it was first introduced as a concept for social reform. As ageism has been linked to lower quality health services and reduced health care access, it is imperative that healthcare and nursing ageism is prevented or identified and reduced or eliminated. A qualitative narrative review of published research literature reviews using a scoping design to map all published reviews was undertaken. The EBSCO Discovery Service (providing access to articles in 271 databases, including MEDLINE and CINAHL) and Directory of Open Access Journals (providing access to over 9,000 open access journals) were used to find review articles. Using predetermined inclusion and exclusion criteria, and limited by English language and peer-review publications, 12 eligible reviews were identified and information from them was systematically identified, assessed and synthesised. The 12 reviews did not provide clear and convincing information to determine how common and impactful nursing or healthcare ageism is, nor what can best be done to prevent or address it. Although each review had value since research literature was collected and discussed on nursing or healthcare ageism, the array of literature search and analysis methods, and diversity in conclusions reached about the evidence is highly problematic. Research literature reviews offering a more balanced perspective and demonstrating greater care in finding and using quality evidence are needed. At this point in time, there is no clear understanding of how widespread and impactful nursing or healthcare ageism is, and what can best be done to prevent or address it. Nurses need to be aware that ageism may be common and impactful, and guard against it. © 2017 John Wiley & Sons Ltd.

  3. Why Participate in Peer Review as a Journal Manuscript Reviewer: What's in It for You?

    Science.gov (United States)

    Pytynia, Kristen B

    2017-06-01

    The peer review process for scientific journals relies on the efforts of volunteer reviewers. Reviewers are selected due to their expertise in their fields. With so many demands on professional time, the benefits of participating in peer review may not be obvious. However, reviewers benefit by exposure to the latest developments in their fields, facilitating their keeping up-to-date with the latest publications. Tenure committees look favorably on participation in peer review, and invitations to review underscore that the reviewer is a respected subject matter expert. Contacts made during the peer review process can lead to long-lasting collaboration. Continuing medical education credit can be obtained through various mechanisms. Overall, participating in peer review is an important part of career development and should be viewed as a critical component of advancement.

  4. Peer review - Why does it matter for your academic career?

    NARCIS (Netherlands)

    Kalz, Marco

    2012-01-01

    Kalz, M. (2012, 8 March). Peer review - Why does it matter for your academic career? Presentation provided in the context of the Young Researchers Special Issue 2012 of the International Journal of Technology-Enhanced Learning (IJTEL).

  5. Peer feedback for examiner quality assurance on MRCGP International South Asia: a mixed methods study.

    Science.gov (United States)

    Perera, D P; Andrades, Marie; Wass, Val

    2017-12-08

    The International Membership Examination (MRCGP[INT]) of the Royal College of General Practitioners UK is a unique collaboration between four South Asian countries with diverse cultures, epidemiology, clinical facilities and resources. In this setting good quality assurance is imperative to achieve acceptable standards of inter rater reliability. This study aims to explore the process of peer feedback for examiner quality assurance with regard to factors affecting the implementation and acceptance of the method. A sequential mixed methods approach was used based on focus group discussions with examiners (n = 12) and clinical examination convenors who acted as peer reviewers (n = 4). A questionnaire based on emerging themes and literature review was then completed by 20 examiners at the subsequent OSCE exam. Qualitative data were analysed using an iterative reflexive process. Quantitative data were integrated by interpretive analysis looking for convergence, complementarity or dissonance. The qualitative data helped understand the issues and informed the process of developing the questionnaire. The quantitative data allowed for further refining of issues, wider sampling of examiners and giving voice to different perspectives. Examiners stated specifically that peer feedback gave an opportunity for discussion, standardisation of judgments and improved discriminatory abilities. Interpersonal dynamics, hierarchy and perception of validity of feedback were major factors influencing acceptance of feedback. Examiners desired increased transparency, accountability and the opportunity for equal partnership within the process. The process was stressful for examiners and reviewers; however acceptance increased with increasing exposure to receiving feedback. The process could be refined to improve acceptability through scrupulous attention to training and selection of those giving feedback to improve the perceived validity of feedback and improved reviewer feedback

  6. Dentistry in Taiwan, Republic of China: National health insurance reforms, illegal dentistry and peer review quality control

    DEFF Research Database (Denmark)

    Moore, R.; Shiau, Y.Y.

    1999-01-01

    licensure. Their popularity and price advantage has maintained a political base that affects policy decisions. Health care reforms of March, 1995 with a comprehensive national health insurance, as well as ambitious plans for systematic peer review quality control of dentists' work are unique health care......The dental health care system in Taiwan, Republic of China is described in terms of demographics, structure, context of treatment and historical development of the dental health care payment system. A notable characteristic of the system is the existence of trade dentists, who operate without...... developments worthy of the attention of health care policy makers in other countries who are studying health care reform processes...

  7. Does a research article's country of origin affect perception of its quality and relevance? A national trial of US public health researchers.

    Science.gov (United States)

    Harris, M; Macinko, J; Jimenez, G; Mahfoud, M; Anderson, C

    2015-12-30

    The source of research may influence one's interpretation of it in either negative or positive ways, however, there are no robust experiments to determine how source impacts on one's judgment of the research article. We determine the impact of source on respondents' assessment of the quality and relevance of selected research abstracts. Web-based survey design using four healthcare research abstracts previously published and included in Cochrane Reviews. All Council on the Education of Public Health-accredited Schools and Programmes of Public Health in the USA. 899 core faculty members (full, associate and assistant professors) Each of the four abstracts appeared with a high-income source half of the time, and low-income source half of the time. Participants each reviewed the same four abstracts, but were randomly allocated to receive two abstracts with high-income source, and two abstracts with low-income source, allowing for within-abstract comparison of quality and relevance Within-abstract comparison of participants' rating scores on two measures--strength of the evidence, and likelihood of referral to a peer (1-10 rating scale). OR was calculated using a generalised ordered logit model adjusting for sociodemographic covariates. Participants who received high income country source abstracts were equal in all known characteristics to the participants who received the abstracts with low income country sources. For one of the four abstracts (a randomised, controlled trial of a pharmaceutical intervention), likelihood of referral to a peer was greater if the source was a high income country (OR 1.28, 1.02 to 1.62, pincome source in their rating of research abstracts. More research may be needed to explore how the origin of a research article may lead to stereotype activation and application in research evaluation. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

  8. Improving your journal article using feedback from peer review.

    Science.gov (United States)

    Price, Bob

    2014-09-30

    While preparation of a journal article for submission may often include informal review by colleagues, an article is not accepted for publication until it has been formally peer reviewed. Peer review is the process whereby journal editors ask expert reviewers to examine the work submitted and prepare a report on its suitability for publication. Two or more revisions of the article may be required following peer review, with the author reworking the article in the light of feedback received on each occasion. This can be challenging for some authors, but used well, it offers a chance to improve the work to the required standard of the journal, and help the author present a more precise and coherent account of the arguments. The extent to which the author responds to the critical commentary of peer reviewers is important, because this may determine whether or not the article is published. This article explores the aims of peer reviewers and recommends ways in which authors can respond to the feedback provided.

  9. WANO peer review. Organization and benefits as seen by WANO; WANO Peer Review. Durchfuehrung und Nutzen aus Sicht der WANO

    Energy Technology Data Exchange (ETDEWEB)

    Haferburg, Manfred [WANO-Paris Centre, Neuilly sur Seine (France)

    2010-02-15

    The World Association of Nuclear Operators (WANO) was founded in May 1989. 144 enterprises operating nuclear power plants signed the WANO Charter in Moscow as a response of industry to the Chernobyl disaster. The Association now comprises the operators of more than 430 nuclear power plants in more than 32 countries. WANO performs its activities through regional centers in Atlanta, Moscow, Paris, and Tokyo. The Coordination Center of WANO is located in London. Each regional WANO Center handles the four most important programs: - Peer Reviews, - exchanges of operating experience, - specialized and technical development, - technical service and exchange. The technical support and exchange program comprises proven processes, such as performance indicators, operator networks, technical support missions. WANO peer reviews are conducted on a voluntary basis and upon request by the licensees. By the end of 2008, WANO had run 388 peer reviews in 31 countries. Peer reviews serve to compare the practical operation of a nuclear power plant with the best international standards. This in-depth examination is carried out by an international, independent team of experts on an optimized objective basis. Peer reviews are conducted not only to examine compliance with all pertinent rules and regulations, but also to strive for excellent performance results. (orig.)

  10. Medical students-as-teachers: a systematic review of peer-assisted teaching during medical school

    Science.gov (United States)

    Yu, Tzu-Chieh; Wilson, Nichola C; Singh, Primal P; Lemanu, Daniel P; Hawken, Susan J; Hill, Andrew G

    2011-01-01

    Introduction International interest in peer-teaching and peer-assisted learning (PAL) during undergraduate medical programs has grown in recent years, reflected both in literature and in practice. There, remains however, a distinct lack of objective clarity and consensus on the true effectiveness of peer-teaching and its short- and long-term impacts on learning outcomes and clinical practice. Objective To summarize and critically appraise evidence presented on peer-teaching effectiveness and its impact on objective learning outcomes of medical students. Method A literature search was conducted in four electronic databases. Titles and abstracts were screened and selection was based on strict eligibility criteria after examining full-texts. Two reviewers used a standard review and analysis framework to independently extract data from each study. Discrepancies in opinions were resolved by discussion in consultation with other reviewers. Adapted models of “Kirkpatrick’s Levels of Learning” were used to grade the impact size of study outcomes. Results From 127 potential titles, 41 were obtained as full-texts, and 19 selected after close examination and group deliberation. Fifteen studies focused on student-learner outcomes and four on student-teacher learning outcomes. Ten studies utilized randomized allocation and the majority of study participants were self-selected volunteers. Written examinations and observed clinical evaluations were common study outcome assessments. Eleven studies provided student-teachers with formal teacher training. Overall, results suggest that peer-teaching, in highly selective contexts, achieves short-term learner outcomes that are comparable with those produced by faculty-based teaching. Furthermore, peer-teaching has beneficial effects on student-teacher learning outcomes. Conclusions Peer-teaching in undergraduate medical programs is comparable to conventional teaching when utilized in selected contexts. There is evidence to suggest

  11. Peer Review and the Dilemmas of Quality Control in Programme Accreditation in South African Higher Education: Challenges and Possibilities

    Science.gov (United States)

    Cross, Michael; Naidoo, Devika

    2011-01-01

    The paper scrutinises the dynamics and the nature of peer review in the programme evaluation and accreditation process within the context of diverse individual and institutional legacies in South Africa. It analyses the peer review process and highlights the contestation at political, policy and epistemological levels. The paper argues that,…

  12. Online Peer Review: Encouraging Student Response and Development

    Science.gov (United States)

    Lansiquot, Reneta; Rosalia, Christine

    2015-01-01

    This study explored the use of a tailored online peer review program for first-year undergraduate students at an urban college of technology. The program facilitated group peer review in meaningful and technologically elegant ways. Students in a composition class were divided into two groups. One group acted as first reviewers, and the other group…

  13. The purpose of peer review in the case of an open-access publication

    Directory of Open Access Journals (Sweden)

    Alexandrov Georgii A

    2006-09-01

    Full Text Available Abstract First scientific journals were simply a way of informing colleagues about new research findings. In due course, they started filtering out unreasonable claims, and introduced a peer-review system. The purpose of peer reviewing changed with time. Since the middle of the past century, commercial publishers have owned a large number of scientific journals and as a result, the marketable value of a submitted manuscript has become an increasingly important factor in publishing decisions. Recently some publishers have developed business schemes which may stop this tendency. In the case of an open-access publication, the marketable value of a manuscript is not the primary consideration, since access to the research is not being sold. This innovation challenges scientists to re-consider the purpose of peer review. This editorial indicates some of the commonly used criteria for publication that consequently should receive less or little emphasis under the open-access model.

  14. International Peer Reviews of Design Basis

    International Nuclear Information System (INIS)

    Hughes, Peter

    2013-01-01

    International peer reviews: Design and safety assessment review service: - Review of design requirements; - Review in support of licensing; - Review in support of severe accident management; - Review in support of modifications; - Review in relation to periodic safety, or life extension; - Reviews take place at any time in NPP lifecycle from concept, through design and operations

  15. Peer review of RELAP5/MOD3 documentation

    International Nuclear Information System (INIS)

    Craddick, W.G.

    1993-01-01

    A peer review was performed on a portion of the documentation of the RELAP5/MOD3 computer code. The review was performed in two phases. The first phase was a review of Volume 3, Developmental Assessment problems, and Volume 4, Models and Correlations. The reviewers for this phase were Dr. Peter Griffith, Dr. Yassin Hassan, Dr. Gerald S. Lellouche, Dr. Marino di Marzo and Mr. Mark Wendel. The reviewers recommended a number of improvements, including using a frozen version of the code for assessment guided by a validation plan, better justification for flow regime maps and extension of models beyond their data base. The second phase was a review of Volume 6, Quality Assurance of Numerical Techniques in RELAP5/MOD3. The reviewers for the second phase were Mr. Mark Wendel and Dr. Paul T. Williams. Recommendations included correction of numerous grammatical and typographical errors and better justification for the use of Lax's Equivalence Theorem

  16. With thanks to our 2016 peer reviewers

    Science.gov (United States)

    2017-01-01

    2016 peer reviewers We are grateful to the following people for their significant contribution to Health Promotion and Chronic Disease Prevention in Canada as peer reviewers in 2016. Their expertise ensures the quality of our journal and promotes the sharing of new knowledge among peers in Canada and internationally. Jillian Avis Sunday Azagba Sharon Bartholomew Michèle Boileau-Falardeau Jimmy Bourque Darren Brenner Robert Brison Yves Carrière Neena Chappell Guanmin Chen Yue Chen Edward Chesney Anna Chudyk Martin Cooke Erica Di Ruggiero Janet Durbin Charlene Elliott Peter Ellis Alexa Ferdinands Bradley Ferguson Lauren Fiechtner Maylene Fong Marilyn Fortin Nancy Gell Margo Greenwood Rita Henderson Erin Hobin Andrew Howell Natalie Iciaszczyk Jeff Johnson Janet Elizabeth Jull Tetyana Kendzerska Nicholas King Elaine Kingwell Victoria Kirsh Erin Kropac Liana Leach Claire Leblanc Yann Le Bodo Daniel Lebouthillier Isra Levy Elizabeth Lin Catherine Mah Loraine Marrett Caitlin McArthur Teri McComber Amy McPherson Verena Menec Leia Minaker Howard Morrison Yeeli Mui Kiyuri Naicker Tor Oiamo Scott Patten Marie-Claude Paquette Cheryl Peters Jennifer Petkovic William Pickett Michelle Ploughman Daniel Poremski Harry Prapavessis Steven Prus Jürgen Rehm Laurene Rehman Sandra Reynolds Annie Rhodes Celia Rodd Kaley Roosen Ellen Rosenberg Linda Rothman Jerry Schultz Kelly Skinner Robin Skinner Robin Somerville Becky Spencer Richard Stanwick Michael Stevenson David Streiner Laura Struik Anna Syrowatka Christopher Tait Chen Tang Kara Thompson Michelle Vine Claudio Violato JianLi Wang Stéphanie Ward Cynthia Weijs Russell Wilkins Keri Lynn Williams Renate Ysseldyk Tingting Zhang Christopher Zou

  17. The effects of an editor serving as one of the reviewers during the peer-review process [version 2; referees: 2 approved, 1 approved with reservations

    Directory of Open Access Journals (Sweden)

    Marco Giordan

    2016-10-01

    Full Text Available Background Publishing in scientific journals is one of the most important ways in which scientists disseminate research to their peers and to the wider public. Pre-publication peer review underpins this process, but peer review is subject to various criticisms and is under pressure from growth in the number of scientific publications.   Methods Here we examine an element of the editorial process at eLife, in which the Reviewing Editor usually serves as one of the referees, to see what effect this has on decision times, decision type, and the number of citations. We analysed a dataset of 8,905 research submissions to eLife since June 2012, of which 2,747 were sent for peer review. This subset of 2747 papers was then analysed in detail.     Results The Reviewing Editor serving as one of the peer reviewers results in faster decision times on average, with the time to final decision ten days faster for accepted submissions (n=1,405 and five days faster for papers that were rejected after peer review (n=1,099. Moreover, editors acting as reviewers had no effect on whether submissions were accepted or rejected, and a very small (but significant effect on citation rates.   Conclusions An important aspect of eLife’s peer-review process is shown to be effective, given that decision times are faster when the Reviewing Editor serves as a reviewer. Other journals hoping to improve decision times could consider adopting a similar approach.

  18. Peer Mentoring to Facilitate Original Scientific Research by Students With Special Needs

    Science.gov (United States)

    Danch, J. M.

    2007-12-01

    Developed to allow high school students with special needs to participate in original scientific research, the Peer Mentoring Program was a supplement to existing science instruction for students in a self-contained classroom. Peer mentors were high school seniors at the end of a three-year advanced science research course who used their experience to create and develop inquiry-based research activities appropriate for students in the self- contained classroom. Peer mentors then assisted cooperative learning groups of special education students to facilitate the implementation of the research activities. Students with special needs successfully carried out an original research project and developed critical thinking and laboratory skills. Prior to embarking on their undergraduate course of study in the sciences, peer mentors developed an appreciation for the need to bring original scientific research to students of all levels. The program will be expanded and continued during the 2007-2008 school year.

  19. Focusing on Content: Discourse in L2 Peer Review Groups

    Science.gov (United States)

    Vorobel, Oksana; Kim, Deoksoon

    2014-01-01

    Recent studies on peer review groups in second language classes have focused on various topics, including collaboration (Carr, 2008) and the effect of peer review versus teacher feedback on students' writing (Zhang, 1995). One area that has received little attention is the content of students' speech during peer review. This longitudinal case…

  20. Undergraduate Essay Writing: Online and Face-to-Face Peer Reviews

    Science.gov (United States)

    Chong, Mike R.; Goff, Lori; Dej, Kimberly

    2012-01-01

    We implemented two different approaches of using peer review to support undergraduate essay assignments for students taking large second-year courses in life sciences and biology: a web-based online peer review (OPR) approach and a more traditional face-to-face peer review (FPR) approach that was conducted in tutorial settings. The essays…

  1. Independent peer review of nuclear safety computer codes

    International Nuclear Information System (INIS)

    Boyack, B.E.; Jenks, R.P.

    1993-01-01

    A structured, independent computer code peer-review process has been developed to assist the US Nuclear Regulatory Commission (NRC) and the US Department of Energy in their nuclear safety missions. This paper describes a structured process of independent code peer review, benefits associated with a code-independent peer review, as well as the authors' recent peer-review experience. The NRC adheres to the principle that safety of plant design, construction, and operation are the responsibility of the licensee. Nevertheless, NRC staff must have the ability to independently assess plant designs and safety analyses submitted by license applicants. According to Ref. 1, open-quotes this requires that a sound understanding be obtained of the important physical phenomena that may occur during transients in operating power plants.close quotes The NRC concluded that computer codes are the principal products to open-quotes understand and predict plant response to deviations from normal operating conditionsclose quotes and has developed several codes for that purpose. However, codes cannot be used blindly; they must be assessed and found adequate for the purposes they are intended. A key part of the qualification process can be accomplished through code peer reviews; this approach has been adopted by the NRC

  2. EERE Peer Review Guide

    Energy Technology Data Exchange (ETDEWEB)

    None

    2009-01-18

    The primary purpose of this guide is to provide managers and staff guidance in establishing formal in-progress peer review that provides intellectually fair expert evaluation of EERE RD3 and supporting business administration programs, both retrospective and prospective.

  3. Essential Features for a Scholarly Journal Content Management and Peer Review Software

    Directory of Open Access Journals (Sweden)

    Fatima Sheikh Shoaie

    2010-03-01

    Full Text Available   The present study investigates the software used in scientific journals for content management and peer review, in order to identify the essential features. These softwares are analyzed and presented in tabular format. A questionnaire was prepared and submitted to a panel composed of 15 referees, editor in chief, software designers and researchers. The essential features for a software managing the review process were divided into three groups with populations of 10-15, 5-10 and 0-5 respectively. The majority of peer review process software features, in view of panelists, fell into a group of features with a population of 10-15. Finally it should be said that the features represented by the first group must be taken into account when designing or purchasing a peer review software. The second tier features (with population of 5-10 are recommended given journal's status and capabilities. The third tier features were altogether discounted due to low population

  4. Feedback from community pharmacy users on the contribution of community pharmacy to improving the public's health: a systematic review of the peer reviewed and non‐peer reviewed literature 1990–2002

    Science.gov (United States)

    Anderson, Claire; Blenkinsopp, Alison; Armstrong, Miriam

    2004-01-01

    Abstract Objective  To systematically review feedback from pharmacy users on their perceptions and experiences of health‐related advice and services provided from community pharmacies. Methods  The focus of the review was community pharmacy activities in relation to promoting health and well‐being, preventing ill‐health and maintaining health. Searches were conducted for peer‐reviewed (international) and non‐peer‐reviewed (UK) research. Electronic databases searched included MEDLINE, EMBASE, Cochrane Library and International Pharmaceutical Abstracts; hand searches of key journals and conference abstracts, key informants. Key informants in the UK were contacted to identify unpublished studies. The inclusion period was 1990 onwards. Data extraction and synthesis  Data were abstracted into a matrix by one author with a sample checked by a second. The Health Development Agency's Evidence Base 2000 standards and the evidence categories used by the Department of Health in the National Service Frameworks were applied to each item. Main results  Seven peer reviewed papers and 13 non‐peer reviewed reports were identified for inclusion in the review. Consumer usage of pharmacies is almost universal with prescription supplies and purchase of over the counter medicines predominating. Evidence shows that not only is usage low for general health advice, but that pharmacists are perceived as ‘drugs experts’ rather than experts on health and illness. Emergency hormonal contraception and head lice management schemes have been well received. There is a need to consider privacy and confidentiality surrounding advice giving. Conclusions  Users of community pharmacy‐based health development initiatives express a high level of satisfaction. If community pharmacies are to be used to their full extent, then actions to extending the public's awareness and acceptance of the pharmacist's role in giving advice will be crucial. Further research will be needed to

  5. Optimizing radiology peer review: a mathematical model for selecting future cases based on prior errors.

    Science.gov (United States)

    Sheu, Yun Robert; Feder, Elie; Balsim, Igor; Levin, Victor F; Bleicher, Andrew G; Branstetter, Barton F

    2010-06-01

    Peer review is an essential process for physicians because it facilitates improved quality of patient care and continuing physician learning and improvement. However, peer review often is not well received by radiologists who note that it is time intensive, is subjective, and lacks a demonstrable impact on patient care. Current advances in peer review include the RADPEER() system, with its standardization of discrepancies and incorporation of the peer-review process into the PACS itself. The purpose of this study was to build on RADPEER and similar systems by using a mathematical model to optimally select the types of cases to be reviewed, for each radiologist undergoing review, on the basis of the past frequency of interpretive error, the likelihood of morbidity from an error, the financial cost of an error, and the time required for the reviewing radiologist to interpret the study. The investigators compiled 612,890 preliminary radiology reports authored by residents and attending radiologists at a large tertiary care medical center from 1999 to 2004. Discrepancies between preliminary and final interpretations were classified by severity and validated by repeat review of major discrepancies. A mathematical model was then used to calculate, for each author of a preliminary report, the combined morbidity and financial costs of expected errors across 3 modalities (MRI, CT, and conventional radiography) and 4 departmental divisions (neuroradiology, abdominal imaging, musculoskeletal imaging, and thoracic imaging). A customized report was generated for each on-call radiologist that determined the category (modality and body part) with the highest total cost function. A universal total cost based on probability data from all radiologists was also compiled. The use of mathematical models to guide case selection could optimize the efficiency and effectiveness of physician time spent on peer review and produce more concrete and meaningful feedback to radiologists

  6. How long is too long in contemporary peer review? Perspectives from authors publishing in conservation biology journals.

    Directory of Open Access Journals (Sweden)

    Vivian M Nguyen

    Full Text Available Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academics as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing and quantitative analyses (generalized linear models. We received 637 responses to a total of 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time is six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. Majority of participants attributed lengthy review times to the 'stress' on the peer-review system (i.e., reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times appear to be greater for early career researchers and can also have impact on author morale (e.g. motivation or frustration. Competition among colleagues were also of concern to respondents. Incentivizing peer review was among the top suggested alterations to the system along with training graduate students in peer review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study view the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer review models.

  7. How long is too long in contemporary peer review? Perspectives from authors publishing in conservation biology journals.

    Science.gov (United States)

    Nguyen, Vivian M; Haddaway, Neal R; Gutowsky, Lee F G; Wilson, Alexander D M; Gallagher, Austin J; Donaldson, Michael R; Hammerschlag, Neil; Cooke, Steven J

    2015-01-01

    Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academics as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to a total of 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time is six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. Majority of participants attributed lengthy review times to the 'stress' on the peer-review system (i.e., reviewer and editor fatigue), while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times appear to be greater for early career researchers and can also have impact on author morale (e.g. motivation or frustration). Competition among colleagues were also of concern to respondents. Incentivizing peer review was among the top suggested alterations to the system along with training graduate students in peer review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study view the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer review models.

  8. Peer effects on self-regulation in adolescence depend on the nature and quality of the peer interaction.

    Science.gov (United States)

    King, Kevin M; McLaughlin, Katie A; Silk, Jennifer; Monahan, Kathryn C

    2017-11-21

    Adolescence is a critical period for the development of self-regulation, and peer interactions are thought to strongly influence regulation ability. Simple exposure to peers has been found to alter decisions about risky behaviors and increase sensitivity to rewards. The link between peer exposure and self-regulation is likely to vary as a function of the type and quality of peer interaction (e.g., rejection or acceptance). Little is known about how the nature of interactions with peers influences different dimensions of self-regulation. We examined how randomization to acceptance or rejection by online "virtual" peers influenced multiple dimensions of self-regulation in a multisite community sample of 273 adolescents aged 16-17 years. Compared to a neutral condition, exposure to peers produced increases in cold cognitive control, but decreased hot cognitive control. Relative to peer acceptance, peer rejection reduced distress tolerance and increased sensitivity to losses. These findings suggest that different dimensions of adolescent self-regulation are influenced by the nature of the peer context: basic cognitive functions are altered by mere exposure to peers, whereas more complex decision making and emotion regulation processes are influenced primarily by the quality of that exposure.

  9. Funding source and research report quality in nutrition practice-related research.

    Directory of Open Access Journals (Sweden)

    Esther F Myers

    Full Text Available BACKGROUND: The source of funding is one of many possible causes of bias in scientific research. One method of detecting potential for bias is to evaluate the quality of research reports. Research exploring the relationship between funding source and nutrition-related research report quality is limited and in other disciplines the findings are mixed. OBJECTIVE: The purpose of this study is to determine whether types of funding sources of nutrition research are associated with differences in research report quality. DESIGN: A retrospective study of research reporting quality, research design and funding source was conducted on 2539 peer reviewed research articles from the American Dietetic Association's Evidence Analysis Library® database. RESULTS: Quality rating frequency distributions indicate 43.3% of research reports were rated as positive, 50.1% neutral, and 6.6% as negative. Multinomial logistic regression results showed that while both funding source and type of research design are significant predictors of quality ratings (χ2 = 118.99, p≤0.001, the model's usefulness in predicting overall research report quality is little better than chance. Compared to research reports with government funding, those not acknowledging any funding sources, followed by studies with University/hospital funding were more likely to receive neutral vs positive quality ratings, OR = 1.85, P <0.001 and OR = 1.54, P<0.001, respectively and those that did not report funding were more likely to receive negative quality ratings (OR = 4.97, P<0.001. After controlling for research design, industry funded research reports were no more likely to receive a neutral or negative quality rating than those funded by government sources. CONCLUSION: Research report quality cannot be accurately predicted from the funding source after controlling for research design. Continued vigilance to evaluate the quality of all research regardless of the funding source

  10. Leading Contributors to the Research Consortium's Annual Program, 1992-2011: High-Visibility Institutions, Researchers, and Topics

    Science.gov (United States)

    Cardinal, Bradley J.; Lee, Hyo

    2013-01-01

    Between 1992-2011, peer-reviewed research on the Research Consortium's annual program has been published in abstract form in the "Research Quarterly for Exercise and Sport". On the basis of frequency, high-visibility institutions, researchers, and sub-disciplinary categories were identified. Data were extracted from each abstract (N =…

  11. Geothermal Technologies Program 2011 Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    Hollett, Douglas [Energy Efficiency and Renewable Energy (EERE), Washington, DC (United States); Stillman, Greg [Energy Efficiency and Renewable Energy (EERE), Washington, DC (United States)

    2011-06-01

    On June 6-10, 2011, the U.S. Department of Energy (DOE), Office of Energy Efficiency and Renewable Energy (EERE), Geothermal Technologies Program (GTP or the Program) conducted its annual program peer review in Bethesda, Maryland. In accordance with the EERE Peer Review Guide, the review provides an independent, expert evaluation of the strategic goals and direction of the program and is a forum for feedback and recommendations on future program planning. The purpose of the review was to evaluate DOE-funded projects for their contribution to the mission and goals of the Program and to assess progress made against stated objectives.

  12. Qualities of a good reviewer

    KAUST Repository

    Bui, Huyen; Dunlap, Dallas; Hearon, Thomas; Herron, Donald; Lan, Chaoli; Jiang, Shu; Marfurt, Kurt; Nemeth, Balazs; Ogiesoba, Osareni; Schuster, Gerard T.; Zeng, Hongliu

    2017-01-01

    Interpretation shares commonalities with Geophysics and the AAPG Bulletin in that it is a peer-reviewed journal. Unlike Geophysics and the AAPG Bulletin, Interpretation is built around special sections headed by a team of special-section editors who are either experts or particularly interested in the focused area. In addition to constructing a Call for Papers announcing their special section, the special-section editors also will solicit papers from colleagues, competitors, technology suppliers, and others that they believe may have contributions of interest to the Interpretation readership community. Submitted papers then are assigned by the special editors to three or more reviewers, many of whom are contributors to (and hence expert in) the same special-section topic. By design, the special section-structure of Interpretation reaches authors, editors, and reviewers who previously may not have been involved in the peer-review process. Recognizing this fact, in this article the standing editorial board attempts to summarize some of the more important qualities of what we find to be a good reviewer.

  13. Qualities of a good reviewer

    KAUST Repository

    Bui, Huyen

    2017-07-22

    Interpretation shares commonalities with Geophysics and the AAPG Bulletin in that it is a peer-reviewed journal. Unlike Geophysics and the AAPG Bulletin, Interpretation is built around special sections headed by a team of special-section editors who are either experts or particularly interested in the focused area. In addition to constructing a Call for Papers announcing their special section, the special-section editors also will solicit papers from colleagues, competitors, technology suppliers, and others that they believe may have contributions of interest to the Interpretation readership community. Submitted papers then are assigned by the special editors to three or more reviewers, many of whom are contributors to (and hence expert in) the same special-section topic. By design, the special section-structure of Interpretation reaches authors, editors, and reviewers who previously may not have been involved in the peer-review process. Recognizing this fact, in this article the standing editorial board attempts to summarize some of the more important qualities of what we find to be a good reviewer.

  14. Measuring the Quality of Mission-Oriented Research

    National Research Council Canada - National Science Library

    Wang, Chun

    2001-01-01

    .... A peer reviewed objective- dependent (PROD) evaluation system is proposed to cater for the broad spectrum of research undertaken by mission-oriented research organisations, ranging from strategic research through to application and development...

  15. A polythematic real-time synergistic hybrid data telecommunication system for scientific research with bidirectional fuzzy feedback peer review by expert referees

    Directory of Open Access Journals (Sweden)

    Panagiotis Petratos

    2003-02-01

    Full Text Available Heterogeneous research environments, interests and locations do not necessarily coincide, thus hitherto the primary method of communication amongst researchers has been email. In this article a novel unified polythematic, real-time, synergistic, data telecommunication system is proposed with peer-reviewed, bidirectional fuzzy feedback for research scientists, to facilitate scientific information exchange via the extensible markup language (XML on multiple scientific topics, e.g. in mathematics, physics, biology and chemistry.

  16. Marketing Academics' Perceptions of the Peer Review Process

    Science.gov (United States)

    Bailey, Charles D.; Hair, Joe F.; Hermanson, Dana R.; Crittenden, Victoria L.

    2012-01-01

    Publication in refereed journals is critical to career success for most marketing faculty members, and the peer review process is the gatekeeper for a refereed journal. The study reported here examines marketing academics' perceptions of this peer review process. Based on responses from 653 marketing academics, we find favorable overall…

  17. EU and OECD benchmarking and peer review compared

    NARCIS (Netherlands)

    Groenendijk, Nico

    2009-01-01

    Benchmarking and peer review are essential elements of the so-called EU open method of coordination (OMC) which has been contested in the literature for lack of effectiveness. In this paper we compare benchmarking and peer review procedures as used by the EU with those used by the OECD. Different

  18. Literacy Is Transformative. The Thirty-Fifth Yearbook A Doubled Peer Reviewed Publication of the Association of Literacy Educators and Researchers

    Science.gov (United States)

    Szabo, Susan, Ed.; Martin, Linda, Ed.; Haas, Leslie, Ed.; Garza-Garcia, Lizabeth, Ed.

    2013-01-01

    For their 56th annual meeting, the Association of Educators and Researchers (ALER) met in Grand Rapids, Michigan at the Amway Grand Hotel. This year's conference theme was Literacy Is Transformative, which was also used as the title for this year's Yearbook, Volume 35. Included are double-peer reviewed papers, the presidential address,…

  19. The continued movement for open access to peer-reviewed literature.

    Science.gov (United States)

    Liesegang, Thomas J

    2013-09-01

    To provide a current overview of the movement for open access to the peer review literature. Perspective. Literature review of recent advances in the open access movement with a personal viewpoint of the nuances of the movement. The open access movement is complex, with many different constituents. The idealists for the open access movement are seeking open access to the literature but also to the data that constitute the research within the manuscript. The business model of the traditional subscription journal is being scrutinized in relation to the surge in the number of open access journals. Within this environment authors should beware predatory practices. More government and funding agencies are mandating open access to their funded research. This open access movement will continue to be disruptive until a business model ensures continuity of the scientific record. A flood of open access articles that might enrich, but also might pollute or confuse, the medical literature has altered the filtering mechanism provided by the traditional peer review system. At some point there may be a shake-out, with some literature being lost in cyberspace. The open access movement is maturing and must be embraced in some format. The challenge is to establish a sustainable financial business model that will permit the use of digital technology but yet not endanger the decades-old traditional publication model and peer review system. Authors seem to be slower in adopting open access than the idealists in the movement. Copyright © 2013 Elsevier Inc. All rights reserved.

  20. Bullied by Siblings and Peers: The Role of Rejecting/Neglecting Parenting and Friendship Quality Among Korean Children.

    Science.gov (United States)

    Kim, Jingu; Kim, Eunha

    2016-07-01

    The primary aim of this study was to examine the direct and indirect links of rejecting/neglecting parenting, sibling victimization, and friendship quality with peer victimization using a convenience sample of 584 Korean children in Grades 3 to 6. In addition, we tested whether these associations differed between male and female students. Structural equation modeling was performed to analyze the data. The results revealed rejecting/neglecting parenting indirectly influenced peer victimization through sibling victimization for both males and females, although such effects were stronger for females than males. Sibling victimization had a direct effect on peer victimization across both sexes, although it indirectly influenced peer victimization through poor friendship quality only for males. Therefore, bullying prevention and intervention programs must involve parents to make them aware of the important role they play in this process and to improve their parenting styles and involvement in sibling conflicts. Furthermore, while the role of friendship quality needs to be highlighted to prevent peer victimization among males, future research continues to explore other peer variables that are related to decreased peer victimization for females.

  1. Geothermal Technologies Office 2012 Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    none,

    2013-04-01

    On May 7-10, 2012, the U.S. Department of Energy, Office of Energy Efficiency and Renewable Energy, Geothermal Technologies Office conducted its annual program peer review in Westminster, CO. In accordance with the EERE Peer Review Guide, the review provides an independent, expert evaluation of the strategic goals and direction of the office and is a forum for feedback and recommendations on future office planning. The purpose of the review was to evaluate DOE-funded projects for their contribution to the mission and goals of the office and to assess progress made against stated objectives. Project scoring results, expert reviewer comments, and key findings and recommendations are included in this report.

  2. Students’ acceptance of peer review in Computer Science course

    Directory of Open Access Journals (Sweden)

    Zuzana Kubincová

    2016-04-01

    Full Text Available Peer review technique used in educational context could be beneficial for students from several points of view. Besides of developing students’ writing skills, critical thinking, practising articulation of own knowledge to the others and giving them feedback, it can encourage collaborative learning and boost the students’ interest in the course. In our web design course we successfully introduced peer review activities more than 2 years ago. In this paper we discuss the students’ acceptance of peer review applied on evaluation of other students’ projects.

  3. How Long Is Too Long in Contemporary Peer Review? Perspectives from Authors Publishing in Conservation Biology Journals

    Science.gov (United States)

    Nguyen, Vivian M.; Haddaway, Neal R.; Gutowsky, Lee F. G.; Wilson, Alexander D. M.; Gallagher, Austin J.; Donaldson, Michael R.; Hammerschlag, Neil; Cooke, Steven J.

    2015-01-01

    Delays in peer reviewed publication may have consequences for both assessment of scientific prowess in academia as well as communication of important information to the knowledge receptor community. We present an analysis on the perspectives of authors publishing in conservation biology journals regarding their opinions on the importance of speed in peer-review as well as how to improve review times. Authors were invited to take part in an online questionnaire, of which the data was subjected to both qualitative (open coding, categorizing) and quantitative analyses (generalized linear models). We received 637 responses to 6,547 e-mail invitations sent. Peer-review speed was generally perceived as slow, with authors experiencing a typical turnaround time of 14 weeks while their perceived optimal review time was six weeks. Male and younger respondents seem to have higher expectations of review speed than females and older respondents. The majority of participants attributed lengthy review times to reviewer and editor fatigue, while editor persistence and journal prestige were believed to speed up the review process. Negative consequences of lengthy review times were perceived to be greater for early career researchers and to have impact on author morale (e.g. motivation or frustration). Competition among colleagues was also of concern to respondents. Incentivizing peer-review was among the top suggested alterations to the system along with training graduate students in peer-review, increased editorial persistence, and changes to the norms of peer-review such as opening the peer-review process to the public. It is clear that authors surveyed in this study viewed the peer-review system as under stress and we encourage scientists and publishers to push the envelope for new peer-review models. PMID:26267491

  4. 2013 Geothermal Technologies Office Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    Geothermal Technologies Office

    2014-01-01

    Geothermal Technologies Office conducted its annual program peer review in April of 2013. The review provided an independent, expert evaluation of the technical progress and merit of GTO-funded projects. Further, the review was a forum for feedback and recommendations on future GTO strategic planning. During the course of the peer review, DOE-funded projects were evaluated for 1) their contribution to the mission and goals of the GTO and 2) their progress against stated project objectives. Principal Investigators (PIs) came together in sessions organized by topic “tracks” to disseminate information, progress, and results to a panel of independent experts as well as attendees.

  5. "Thank you for your critical comments and helpful suggestions": compliance and conflict in authors' replies to referees' comments in peer reviews of scientific research papers

    Directory of Open Access Journals (Sweden)

    Hugh Gosden

    2001-04-01

    Full Text Available Peer reviews of research papers submitted to journals are an "occluded" genre (Swales, 1996 - referees are usually anonymous and the confidential reports themselves are not part of the official record of research publication. Thus, compared to the published, readily available genres of the academy, there are few opportunities to study gatekeeping discourse such as peer reviews, nor are there many opportunities for novice researchers to practice framing appropriate and effective point-by-point replies to criticisms. This paper is part of a study based on the analysis and functional description of comments from a corpus of referees' reports and authors' replies. The data highlight the importance of authors being able to recognize and interpret the relative interactional/interpersonal vs. technical/ideational orientation of requested revisions, in order to revise successfully their papers after peer review. Research on publication productivity in the sciences has emphasized the importance of early productivity as a strong predictor of future publication (Fox, 1983. When young scientists take up their first academic position, publication levels are initially more affected by the productivity of the pre-doctoral years than by the prestige of the new department and institution. In a "reinforcing process of advantage" (Fox, 1983:293, those who have published early will often continue to do so for several years until the supportive research environment of their present location will more strongly affect continued productivity.

  6. Post-traumatic stress symptom development as a function of changing witnessing in-home violence and changing peer relationship quality: Evaluating protective effects of peer relationship quality.

    Science.gov (United States)

    Mishra, Aura A; Christ, Sharon L; Schwab-Reese, Laura M; Nair, Nayantara

    2018-07-01

    In the present study, witnessing in-home violence and peer relationship quality are evaluated as to their relative impact on Post Traumatic Stress (PTS) symptoms among children aged 8 to 17 investigated by child protective services (CPS) for maltreatment exposure. The sample included 2151 children from the National Survey of Child and Adolescent Well-Being II (NSCAW II). Linear growth models were estimated to assess associations between changes in PTS symptoms, witnessing in-home violence, and peer relationship quality over time. Greater frequency of witnessing in-home violence at baseline (i.e. wave 1) was associated with higher baseline PTS symptoms (β = 0.44). Increases in witnessing in-home violence frequency over time (average annual change across three years) had a strong association with increases in PTS symptoms over time (β = 0.88). Baseline peer relationship quality was associated with fewer PTS symptoms at baseline (β = -0.45). Increases in peer relationship quality over time were strongly associated with declines in PTS symptoms over time (β = -0.68). Peer relationship quality at baseline did not moderate baseline or over time associations between witnessing in-home violence and PTS symptoms. The average decline in PTS symptoms due to decreases in witnessing in-home violence and increases in peer relationship quality was 0.51 and 0.65 standard deviations respectively, over the three-year study period. Reducing chronic witnessing in-home violence and promoting the development of healthy social relationships with peers are critical for PTS symptom recovery. Copyright © 2018 Elsevier Ltd. All rights reserved.

  7. Quality and Research Evaluation in Organizations

    DEFF Research Database (Denmark)

    Hansson, Finn

    A central issue in science policy today is the changing role and function ofresearch evaluation. How is quality selected, has local organizational traditionsand managerial practices influence on the research evaluation? Who isperceived as peers or evaluators by the researchers and by managers...

  8. Biomass Program 2007 Program Peer Review - Feedstock Platform Summary

    Energy Technology Data Exchange (ETDEWEB)

    none,

    2009-10-27

    This document discloses the comments provided by a review panel at the U.S. Department of Energy Office of the Biomass Program Peer Review held on November 15-16, 2007 in Baltimore, MD and the Feedstock Platform Portfolio Peer Review held on August 21st through 23rd in Washington D.C.

  9. Transition From Peer Review to Peer Learning: Experience in a Radiology Department.

    Science.gov (United States)

    Donnelly, Lane F; Dorfman, Scott R; Jones, Jeremy; Bisset, George S

    2017-10-18

    To describe the process by which a radiology department moved from peer review to peer collaborative improvement (PCI) and review data from the first 16 months of the PCI process. Data from the first 16 months after PCI were reviewed: number of case reviews performed, number of learning opportunities identified, percentage yield of learning opportunities identified, type of learning opportunities identified, and comparison of the previous parameters between case randomly reviewed versus actively pushed (issues actively identified and entered). Changes in actively pushed cases were also assessed as volume per month over the 16 months (run chart). Faculty members were surveyed about their perception of the conversion to PCI. In all, 12,197 cases were peer reviewed, yielding 1,140 learning opportunities (9.34%). The most common types of learning opportunities for all reviewed cases included perception (5.1%) and reporting (1.9%). The yield of learning opportunities from actively pushed cases was 96.3% compared with 3.88% for randomly reviewed cases. The number of actively pushed cases per month increased over the course of the period and established two new confidence intervals. The faculty survey revealed that the faculty perceived the new PCI process as positive, nonpunitive, and focused on improvement. The study demonstrates that a switch to PCI is perceived as nonpunitive and associated with increased radiologist submission of learning opportunities. Active entering of identified learning opportunities had a greater yield and perceived value, compared with random review of cases. Copyright © 2017 American College of Radiology. Published by Elsevier Inc. All rights reserved.

  10. 2017 Project Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    None, None

    2018-02-06

    This document summarizes the recommendations and evaluations provided by an independent external panel of experts at the 2017 U.S. Department of Energy Bioenergy Technologies Office's Peer Review meeting.

  11. Research peer exchange, 2014.

    Science.gov (United States)

    2017-08-01

    The WSDOT Research Peer Exchange was held in Olympia, Washington on May 13 and 14, 2014 and addressed Research Program and Project Management as described in the following paragraphs: Program Management There are numerous funding programs, standing c...

  12. Evidence-based practice: a quality indicator analysis of peer-tutoring in adapted physical education.

    Science.gov (United States)

    Kalef, Laura; Reid, Greg; Macdonald, Cathy

    2013-09-01

    The purpose of the research was to conduct a quality indicator analysis of studies investigating peer-tutoring for students with a disability in adapted physical education. An electronic search was conducted among English journals published from 1960 to November 2012. Databases included ERIC, PsycINFO, and SPORTDiscus. Fifteen research studies employing group-experimental (Gersten et al., 2005) or single-subject designs (Horner et al., 2005) met inclusion criteria. Each study was assessed for the presence and clarity of quality indicators. Group designs met an average of 62.5% essential and 69% desirable indicators. An average of 80% of indicators was present for single-subject designs. Results suggest claims of peer-tutoring being an evidence-based practice are premature. Recommendations for clarifying and applying the quality indicators are offered. Copyright © 2013 Elsevier Ltd. All rights reserved.

  13. Peer review of RELAP5/MOD3 documentation

    International Nuclear Information System (INIS)

    Craddick, W.G.

    1994-01-01

    A peer review was performed on a portion of the documentation of the RELAP5/MOD3 computer code. The review was performed in two phases. The first phase was a review of Vol. III, Developmental Assessment Problems, and Vol. IV, Models and Correlations. The reviewers for this phase were Dr. Peter Griffith, Dr. Yassin Hassan, Dr. Gerald S. Lellouche, Dr. Marino di Marzo and Mr. Mark Wendel. The reviewers recommended a number of improvements, including using a frozen version of the code for assessment guided by a validation plan, better discussion of discrepancies between the code and experimental data, and better justification for flow regime maps and extension of models beyond their data base. The second phase was a review of Vol. VI, Quality Assurance of Numerical Techniques in RELAP5/MOD3. The reviewers for the second phase were Mr. Mark Wendel and Dr. Paul T. Williams. Recommendations included correction of numerous grammatical and typographical errors and better justification for the use of Lax's Equivalence Theorem

  14. Peer tutoring programs in health professions schools.

    Science.gov (United States)

    Santee, Jennifer; Garavalia, Linda

    2006-06-15

    Peer tutoring programs may be one method of maintaining quality of pharmacy education in the face of growing student enrollment and a small faculty body. A critical review of the literature was performed to ascertain whether peer tutoring programs improve or maintain the academic performance of health care professional students. Various electronic databases and abstracts from past American Association of Colleges of Pharmacy's annual meetings were searched to identify pertinent research. Only those articles with quantitative data, an experimental design, and comparative statistical analysis were included for review. Most studies found that peer tutoring had a positive impact on academic performance. These results may not be readily generalizable as there were numerous methodological flaws and limited descriptions of the programs and participants. Studies with better designs and more detail are needed to answer definitively whether peer tutoring is of benefit. Details of what resources were required should be included in the study to allow the reader to determine the feasibility of the intervention.

  15. Peer review for USI A-46 and the seismic IPE

    International Nuclear Information System (INIS)

    Smith, P.; Johnson, H.

    1993-01-01

    Two major seismic re-evaluation programs are underway at many US nuclear power plants. Over 60 units are being examined as part of the Nuclear Regulatory Commission's (NRC's) Unresolved Safety Issue A46 (Seismic Qualification of Equipment in Operating Plants). In addition, almost all plants are being examined as part of the seismic portion of NRC's Individual Plant Examination of External Events for Severe Accident Vulnerabilities. Both programs require an independent peer review of the evaluation performed by the utility. This paper presents observations on peer reviews, based on the authors's experience with them. Suggestions are presented on the scope of peer review, as well as some of the unique peer review issues inherent to these seismic programs

  16. Teaching undergraduates the process of peer review: learning by doing.

    Science.gov (United States)

    Rangachari, P K

    2010-09-01

    An active approach allowed undergraduates in Health Sciences to learn the dynamics of peer review at first hand. A four-stage process was used. In stage 1, students formed self-selected groups to explore specific issues. In stage 2, each group posted their interim reports online on a specific date. Each student read all the other reports and prepared detailed critiques. In stage 3, each report was discussed at sessions where the lead discussant was selected at random. All students participated in the peer review process. The written critiques were collated and returned to each group, who were asked to resubmit their revised reports within 2 wk. In stage 4, final submissions accompanied by rebuttals were graded. Student responses to a questionnaire were highly positive. They recognized the individual steps in the standard peer review, appreciated the complexities involved, and got a first-hand experience of some of the inherent variabilities involved. The absence of formal presentations and the opportunity to read each other's reports permitted them to study issues in greater depth.

  17. A protocol of a cross-sectional study evaluating an online tool for early career peer reviewers assessing reports of randomised controlled trials.

    Science.gov (United States)

    Chauvin, Anthony; Moher, David; Altman, Doug; Schriger, David L; Alam, Sabina; Hopewell, Sally; Shanahan, Daniel R; Recchioni, Alessandro; Ravaud, Philippe; Boutron, Isabelle

    2017-09-15

    Systematic reviews evaluating the impact of interventions to improve the quality of peer review for biomedical publications highlighted that interventions were limited and have little impact. This study aims to compare the accuracy of early career peer reviewers who use an innovative online tool to the usual peer reviewer process in evaluating the completeness of reporting and switched primary outcomes in completed reports. This is a cross-sectional study of individual two-arm parallel-group randomised controlled trials (RCTs) published in the BioMed Central series medical journals, BMJ , BMJ Open and Annals of Emergency Medicine and indexed with the publication type 'Randomised Controlled Trial'. First, we will develop an online tool and training module based (a) on the Consolidated Standards of Reporting Trials (CONSORT) 2010 checklist and the Explanation and Elaboration document that would be dedicated to junior peer reviewers for assessing the completeness of reporting of key items and (b) the Centre for Evidence-Based Medicine Outcome Monitoring Project process used to identify switched outcomes in completed reports of the primary results of RCTs when initially submitted. Then, we will compare the performance of early career peer reviewers who use the online tool to the usual peer review process in identifying inadequate reporting and switched outcomes in completed reports of RCTs at initial journal submission. The primary outcome will be the mean number of items accurately classified per manuscript. The secondary outcomes will be the mean number of items accurately classified per manuscript for the CONSORT items and the sensitivity, specificity and likelihood ratio to detect the item as adequately reported and to identify a switch in outcomes. We aim to include 120 RCTs and 120 early career peer reviewers. The research protocol was approved by the ethics committee of the INSERM Institutional Review Board (21 January 2016). The study is based on voluntary

  18. Online peer support interventions for chronic conditions: a scoping review protocol.

    Science.gov (United States)

    Munce, Sarah Elizabeth Patricia; Shepherd, John; Perrier, Laure; Allin, Sonya; Sweet, Shane N; Tomasone, Jennifer R; Nelson, Michelle L A; Guilcher, Sara J T; Hossain, Saima; Jaglal, Susan

    2017-09-24

    Peer support is receiving increasing attention as both an effective and cost-effective intervention method to support the self-management of chronic health conditions. Given that an increasing proportion of Canadians have internet access and the increasing implementation of web-based interventions, online peer support interventions are a promising option to address the burden of chronic diseases. Thus, the specific research question of this scoping review is the following: What is known from the existing literature about the key characteristics of online peer support interventions for adults with chronic conditions? METHODS AND ANALYSIS: We will use the methodological frameworks used by Arksey and O'Malley as well as Levac and colleagues for the current scoping review. To be eligible for inclusion, studies must report on adults (≥18 years of age) with one of the Public Health Agency of Canada chronic conditions or HIV/AIDS. We will limit our review to peer support interventions delivered through online formats. All study designs will be included. Only studies published from 2012 onwards will be included to ensure relevance to the current healthcare context and feasibility. Furthermore, only English language studies will be included. Studies will be identified by searching a variety of databases. Two reviewers will independently screen the titles and abstracts identified by the literature search for inclusion (ie, level 1 screening), the full text articles (ie, level 2 screening) and then perform data abstraction. Abstracted data will include study characteristics, participant population, key characteristics of the intervention and outcomes collected. This review will identify the key features of online peer support interventions and could assist in the future development of other online peer support programmes so that effective and sustainable programmes can be developed. © Article author(s) (or their employer(s) unless otherwise stated in the text of the

  19. A Qualitative Review of Literature on Peer Review of Teaching in Higher Education: An Application of the SWOT Framework

    Science.gov (United States)

    Thomas, Susan; Chie, Qiu Ting; Abraham, Mathew; Raj, Sony Jalarajan; Beh, Loo-See

    2014-01-01

    The issues of professional accountability, faculty member development, and enhancing higher education quality in universities are gaining importance. A strategy that could increase personal control over teaching practices in addition to improving professional development among faculty members is peer review of teaching (PRT). Five themes that are…

  20. Clinical research data warehouse governance for distributed research networks in the USA: a systematic review of the literature.

    Science.gov (United States)

    Holmes, John H; Elliott, Thomas E; Brown, Jeffrey S; Raebel, Marsha A; Davidson, Arthur; Nelson, Andrew F; Chung, Annie; La Chance, Pierre; Steiner, John F

    2014-01-01

    To review the published, peer-reviewed literature on clinical research data warehouse governance in distributed research networks (DRNs). Medline, PubMed, EMBASE, CINAHL, and INSPEC were searched for relevant documents published through July 31, 2013 using a systematic approach. Only documents relating to DRNs in the USA were included. Documents were analyzed using a classification framework consisting of 10 facets to identify themes. 6641 documents were retrieved. After screening for duplicates and relevance, 38 were included in the final review. A peer-reviewed literature on data warehouse governance is emerging, but is still sparse. Peer-reviewed publications on UK research network governance were more prevalent, although not reviewed for this analysis. All 10 classification facets were used, with some documents falling into two or more classifications. No document addressed costs associated with governance. Even though DRNs are emerging as vehicles for research and public health surveillance, understanding of DRN data governance policies and procedures is limited. This is expected to change as more DRN projects disseminate their governance approaches as publicly available toolkits and peer-reviewed publications. While peer-reviewed, US-based DRN data warehouse governance publications have increased, DRN developers and administrators are encouraged to publish information about these programs. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

  1. Relational spirituality and quality of life 2007 to 2017: an integrative research review.

    Science.gov (United States)

    Counted, Victor; Possamai, Adam; Meade, Tanya

    2018-04-24

    Despite the increasing number of evidence-based research on relational spirituality (RS) and quality of life (QoL) in medical-health research, little is known about the links between RS and QoL outcomes and the mechanisms by which RS aspects are functionally tied to QoL. To determine how RS is perceived/positioned in relation to QoL, we (a) examined recent available data that identify and appraise the links between RS and QoL; (b) identified themes emerging from the association between RS and QoL, and (c) discussed the implications of the effects of RS on QoL outcomes. We conducted an integrative research review of English-language peer-reviewed articles published between 2007 to March 2017 which examined an association between RS and QoL, as identified from a search of three databases: PubMed, PsycINFO, and ScienceDirect. A total of 20 studies were analysed. Of these, twelve (60%) reported positive association between RS and QoL, three (15%) studies reported inverse associations, whereas five (25%) studies showed evidence of lack of association (with two out of the five studies showing an indirect association). Physical health and psychological functioning were the most researched domains of QoL, and some studies suggest an attachment-based model of RS in the last 10 years of RS and QoL research. Studies conducted with participants with serious illnesses ranging from dementia, cardiac arrest, and breast cancer reported no association between RS and physical health. Our review shows evidence of both the direct and/or indirect effects of RS on QoL as a possible spiritual coping model for complementary alternative health therapy, albeit occurring through several religious-related psychosocial conduits. RS appears to be associated with health benefits as indicated across QoL domains. General medical practitioners and other healthcare agencies could benefit from the understanding that a spiritual coping model could aid their patients, and therefore their clinical

  2. 2013 Building Technologies Office Program Peer Review Report

    Energy Technology Data Exchange (ETDEWEB)

    none,

    2013-11-01

    The 2013 Building Technologies Office Program Peer Review Report summarizes the results of the 2013 Building Technologies Office (BTO) peer review, which was held in Washington, D.C., on April 2–4, 2013. The review was attended by over 300 participants and included presentations on 59 BTO-funded projects: 29 from BTO’s Emerging Technologies Program, 20 from the Commercial Buildings Integration Program, 6 from the Residential Buildings Integration Program, and 4 from the Building Energy Codes Program. This report summarizes the scores and comments provided by the independent reviewers for each project.

  3. 34 CFR 350.52 - What is the composition of a peer review panel?

    Science.gov (United States)

    2010-07-01

    ... 34 Education 2 2010-07-01 2010-07-01 false What is the composition of a peer review panel? 350.52... composition of a peer review panel? (a) The Secretary selects as members of a peer review panel scientists and... information, or conferences, must be reviewed by a peer review panel that consists of a majority of non...

  4. HortFlora Research Spectrum; NAAS Rating 3.78

    OpenAIRE

    Umrao, Dr. V.K.

    2017-01-01

    The journal HortFlora Research Spectrum (HRS) having International Impact (NAAS Rating: 3.78; ICV: 27.39, GIF: 0.471; IBI Factor: 2.8; NJIF: 2.14; GSCIF: 0.364; OAJI Impact Factor: 0.201), publishes high quality peer reviewed/refereed original research papers, review articles and research notes on all aspects of Horticultural plants' research including agronomic management, plant nutrition, biotechnology, crop improvement, plant protection, plant physiology, cell & molecular biology, medicina...

  5. Adolescent Peer Relations and Socioemotional Development in Latin America: Translating International Theory into Local Research.

    Science.gov (United States)

    Berger, Christian; Lisboa, Carolina; Cuadros, Olga; de Tezanos-Pinto, Pablo

    2016-06-01

    Peer relations constitute a main developmental context for adolescents. Peers offer an instance for identity definition and set the norms of acceptable and valued characteristics, behaviors, and attitudes, representing a societal model that allows and restrains avenues for adolescents' socioemotional development. The present article departs from these considerations to review research on adolescents' peer relations in Latin America from a socioemotional perspective. First, approaches to adolescence are discussed, with a main focus on attachment and identity theories, based on a bioecological framework. Then, a review of research in Latin America on friendships, school climate, and intergroup relations is presented. The discussion addresses the tension between theories and evidence generated in developed societies and highlights the particularities of Latin American youth, stressing the need for collecting local data. © 2016 Wiley Periodicals, Inc.

  6. Press Start: the value of an online student-led, peer-reviewed game studies journal

    Directory of Open Access Journals (Sweden)

    Matthew Barr

    2017-12-01

    Full Text Available In this article, an online student journal is described, and the ways in which student participants value the journal are discussed. Press Start is a peer-reviewed international journal of game studies, which aims to publish the best student work related to the academic study of video games. Content analysis of qualitative survey data (n = 29 provides insights into what students value about the journal, revealing six broad themes: community and support, inclusiveness and accessibility, the published research, feedback from peer review, experience of conducting peer review and the opportunity to publish. The article concludes by suggesting that engagement with online student journals should not be limited in terms of geography or the level of study, unless there are robust pedagogical reasons for doing so.

  7. 34 CFR 350.51 - What is the purpose of peer review?

    Science.gov (United States)

    2010-07-01

    ... 34 Education 2 2010-07-01 2010-07-01 false What is the purpose of peer review? 350.51 Section 350... PROJECTS AND CENTERS PROGRAM How Does the Secretary Make an Award? § 350.51 What is the purpose of peer review? The purpose of peer review is to insure that— (a) Those activities supported by the National...

  8. The Validity of Online Patient Ratings of Physicians: Analysis of Physician Peer Reviews and Patient Ratings.

    Science.gov (United States)

    McGrath, Robert J; Priestley, Jennifer Lewis; Zhou, Yiyun; Culligan, Patrick J

    2018-04-09

    Information from ratings sites are increasingly informing patient decisions related to health care and the selection of physicians. The current study sought to determine the validity of online patient ratings of physicians through comparison with physician peer review. We extracted 223,715 reviews of 41,104 physicians from 10 of the largest cities in the United States, including 1142 physicians listed as "America's Top Doctors" through physician peer review. Differences in mean online patient ratings were tested for physicians who were listed and those who were not. Overall, no differences were found between the online patient ratings based upon physician peer review status. However, statistical differences were found for four specialties (family medicine, allergists, internal medicine, and pediatrics), with online patient ratings significantly higher for those physicians listed as a peer-reviewed "Top Doctor" versus those who were not. The results of this large-scale study indicate that while online patient ratings are consistent with physician peer review for four nonsurgical, primarily in-office specializations, patient ratings were not consistent with physician peer review for specializations like anesthesiology. This result indicates that the validity of patient ratings varies by medical specialization. ©Robert J McGrath, Jennifer Lewis Priestley, Yiyun Zhou, Patrick J Culligan. Originally published in the Interactive Journal of Medical Research (http://www.i-jmr.org/), 09.04.2018.

  9. Designing Peer Review for Pedagogical Success: What Can We Learn from Professional Science?

    Science.gov (United States)

    Trautmann, Nancy M.

    2009-01-01

    This article compares peer review in professional versus education settings, summarizing key aspects of scientific peer review and reflecting on how these relate to the process as experienced by students. Consideration of professional peer review benefits educators in two ways. First, systems used for student peer review can employ some of the…

  10. The effect of peer influence and selection processes on adolescent alcohol use: a systematic review of longitudinal studies.

    Science.gov (United States)

    Leung, Rachel K; Toumbourou, John W; Hemphill, Sheryl A

    2014-01-01

    Adolescent alcohol use remains an important public health concern. One of the most salient and consistent predictors for drinking behaviour among young people is peer influence. A systematic review of longitudinal studies that examined the effect of peer influence on adolescent alcohol use between January 1997 and February 2011 is presented. Twenty-two studies fulfilled inclusion criteria and were reviewed. All but one study confirmed affiliation with alcohol-using or deviant peers as prospective predictors for the development of adolescent alcohol use. Findings revealed that existing longitudinal studies that have used multivariate analytic techniques to segregate peer influence (whereby adolescents start drinking after exposure to alcohol-using friends) and peer selection (whereby adolescents that start drinking without alcohol-using friends subsequently seek out drinking peers) effects consistently report significant peer influence effects. However, studies are unable to elucidate the relative contribution and developmental sequence of peer influence and selection. Existing research is synthesised to model the developmental influence of peer processes on adolescent alcohol use. Future research directions are recommended to inform better designed investigations that can lead to more effective endeavours to address peer processes in prevention efforts.

  11. Peer-to-peer mentoring for individuals with early inflammatory arthritis: feasibility pilot.

    Science.gov (United States)

    Sandhu, Sharron; Veinot, Paula; Embuldeniya, Gayathri; Brooks, Sydney; Sale, Joanna; Huang, Sicong; Zhao, Alex; Richards, Dawn; Bell, Mary J

    2013-03-01

    To examine the feasibility and potential benefits of early peer support to improve the health and quality of life of individuals with early inflammatory arthritis (EIA). Feasibility study using the 2008 Medical Research Council framework as a theoretical basis. A literature review, environmental scan, and interviews with patients, families and healthcare providers guided the development of peer mentor training sessions and a peer-to-peer mentoring programme. Peer mentors were trained and paired with a mentee to receive (face-to-face or telephone) support over 12 weeks. Two academic teaching hospitals in Toronto, Ontario, Canada. Nine pairs consisting of one peer mentor and one mentee were matched based on factors such as age and work status. Mentee outcomes of disease modifying antirheumatic drugs (DMARDs)/biological treatment use, self-efficacy, self-management, health-related quality of life, anxiety, coping efficacy, social support and disease activity were measured using validated tools. Descriptive statistics and effect sizes were calculated to determine clinically important (>0.3) changes. Peer mentor self-efficacy was assessed using a self-efficacy scale. Interviews conducted with participants examined acceptability and feasibility of procedures and outcome measures, as well as perspectives on the value of peer support for individuals with EIA. Themes were identified through constant comparison. Mentees experienced improvements in the overall arthritis impact on life, coping efficacy and social support (effect size >0.3). Mentees also perceived emotional, informational, appraisal and instrumental support. Mentors also reported benefits and learnt from mentees' fortitude and self-management skills. The training was well received by mentors. Their self-efficacy increased significantly after training completion. Participants' experience of peer support was informed by the unique relationship with their peer. All participants were unequivocal about the need for

  12. Peer-to-peer mentoring for individuals with early inflammatory arthritis: feasibility pilot

    Science.gov (United States)

    Sandhu, Sharron; Veinot, Paula; Embuldeniya, Gayathri; Brooks, Sydney; Sale, Joanna; Huang, Sicong; Zhao, Alex; Richards, Dawn; Bell, Mary J

    2013-01-01

    Objectives To examine the feasibility and potential benefits of early peer support to improve the health and quality of life of individuals with early inflammatory arthritis (EIA). Design Feasibility study using the 2008 Medical Research Council framework as a theoretical basis. A literature review, environmental scan, and interviews with patients, families and healthcare providers guided the development of peer mentor training sessions and a peer-to-peer mentoring programme. Peer mentors were trained and paired with a mentee to receive (face-to-face or telephone) support over 12 weeks. Setting Two academic teaching hospitals in Toronto, Ontario, Canada. Participants Nine pairs consisting of one peer mentor and one mentee were matched based on factors such as age and work status. Primary outcome measure Mentee outcomes of disease modifying antirheumatic drugs (DMARDs)/biological treatment use, self-efficacy, self-management, health-related quality of life, anxiety, coping efficacy, social support and disease activity were measured using validated tools. Descriptive statistics and effect sizes were calculated to determine clinically important (>0.3) changes. Peer mentor self-efficacy was assessed using a self-efficacy scale. Interviews conducted with participants examined acceptability and feasibility of procedures and outcome measures, as well as perspectives on the value of peer support for individuals with EIA. Themes were identified through constant comparison. Results Mentees experienced improvements in the overall arthritis impact on life, coping efficacy and social support (effect size >0.3). Mentees also perceived emotional, informational, appraisal and instrumental support. Mentors also reported benefits and learnt from mentees’ fortitude and self-management skills. The training was well received by mentors. Their self-efficacy increased significantly after training completion. Participants’ experience of peer support was informed by the unique

  13. Criteria for Assessing Quality in Academic Research: The Views of Biomedical Scientists, Clinical Scientists and Social Scientists

    Science.gov (United States)

    Albert, Mathieu; Laberge, Suzanne; McGuire, Wendy

    2012-01-01

    This study empirically addresses the claim made by Gibbons et al ("The new production of knowledge: The dynamics of science and research in contemporary societies." Sage, Thousand Oaks, 1994) that a novel form of quality control (associated with Mode 2 knowledge production) is supplementing the "traditional" peer-review process…

  14. Challenges in the Selection, Design and Implementation of an Online Submission and Peer Review System for STM Journals

    OpenAIRE

    J. Best; R. Akerman

    2007-01-01

    Two international scientific publishers collaborated to develop an Online Submission and Peer Review System (OSPREY) for their journals. Our goals were to meet market demand, increase editorial efficiency and streamline the transition from peer review to publishing. One of the publishers (National Research Council (NRC) Research Press, Canada) had previously purchased a third-party system that was subsequently discontinued by the vendor. Because of this experience and its complex requirements...

  15. The Impact of Peer Review on Writing in a Psychology Course: Lessons Learned

    Science.gov (United States)

    Bhullar, Naureen; Rose, Karen C.; Utell, Janine M.; Healey, Kathryn N.

    2014-01-01

    The authors assessed the impact of peer review on student writing in four sections of an undergraduate Developmental Psychology course. They hypothesized that peer review would result in better writing in the peer review group compared to the group with no peer review. Writing was rated independently by two instructors who were blind to the…

  16. Medical students-as-teachers: a systematic review of peer-assisted teaching during medical school

    Directory of Open Access Journals (Sweden)

    Yu TC

    2011-06-01

    Full Text Available Tzu-Chieh Yu¹, Nichola C Wilson², Primal P Singh¹, Daniel P Lemanu¹, Susan J Hawken³, Andrew G Hill¹¹South Auckland Clinical School, University of Auckland, Auckland, New Zealand; ²Department of Surgery, University of Auckland, Auckland, New Zealand; ³Department of Psychological Medicine, University of Auckland, Auckland, New ZealandIntroduction: International interest in peer-teaching and peer-assisted learning (PAL during undergraduate medical programs has grown in recent years, reflected both in literature and in practice. There, remains however, a distinct lack of objective clarity and consensus on the true effectiveness of peer-teaching and its short- and long-term impacts on learning outcomes and clinical practice.Objective: To summarize and critically appraise evidence presented on peer-teaching effectiveness and its impact on objective learning outcomes of medical students.Method: A literature search was conducted in four electronic databases. Titles and abstracts were screened and selection was based on strict eligibility criteria after examining full-texts. Two reviewers used a standard review and analysis framework to independently extract data from each study. Discrepancies in opinions were resolved by discussion in consultation with other reviewers. Adapted models of “Kirkpatrick’s Levels of Learning” were used to grade the impact size of study outcomes.Results: From 127 potential titles, 41 were obtained as full-texts, and 19 selected after close examination and group deliberation. Fifteen studies focused on student-learner outcomes and four on student-teacher learning outcomes. Ten studies utilized randomized allocation and the majority of study participants were self-selected volunteers. Written examinations and observed clinical evaluations were common study outcome assessments. Eleven studies provided student-teachers with formal teacher training. Overall, results suggest that peer-teaching, in highly selective

  17. An institutional review board-based clinical research quality assurance program.

    Science.gov (United States)

    Lad, Pramod M; Dahl, Rebecca

    2013-01-01

    Despite the acknowledged importance of quality assurance in the clinical research process, the problem of how such a program should be implemented at the level of an academic teaching hospital or a similar institution has not been addressed in the literature. Despite the fact that quality assurance is expected in programs which certify and accredit Institutional Review Boards (IRBs), very little is known about the role of the IRB in programs of clinical research quality assurance. In this article we consider the definition of clinical research quality assurance, and describe a program designed to achieve it. The key elements of such a program are education at the site level, which has both mandatory and voluntary components, and an auditing and monitoring program, which reinforces the education on quality assurance. The role of the IRB in achieving the program goals and the organizational placement of the quality assurance program within the IRB structure and function are important items of discussion.

  18. The Biosphere International Peer Review

    International Nuclear Information System (INIS)

    Van Luik, Abraham

    2002-01-01

    Abe van Luik (US DOE- YM, USA), ended the presentation by giving feedback from the IAEA peer review on the biosphere modelling strategy developed by the DOE Yucca Mountain Site Characterisation Office (YMSCO). This review was based on available international standards and guidance. The peer review team was constituted of both experts from regulatory and waste management organisations and national advisory committees. The implementation of the review consisted of an examination of biosphere reports mainly regarding the modelling and question and answer exchanges. The final report was submitted in April 2000. It contained twenty-three recommendations within two broad classifications; one concerning the regulatory framework, the other one regarding the framework to increase stakeholders' confidence in modelling. The three main categories of recommendations were outlined, namely (i) the DOE' s Biosphere assessment Approach, (ii) the definition of the biosphere system, and (iii) the model development, data and results. Regarding in particular the treatment of the uncertainties in the biosphere, it was viewed as a key issue during the review and thus it will be re-evaluated in the future performance assessment. The summary highlighted most of the recommendations received are to be acted on, and are to be included in the License Application plan for biosphere modelling

  19. The Joy of Teaching Literacy. The Thirty-Fourth Yearbook: A Double Peer Reviewed Publication of the Association of Literacy Educators and Researchers

    Science.gov (United States)

    Marin, Linda, Ed.; Boggs, Merry, Ed.; Szabo, Susan, Ed.; Morrision, Timothy, Ed.; Garza-Garcia, Lizabeth, Ed.

    2012-01-01

    The Association of Literacy Educators and Researchers (ALER) Yearbook, Volume 34, includes papers presented at the annual conference, which have gone through a double peer review process. It also includes the Presidential Address and the keynote addresses given at the conference. For ALER's 55th annual meeting, the Association of Literacy…

  20. Clinical Case Reporting in the Peer-Reviewed Physical Therapy Literature: Time to Move Toward Functioning.

    Science.gov (United States)

    Davenport, Todd E

    2015-12-01

    Physical therapists increasingly are contributing clinical case reports to the health literature, which form the basis for higher quality evidence that has been incorporated into clinical practice guidelines. Yet, few resources exist to assist physical therapists with the basic mechanics and quality standards of producing a clinical case report. This situation is further complicated by the absence of uniform standards for quality in case reporting. The importance of including a concise yet comprehensive description of patient functioning in all physical therapy case reports suggest the potential appropriateness of basing quality guidelines on the World Health Organization's International Classification of Functioning Disability and Health (ICF) model. The purpose of this paper is to assist physical therapists in creating high-quality clinical case reports for the peer-reviewed literature using the ICF model as a guiding framework. Along these lines, current recommendations related to the basic mechanics of writing a successful clinical case report are reviewed, as well and a proposal for uniform clinical case reporting requirements is introduced with the aim to improve the quality and feasibility of clinical case reporting in physical therapy that are informed by the ICF model. Copyright © 2013 John Wiley & Sons, Ltd.

  1. 42 CFR 67.103 - Peer review of contract proposals.

    Science.gov (United States)

    2010-10-01

    ... specific health care issues; and (5) Appropriate representation based on gender, racial/ethnic origin, and... the contract(s) awarded as a result of the peer review. (e) Conflict of interest. (1) Members of peer review groups will be screened for potential conflicts of interest prior to appointment and will be...

  2. The JSC Engineering Directorate Product Peer Review Process

    Science.gov (United States)

    Jenks, Kenneth C.

    2009-01-01

    The JSC Engineering Directorate has developed a Product Peer Review process in support of NASA policies for project management and systems engineering. The process complies with the requirements of NPR 7120.5, NPR 7123.1 and NPR 7150.2 and follows the guidance in NASA/SP-2007-6105. This presentation will give an overview of the process followed by a brief demonstration of an actual peer review, with audience participation.

  3. Peers and adolescent smoking.

    Science.gov (United States)

    Kobus, Kimberly

    2003-05-01

    There is a considerable body of empirical research that has identified adolescent peer relationships as a primary factor involved in adolescent cigarette smoking. Despite this large research base, many questions remain unanswered about the mechanisms by which peers affect youths' smoking behavior. Understanding these processes of influence is key to the development of prevention and intervention programs designed to address adolescent smoking as a significant public health concern. In this paper, theoretical frameworks and empirical findings are reviewed critically which inform the current state of knowledge regarding peer influences on teenage smoking. Specifically, social learning theory, primary socialization theory, social identity theory and social network theory are discussed. Empirical findings regarding peer influence and selection, as well as multiple reference points in adolescent friendships, including best friendships, romantic relationships, peer groups and social crowds, are also reviewed. Review of this work reveals the contribution that peers have in adolescents' use of tobacco, in some cases promoting use, and in other cases deterring it. This review also suggests that peer influences on smoking are more subtle than commonly thought and need to be examined more carefully, including consideration of larger social contexts, e.g. the family, neighborhood, and media. Recommendations for future investigations are made, as well as suggestions for specific methodological approaches that offer promise for advancing our knowledge of the contribution of peers on adolescent tobacco use.

  4. Enhanced Peer Assessment in MOOC Evaluation Through Assignment and Review Analysis

    Directory of Open Access Journals (Sweden)

    Ramón Alcarria

    2018-01-01

    Full Text Available The rapid evolution of MOOCs in recent years has produced a change in the education of students and in the development of professional skills. There is an increasing pressure on universities to establish procedures for the recognition and certification of student participation in MOOCs. In order to guarantee that the evaluation procedures are in line with the quality of the procedures traditionally established in the university, a proposal for an enhanced peer assessment is required to allow a more precise review of the students' tasks and the assessments provided by his colleagues, considering procedures of verification of originality and a complete rubric for the peer review that takes into account reviewer’s history for a correct grade calibration. This paper describes the implementation of the evaluation tool, and an experimental validation that indicates that the majority of the students who have used the tool for the revision of assignments have generated grades closer to the revisions generated by the professors in the study.

  5. Ethical considerations for peer review in forensic neuropsychology.

    Science.gov (United States)

    Johnson-Greene, Doug; Bechtold, Kathleen T

    2002-02-01

    The role of an expert is to assist the trier of fact in weighing evidence and reaching conclusions. Critical evaluation of opposing experts is an integral part of this process. In more recent times, cross-examination has given way to critical evaluation of opposing experts outside of the courtroom, a tactic we refer to as peer review in this paper. Though neuropsychologists frequently review the work of their colleagues, we are concerned here primarily with commentary that is at best misleading, and occasionally malicious, unethical, and unprofessional. Despite a growing trend to use experts as peer reviewers in the medicolegal arena, expectations concerning ethical and professional conduct of neuropsychologists have been absent. Enforcement of appropriate conduct is further complicated by the ambiguity of existing ethical standards and state statutes, and their limited applicability to all neuropsychologists who provide forensic services. This article provides an overview of ethical and professional issues pertaining to forensic peer review and concludes with recommendations for appropriate professional conduct.

  6. Potential Benefits of Incorporating Peer-to-Peer Interactions Into Digital Interventions for Psychotic Disorders: A Systematic Review.

    Science.gov (United States)

    Biagianti, Bruno; Quraishi, Sophia H; Schlosser, Danielle A

    2018-04-01

    Peer-to-peer interactions and support groups mitigate experiences of social isolation and loneliness often reported by individuals with psychotic disorders. Online peer-to-peer communication can promote broader use of this form of social support. Peer-to-peer interactions occur naturally on social media platforms, but they can negatively affect mental health. Recent digital interventions for persons with psychotic disorders have harnessed the principles of social media to incorporate peer-to-peer communication. This review examined the feasibility, acceptability, and preliminary efficacy of recent digital interventions in order to identify strategies to maximize benefits of online peer-to-peer communication for persons with psychotic disorders. An electronic database search of PubMed, EMBASE, PsycINFO, Ovid MEDLINE, Cochrane Central Register of Controlled Trials, and Health Technology Assessment Database was conducted in February 2017 and yielded a total of 1,015 results. Eight publications that reported data from six independent trials and five interventions were reviewed. The technology supporting peer-to-peer communication varied greatly across studies, from online forums to embedded social networking. When peer-to-peer interactions were moderated by facilitators, retention, engagement, acceptability, and efficacy were higher than for interventions with no facilitators. Individuals with psychotic disorders were actively engaged with moderated peer-to-peer communication and showed improvements in perceived social support. Studies involving service users in intervention design showed higher rates of acceptability. Individuals with psychotic disorders value and benefit from digital interventions that include moderated peer-to-peer interactions. Incorporating peer-to-peer communication into digital interventions for this population may increase compliance with other evidence-based therapies by producing more acceptable and engaging online environments.

  7. SCDAP/RELAP5 independent peer review

    Energy Technology Data Exchange (ETDEWEB)

    Corradini, M.L. [Wisconsin Univ., Madison, WI (United States). Dept. of Nuclear Engineering; Dhir, V.K. [Dhir, (V.K.) Santa Monica, CA (United States); Haste, T.J. [AEA Technology, Winfrith (United Kingdom); Heames, T.J. [Science Applications, Inc., Albuquerque, NM (United States); Jenks, R.P. [Los Alamos National Lab., NM (United States); Kelly, J.E. [Sandia National Labs., Albuquerque, NM (United States); Khatib-Rahbar, M. [Energy Research, Inc., Rockville, MD (United States); Viskanta, R. [Purdue Univ., Lafayette, IN (United States). Heat Transfer Lab.

    1993-01-01

    The SCDAP/RELAP5 code has been developed for best-estimate transient simulation of light-water-reactor coolant systems during severe accidents. The newest version of the code is SCDAP/RELAP5/MOD3. The US Nuclear Regulatory Commission (NRC) decided that there was a need for a broad technical review of the code by recognized experts to determine overall technical adequacy, even though the code is still under development. For this purpose, an eight-member SCDAP/RELAP5 Peer Review Committee was organized, and the outcome of the review should help the NRC prioritize future code-development activity. Because the code is designed to be mechanistic, the Committee used a higher standard for technical adequacy than was employed in the peer review of the parametric MELCOR code. The Committee completed its review of the SCDAP/RELAP5 code, and the findings are documented in this report. Based on these findings, recommendations in five areas are provided: (1) phenomenological models, (2) code-design objectives, (3) code-targeted applications, (4) other findings, and (5) additional recommendations.

  8. SCDAP/RELAP5 independent peer review

    International Nuclear Information System (INIS)

    Corradini, M.L.; Haste, T.J.; Heames, T.J.; Jenks, R.P.; Kelly, J.E.; Khatib-Rahbar, M.; Viskanta, R.

    1993-01-01

    The SCDAP/RELAP5 code has been developed for best-estimate transient simulation of light-water-reactor coolant systems during severe accidents. The newest version of the code is SCDAP/RELAP5/MOD3. The US Nuclear Regulatory Commission (NRC) decided that there was a need for a broad technical review of the code by recognized experts to determine overall technical adequacy, even though the code is still under development. For this purpose, an eight-member SCDAP/RELAP5 Peer Review Committee was organized, and the outcome of the review should help the NRC prioritize future code-development activity. Because the code is designed to be mechanistic, the Committee used a higher standard for technical adequacy than was employed in the peer review of the parametric MELCOR code. The Committee completed its review of the SCDAP/RELAP5 code, and the findings are documented in this report. Based on these findings, recommendations in five areas are provided: (1) phenomenological models, (2) code-design objectives, (3) code-targeted applications, (4) other findings, and (5) additional recommendations

  9. Factors impacting the quality of peer relationships of youth with Tourette's syndrome.

    Science.gov (United States)

    O'Hare, Deirdre; Eapen, Valsamma; Helmes, Edward; McBain, Kerry; Reece, John; Grove, Rachel

    2015-09-30

    Tourette's syndrome (TS) is a poorly understood neurodevelopmental disorder consistently associated with impaired peer relationships. This research aimed to investigate the relationship between TS and the ability of diagnosed youth to form secure attachment relationships with peers. A quantitative study examined differences between youth with TS and typically developing peers in social functioning, relationship problems and attachment security. Qualitative studies sought to identify factors that enhanced or impeded the ability to form secure peer relationships, including the impact of tic severity, comorbidity and personality traits. All research was conducted from the parental perspective. The research consisted of a controlled, survey-based qualitative and quantitative study (Study One) of parents of youth with TS (n = 86) and control group peers (n = 108), and a qualitative telephone interview-based study of TS group parents (Study Two, n = 22). Quantitative assessment of social functioning, peer problems and peer attachment security was conducted using the Paediatric Quality of Life inventory, the Strengths and Difficulties Questionnaire and the Attachment Questionnaire for Children. Qualitative data relating to personality was classified using the Five Factor Model. Results revealed significantly higher rates of insecure peer attachment, problems in peer relationships, difficulty making friends, stigmatisation and lower levels of social functioning for the TS group. Significant between-group differences in number and type of factors impacting peer relationships were also determined with 'personality' emerging as the most prevalent factor. Whilst Extraversion and Agreeableness facilitated friendships for both groups, higher rates of Neuroticism were barriers to friendship for individuals with TS. The TS group also identified multiple 'non-personality' factors impacting peer relationships, including TS and comorbid symptom severity, the child

  10. A descriptive study of effect-size reporting in research reviews.

    Science.gov (United States)

    Floyd, Judith A

    2017-06-01

    To describe effect-size reporting in research reviews completed in support of evidence-based practice in nursing. Many research reviews report nurses' critical appraisal of level, quality and overall strength of evidence available to address clinical questions. Several studies of research-review quality suggest effect-size information would be useful to include in these reviews, but none focused on reviewers' attention to effect sizes. Descriptive. One hundred and four reviews indexed in CINAHL as systematic reviews and published from July 2012-February 2014 were examined. Papers were required to be peer-reviewed, written in English, contain an abstract and have at least one nurse author. Reviews were excluded if they did not use critical appraisal methods to address evidence of correlation, prediction or effectiveness. Data from remaining papers (N = 73) were extracted by three or more independent coders using a structured coding form and detailed codebook. Data were stored, viewed and analysed using Microsoft Office Excel ® spreadsheet functions. Sixteen percent (n = 12) of the sample contained effect-size information. Of the 12, six included all the effect-size information recommended by APA guidelines. Independent of completeness of reporting, seven contained discussion of effect sizes in the paper, but none included effect-size information in abstracts. Research reviews available to practicing nurses often fail to include information needed to accurately assess how much improvement may result from implementation of evidence-based policies, programs, protocols or practices. Manuscript reviewers are urged to hold authors to APA standards for reporting/discussing effect-size information in both primary research reports and research reviews. © 2016 John Wiley & Sons Ltd.

  11. CONTAIN independent peer review

    International Nuclear Information System (INIS)

    Boyack, B.E.; Corradini, M.L.; Khatib-Rahbar, M.; Loyalka, S.K.; Smith, P.N.

    1995-01-01

    The CONTAIN code was developed by Sandia National Laboratories under the sponsorship of the US Nuclear Regulatory Commission (NRC) to provide integrated analyses of containment phenomena. It is used to predict nuclear reactor containment loads, radiological source terms, and associated physical phenomena for a range of accident conditions encompassing both design-basis and severe accidents. The code's targeted applications include support for containment-related experimental programs, light water and advanced light water reactor plant analysis, and analytical support for resolution of specific technical issues such as direct containment heating. The NRC decided that a broad technical review of the code should be performed by technical experts to determine its overall technical adequacy. For this purpose, a six-member CONTAIN Peer Review Committee was organized and a peer review as conducted. While the review was in progress, the NRC issued a draft ''Revised Severe Accident Code Strategy'' that incorporated revised design objectives and targeted applications for the CONTAIN code. The committee continued its effort to develop findings relative to the original NRC statement of design objectives and targeted applications. However, the revised CONTAIN design objectives and targeted applications. However, the revised CONTAIN design objectives and targeted applications were considered by the Committee in assigning priorities to the Committee's recommendations. The Committee determined some improvements are warranted and provided recommendations in five code-related areas: (1) documentation, (2) user guidance, (3) modeling capability, (4) code assessment, and (5) technical assessment

  12. CONTAIN independent peer review

    Energy Technology Data Exchange (ETDEWEB)

    Boyack, B.E. [Los Alamos National Lab., NM (United States); Corradini, M.L. [Univ. of Wisconsin, Madison, WI (United States). Nuclear Engineering Dept.; Denning, R.S. [Battelle Memorial Inst., Columbus, OH (United States); Khatib-Rahbar, M. [Energy Research Inc., Rockville, MD (United States); Loyalka, S.K. [Univ. of Missouri, Columbia, MO (United States); Smith, P.N. [AEA Technology, Dorchester (United Kingdom). Winfrith Technology Center

    1995-01-01

    The CONTAIN code was developed by Sandia National Laboratories under the sponsorship of the US Nuclear Regulatory Commission (NRC) to provide integrated analyses of containment phenomena. It is used to predict nuclear reactor containment loads, radiological source terms, and associated physical phenomena for a range of accident conditions encompassing both design-basis and severe accidents. The code`s targeted applications include support for containment-related experimental programs, light water and advanced light water reactor plant analysis, and analytical support for resolution of specific technical issues such as direct containment heating. The NRC decided that a broad technical review of the code should be performed by technical experts to determine its overall technical adequacy. For this purpose, a six-member CONTAIN Peer Review Committee was organized and a peer review as conducted. While the review was in progress, the NRC issued a draft ``Revised Severe Accident Code Strategy`` that incorporated revised design objectives and targeted applications for the CONTAIN code. The committee continued its effort to develop findings relative to the original NRC statement of design objectives and targeted applications. However, the revised CONTAIN design objectives and targeted applications. However, the revised CONTAIN design objectives and targeted applications were considered by the Committee in assigning priorities to the Committee`s recommendations. The Committee determined some improvements are warranted and provided recommendations in five code-related areas: (1) documentation, (2) user guidance, (3) modeling capability, (4) code assessment, and (5) technical assessment.

  13. Radioactive waste management: International peer reviews

    International Nuclear Information System (INIS)

    Warnecke, E.; Bonne, A.

    1995-01-01

    The Agency's peer review service for radioactive waste management - known as the Waste Management Assessment and Technical Review Programme (WATRP) - started in 1989, building upon earlier types of advisory programmes. WATRP's international experts today provide advice and guidance on proposed or ongoing radioactive waste management programmes; planning, operation, or decommissioning of waste facilities; or on legislative, organizational, and regulatory matters. Specific topics often cover waste conditioning, storage, and disposal concepts or facilities; or technical and other aspects of ongoing or planned research and development programmes. The missions can thus contributed to improving waste management systems and plans, and in raising levels of public confidence in them, as part of IAEA efforts to assist countries in the safe management of radioactive wastes. This article presents a brief overview of recent WATRP missions in Norway, Slovak Republic, Czech Republic and Finland

  14. Public service quality improvements: a case for exemption from IRB review of public administration research.

    Science.gov (United States)

    Jordan, Sara R

    2014-01-01

    Should the exemption from Institutional Review Board (IRB) evaluations currently in place for quality improvements research be extended to public administration research that addresses questions of improving the quality of public service delivery? As a means to both reduce the level of disdain held by a group of social science researchers for IRBs and to reduce the cost of review for minimal risk studies, I argue here that much of the current public administration research should also be exempted from normal processes of review by IRBs on the basis of their similarity to Quality Improvements (QI) research, a category of studies already granted exemption. This argument dovetails provisions currently in place for studies of public service and public benefit, but reframes these exemptions in the language of "quality improvements," which may be a more comfortable language for IRBs concerned to demonstrate compliance for review of all fields. To expedite this argument into the practices of IRBs, I included a checklist that researchers could use to self-identify their studies as QI, not research as such.

  15. Mentoring Model for Lecturers' Research Skills Development: Case ...

    African Journals Online (AJOL)

    The informal group mentoring model for research skills development begins with desk research for qualities of a publishable paper. Five dummy papers were reviewed by participants for quality. Participants conducted new studies and wrote research articles. These articles were peer reviewed by participants and submitted ...

  16. Peer-supported review of teaching: making the grade in midwifery and nursing education.

    Science.gov (United States)

    Murphy Tighe, Sylvia; Bradshaw, Carmel

    2013-11-01

    This paper outlines the value of peer-supported review of teaching for nurse and midwifery educators in an academic environment. Reflection and continuing professional development are important tenets of an educators' practice and can be addressed via peer observation. Definitions and models of peer observation are presented. The strengths and challenges associated with peer-supported review of teaching are discussed. The reasons why peer observation is underutilised are explored with some suggestions on how to overcome these challenges. Recent developments in relation to peer observation and peer-supported review are outlined. The need for tangible evidence of development and enhancement of existing teaching expertise is very pronounced in the current economic climate, it is concluded that peer-supported review of teaching can provide such evidence. Copyright © 2012 Elsevier Ltd. All rights reserved.

  17. Peer-to-Peer Teaching in Higher Education: A Critical Literature Review

    Science.gov (United States)

    Stigmar, Martin

    2016-01-01

    The aim of my critical literature review is to identify studies where students are engaged as partners in teaching in higher education and to analyze how tutors and tutees benefit from peer teaching. Thirty studies were included for review. Thirteen countries are represented and two thirds of the studies conducted in the United States of America…

  18. Research evaluation and organizational learning

    DEFF Research Database (Denmark)

    Hansson, Finn

    The paper will address the role of the recent implementation of systems of research evaluation in universities. The role of classic quality control system, the peer review, is to produce the most trustworthy knowledge and at the same time function as a learning system in a peer-to-peer learning p...

  19. Biomass Program 2007 Program Peer Review - Thermochemical Conversion Platform Summary

    Energy Technology Data Exchange (ETDEWEB)

    none,

    2009-10-27

    This document discloses the comments provided by a review panel at the U.S. Department of Energy Office of the Biomass Program Peer Review held on November 15-16, 2007 in Baltimore, MD and the Biomass Program Peer Review for the Thermochemical Platform, held on July 9th and 10th in Golden, Colorado.

  20. Is there something like a peer to peer science?

    Directory of Open Access Journals (Sweden)

    Michel Bauwens

    2010-03-01

    Full Text Available How will peer to peer infrastructures, and the underlying intersubjective and ethical relational model that is implied by it, affect scientific practice? Are peer-to-peer forms of cooperation, based on open and free input of voluntary contributors, participatory processes of governance, and universal availability of the output, more productive than centralized alternatives? In this short introduction, Michel Bauwens reviews a number of open and free, participatory and commons oriented practices that are emerging in scientific research and practice, but which ultimately point to a more profound epistemological revolution linked to increased participatory consciousness between the scientist and his human, organic and inorganic research material.

  1. The Significance of Attachment Quality for Obesity : A Meta-Analytic Review

    NARCIS (Netherlands)

    Diener, Marc J.; Geenen, Rinie; Koelen, Jurrijn A.; Aarts, Floor; Gerdes, Victor E. A.; Brandjes, Dees P. M.; Hinnen, Chris

    2016-01-01

    Theoretical considerations and empirical results suggest that attachment quality is relevant to obesity. This study used meta-analytic methods to systematically examine the empirical, peer-reviewed evidence regarding the relationship between attachment quality and body mass index (BMI) in separate

  2. Science and Technology Peer Review: GPRA

    National Research Council Canada - National Science Library

    Kostoff, Ronald

    2003-01-01

    This report describes practical issues for federal agencies to consider if they choose program peer review for internal purposes and/ or to contribute to satisfying the requirements of the Government...

  3. Characterization of the peer review network at the Center for Scientific Review, National Institutes of Health.

    Science.gov (United States)

    Boyack, Kevin W; Chen, Mei-Ching; Chacko, George

    2014-01-01

    The National Institutes of Health (NIH) is the largest source of funding for biomedical research in the world. This funding is largely effected through a competitive grants process. Each year the Center for Scientific Review (CSR) at NIH manages the evaluation, by peer review, of more than 55,000 grant applications. A relevant management question is how this scientific evaluation system, supported by finite resources, could be continuously evaluated and improved for maximal benefit to the scientific community and the taxpaying public. Towards this purpose, we have created the first system-level description of peer review at CSR by applying text analysis, bibliometric, and graph visualization techniques to administrative records. We identify otherwise latent relationships across scientific clusters, which in turn suggest opportunities for structural reorganization of the system based on expert evaluation. Such studies support the creation of monitoring tools and provide transparency and knowledge to stakeholders.

  4. Peer Support for the Hardly Reached: A Systematic Review.

    Science.gov (United States)

    Sokol, Rebeccah; Fisher, Edwin

    2016-07-01

    Health disparities are aggravated when prevention and care initiatives fail to reach those they are intended to help. Groups can be classified as hardly reached according to a variety of circumstances that fall into 3 domains: individual (e.g., psychological factors), demographic (e.g., socioeconomic status), and cultural-environmental (e.g., social network). Several reports have indicated that peer support is an effective means of reaching hardly reached individuals. However, no review has explored peer support effectiveness in relation to the circumstances associated with being hardly reached or across diverse health problems. To conduct a systematic review assessing the reach and effectiveness of peer support among hardly reached individuals, as well as peer support strategies used. Three systematic searches conducted in PubMed identified studies that evaluated peer support programs among hardly reached individuals. In aggregate, the searches covered articles published from 2000 to 2015. Eligible interventions provided ongoing support for complex health behaviors, including prioritization of hardly reached populations, assistance in applying behavior change plans, and social-emotional support directed toward disease management or quality of life. Studies were excluded if they addressed temporally isolated behaviors, were limited to protocol group classes, included peer support as the dependent variable, did not include statistical tests of significance, or incorporated comparison conditions that provided appreciable social support. We abstracted data regarding the primary health topic, categorizations of hardly reached groups, program reach, outcomes, and strategies employed. We conducted a 2-sample t test to determine whether reported strategies were related to reach. Forty-seven studies met our inclusion criteria, and these studies represented each of the 3 domains of circumstances assessed (individual, demographic, and cultural-environmental). Interventions

  5. Health-related quality of life in children with high-functioning autism.

    Science.gov (United States)

    Potvin, Marie-Christine; Snider, Laurie; Prelock, Patricia A; Wood-Dauphinee, Sharon; Kehayia, Eva

    2015-01-01

    The health-related quality of life of school-aged children with high-functioning autism is poorly understood. The objectives of this study were to compare the health-related quality of life of children with high-functioning autism to that of typically developing peers and to compare child-self and parent-proxy reports of health-related quality of life of children. A cross-sectional study of children with high-functioning autism (n = 30) and peers (n = 31) was conducted using the Pediatric Quality of Life Inventory 4.0 Generic Core Scales. Children with high-functioning autism had significantly poorer health-related quality of life than peers whether reported by themselves (p children and parental scores suggested variance in points of view. This study specifically investigated health-related quality of life in children with high-functioning autism as compared to a sample of peers, from the child's perspective. It strengthens earlier findings that children with high-functioning autism experience poorer health-related quality of life than those without this disorder and points to the importance of clinicians working with families to identify areas in a child's life that promote or hinder their sense of well-being. © The Author(s) 2013.

  6. Calibrated peer review assignments for the earth sciences

    Science.gov (United States)

    Rudd, J.A.; Wang, V.Z.; Cervato, C.; Ridky, R.W.

    2009-01-01

    Calibrated Peer Review ??? (CPR), a web-based instructional tool developed as part of the National Science Foundation reform initiatives in undergraduate science education, allows instructors to incorporate multiple writing assignments in large courses without overwhelming the instructor. This study reports successful implementation of CPR in a large, introductory geology course and student learning of geoscience content. For each CPR assignment in this study, students studied web-based and paper resources, wrote an essay, and reviewed seven essays (three from the instructor, three from peers, and their own) on the topic. Although many students expressed negative attitudes and concerns, particularly about the peer review process of this innovative instructional approach, they also recognized the learning potential of completing CPR assignments. Comparing instruction on earthquakes and plate boundaries using a CPR assignment vs. an instructional video lecture and homework essay with extensive instructor feedback, students mastered more content via CPR instruction.

  7. An evidence based protocol for peer review of radiographer musculoskeletal plain film reporting

    International Nuclear Information System (INIS)

    Stephenson, Paul; Hannah, April; Jones, Helen; Edwards, Rosemary; Harrington, Kate; Baker, Sally-Anne; Fitzgerald, Nicole; Belfield, Jane

    2012-01-01

    Aims: Medical image interpretation by non-medically trained staff continues to court controversy. This article aims to show that any potential risks associated with radiographer reporting can be monitored and mitigated if a robust peer review system is introduced. A search of the evidence base illustrates a paucity of guidance on how reporting radiographers should be audited or how a peer review process should be implemented. A practical framework for designing a reporting radiographer peer review process is provided. Methods: Following a literature review, key issues faced when designing a peer review protocol were identified. The following questions are answered: How frequent should peer review take place? How many reports should be reviewed? How are reports selected for review? Who should peer review the radiographer reports? How should radiographer's reporting performance be measured? What standard of reporting is acceptable? Results: Details are provided of the process that has been used for over three years at a busy inner-city teaching hospital for auditing musculoskeletal plain film radiographer reporting. The peer review method presented is not intended to produce robust statistical data; it is a practical method of locally assessing the reporting competency. As such, our protocol should be viewed as part of a larger programme for continuing professional development. Conclusion: It is hoped that this practical protocol will encourage radiology departments to engage in a programme of peer review for reporting radiographers.

  8. Thanking our peer reviewers

    Directory of Open Access Journals (Sweden)

    Storey Alan

    2013-03-01

    Full Text Available Contributing reviewers As 2013 commences I would like to take a moment to reflect and recognize the peer reviewers that made the previous year possible. Listed below are those people who reviewed for Molecular Cancer last year. All are generous individuals who donated their time to assessing and improving our authors’ submissions. Your combined efforts have been invaluable to the editorial staff in maintaining the continued success of the journal in the Open Access forum. The editors of Molecular Cancer would like to thank all the reviewers who contributed to the journal in Volume 11 (2012 by participating in the review process - taking time out of your busy schedules and even to volunteer - without your critical insights, hard work and support for the journal we wouldn’t be able to do what we do.

  9. Identifying the Potential Organizational Impact of an Educational Peer Review Program

    Science.gov (United States)

    Toth, Kate E.; McKey, Colleen A.

    2010-01-01

    The literature on educational peer review (EPR) has focused on evaluating EPR's impact on faculty and/or student learning outcomes; no literature exists on the potential organizational impact. A qualitative (case study) research design explored perceptions of 17 faculty and 10 administrators within a school of nursing in an Ontario university…

  10. The dynamics of writing and peer review at primary school

    Directory of Open Access Journals (Sweden)

    Jacques Crinon

    2012-11-01

    Full Text Available The object of this research is a learning method that uses email correspondence to promote the development of narrative writing skills in year 4 and year 5 students. Focusing on the written production of episodes of adventure novels and peer review, this learning method was applied to four classes in the Paris region over a 1-year period. The classes were paired in such a way that some students were required to read and analyze texts produced by correspondents (advice givers while others carried out revisions using peer advice and suggestions (advice receivers. To describe the dynamics of writing, revision and learning, a qualitative analysis of the texts and suggestions given or received by the student partners is carried out. A statistical analysis comparing the texts produced by students in both groups is used to corroborate the findings of the initial analysis. Students showed an increasing awareness and consideration of the key characteristics of the practiced genre, resulting in an improvement of the quality of the texts in the course of the revision process and throughout the year. The texts produced by the advice givers improved more than the texts produced by the advice receivers. The findings are attributed to greater self-reflection and successive reformulations fostered by the elaboration of advice and suggestions.

  11. Trends in High Nature Value farmland studies: A systematic review

    Directory of Open Access Journals (Sweden)

    Benedetti Yanina

    2017-12-01

    Full Text Available Background. Since the High Nature Value (HNV concept was defined in the early 1990s, several studies on HNV farmland has been increasing over the past 30 years in Europe, highlighting the interest by scientific community of HNV farming systems supporting biodiversity conservation. The aim of this study was to evaluate the trends and main gaps on HNV farmland peer-reviewed publications in order to contribute to the effectiveness of future research in this field. Methods. Searches were conducted using the databases Web of SciencesTM and Scopus in order to identify only peer-reviewed articles on HNV farmland, published prior to July 2017. The inclusion and exclusion criteria were developed a priori. Data as year, country, type of document, subject area, taxa studied and biodiversity metrics assessed were extracted and explored in order to analyse the spatial and temporal distribution of the concept, including the main topics addressed in HNV farmland literature. Results. After screening 308 original articles, 90 were selected for this review. HNV farmland studies involved several disciplines, mainly biodiversity and conservation and environmental sciences and ecology. Most peer-reviewed articles focused on HNV farming were conducted in Spain, Italy, Ireland and Portugal. The main studied taxa were plants and birds. Taxonomic diversity was the biodiversity metric more often used to assess the biodiversity status on HNV farmland areas. A positive correlation was found between HNV farmland area and HNV farmland studies conducted in respective countries. Discussion. The HNV farmland research subject is a relative novel approach, and this systematic review provides a comprehensive overview about the main topics in the HNV farmland peer-reviewed literature contributing to highlight the main gaps and provide some considerations in order to assist the performance of HNV farming systems and conservation policies, addressed to sustain high levels of

  12. WANO peer review. Organization and benefits as seen by WANO

    International Nuclear Information System (INIS)

    Haferburg, Manfred

    2010-01-01

    The World Association of Nuclear Operators (WANO) was founded in May 1989. 144 enterprises operating nuclear power plants signed the WANO Charter in Moscow as a response of industry to the Chernobyl disaster. The Association now comprises the operators of more than 430 nuclear power plants in more than 32 countries. WANO performs its activities through regional centers in Atlanta, Moscow, Paris, and Tokyo. The Coordination Center of WANO is located in London. Each regional WANO Center handles the four most important programs: - Peer Reviews, - exchanges of operating experience, - specialized and technical development, - technical service and exchange. The technical support and exchange program comprises proven processes, such as performance indicators, operator networks, technical support missions. WANO peer reviews are conducted on a voluntary basis and upon request by the licensees. By the end of 2008, WANO had run 388 peer reviews in 31 countries. Peer reviews serve to compare the practical operation of a nuclear power plant with the best international standards. This in-depth examination is carried out by an international, independent team of experts on an optimized objective basis. Peer reviews are conducted not only to examine compliance with all pertinent rules and regulations, but also to strive for excellent performance results. (orig.)

  13. Thank You to Our 2017 Peer Reviewers

    Science.gov (United States)

    Hauck, Steven A.; Baratoux, David; Stanley, Sabine; Stanley

    2018-02-01

    Science operates best by sharing accurate new knowledge in clear ways. In order to check our assumptions, our methods, and our interpretations of the observations, experiments, analyses, and calculations that we do, we ask others to look at our work. We call this peer review—other experts who were not involved in a given study read and critically evaluate the descriptions of our work. They look for completeness, accuracy, whether work is new, and how clearly we have written the descriptions. We continue to be humbled by the time, effort, and careful insights that our colleagues share with each other through the process of peer review. In 2017, JGR Planets benefited from more than 610 reviews provided by 398 of our peers for papers submitted to the journal. Thank you all for your awesome efforts toward advancing planetary science now and for the future.

  14. Citation analysis as a measure of article quality, journal influence and individual researcher performance

    International Nuclear Information System (INIS)

    Nightingale, Julie M.; Marshall, Gill

    2012-01-01

    The research-related performance of universities, as well as that of individual researchers, is increasingly evaluated through the use of objective measures, or metrics, which seek to support or in some cases even replace more traditional methods of peer review. In particular there is a growing awareness in research communities, government organisations and funding bodies around the concept of using evaluation metrics to analyse research citations. The tools available for ‘citation analysis’ are many and varied, enabling a quantification of scientific quality, academic impact and prestige. However there is increasing concern regarding the potential misuse of such tools, which have limitations in certain research disciplines. This article uses ‘real world’ examples from radiography research and scholarship to illustrate the range of currently available citation analysis tools. It explores the academic debate surrounding their strengths and limitations, and identifies the potential impact of citation analysis on the radiography research community. The article concludes that citation analysis is a valuable tool for researchers to use for personal reflection and research planning, yet there are inherent dangers if it is used inappropriately. Whilst citation analysis can give objective information regarding an individual, research group, journal or higher education institution, it should not be used as a total substitute for traditional qualitative review and peer assessment.

  15. IRIS Toxicological Review of Hexavalent Chromium (Peer Review Plan)

    Science.gov (United States)

    EPA is conducting a peer review of the scientific basis supporting the human health hazard and dose-response assessment of hexavalent chromium that will appear on the Integrated Risk Information System (IRIS) database.

  16. A peer review of the Hanford Site Permanent Isolation Surface Barrier Development Program

    International Nuclear Information System (INIS)

    Wing, N.R.

    1992-09-01

    A panel of technical experts was organized to peer review the Hanford Site Permanent Isolation Surface Barrier Development Program (BDP) and to provide a specific review of a preconceptual prototype barrier design initiated during fiscal year (FY) 1990. The technical peer review of the BDP and the prototype is being conducted in three phases, two of which have been completed. This document presents the peer review panel's findings on the first two phases of the peer review process. Biointrusion and water intrusion control are discussed, along with design life, vegetation, and climate impact

  17. An Open Science Peer Review Oath [v2; ref status: indexed, http://f1000r.es/4wf

    Directory of Open Access Journals (Sweden)

    Jelena Aleksic

    2015-01-01

    Full Text Available One of the foundations of the scientific method is to be able to reproduce experiments and corroborate the results of research that has been done before. However, with the increasing complexities of new technologies and techniques, coupled with the specialisation of experiments, reproducing research findings has become a growing challenge. Clearly, scientific methods must be conveyed succinctly, and with clarity and rigour, in order for research to be reproducible. Here, we propose steps to help increase the transparency of the scientific method and the reproducibility of research results: specifically, we introduce a peer-review oath and accompanying manifesto. These have been designed to offer guidelines to enable reviewers (with the minimum friction or bias to follow and apply open science principles, and support the ideas of transparency, reproducibility and ultimately greater societal impact. Introducing the oath and manifesto at the stage of peer review will help to check that the research being published includes everything that other researchers would need to successfully repeat the work. Peer review is the lynchpin of the publishing system: encouraging the community to consciously (and conscientiously uphold these principles should help to improve published papers, increase confidence in the reproducibility of the work and, ultimately, provide strategic benefits to authors and their institutions.

  18. The Peer Education Approach in Adolescents- Narrative Review Article.

    Science.gov (United States)

    Abdi, Fatemeh; Simbar, Masoumeh

    2013-11-01

    Adolescence is an important stage of human life span, which crucial developmental processes occur. Since peers play a critical role in the psychosocial development of most adolescents, peer education is currently considered as a health promotion strategy in adolescents. Peer education is defined as a system of delivering knowledge that improves social learning and provides psychosocial support. As identifying the outcomes of different educational approaches will be beneficial in choosing the most effective programs for training adolescents, the present article reviewed the impact of the peer education approach on adolescents. In this review, databases such as PubMed, EMBASE, ISI, and Iranian databases, from 1999 to 2013, were searched using a number of keywords. Peer education is an effective tool for promoting healthy behaviors among adolescents. The development of this social process depends on the settings, context, and the values and expectations of the participants. Therefore, designing such programs requires proper preparation, training, supervision, and evaluation.

  19. Active Minds: Creating Peer-to-Peer Mental Health Awareness

    Science.gov (United States)

    Walther, Willliam A.; Abelson, Sara; Malmon, Alison

    2014-01-01

    Utilizing student peers is one vital avenue for improving the prevention, detection, and treatment of mental health disorders on college campuses (The Campus Suicide Prevention Center of Virginia, 2011). This article will briefly review research findings indicating the importance of student peers and then focus on a promising model and growing…

  20. An educational programme for peer review groups to improve treatment of chronic heart failure and diabetes mellitus type 2 in general practice

    NARCIS (Netherlands)

    Kasje, Willeke N.; Denig, Petra; Stewart, Roy E.; de Graeff, Pieter A.; Haaijer-Ruskamp, Flora M.

    2006-01-01

    Rationale, aims and objectives Peer review groups are considered helpful for quality improvement in primary care. An interactive educational programme for small peer groups was developed, focusing on the implementation of newly developed treatment guidelines. The aim is to evaluate the effect of the

  1. A systematic review of the literature describing the outcomes of near-peer mentoring programs for first year medical students.

    Science.gov (United States)

    Akinla, Olawunmi; Hagan, Pamela; Atiomo, William

    2018-05-08

    Transition into higher education has been identified as one of the most stressful periods for learners. Interventions targeting the transition phase such as near- peer mentoring might help address some of these challenges. We were however unable to identify a published systematic review of the literature describing outcomes of near-peer mentoring of medical students during the transition phase into medical school. The aim of this paper is to review the literature and describe the outcomes of near-peer mentoring schemes for first-year medical students in the transition phase. A search of different electronic databases was carried out, using the search terms peer, buddy, mentor*, counsel*, advise*, tutor*, student, medical, school. 1861 articles were identified, however only 5 studies met the inclusion criteria- primary mentees should be first-years, and mentors must be inclusive of second-years but not limited to them. In reporting this paper, the PRISMA guidelines were followed. Published material on near-peer mentoring for medical students is scarce. Three outcomes for peer mentoring were identified- professional and personal development, stress reduction, and ease of transitioning. Incidentally, peer-mentoring was also found to have facilitated the development of personal and professional attitudes in the mentors. The quality of the evaluation methods in the studies was however low to moderate. Near-peer-mentoring is a way of promoting professional and personal development. It is also promising to aid transition and maintain well-being of first-year medical students. However, larger, better quality longitudinal studies, are needed to ascertain its true value for these students.

  2. Peer Reviews: a voluntary means of enhancing operating culture

    International Nuclear Information System (INIS)

    Vella, R.

    1996-01-01

    In the nuclear energy industry, and also in other fields, excellent experience has been gained from the regular accumulation of expert evidence of power station operation through external organizations or teams. In 1991, the World Association of Nuclear Operations (WANO) initiated a pilot programme for voluntary 'Peer Reviews'. The success of this first exercise in gathering expert evidence led to the introduction of the 'Peer Review' programme in 1993 as one of the standard programmes of WANO. The object was to increase the safety and reliability of nuclear power stations throughout the world. WANO Peer Reviews are voluntary and are carried out at the request of a member. They are oriented towards special WANO performance objectives and criteria, which have been established by the management of WANO. (orig.) [de

  3. The reporting characteristics and methodological quality of Cochrane reviews about health policy research.

    Science.gov (United States)

    Xiu-xia, Li; Ya, Zheng; Yao-long, Chen; Ke-hu, Yang; Zong-jiu, Zhang

    2015-04-01

    The systematic review has increasingly become a popular tool for researching health policy. However, due to the complexity and diversity in the health policy research, it has also encountered more challenges. We set out the Cochrane reviews on health policy research as a representative to provide the first examination of epidemiological and descriptive characteristics as well as the compliance of methodological quality with the AMSTAR. 99 reviews were included by inclusion criteria, 73% of which were Implementation Strategies, 15% were Financial Arrangements and 12% were Governance Arrangements; involved Public Health (34%), Theoretical Exploration (18%), Hospital Management (17%), Medical Insurance (12%), Pharmaceutical Policy (9%), Community Health (7%) and Rural Health (2%). Only 39% conducted meta-analysis, and 49% reported being updates, and none was rated low methodological quality. Our research reveals that the quantity and quality of the evidence should be improved, especially Financial Arrangements and Governance Arrangements involved Rural Health, Health Care Reform and Health Equity, etc. And the reliability of AMSTAR needs to be tested in larger range in this field. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  4. The nature of qualitative construction partnering research : literature review

    NARCIS (Netherlands)

    Marieke Venselaar; Hans Warmelink

    2017-01-01

    from the publisher's site: "The purpose of this paper is to investigate the nature of qualitative construction partnering research. Design/methodology/approach. In total, 20 qualitative peer-reviewed papers about construction partnering research are reviewed. Findings: The results show four

  5. Review: how do hospital organizational structure and processes affect quality of care?: a critical review of research methods.

    Science.gov (United States)

    Hearld, Larry R; Alexander, Jeffrey A; Fraser, Irene; Jiang, H Joanna

    2008-06-01

    Interest in organizational contributions to the delivery of care has risen significantly in recent years. A challenge facing researchers, practitioners, and policy makers is identifying ways to improve care by improving the organizations that provide this care, given the complexity of health care organizations and the role organizations play in influencing systems of care. This article reviews the literature on the relationship between the structural characteristics and organizational processes of hospitals and quality of care. The review uses Donabedian's structure-process-outcome and level of analysis frameworks to organize the literature. The results of this review indicate that a preponderance of studies are conducted at the hospital level of analysis and are predominantly focused on the organizational structure-quality outcome relationship. The article concludes with recommendations of how health services researchers can expand their research to enhance one's understanding of the relationship between organizational characteristics and quality of care.

  6. A systematic review of peer-supported interventions for health promotion and disease prevention.

    Science.gov (United States)

    Ramchand, Rajeev; Ahluwalia, Sangeeta C; Xenakis, Lea; Apaydin, Eric; Raaen, Laura; Grimm, Geoffrey

    2017-08-01

    Prior research has examined peer programs with respect to specific peer roles (e.g.; peer support) or specific health/wellness domains (e.g.; exercise/diet), or have aggregated effects across roles and domains. We sought to conduct a systematic review that categorizes and assesses the effects of peer interventions to promote health and wellness by peer role, intervention type, and outcomes. We use evidence mapping to visually catalog and synthesize the existing research. We searched PubMed and WorldCat databases (2005 to 2015) and New York Academy of Medicine Grey Literature Report (1999 to 2016) for English-language randomized control trials. We extracted study design, study participants, type of intervention(s), peer role(s), outcomes assessed and measures used, and effects from 116 randomized controlled trials. Maps were created to provide a visual display of the evidence by intervention type, peer role, outcome type, and significant vs null or negative effects. There are more null than positive effects across peer interventions, with notable exceptions: group-based interventions that use peers as educators or group facilitators commonly improve knowledge, attitudes, beliefs, and perceptions; peer educators also commonly improved social health/connectedness and engagement. Dyadic peer support influenced behavior change and peer counseling shows promising effects on physical health outcomes. Programs seeking to use peers in public health campaigns can use evidence maps to identify interventions that have previously demonstrated beneficial effects. Those seeking to produce health outcomes may benefit from identifying the mechanisms by which they expect their program to produce these effects and associated proximal outcomes for future evaluations. Although we attempted to register our protocol with PROSPERO, we did not meet eligibility criteria because we were past the data collection phase. The full PROSPERO-aligned protocol is available from the authors

  7. The learner as co-creator: A new peer review and self-assessment feedback form created by student nurses.

    Science.gov (United States)

    Duers, Lorraine E

    2017-11-01

    Engagement with peer review and self-assessment is not always regarded by student nurses as an activity that results in a positive learning experience. Literature indicates that withdrawal from the learning process becomes attractive to individuals affected by a negative experience of peer review. Literature also provides examples of student nurses' feeling 'torn to shreds' during the process of peer review, resulting in loss of confidence and self-esteem. An influencing factor in such situations appears to be the absence of specific learner-driven criteria against which student nurses can assess peer and self-performance. The idea was thus ignited, that creation and utilisation of a learner-driven feedback form might potentially prevent, or at least minimise, the possibility of negative peer review experience. Set within the context of a pre-registration nursing programme, within a Higher Education institution, student nurses (n=25), created a peer review/self-assessment feedback form. Its potential cross-discipline, global applicability is reasonably speculated. Purposive sampling, followed by Stratified Random sampling, maximised participant variation. Data collection took place on 34 occasions, utilising focus group discussions using Nominal Group Technique, a practical task which was video recorded for mediating artefact purposes, and individual interviews. Analysis was concept and theme driven. The study found that participants desired a new feedback form that specifically asks the evaluator to judge human qualities, such as 'compassion' and 'kindness', in addition to the skills and knowledge criteria that any peer review or self-assessment form used currently had incorporated. Providing the participants with the opportunity to develop criteria, against which performance could be measured, with emphasis being afforded to student inclusivity and resultant shift in power balance from the educator to the learner, embraces the idea of teaching and learning in the

  8. Grant Peer Review: Improving Inter-Rater Reliability with Training.

    Science.gov (United States)

    Sattler, David N; McKnight, Patrick E; Naney, Linda; Mathis, Randy

    2015-01-01

    This study developed and evaluated a brief training program for grant reviewers that aimed to increase inter-rater reliability, rating scale knowledge, and effort to read the grant review criteria. Enhancing reviewer training may improve the reliability and accuracy of research grant proposal scoring and funding recommendations. Seventy-five Public Health professors from U.S. research universities watched the training video we produced and assigned scores to the National Institutes of Health scoring criteria proposal summary descriptions. For both novice and experienced reviewers, the training video increased scoring accuracy (the percentage of scores that reflect the true rating scale values), inter-rater reliability, and the amount of time reading the review criteria compared to the no video condition. The increase in reliability for experienced reviewers is notable because it is commonly assumed that reviewers--especially those with experience--have good understanding of the grant review rating scale. The findings suggest that both experienced and novice reviewers who had not received the type of training developed in this study may not have appropriate understanding of the definitions and meaning for each value of the rating scale and that experienced reviewers may overestimate their knowledge of the rating scale. The results underscore the benefits of and need for specialized peer reviewer training.

  9. The gender gap in peer-reviewed publications by physical therapy faculty members: a productivity puzzle.

    Science.gov (United States)

    Kaufman, Regina R; Chevan, Julia

    2011-01-01

    Studies of peer-reviewed article publication by faculty in higher education show men publish more than women. Part of the difference in publishing appears to be attributable directly to gender. Gender differences in publishing productivity have not been explored in physical therapy. The purpose of this study was to explore effects of gender on peer-reviewed publication productivity in physical therapy. This was a cross-sectional study using survey methods. A survey was administered to a random sample of 881 physical therapy faculty members; 459 responses were used for analysis. Men were more likely than women to be married, have children, hold a PhD degree, be tenured or on a tenure track, and hold the position of department chair. There was a significant difference in peer-reviewed publication rates between male and female respondents. Negative binomial regression models revealed that female gender was a negative predictor of peer-reviewed publication, accounting for between 0.51 and 0.58 fewer articles per year for women than for men over the course of a career. Reasons for the gender differences are not clear. Factors such as grant funding, laboratory resources, nature of collaborative relationships, values for different elements of the teaching/research/service triad, and ability to negotiate the academic culture were not captured by our model. The gender gap in peer-reviewed publishing productivity may have implications for individuals and the profession of physical therapy and should be subject to further exploration.

  10. 76 FR 4113 - Independent Scientific Peer Review Panel Meeting on an In Vitro

    Science.gov (United States)

    2011-01-24

    ... antagonist activity. These studies were funded primarily by a Small Business Innovation Research (SBIR) grant... Vitro Estrogen Receptor Transcriptional Activation Test Method for Endocrine Disruptor Chemical... Toxicological Methods (NICEATM); Announcement of an Independent Scientific Peer Review Panel Meeting on an In...

  11. Where is the trust in the peer review dynamic?

    Science.gov (United States)

    Ucko, Daniel

    The motto of the Royal Society is ``nullius in verba'', which translates roughly as ``take nobody's word for it'', and this motto is furthermore emblematic of the conduct of science. We want facts and not opinions, verified results and not conjecture. From the time that we first started communicating scientific results, it has been recognized that scientific claims must be verified by someone who is not the maker of those claims, and who furthermore has no stake in the matter, in other words, a claim needs to be evaluated objectively. Peer review as a method of evaluation can be thought of as akin to an experiment, where the review process tests the hypothesis of a submitted paper. Peer review is however also a social process with human actors: authors, referees, and editors. As a process, peer review depends on trust, but in what way does that manifest? There are many agents in peer review: in addition to the human actors, there is also the institution that is the journal, as well as the publisher (e.g. APS) that stands behind the journal. People can also have trust in the very concept of peer review. If we accept as a proposition that publications are witnesses to science in the same way that people who attend scientific demonstrations are witnesses of an experiment, then how much do we trust this witness? A few further questions arise: If referees (and sometimes authors) are anonymous, what does this do to the mechanisms of trust? Is trust only possible between human agents, or can you trust a process or a journal in a similar way to trusting a certain car brand? Is an absence of trust the same as distrust? Is trust rational, or cognitive, or is it a practice? In this paper I will attempt to locate the trust and ask how trust is earned, and, conversely, how it can be lost, using peer review as example. I have a joint affiliation with Stony Brook University and APS and would like both listed, in that order, in the abstract.

  12. Teacher Peer Assistance and Review: A Practical Guide for Teachers and Administrators.

    Science.gov (United States)

    Anderson, Lorin W.; Pellicer, Leonard O.

    This book provides educators and administrators with the knowledge and skills needed to engage in peer assistance and review within the context of teacher evaluation, describing how to develop and implement an effective teacher peer assistance and review program. The book offers the following: components of successful peer assistance and review…

  13. How operational issues impact science peer review

    Science.gov (United States)

    Blacker, Brett S.; Golombek, Daniel; Macchetto, Duccio

    2006-06-01

    In some eyes, the Phase I proposal selection process is the most important activity handled by the Space Telescope Science Institute (STScI). Proposing for HST and other missions consists of requesting observing time and/or archival research funding. This step is called Phase I, where the scientific merit of a proposal is considered by a community based peer-review process. Accepted proposals then proceed thru Phase II, where the observations are specified in sufficient detail to enable scheduling on the telescope. Each cycle the Hubble Space Telescope (HST) Telescope Allocation Committee (TAC) reviews proposals and awards observing time that is valued at $0.5B, when the total expenditures for HST over its lifetime are figured on an annual basis. This is in fact a very important endeavor that we continue to fine-tune and tweak. This process is open to the science community and we constantly receive comments and praise for this process. In this last year we have had to deal with the loss of the Space Telescope Imaging Spectrograph (STIS) and move from 3-gyro operations to 2-gyro operations. This paper will outline how operational issues impact the HST science peer review process. We will discuss the process that was used to recover from the loss of the STIS instrument and how we dealt with the loss of 1/3 of the current science observations. We will also discuss the issues relating to 3-gyro vs. 2-gyro operations and how that changes impacted Proposers, our in-house processing and the TAC.

  14. From abstract to peer-reviewed publication: country matters

    DEFF Research Database (Denmark)

    Fosbol, E.; Fosbøl, Philip Loldrup; Eapen, Z. J.

    2013-01-01

    within 2 years of the conference. Less is known about the relative difference between countries in regards to likelihood of publication. Methods: Using a validated automated computer algorithm, we searched the ISI Web of Science to identify peer-reviewed publications of abstracts presented at the AHA...... observed a significant variation among countries in terms of odds of subsequent publication (Figure). Conclusions: Our results show that conversion of science from an abstract into a peer-reviewed publication varies significantly by country. Local national initiatives should be deployed in order to break...

  15. Perceptions of Peer Review Using Cloud-Based Software

    Science.gov (United States)

    Andrichuk, Gjoa

    2016-01-01

    This study looks at the change in perception regarding the effect of peer feedback on writing skills using cloud-based software. Pre- and post-surveys were given. The students peer reviewed drafts of five sections of scientific reports using Google Docs. While students reported that they did not perceive their writing ability improved by being…

  16. 76 FR 67439 - External Peer Review Meeting for Draft Microbial Risk Assessment Guideline: Pathogenic...

    Science.gov (United States)

    2011-11-01

    ... ENVIRONMENTAL PROTECTION AGENCY [EPA-HQ-ORD-2011-053; FRL-9485-1] External Peer Review Meeting for... review draft does not represent EPA policy. The public may register to attend this peer review meeting as... to consider the comments from the external peer review meeting, along with public comments received...

  17. A Case Study of Peer Review Practices of Four Adolescent English Language Learners in Face-to-Face and Online Contexts

    Science.gov (United States)

    Vorobel, Oksana

    2013-01-01

    Peer review is a complex collaborative activity, which may engage English language learners in reading, writing, listening, and speaking and carry many potential benefits for their language learning (Hu, 2005). While many research studies focused on peer review practices of adult language learners in academic settings in the USA or abroad in…

  18. Ambiguity, logic, simplicity, and dynamics: Wittgensteinian evaluative criteria in peer review of quantitative research on categorization.

    Science.gov (United States)

    Shimp, Charles P

    2004-06-30

    Research on categorization has changed over time, and some of these changes resemble how Wittgenstein's views changed from his Tractatus Logico-Philosophicus to his Philosophical Investigations. Wittgenstein initially focused on unambiguous, abstract, parsimonious, logical propositions and rules, and on independent, static, "atomic facts." This approach subsequently influenced the development of logical positivism and thereby may have indirectly influenced method and theory in research on categorization: much animal research on categorization has focused on learning simple, static, logical rules unambiguously interrelating small numbers of independent features. He later rejected logical simplicity and rigor and focused instead on Gestalt ideas about figure-ground reversals and context, the ambiguity of family resemblance, and the function of details of everyday language. Contemporary contextualism has been influenced by this latter position, some features of which appear in contemporary empirical research on categorization. These developmental changes are illustrated by research on avian local and global levels of visual perceptual analysis, categorization of rectangles and moving objects, and artificial grammar learning. Implications are described for peer review of quantitative theory in which ambiguity, logical rigor, simplicity, or dynamics are designed to play important roles.

  19. Sealed source peer review plan

    International Nuclear Information System (INIS)

    Feldman, Alexander; Leonard, Lee; Burns, Ron

    2009-01-01

    Sealed sources are known quantities of radioactive materials that have been encapsulated in quantities that produce known radiation fields. Sealed sources have multiple uses ranging from instrument calibration sources to sources that produce radiation fields for experimental applications. The Off-Site Source Recovery (OSR) Project at Los Alamos National Laboratory (LANL), created in 1999, under the direction of the Waste Management Division of the U.S. Department of Energy (DOE) Albuquerque has been assigned the responsibility to recover and manage excess and unwanted radioactive sealed sources from the public and private sector. LANL intends to ship drums containing qualified sealed sources to the Waste Isolation Pilot Plant (WIPP) for disposal. Prior to shipping, these drums must be characterized with respect to radiological content and other parameters. The U. S. Environmental Protection Agency (EPA) requires that ten radionulcides be quantified and reported for every container of waste to be disposed in the WIPP. The methods traditionally approved by the EPA include non-destructive assay (NDA) in accordance with Appendix A of the Contact-Handled Transuranic Waste Acceptance Criteria for the Waste Isolation Pilot Plant (DOE, 2002) (CH WAC). However, because of the nature and pedigree of historical records for sealed sources and the technical infeasibility of performing NDA on these sources, LANL proposes to characterize the content of these waste drums using qualified existing radiological data in lieu of direct measurement. This plan describes the process and documentation requirements for the use of the peer review process to qualify existing data for sealed radiological sources in lieu of perfonning radioassay. The peer review process will be performed in accordance with criteria provided in 40 CFR (section) 194.22 which specifies the use of the NUREG 1297 guidelines. The plan defines the management approach, resources, schedule, and technical requirements

  20. A Reciprocal Peer Review System to Support College Students' Writing

    Science.gov (United States)

    Yang, Yu-Fen

    2011-01-01

    As students' problem-solving processes in writing are rarely observed in face-to-face instruction, they have few opportunities to participate collaboratively in peer review to improve their texts. This study reports the design of a reciprocal peer review system for students to observe and learn from each other when writing. A sample of 95…