The evaluation of complex interventions in palliative care: an exploration of the potential of case study research strategies.

Science.gov (United States)

Walshe, Catherine

2011-12-01

Complex, incrementally changing, context dependent and variable palliative care services are difficult to evaluate. Case study research strategies may have potential to contribute to evaluating such complex interventions, and to develop this field of evaluation research. This paper explores definitions of case study (as a unit of study, a process, and a product) and examines the features of case study research strategies which are thought to confer benefits for the evaluation of complex interventions in palliative care settings. Ten features of case study that are thought to be beneficial in evaluating complex interventions in palliative care are discussed, drawing from exemplars of research in this field. Important features are related to a longitudinal approach, triangulation, purposive instance selection, comprehensive approach, multiple data sources, flexibility, concurrent data collection and analysis, search for proving-disproving evidence, pattern matching techniques and an engaging narrative. The limitations of case study approaches are discussed including the potential for subjectivity and their complex, time consuming and potentially expensive nature. Case study research strategies have great potential in evaluating complex interventions in palliative care settings. Three key features need to be exploited to develop this field: case selection, longitudinal designs, and the use of rival hypotheses. In particular, case study should be used in situations where there is interplay and interdependency between the intervention and its context, such that it is difficult to define or find relevant comparisons.

The evolution of an evaluation: a case study using the tribal participatory research model.

Science.gov (United States)

Richmond, Lucinda S; Peterson, Donna J; Betts, Sherry C

2008-10-01

This article presents a case study of how the evaluation design for a dating violence prevention and/or youth development program for American Indian youth in Arizona evolved throughout the project. Particular attention is given to how the evaluation design was guided by the tribal participatory research model. A brief rationale for the project is presented along with literature on culturally competent evaluation and research with American Indians. A description of the project and the unique communities in which it was implemented is provided. The focus of the article is the process of how the evaluation plan changed and how various factors influenced this process (e.g., feedback from community stakeholders, conversations with funder, results of process evaluation, suggestions from literature, the authors' experience working in American Indian communities). The authors conclude with lessons learned for others to consider as they develop working relationships and evaluation plans in similar communities.

Learning Evaluation: blending quality improvement and implementation research methods to study healthcare innovations.

Science.gov (United States)

Balasubramanian, Bijal A; Cohen, Deborah J; Davis, Melinda M; Gunn, Rose; Dickinson, L Miriam; Miller, William L; Crabtree, Benjamin F; Stange, Kurt C

2015-03-10

In healthcare change interventions, on-the-ground learning about the implementation process is often lost because of a primary focus on outcome improvements. This paper describes the Learning Evaluation, a methodological approach that blends quality improvement and implementation research methods to study healthcare innovations. Learning Evaluation is an approach to multi-organization assessment. Qualitative and quantitative data are collected to conduct real-time assessment of implementation processes while also assessing changes in context, facilitating quality improvement using run charts and audit and feedback, and generating transportable lessons. Five principles are the foundation of this approach: (1) gather data to describe changes made by healthcare organizations and how changes are implemented; (2) collect process and outcome data relevant to healthcare organizations and to the research team; (3) assess multi-level contextual factors that affect implementation, process, outcome, and transportability; (4) assist healthcare organizations in using data for continuous quality improvement; and (5) operationalize common measurement strategies to generate transportable results. Learning Evaluation principles are applied across organizations by the following: (1) establishing a detailed understanding of the baseline implementation plan; (2) identifying target populations and tracking relevant process measures; (3) collecting and analyzing real-time quantitative and qualitative data on important contextual factors; (4) synthesizing data and emerging findings and sharing with stakeholders on an ongoing basis; and (5) harmonizing and fostering learning from process and outcome data. Application to a multi-site program focused on primary care and behavioral health integration shows the feasibility and utility of Learning Evaluation for generating real-time insights into evolving implementation processes. Learning Evaluation generates systematic and rigorous cross

Organising, Providing and Evaluating Technical Training for Early Career Researchers: A Case Study

Science.gov (United States)

van Besouw, Rachel M.; Rogers, Katrine S.; Powles, Christopher J.; Papadopoulos, Timos; Ku, Emery M.

2013-01-01

This paper considers the importance of providing technical training opportunities for Early Career Researchers (ECRs) worldwide through the case study of a MATLAB training programme, which was proposed, organised, managed and evaluated by a team of five ECRs at the University of Southampton. The effectiveness of the programme in terms of the…

Evaluating Translational Research: A Process Marker Model

Science.gov (United States)

Trochim, William; Kane, Cathleen; Graham, Mark J.; Pincus, Harold A.

2011-01-01

Abstract Objective: We examine the concept of translational research from the perspective of evaluators charged with assessing translational efforts. One of the major tasks for evaluators involved in translational research is to help assess efforts that aim to reduce the time it takes to move research to practice and health impacts. Another is to assess efforts that are intended to increase the rate and volume of translation. Methods: We offer an alternative to the dominant contemporary tendency to define translational research in terms of a series of discrete “phases.”Results: We contend that this phased approach has been confusing and that it is insufficient as a basis for evaluation. Instead, we argue for the identification of key operational and measurable markers along a generalized process pathway from research to practice. Conclusions: This model provides a foundation for the evaluation of interventions designed to improve translational research and the integration of these findings into a field of translational studies. Clin Trans Sci 2011; Volume 4: 153–162 PMID:21707944

Bibliometrics and research evaluation uses and abuses

CERN Document Server

Gingras, Yves

2016-01-01

The research evaluation market is booming. "Ranking," "metrics," "h-index," and "impact factors" are reigning buzzwords. Government and research administrators want to evaluate everything -- teachers, professors, training programs, universities -- using quantitative indicators. Among the tools used to measure "research excellence," bibliometrics -- aggregate data on publications and citations -- has become dominant. Bibliometrics is hailed as an "objective" measure of research quality, a quantitative measure more useful than "subjective" and intuitive evaluation methods such as peer review that have been used since scientific papers were first published in the seventeenth century. In this book, Yves Gingras offers a spirited argument against an unquestioning reliance on bibliometrics as an indicator of research quality. Gingras shows that bibliometric rankings have no real scientific validity, rarely measuring what they pretend to. Although the study of publication and citation patterns, at the proper scales...

Evaluating Prior Scholarship in Literature Reviews of Research Articles: A Comparative Study of Practices in Two Research Paradigms

Science.gov (United States)

Kwan, Becky S. C.; Chan, Hang; Lam, Colin

2012-01-01

Evaluations of prior scholarship play a crucial role in the literature review (LR) of a research article by showing how the boundary of an area of inquiry can be further advanced by the writer's work. Yet, many inexperienced writers find evaluating others' work a major challenge. Although the task has received some attention in research and…

Phenomenological study on crystalline rock for evaluating of long-term behavior (Contract research)

International Nuclear Information System (INIS)

Okubo, Seisuke; Seno, Yasuhiro; Hirano, Toru; Matsui, Hiroya; Nakama, Shigeo

2008-08-01

The Japan Atomic Energy Agency (JAEA) is conducting the Mizunami Underground Research Laboratory (MIU) Project in order to develop comprehensive geological investigation and engineering techniques for deep underground applications (e.g. repository of HLW). The purpose of this study is to contribute to the evaluation of the mechanical stability of a research drift and to plan the future studies. Rock shows time-dependent behavior such as creep/relaxation. For the shaft and gallery of the geological disposal for the radioactive waste, the mechanical stability over a period of thousands of years is demanded not only during construction and operation but also after back-filling. So, to understand the time-dependent behavior of rock is very important for evaluating the long-term mechanical stability. This study is aiming to find out the mechanism of time-dependent behavior of rock such as creep by the precision test, observation and measurement, to develop the evaluating method of long-term behavior of rock mass, and to get the information for planning the study of the Phase III (Operation Phase) at the Mizunami URL. In the previous work conducted before this fiscal year 2007, we improved the testing technique and started test of Toki granite sampled from target site. Furthermore we studied the in-situ measurement method for evaluating the scatter of rock properties. This report describes the results of the works in the fiscal year 2007. In Chapter 1, we described the overview and background of this study. In Chapter 2, the result of continuing creep test of Tage tuff which was started from the fiscal year 1997 was described. Although there was some annual variability, the precious data were obtained. In Chapter 3, the control program for the generalized relaxation test was developed. The generalized relaxation test of Toki granite was conducted in order to get basically data. In Chapter 4, the extended constitutive equation of variable compliance was analytically

The impact of consumer involvement in research: an evaluation of consumer involvement in the London Primary Care Studies Programme.

Science.gov (United States)

Wyatt, Katrina; Carter, Mary; Mahtani, Vinita; Barnard, Angela; Hawton, Annie; Britten, Nicky

2008-06-01

The value of consumer involvement in health services research is widely recognized. While there is a growing body of evidence about the principles of good consumer involvement, there is little research about the effect that involvement can have on the research. This evaluation assessed the level and impact of consumer involvement in the London Primary Care Studies Programme (LPCSP), all of whose individual projects had to demonstrate substantial involvement as a condition of funding. To evaluate consumer involvement in the LPSCP and understand what impact consumers had on the research process and outcomes. A multi-method case study approach was undertaken, using survey techniques, interviews, focus groups, observation and scrutiny of written documents. The overall data set comprised 61 questionnaires, 44 semi-structured interviews, 2 focus groups and 15 hours of observation of meetings. Eleven primary care-based research projects which together made up the LPCSP. An in-depth description of consumer involvement in the Programme was produced. Nine projects had consumers as co-applicants, four projects had been completed before the evaluation began and one was still ongoing at the time of the evaluation. Of the eight projects which have produced final reports, all met their aims and objectives. Consumers had had an additional impact in the research, in the initial design of the study, in recruitment of the research subjects, in developing data collection tools, in collecting the data, in analysis and disseminating the findings. Consumer involvement in National Health Service research is a relatively recent policy development and while there is an increasing amount of literature about how and why consumers should be involved in research, there is less evidence about the impact of such involvement. This evaluation provides evidence about the impact that consumers have not only on the research process but also on the outcomes of the research.

A Disability and Health Institutional Research Capacity Building and Infrastructure Model Evaluation: A Tribal College-Based Case Study

Science.gov (United States)

Moore, Corey L.; Manyibe, Edward O.; Sanders, Perry; Aref, Fariborz; Washington, Andre L.; Robertson, Cherjuan Y.

2017-01-01

Purpose: The purpose of this multimethod study was to evaluate the institutional research capacity building and infrastructure model (IRCBIM), an emerging innovative and integrated approach designed to build, strengthen, and sustain adequate disability and health research capacity (i.e., research infrastructure and investigators' research skills)…

[Evaluation of arguments in research reports].

Science.gov (United States)

Botes, A

1999-06-01

Some authors on research methodology are of opinion that research reports are based on the logic of reasoning and that such reports communicate with the reader by presenting logical, coherent arguments (Böhme, 1975:206; Mouton, 1996:69). This view implies that researchers draw specific conclusions and that such conclusions are justified by way of reasoning (Doppelt, 1998:105; Giere, 1984:26; Harre, 1965:11; Leherer & Wagner, 1983 & Pitt, 1988:7). The structure of a research report thus consists mainly of conclusions and reasons for such conclusions (Booth, Colomb & Williams, 1995:97). From this it appears that justification by means of reasoning is a standard procedure in research and research reports. Despite the fact that the logic of research is based on reasoning, that the justification of research findings by way of reasoning appears to be standard procedure and that the structure of a research report comprises arguments, the evaluation or assessment of research, as described in most textbooks on research methodology (Burns & Grove, 1993:647; Creswell, 1994:193; LoBiondo-Wood & Haber, 1994:441/481) does not focus on the arguments of research. The evaluation criteria for research reports which are set in these textbooks are related to the way in which the research process is carried out and focus on the measures for internal, external, theoretical, measurement and inferential validity. This means that criteria for the evaluation of research are comprehensive and they should be very specific in respect of each type of research (for example quantitative or qualitative). When the evaluation of research reports is focused on arguments and logic, there could probably be one set of universal standards against which all types of human science research reports can be assessed. Such a universal set of standards could possibly simplify the evaluation of research reports in the human sciences since they can be used to assess all the critical aspects of research reports

Citation analysis in research evaluation

CERN Document Server

Moed, Henk F

2005-01-01

This book is written for members of the scholarly research community, and for persons involved in research evaluation and research policy. More specifically, it is directed towards the following four main groups of readers: - All scientists and scholars who have been or will be subjected to a quantitative assessment of research performance using citation analysis. - Research policy makers and managers who wish to become conversant with the basic features of citation analysis, and about its potentialities and limitations. - Members of peer review committees and other evaluators, who consider th

Health services research evaluation principles. Broadening a general framework for evaluating health information technology.

Science.gov (United States)

Sockolow, P S; Crawford, P R; Lehmann, H P

2012-01-01

Our forthcoming national experiment in increased health information technology (HIT) adoption funded by the American Recovery and Reinvestment Act of 2009 will require a comprehensive approach to evaluating HIT. The quality of evaluation studies of HIT to date reveals a need for broader evaluation frameworks that limits the generalizability of findings and the depth of lessons learned. Develop an informatics evaluation framework for health information technology (HIT) integrating components of health services research (HSR) evaluation and informatics evaluation to address identified shortcomings in available HIT evaluation frameworks. A systematic literature review updated and expanded the exhaustive review by Ammenwerth and deKeizer (AdK). From retained studies, criteria were elicited and organized into classes within a framework. The resulting Health Information Technology Research-based Evaluation Framework (HITREF) was used to guide clinician satisfaction survey construction, multi-dimensional analysis of data, and interpretation of findings in an evaluation of a vanguard community health care EHR. The updated review identified 128 electronic health record (EHR) evaluation studies and seven evaluation criteria not in AdK: EHR Selection/Development/Training; Patient Privacy Concerns; Unintended Consequences/ Benefits; Functionality; Patient Satisfaction with EHR; Barriers/Facilitators to Adoption; and Patient Satisfaction with Care. HITREF was used productively and was a complete evaluation framework which included all themes that emerged. We can recommend to future EHR evaluators that they consider adding a complete, research-based HIT evaluation framework, such as HITREF, to their evaluation tools suite to monitor HIT challenges as the federal government strives to increase HIT adoption.

Norwegian climate research. An evaluation

Energy Technology Data Exchange (ETDEWEB)

NONE

2012-06-15

[English] In early 2011, the Norwegian Research Council (RCN) appointed a committee to review Norwegian climate research. The aim of the evaluation was to provide a critical review of Norwegian climate research in an international perspective and to recommend measures to enhance the quality, efficiency and relevance of future climate research. The Evaluation Committee met three times: in August and December 2011, and March 2012. RCN sent an invitation to 140 research organisations to participate by delivering background information on their climate research. Based on the initial response, 48 research units were invited to submit self-assessments and 37 research units responded. These were invited to hearings during the second meeting of the Evaluation Committee in December. In our judgement, a great majority of the most active research units are covered by this evaluation report. It should be emphasised that the evaluation concerned the Norwegian landscape of climate research rather than individual scientists or research units. Bibliometric analyses and social network analyses provided additional information. We are aware of problems in making comparisons across disciplinary publishing traditions, especially with regard to the differences between the natural and social sciences and the humanities. The Evaluation Committee also reviewed a number of governmental and RCN policy documents and conducted interviews with the chairs of the NORKLIMA Programme Steering Board and the Norwegian IPY Committee, as well as with staff members of RCN. Additional information was received from hearings organised by RCN with the science communities and various stakeholders in January 2012. For the purpose of this evaluation, climate research was divided into three broad thematic areas: 1. The climate system and climate change: research on climate variability and change in order to improve our capability of understanding climate and of projecting climate change for different time

Research on Livable Community Evaluation Based on GIS

Science.gov (United States)

Yin, Zhangcai; Wu, Yang; Jin, Zhanghaonan; Zhang, Xu

2018-01-01

Community is the basic unit of the city. Research on livable community could provide a bottom-up research path for the realization of livable city. Livability is the total factor affecting the quality of community life. In this paper, livable community evaluation indexes are evaluated based on GIS and fuzzy comprehensive evaluation method. Then the sum-index and sub-index of community livability are both calculated. And community livable evaluation index system is constructed based on the platform of GIS. This study provides theoretical support for the construction and management of livable communities, so as to guide the development and optimization of city.

Study on crystalline rock for evaluating method of long-term behavior. FY2012 (Contract research)

International Nuclear Information System (INIS)

Fukui, Katsunori; Hashiba, Kimihiro; Tanno, Takeo; Hikima, Ryoichi; Sanada, Hiroyuki; Sato, Toshinori

2013-12-01

Rock shows time-dependent behavior such as creep/relaxation. With respect to high-level radioactive waste disposal, knowledge of the long-term mechanical stability of shafts and galleries excavated in rock are required, over a period of thousands of years after closure as well as during construction and operation. Therefore, it is very important to understand the time-dependent behavior of rock for evaluating long-term mechanical stability. The purpose of this study is to determine the mechanisms of time-dependent behavior of rock by the precise test (e.g. laboratory creep test), observation and measurement and to develop methods for evaluating long-term mechanical stability. In previous works, testing techniques were established and basic evaluation methods were developed. Recently, some parameters, which required for simulation of time-dependent behavior, were determined for the modeling of biotite granite (Toki granite) distributed around the Mizunami underground research laboratory. However, we were not able to obtain enough data to assess the reliability of the method to evaluate these parameters. This report describes the results of the research activities carried out in fiscal year 2012. In Chapter 1, we provide background and an overview of this study. In Chapter 2, the results of a long-term creep test on Tage tuff, started in fiscal year 1997, are described. In Chapter 3, the experimental results concerning the loading-rate dependency of rock strength were examined to understand the time-dependent behavior of rock. In Chapter 4, the stability of tunnels, under conditions which rock stress is larger than that around a circular tunnel, were examined to obtain useful information on the future plan for in-situ tests in the underground research laboratory. (author)

Evaluative studies in nuclear medicine research: positron computed tomography assessment. Final report, January 1, 1982-December 31, 1982

International Nuclear Information System (INIS)

Potchen, E.J.; Harris, G.I.; Gift, D.A.; Reinhard, D.K.; Siebert, J.E.

1983-02-01

Results are reported of the final phase of the study effort generally titled Evaluative Studies in Nuclear Medicine Research. The previous work is reviewed and extended to an assessment providing perspectives on medical applications of positron emission tomographic (PET) systems, their technological context, and the related economic and marketing environment. Methodologies developed and used in earlier phases of the study were continued, but specifically extended to include solicitation of opinion from commercial organizations deemed to be potential developers, manufacturers and marketers of PET systems. Several factors which influence the demand for clinical uses of PET are evaluated and discussed. The recent Federal funding of applied research with PET systems is found to be a necessary and encouraging event toward a determination that PET either is a powerful research tool limited to research, or whether it also presents major clinical utility. A comprehensive, updated bibliography of current literature related to the development, applications and economic considerations of PET technology is appended

Health systems research training enhances workplace research skills: a qualitative evaluation.

Science.gov (United States)

Adams, Jolene; Schaffer, Angela; Lewin, Simon; Zwarenstein, Merrick; van der Walt, Hester

2003-01-01

In-service education is a widely used means of enhancing the skills of health service providers, for example, in undertaking research. However, the transfer of skills acquired during an education course to the workplace is seldom evaluated. The objectives of this study were to assess learner, teacher, and health service manager perceptions of the usefulness, in the work setting, of skills taught on a health systems research education course in South Africa and to assess the extent to which the course stimulated awareness and development of health systems research in the work setting. The education course was evaluated using a qualitative approach. Respondents were selected for interview using purposive sampling. Interviews were conducted with 39 respondents, including all of the major stakeholders. The interviews lasted between 20 and 60 minutes and were conducted either face to face or over the telephone. Thematic analysis was applied to the data, and key themes were identified. The course demystified health systems research and stimulated interest in reading and applying research findings. The course also changed participants' attitudes to routine data collection and was reported to have facilitated the application of informal research or problem-solving methods to everyday work situations. However, inadequate support within the workplace was a significant obstacle to applying the skills learned. A 2-week intensive, experiential course in health systems research methods can provide a mechanism for introducing basic research skills to a wide range of learners. Qualitative evaluation is a useful approach for assessing the impacts of education courses.

Quality and Research Evaluation in Organizations

DEFF Research Database (Denmark)

Hansson, Finn

A central issue in science policy today is the changing role and function ofresearch evaluation. How is quality selected, has local organizational traditionsand managerial practices influence on the research evaluation? Who isperceived as peers or evaluators by the researchers and by managers...

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Health Research Governance: Introduction of a New Web-based Research Evaluation Model in Iran: One-decade Experience

Science.gov (United States)

MALEKZADEH, Reza; AKHONDZADEH, Shahin; EBADIFAR, Asghar; BARADARAN EFTEKHARI, Monir; OWLIA, Parviz; GHANEI, Mostafa; FALAHAT, Katayoun; HABIBI, Elham; SOBHANI, Zahra; DJALALINIA, Shirin; PAYKARI, Niloofar; MOJARRAB, Shahnaz; ELTEMASI, Masoumeh; LAALI, Reza

2016-01-01

Background: Governance is one of the main functions of Health Research System (HRS) that consist of four essential elements such as setting up evaluation system. The goal of this study was to introduce a new web based research evaluation model in Iran. Methods: Based on main elements of governance, research indicators have been clarified and with cooperation of technical team, appropriate software was designed. Three main steps in this study consist of developing of mission-oriented program, creating enabling environment and set up Iran Research Medical Portal as a center for research evaluation. Results: Fifty-two universities of medical sciences in three types have been participated. After training the evaluation focal points in all of medical universities, access to data entry and uploading all of documents were provided. Regarding to mission – based program, the contribution of medical universities in knowledge production was 60% for type one, 31% for type two and 9% for type three. The research priorities based on Essential National Health Research (ENHR) approach and mosaic model were gathered from universities of medical sciences and aggregated to nine main areas as national health research priorities. Ethical committees were established in all of medical universities. Conclusion: Web based research evaluation model is a comprehensive and integrated system for data collection in research. This system is appropriate tool to national health research ranking. PMID:27957437

Research Quality Plus (RQ+) A Holistic Approach to Evaluating Research

Energy Technology Data Exchange (ETDEWEB)

McLean, R.K.D.; Feinstein, O.N.

2016-07-01

The International Development Research Centre (IDRC) strives to fund excellence in research - defining excellence as, {sup m}ethodologically sound, evidence-based, and scientifically robust{sup .} But how is the concept of excellence identified and evaluated across the diverse range of research the IDRC supports? The Research Quality Plus (RQ+) Assessment Framework was developed in order to address these complex issues. It provides a systems-informed approach to defining and evaluating the quality of research, and its positioning for use and impact. It allows tailoring to context, values, mandate and purpose, and can support planning, management and learning processes at any stage in the lifetime of a research project, program or grants portfolio. This paper presents: 1) the rationale for RQ+ creation, 2) the RQ+ Assessment Framework, and how it can be adapted and used, 3) our early experiences applying it in a series of extenal evaluations of research quality. The paper is presented by an RQ+ designer and an external user. (Author)

Evaluation of strategic research programs: The case of Danish environmental research 1993-2002

DEFF Research Database (Denmark)

Ingwersen, Peter Emil Rerup; Larsen, Birger

2007-01-01

The article reports on the mid-term and final scientometric evaluations of the Danish Strategic Environmental Research Program (SMP), which consisted of 13 virtual research centers from 1993 to 1997, nine of which are studied bibliometrically here. Citations are measured from 1993 to 2002. Central...

Development of a research evaluation protocol for NSD research portfolios

International Nuclear Information System (INIS)

Gould, J.

1999-01-01

This report is concerned with developing and describing a research evaluation protocol for use by the Nuclear Safety Directorate (NSD), in evaluating their various programmes of research; or aspects of those programmes. The Health and Safety Executive (HSE) has been involved with research evaluation for some considerable time and NSD, as part of HSE, wishes to develop a protocol which, while it meets their needs, is also fully compatible with other HSE approaches. It is intended that the methodology developed by this project will be used for evaluation of the Probabilistic Safety Assessment Portfolio (as a separate project). The usefulness of the methodology will be reviewed in the light of this experience

Outlining an analytical framework for mapping research evaluation landscapes

Energy Technology Data Exchange (ETDEWEB)

Åström, F.

2016-07-01

This paper suggests an infrastructure perspective, as suggested by Star and Bowker (2006), as an analytical framework for studying the research evaluation landscape. An infrastructure is suggested to be understood, not as a concrete technology, but as a system of contextual factors including ‘Actors/Stakeholders’, ‘Technical systems’, and ‘Evaluation practices’. How the framework can be operationationalized is exemplified by examples from previous and ongoing research, as well as by identify gaps in current research. (Author)

Performance Evaluation Tests for Environmental Research (PETER): evaluation of 114 measures

Science.gov (United States)

Bittner, A. C. Jr; Carter, R. C.; Kennedy, R. S.; Harbeson, M. M.; Krause, M.

1986-01-01

The goal of the Performance Evaluation Tests for Environmental Research (PETER) Program was to identify a set of measures of human capabilities for use in the study of environmental and other time-course effects. 114 measures studied in the PETER Program were evaluated and categorized into four groups based upon task stability and task definition. The Recommended category contained 30 measures that clearly obtained total stabilization and had an acceptable level of reliability efficiency. The Acceptable-But-Redundant category contained 15 measures. The 37 measures in the Marginal category, which included an inordinate number of slope and other derived measures, usually had desirable features which were outweighed by faults. The 32 measures in the Unacceptable category had either differential instability or weak reliability efficiency. It is our opinion that the 30 measures in the Recommended category should be given first consideration for environmental research applications. Further, it is recommended that information pertaining to preexperimental practice requirements and stabilized reliabilities should be utilized in repeated-measures environmental studies.

African Primary Care Research: Performing a programme evaluation

OpenAIRE

Dudley, Lilian

2014-01-01

Abstract This article is part of a series on Primary Care Research in the African context and focuses on programme evaluation. Different types of programme evaluation are outlined: developmental, process, outcome and impact. Eight steps to follow in designing your programme evaluation are then described in some detail: engage stakeholders; establish what is known; describe the programme; define the evaluation and select a study design; define the indicators; plan and manage data collection an...

Functional Capacity Evaluation Research : Report from the Third International Functional Capacity Evaluation Research Meeting

NARCIS (Netherlands)

James, C. L.; Reneman, M. F.; Gross, D. P.

Introduction Functional capacity evaluations are an important component of many occupational rehabilitation programs and can play a role in facilitating reintegration to work thus improving health and disability outcomes. The field of functional capacity evaluation (FCE) research has continued to

The Focus of Current HCI Research in Usability Evaluation and Feedback

DEFF Research Database (Denmark)

Høegh, Rune Thaarup

2007-01-01

This paper presents the findings from a systematic literature study of the research on usability evaluation and feedback. The literature study covers the papers published from five key human-computer interaction journals for a period of four years, and depicts the most current research within...... the field with regard to usability evaluation and feedback....

Designing, Teaching, and Evaluating Two Complementary Mixed Methods Research Courses

Science.gov (United States)

Christ, Thomas W.

2009-01-01

Teaching mixed methods research is difficult. This longitudinal explanatory study examined how two classes were designed, taught, and evaluated. Curriculum, Research, and Teaching (EDCS-606) and Mixed Methods Research (EDCS-780) used a research proposal generation process to highlight the importance of the purpose, research question and…

Research and Evaluation in Medical Education

Science.gov (United States)

Ferris, Helena A.; Collins, Mary E.

2015-01-01

The landscape of medical education is continuously evolving, as are the needs of the learner. The appropriate use of research and evaluation is key when assessing the need for change and instituting one's innovative endeavours. This paper demonstrates how research seeks to generate new knowledge, whereas evaluation uses information acquired from…

Commentary: Writing and Evaluating Qualitative Research Reports

Science.gov (United States)

Thompson, Deborah; Aroian, Karen J.; McQuaid, Elizabeth L.; Deatrick, Janet A.

2016-01-01

Objective To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. Methods A question and answer format is used to address considerations for writing and evaluating qualitative research. Results and Conclusions When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field’s ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. PMID:27118271

Health Systems Research Training Enhances Workplace Research Skills: A Qualitative Evaluation

Science.gov (United States)

Adams, Jolene; Schaffer, Angela; Lewin, Simon; Zwarenstein, Merrick; van der Walt, Hester

2003-01-01

Introduction: In-service education is a widely used means of enhancing the skills of health service providers, for example, in undertaking research. However, the transfer of skills acquired during an education course to the workplace is seldom evaluated. The objectives of this study were to assess learner, teacher, and health service manager…

Research evaluation support services in biomedical libraries.

Science.gov (United States)

Gutzman, Karen Elizabeth; Bales, Michael E; Belter, Christopher W; Chambers, Thane; Chan, Liza; Holmes, Kristi L; Lu, Ya-Ling; Palmer, Lisa A; Reznik-Zellen, Rebecca C; Sarli, Cathy C; Suiter, Amy M; Wheeler, Terrie R

2018-01-01

The paper provides a review of current practices related to evaluation support services reported by seven biomedical and research libraries. A group of seven libraries from the United States and Canada described their experiences with establishing evaluation support services at their libraries. A questionnaire was distributed among the libraries to elicit information as to program development, service and staffing models, campus partnerships, training, products such as tools and reports, and resources used for evaluation support services. The libraries also reported interesting projects, lessons learned, and future plans. The seven libraries profiled in this paper report a variety of service models in providing evaluation support services to meet the needs of campus stakeholders. The service models range from research center cores, partnerships with research groups, and library programs with staff dedicated to evaluation support services. A variety of products and services were described such as an automated tool to develop rank-based metrics, consultation on appropriate metrics to use for evaluation, customized publication and citation reports, resource guides, classes and training, and others. Implementing these services has allowed the libraries to expand their roles on campus and to contribute more directly to the research missions of their institutions. Libraries can leverage a variety of evaluation support services as an opportunity to successfully meet an array of challenges confronting the biomedical research community, including robust efforts to report and demonstrate tangible and meaningful outcomes of biomedical research and clinical care. These services represent a transformative direction that can be emulated by other biomedical and research libraries.

Using a community of inquiry framework to teach a nursing and midwifery research subject: An evaluative study.

Science.gov (United States)

Mills, Jane; Yates, Karen; Harrison, Helena; Woods, Cindy; Chamberlain-Salaun, Jennifer; Trueman, Scott; Hitchins, Marnie

2016-08-01

Postgraduate nursing students' negative perceptions about a core research subject at an Australian university led to a revision and restructure of the subject using a Communities of Inquiry framework. Negative views are often expressed by nursing and midwifery students about the research process. The success of evidence-based practice is dependent on changing these views. A Community of Inquiry is an online teaching, learning, thinking, and sharing space created through the combination of three domains-teacher presence (related largely to pedagogy), social presence, and cognitive presence (critical thinking). Evaluate student satisfaction with a postgraduate core nursing and midwifery subject in research design, theory, and methodology, which was delivered using a Communities of Inquiry framework. This evaluative study incorporated a validated Communities of Inquiry survey (n=29) and interviews (n=10) and was conducted at an Australian university. Study participants were a convenience sample drawn from 56 postgraduate students enrolled in a core research subject. Survey data were analysed descriptively and interviews were coded thematically. Five main themes were identified: subject design and delivery; cultivating community through social interaction; application-knowledge, practice, research; student recommendations; and technology and technicalities. Student satisfaction was generally high, particularly in the areas of cognitive presence (critical thinking) and teacher presence (largely pedagogy related). Students' views about the creation of a "social presence" were varied but overall, the framework was effective in stimulating both inquiry and a sense of community. The process of research is, in itself, the creation of a "community of inquiry." This framework showed strong potential for use in the teaching of nurse research subjects; satisfaction was high as students reported learning, not simply the theory and the methods of research, but also how to engage

Citation ranking versus peer evaluation of senior faculty research performance

DEFF Research Database (Denmark)

Meho, Lokman I.; Sonnenwald, Diane H.

2000-01-01

The purpose of this study is to analyze the relationship between citation ranking and peer evaluation in assessing senior faculty research performance. Other studies typically derive their peer evaluation data directly from referees, often in the form of ranking. This study uses two additional...... indicator of research performance of senior faculty members? Citation data, book reviews, and peer ranking were compiled and examined for faculty members specializing in Kurdish studies. Analysis shows that normalized citation ranking and citation content analysis data yield identical ranking results....... Analysis also shows that normalized citation ranking and citation content analysis, book reviews, and peer ranking perform similarly (i.e., are highly correlated) for high-ranked and low-ranked senior scholars. Additional evaluation methods and measures that take into account the context and content...

Research into real-option evaluation method

International Nuclear Information System (INIS)

Shiba, Tsuyoshi; Wakamatsu, Hitoshi

2002-03-01

As an evaluational method for valuation of a corporation, an investment project, a research and development, or the evaluation technique of an enterprise strategy, a real option analysis attracts attention instead of conventional Discount Cash Flow method. The reason is that it can divert the technique for the option valuation in financial engineering to the decision-making process performed according to change in investment environment. Related references, the analysis tools, the application examples, etc. were investigated about the decision-making technique using real option analysis, and this investigation considered the application method to decision-making of the research and development at Japan Nuclear Cycle Development Institute. Consequently, since the feature is in real option analysis being the evaluation technique on condition of that business conditions and business itself also change, the real option analysis fits for evaluation of a research and development that business conditions were opaque and it turns out that the businesses are highly flexible. Moreover, it turns out that it fits also for evaluation of a capital concentration type investment issue like power plants. (author)

Research Planning and Evaluation Project

International Nuclear Information System (INIS)

Song, Seunghyun; Kim, Doyang; Ryu, Byunghoon; Lim, Chaeyoung; Song, Leeyoung; Lee, Youngchul; Han, Changsun; Kim, Hackchoon

2011-12-01

- To activate R and D through a systematic and impartial evaluation by using information on efficient distribution of research resource, setting project priorities, and measuring achievement against goals produced after research on planning and evaluation system for the government-funded project for KAERI was conducted. - Nuclear R and D project is the representative national R and D project which has been implemented in Korea. For the sustainable development of nuclear energy which supplies about 40% of total electricity generation and the enhancement of it innovative ability in the future, a systematic and efficient strategy in the planning stage is required

Evaluating the role of the diagnostic research radiographer

International Nuclear Information System (INIS)

Reid, Karen; Edwards, Hazel

2011-01-01

The NHS has an increasingly strong focus on evidence-based medicine to underpin policy making and the development of a culture of evaluation and learning. Good quality research is the foundation for this ethos. Numbers of research projects and clinical trials involving imaging are increasing and therefore more radiographers are contributing to these studies but perhaps on some occasions they may be unaware. This paper describes the benefits of having a dedicated research radiographer within a radiology department to organise and monitor studies. We explain the procedures of the research process, the knowledge and skills that such a radiographer requires and the value of coordination and governance in developing a culture of research in a radiology department. We make suggestions to overcome perceived barriers to engaging with research and discuss the advantages and limitations of the role. Others who are considering appointing a dedicated research radiographer may find our experience helpful.

FEDS : A Framework for Evaluation in Design Science Research

DEFF Research Database (Denmark)

Venable, John; Pries-Heje, Jan; Baskerville, Richard

2015-01-01

Evaluation of design artefacts and design theories is a key activity in Design Science Research (DSR), as it provides feedback for further development and (if done correctly) assures the rigour of the research. However, the extant DSR literature provides insufficient guidance on evaluation...... to enable Design Science Researchers to effectively design and incorporate evaluation activities into a DSR project that can achieve DSR goals and objectives. To address this research gap, this research paper develops, explicates, and provides evidence for the utility of a Framework for Evaluation in Design...... Science (FEDS) together with a process to guide design science researchers in developing a strategy for evaluating the artefacts they develop within a DSR project. A FEDS strategy considers why, when, how, and what to evaluate. FEDS includes a two-dimensional characterisation of DSR evaluation episodes...

Toward an agenda for evaluation of qualitative research.

Science.gov (United States)

Stige, Brynjulf; Malterud, Kirsti; Midtgarden, Torjus

2009-10-01

Evaluation is essential for research quality and development, but the diversity of traditions that characterize qualitative research suggests that general checklists or shared criteria for evaluation are problematic. We propose an approach to research evaluation that encourages reflexive dialogue through use of an evaluation agenda. In proposing an evaluation agenda we shift attention from rule-based judgment to reflexive dialogue. Unlike criteria, an agenda may embrace pluralism, and does not request consensus on ontological, epistemological, and methodological issues, only consensus on what themes warrant discussion. We suggest an evaluation agenda-EPICURE-with two dimensions communicated through use of two acronyms.The first, EPIC, refers to the challenge of producing rich and substantive accounts based on engagement, processing, interpretation, and (self-)critique. The second-CURE-refers to the challenge of dealing with preconditions and consequences of research, with a focus on (social) critique, usefulness, relevance, and ethics. The seven items of the composite agenda EPICURE are presented and exemplified. Features and implications of the agenda approach to research evaluation are then discussed.

The Policy Use of Environmental Indicators - Learning from Evaluation Research

DEFF Research Database (Denmark)

Gudmundsson, H.

2003-01-01

indicators and monitoring systems are increasingly used, but what does the use of indicators mean for policymaking? The article exploits indicator theory and the evaluation research literature to develop an analytical framework so as to study the policy uses of indicators. The paper then provides...... system and partly to the lack of accountability mechanisms. The article concludes that the analytical framework and the concepts derived from evaluation research are useful starting points, but that further research should extend the analysis to other policy contexts (national or local) and broaden...

Norwegian climate research. An evaluation

Energy Technology Data Exchange (ETDEWEB)

NONE

2012-07-01

From the executive summary; Based on our evaluation, we make six major recommendations and provide suggestions for how these might be implemented. 1. Establish a clear and coherent national strategy for climate research and its funding. 2. The Research Council of Norway should develop a new integrated long-term climate research programme. 3. Build on strengths and develop capacities in areas where Norway currently lacks sufficient scientific expertise. 4. Ensure societal relevance as well as inter- and transdisciplinarity in research. 5. Emphasise collaboration and cooperation as a basis for successful climate research. 6. Prioritise outreach and stakeholder interaction.(Author)

Case Study Observational Research: A Framework for Conducting Case Study Research Where Observation Data Are the Focus.

Science.gov (United States)

Morgan, Sonya J; Pullon, Susan R H; Macdonald, Lindsay M; McKinlay, Eileen M; Gray, Ben V

2017-06-01

Case study research is a comprehensive method that incorporates multiple sources of data to provide detailed accounts of complex research phenomena in real-life contexts. However, current models of case study research do not particularly distinguish the unique contribution observation data can make. Observation methods have the potential to reach beyond other methods that rely largely or solely on self-report. This article describes the distinctive characteristics of case study observational research, a modified form of Yin's 2014 model of case study research the authors used in a study exploring interprofessional collaboration in primary care. In this approach, observation data are positioned as the central component of the research design. Case study observational research offers a promising approach for researchers in a wide range of health care settings seeking more complete understandings of complex topics, where contextual influences are of primary concern. Future research is needed to refine and evaluate the approach.

Evaluating the "Evaluative State": Implications for Research in Higher Education.

Science.gov (United States)

Dill, David D.

1998-01-01

Examines the "evaluative state" that is, public management-based evaluation systems--in the context of experiences in the United Kingdom and New Zealand, and suggests that further research is needed to examine problems in the evaluative state itself, in how market competition impacts upon it, and how academic oligarchies influence the…

Commentary: Writing and Evaluating Qualitative Research Reports.

Science.gov (United States)

Wu, Yelena P; Thompson, Deborah; Aroian, Karen J; McQuaid, Elizabeth L; Deatrick, Janet A

2016-06-01

To provide an overview of qualitative methods, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals are encouraged to address the qualitative research considerations raised and to explicitly identify the systematic strategies used to ensure rigor in study design and methods, analysis, and presentation of findings. Increasing capacity for review and publication of qualitative research within pediatric psychology will advance the field's ability to gain a better understanding of the specific needs of pediatric populations, tailor interventions more effectively, and promote optimal health. © The Author 2016. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Phenomenological study on crystalline rock for evaluating of long-term behavior (Contract research)

International Nuclear Information System (INIS)

Okubo, Seisuke; Fukui, Katsunori; Hashiba, Kimihiro; Hikima, Ryoichi; Tanno, Takeo; Sanada, Hiroyuki; Matsui, Hiroya; Sato, Toshinori

2012-02-01

Rock, under in situ conditions, shows time-dependent behavior such as creep/relaxation. With respect to high-level radioactive waste disposal, knowledge of the long-term mechanical stability of shafts and galleries excavated in rock is required, not only during construction and operation but also over a period of thousands of years after closure. Therefore, it is very important to understand the time-dependent behavior of rock for evaluating long-term mechanical stability. The purpose of this study is determining the mechanisms of time-dependent behavior of rock by precise testing, observation and measurement in order to develop methods for evaluating long-term mechanical stability of a rock mass. In the previous work, testing techniques have been established and basic evaluation methods were developed. Recently, some parameters needed for simulation of time-dependent behavior were determined at the Mizunami underground research facilities. However, sufficient data to check the reliability of the evaluation method for these parameters were not available. This report describes the results of the activities in fiscal year 2010. In Chapter 1, we provide an overview and the background to this study. In Chapter 2, the results of a long-term creep test on Tage tuff, started in fiscal year 1997 are described. In Chapter 3, the relation of loading-rate dependency of strength and stress dependency of creep life, the relation of time dependency, probability distribution and size effects are discussed to indicate more clearly the meaning of the value of 'n' to express the degree of time dependency of the rock. Furthermore, past studies concerning the value of 'n' are reviewed and the tests that could be carried out in future studies of mechanical properties and time dependency of Toki granite are considered in this Chapter. In Chapter 4, failure criterions of a rock mass considering time dependency are discussed. In Chapter 5, the FEM analysis implemented with a generalized

A Preliminary Rubric Design to Evaluate Mixed Methods Research

Science.gov (United States)

Burrows, Timothy J.

2013-01-01

With the increase in frequency of the use of mixed methods, both in research publications and in externally funded grants there are increasing calls for a set of standards to assess the quality of mixed methods research. The purpose of this mixed methods study was to conduct a multi-phase analysis to create a preliminary rubric to evaluate mixed…

Disability Evaluation Systems Analysis and Research Annual Report 2015

Science.gov (United States)

2016-03-21

Army and Air Force had higher percentages of reserve component disability evaluations, likely due to the inclusion of National Guard service members...Annual Report 2015 Disability Evaluation Systems Analysis and Research Prepared by Accession Medical Standards Analysis and Research Activity...Preventive Medicine Branch Walter Reed Army Institute of Research Silver Spring, Maryland Disability Evaluation Systems Analysis and Research

Disability Evaluation System Analysis and Research Annual Report 2015

Science.gov (United States)

2016-03-11

Inclusion of laboratory and diagnostic information on the medical condition or injury that precipitated the disability evaluation in each service’s...Annual Report 2015 Disability Evaluation Systems Analysis and Research Prepared by Accession Medical Standards Analysis and Research Activity...Preventive Medicine Branch Walter Reed Army Institute of Research Silver Spring, Maryland Disability Evaluation Systems Analysis and Research

Evaluation of Research in Engineering Science in Norway

DEFF Research Database (Denmark)

Van Brussel, Hendrik Van Brussel; Lindberg, Bengt; Cederwall, Klas

This report presents the conclusions of Panel 1: Construction engineering, Production and Operation. The Research Council of Norway (NFR) appointed three expert panels to evaluate Research in Engineering Science in Norway .......This report presents the conclusions of Panel 1: Construction engineering, Production and Operation. The Research Council of Norway (NFR) appointed three expert panels to evaluate Research in Engineering Science in Norway ....

Handbook of bibliometric indicators quantitative tools for studying and evaluating research

CERN Document Server

Todeschini, Roberto

2016-01-01

At last, the first systematic guide to the growing jungle of citation indices and other bibliometric indicators. Written with the aim of providing a complete and unbiased overview of all available statistical measures for scientific productivity, the core of this reference is an alphabetical dictionary of indices and other algorithms used to evaluate the importance and impact of researchers and their institutions. In 150 major articles, the authors describe all indices in strictly mathematical terms without passing judgement on their relative merit. From widely used measures, such as the journal impact factor or the h-index, to highly specialized indices, all indicators currently in use in the sciences and humanities are described, and their application explained. The introductory section and the appendix contain a wealth of valuable supporting information on data sources, tools and techniques for bibliometric and scientometric analysis - for individual researchers as well as their funders and publishers.

Research Issues in Evaluating Learning Pattern Development in Higher Education

Science.gov (United States)

Richardson, John T. E.

2013-01-01

This article concludes the special issue of "Studies in Educational Evaluation" concerned with "Evaluating learning pattern development in higher education" by discussing research issues that have emerged from the previous contributions. The article considers in turn: stability versus variability in learning patterns; old versus new analytic…

Clinical evaluation of marketed orthodontic products: are researchers behind the times? A meta-epidemiological study

Directory of Open Access Journals (Sweden)

Jadbinder Seehra

2017-05-01

Full Text Available Abstract Background The role of marketing and industry in the treatment decisions of orthodontists has received increasing attention in recent years with clinical research typically undertaken subsequent to established use of these devices and often failing to confirm the promise of manufacturers’ claims. This meta-epidemiological study was undertaken to assess the proportion of clinical trials in orthodontics evaluating commercially marketed products and to evaluate the direction of the results of these studies. Methods Electronic searching was undertaken to identify randomized controlled trials (RCTs published over a 5-year period (1 January 2012 to 31 December 2016. Data obtained included the type of marketed intervention, direction of effect and declaration of both industry sponsorship and conflict of interest. Results Eighty-four RCTs published in 23 scientific journals were included with the highest percentage in the American Journal of Dentofacial Orthopedics (AJO-DO (23.8%, followed by the European Journal of Orthodontics (EJO (14.3%, Journal of Orthodontics (JO (10.7% and Angle Orthodontist (AO (10.7%. Overall, 45% (38/84 of clinical trials assessed involved analysis of marketed products after their introduction. Interventions to improve oral health or circumvent the risk of iatrogenic damage, such as white spot lesions, were most commonly assessed (15.8%, with the relative merits of non-surgical adjuncts (14.1% and other orthodontic auxiliaries (13.1% also frequently evaluated. In 44% of RCTs, a positive effect of the marketed intervention was not reported. Industry sponsorship of the research was declared in 9.5% RCTs. No significant associations between the direction of the effect and both declaration of industry sponsorship (p = 0.56 and conflict of interest (p = 0.96 were detected. Moreover, for marketed and non-marketed products, no significant associations for both declaration of industry sponsorship (p = 0.44 and

Promoting and evaluating scientific rigour in qualitative research.

Science.gov (United States)

Baillie, Lesley

2015-07-15

This article explores perspectives on qualitative research and the variety of views concerning rigour in the research process. Evaluating and ensuring the quality of research are essential considerations for practitioners who are appraising evidence to inform their practice or research. Several criteria and principles for evaluating quality in qualitative research are presented, recognising that their application in practice is influenced by the qualitative methodology used. The article examines a range of techniques that a qualitative researcher can use to promote rigour and apply it to practice.

Ethical review from the inside: repertoires of evaluation in Research Ethics Committee meetings

NARCIS (Netherlands)

de Jong, Jean Philippe; van Zwieten, Myra C. B.; Willems, Dick L.

2012-01-01

Evaluating the practice of ethical review by Research Ethics Committees (REC) could help protect the interests of human participants and promote scientific progress. To facilitate such evaluations, we conducted an ethnographic study of how an REC reviews research proposals during its meetings. We

Commentary: Writing and evaluating qualitative research reports

Science.gov (United States)

An overview of qualitative methods is provided, particularly for reviewers and authors who may be less familiar with qualitative research. A question and answer format is used to address considerations for writing and evaluating qualitative research. When producing qualitative research, individuals ...

Logistics case study based research: Towards higher quality

DEFF Research Database (Denmark)

Pedrosa, Alex; Näslund, Dag; Jasmand, Claudia

2012-01-01

analysis of 134 case study based articles published in six leading logistics and supply chain management (SCM) journals between 1998 and 2010 is used to assess and evaluate the quality of the case study based research approach as documented in these publications. Findings – This research provides...... to address to ensure high quality of the case study based research approach in published articles. Research limitations/implications – This study is limited to the analysis of published articles in six logistics and SCM journals. Further research should investigate different journals in logistics and other...

Acoustic evaluation of standing trees : recent research development

Science.gov (United States)

Xiping Wang; Robert J. Ross; Peter Carter

2005-01-01

This paper presents some research results from recent trial studies on measuring acoustic velocities on standing trees of five softwood species. The relationships between tree velocities measured by time of flight method and log velocities measured by resonance method were evaluated. Theoretical and empirical models were developed for adjusting observed tree velocity...

A Comprehensive Framework for Evaluation in Design Science Research

DEFF Research Database (Denmark)

Pries-Heje, Jan; Baskerville, Richard; Venable, John

2012-01-01

Evaluation is a central and essential activity in conducting rigorous Design Science Research (DSR), yet there is surprisingly little guidance about designing the DSR evaluation activity beyond suggesting possible methods that could be used for evaluation. This paper extends the notable exception...... of the existing framework of Pries-Heje et al [11] to address this problem. The paper proposes an extended DSR evaluation framework together with a DSR evaluation design method that can guide DSR researchers in choosing an appropriate strategy for evaluation of the design artifacts and design theories that form...... the output from DSR. The extended DSR evaluation framework asks the DSR researcher to consider (as input to the choice of the DSR evaluation strategy) contextual factors of goals, conditions, and constraints on the DSR evaluation, e.g. the type and level of desired rigor, the type of artifact, the need...

Evaluating research recruitment strategies to improve response rates amongst South African nurses

Directory of Open Access Journals (Sweden)

Natasha Khamisa

2014-03-01

Research purpose: The aim of this study was to evaluate three research recruitment methods for their impact on recruitment and participation rates amongst South African nurses. Motivation for the study: A limited number of studies exist that formally evaluates different recruitment strategies to improve participation in research amongst nurses within developing contexts, especially South Africa. Research approach, design and method: Participants were recruited using three different methods. Of the 250 nurses randomly selected and invited to participate in a cross-sectional survey, 201 agreed and 162 (81% returned the questionnaires. Main findings: Nursing management participation in the recruitment and data collection process produces more favourable response rates. Reminders and the use of shorter questionnaires also aid higher response rates. Practical/managerial implications: Reminders as well as face-to-face recruitment strategies (especially by a familiar person successfully improved participation rates amongst South African nurses in this study. Contribution/value-add: This study identifies some strategies that could be used more widely to increase the recruitment and participation of South African nurses in research whilst potentially improving their work situation.

Evaluating research impact: the development of a ‘RESEARCH for IMPACT’ TOOL

Directory of Open Access Journals (Sweden)

Komla Tsey

2016-08-01

Full Text Available Introduction: This paper describes the development of a ‘Research for Impact’ Tool against a background of concerns about the over-researching of Aboriginal and Torres Strait Islander people’s issues without demonstrable benefits.Material and Methods: A combination of literature reviews, workshops with researchers and reflections by project team members and partners using participatory snowball techniques.Results: Assessing research impact is difficult, akin to so-called ‘wicked problem’, but not impossible. Heuristic and collaborative approach to research that takes in the expectations of research users, those being researched and the funders of research offers a pragmatic solution to evaluating research impact. The proposed ‘Research for Impact’ Tool is based on the understanding that the value of research is to create evidence and/or products to support smarter decisions so as to improve the human condition.Research is of limited value unless the evidence produced is used to inform smarter decisions. A practical way of approaching research impact is therefore to start with the decisions confronting decision makers whether they are government policymakers, professional practitioners or households and the extent to which the research supports smarter decisions and the knock-on consequences of such smart decisions. Embedded at each step in the impact planning, monitoring and evaluation process is the need for Indigenous leadership and participation, capacity enhancement and collaborative partnerships and participatory learning by doing approaches across partners.Discussion: The tool is designed in the context of Indigenous research but the basic idea that the way to assess research impact is to start upfront by defining the users’ of research and their information needs, the decisions confronting them and the extent to which research informs smarter decisions is equally applicable to research in other settings, both applied and

Report of the evaluation by the Ad Hoc Review Committee on advance science research. Result evaluation, interim evaluation, in-advance evaluation in fiscal year 2003

International Nuclear Information System (INIS)

2003-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Advanced Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the accomplishments of the research completed in Fiscal Year 2002, the accomplishments of the research started in Fiscal Year 2001, and the adequacy of the programs of the research to be started in Fiscal Year 2004 at Advanced Science Research Center of JAERI. The Ad Hoc Review Committee consisted of nine specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from May to July 2003. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 24, 2003, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on August 4, 2003. This report describes the result of the evaluation by the Ad Hoc Review Committee on Advanced Science Research. (author)

Report of the evaluation by the Ad Hoc Review Committee on Advance Science Research. Result evaluation, interim evaluation, in-advance evaluation in fiscal year 2002

Energy Technology Data Exchange (ETDEWEB)

NONE

2002-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Advanced Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the accomplishments of the research completed in Fiscal Year 2001, the accomplishments of the research started in Fiscal Year 2000, and the adequacy of the programs of the research to be started in Fiscal Year 2003 at Advanced Science Research Center of JAERI. The Ad Hoc Review Committee consisted of eight specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from May to July 2002. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 4, 2002, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on August 5, 2002. This report describes the result of the evaluation by the Ad Hoc Review Committee on Advanced Science Research. (author)

Conference presentation to publication: a retrospective study evaluating quality of abstracts and journal articles in medical education research

Directory of Open Access Journals (Sweden)

Christopher R. Stephenson

2017-11-01

Full Text Available Abstract Background There is little evidence regarding the comparative quality of abstracts and articles in medical education research. The Medical Education Research Study Quality Instrument (MERSQI, which was developed to evaluate the quality of reporting in medical education, has strong validity evidence for content, internal structure, and relationships to other variables. We used the MERSQI to compare the quality of reporting for conference abstracts, journal abstracts, and published articles. Methods This is a retrospective study of all 46 medical education research abstracts submitted to the Society of General Internal Medicine 2009 Annual Meeting that were subsequently published in a peer-reviewed journal. We compared MERSQI scores of the abstracts with scores for their corresponding published journal abstracts and articles. Comparisons were performed using the signed rank test. Results Overall MERSQI scores increased significantly for published articles compared with conference abstracts (11.33 vs 9.67; P < .001 and journal abstracts (11.33 vs 9.96; P < .001. Regarding MERSQI subscales, published articles had higher MERSQI scores than conference abstracts in the domains of sampling (1.59 vs 1.34; P = .006, data analysis (3.00 vs 2.43; P < .001, and validity of evaluation instrument (1.04 vs 0.28; P < .001. Published articles also had higher MERSQI scores than journal abstracts in the domains of data analysis (3.00 vs 2.70; P = .004 and validity of evaluation instrument (1.04 vs 0.26; P < .001. Conclusions To our knowledge, this is the first study to compare the quality of medical education abstracts and journal articles using the MERSQI. Overall, the quality of articles was greater than that of abstracts. However, there were no significant differences between abstracts and articles for the domains of study design and outcomes, which indicates that these MERSQI elements may be applicable to abstracts. Findings

Evaluation of the fusion technology and safety programme of the Joint Research Centre (1980-85)

International Nuclear Information System (INIS)

Haines, M.; Cabibbo, N.; Crocker, J.G.; Lecomte, M.; Merz, E.

1986-01-01

The Joint Research Centre, Ispra, has been involved in fusion research since 1973. In July 1985 the Commission of European Communities - DG XII, following a policy of systematically evaluating its RandD activities, appointed a panel of external experts to evaluate the fusion technology and safety programme carried out at the Joint Research Centre. This report describes the work of the panel in evaluating the research performed by the JRC within the framework of its 1984-87 programme. The achievements of the previous programme, 1980-83, were also taken into consideration. The different research areas covered in the programme, i.e.: reactor studies, breeding blanket technology, structural materials studies, risk assessment and tritium laboratory studies, are described and a draft proposal for the period 1987-90 presented. The evaluation panel has been asked to assess the following aspects: the scientific and technical achievements of the programme, the contribution of the programme to the development of other Community policies, the role played by the JRC in the European fusion research (including NET) and in international collaborations such as INTOR. From its assessment the evaluation panel has made a series of recommendations for the current programme and for future work

DOE/DOT Crude Oil Characterization Research Study, Task 2 Test Report on Evaluating Crude Oil Sampling and Analysis Methods

Energy Technology Data Exchange (ETDEWEB)

Lord, David [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Allen, Ray [Allen Energy Services, Inc., Longview, TX (United States); Rudeen, David [GRAM, Inc., Albuquerque, NM (United States)

2017-11-01

The Crude Oil Characterization Research Study is designed to evaluate whether crude oils currently transported in North America, including those produced from "tight" formations, exhibit physical or chemical properties that are distinct from conventional crudes, and how these properties associate with combustion hazards with may be realized during transportation and handling.

Innovative technology transfer of nondestructive evaluation research

Science.gov (United States)

Brian Brashaw; Robert J. Ross; Xiping Wang

2008-01-01

Technology transfer is often an afterthought for many nondestructive evaluation (NDE) researchers. Effective technology transfer should be considered during the planning and execution of research projects. This paper outlines strategies for using technology transfer in NDE research and presents a wide variety of technology transfer methods used by a cooperative...

Reliability studies in research reactors

International Nuclear Information System (INIS)

Albuquerque, Tob Rodrigues de

2013-01-01

Fault trees and event trees are widely used in industry to model and to evaluate the reliability of safety systems. Detailed analyzes in nuclear installations require the combination of these two techniques. This study uses the methods of FT (Fault Tree) and ET (Event Tree) to accomplish the PSA (Probabilistic Safety Assessment) in research reactors. According to IAEA (lnternational Atomic Energy Agency), the PSA is divided into Level 1, Level 2 and Level 3. At the Level 1, conceptually, the security systems perform to prevent the occurrence of accidents, At the Level 2, once accidents happened, this Level seeks to minimize consequences, known as stage management of accident, and at Level 3 accident impacts are determined. This study focuses on analyzing the Level 1, and searching through the acquisition of knowledge, the consolidation of methodologies for future reliability studies. The Greek Research Reactor, GRR-1, is a case example. The LOCA (Loss of Coolant Accident) was chosen as the initiating event and from it, using ET, possible accidental sequences were developed, which could lead damage to the core. Moreover, for each of affected systems, probabilities of each event top of FT were developed and evaluated in possible accidental sequences. Also, the estimates of importance measures for basic events are presented in this work. The studies of this research were conducted using a commercial computational tool SAPHIRE. Additionally, achieved results thus were considered satisfactory for the performance or the failure of analyzed systems. (author)

Solving a methodological challenge in work stress evaluation with the Stress Assessment and Research Toolkit (StART): a study protocol.

Science.gov (United States)

Guglielmi, Dina; Simbula, Silvia; Vignoli, Michela; Bruni, Ilaria; Depolo, Marco; Bonfiglioli, Roberta; Tabanelli, Maria Carla; Violante, Francesco Saverio

2013-06-22

Stress evaluation is a field of strong interest and challenging due to several methodological aspects in the evaluation process. The aim of this study is to propose a study protocol to test a new method (i.e., the Stress Assessment and Research Toolkit) to assess psychosocial risk factors at work. This method addresses several methodological issues (e.g., subjective vs. objective, qualitative vs quantitative data) by assessing work-related stressors using different kinds of data: i) organisational archival data (organisational indicators sheet); ii) qualitative data (focus group); iii) worker perception (questionnaire); and iv) observational data (observational checklist) using mixed methods research. In addition, it allows positive and negative aspects of work to be considered conjointly, using an approach that considers at the same time job demands and job resources. The integration of these sources of data can reduce the theoretical and methodological bias related to stress research in the work setting, allows researchers and professionals to obtain a reliable description of workers' stress, providing a more articulate vision of psychosocial risks, and allows a large amount of data to be collected. Finally, the implementation of the method ensures in the long term a primary prevention for psychosocial risk management in that it aims to reduce or modify the intensity, frequency or duration of organisational demands.

Web indicators for research evaluation a practical guide

CERN Document Server

Thelwall, Michael

2017-01-01

In recent years there has been an increasing demand for research evaluation within universities and other research-based organisations. In parallel, there has been an increasing recognition that traditional citation-based indicators are not able to reflect the societal impacts of research and are slow to appear. This has led to the creation of new indicators for different types of research impact as well as timelier indicators, mainly derived from the Web. These indicators have been called altmetrics, webometrics or just web metrics. This book describes and evaluates a range of web indicators for aspects of societal or scholarly impact, discusses the theory and practice of using and evaluating web indicators for research assessment and outlines practical strategies for obtaining many web indicators. In addition to describing impact indicators for traditional scholarly outputs, such as journal articles and monographs, it also covers indicators for videos, datasets, software and other non-standard scholarly out...

Gas research programme in Sweden 1994-1996. Evaluation report

Energy Technology Data Exchange (ETDEWEB)

Hustad, J E [Norwegian Univ. of Science and Technology, Trondheim (Norway); Jahkola, A [Helsinki Univ. of Technology (Finland); Norhammar, U [STOSEB (Sweden)

1997-05-01

This evaluation report is written by an international committee at the request of the Swedish National Board for Industrial and Technical Development (NUTEK). The committee was invited to look into the quality of a research programme funded jointly by Svenskt Gastekniskt Center SGC (Swedish Gas Technical Centre) and NUTEK. Criteria`s considered in the evaluation have in short been as follows: scientific value of the projects and of the results obtained; merits of the methods; capability of research groups and adequacy of resources; quality of research in the view of problem oriented applied research; necessity of future financial support. Although the projects are the main elements to be evaluated, the evaluators have paid attention to structural and other problems wherever such a need has been seen.

Research on evaluation of enterprise project culture based on Denison model

Directory of Open Access Journals (Sweden)

Yucheng Zeng

2015-05-01

Full Text Available Purpose: The purpose of this paper is to build enterprise project culture evaluation model and search for the best evaluation method for Chinese enterprise project culture on the basis of studying and drawing lessons from enterprise culture evaluation theory and method at home and abroad. Design/methodology/approach: Referring to the Denison enterprise culture evaluation model, this paper optimizes it according to the difference of enterprise project culture, designs the enterprise project culture evaluation model and proves the practicability of the model through empirical. Finding: This paper finds that it`s more applicable to use the Denison model for enterprise project culture evaluation through the comparative analysis of domestic and foreign enterprise culture evaluation theory and method, the systematic project culture management framework of Chinese enterprises has not yet formed through empirical research, and four factors in enterprise project culture have important influence on project operation performance improvement. Research limitations/implications: The research on evaluation of enterprise project culture based on Denison model is a preliminary attempt, the design of evaluation index system, evaluation model and scale structure also need to be improved, but the thinking of this paper in this field provides a valuable reference for future research. Practical Implications: This paper provides the support of theory and practice for evaluating the present situation of enterprise project culture construction and analyzing the advantages and disadvantages of project culture, which contributes to the "dialectical therapy" of enterprise project management, enterprise management and enterprise project culture construction. Originality/value: The main contribution of this paper is the introduction of Denison enterprise culture model. Combining with the actual situation of enterprises, this paper also builds the evaluation model for

A New Tool for Identifying Research Standards and Evaluating Research Performance

Science.gov (United States)

Bacon, Donald R.; Paul, Pallab; Stewart, Kim A.; Mukhopadhyay, Kausiki

2012-01-01

Much has been written about the evaluation of faculty research productivity in promotion and tenure decisions, including many articles that seek to determine the rank of various marketing journals. Yet how faculty evaluators combine journal quality, quantity, and author contribution to form judgments of a scholar's performance is unclear. A…

QUALITY OF AN ACADEMIC STUDY PROGRAMME - EVALUATION MODEL

Directory of Open Access Journals (Sweden)

Mirna Macur

2016-01-01

Full Text Available Quality of an academic study programme is evaluated by many: employees (internal evaluation and by external evaluators: experts, agencies and organisations. Internal and external evaluation of an academic programme follow written structure that resembles on one of the quality models. We believe the quality models (mostly derived from EFQM excellence model don’t fit very well into non-profit activities, policies and programmes, because they are much more complex than environment, from which quality models derive from (for example assembly line. Quality of an academic study programme is very complex and understood differently by various stakeholders, so we present dimensional evaluation in the article. Dimensional evaluation, as opposed to component and holistic evaluation, is a form of analytical evaluation in which the quality of value of the evaluand is determined by looking at its performance on multiple dimensions of merit or evaluation criteria. First stakeholders of a study programme and their views, expectations and interests are presented, followed by evaluation criteria. They are both joined into the evaluation model revealing which evaluation criteria can and should be evaluated by which stakeholder. Main research questions are posed and research method for each dimension listed.

Evaluating the Non-Academic Impact of Academic Research: Design Considerations

Science.gov (United States)

Gunn, Andrew; Mintrom, Michael

2017-01-01

Evaluation of academic research plays a significant role in government efforts to steer public universities. The scope of such evaluation is now being extended to include the "relevance" or "impact" of academic research outside the academy. We address how evaluation of non-academic research impact can promote more such impact…

Study on Related Courses to Help Undergraduate Students Write Research Reports: A Curriculum Evaluation

Directory of Open Access Journals (Sweden)

Eny Winarti

2014-02-01

Full Text Available From the experience of joining the boards in the students’ research report defence, teaching education research methodology, and classroom action research, the researcher indicated that students had challenges related with the logic of research methods and academic research writing.  These findings encouraged the researcher to study the courses that have potential in helping students writing their research reports.  To study the courses, the researcher analysed related documents, such as syllabi and lesson plans.  The researcher also interviewed teachers and students to clarify the relevance of the syllabi and the classroom learning.  The results of the study indicated that logic, academic writing, statistics, research methodology, and classroom action research had the potential of helping the students write their research report.  The researcher also indicated that the content of the courses should have been more helpful.  The fact, however, was that the students still had challenges understanding the materials after taking the courses.  Further study about this fact is then recommended.

Evaluating the risks of clinical research: direct comparative analysis.

Science.gov (United States)

Rid, Annette; Abdoler, Emily; Roberson-Nay, Roxann; Pine, Daniel S; Wendler, David

2014-09-01

Many guidelines and regulations allow children and adolescents to be enrolled in research without the prospect of clinical benefit when it poses minimal risk. However, few systematic methods exist to determine when research risks are minimal. This situation has led to significant variation in minimal risk judgments, raising concern that some children are not being adequately protected. To address this concern, we describe a new method for implementing the widely endorsed "risks of daily life" standard for minimal risk. This standard defines research risks as minimal when they do not exceed the risks posed by daily life activities or routine examinations. This study employed a conceptual and normative analysis, and use of an illustrative example. Different risks are composed of the same basic elements: Type, likelihood, and magnitude of harm. Hence, one can compare the risks of research and the risks of daily life by comparing the respective basic elements with each other. We use this insight to develop a systematic method, direct comparative analysis, for implementing the "risks of daily life" standard for minimal risk. The method offers a way of evaluating research procedures that pose the same types of risk as daily life activities, such as the risk of experiencing anxiety, stress, or other psychological harm. We thus illustrate how direct comparative analysis can be applied in practice by using it to evaluate whether the anxiety induced by a respiratory CO2 challenge poses minimal or greater than minimal risks in children and adolescents. Direct comparative analysis is a systematic method for applying the "risks of daily life" standard for minimal risk to research procedures that pose the same types of risk as daily life activities. It thereby offers a method to protect children and adolescents in research, while ensuring that important studies are not blocked because of unwarranted concerns about research risks.

A protocol for a systematic review of the use of process evaluations in knowledge translation research.

Science.gov (United States)

Scott, Shannon D; Rotter, Thomas; Hartling, Lisa; Chambers, Thane; Bannar-Martin, Katherine H

2014-12-23

Experimental designs for evaluating knowledge translation (KT) interventions for professional behavior change can provide strong estimates of intervention effectiveness but offer limited insight how the intervention worked or not. Furthermore, trials provide little insight into the ways through which interventions lead to behavior change and how they are moderated by different facilitators and barriers. As a result, the ability to generalize the findings from one study to a different context, organization, or clinical problem is severely compromised. Consequently, researchers have started to explore the causal mechanisms in complementary studies (process evaluations) alongside experimental designs for evaluating KT interventions. This study focuses on improving process evaluations by synthesizing current evidence on process evaluations conducted alongside experimental designs for evaluating KT interventions. A medical research librarian will develop and implement search strategies designed to identify evidence that is relevant to process evaluations in health research. Studies will not be excluded based on design. Included studies must contain a process evaluation component aimed at understanding or evaluating a KT intervention targeting professional behavior change. Two reviewers will perform study selection, quality assessment, and data extraction using standard forms. Disagreements will be resolved through discussion or third party adjudication. Data to be collected include study design, details about data collection approaches and types, theoretical influences, approaches to evaluate intervention dose delivered, intervention dose received, intervention fidelity, intervention reach, data analysis, and study outcomes. This study is not registered with PROSPERO. There is widespread acceptance that the generalizability of quantitative trials of KT interventions would be significantly enhanced to other contexts, health professional groups, and clinical conditions

Testimony in Narrative Educational Research: A Qualitative Interview, Narrative Analysis and Epistemological Evaluation

Science.gov (United States)

Christopher, Justin

2017-01-01

The purpose of this study is to assess issues that arise in the context of epistemological claims in narrative educational research by means of narrative analysis and epistemological evaluation. The research questions which guided the study were: 1) To what extent is epistemology considered by narrative educational researchers?; 2) What issues do…

Evaluating an artifact in design science research

CSIR Research Space (South Africa)

Herselman, M

2015-09-01

Full Text Available In this paper, we describe the iterative evaluation of an artifact developed through the application of Design Science Research (DSR) methodology in a resource constrained environment. In the DSR process the aspect of evaluation is often done...

Research evaluation support services in biomedical libraries

Directory of Open Access Journals (Sweden)

Karen Elizabeth Gutzman

2018-01-01

Conclusions: Libraries can leverage a variety of evaluation support services as an opportunity to successfully meet an array of challenges confronting the biomedical research community, including robust efforts to report and demonstrate tangible and meaningful outcomes of biomedical research and clinical care. These services represent a transformative direction that can be emulated by other biomedical and research libraries.

In-silico studies in Chinese herbal medicines' research: evaluation of in-silico methodologies and phytochemical data sources, and a review of research to date.

Science.gov (United States)

Barlow, D J; Buriani, A; Ehrman, T; Bosisio, E; Eberini, I; Hylands, P J

2012-04-10

The available databases that catalogue information on traditional Chinese medicines are reviewed in terms of their content and utility for in-silico research on Chinese herbal medicines, as too are the various protein database resources, and the software available for use in such studies. The software available for bioinformatics and 'omics studies of Chinese herbal medicines are summarised, and a critical evaluation given of the various in-silico methods applied in screening Chinese herbal medicines, including classification trees, neural networks, support vector machines, docking and inverse docking algorithms. Recommendations are made regarding any future in-silico studies of Chinese herbal medicines. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Study on Related Courses to Help Undergraduate Students Write Research Reports: a Curriculum Evaluation

OpenAIRE

Winarti, Eny

2014-01-01

From the experience of joining the boards in the students’ research report defence, teaching education research methodology, and classroom action research, the researcher indicated that students had challenges related with the logic of research methods and academic research writing.  These findings encouraged the researcher to study the courses that have potential in helping students writing their research reports.  To study the courses, the researcher analysed related documents, such as ...

Talk, trust and time: a longitudinal study evaluating knowledge translation and exchange processes for research on violence against women

Directory of Open Access Journals (Sweden)

Jack Susan M

2011-09-01

Full Text Available Abstract Background Violence against women (VAW is a major public health problem. Translation of VAW research to policy and practice is an area that remains understudied, but provides the opportunity to examine knowledge translation and exchange (KTE processes in a complex, multi-stakeholder context. In a series of studies including two randomized trials, the McMaster University VAW Research Program studied one key research gap: evidence about the effectiveness of screening women for exposure to intimate partner violence. This project developed and evaluated KTE strategies to share research findings with policymakers, health and community service providers, and women's advocates. Methods A longitudinal cross-sectional design, applying concurrent mixed data collection methods (surveys, interviews, and focus groups, was used to evaluate the utility of specific KTE strategies, including a series of workshops and a day-long Family Violence Knowledge Exchange Forum, on research sharing, uptake, and use. Results Participants valued the opportunity to meet with researchers, provide feedback on key messages, and make personal connections with other stakeholders. A number of factors specific to the knowledge itself, stakeholders' contexts, and the nature of the knowledge gap being addressed influenced the uptake, sharing, and use of the research. The types of knowledge use changed across time, and were specifically related to both the types of decisions being made, and to stage of decision making; most reported use was conceptual or symbolic, with few examples of instrumental use. Participants did report actively sharing the research findings with their own networks. Further examination of these second-order knowledge-sharing processes is required, including development of appropriate methods and measures for its assessment. Some participants reported that they would not use the research evidence in their decision making when it contradicted professional

Talk, trust and time: a longitudinal study evaluating knowledge translation and exchange processes for research on violence against women

Science.gov (United States)

2011-01-01

Background Violence against women (VAW) is a major public health problem. Translation of VAW research to policy and practice is an area that remains understudied, but provides the opportunity to examine knowledge translation and exchange (KTE) processes in a complex, multi-stakeholder context. In a series of studies including two randomized trials, the McMaster University VAW Research Program studied one key research gap: evidence about the effectiveness of screening women for exposure to intimate partner violence. This project developed and evaluated KTE strategies to share research findings with policymakers, health and community service providers, and women's advocates. Methods A longitudinal cross-sectional design, applying concurrent mixed data collection methods (surveys, interviews, and focus groups), was used to evaluate the utility of specific KTE strategies, including a series of workshops and a day-long Family Violence Knowledge Exchange Forum, on research sharing, uptake, and use. Results Participants valued the opportunity to meet with researchers, provide feedback on key messages, and make personal connections with other stakeholders. A number of factors specific to the knowledge itself, stakeholders' contexts, and the nature of the knowledge gap being addressed influenced the uptake, sharing, and use of the research. The types of knowledge use changed across time, and were specifically related to both the types of decisions being made, and to stage of decision making; most reported use was conceptual or symbolic, with few examples of instrumental use. Participants did report actively sharing the research findings with their own networks. Further examination of these second-order knowledge-sharing processes is required, including development of appropriate methods and measures for its assessment. Some participants reported that they would not use the research evidence in their decision making when it contradicted professional experiences, while others

Evaluation of the state water-resources research institutes

Science.gov (United States)

Ertel, M.O.

1988-01-01

Water resources research institutes, as authorized by the Water Resources Research Act of 1984 (Public Law 98-242), are located in each state and in the District of Columbia, Guam, Puerto Rico , and the Virgin Islands. Public Law 98-242 mandated an onsite evaluation of each of these institutes to determine whether ' . . .the quality and relevance of its water resources research and its effectiveness as an institution for planning, conducting, and arranging for research warrant its continued support in the national interest. ' The results of these evaluations, which were conducted between September 1985 and June 1987, are summarized. The evaluation teams found that all 54 institutes are meeting the basic objectives of the authorizing legislation in that they: (1) use the grant funds to support research that addresses water problems of state and regional concern; (2) provide opportunities for training of water scientists through student involvement on research projects; and (3) promote the application of research results through preparation of technical reports and contributions to the technical literature. The differences among institutes relate primarily to degrees of effectiveness, and most often are determined by the financial, political, and geographical contexts in which the institutes function and by the quality of their leadership. (Lantz-PTT)

Research evaluation and organizational learning

DEFF Research Database (Denmark)

Hansson, Finn

The paper will address the role of the recent implementation of systems of research evaluation in universities. The role of classic quality control system, the peer review, is to produce the most trustworthy knowledge and at the same time function as a learning system in a peer-to-peer learning p...

Center for Drug Evaluation and Research

Data.gov (United States)

Federal Laboratory Consortium — The Center for Drug Evaluation and Research(CDER) performs an essential public health task by making sure that safe and effective drugs are available to improve the...

Research on uncertainty evaluation measure and method of voltage sag severity

Science.gov (United States)

Liu, X. N.; Wei, J.; Ye, S. Y.; Chen, B.; Long, C.

2018-01-01

Voltage sag is an inevitable serious problem of power quality in power system. This paper focuses on a general summarization and reviews on the concepts, indices and evaluation methods about voltage sag severity. Considering the complexity and uncertainty of influencing factors, damage degree, the characteristics and requirements of voltage sag severity in the power source-network-load sides, the measure concepts and their existing conditions, evaluation indices and methods of voltage sag severity have been analyzed. Current evaluation techniques, such as stochastic theory, fuzzy logic, as well as their fusion, are reviewed in detail. An index system about voltage sag severity is provided for comprehensive study. The main aim of this paper is to propose thought and method of severity research based on advanced uncertainty theory and uncertainty measure. This study may be considered as a valuable guide for researchers who are interested in the domain of voltage sag severity.

Childhood Obesity Research Demonstration (CORD): Evaluation plan

Science.gov (United States)

The Childhood Obesity Research Demonstration (CORD) project evaluation will determine the extent to which the CORD model of linking primary care (PC) interventions to public health (PH) interventions in multiple community sectors affects BMI and behavior in children (2 to 12 years). The evaluation c...

Mid-term evaluation of ten National Research schools

DEFF Research Database (Denmark)

Gustafsson, Göran; Dahl, Hanne Marlene; Gustafsson, Christina

the scheme was launched, the Research Council has issued three calls for proposals and allocated grants to a total of 22 national research schools. Five were started up in 2009, ten in 2013 and seven in 2015. A Nordic scientific programme committee was appointed in 2013, with responsibility for assessing...... grant applications, monitoring the progress of the FORSKERSKOLER scheme and serving as the evaluation panel for the mid-term evaluation in 2013 and in 2016/2017. The task of the evaluation panel has been to: 1) evaluate the quality of and progress achieved by the ten research schools which were awarded...... funding in 2012 and launched in 2013; and 2) to provide recommendations as to whether funding should be continued to cover the full eight-year period or terminated after five years. Continued funding is recommended for all ten schools to cover the full eight-year period, according to the proposed budget...

Role of research in non-destructive evaluation for nuclear technology

International Nuclear Information System (INIS)

Jayakumar, T.; Rao, B.P.C.; Raj, Baldev

2010-01-01

This paper presents the role of research in non-destructive evaluation (NDE) of microstructures and mechanical properties in materials, assessment of manufacturing quality and early detection of in-service damage in nuclear components and structures. A few applications and case studies are discussed based on the results of systematic research and developmental activities pursued in different NDE techniques at the authors' laboratory for three different types of Indian nuclear reactors. (author)

Collaborative research between clinicians and researchers: a multiple case study of implementation

Directory of Open Access Journals (Sweden)

Edlund Carrie

2010-10-01

Full Text Available Abstract Background Bottom-up, clinician-conceived and directed clinical intervention research, coupled with collaboration from researcher experts, is conceptually endorsed by the participatory research movement. This report presents the findings of an evaluation of a program in the Veterans Health Administration meant to encourage clinician-driven research by providing resources believed to be critical. The evaluation focused on the extent to which funded projects: maintained integrity to their original proposals; were methodologically rigorous; were characterized by collaboration between partners; and resulted in sustained clinical impact. Methods Researchers used quantitative (survey and archival and qualitative (focus group data to evaluate the implementation, evaluation, and sustainability of four clinical demonstration projects at four sites. Fourteen research center mentors and seventeen clinician researchers evaluated the level of collaboration using a six-dimensional model of participatory research. Results Results yielded mixed findings. Qualitative and quantitative data suggested that although the process was collaborative, clinicians' prior research experience was critical to the quality of the projects. Several challenges were common across sites, including subject recruitment, administrative support and logistics, and subsequent dissemination. Only one intervention achieved lasting clinical effect beyond the active project period. Qualitative analyses identified barriers and facilitators and suggested areas to improve sustainability. Conclusions Evaluation results suggest that this participatory research venture was successful in achieving clinician-directed collaboration, but did not produce sustainable interventions due to such implementation problems as lack of resources and administrative support.

The Childhood Obesity Declines Project: Implications for Research and Evaluation Approaches.

Science.gov (United States)

Young-Hyman, Deborah; Morris, Kathryn; Kettel Khan, Laura; Dawkins-Lyn, Nicola; Dooyema, Carrie; Harris, Carole; Jernigan, Jan; Ottley, Phyllis; Kauh, Tina

2018-03-01

Childhood obesity remains prevalent and is increasing in some disadvantaged populations. Numerous research, policy and community initiatives are undertaken to impact this pandemic. Understudied are natural experiments. The need to learn from these efforts is paramount. Resulting evidence may not be readily available to inform future research, community initiatives, and policy development/implementation. We discuss the implications of using an adaptation of the Systematic Screening and Assessment (SSA) method to evaluate the Childhood Obesity Declines (COBD) project. The project examined successful initiatives, programs and policies in four diverse communities which were concurrent with significant declines in child obesity. In the context of other research designs and evaluation schemas, rationale for use of SSA is presented. Evidence generated by this method is highlighted and guidance suggested for evaluation of future studies of community-based childhood obesity prevention initiatives. Support for the role of stakeholder collaboratives, in particular the National Collaborative on Childhood Obesity Research, as a synergistic vehicle to accelerate research on childhood obesity is discussed. SSA mapped active processes and provided contextual understanding of multi-level/component simultaneous efforts to reduce rates of childhood obesity in community settings. Initiatives, programs and policies were not necessarily coordinated. And although direct attribution of intervention/initiative/policy components could not be made, the what, by who, how, to whom was temporally associated with statistically significant reductions in childhood obesity. SSA provides evidence for context and processes which are not often evaluated in other data analytic methods. SSA provides an additional tool to layer with other evaluation approaches.

Presentation of a Novel Model for Evaluation of Commercialization of Research and Development: Case Study of the Pharmaceutical Biotechnology Industry.

Science.gov (United States)

Emami, Hassan; Radfar, Reza

2017-01-01

The current situation in Iran suggests an appropriate basis for developing biotechnology industries, because the patents for the majority of hi-tech medicines registered in developed countries are ending. Biosimilar and technology-oriented companies which do not have patents will have the opportunity to enter the biosimilar market and move toward innovative initiatives. The present research proposed a model by which one can evaluate commercialization of achievements obtained from research with a focus on the pharmaceutical biotechnology industry. This is a descriptive-analytic study where mixed methodology is followed by a heuristic approach. The statistical population was pharmaceutical biotechnology experts at universities and research centers in Iran. Structural equations were employed in this research. The results indicate that there are three effective layers within commercialization in the proposed model. These are a general layer (factors associated with management, human capital, legal infrastructure, communication infrastructure, a technical and executive infrastructures, and financial factors), industrial layer (internal industrial factors and pharmaceutical industry factors), and a third layer that included national and international aspects. These layers comprise 6 domains, 21 indices, 41 dimensions, and 126 components. Compilation of these layers (general layer, industrial layer, and national and international aspects) can serve commercialization of research and development as an effective evaluation package.

On multiplying methods in the field of research evaluation

Energy Technology Data Exchange (ETDEWEB)

Derrick, G.; Molas-Gallart, J.; De Rijcke, S.; Meijer, I.; Van der Weijden, I.; Wouters, P.

2016-07-01

This special session forms part of a larger program aimed at the multiplication and integration of methodological approaches in the research evaluation and innovation policy field. The session builds on previous initiatives by Gemma Derrick and colleagues at CWTS, INGENIO, the Rathenau Instituut and SPRU, exploring the advantages of qualitative methodological tools at the STI/ENID conference in Lugano, and an international workshop in London in October 2015. The program is highly topical: the research evaluation field is currently reconsidering its methodological foundations in light of new research questions arising from policy initiatives regarding a) the move toward open science; b) a reconceptualization of research excellence to include societal relevance; c) diversification of academic careers, and d) the search for indicators showcasing responsible research behavior and innovation. This new special session at STI2016 will advance and broaden the scope of previous initiatives by building bridges between cutting edge research involving quantitative, qualitative, and mixed methodological research designs. Bringing together leading experts and promising researchers with distinctive methodological skill-sets, the session will demonstrate the advantages of cross-fertilization between ‘core’ and ‘peripheral’ methodological approaches for the research evaluation and science indicators field. (Author)

Evaluation of doctoral nursing programs in Japan by faculty members and their educational and research activities.

Science.gov (United States)

Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo

2012-07-01

Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan. Copyright © 2011 Elsevier Ltd. All rights reserved.

Current research projects on traffic conflicts technique studies.

NARCIS (Netherlands)

Hondel, M. van den & and Kraay, J.H.

1979-01-01

A review of current research concerning the development, evaluation and use of the traffic conflicts technique is presented. The 32 studies, selected from the IRRD data base, are listed alphabetically by names of countries and under countries by names of research organizations. The IRRD descriptions

Process evaluations in neurological rehabilitation: a mixed-evidence systematic review and recommendations for future research.

Science.gov (United States)

Masterson-Algar, Patricia; Burton, Christopher R; Rycroft-Malone, Jo

2016-11-08

To systematically review how process evaluations are currently designed, what methodologies are used and how are they developed alongside or within neurological rehabilitation trials. This mixed-methods systematic review had two evidence streams: stream I, studies reporting process evaluations alongside neurorehabilitation trials research and stream II, methodological guidance on process evaluation design and methodology. A search strategy was designed for each evidence stream. Data regarding process evaluation core concepts and design issues were extracted using a bespoke template. Evidence from both streams was analysed separately and then synthesised in a final overarching synthesis proposing a number of recommendations for future research. A total of 124 process evaluation studies, reporting on 106 interventions, were included in stream I evidence. 30 studies were included as stream II evidence. Synthesis 1 produced 9 themes, and synthesis 2 identified a total of 8 recommendations for process evaluation research. The overall synthesis resulted in 57 'synthesis recommendations' about process evaluation methodology grouped into 9 research areas, including the use of theory, the investigation of context, intervention staff characteristics and the delivery of the trial intervention. There remains no consensus regarding process evaluation terminology within the neurological rehabilitation field. There is a need for process evaluations to address the nature and influence of context over time. Process evaluations should clearly describe what intervention staff bring to a trial, including skills and experience prior to joining the research. Process evaluations should monitor intervention staff's learning effects and the possible impact that these may have on trial outcomes. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

New approaches to the economic evaluation of fusion research

International Nuclear Information System (INIS)

Hazelrigg, G.A.; Lietzke, K.R.

1978-01-01

The economic evaluation of fusion research to date has focussed on the benefits of essentially unlimited energy for future generations. In this paper it is shown that energy research in general, and fusion research in particular, also provides benefits in the short term, benefitting us today as well as future generations. Short-term benefits are the result of two distinct aspects of fusion research. First, fusion research provides information for decision making on both the continuing fusion research efforts and on other energy research programs. Second, fusion research provides an expectation of a future energy source thereby promoting accelerated consumption of existing fossil fuels today. Both short-term benefits can be quantitatively evaluated and both are quite substantial. Together, these short-term benefits form the primary economic rationale for fusion research

State of health economic evaluation research in Saudi Arabia: a review.

Science.gov (United States)

Al-Aqeel, Sinaa A

2012-01-01

If evaluation of economic evidence is to be used increasingly in Saudi Arabia, a review of the published literature would be useful to inform policy decision-makers of the current state of research and plan future research agendas. The purpose of this paper is to provide a critical review of the state of health economic evaluation research within the Saudi context with regard to the number, characteristics, and quality of published articles. A literature search was conducted on May 8, 2011 to identify health economic articles pertaining to Saudi Arabia in the PubMed, Embase, and EconLit databases, using the following terms alone or in combination: "cost*", "economics", "health economics", "cost-effectiveness", "cost-benefit", "cost minimization", "cost utility analysis", and "Saudi". Reference lists of the articles identified were also searched for further articles. The tables of contents of the Saudi Pharmaceutical Journal and the Saudi Medical Journal were reviewed for the previous 5 years. The search identified 535 citations. Based on a reading of abstracts and titles, 477 papers were excluded. Upon reviewing the full text of the remaining 58 papers, 43 were excluded. Fifteen papers were included. Ten were categorized as full economic evaluations and five as partial economic evaluations. These articles were published between 1997 and 2010. The majority of the studies identified did not clearly state the perspective of their evaluation. There are many concerns about the methods used to collect outcome and costs data. Only one study used some sort of sensitivity analysis to assess the effects of uncertainty on the robustness of its conclusions. This review highlights major flaws in the design, analysis, and reporting of the identified economic analyses. Such deficiencies mean that the local economic evidence available to decision-makers is not very useful. Thus, building research capability in health economics is warranted.

The risk-benefit task of research ethics committees: An evaluation of current approaches and the need to incorporate decision studies methods

Directory of Open Access Journals (Sweden)

Bernabe Rosemarie D L C

2012-04-01

Full Text Available Abstract Background Research ethics committees (RECs are tasked to assess the risks and the benefits of a trial. Currently, two procedure-level approaches are predominant, the Net Risk Test and the Component Analysis. Discussion By looking at decision studies, we see that both procedure-level approaches conflate the various risk-benefit tasks, i.e., risk-benefit assessment, risk-benefit evaluation, risk treatment, and decision making. This conflation makes the RECs’ risk-benefit task confusing, if not impossible. We further realize that RECs are not meant to do all the risk-benefit tasks; instead, RECs are meant to evaluate risks and benefits, appraise risk treatment suggestions, and make the final decision. Conclusion As such, research ethics would benefit from looking beyond the procedure-level approaches and allowing disciplines like decision studies to be involved in the discourse on RECs’ risk-benefit task.

Research on Evaluation Use: A Review of the Empirical Literature from 1986 to 2005

Science.gov (United States)

Johnson, Kelli; Greenseid, Lija O.; Toal, Stacie A.; King, Jean A.; Lawrenz, Frances; Volkov, Boris

2009-01-01

This paper reviews empirical research on the use of evaluation from 1986 to 2005 using Cousins and Leithwood's 1986 framework for categorizing empirical studies of evaluation use conducted since that time. The literature review located 41 empirical studies of evaluation use conducted between 1986 and 2005 that met minimum quality standards. The…

Design, Implementation and Evaluation of School-Based Sexual Health Education in Sub-Saharan Africa: A Qualitative Study of Researchers' Perspectives

Science.gov (United States)

Sani, A. Sadiq; Abraham, Charles; Denford, Sarah; Mathews, Catherine

2018-01-01

This study investigated facilitators and challenges to designing, implementing and evaluating school-based sexual health education in sub-Saharan Africa, using interviews with intervention designers and researchers. At the pre-planning and planning stages, participants reported that facilitating factors included addressing the reproductive health…

Evaluating the outcomes and processes of a research-action partnership: The need for continuous reflective evaluation

Directory of Open Access Journals (Sweden)

Chantal Taylor

2016-12-01

Full Text Available Background: The KwaZulu-Natal Sandstone Sourveld (KZNSS Research Programme is part of a collaborative, transdisciplinary research partnership between the University of KwaZulu-Natal and the eThekwini Municipality (EM, aimed at bridging the science-policy-practice gap. The research programme focuses on generating knowledge and capacity to support local land-use planning, management and policy development related to biodiversity and climate change issues. Objectives: The objectives were (1 to describe how a continuous reflective evaluation approach helped to better understand the research programme and its outcomes; and (2 to assess research outputs and outcomes, relevance of outcomes to the requirements of EM, and participants’ perceptions of the programme (both the outcomes and the process. Methods: The evaluation took a mixed methods approach, combining various quantitative and qualitative methods such as anonymous individual questionnaires, reflective exercises and group reflections. Results: The KZNSS programme was successful in capacity building and establishing a long-term partnership, but had lower scientific publication output and practice uptake than expected. Participants’ perceptions changed over time, with a decrease in the perceived success of addressing tangible research outcomes, and an increase in the perceived success of collaborative relationships in the partnership. Conclusion: Transdisciplinary partnerships can be a means of integrating research into policy and practice through knowledge exchange. An important lesson in the early stages of this partnership was to pay attention to the process and not only the outputs. The study highlights the importance of continuous participatory reflection and evaluation in such partnerships.

Using mixed methods to develop and evaluate complex interventions in palliative care research.

Science.gov (United States)

Farquhar, Morag C; Ewing, Gail; Booth, Sara

2011-12-01

there is increasing interest in combining qualitative and quantitative research methods to provide comprehensiveness and greater knowledge yield. Mixed methods are valuable in the development and evaluation of complex interventions. They are therefore particularly valuable in palliative care research where the majority of interventions are complex, and the identification of outcomes particularly challenging. this paper aims to introduce the role of mixed methods in the development and evaluation of complex interventions in palliative care, and how they may be used in palliative care research. the paper defines mixed methods and outlines why and how mixed methods are used to develop and evaluate complex interventions, with a pragmatic focus on design and data collection issues and data analysis. Useful texts are signposted and illustrative examples provided of mixed method studies in palliative care, including a detailed worked example of the development and evaluation of a complex intervention in palliative care for breathlessness. Key challenges to conducting mixed methods in palliative care research are identified in relation to data collection, data integration in analysis, costs and dissemination and how these might be addressed. the development and evaluation of complex interventions in palliative care benefit from the application of mixed methods. Mixed methods enable better understanding of whether and how an intervention works (or does not work) and inform the design of subsequent studies. However, they can be challenging: mixed method studies in palliative care will benefit from working with agreed protocols, multidisciplinary teams and engaging staff with appropriate skill sets.

[Evaluation and prioritisation of the scientific research in Spain. Researchers' point of view].

Science.gov (United States)

María Martín-Moreno, José; Juan Toharia, José; Gutiérrez Fuentes, José Antonio

2008-12-01

The assessment and prioritisation of research activity are essential components of any Science, Technology and Industry System. Data on researchers' perspectives in this respect are scarce. The objective of this paper was to describe Spanish scientists' point of view on the current evaluation system in Spain and how they believe this system should be functionally structured. From the sampling frame formed by established Spanish scientists, listed in the databases of CSIC and FIS (Institute of Health Carlos III), clinical, biomedical-non clinical, and physics and chemical researchers were randomly selected. Two hundred and eleven interviews were carried out by means of a computer-assisted telephone interviewing system. Researchers expressed their acknowledgement of progress in the Spanish research field but made their wish clear to progress towards better scientific scenarios. In their assessment, they gave a score of 5.4 to scientific policy, as opposed to 9.4 when speaking about the goals, reflecting the desire for a better policy definition, with clear objectives, stable strategies and better coordination of R&D activities (the current coordination received a score of 3.9, while the desirable coordination was valued as high as 9.2). There was certain agreement regarding the need for a prioritisation criteria which preserves some degree of creativity by researchers. They also stated that they would like to see an independent research structure with social prestige and influence. The interviewed researchers believe that the evaluation of scientific activities is fundamental in formulating a sound scientific policy. Prioritisation should arise from appropriate evaluation. Strategies properly coordinated among all the stakeholders (including the private sector) should be fostered. Budget sufficiency, stability, and better organization of independent researchers should be the backbone of any strategy tailored to increase their capacity to influence future scientific

Evaluation of the work of hospital districts' research ethics committees in Finland.

Science.gov (United States)

Halila, Ritva

2014-12-01

The main task of research ethics committees (RECs) is to assess research studies before their start. In this study, 24 RECs that evaluate medical research were sent questionnaires about their structure and functions. The RECs were divided into two separate groups: those working in university hospital districts (uRECs) and those in central hospital districts (non-uRECs). The two groups were different in many respects: the uRECs were bigger in size, covered a wider range of disciplines (both medical and non-medical), had better resources and more frequent and regular meetings. After the survey was performed and analysed, the Medical Research Act was amended so that only hospital districts with a medical faculty in their region had a duty to establish ethics committees. After the amendment, the number of RECs evaluating medical research in Finland decreased from 25 to 9. The ethics committees that remained had wider expertise and were better equipped already by the time of this survey. Only one non-uREC was continuing its work, and this was being done under the governance of a university hospital district. Simple measures were used for qualitative analysis of the work of RECs that evaluate medical research. These showed differences between RECs. This may be helpful in establishing an ethics committee network in a research field or administrational area. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Employing Quality Principles in Evaluating Research Companies According to I.S.O Requirements 9001/2000 (AL-Melad Company Case Study

Directory of Open Access Journals (Sweden)

Abdulrahman A. Ibrahem

2013-05-01

Full Text Available Research companies are considered to be the pioneer in the country since it have  advanced personal staff of high qualification. Thus it is considered as shining point in the society. Therefore, it have to be the first in applying the quality requirements. This will positively reflected on its performance.            The research aim is to evaluate the quality management for Al-Melad Company. In the present study, the current system of Al-Melad company is evaluated according to  I.S.O 9001/2000 requirement. A computer program is prepared for this purpose to facilitate evaluation process depending on check lists of quality requirements and on field existing conditions living with experts and on the information presented to the program operator through interviews, documents and registries.            The program  will evaluate each element and the pivot in the system and then a total evaluation of the applied quality system. It is found that the congruence percentage with the requirements is 29.84%. This finding illustrate the need of construction quality system based on mixing the functions of the main management (planning and organizing with I.S.O specification 9001/2000 and principles of total quality management.

Program Evaluation - Automotive Lightweighting Materials Program Research and Development Projects Assessment of Benefits - Case Studies No. 2

Energy Technology Data Exchange (ETDEWEB)

Das, S.

2003-01-23

This report is the second of a series of studies to evaluate research and development (R&D) projects funded by the Automotive Lightweighting Materials (ALM) Program of the Office of Advanced Automotive Technologies (OAAT) of the U.S. Department of Energy (DOE). The objectives of the program evaluation are to assess short-run outputs and long-run outcomes that may be attributable to the ALM R&D projects. The ALM program focuses on the development and validation of advanced technologies that significantly reduce automotive vehicle body and chassis weight without compromising other attributes such as safety, performance, recyclability, and cost. Funded projects range from fundamental materials science research to applied research in production environments. Collaborators on these projects include national laboratories, universities, and private sector firms, such as leading automobile manufacturers and their suppliers. Three ALM R&D projects were chosen for this evaluation: Design and Product Optimization for Cast Light Metals, Durability of Lightweight Composite Structures, and Rapid Tooling for Functional Prototyping of Metal Mold Processes. These projects were chosen because they have already been completed. The first project resulted in development of a comprehensive cast light metal property database, an automotive application design guide, computerized predictive models, process monitoring sensors, and quality assurance methods. The second project, the durability of lightweight composite structures, produced durability-based design criteria documents, predictive models for creep deformation, and minimum test requirements and suggested test methods for establishing durability properties and characteristics of random glass-fiber composites for automotive structural composites. The durability project supported Focal Project II, a validation activity that demonstrates ALM program goals and reduces the lead time for bringing new technology into the marketplace. Focal

Primary prevention research: a preliminary review of program outcome studies.

Science.gov (United States)

Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

1980-07-01

This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

Towards mHealth Systems for Support of Psychotherapeutic Practice: A Qualitative Study of Researcher-Clinician Collaboration in System Design and Evaluation

Directory of Open Access Journals (Sweden)

Karin Halje

2016-01-01

Full Text Available We examined clinicians’ and researchers’ experiences from participation in collaborative research on the introduction of Internet and mobile information systems (mHealth systems in psychotherapeutic routines. The study used grounded theory methodology and was set in a collaboration that aimed to develop and evaluate mHealth support of psychotherapy provided to young people. Soundness of the central objects developed in the design phase (the collaboration contract, the trial protocol, and the system technology was a necessary foundation for successful collaborative mHealth research; neglect of unanticipated organizational influences during the trial phase was a factor in collaboration failure. The experiences gained in this study can be used in settings where collaborative research on mHealth systems in mental health is planned.

Diagnostic and economic evaluation of new biomarkers for Alzheimer’s disease: the research protocol of a prospective cohort study

Directory of Open Access Journals (Sweden)

Handels Ron LH

2012-08-01

Full Text Available Abstract Background New research criteria for the diagnosis of Alzheimer’s disease (AD have recently been developed to enable an early diagnosis of AD pathophysiology by relying on emerging biomarkers. To enable efficient allocation of health care resources, evidence is needed to support decision makers on the adoption of emerging biomarkers in clinical practice. The research goals are to 1 assess the diagnostic test accuracy of current clinical diagnostic work-up and emerging biomarkers in MRI, PET and CSF, 2 perform a cost-consequence analysis and 3 assess long-term cost-effectiveness by an economic model. Methods/design In a cohort design 241 consecutive patients suspected of having a primary neurodegenerative disease are approached in four academic memory clinics and followed for two years. Clinical data and data on quality of life, costs and emerging biomarkers are gathered. Diagnostic test accuracy is determined by relating the clinical practice and new research criteria diagnoses to a reference diagnosis. The clinical practice diagnosis at baseline is reflected by a consensus procedure among experts using clinical information only (no biomarkers. The diagnosis based on the new research criteria is reflected by decision rules that combine clinical and biomarker information. The reference diagnosis is determined by a consensus procedure among experts based on clinical information on the course of symptoms over a two-year time period. A decision analytic model is built combining available evidence from different resources among which (accuracy results from the study, literature and expert opinion to assess long-term cost-effectiveness of the emerging biomarkers. Discussion Several other multi-centre trials study the relative value of new biomarkers for early evaluation of AD and related disorders. The uniqueness of this study is the assessment of resource utilization and quality of life to enable an economic evaluation. The study results

Research Evaluation and the Assessment of Public Value

Science.gov (United States)

Molas-Gallart, Jordi

2015-01-01

Funding organisations are increasingly asking academics to show evidence of the economic and social value generated by their research. These requests have often been associated with the emergence of a so-called "new social contract for research" and are related to the implementation of new research evaluation systems. Although the…

Handbook for evaluation studies in virtual reality

DEFF Research Database (Denmark)

Livatino, Salvatore; Koeffel, Christina

2006-01-01

of human behavior including aspects of perception, action, and task-performance. The evaluation issue calls for multi- and interdisciplinary research activities, where technical expertise is combined with humanistic knowledge and methodology. Several experts in the field of VR as well as in the field...... in evaluation studies as well as students. The aim is also to facilitate multi-disciplinary activities through the use of an evaluation handbook which would be simple and focused on VR. The applicability of this guideline has been tested in two pilot studies, which showed how this handbook could successfully...... be employed to carry out pilot (and formal) evaluations....

Research methodology workshops evaluation using the Kirkpatrick's model: translating theory into practice.

Science.gov (United States)

Abdulghani, Hamza Mohammad; Shaik, Shaffi Ahamed; Khamis, Nehal; Al-Drees, Abdulmajeed Abdulrahman; Irshad, Mohammad; Khalil, Mahmoud Salah; Alhaqwi, Ali Ibrahim; Isnani, Arthur

2014-04-01

Qualitative and quantitative evaluation of academic programs can enhance the development, effectiveness, and dissemination of comparative quality reports as well as quality improvement efforts. To evaluate the five research methodology workshops through assessing participants' satisfaction, knowledge and skills gain and impact on practices by the Kirkpatrick's evaluation model. The four level Kirkpatrick's model was applied for the evaluation. Training feedback questionnaires, pre and post tests, learner development plan reports and behavioral surveys were used to evaluate the effectiveness of the workshop programs. Of the 116 participants, 28 (24.1%) liked with appreciation, 62 (53.4%) liked with suggestions and 26 (22.4%) disliked the programs. Pre and post MCQs tests mean scores showed significant improvement of relevant basic knowledge and cognitive skills by 17.67% (p ≤ 0.005). Pre-and-post tests scores on workshops sub-topics also significantly improved for the manuscripts (p ≤ 0.031) and proposal writing (p ≤ 0.834). As for the impact, 56.9% of participants started research, and 6.9% published their studies. The results from participants' performance revealed an overall positive feedback and 79% of participant reported transfer of training skills at their workplace. The course outcomes achievement and suggestions given for improvements offer insight into the program which were encouraging and very useful. Encouraging "research culture" and work-based learning are probably the most powerful determinants for research promotion. These findings therefore encourage faculty development unit to continue its training and development in the research methodology aspects.

In situ stress determination research study

International Nuclear Information System (INIS)

Austin, W.G.; Thompson, P.M.

1994-01-01

The objectives of this study are to evaluate and implement rock stress determination instruments and techniques developed by Atomic Energy of Canada Limited (AECL) at its Underground Research Laboratory (URL) for use in jointed rock and to continue the development of analytical and interpretation methods for stress determination results including effects of scale, structure and anisotropy. Testing and evaluation of the instruments and methods developed at URL need to be done in a similar rock type prior to underground access at the Yucca Mountain Site Characterization Project

The design and research of poverty alleviation monitoring and evaluation system: a case study in the Jiangxi province

Science.gov (United States)

Mo, Hong-yuan; Wang, Ying-jie; Yu, Zhuo-yuan

2009-07-01

The Poverty Alleviation Monitoring and Evaluation System (PAMES) is introduced in this paper. The authors present environment platform selection, and details of system design and realization. Different with traditional research of poverty alleviation, this paper develops a new analytical geo-visualization approach to study the distribution and causes of poverty phenomena within Geographic Information System (GIS). Based on the most detailed poverty population data, the spatial location and population statistical indicators of poverty village in Jiangxi province, the distribution characteristics of poverty population are detailed. The research results can provide much poverty alleviation decision support from a spatial-temporal view. It should be better if the administrative unit of poverty-stricken area to be changed from county to village according to spatial distribution pattern of poverty.

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

Science.gov (United States)

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Conference presentation to publication: a retrospective study evaluating quality of abstracts and journal articles in medical education research.

Science.gov (United States)

Stephenson, Christopher R; Vaa, Brianna E; Wang, Amy T; Schroeder, Darrell R; Beckman, Thomas J; Reed, Darcy A; Sawatsky, Adam P

2017-11-09

There is little evidence regarding the comparative quality of abstracts and articles in medical education research. The Medical Education Research Study Quality Instrument (MERSQI), which was developed to evaluate the quality of reporting in medical education, has strong validity evidence for content, internal structure, and relationships to other variables. We used the MERSQI to compare the quality of reporting for conference abstracts, journal abstracts, and published articles. This is a retrospective study of all 46 medical education research abstracts submitted to the Society of General Internal Medicine 2009 Annual Meeting that were subsequently published in a peer-reviewed journal. We compared MERSQI scores of the abstracts with scores for their corresponding published journal abstracts and articles. Comparisons were performed using the signed rank test. Overall MERSQI scores increased significantly for published articles compared with conference abstracts (11.33 vs 9.67; P quality of medical education abstracts and journal articles using the MERSQI. Overall, the quality of articles was greater than that of abstracts. However, there were no significant differences between abstracts and articles for the domains of study design and outcomes, which indicates that these MERSQI elements may be applicable to abstracts. Findings also suggest that abstract quality is generally preserved from original presentation to publication.

Five Steps to Successfully Implement and Evaluate Propensity Score Matching in Clinical Research Studies.

Science.gov (United States)

Staffa, Steven J; Zurakowski, David

2018-01-09

-matched data to compare outcomes among treatment groups.PSM is becoming an increasingly more popular statistical methodology in medical research. It often allows for improved evaluation of a treatment effect that may otherwise be invalid due to a lack of balance between the 2 treatment groups with regard to confounding variables. PSM may increase the level of evidence of a study and in turn increases the strength and generalizability of its results. Our step-by-step approach provides a useful strategy for anesthesiologists to implement PSM in their future research.

An evaluation of Irish general surgical research publications from 2000 to 2009.

LENUS (Irish Health Repository)

Robertson, I J

2010-12-01

Maintaining a high standard of research, and being competitive in the funding application process requires a coordinated and focused research strategy. The first step in the formulation of such a strategy is the identification of those centres, and specifically those areas of study, in which Irish surgical research has previously performed strongly. The aim of this paper was to evaluate all surgical research produced in the Republic of Ireland in the first ten years of the new millennium.

Evaluation of KFB-funded research on transport systems

Energy Technology Data Exchange (ETDEWEB)

Boyce, D.; Knudsen, T.; Wegener, M.

1999-09-01

This report presents an evaluation of two research projects on transport systems, which have been financed fully or partially by KFB. The projects are: l. Systems analysis of transport markets at the Division of Transport and Location Analysis in the Department of Infrastructure and Planning of the Royal Institute of Technology, Stockholm; and 2. Planning, analysis and management in traffic networks - optimization models and methods at the Division of Optimization in the Department of Mathematics at Linkoeping University. The evaluation seeks to examine the scientific quality of the research and its relevance to the academic world and society. The two project teams prepared a self-assessment of their research activities and submitted copies of relevant publications. The evaluation committee visited both institutions and engaged the teams in discussions of their results and methodology. These visits occurred on June 1 and 2, 1999. This report is based on the self-assessments of the teams, the materials submitted and the meetings with the project teams. The evaluation and recommendations presented in the report are those of the reviewers and do not necessarily represent the views of KFB

Quantitative evaluation research of glare from automotive headlamps

Science.gov (United States)

Wang, Tiecheng; Qian, Rui; Cao, Ye; Gao, Mingqiu

2018-01-01

This study concerns the quantized evaluation research of glare from automotive headlamps. In the actual regulations, only one point in the test screen is set for judging whether driver can bear the light caused by headlamps of opposing vehicle. To evaluating practical effect of glare, we accept a glare zone with the probability distribution information of the oncoming driver's eye position. In this focus area, glare level of headlamp is represented by weighted luminous flux. To confirm the most comfortable illuminance value to human eyes at 50 m, we used test point B50L as observation position, and collected 1,000 subjective evaluation data from 20 test personnel in different ages during two months. Basing on the assessment results, we calculated 0.60 lx as recommended value for standardized testing procedure at 25 m. Then we figured out 0.38 lm as optimum value, and 0.25 / 1.20 lm as limiting values depending on regulations. We tested 40 sample vehicles with different levels to verify the sectional nonlinear quantitative evaluation method we designed, and analyzed the typical test results.

Evaluation and Characterization of Health Economics and Outcomes Research in SAARC Nations.

Science.gov (United States)

Mehta, Manthan; Nerurkar, Rajan

2018-05-01

To identify, evaluate, and characterize the variety, quality, and intent of the health economics and outcomes research studies being conducted in SAARC (South Asian Association for Regional Cooperation) nations. Studies published in English language between 1990 and 2015 were retrieved from Medline databases using relevant search strategies. Studies were independently reviewed as per Cochrane methodology and information on the type of research and outcomes were extracted. Quality of reporting was assessed. Of the 2638 studies screened from eight SAARC nations, a total of 179 were included for review (India = 140; Bangladesh = 12; Sri Lanka = 8; Pakistan = 7; Afghanistan = 5; Nepal = 4; Bhutan = 2; Maldives = 1). The broad study categories were cost-effectiveness analyses (CEAs = 76 studies), cost analyses (35 studies), and burden of illness (BOI=26 studies). The outcomes evaluated were direct costs, indirect costs, and incremental cost-effectiveness ratio (ICER), quality-adjusted life-years (QALYs), and disability-adjusted life-years (DALYs). Cost of medicines, consultation and hospital charges, and monitoring costs were assessed as direct medical costs along with non-direct medical costs such as travel and food for patients and caregivers. The components of indirect costs were loss of income of patients and caregivers and loss of productivity. Quality of life (QoL) was assessed in 48 studies. The most commonly used instrument for assessing QoL was the WHO-Quality of Life BREF (WHOQOL-BREF) questionnaire (76%). The Quality of Health Economic Studies (QHES) score was used for quality assessment of full economic studies (44 studies). The mean QHES score was 43.76. This review identifies various patterns of health economic studies in eight SAARC nations. The quality of economic evaluation studies for health care in India, Bangladesh, Sri Lanka, Pakistan, Afghanistan, Nepal, Bhutan, and Maldives needs improvement. There is a need to generate the capacity of researchers

Evaluation of a 'virtual' approach to commissioning health research.

Science.gov (United States)

McCourt, Christine A; Morgan, Philip A; Youll, Penny

2006-10-18

The objective of this study was to evaluate the implementation of a 'virtual' (computer-mediated) approach to health research commissioning. This had been introduced experimentally in a DOH programme--the 'Health of Londoners Programme'--in order to assess whether is could enhance the accessibility, transparency and effectiveness of commissioning health research. The study described here was commissioned to evaluate this novel approach, addressing these key questions. A naturalistic-experimental approach was combined with principles of action research. The different commissioning groups within the programme were randomly allocated to either the traditional face-to-face mode or the novel 'virtual' mode. Mainly qualitative data were gathered including observation of all (virtual and face-to-face) commissioning meetings; semi-structured interviews with a purposive sample of participants (n = 32/66); structured questionnaires and interviews with lead researchers of early commissioned projects. All members of the commissioning groups were invited to participate in collaborative enquiry groups which participated actively in the analysis process. The virtual process functioned as intended, reaching timely and relatively transparent decisions that participants had confidence in. Despite the potential for greater access using a virtual approach, few differences were found in practice. Key advantages included physical access, a more flexible and extended time period for discussion, reflection and information gathering and a more transparent decision-making process. Key challenges were the reduction of social cues available in a computer-mediated medium that require novel ways of ensuring appropriate dialogue, feedback and interaction. However, in both modes, the process was influenced by a range of factors and was not technology driven. There is potential for using computer-mediated communication within the research commissioning process. This may enhance access

Research on the Evaluation System for Rural Public Safety Planning

Institute of Scientific and Technical Information of China (English)

Ming; SUN; Jianxin; YAN

2014-01-01

The indicator evaluation system is introduced to the study of rural public safety planning in this article.By researching the current rural public safety planning and environmental carrying capacity,we select some carrying capacity indicators influencing the rural public safety,such as land,population,ecological environment,water resources,infrastructure,economy and society,to establish the environmental carrying capacity indicator system.We standardize the indicators,use gray correlation analysis method to determine the weight of indicators,and make DEA evaluation of the indicator system,to obtain the evaluation results as the basis for decision making in rural safety planning,and provide scientific and quantified technical support for rural public safety planning.

Evaluation of a learner-designed course for teaching health research skills in Ghana

Directory of Open Access Journals (Sweden)

Agbenyega Tsiri

2007-06-01

Full Text Available Abstract Background In developing countries the ability to conduct locally-relevant health research and high quality education are key tools in the fight against poverty. The objective of our study was to evaluate the effectiveness of a novel UK accredited, learner-designed research skills course delivered in a teaching hospital in Ghana. Methods Study participants were 15 mixed speciality health professionals from Komfo Anokye Teaching Hospital, Kumasi, Ghana. Effectiveness measures included process, content and outcome indicators to evaluate changes in learners' confidence and competence in research, and assessment of the impact of the course on changing research-related thinking and behaviour. Results were verified using two independent methods. Results 14/15 learners gained research competence assessed against UK Quality Assurance Agency criteria. After the course there was a 36% increase in the groups' positive responses to statements concerning confidence in research-related attitudes, intentions and actions. The greatest improvement (45% increase was in learners' actions, which focused on strengthening institutional research capacity. 79% of paired before/after responses indicated positive changes in individual learners' research-related attitudes (n = 53, 81% in intention (n = 52 and 85% in action (n = 52. The course had increased learners' confidence to start and manage research, and enhanced life-long skills such as reflective practice and self-confidence. Doing their own research within the work environment, reflecting on personal research experiences and utilising peer support and pooled knowledge were critical elements that promoted learning. Conclusion Learners in Ghana were able to design and undertake a novel course that developed individual and institutional research capacity and met international standards. Learning by doing and a supportive peer community at work were critical elements in promoting learning in this environment

Evaluating meta-ethnography: systematic analysis and synthesis of qualitative research.

Science.gov (United States)

Campbell, R; Pound, P; Morgan, M; Daker-White, G; Britten, N; Pill, R; Yardley, L; Pope, C; Donovan, J

2011-12-01

Methods for reviewing and synthesising findings from quantitative research studies in health care are well established. Although there is recognition of the need for qualitative research to be brought into the evidence base, there is no consensus about how this should be done and the methods for synthesising qualitative research are at a relatively early stage of development. To evaluate meta-ethnography as a method for synthesising qualitative research studies in health and health care. Two full syntheses of qualitative research studies were conducted between April 2002 and September 2004 using meta-ethnography: (1) studies of medicine-taking and (2) studies exploring patients' experiences of living with rheumatoid arthritis. Potentially relevant studies identified in multiple literature searches conducted in July and August 2002 (electronically and by hand) were appraised using a modified version of the Critical Appraisal Skills Programme questions for understanding qualitative research. Candidate papers were excluded on grounds of lack of relevance to the aims of the synthesis or because the work failed to employ qualitative methods of data collection and analysis. Thirty-eight studies were entered into the medicine-taking synthesis, one of which did not contribute to the final synthesis. The synthesis revealed a general caution about taking medicine, and that the practice of lay testing of medicines was widespread. People were found to take their medicine passively or actively or to reject it outright. Some, in particular clinical areas, were coerced into taking it. Those who actively accepted their medicine often modified the regimen prescribed by a doctor, without the doctor's knowledge. The synthesis concluded that people often do not take their medicines as prescribed because of concern about the medicines themselves. 'Resistance' emerged from the synthesis as a concept that best encapsulated the lay response to prescribed medicines. It was suggested that a

Report of the evaluation by the Ad Hoc Review Committee on Nuclear Safety Research. Result evaluation in fiscal year 2000

International Nuclear Information System (INIS)

2001-06-01

The Research Evaluation Committee, which consisted of 14 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Nuclear Safety Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the R and D accomplishments achieved for five years from Fiscal Year 1995 to Fiscal Year 1999 at Department of Reactor Safety Research, Department of Fuel Cycle Safety Research, Department of Environmental Safety Research and Department of Safety Research Technical Support in Tokai Research Establishment at JAERI. The Ad Hoc Review Committee consisted of 11 specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from December 2000 to February 2001. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on December 11, 2000, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on March 16, 2001. This report describes the result of the evaluation by the Ad Hoc Review Committee on Nuclear Safety Research. (author)

Neuroscience-related research in Ghana: a systematic evaluation of direction and capacity.

Science.gov (United States)

Quansah, Emmanuel; Karikari, Thomas K

2016-02-01

Neurological and neuropsychiatric diseases account for considerable healthcare, economic and social burdens in Ghana. In order to effectively address these burdens, appropriately-trained scientists who conduct high-impact neuroscience research will be needed. Additionally, research directions should be aligned with national research priorities. However, to provide information about current neuroscience research productivity and direction, the existing capacity and focus need to be identified. This would allow opportunities for collaborative research and training to be properly explored and developmental interventions to be better targeted. In this study, we sought to evaluate the existing capacity and direction of neuroscience-related research in Ghana. To do this, we examined publications reporting research investigations authored by scientists affiliated with Ghanaian institutions in specific areas of neuroscience over the last two decades (1995-2015). 127 articles that met our inclusion criteria were systematically evaluated in terms of research foci, annual publication trends and author affiliations. The most actively-researched areas identified include neurocognitive impairments in non-nervous system disorders, depression and suicide, epilepsy and seizures, neurological impact of substance misuse, and neurological disorders. These studies were mostly hospital and community-based surveys. About 60% of these articles were published in the last seven years, suggesting a recent increase in research productivity. However, data on experimental and clinical research outcomes were particularly lacking. We suggest that future investigations should focus on the following specific areas where information was lacking: large-scale disease epidemiology, effectiveness of diagnostic platforms and therapeutic treatments, and the genetic, genomic and molecular bases of diseases.

Sustainable operations in nuclear research reactors. A bibliographical study

International Nuclear Information System (INIS)

Kibrit, Eduardo; Rodrigues de Aquino, Afonso; Marotti de Mello, Adriana; Tromboni de Souza Nascimento, Paulo

2017-01-01

Sustainability is gaining prominence in the area of operations management. By means of a bibliographical research, we identified in literature sustainable operations carried out by operating organizations of nuclear research reactors. The methodology applied consisted in gathering material, descriptive analysis, selection of analytical categories and evaluation of the material collected. The collection of material was performed by a search made on academic and nuclear databases, with keywords structured for the subject of the research. The collected material was analysed and analytical categories on the theme sustainable operations were established. The evaluation of the collected material resulted in references accepted for the study, classified according to the pre-established analytical categories. The results were significant. From then on, a theoretical review on the topic under study was structured, based on pre-defined analytical categories. Thus, we were able to identify gaps in the literature and propose new studies on the subject.

Sustainable operations in nuclear research reactors. A bibliographical study

Energy Technology Data Exchange (ETDEWEB)

Kibrit, Eduardo; Rodrigues de Aquino, Afonso [Cidade Univ., Sao Paolo (Brazil). Inst. de Pesquisas Energeticas e Nucleares; Marotti de Mello, Adriana [Sao Paolo Univ. (Brazil). Faculdade de Economia; Tromboni de Souza Nascimento, Paulo [Sao Paolo Univ. (Brazil). Faculdade de Economia Administracao e Contabilidade

2017-10-15

Sustainability is gaining prominence in the area of operations management. By means of a bibliographical research, we identified in literature sustainable operations carried out by operating organizations of nuclear research reactors. The methodology applied consisted in gathering material, descriptive analysis, selection of analytical categories and evaluation of the material collected. The collection of material was performed by a search made on academic and nuclear databases, with keywords structured for the subject of the research. The collected material was analysed and analytical categories on the theme sustainable operations were established. The evaluation of the collected material resulted in references accepted for the study, classified according to the pre-established analytical categories. The results were significant. From then on, a theoretical review on the topic under study was structured, based on pre-defined analytical categories. Thus, we were able to identify gaps in the literature and propose new studies on the subject.

Assessing Statistical Change Indices in Selected Social Work Intervention Research Studies

Science.gov (United States)

Ham, Amanda D.; Huggins-Hoyt, Kimberly Y.; Pettus, Joelle

2016-01-01

Objectives: This study examined how evaluation and intervention research (IR) studies assessed statistical change to ascertain effectiveness. Methods: Studies from six core social work journals (2009-2013) were reviewed (N = 1,380). Fifty-two evaluation (n= 27) and intervention (n = 25) studies met the inclusion criteria. These studies were…

Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC

Directory of Open Access Journals (Sweden)

Rycroft-Malone Jo

2011-07-01

Full Text Available Abstract Background The English National Health Service has made a major investment in nine partnerships between higher education institutions and local health services called Collaborations for Leadership in Applied Health Research and Care (CLAHRC. They have been funded to increase capacity and capability to produce and implement research through sustained interactions between academics and health services. CLAHRCs provide a natural 'test bed' for exploring questions about research implementation within a partnership model of delivery. This protocol describes an externally funded evaluation that focuses on implementation mechanisms and processes within three CLAHRCs. It seeks to uncover what works, for whom, how, and in what circumstances. Design and methods This study is a longitudinal three-phase, multi-method realistic evaluation, which deliberately aims to explore the boundaries around knowledge use in context. The evaluation funder wishes to see it conducted for the process of learning, not for judging performance. The study is underpinned by a conceptual framework that combines the Promoting Action on Research Implementation in Health Services and Knowledge to Action frameworks to reflect the complexities of implementation. Three participating CLARHCS will provide in-depth comparative case studies of research implementation using multiple data collection methods including interviews, observation, documents, and publicly available data to test and refine hypotheses over four rounds of data collection. We will test the wider applicability of emerging findings with a wider community using an interpretative forum. Discussion The idea that collaboration between academics and services might lead to more applicable health research that is actually used in practice is theoretically and intuitively appealing; however the evidence for it is limited. Our evaluation is designed to capture the processes and impacts of collaborative approaches for

Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC).

Science.gov (United States)

Rycroft-Malone, Jo; Wilkinson, Joyce E; Burton, Christopher R; Andrews, Gavin; Ariss, Steven; Baker, Richard; Dopson, Sue; Graham, Ian; Harvey, Gill; Martin, Graham; McCormack, Brendan G; Staniszewska, Sophie; Thompson, Carl

2011-07-19

The English National Health Service has made a major investment in nine partnerships between higher education institutions and local health services called Collaborations for Leadership in Applied Health Research and Care (CLAHRC). They have been funded to increase capacity and capability to produce and implement research through sustained interactions between academics and health services. CLAHRCs provide a natural 'test bed' for exploring questions about research implementation within a partnership model of delivery. This protocol describes an externally funded evaluation that focuses on implementation mechanisms and processes within three CLAHRCs. It seeks to uncover what works, for whom, how, and in what circumstances. This study is a longitudinal three-phase, multi-method realistic evaluation, which deliberately aims to explore the boundaries around knowledge use in context. The evaluation funder wishes to see it conducted for the process of learning, not for judging performance. The study is underpinned by a conceptual framework that combines the Promoting Action on Research Implementation in Health Services and Knowledge to Action frameworks to reflect the complexities of implementation. Three participating CLARHCS will provide in-depth comparative case studies of research implementation using multiple data collection methods including interviews, observation, documents, and publicly available data to test and refine hypotheses over four rounds of data collection. We will test the wider applicability of emerging findings with a wider community using an interpretative forum. The idea that collaboration between academics and services might lead to more applicable health research that is actually used in practice is theoretically and intuitively appealing; however the evidence for it is limited. Our evaluation is designed to capture the processes and impacts of collaborative approaches for implementing research, and therefore should contribute to the evidence

[Research progress on mechanical performance evaluation of artificial intervertebral disc].

Science.gov (United States)

Li, Rui; Wang, Song; Liao, Zhenhua; Liu, Weiqiang

2018-03-01

The mechanical properties of artificial intervertebral disc (AID) are related to long-term reliability of prosthesis. There are three testing methods involved in the mechanical performance evaluation of AID based on different tools: the testing method using mechanical simulator, in vitro specimen testing method and finite element analysis method. In this study, the testing standard, testing equipment and materials of AID were firstly introduced. Then, the present status of AID static mechanical properties test (static axial compression, static axial compression-shear), dynamic mechanical properties test (dynamic axial compression, dynamic axial compression-shear), creep and stress relaxation test, device pushout test, core pushout test, subsidence test, etc. were focused on. The experimental techniques using in vitro specimen testing method and testing results of available artificial discs were summarized. The experimental methods and research status of finite element analysis were also summarized. Finally, the research trends of AID mechanical performance evaluation were forecasted. The simulator, load, dynamic cycle, motion mode, specimen and test standard would be important research fields in the future.

Practical Assessment, Research and Evaluation, 2001.

Science.gov (United States)

Rudner, Lawrence M., Ed.; Schafer, William D., Ed.

2001-01-01

This document consists of articles 23 through 26 published in the electronic journal "Practical Assessment, Research & Evaluation" in 2001: (23) "Effects of Removing the Time Limit on First and Second Language Intelligence Test Performance" (Jennifer Mullane and Stuart J. McKelvie); (24) "Consequences of (Mis)use of the Texas Assessment of…

Report of the summative evaluation by the advisory committee on nuclear safety research

International Nuclear Information System (INIS)

2005-03-01

The Research Evaluation Committee of the Japan Atomic Energy Research Institute (JAERI) set up an Advisory Committee on Nuclear Safety Research in accordance with the 'Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations. The Advisory Committee on Nuclear Safety Research evaluated the adequacy of the plans of nuclear safety research to be succeeded from JAERI to a new research institute which will be established by integration of JAERI and the Japan Nuclear Cycle Development Institute (JNC). The Advisory Committee consisted of eight specialists from outside the JAERI conducted its activities from June 2004 to August 2004. The evaluation was performed on the basis of the materials submitted in advanced and of the oral presentations made at the Advisory Committee meeting which was held on July 27, 2004, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Advisory Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on December 1, 2004. This report describes the result of the evaluation by the Advisory Committee on Safety Research. (author)

Study on development of evaluation technique of in-situ tracer test in Horonobe Underground Research Laboratory project (Contract research)

International Nuclear Information System (INIS)

Yokota, Hideharu; Amano, Kenji; Maekawa, Keisuke; Kunimaru, Takanori; Naemura, Yumi; Ijiri, Yuji; Motoshima, Takayuki; Suzuki, Shunichi; Teshima, Kazufumi

2013-06-01

In the Horonobe Underground Research Laboratory Project, in-situ tracer tests are valuable and important as the investigations to obtain the mass transportation data of fractures in hostrock. However, it is difficult that the in-situ tests are executed under various conditions due to long test period and the tests results are evaluated about permeable heterogeneity in a fracture and/or scale effects. In this study, a number of tracer tests are simulated in a fictitious single plate fracture generated on computer. And the transport parameters are identified by fitting one- and two-dimensional models to the breakthrough curves obtained from the simulations in order to investigate the applicability of these models to the evaluation of in-situ tracer test. As a result, one-dimensional model yields larger longitudinal dispersion length than two-dimensional model in the both cases of homogeneous and heterogeneous hydraulic conductivity fields of the fictitious fracture. This is because that the effect of transverse dispersion has to be included in the longitudinal dispersion length parameter in the one-dimensional model. It is also found that the larger dipole ratio and the larger natural groundwater flow crossing the flow generated between two boreholes make the identified longitudinal dispersion length larger. And, the longitudinal dispersion length identified from a tracer test is smaller and/or larger than the macroscopic longitudinal dispersion length identified from whole fracture. It is clarified that these are occurred by shorter or longer distance between boreholes compare to the correlation length of geostatistical heterogeneity of fictitious fracture. (author)

Report of the evaluation by the Ad Hoc Review Committee on Nuclear Safety Research. Result evaluation in fiscal year 2000

Energy Technology Data Exchange (ETDEWEB)

NONE

2001-06-01

The Research Evaluation Committee, which consisted of 14 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Nuclear Safety Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the R and D accomplishments achieved for five years from Fiscal Year 1995 to Fiscal Year 1999 at Department of Reactor Safety Research, Department of Fuel Cycle Safety Research, Department of Environmental Safety Research and Department of Safety Research Technical Support in Tokai Research Establishment at JAERI. The Ad Hoc Review Committee consisted of 11 specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from December 2000 to February 2001. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on December 11, 2000, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on March 16, 2001. This report describes the result of the evaluation by the Ad Hoc Review Committee on Nuclear Safety Research. (author)

Report of the review committee on evaluation of the research subjects in the field of advanced science research (FY2000)

International Nuclear Information System (INIS)

2000-10-01

On the basis of the JAERI's Basic Guidelines for the Research Evaluation Methods and the Practices Manuals of the Institution Evaluation Committee, the Ad Hoc Review Committee composed of eight experts was set up under the Research Evaluation Committee of the JAERI in order to review the research themes completed in FY1999, those to be ended through FY2000, and those planned for five years starting in FY2001 in the Advanced Science Research Center. The Ad Hoc Review Committee meeting was held on July 17, 2000. According to the review methods including review items, points of review and review criteria, determined by the Research Evaluation Committee, the review was conducted based on the research result/plan documents submitted in advance and presentations by the Research Group Leaders. The review report was submitted to the Research Evaluation Committee for further review and discussions in its meeting held on August 31, 2000. The Research Evaluation Committee recognized the review results as appropriate. This report describes the review results. (author)

Evaluation of university scientific research ability based on the output of sci-tech papers: A D-AHP approach.

Science.gov (United States)

Zong, Fan; Wang, Lifang

2017-01-01

University scientific research ability is an important indicator to express the strength of universities. In this paper, the evaluation of university scientific research ability is investigated based on the output of sci-tech papers. Four university alliances from North America, UK, Australia, and China, are selected as the case study of the university scientific research evaluation. Data coming from Thomson Reuters InCites are collected to support the evaluation. The work has contributed new framework to the issue of university scientific research ability evaluation. At first, we have established a hierarchical structure to show the factors that impact the evaluation of university scientific research ability. Then, a new MCDM method called D-AHP model is used to implement the evaluation and ranking of different university alliances, in which a data-driven approach is proposed to automatically generate the D numbers preference relations. Next, a sensitivity analysis has been given to show the impact of weights of factors and sub-factors on the evaluation result. At last, the results obtained by using different methods are compared and discussed to verify the effectiveness and reasonability of this study, and some suggestions are given to promote China's scientific research ability.

Scaling Research Results: Design and Evaluation | IDRC ...

International Development Research Centre (IDRC) Digital Library (Canada)

Design and evaluation The project will provide helpful guidance to IDRC management and ... scaling and programming for scalable research Offer the monograph in multiple forms, ... Asian outlook: New growth dependent on new productivity.

Process variables in organizational stress management intervention evaluation research: a systematic review.

Science.gov (United States)

Havermans, Bo M; Schlevis, Roosmarijn Mc; Boot, Cécile Rl; Brouwers, Evelien Pm; Anema, Johannes; van der Beek, Allard J

2016-09-01

This systematic review aimed to explore which process variables are used in stress management intervention (SMI) evaluation research. A systematic review was conducted using seven electronic databases. Studies were included if they reported on an SMI aimed at primary or secondary stress prevention, were directed at paid employees, and reported process data. Two independent researchers checked all records and selected the articles for inclusion. Nielsen and Randall's model for process evaluation was used to cluster the process variables. The three main clusters were context, intervention, and mental models. In the 44 articles included, 47 process variables were found, clustered into three main categories: context (two variables), intervention (31 variables), and mental models (14 variables). Half of the articles contained no reference to process evaluation literature. The collection of process evaluation data mostly took place after the intervention and at the level of the employee. The findings suggest that there is great heterogeneity in methods and process variables used in process evaluations of SMI. This, together with the lack of use of a standardized framework for evaluation, hinders the advancement of process evaluation theory development.

Integrating knowledge generation with knowledge diffusion and utilization: a case study analysis of the Consortium for Applied Research and Evaluation in Mental Health.

Science.gov (United States)

Vingilis, Evelyn; Hartford, Kathleen; Schrecker, Ted; Mitchell, Beth; Lent, Barbara; Bishop, Joan

2003-01-01

Knowledge diffusion and utilization (KDU) have become a key focus in the health research community because of the limited success to date of research findings to inform health policies, programs and services. Yet, evidence indicates that successful KDU is often predicated on the early involvement of potential knowledge users in the conceptualization and conduct of the research and on the development of a "partnership culture". This study describes the integration of KDU theory with practice via a case study analysis of the Consortium for Applied Research and Evaluation in Mental Health (CAREMH). This qualitative study, using a single-case design, included a number of data sources: proposals, meeting minutes, presentations, publications, reports and curricula vitae of CAREMH members. CAREMH has adopted the following operational strategies to increase KDU capacity: 1) viewing research as a means and not as an end; 2) bringing the university and researcher to the community; 3) using participatory research methods; 4) embracing transdisciplinary research and interactions; and 5) using connectors. Examples of the iterative process between researchers and potential knowledge users in their contribution to knowledge generation, diffusion and utilization are provided. This case study supports the importance of early and ongoing involvement of relevant potential knowledge users in research to enhance its utilization potential. It also highlights the need for re-thinking research funding approaches.

Exploring perceived barriers, drivers, impacts and the need for evaluation of public involvement in health and social care research: a modified Delphi study

Science.gov (United States)

Snape, D; Kirkham, J; Britten, N; Froggatt, K; Gradinger, F; Lobban, F; Popay, Jennie; Wyatt, K; Jacoby, Ann

2014-01-01

Objective To explore areas of consensus and conflict in relation to perceived public involvement (PI) barriers and drivers, perceived impacts of PI and ways of evaluating PI approaches in health and social care research. Background Internationally and within the UK the recognition of potential benefits of PI in health and social care research is gathering momentum and PI is increasingly identified by organisations as a prerequisite for funding. However, there is relatively little examination of the impacts of PI and how those impacts might be measured. Design Mixed method, three-phase, modified Delphi technique, conducted as part of a larger MRC multiphase project. Sample Clinical and non-clinical academics, members of the public, research managers, commissioners and funders. Findings This study found high levels of consensus about the most important barriers and drivers to PI. There was acknowledgement that tokenism was common in relation to PI; and strong support for the view that demonstrating the impacts and value of PI was made more difficult by tokenistic practice. PI was seen as having intrinsic value; nonetheless, there was clear support for the importance of evaluating its impact. Research team cohesion and appropriate resources were considered essential to effective PI implementation. Panellists agreed that PI can be challenging, but can be facilitated by clear guidance, together with models of good practice and measurable standards. Conclusions This study is the first to present empirical evidence of the opinions voiced by key stakeholders on areas of consensus and conflict in relation to perceived PI barriers and drivers, perceived impacts of PI and the need to evaluate PI. As such it further contributes to debate around best practice in PI, the potential for tokenism and how best to evaluate the impacts of PI. These findings have been used in the development of the Public Involvement Impact Assessment Framework (PiiAF), an online resource which offers

Academic research groups: evaluation of their quality and quality of their evaluation

Science.gov (United States)

Berche, Bertrand; Holovatch, Yuri; Kenna, Ralph; Mryglod, Olesya

2016-02-01

In recent years, evaluation of the quality of academic research has become an increasingly important and influential business. It determines, often to a large extent, the amount of research funding flowing into universities and similar institutes from governmental agencies and it impacts upon academic careers. Policy makers are becoming increasingly reliant upon, and influenced by, the outcomes of such evaluations. In response, university managers are increasingly attracted to simple metrics as guides to the dynamics of the positions of their various institutions in league tables. However, these league tables are invariably drawn up by inexpert bodies such as newspapers and magazines, using arbitrary measures and criteria. Terms such as “critical mass” and “h-index” are bandied about without understanding of what they actually mean. Rather than accepting the rise and fall of universities, departments and individuals on a turbulent sea of arbitrary measures, we suggest it is incumbent upon the scientific community itself to clarify their nature. Here we report on recent attempts to do that by properly defining critical mass and showing how group size influences research quality. We also examine currently predominant metrics and show that these fail as reliable indicators of group research quality.

Some Observations on the Relationships Between Research Productivity and Student Evaluations of Courses and Teaching.

Science.gov (United States)

Stallings, William A.; Singhal, Sushila

"Does the good researcher tend to be a good teacher, and vice versa?" University administrators contend that teaching and research are equally important, though students claim that researchers neglect teaching and professors claim that only their research efforts are rewarded. In this study, course and instructor evaluations were defined…

Current Research Studies

Science.gov (United States)

... Success Home > Explore Research > Current Research Studies Current Research Studies Email Print + Share The Crohn’s & Colitis Foundation ... conducted online. Learn more about IBD Partners. Clinical Research Alliance The Clinical Research Alliance is a network ...

Evaluating the design and reporting of pragmatic trials in osteoarthritis research.

Science.gov (United States)

Ali, Shabana Amanda; Kloseck, Marita; Lee, Karen; Walsh, Kathleen Ellen; MacDermid, Joy C; Fitzsimmons, Deborah

2018-01-01

Among the challenges in health research is translating interventions from controlled experimental settings to clinical and community settings where chronic disease is managed daily. Pragmatic trials offer a method for testing interventions in real-world settings but are seldom used in OA research. The aim of this study was to evaluate the literature on pragmatic trials in OA research up to August 2016 in order to identify strengths and weaknesses in the design and reporting of these trials. We used established guidelines to assess the degree to which 61 OA studies complied with pragmatic trial design and reporting. We assessed design according to the pragmatic-explanatory continuum indicator summary and reporting according to the pragmatic trials extension of the CONsolidated Standards of Reporting Trials guidelines. None of the pragmatic trials met all 11 criteria evaluated and most of the trials met between 5 and 8 of the criteria. Criteria most often unmet pertained to practitioner expertise (by requiring specialists) and criteria most often met pertained to primary outcome analysis (by using intention-to-treat analysis). Our results suggest a lack of highly pragmatic trials in OA research. We identify this as a point of opportunity to improve research translation, since optimizing the design and reporting of pragmatic trials can facilitate implementation of evidence-based interventions for OA care. © The Author 2017. Published by Oxford University Press on behalf of the British Society for Rheumatology. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

Science.gov (United States)

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Study on chemical reactivity control of liquid sodium. Research program

International Nuclear Information System (INIS)

Saito, Jun-ichi; Ara, Kuniaki; Sugiyama, Ken-ichiro; Kitagawa, Hiroshi; Oka, Nobuki; Yoshioka, Naoki

2007-01-01

Liquid sodium has the excellent properties as coolant of the fast breeder reactor (FBR). On the other hand, it reacts high with water and oxygen. So an innovative technology to suppress the reactivity is desired. The purpose of this study is to control the chemical reactivity of liquid sodium by dispersing the nanometer-size metallic particles (we call them Nano-particles) into liquid sodium. We focus on the atomic interaction between Nano-particles and sodium atoms. And we try to apply it to suppress the chemical reactivity of liquid sodium. Liquid sodium dispersing Nano-particles is named 'Nano-fluid'. Research programs of this study are the Nano-particles production, the evaluation of reactivity suppression of liquid sodium and the feasibility study to FBR plant. In this paper, the research programs and status are described. The important factors for particle production were understood. In order to evaluate the chemical reactivity of Nano-fluid the research programs were planned. The feasibility of the application of Nano-fluid to the coolant of FBR plant was evaluated preliminarily from the viewpoint of design and operation. (author)

Evaluation of a 'virtual' approach to commissioning health research

Directory of Open Access Journals (Sweden)

Morgan Philip A

2006-10-01

Full Text Available Abstract Background The objective of this study was to evaluate the implementation of a 'virtual' (computer-mediated approach to health research commissioning. This had been introduced experimentally in a DOH programme – the 'Health of Londoners Programme' – in order to assess whether is could enhance the accessibility, transparency and effectiveness of commissioning health research. The study described here was commissioned to evaluate this novel approach, addressing these key questions. Methods A naturalistic-experimental approach was combined with principles of action research. The different commissioning groups within the programme were randomly allocated to either the traditional face-to-face mode or the novel 'virtual' mode. Mainly qualitative data were gathered including observation of all (virtual and face-to-face commissioning meetings; semi-structured interviews with a purposive sample of participants (n = 32/66; structured questionnaires and interviews with lead researchers of early commissioned projects. All members of the commissioning groups were invited to participate in collaborative enquiry groups which participated actively in the analysis process. Results The virtual process functioned as intended, reaching timely and relatively transparent decisions that participants had confidence in. Despite the potential for greater access using a virtual approach, few differences were found in practice. Key advantages included physical access, a more flexible and extended time period for discussion, reflection and information gathering and a more transparent decision-making process. Key challenges were the reduction of social cues available in a computer-mediated medium that require novel ways of ensuring appropriate dialogue, feedback and interaction. However, in both modes, the process was influenced by a range of factors and was not technology driven. Conclusion There is potential for using computer-mediated communication within

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

Science.gov (United States)

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

Evaluating Community-Based Participatory Research to Improve Community-Partnered Science and Community Health

Science.gov (United States)

Hicks, Sarah; Duran, Bonnie; Wallerstein, Nina; Avila, Magdalena; Belone, Lorenda; Lucero, Julie; Magarati, Maya; Mainer, Elana; Martin, Diane; Muhammad, Michael; Oetzel, John; Pearson, Cynthia; Sahota, Puneet; Simonds, Vanessa; Sussman, Andrew; Tafoya, Greg; Hat, Emily White

2013-01-01

Background Since 2007, the National Congress of American Indians (NCAI) Policy Research Center (PRC) has partnered with the Universities of New Mexico and Washington to study the science of community-based participatory research (CBPR). Our goal is to identify facilitators and barriers to effective community–academic partnerships in American Indian and other communities, which face health disparities. Objectives We have described herein the scientific design of our National Institutes of Health (NIH)-funded study (2009–2013) and lessons learned by having a strong community partner leading the research efforts. Methods The research team is implementing a mixed-methods study involving a survey of principal investigators (PIs) and partners across the nation and in-depth case studies of CBPR projects. Results We present preliminary findings on methods and measures for community-engaged research and eight lessons learned thus far regarding partnership evaluation, advisory councils, historical trust, research capacity development of community partner, advocacy, honoring each other, messaging, and funding. Conclusions Study methodologies and lessons learned can help community–academic research partnerships translate research in communities. PMID:22982842

Nuclear waste. DOE has terminated research evaluating crystalline rock for a repository

International Nuclear Information System (INIS)

Fultz, Keith O.; Sprague, John W.; Weigel, Dwayne E.; Price, Vincent P.

1989-05-01

We found that DOE terminated funding of research projects specifically designed to evaluate the suitability of crystalline rock for a repository. DOE continued other research efforts involving crystalline rock because they will provide information that it considers useful for evaluating the suitability of Yucca Mountain, Nevada, for a potential repository. Such research activities are not prohibited by the amendments. In January 1988, DOE began evaluating both its domestic and international research programs to ensure their compliance with the 1987 amendments. Several DOE offices and contractors were involved in the evaluation. DOE officials believe that the evaluation effectively brought the Office of Civilian Radioactive Waste Management activities into compliance with the amendments while maintaining useful international relations of continuing benefit to the nuclear waste program in general and to DOE's investigation of the Yucca Mountain site in particular. (The 1987 amendments designated Yucca Mountain as the only site that DOE is to investigate for a potential repository.) The approach and results of DOE's evaluation are discussed. Our review of DOE documents indicates that, by June 22, 1988, DOE completed its evaluation of ongoing crystalline rock research projects to ensure compliance with the 1987 amendments, terminated those research activities it identified as being specifically designed to evaluate the suitability of crystalline rock for a repository, continued some research activities involving crystalline rock because these activities would benefit the investigation and development of the Yucca Mountain repository site, and redirected some research activities so that they would contribute to investigating and developing the Yucca Mountain site

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review.

Science.gov (United States)

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; "simulation," "practice," "drill," "exercise," "instrument," "tool," "questionnaire," " measurement," "checklist," "scale," "test," "inventory," "battery," "evaluation," "assessment," "appraisal," "emergency," "disaster," "cricise," "hazard," "catastrophe,: "hospital", "prehospital," "health centers," "treatment centers," were used in combination with Boolean operators OR and AND. The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages.

Evaluating a Research Training Programme for People with Intellectual Disabilities Participating in Inclusive Research: The Views of Participants.

Science.gov (United States)

Fullana, Judit; Pallisera, Maria; Català, Elena; Puyalto, Carolina

2017-07-01

This article presents the results of evaluating a research training programme aimed at developing the skills of people with intellectual disabilities to actively participate in inclusive research. The present authors opted for a responsive approach to evaluation, using a combination of interviews, questionnaires and focus groups to gather information on the views of students, trainers and members of the research team regarding how the programme progressed, the learning achieved and participants' satisfaction with the programme. The evaluation showed that most of the participants were satisfied with the programme and provided guidelines for planning contents and materials, demonstrating the usefulness of these types of programme in constructing the research group and empowering people with intellectual disabilities to participate in research. The evaluation revealed that the programme had been a positive social experience that fostered interest in lifelong learning for people with intellectual disabilities. © 2016 John Wiley & Sons Ltd.

Research Award: Policy and Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

2016-09-07

Sep 7, 2016 ... IDRC is one of the world's leaders in generating new knowledge to meet ... research skills and gain a fresh perspective on crucial development issues. ... What is cutting-edge practice for evaluating the building of leaders?

Emerging Methodologies in Pediatric Palliative Care Research: Six Case Studies

Directory of Open Access Journals (Sweden)

Katherine E. Nelson

2018-02-01

Full Text Available Given the broad focus of pediatric palliative care (PPC on the physical, emotional, and spiritual needs of children with potentially life-limiting illnesses and their families, PPC research requires creative methodological approaches. This manuscript, written by experienced PPC researchers, describes issues encountered in our own areas of research and the novel methods we have identified to target them. Specifically, we discuss potential approaches to: assessing symptoms among nonverbal children, evaluating medical interventions, identifying and treating problems related to polypharmacy, addressing missing data in longitudinal studies, evaluating longer-term efficacy of PPC interventions, and monitoring for inequities in PPC service delivery.

Emerging Methodologies in Pediatric Palliative Care Research: Six Case Studies

Science.gov (United States)

Nelson, Katherine E.; Gerhardt, Cynthia A.; Rosenberg, Abby R.; Widger, Kimberley; Faerber, Jennifer A.; Feudtner, Chris

2018-01-01

Given the broad focus of pediatric palliative care (PPC) on the physical, emotional, and spiritual needs of children with potentially life-limiting illnesses and their families, PPC research requires creative methodological approaches. This manuscript, written by experienced PPC researchers, describes issues encountered in our own areas of research and the novel methods we have identified to target them. Specifically, we discuss potential approaches to: assessing symptoms among nonverbal children, evaluating medical interventions, identifying and treating problems related to polypharmacy, addressing missing data in longitudinal studies, evaluating longer-term efficacy of PPC interventions, and monitoring for inequities in PPC service delivery. PMID:29495384

Research on evaluation techniques for immersive multimedia

Science.gov (United States)

Hashim, Aslinda M.; Romli, Fakaruddin Fahmi; Zainal Osman, Zosipha

2013-03-01

Nowadays Immersive Multimedia covers most usage in tremendous ways, such as healthcare/surgery, military, architecture, art, entertainment, education, business, media, sport, rehabilitation/treatment and training areas. Moreover, the significant of Immersive Multimedia to directly meet the end-users, clients and customers needs for a diversity of feature and purpose is the assembly of multiple elements that drive effective Immersive Multimedia system design, so evaluation techniques is crucial for Immersive Multimedia environments. A brief general idea of virtual environment (VE) context and `realism' concept that formulate the Immersive Multimedia environments is then provided. This is followed by a concise summary of the elements of VE assessment technique that is applied in Immersive Multimedia system design, which outlines the classification space for Immersive Multimedia environments evaluation techniques and gives an overview of the types of results reported. A particular focus is placed on the implications of the Immersive Multimedia environments evaluation techniques in relation to the elements of VE assessment technique, which is the primary purpose of producing this research. The paper will then conclude with an extensive overview of the recommendations emanating from the research.

Safety evaluation of the Dalat research reactor operation

International Nuclear Information System (INIS)

Long, V.H.; Lam, P.V.; An, T.K.

1989-01-01

After an introduction presenting the essential characteristics of the Dalat Nuclear Research Reactor, the document presents i) The safety assurance condition of the reactor, ii) Its safety behaviour after 5 years of operation, iii) Safety research being realized on the reactor. Following is questionnaire of safety evaluation and a list of attachments, which concern the reactor

SCIENTOMETRY AND EVALUATION OF THE RESULTS OF ECONOMIC SCIENTIFIC RESEARCH

Directory of Open Access Journals (Sweden)

Ana-Lucia RISTEA

2017-04-01

Full Text Available Starting from the necessity of a continuous and demanding evaluation, capable of linking the results obtained with the human, material and financial resources, allocated and periodically setting the position of the national research relative to the world level, the evaluation of the relevance of the publications must be carried out from the positions and requirements of new disciplines: Scientometry. Scientometry is intended to help substantiate the evaluation of research activity and decision-making on its development, the science policy as a whole.

Why, and how, mixed methods research is undertaken in health services research in England: a mixed methods study

Science.gov (United States)

O'Cathain, Alicia; Murphy, Elizabeth; Nicholl, Jon

2007-01-01

Background Recently, there has been a surge of international interest in combining qualitative and quantitative methods in a single study – often called mixed methods research. It is timely to consider why and how mixed methods research is used in health services research (HSR). Methods Documentary analysis of proposals and reports of 75 mixed methods studies funded by a research commissioner of HSR in England between 1994 and 2004. Face-to-face semi-structured interviews with 20 researchers sampled from these studies. Results 18% (119/647) of HSR studies were classified as mixed methods research. In the documentation, comprehensiveness was the main driver for using mixed methods research, with researchers wanting to address a wider range of questions than quantitative methods alone would allow. Interviewees elaborated on this, identifying the need for qualitative research to engage with the complexity of health, health care interventions, and the environment in which studies took place. Motivations for adopting a mixed methods approach were not always based on the intrinsic value of mixed methods research for addressing the research question; they could be strategic, for example, to obtain funding. Mixed methods research was used in the context of evaluation, including randomised and non-randomised designs; survey and fieldwork exploratory studies; and instrument development. Studies drew on a limited number of methods – particularly surveys and individual interviews – but used methods in a wide range of roles. Conclusion Mixed methods research is common in HSR in the UK. Its use is driven by pragmatism rather than principle, motivated by the perceived deficit of quantitative methods alone to address the complexity of research in health care, as well as other more strategic gains. Methods are combined in a range of contexts, yet the emerging methodological contributions from HSR to the field of mixed methods research are currently limited to the single

Visual soil evaluation - future research requirements

Science.gov (United States)

Emmet-Booth, Jeremy; Forristal, Dermot; Fenton, Owen; Ball, Bruce; Holden, Nick

2017-04-01

A review of Visual Soil Evaluation (VSE) techniques (Emmet-Booth et al., 2016) highlighted their established utility for soil quality assessment, though some limitations were identified; (1) The examination of aggregate size, visible intra-porosity and shape forms a key assessment criterion in almost all methods, thus limiting evaluation to structural form. The addition of criteria that holistically examine structure may be desirable. For example, structural stability can be indicated using dispersion tests or examining soil surface crusting, while the assessment of soil colour may indirectly indicate soil organic matter content, a contributor to stability. Organic matter assessment may also indicate structural resilience, along with rooting, earthworm numbers or shrinkage cracking. (2) Soil texture may influence results or impeded method deployment. Modification of procedures to account for extreme texture variation is desirable. For example, evidence of compaction in sandy or single grain soils greatly differs to that in clayey soils. Some procedures incorporate separate classification systems or adjust deployment based on texture. (3) Research into impacts of soil moisture content on VSE evaluation criteria is required. Criteria such as rupture resistance and shape may be affected by moisture content. It is generally recommended that methods are deployed on moist soils and quantification of influences of moisture variation on results is necessary. (4) Robust sampling strategies for method deployment are required. Dealing with spatial variation differs between methods, but where methods can be deployed over large areas, clear instruction on sampling is required. Additionally, as emphasis has been placed on the agricultural production of soil, so the ability of VSE for exploring structural quality in terms of carbon storage, water purification and biodiversity support also requires research. References Emmet-Booth, J.P., Forristal. P.D., Fenton, O., Ball, B

Developmental Advising for Marginalized Community College Students: An Action Research Study

Science.gov (United States)

Jones, Terrica S.

2013-01-01

The purpose of this action research study was to understand, evaluate, and improve the developmental advising practices used at a Washington State community college. This action research study endeavored to strengthen the developmental advising model originally designed to support the college's marginalized students. Guiding questions for the…

Report of the summative evaluation by the advisory committee on fusion research and development

International Nuclear Information System (INIS)

2005-03-01

The Research Evaluation Committee of the Japan Atomic Energy Research Institute (JAERI) set up an Advisory Committee on Fusion Research and Development in accordance with the 'Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations. The Advisory Committee on Fusion Research and Development evaluated the adequacy of the plans of fusion research and development to be succeeded from JAERI to a new research institute which will be established by integration of JAERI and the Japan Nuclear Cycle Development Institute (JNC). The Advisory Committee consisted of eight specialists from outside the JAERI conducted its activities from June 2004 to August 2004. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Advisory Committee meeting which was held on July 23, 2004, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Advisory Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on December 1, 2004. This report describes the result of the evaluation by the Advisory Committee on Fusion Research and Development. (author)

Report of the summative evaluation by the advisory committee on research for radiation applications

International Nuclear Information System (INIS)

2005-03-01

The Research Evaluation Committee of the Japan Atomic Energy Research Institute (JAERI) set up an Advisory Committee on Research for Radiation Applications in accordance with the 'Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations. The Advisory Committee on Research for Radiation Applications evaluated the adequacy of the plans of research for radiation applications to be succeeded from JAERI to a new research institute which will be established by integration of JAERI and the Japan Nuclear Cycle Development Institute (JNC). The Advisory Committee consisted of nine specialists from outside the JAERI conducted its activities from June 2004 to August 2004. The evaluation was performed on the basis of the materials submitted in advanced and of the oral presentations made at the Advisory Committee meeting which was held on July 29, 2004, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Advisory Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on December 1, 2004. This report describes the result of the evaluation by the Advisory Committee on Research for Radiation Applications. (author)

Radiological evaluation of tumor response in oncological studies (tumor response evaluation)

International Nuclear Information System (INIS)

Gebauer, B.; Riess, H.

2011-01-01

Purpose: Radiological-morphological response evaluation plays a major role in oncological therapy and studies for approval. Specific criteria have been developed for some tumor entities and chemotherapeutics. Application, limitations and definitions of the most frequently used criteria for tumor response evaluation will be presented. Materials and Methods: Review based on a selective literature research. Results: In clinical oncological therapy studies, WHO and RECIST are the most frequently used criteria to evaluate morphological therapy response. RECIST criteria have been modified recently, especially with respect to the evaluation of lymph nodes, and were published as RECIST 1.1 in 2009. All criteria were originally developed and defined to review clinical multicenter trials for approval. Using these criteria in a clinical situation, certain limitations have to be considered. To evaluate response, a baseline scan before therapy start is mandatory. Special tumor response criteria have been defined for some certain tumor entities. Oncologists and radiologists should define in advance which criteria are used before starting therapy. Conclusion: The use of defined criteria is very important in oncology response evaluation. In-depth knowledge of the criteria and their limits is required for correct usage. (orig.)

Assessment report of research and development activities in FY2014. Activity: 'Quantum beam science research' (Result evaluation)

International Nuclear Information System (INIS)

2015-09-01

Japan Atomic Energy Agency (hereafter referred to as 'JAEA') consulted an assessment committee, 'Evaluation Committee of Research Activities for Quantum Beam Science' (hereafter referred to as 'Committee') for result evaluation of 'Quantum Beam Science', in accordance with 'General Guideline for the Evaluation of Government Research and Development (R and D) Activities' by Cabinet Office, Government of Japan, 'Guideline for Evaluation of R and D in Ministry of Education, Culture, Sports, Science and Technology' and 'Regulation on Conduct for Evaluation of R and D Activities' by JAEA. In response to the JAEA's request, the Committee assessed the research program of the Quantum Beam Science Center (hereafter referred to as 'QuBS') during the period from April 2010 to September 2014. The Committee evaluated the management and research activities of QuBS based on the explanatory documents and oral presentations. (author)

Relationships of Research and Teaching: Implications for Faculty Evaluation

Science.gov (United States)

Jauch, Lawrence R.

1976-01-01

Research involving 23 hard science disciplines at a midwestern university indicates that research and teaching are complementary but that time allocation tradeoffs are necessary between the two functions. Administratively, evaluations tend to influence the direction faculty choose to follow. (Author/LBH)

Study to improve recriticality evaluation methodology after severe accident (Joint research)

International Nuclear Information System (INIS)

Kugo, Teruhiko; Ishikawa, Makoto; Nagaya, Yasunobu; Yokoyama, Kenji; Fukaya, Yuji; Maruyama, Hiromi; Kondo, Takao; Minato, Hirokazu; Tsuchiya, Akiyuki; Ishii, Yoshihiko; Fujimura, Koji

2014-03-01

The present report summarizes the results of a 2-year cooperative study between JAEA and Hitachi-GE Nuclear Energy in order to contribute to the settlement of the Fukushima-Daiich nuclear power plants which suffered from the severe accident on March 2011. In the Fukushima-Daiich plants, it is considered that the nuclear fuel in the core was melted down by the loss of ultimate heat sink by the station black out after the 2011 off the Pacific coast of Tohoku Earthquake. The position and/or the mass of the melted fuel have not been known yet. Therefore, the possibility of recriticality events and the severity of the postulated recriticality are uncertain. In the present study, the possible scenarios to reach the recriticality events in Fukushima-Daiich were investigated first. Then, the analytical methodology to evaluate the time-dependent recriticality events has been developed by modelling the reactivity insertion rate and the possible feedback according to the recriticality scenarios identified in the first step. The methodology developed here has been equipped as a transient simulation tool, PORCAS, which is operated on a multi-purpose platform for reactor analysis, MARBLE. Finally, the radiation exposure rates by the postulated recriticality events in Fukushima-Daiich were approximately evaluated to estimate the impact to the public environment. (author)

Report of the evaluation by the Ad Hoc Review Committee on Materials Science Research. Ex-post evaluation in fiscal year 2003

International Nuclear Information System (INIS)

2004-06-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Materials Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the adequacy of the R and D results achieved for five years until Fiscal Year 2002 at Department of Materials Science in Tokai Research Establishment of JAERI. The Ad Hoc Review Committee consisted of eight specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from October 2003 to February 2004. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on November 14, 2003, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on March 8, 2004. This report describes the result of the evaluation by the Ad Hoc Review Committee on Materials Science Research. (author)

Evaluating Faculty Work: Expectations and Standards of Faculty Performance in Research Universities

Science.gov (United States)

Hardre, Patricia; Cox, Michelle

2009-01-01

Expectations and the way they are communicated can influence employees' motivation and performance. Previous research has demonstrated individual effects of workplace climate and individual differences on faculty productivity. The present study focused on the characteristics of institutional performance standards, evaluation processes and…

Process variables in organizational stress management intervention evaluation research: a systematic review

NARCIS (Netherlands)

Havermans, B.M.; Schelvis, R.M.C.; Boot, C.R.L.; Brouwers, E.P.M.; Anema, J.R.; Beek, A.J. van der

2016-01-01

Objectives This systematic review aimed to explore which process variables are used in stress management intervention (SMI) evaluation research. Methods A systematic review was conducted using seven electronic databases. Studies were included if they reported on an SMI aimed at primary or secondary

Process variables in organizational stress management intervention evaluation research : A systematic review

NARCIS (Netherlands)

Havermans, B.M.; Schlevis, Roosmarijn Mc; Boot, Cécile Rl; Brouwers, E.P.M.; Anema, Johannes R; van der Beek, Allard J

2016-01-01

OBJECTIVES: This systematic review aimed to explore which process variables are used in stress management intervention (SMI) evaluation research. METHODS: A systematic review was conducted using seven electronic databases. Studies were included if they reported on an SMI aimed at primary or

Strategies towards Evaluation beyond Scientific Impact. Pathways not only for Agricultural Research

Directory of Open Access Journals (Sweden)

Birge M. Wolf

2013-12-01

Full Text Available Various research fields, like organic agricultural research, are dedicated to solving real-world problems and contributing to sustainable development. Therefore, systems research and the application of interdisciplinary and transdisciplinary approaches are increasingly endorsed. However, research performance depends not only on self-conception, but also on framework conditions of the scientific system, which are not always of benefit to such research fields. Recently, science and its framework conditions have been under increasing scrutiny as regards their ability to serve societal benefit. This provides opportunities for (organic agricultural research to engage in the development of a research system that will serve its needs. This article focuses on possible strategies for facilitating a balanced research evaluation that recognises scientific quality as well as societal relevance and applicability. These strategies are (a to strengthen the general support for evaluation beyond scientific impact, and (b to provide accessible data for such evaluations. Synergies of interest are found between open access movements and research communities focusing on global challenges and sustainability. As both are committed to increasing the societal benefit of science, they may support evaluation criteria such as knowledge production and dissemination tailored to societal needs, and the use of open access. Additional synergies exist between all those who scrutinise current research evaluation systems for their ability to serve scientific quality, which is also a precondition for societal benefit. Here, digital communication technologies provide opportunities to increase effectiveness, transparency, fairness and plurality in the dissemination of scientific results, quality assurance and reputation. Furthermore, funders may support transdisciplinary approaches and open access and improve data availability for evaluation beyond scientific impact. If they begin to

Time-to-event methodology improved statistical evaluation in register-based health services research.

Science.gov (United States)

Bluhmki, Tobias; Bramlage, Peter; Volk, Michael; Kaltheuner, Matthias; Danne, Thomas; Rathmann, Wolfgang; Beyersmann, Jan

2017-02-01

Complex longitudinal sampling and the observational structure of patient registers in health services research are associated with methodological challenges regarding data management and statistical evaluation. We exemplify common pitfalls and want to stimulate discussions on the design, development, and deployment of future longitudinal patient registers and register-based studies. For illustrative purposes, we use data from the prospective, observational, German DIabetes Versorgungs-Evaluation register. One aim was to explore predictors for the initiation of a basal insulin supported therapy in patients with type 2 diabetes initially prescribed to glucose-lowering drugs alone. Major challenges are missing mortality information, time-dependent outcomes, delayed study entries, different follow-up times, and competing events. We show that time-to-event methodology is a valuable tool for improved statistical evaluation of register data and should be preferred to simple case-control approaches. Patient registers provide rich data sources for health services research. Analyses are accompanied with the trade-off between data availability, clinical plausibility, and statistical feasibility. Cox' proportional hazards model allows for the evaluation of the outcome-specific hazards, but prediction of outcome probabilities is compromised by missing mortality information. Copyright © 2016 Elsevier Inc. All rights reserved.

Delirium diagnosis methodology used in research: a survey-based study.

Science.gov (United States)

Neufeld, Karin J; Nelliot, Archana; Inouye, Sharon K; Ely, E Wesley; Bienvenu, O Joseph; Lee, Hochang Benjamin; Needham, Dale M

2014-12-01

To describe methodology used to diagnose delirium in research studies evaluating delirium detection tools. The authors used a survey to address reference rater methodology for delirium diagnosis, including rater characteristics, sources of patient information, and diagnostic process, completed via web or telephone interview according to respondent preference. Participants were authors of 39 studies included in three recent systematic reviews of delirium detection instruments in hospitalized patients. Authors from 85% (N = 33) of the 39 eligible studies responded to the survey. The median number of raters per study was 2.5 (interquartile range: 2-3); 79% were physicians. The raters' median duration of clinical experience with delirium diagnosis was 7 years (interquartile range: 4-10), with 5% having no prior clinical experience. Inter-rater reliability was evaluated in 70% of studies. Cognitive tests and delirium detection tools were used in the delirium reference rating process in 61% (N = 21) and 45% (N = 15) of studies, respectively, with 33% (N = 11) using both and 27% (N = 9) using neither. When patients were too drowsy or declined to participate in delirium evaluation, 70% of studies (N = 23) used all available information for delirium diagnosis, whereas 15% excluded such patients. Significant variability exists in reference standard methods for delirium diagnosis in published research. Increasing standardization by documenting inter-rater reliability, using standardized cognitive and delirium detection tools, incorporating diagnostic expert consensus panels, and using all available information in patients declining or unable to participate with formal testing may help advance delirium research by increasing consistency of case detection and improving generalizability of research results. Copyright © 2014 American Association for Geriatric Psychiatry. Published by Elsevier Inc. All rights reserved.

Report of the evaluation by the Ad Hoc Review Committee on Materials Science Research. In-advance evaluation in fiscal year 2002

Energy Technology Data Exchange (ETDEWEB)

NONE

2002-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Materials Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the adequacy of the R and D programs to be implemented for five years starting in Fiscal Year 2003 at Department of Materials Science in Tokai Research Establishment of JAERI. The Ad Hoc Review Committee consisted of eight specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from April 2002 to August 2002. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 5th, 2002, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on August 5th, 2002. This report describes the result of the evaluation by the Ad Hoc Review Committee on Materials Science Research. (author)

Report of the evaluation by the Ad Hoc Review Committee on Materials Science Research. In-advance evaluation in fiscal year 2002

Energy Technology Data Exchange (ETDEWEB)

NONE

2002-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Materials Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the adequacy of the R and D programs to be implemented for five years starting in Fiscal Year 2003 at Department of Materials Science in Tokai Research Establishment of JAERI. The Ad Hoc Review Committee consisted of eight specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from April 2002 to August 2002. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 5th, 2002, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on August 5th, 2002. This report describes the result of the evaluation by the Ad Hoc Review Committee on Materials Science Research. (author)

Report of the evaluation by the ad hoc review committee on radiation application research. In-advance evaluation in fiscal year 2001

International Nuclear Information System (INIS)

2001-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Radiation Application Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the adequacy of the R and D programs to be implemented for five years starting in Fiscal Year 2002 at Department of Material Development, at Department of Ion-Beam-Applied Biology and at Advanced Radiation Technology Center in Takasaki Radiation Chemistry Research Establishment of JAERI. The Ad Hoc Review Committee consisted of ten specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from May to July 2001. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 25, 2001, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on July 12, 2001. This report describes the result of the evaluation by the Ad Hoc Review Committee on Radiation Application Research. (author)

Integrating utilization-focused evaluation with business process modeling for clinical research improvement.

Science.gov (United States)

Kagan, Jonathan M; Rosas, Scott; Trochim, William M K

2010-10-01

New discoveries in basic science are creating extraordinary opportunities to design novel biomedical preventions and therapeutics for human disease. But the clinical evaluation of these new interventions is, in many instances, being hindered by a variety of legal, regulatory, policy and operational factors, few of which enhance research quality, the safety of study participants or research ethics. With the goal of helping increase the efficiency and effectiveness of clinical research, we have examined how the integration of utilization-focused evaluation with elements of business process modeling can reveal opportunities for systematic improvements in clinical research. Using data from the NIH global HIV/AIDS clinical trials networks, we analyzed the absolute and relative times required to traverse defined phases associated with specific activities within the clinical protocol lifecycle. Using simple median duration and Kaplan-Meyer survival analysis, we show how such time-based analyses can provide a rationale for the prioritization of research process analysis and re-engineering, as well as a means for statistically assessing the impact of policy modifications, resource utilization, re-engineered processes and best practices. Successfully applied, this approach can help researchers be more efficient in capitalizing on new science to speed the development of improved interventions for human disease.

Research capacity building in midwifery: Case study of an Australian Graduate Midwifery Research Intern Programme.

Science.gov (United States)

Hauck, Yvonne L; Lewis, Lucy; Bayes, Sara; Keyes, Louise

2015-09-01

Having the research capacity to identify problems, create new knowledge and most importantly translate this knowledge into practice is essential within health care. Midwifery, as well as other health professions in Australia, is challenged in building its research capacity to contribute evidence to inform clinical practice. The aim of this project was to evaluate an innovative Graduate Midwifery Research Intern Programme offered at a tertiary obstetric hospital in Western Australia, to determine what was working well and how the programme could be improved. A case study approach was used to gain feedback from graduate midwives within a Graduate Research Intern (GRI) Programme. In addition outcomes were compiled of all projects the GRI midwives contributed to. Six GRI midwives participated in a survey comprising of four open ended questions to provide feedback about the programme. Findings confirm that the GRI programme increased the graduates understanding of how research works, its capacity to define a problem, generate new knowledge and inform clinical practice. The GRI midwives' feedback suggested the programme opened their thinking to future study and gave them enhanced insight into women's experiences around childbirth. To grow our knowledge as a professional group, midwives must develop and promote programmes to build our pool of research capable midwives. By sharing our programme evaluation we hope to entice other clinical settings to consider the value in replicating such a programme within their context. Copyright © 2015 Australian College of Midwives. Published by Elsevier Ltd. All rights reserved.

Methodology for evaluation of railroad technology research projects

Science.gov (United States)

1981-04-01

This Project memorandum presents a methodology for evaluating railroad research projects. The methodology includes consideration of industry and societal benefits, with special attention given to technical risks, implementation considerations, and po...

National evaluation commission relative to the researches on the radioactive wastes management

International Nuclear Information System (INIS)

2004-01-01

Implemented in april 1994, the National Evaluation Commission (CNE) continues in this tenth report, its study on the radioactive wastes management following the three axis defined by the 1991 law: separation and transmutation, underground disposal, conditioning and log time storage. This report takes stock on the CNE activity in 2003 as on the researches advances around these three axis. In the framework of the international cooperation, the commission details also the researches and realizations abroad. (A.L.B.)

Ethical Evaluation of Mental Health Social Research: Agreement Between Researchers and Ethics Committees.

Science.gov (United States)

Mondragón Barrios, Liliana; Guarneros García, Tonatiuh; Jiménez Tapia, Alberto

2017-07-01

The objective of this article is to compare various ethical issues considered by social scientists and research ethics committees in the evaluation of mental health social research protocols. We contacted 47 social scientists and 10 members of ethics committees in Mexico with two electronic national surveys that requested information from both groups related to the application of ethical principles in mental health social research. The results showed no significant difference between these groups in the value placed on the ethical issues explored. Based on this finding, we make proposals to strengthen the collaboration between the two groups.

The promise and challenge of practice-research collaborations: Guiding principles and strategies for initiating, designing, and implementing program evaluation research.

Science.gov (United States)

Secret, Mary; Abell, Melissa L; Berlin, Trey

2011-01-01

The authors present a set of guiding principles and strategies to facilitate the collaborative efforts of social work researchers and practitioners as they initiate, design, and implement outcome evaluations of human service interventions and programs. Beginning with an exploration of the interpersonal barriers to practice-research collaborations, and building on their experiences in successfully completing a community-based research evaluation, the authors identify specific relationship-focused principles and strategies and illustrate how these approaches can guide practice-research teams through the various sequential activities of the evaluation research process. In particular, it is suggested that practice-research collaborations can be formed, strengthened, and sustained by emphasis on a spirit of discovery and shared leadership at the start of the relationship, use of a comprehensive evaluation model to clarify and frame the evaluation and program goals, beginning where the client is when selecting research methodology and measurement tools, commitment to keeping the program first and recording everything during the implementation and data-collection stages, discussion of emerging findings and presentation of findings in graphic format at the data-analysis stage, and a total team approach at the dissemination stage.

Study to define NDE research for inspection of stainless steels

International Nuclear Information System (INIS)

Reinhart, E.R.

1978-08-01

After the boiling water reactor (BWR) stress corrosion cracking incidents on 4- and 10-inch stainless steel piping, the Electric Power Research Institute (EPRI) organized a round-robin ultrasonic examination of piping removed from service (TPS-75-609). Five inspection teams participated in this program, using both a standard procedure and the individual team procedure. The original intent was to section the piping after the program to evaluate the effectiveness of state-of-the-art ultrasonics in finding stress corrosion cracking. The sectioning was delayed, however, to allow research and development (R and D) groups time to perform basic measurements aimed at determining optimum search unit and instrument characteristics for the ultrasonic examination of stainless steel piping and to study the applicability of various advanced inspection methods. This additional effort was funded as part of an EPRI technical planning study (TPS-75-620), A Study to Define NDE Research for Inspection of Stainless Steels. Inspection methods evaluated in this study included (1) processing of manual scan data using a miniature programmable calculator (Aerojet Nuclear); (2) investigation into the performance characteristics of three experimental ultrasonic transducers (Battelle-Columbus Laboratories); (3) analysis of fundamental ultrasonic response data from intergranular stress corrosion cracks in stainless steels (Southwest Research Institute); and (4) a feasibility study of advanced signal processing and pattern recognition for analyzing flaws in stainless steel piping (Ultrasonics International). The results of the studies compiled in the report have indicated the direction for future research and development and have formed the basis for the recently initiated EPRI Research Project 892, Ultrasonic System Optimization

Research on evaluation methods for water regulation ability of dams in the Huai River Basin

Science.gov (United States)

Shan, G. H.; Lv, S. F.; Ma, K.

2016-08-01

Water environment protection is a global and urgent problem that requires correct and precise evaluation. Evaluation methods have been studied for many years; however, there is a lack of research on the methods of assessing the water regulation ability of dams. Currently, evaluating the ability of dams has become a practical and significant research orientation because of the global water crisis, and the lack of effective ways to manage a dam's regulation ability has only compounded this. This paper firstly constructs seven evaluation factors and then develops two evaluation approaches to implement the factors according to the features of the problem. Dams of the Yin Shang ecological control section in the Huai He River basin are selected as an example to demonstrate the method. The results show that the evaluation approaches can produce better and more practical suggestions for dam managers.

Situated Research Design and Methodological Choices in Formative Program Evaluation

Science.gov (United States)

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

Consumer and community involvement in health and medical research: evaluation by online survey of Australian training workshops for researchers.

Science.gov (United States)

McKenzie, Anne; Alpers, Kirsten; Heyworth, Jane; Phuong, Cindy; Hanley, Bec

2016-01-01

In Australia, since 2009, the Consumer and Community Involvement Program (formerly the Consumer and Community Participation Program) has developed and run workshops to help people working in health and medical research involve more consumers (patients) and community members (the public) in their research. In 2012, workshop attendees were invited to do an online survey to find out the effect, if any, that attending a workshop had on their awareness of and attitudes to consumer and community involvement. They were also asked about changes in their behaviour when it came to the involvement of consumers and the community in their work. The study found that, for people who answered the survey, more than double the number found consumer and community involvement very relevant after attending a workshop, compared with the number who thought that before attending one. Also, amongst those who answered the survey, 94 % thought that the workshop increased their understanding about involvement. Background There is limited evidence of the benefits of providing training workshops for researchers on how to involve consumers (patients) and the community (public) in health and medical research. Australian training workshops were evaluated to contribute to the evidence base. The key objective was to evaluate the impact of the workshops in increasing awareness of consumer and community involvement; changing attitudes to future implementation of involvement activities and influencing behaviour in the methods of involvement used. A secondary objective was to use a formal evaluation survey to build on the anecdotal feedback received from researchers about changes in awareness, attitudes and behaviours. Methods The study used a cross-sectional, online survey of researchers, students, clinicians, administrators and members of non-government organisations who attended Consumer and Community Involvement Program training workshops between 2009 and 2012 to ascertain changes to awareness

Evaluation in health promotion: thoughts from inside a human research ethics committee.

Science.gov (United States)

Allen, Judy; Flack, Felicity

2015-12-01

Health promotion research, quality improvement and evaluation are all activities that raise ethical issues. In this paper, the Chair and a member of human resear ch ethics committees provide an insiders' point of view on how to demonstrate ethical conduct in health promotion research and quality improvement. Several common issues raised by health promotion research and evaluation are discussed including researcher integrity, conflicts of interest, use of information, consent and privacy.

Methods to evaluate fish freshness in research and industry

DEFF Research Database (Denmark)

Olafsdottir, G.; Martinsdóttir, E.; Oehlenschläger, J.

1997-01-01

Current work in a European concerted action project 'Evaluation of Fish Freshness' (AIR3 CT94-2283) focuses on harmonizing research activities in the area of fish freshness evaluation in leading fish laboratories in Europe (see Box 1). The overall aim of the concerted action project is to validat...... measurements with respect to fish freshness evaluation. In this article, the different subgroups have summarized changes that occur in fish and methods to evaluate fish freshness as a first step towards the definition of criteria for fish freshness...

Government Research Evaluations and Academic Freedom: A UK and Australian Comparison

Science.gov (United States)

Martin-Sardesai, Ann; Irvine, Helen; Tooley, Stuart; Guthrie, James

2017-01-01

Performance management systems have been an inevitable consequence of the development of government research evaluations (GREs) of university research, and have also inevitably affected the working life of academics. The aim of this paper is to track the development of GREs over the past 25 years, by critically evaluating their adoption in the UK…

Curriculum vitae method in science policy and research evaluation: the state-of-the-art

OpenAIRE

Carolina Cañibano; Barry Bozeman

2009-01-01

This is a state-of-the-art assessment for a small but burgeoning research approach, use of curricula vitae in research evaluation. The accumulated research remains sufficiently modest for us to consider nearly all published studies and the full range of research purposes to which CV analysis has been applied. CV analysis has been theory-driven, and theory and tools have increasingly converged. Advances in method and technique have been abetted especially by the push for a scientific and techn...

Assessment report of research and development activities in FY2014. Activity: 'Quantum beam science research' (In-advance evaluation)

International Nuclear Information System (INIS)

2015-09-01

Japan Atomic Energy Agency (hereafter referred to as 'JAEA') consulted an assessment committee, 'Evaluation Committee of Research Activities for Quantum Beam Science' (hereafter referred to as 'Committee') for result evaluation of 'Quantum Beam Science', in accordance with 'General Guideline for the Evaluation of Government Research and Development (R and D) Activities' by Cabinet Office, Government of Japan, 'Guideline for Evaluation of R and D in Ministry of Education, Culture, Sports, Science and Technology' and 'Regulation on Conduct for Evaluation of R and D Activities' by JAEA. In response to the JAEA's request, the Committee assessed the research program of the Quantum Beam Science Center (hereafter referred to as 'QuBS') during the period from April 2015 to March 2022. The Committee evaluated the management and research activities of QuBS based on the explanatory documents and oral presentations. (author)

[Qualitative Research in Health Services Research - Discussion Paper, Part 3: Quality of Qualitative Research].

Science.gov (United States)

Stamer, M; Güthlin, C; Holmberg, C; Karbach, U; Patzelt, C; Meyer, T

2015-12-01

The third and final discussion paper of the German Network of Health Services Research's (DNVF) "Qualitative Methods Working Group" demonstrates methods for the evaluation and quality of qualitative research in health services research. In this paper we discuss approaches described in evaluating qualitative studies, including: an orientation to the general principles of empirical research, an approach-specific course of action, as well as procedures based on the research-process and criteria-oriented approaches. Divided into general and specific aspects to be considered in a qualitative study quality evaluation, the central focus of the discussion paper undertakes an extensive examination of the process and criteria-oriented approaches. The general aspects include the participation of relevant groups in the research process as well as ethical aspects of the research and data protection issues. The more specific aspects in evaluating the quality of qualitative research include considerations about the research interest, research questions, and the selection of data collection methods and types of analyses. The formulated questions are intended to guide reviewers and researchers to evaluate and to develop qualitative research projects appropriately. The intention of this discussion paper is to ensure a transparent research culture, and to reflect on and discuss the methodological and research approach of qualitative studies in health services research. With this paper we aim to initiate a discussion on high quality evaluation of qualitative health services research. © Georg Thieme Verlag KG Stuttgart · New York.

Research evaluation and competition for academic positions in occupational medicine.

Science.gov (United States)

Franco, Giuliano

2013-01-01

Citation analysis is widely used to evaluate the performance of individual researchers, journals, and universities. Its outcome plays a crucial role in the decision-making process of ranking applicants for an academic position. A number of indicators, including the h-index reflecting both scientific productivity and its relevance in medical fields, are available through the Web of Knowledge( sm ) and Scopus®. In the field of occupational medicine, the adoption of the h-index in assessing the value of core journals shows some advantages compared with traditional bibliometrics and may encourage researchers to submit their papers. Although evaluation of the overall individual performance for academic positions should assess several aspects, scientific performance is usually based on citation analysis indicators. Younger researchers should be aware of the new approach based on transparent threshold rules for career promotion and need to understand the new evaluation systems based on metrics.

Usability Evaluation of a Research Repository and Collaboration Web Site

Science.gov (United States)

Zhang, Tao; Maron, Deborah J.; Charles, Christopher C.

2013-01-01

This article reports results from an empirical usability evaluation of Human-Animal Bond Research Initiative Central as part of the effort to develop an open access research repository and collaboration platform for human-animal bond researchers. By repurposing and altering key features of the original HUBzero system, Human-Animal Bond Research…

[The positioning of nursing research in the academic studies: the origin and development of qualitative and quantitative studies].

Science.gov (United States)

Lu, Pei-Pei; Ting, Shing-Shiang; Chen, Mei-Ling; Tang, Woung-Ru

2005-12-01

The purpose of this study is to discuss the historical context of qualitative and quantitative research so as to explain the principle of qualitative study and examine the positioning of nursing research within academic study as a whole. This paper guides the readers towards the historical context from empirical science, discusses the influences of qualitative and quantitative research on nursing research, then investigates the nature of research paradigms, examines the positioning of nursing research, which includes the characteristics of fields such as natural science, humanity and social studies, and science, and lastly, presents the research standard proposed by Yardley in 2000. The research paradigms include Positivism, Postpositivism, Criticism, and Constructivism, which can be compared with Ontology, Epistemology, and Methodology. The nature of the paradigm is to determine the assumption of the paradigm on the basis of Ontology, Epistemology, and Methodology. The paradigm determines how the researcher views the world and decides on what to answer, how to research, and how to answer. The difference in academic environment is reflected in the long-term dialogue between qualitative and quantitative studies, as well as the standard for criticism. This paper introduces the method of evaluation of the quality of qualitative study proposed by Yardley in 2002, namely the sensitivity of the context, the promise and conscientiousness, transparency and consistency, influence and significance. The paper is intended to provide a guideline for readers in evaluating the quality of qualitative study.

Disability Evaluation System Analysis and Research Annual Report 2017

Science.gov (United States)

2017-11-20

females, other race, enlisted and active duty service members for all services and time periods. • Rates increase as age increases in the Army. For the...Annual Report 2017 Disability Evaluation Systems Analysis and Research Prepared by Accession Medical Standards Analysis and Research Activity ...50 History of hospitalization among active duty service

GPRA (Government Performance and Results Act) and research evaluation for basic science

International Nuclear Information System (INIS)

Takahashi, Shoji

2002-08-01

The purpose of the Government Performance and Results Act of 1993 (GPRA) is to ask federal agencies for evaluating their program performance especially from cost-efficiency aspect and to report to Congress. GPRA is to hold agencies accountable for their programs by requiring that they think strategically (in most cases every 5 years) and set, measure and report goals annually. The agencies which have responsibilities for enhancing basic science like Department of Energy (DOE) and National Science Fund (NSF) are not excluded by reasons of the difficulties of economic evaluations. In Japan, based on 'the Rationalization program for the public corporations' of 2001, the research developing type corporations should make a cost-performance evaluation in addition to the conventional ones. They have same theme as US agencies struggles. The purpose of this report is to get some hints for this theme by surveying GPRA reports of DOE and NSF and analyzing related information. At present, I have to conclude although everybody accepts the necessities of socio-economic evaluations and investment criteria for basic research, studies and discussions about ways and means are still continuing even in the US. (author)

Report of the summative evaluation by the advisory committee on research support and collaborative activities

International Nuclear Information System (INIS)

2005-03-01

The Research Evaluation Committee of the Japan Atomic Energy Research Institute (JAERI) set up an Advisory Committee on Research Support and Collaborative Activities in accordance with the 'Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations. The Advisory Committee on Research Support and Collaborative Activities evaluated the adequacy of the plans of research support and collaborative activities to be succeeded from JAERI to a new research institute which will be established by integration of JAERI and the Japan Nuclear Cycle Development Institute (JNC). The Advisory Committee consisted of nine specialists from outside the JAERI conducted its activities from June 2004 to August 2004. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Advisory Committee meeting which was held on July 21, 2004, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Advisory Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on December 1, 2004. This report describes the result of the evaluation by the Advisory Committee on Research Support and Collaborative Activities. (author)

Research on Comprehensive Evaluation Method for Heating Project Based on Analytic Hierarchy Processing

Science.gov (United States)

Han, Shenchao; Yang, Yanchun; Liu, Yude; Zhang, Peng; Li, Siwei

2018-01-01

It is effective to reduce haze in winter by changing the distributed heat supply system. Thus, the studies on comprehensive index system and scientific evaluation method of distributed heat supply project are essential. Firstly, research the influence factors of heating modes, and an index system with multiple dimension including economic, environmental, risk and flexibility was built and all indexes were quantified. Secondly, a comprehensive evaluation method based on AHP was put forward to analyze the proposed multiple and comprehensive index system. Lastly, the case study suggested that supplying heat with electricity has great advantage and promotional value. The comprehensive index system of distributed heating supply project and evaluation method in this paper can evaluate distributed heat supply project effectively and provide scientific support for choosing the distributed heating project.

New evaluation tool now available to assess research quality | IDRC ...

International Development Research Centre (IDRC) Digital Library (Canada)

2016-04-25

Apr 25, 2016 ... New evaluation tool now available to assess research quality ... Ratings on a scale defined by rubrics, to indicate the level at which a project ... Report: The value-for-money discourse: risks and opportunities for research for development ... Copyright · Open access policy · Privacy policy · Research ethics ...

78 FR 13097 - Electric Power Research Institute; Seismic Evaluation Guidance

Science.gov (United States)

2013-02-26

... NUCLEAR REGULATORY COMMISSION [NRC-2013-0038] Electric Power Research Institute; Seismic... Electric Power Research Institute (EPRI)-1025287, ``Seismic Evaluation Guidance: Screening, Prioritization... guidance and clarification of an acceptable approach to assist nuclear power reactor licensees when...

Report of the evaluation by the Ad Hoc Review Committee on High-Temperature Engineering and Research. Result evaluation in fiscal year 2000

International Nuclear Information System (INIS)

2001-06-01

The Research Evaluation Committee, which consisted of 14 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on High-Temperature Engineering and Research in accordance with the 'Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the R and D accomplishments achieved for five years from Fiscal Year 1995 to Fiscal Year 1999 at Department of HTTR Project and Department of Advanced Nuclear Heat Technology in Oarai Research Establishment of JAERI. The Ad Hoc Review Committee consisted of nine specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from December 2000 to February 2001. The evaluation was performed on the basis of the materials submitted in advanced and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on December 8, 2000, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on March 16, 2001. This report describes the result of the evaluation by the Ad Hoc Review Committee on High-Temperature Engineering and Research. (author)

FHWA research and technology evaluation program summary report spring 2016

Science.gov (United States)

2016-08-01

This report summarizes the 16 evaluations being conducted by the Volpe National Transportation Systems Center on behalf of FHWAs Research and Technology Program. The FHWA R&T Program furthers the Turner-Fairbank Highway Research Centers goal of...

Study on post-earthquake plant evaluation and communication (Annual safety research report, JFY 2010)

International Nuclear Information System (INIS)

Iijima, Toru; Taoka, Hideto; Yamada, Hiroyuki; Sano, Kyoko

2011-01-01

The aims of this study are to establish a post-earthquake plant evaluation method and to develop a communication system for the improving seismic safety regulations as well as encouraging public communication. The Miyagiken-oki earthquake in 2005, Onagawa Nuclear Power Plant shut down automatically. Subsequently, JNES started development of post-earthquake plant evaluation and communication system based on the experience of the cross-check analysis for Onagawa Nuclear Power Plant. The Niigata-ken Chuetsu-oki Earthquake in 2007, the plant situation was not transmitted promptly. The loss of information sharing between local community and related organizations caused the public anxiety. The importance of plant information transmission as well as seismic information gathering were recognized. The proposal for the solution of the information issues were performed by government committee. In this study, the evaluation method for soundness of the main structure and equipment after earthquake event were updated. Moreover, procedure of the post-earthquake plant soundness evaluation and multi-functional seismic information system were developed. In addition, the implementation strategy of the easy-to -understand information dissemination to the public and transparent communication methodology was examined by the Industry-Academia-Government cooperation in the Kashiwazaki-Kariwa region. (author)

An Evaluation of the Research Evidence on the Early Start Denver Model

Science.gov (United States)

Baril, Erika M.; Humphreys, Betsy P.

2017-01-01

The Early Start Denver Model (ESDM) has been gaining popularity as a comprehensive treatment model for children ages 12 to 60 months with autism spectrum disorders (ASD). This article evaluates the research on the ESDM through an analysis of study design and purpose; child participants; setting, intervention agents, and context; density and…

78 FR 20924 - Center for Biologics Evaluation and Research eSubmitter Pilot Evaluation Program for...

Science.gov (United States)

2013-04-08

..., Office of Blood Research and Review, Center for Biologics Evaluation and Research (HFM-375), Food and... assist CBER in the final development and release of this electronic program for use by industry. III... DEPARTMENT OF HEALTH AND HUMAN SERVICES Food and Drug Administration [Docket No. FDA-2013-N-0248...

Research status and evaluation system of heat source evaluation method for central heating

Science.gov (United States)

Sun, Yutong; Qi, Junfeng; Cao, Yi

2018-02-01

The central heating boiler room is a regional heat source heating center. It is also a kind of the urban environment pollution, it is an important section of building energy efficiency. This article through to the evaluation method of central heating boiler room and overviews of the researches during domestic and overseas, summarized the main influence factors affecting energy consumption of industrial boiler under the condition of stable operation. According to the principle of establishing evaluation index system. We can find that is great significance in energy saving and environmental protection for the content of the evaluation index system of the centralized heating system.

Evaluating department of transportation's research program : a methodology and case study.

Science.gov (United States)

2012-06-01

An effective research program within a transportation organization can be a valuable asset to accomplish the goals of the overall : mission. Determining whether a research program is pursuing relevant research projects and obtaining results for the s...

Research priorities in medical education: A national study.

Science.gov (United States)

Tootoonchi, Mina; Yamani, Nikoo; Changiz, Tahereh; Yousefy, Alireza

2012-01-01

One preliminary step to strengthen medical education research would be determining the research priorities. The aim of this study was to determine the research priorities of medical education in Iran in 2007-2008. This descriptive study was carried out in two phases. Phase one was performed in 3 stages and used Delphi technique among academic staffs of Isfahan University of Medical Sciences. The three stages included a brainstorming workshop for 140 faculty members and educational experts resulting in a list of research priorities, then, in the second and third stages 99 and 76 questionnaires were distributed among faculty members. In the second phase, the final questionnaires were mailed to educational research center managers of universities type I, II and III, and were distributed among 311 academic members and educational experts to rate the items on a numerical scale ranging from 1 to 10. The most important research priorities included faculty members' development methods, faculty members' motives, satisfaction and welfare, criteria and procedures of faculty members' promotion, teaching methods and learning techniques, job descriptions and professional skills of graduates, quality management in education, second language, clinical education, science production in medicine, faculty evaluation and information technology. This study shows the medial education research priorities in national level and in different types of medical universities in Iran. It is recommended that faculty members and research administrators consider the needs and requirements of education and plan the researches in education according to these priorities.

Educational research methods for researching innovations in teaching, learning and assessment: The nursing lecturer as researcher.

Science.gov (United States)

Marks-Maran, Diane

2015-11-01

The author, who has had previous experience as a nurse researcher, has been engaged in helping nurse lecturers to undertake evaluation research studies into innovations in their teaching, learning and assessment methods. In order to undertake this work successfully, it was important to move from thinking like a nurse researcher to thinking like an educational researcher and developing the role of the nursing lecturer as researcher of their teaching. This article explores the difference between evaluation and evaluation research and argues for the need to use educational research methods when undertaking evaluation research into innovations in teaching, learning and assessment. A new model for educational evaluation research is presented together with two case examples of the model in use. The model has been tested on over 30 research studies into innovations in teaching, learning and assessment over the past 8 years. Copyright © 2015 Elsevier Ltd. All rights reserved.

Surgery resident selection and evaluation. A critical incident study.

Science.gov (United States)

Edwards, J C; Currie, M L; Wade, T P; Kaminski, D L

1993-03-01

This article reports a study of the process of selecting and evaluating general surgery residents. In personnel psychology terms, a job analysis of general surgery was conducted using the Critical Incident Technique (CIT). The researchers collected 235 critical incidents through structured interviews with 10 general surgery faculty members and four senior residents. The researchers then directed the surgeons in a two-step process of sorting the incidents into categories and naming the categories. The final essential categories of behavior to define surgical competence were derived through discussion among the surgeons until a consensus was formed. Those categories are knowledge/self-education, clinical performance, diagnostic skills, surgical skills, communication skills, reliability, integrity, compassion, organization skills, motivation, emotional control, and personal appearance. These categories were then used to develop an interview evaluation form for selection purposes and a performance evaluation form to be used throughout residency training. Thus a continuum of evaluation was established. The categories and critical incidents were also used to structure the interview process, which has demonstrated increased interview validity and reliability in many other studies. A handbook for structuring the interviews faculty members conduct with applicants was written, and an interview training session was held with the faculty. The process of implementation of the structured selection interviews is being documented currently through qualitative research.

Evaluation of the RATU2 and RETU research programs

International Nuclear Information System (INIS)

Faidy, C.; Hayns, M.R.

1998-05-01

The report is an evaluation of the Finnish RATU2 (Structural Integrity of Nuclear Power Plants) and RETU (Reactor Safety) programs. The first generation of nuclear safety research programs were started in 1988-1990. Mid-term reviews were carried out and published in 1992. Many of the recommendations from those reviews have been implemented and they are referred to in this evaluation report

[Methods in health services research. The example of the evaluation of the German disease management programmes].

Science.gov (United States)

Morfeld, M; Wirtz, M

2006-02-01

According to the established definition of Pfaff, health services research analyses patients' path through the institutions of the health care system. The focus is on development, evaluation and implementation of innovative measures of health care. By increasing its quality health services research strives for an improvement of efficacy and efficiency of the health care system. In order to allow for an appropriate evaluation it is essential to differentiate between structure, process and outcome quality referring to (1) the health care system in its entirety, (2) specific health care units as well as (3) processes of communication in different settings. Health services research comprises a large array of scientific disciplines like public health, medicine, social sciences and social care. For the purpose of managing its tasks adequately a special combination of instruments and methodological procedures is needed. Thus, diverse techniques of evaluation research as well as special requirements for study designs and assessment procedures are of vital importance. The example of the German disease management programmes illustrates the methodical requirements for a scientific evaluation.

Research on psychological evaluation method for nuclear power plant operators

International Nuclear Information System (INIS)

Fang Xiang; He Xuhong; Zhao Bingquan

2007-01-01

The qualitative and quantitative psychology evaluation methods to the nuclear power plant operators were analyzed and discussed in the paper. The comparison analysis to the scope and result of application was carried out between method of outline figure fitted and method of fuzzy synthetic evaluation. The research results can be referenced to the evaluation of nuclear power plant operators. (authors)

Cluster-randomized Studies in Educational Research: Principles and Methodological Aspects

Directory of Open Access Journals (Sweden)

Dreyhaupt, Jens

2017-05-01

Full Text Available An increasing number of studies are being performed in educational research to evaluate new teaching methods and approaches. These studies could be performed more efficiently and deliver more convincing results if they more strictly applied and complied with recognized standards of scientific studies. Such an approach could substantially increase the quality in particular of prospective, two-arm (intervention studies that aim to compare two different teaching methods. A key standard in such studies is randomization, which can minimize systematic bias in study findings; such bias may result if the two study arms are not structurally equivalent. If possible, educational research studies should also achieve this standard, although this is not yet generally the case. Some difficulties and concerns exist, particularly regarding organizational and methodological aspects. An important point to consider in educational research studies is that usually individuals cannot be randomized, because of the teaching situation, and instead whole groups have to be randomized (so-called “cluster randomization”. Compared with studies with individual randomization, studies with cluster randomization normally require (significantly larger sample sizes and more complex methods for calculating sample size. Furthermore, cluster-randomized studies require more complex methods for statistical analysis. The consequence of the above is that a competent expert with respective special knowledge needs to be involved in all phases of cluster-randomized studies.Studies to evaluate new teaching methods need to make greater use of randomization in order to achieve scientifically convincing results. Therefore, in this article we describe the general principles of cluster randomization and how to implement these principles, and we also outline practical aspects of using cluster randomization in prospective, two-arm comparative educational research studies.

Cluster-randomized Studies in Educational Research: Principles and Methodological Aspects.

Science.gov (United States)

Dreyhaupt, Jens; Mayer, Benjamin; Keis, Oliver; Öchsner, Wolfgang; Muche, Rainer

2017-01-01

An increasing number of studies are being performed in educational research to evaluate new teaching methods and approaches. These studies could be performed more efficiently and deliver more convincing results if they more strictly applied and complied with recognized standards of scientific studies. Such an approach could substantially increase the quality in particular of prospective, two-arm (intervention) studies that aim to compare two different teaching methods. A key standard in such studies is randomization, which can minimize systematic bias in study findings; such bias may result if the two study arms are not structurally equivalent. If possible, educational research studies should also achieve this standard, although this is not yet generally the case. Some difficulties and concerns exist, particularly regarding organizational and methodological aspects. An important point to consider in educational research studies is that usually individuals cannot be randomized, because of the teaching situation, and instead whole groups have to be randomized (so-called "cluster randomization"). Compared with studies with individual randomization, studies with cluster randomization normally require (significantly) larger sample sizes and more complex methods for calculating sample size. Furthermore, cluster-randomized studies require more complex methods for statistical analysis. The consequence of the above is that a competent expert with respective special knowledge needs to be involved in all phases of cluster-randomized studies. Studies to evaluate new teaching methods need to make greater use of randomization in order to achieve scientifically convincing results. Therefore, in this article we describe the general principles of cluster randomization and how to implement these principles, and we also outline practical aspects of using cluster randomization in prospective, two-arm comparative educational research studies.

Building research capacity and productivity among advanced practice nurses: an evaluation of the Community of Practice model.

Science.gov (United States)

Gullick, Janice G; West, Sandra H

2016-03-01

The aim of this study was to evaluate Wenger's Community of Practice as a framework for building research capacity and productivity. While research productivity is an expected domain in influential models of advanced nursing practice, internationally it remains largely unmet. Establishment of nursing research capacity precedes productivity and consequently, there is a strong imperative to identify successful capacity-building models for nursing-focussed research in busy clinical environments. Prospective, longitudinal, qualitative descriptive design was used in this study. Bruyn's participant observation framed evaluation of a Community of Practice comprising 25 advanced practice nurses. Data from focus groups, education evaluations, blog/email transcripts and field observations, collected between 2007 and 2014, were analysed using a qualitative descriptive method. The Community of Practice model invited differing levels of participation, allowed for evolution of the research community and created a rhythm of research-related interactions and enduring research relationships. Participants described the value of research for their patients and families and the significance of the developing research culture in providing richness to their practice and visibility of their work to multidisciplinary colleagues. Extensive examples of research dissemination and enrolment in doctoral programmes further confirmed this value. A Community of Practice framework is a powerful model enabling research capacity and productivity evidenced by publication. In developing a solid foundation for a nursing research culture, it should be recognized that research skills, confidence and growth develop over an extended period of time and success depends on skilled coordination and leadership. © 2015 John Wiley & Sons Ltd.

The Evaluation of Research Loop and Bio beam GM8000 for Preparation of Fundamental Study of Insect Disinfection, Dysmicoccus neobrevipes into Irradiation Treatment

International Nuclear Information System (INIS)

Ahmad Zainuri Mohd Dzomir; Hasan Sham; Suhana Yusof; Ahsanulkhaliqin Abdul Wahab; Zainon Othman; Shuhaimi Shamsudin; Zulkifli Johari; Norsiah Mohd Jani; George, Cosmos

2014-01-01

Dysmicoccus neobrevipes is a major quarantine pests of pineapple and irradiation is the treatment suggested and adopted for preventing the spread of this insect to importing countries. The development of treatment protocols for irradiation procedures is important as a strategy to expand the export of fruit to new markets by overcoming trade barriers by countries with quarantine regulations against this insect. Before a thorough study be made, basic research on disinfections should be conducted. To meet this goal, Research loop and Bio beam GM 8000 were selected for initial evaluation before they are used in basic research which is used Fricke dosimeter. The findings research indicates Loop index equal to dose uniformity ratio of 1.2 compared to GM Bio beam 8000 of 1.7 and 3.2 for irradiation oscillation mode and fixed source 170 mm respectively. (author)

Requirements for an evaluation infrastructure for reliable pervasive healthcare research

DEFF Research Database (Denmark)

Wagner, Stefan Rahr; Toftegaard, Thomas Skjødeberg; Bertelsen, Olav W.

2012-01-01

The need for a non-intrusive evaluation infrastructure platform to support research on reliable pervasive healthcare in the unsupervised setting is analyzed and challenges and possibilities are identified. A list of requirements is presented and a solution is suggested that would allow researchers...

Integrated Technology Rotor/Flight Research Rotor (ITR/FRR) concept definition study

Science.gov (United States)

Hughes, C. W.

1983-01-01

Studies were conducted by Hughes Helicopters, Inc. (HHI) for the Applied Technology Laboratory and Aeromechanics Laboratory, U.S. Army Research and Technology Laboratories (AVRADCOM) and the Ames Research Center, National Aeronautics and Space Administration (NASA). Results of predesign studies of advanced main rotor hubs, including bearingless designs, are presented in this report. In addition, the Government's rotor design goals and specifications were reviewed and evaluated. Hub concepts were designed and qualitatively evaluated in order to select the two most promising concepts for further development. Various flexure designs, control systems, and pitchcase designs were investigated during the initial phases of this study. The two designs selected for additional development were designated the V-strap and flat-strap cruciform hubs. These hubs were designed for a four bladed rotor and were sized for 18,400 pounds gross weight with the same diameter (62 feet) and solidity (23 inch chord) as the existing rotor on the Rotor Systems Research Aircraft (RSRA).

A Second Year Evaluation Study of Promethean ActivClassroom. Executive Summary

Science.gov (United States)

Marzano Research Laboratory, 2010

2010-01-01

During the 2009-2010 school year, Marzano Research Laboratory (MRL) was commissioned by Promethean Ltd. to conduct a second year evaluation study of the effects of Promethean ActivClassroom on student academic achievement. This executive summary highlights the key findings. [For "A Second Year Evaluation Study of Promethean ActivClassroom. Final…

Studies on engineering technologies in the Mizunami Underground Research Laboratory. FY 2007 (Contract research)

International Nuclear Information System (INIS)

Noda, Masaru; Suyama, Yasuhiro; Nobuto, Jun; Ijiri, Yuji; Mikake, Shinichiro; Matsui, Hiroya

2009-07-01

The Mizunami Underground Research Laboratory (MIU) of the Japan Atomic Energy Agency is a major site for geoscientific research to advance the scientific and technological basis for geological disposal of high-level radioactive waste in crystalline rock. Studies on relevant engineering technologies in the MIU consist of a) research on design and construction technology for very deep underground applications, and b) research on engineering technology as a basis of geological disposal. In the Second Phase of the MIU project (the construction phase), engineering studies have focused on research into design and construction technologies for deep underground. The main subjects in the study of very deep underground structures consist of the following: 'Demonstration of the design methodology', 'Demonstration of existing and supplementary excavation methods', 'Demonstration of countermeasures during excavation' and 'Demonstration of safe construction'. In the FY 2007 studies, identification and evaluation of the subjects for study of engineering technologies in the construction phase were carried out to optimize future research work. Specific studies included: validation of the existing design methodology based on data obtained during construction; validation of existing and supplementary rock excavation methods for very deep shafts; estimation of rock stability under high differential water pressures, methodology on long-term maintenance of underground excavations and risk management systems for construction of underground structures have been performed. Based on these studies, future research focused on the four subject areas, which are 'Demonstration of the design methodology', 'Demonstration of existing and supplementary excavation methods', 'Demonstration of countermeasures during excavation' and 'Demonstration of safe construction', has been identified. The design methodology in the first phase of the MIU Project (surface-based investigation phase) was verified to

A Theoretical and Methodological Evaluation of Leadership Research.

Science.gov (United States)

Lashbrook, Velma J.; Lashbrook, William B.

This paper isolates some of the strengths and weaknesses of leadership research by evaluating it from both a theoretical and methodological perspective. The seven theories or approaches examined are: great man, trait, situational, style, functional, social influence, and interaction positions. General theoretical, conceptual, and measurement…

Research Project Evaluation-Learnings from the PATHWAYS Project Experience.

Science.gov (United States)

Galas, Aleksander; Pilat, Aleksandra; Leonardi, Matilde; Tobiasz-Adamczyk, Beata

2018-05-25

Every research project faces challenges regarding how to achieve its goals in a timely and effective manner. The purpose of this paper is to present a project evaluation methodology gathered during the implementation of the Participation to Healthy Workplaces and Inclusive Strategies in the Work Sector (the EU PATHWAYS Project). The PATHWAYS project involved multiple countries and multi-cultural aspects of re/integrating chronically ill patients into labor markets in different countries. This paper describes key project's evaluation issues including: (1) purposes, (2) advisability, (3) tools, (4) implementation, and (5) possible benefits and presents the advantages of a continuous monitoring. Project evaluation tool to assess structure and resources, process, management and communication, achievements, and outcomes. The project used a mixed evaluation approach and included Strengths (S), Weaknesses (W), Opportunities (O), and Threats (SWOT) analysis. A methodology for longitudinal EU projects' evaluation is described. The evaluation process allowed to highlight strengths and weaknesses and highlighted good coordination and communication between project partners as well as some key issues such as: the need for a shared glossary covering areas investigated by the project, problematic issues related to the involvement of stakeholders from outside the project, and issues with timing. Numerical SWOT analysis showed improvement in project performance over time. The proportion of participating project partners in the evaluation varied from 100% to 83.3%. There is a need for the implementation of a structured evaluation process in multidisciplinary projects involving different stakeholders in diverse socio-environmental and political conditions. Based on the PATHWAYS experience, a clear monitoring methodology is suggested as essential in every multidisciplinary research projects.

The International Endometriosis Evaluation Program (IEEP Study) - A Systematic Study for Physicians, Researchers and Patients.

Science.gov (United States)

Burghaus, S; Fehm, T; Fasching, P A; Blum, S; Renner, S K; Baier, F; Brodkorb, T; Fahlbusch, C; Findeklee, S; Häberle, L; Heusinger, K; Hildebrandt, T; Lermann, J; Strahl, O; Tchartchian, G; Bojahr, B; Porn, A; Fleisch, M; Reicke, S; Füger, T; Hartung, C-P; Hackl, J; Beckmann, M W; Renner, S P

2016-08-01

Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers.

Systematic review and meta-analysis of studies evaluating diagnostic test accuracy: A practical review for clinical researchers-Part I. general guidance and tips

International Nuclear Information System (INIS)

Kim, Kyung Won; Choi, Sang Hyun; Huh, Jimi; Park, Seong Ho; Lee, June Young

2015-01-01

In the field of diagnostic test accuracy (DTA), the use of systematic review and meta-analyses is steadily increasing. By means of objective evaluation of all available primary studies, these two processes generate an evidence-based systematic summary regarding a specific research topic. The methodology for systematic review and meta-analysis in DTA studies differs from that in therapeutic/interventional studies, and its content is still evolving. Here we review the overall process from a practical standpoint, which may serve as a reference for those who implement these methods

Evaluation of NKS research activities during 2002-2005

Energy Technology Data Exchange (ETDEWEB)

Sairanen, R. [Radiation and Nuclear Safety Authority (Finland); Persson, P. [Independent consultant (Sweden); Hedemann Jensen, P. [Danish Decommissioning (Denmark); Lindmo, T. [The Norwegian Univ. of Science and Technology (Norway)

2006-12-15

NKS research work during the years 2002-2005 and its results have been evaluated against a set of criteria defined by the NKS Board. The evaluation encompassed the NKS-R (reactor safety) and NKS-B (emergency preparedness) programs and was conducted by two persons per program. The mode of work of the two evaluation teams was adapted to the special conditions of the program at hand, one being aimed more at the nuclear industry and the other at a more academic surrounding; in both cases, however, with great involvement of relevant national authorities. The findings of the evaluators are presented in this report. Financing and participating organizations, end users, deliverables, quality aspects, cost-benefit issues, time schedules, budgets and related issues are discussed. Finally, the sections on NKS-R and NKS-B, respectively, include conclusions and recommendations for future NKS work. (au)

Evaluation of NKS research activities during 2002-2005

International Nuclear Information System (INIS)

Sairanen, R.; Persson, P.; Hedemann Jensen, P.; Lindmo, T.

2006-12-01

NKS research work during the years 2002-2005 and its results have been evaluated against a set of criteria defined by the NKS Board. The evaluation encompassed the NKS-R (reactor safety) and NKS-B (emergency preparedness) programs and was conducted by two persons per program. The mode of work of the two evaluation teams was adapted to the special conditions of the program at hand, one being aimed more at the nuclear industry and the other at a more academic surrounding; in both cases, however, with great involvement of relevant national authorities. The findings of the evaluators are presented in this report. Financing and participating organizations, end users, deliverables, quality aspects, cost-benefit issues, time schedules, budgets and related issues are discussed. Finally, the sections on NKS-R and NKS-B, respectively, include conclusions and recommendations for future NKS work. (au)

Evaluation acting: the experience of a public research institute

International Nuclear Information System (INIS)

Guimaraes, Regia Ruth Ramirez; Ferreira, Hudson Rubio; Filgueiras, Sergio A. Cunha

2007-01-01

Innovation and knowledge management are central questions of the modern world economy where the incorporation of new knowledge is determining for competition. In this context, there is a movement of pression under public research institutions for a more dynamic participation on the local innovation system. The institutions of C and T should prepare to help the companies to insert in the context of open economies and also to compete in the global market. The modernity requires flexibility and organizational changes in the research institutions. Redefinitions of their practices in relation to other aspects such as: financing sources; partnership with other organizations; definition and planning of the objectives; evaluation, diffusion and valorization of the results and the establishing of a measuring system and performance indicators. Aiming at having an effective institutional insertion on the national and regional systems of innovation, the Nuclear Technology Development Center - CDTN reformulated its strategical planning, incorporating the view of the researchers of the Center and external experts. As part of the evaluation process, CDTN organizes an annual seminar for evaluating its projects, focused on presenting the results and also on the analysis of the performance indicators. The result of this pairs review are widely informed to the Institution and is an important tool for the critical analysis of the institutional performance and for corrections to be made by the high direction. This paper presents the methodology for evaluating the results, as well as the difficulties and improvements incorporated to the process, which has been applied for three years. (author)

Applied Warfighter Ergonomics: A Research Method for Evaluating Military Individual Equipment

National Research Council Canada - National Science Library

Takagi, Koichi

2005-01-01

The objective of this research effort is to design and implement a laboratory and establish a research method focused on scientific evaluation of human factors considerations for military individual...

Guidelines for Qualitative Research in Organization Studies: Controversy and Possibilities

Directory of Open Access Journals (Sweden)

Maria Fernanda Rios Cavalcanti

2017-09-01

Full Text Available The aim of the present article is to tackle the controversy of establishing guidelines for qualitative research in Organization and Management Theory (OMT and to present a summary of suggestions on how to conduct good qualitative research given by methodologists on top-tier international publications. In order to do so, the article discusses: general guidelines for qualitative research; how to achieve coherence and transparency in a qualitative empirical study; the meaning and importance of the concept of reflexivity; and, finally how to establish a theoretical contribution and transferability of findings in such context. The work presents a valuable contribution because such guidelines, concepts, and approaches can be adopted by students and researchers when conducting a qualitative research proposal, and by periodic reviewers to evaluate the quality of existing empirical studies.

Research priorities in medical education: A national study

Directory of Open Access Journals (Sweden)

Mina Tootoonchi

2012-01-01

Full Text Available Background: One preliminary step to strengthen medical education research would be determining the research prior-ities. The aim of this study was to determine the research priorities of medical education in Iran in 2007-2008. Methods: This descriptive study was carried out in two phases. Phase one was performed in 3 stages and used Delphi technique among academic staffs of Isfahan University of Medical Sciences. The three stages included a brainstorming workshop for 140 faculty members and educational experts resulting in a list of research priorities, then, in the second and third stages 99 and 76 questionnaires were distributed among faculty members. In the second phase, the final ques-tionnaires were mailed to educational research center managers of universities type I, II and III, and were distributed among 311 academic members and educational experts to rate the items on a numerical scale ranging from 1 to 10. Results: The most important research priorities included faculty members′ development methods, faculty members′ motives, satisfaction and welfare, criteria and procedures of faculty members′ promotion, teaching methods and learning techniques, job descriptions and professional skills of graduates, quality management in education, second language, clinical education, science production in medicine, faculty evaluation and information technology. Conclusions: This study shows the medial education research priorities in national level and in different types of medical universities in Iran. It is recommended that faculty members and research administrators consider the needs and requirements of education and plan the researches in education according to these priorities.

Study on post-earthquake plant evaluation and communication (Annual safety research report, JFY 2011)

International Nuclear Information System (INIS)

2012-01-01

The aims of this study are to establish a post-earthquake plant evaluation method and to develop a communication system for the improving seismic safety regulations as well as encouraging public communication. The Miyagiken-oki earthquake in 2005, Onagawa Nuclear Power Plant shut down automatically. Subsequently, JNES started development of post-earthquake plant evaluation and communication system based on the experience of the cross-check analysis for Onagawa Nuclear Power Plant. The Niigata-ken Chuetsu-oki Earthquake in 2007, the plant situation was not transmitted promptly. The loss of information sharing between local community and related organizations caused the public anxiety. The importance of plant information transmission as well as seismic information gathering were recognized. The proposal for the solution of the information issues were performed by government committee, In this study the evaluation method for soundness of the main structure and equipment after earthquake event were updated. Moreover, information dissemination to the public and transparent communication methodology was examined by the Industry-Academia-Government cooperation in the Kashiwazaki-Kariwa region. (author)

Report of the evaluation by the ad hoc review committee on advanced photon and synchrotron radiation research. In-advance evaluation in fiscal year 2001

International Nuclear Information System (INIS)

2001-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Advanced Photon and Synchrotron Radiation Research in accordance with the 'Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the adequacy of the R and D programs to be implemented for five years starting in Fiscal Year 2002 at Advanced Photon Research Center and at Synchrotron Radiation Research Center in Kansai Research Establishment of JAERI. The Ad Hoc Review Committee consisted of ten specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from May to July 2001. The evaluation was performed on the basis of the materials submitted in advanced and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 21, 2001, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on July 12, 2001. This report describes the result of the evaluation by the Ad Hoc Review Committee on Advanced Photon and Synchrotron Radiation Research. (author)

A Different Approach to the Evaluation of Research Libraries. Research Brief No. 6.

Science.gov (United States)

Council on Library and Information Resources, Washington, DC.

In 1996, the Council on Library and Information Resources (CLIR) supported a project at Rutgers University that applied new economic theories to measuring how well research libraries fulfill their service roles. This summary draws on the original proposal and the final report from the project's directors. The evaluation of library performance is…

An Empirical Study on Marketing Effectiveness Evaluation of Green Food Industry

OpenAIRE

Yazhou Xiong; Qianxia Lu; Rui Wang

2015-01-01

This study aims to evaluate the marketing effectiveness of green food industry in Hubei Province via fuzzy comprehensive evaluation. Based on the cost basis of analysis of present situation, an evaluation system of marketing effectiveness evaluation on green food industry is established from three aspects, including the industry factor, policy factor and marketing performance factor. And fuzzy comprehensive evaluation method is used to make the quantitative research, analyze the major obstacl...

An Evaluation of h-Index as a Measure of Research Productivity Among Canadian Academic Plastic Surgeons.

Science.gov (United States)

Hu, Jiayi; Gholami, Arian; Stone, Nicholas; Bartoszko, Justyna; Thoma, Achilleas

2018-02-01

Evaluation of research productivity among plastic surgeons can be complex. The Hirsch index (h-index) was recently introduced to evaluate both the quality and quantity of one's research activity. It has been proposed to be valuable in assessing promotions and grant funding within academic medicine, including plastic surgery. Our objective is to evaluate research productivity among Canadian academic plastic surgeons using the h-index. A list of Canadian academic plastic surgeons was obtained from websites of academic training programs. The h-index was retrieved using the Scopus database. Relevant demographic and academic factors were collected and their effects on the h-index were analyzed using the t test and Wilcoxon Mann-Whitney U test. Nominal and categorical variables were analyzed using χ 2 test and 1-way analysis of variance. Univariate and multivariate models were built a priori. All P values were 2 sided, and P h-index of 7.6. Over 80% of the surgeons were male. Both univariable and multivariable analysis showed that graduate degree ( P h-index. Limitations of the study include that the Scopus database and the websites of training programs were not always up-to-date. The h-index is a novel tool for evaluating research productivity in academic medicine, and this study shows that the h-index can also serve as a useful metric for measuring research productivity in the Canadian plastic surgery community. Plastic surgeons would be wise to familiarize themselves with the h-index concept and should consider using it as an adjunct to existing metrics such as total publication number.

Study for improvement of performance of the test and research reactors

Energy Technology Data Exchange (ETDEWEB)

Sakurai, Fumio [Japan Atomic Energy Research Inst., Tokai, Ibaraki (Japan). Tokai Research Establishment

1999-03-01

Current utilization needs for the test and research reactors become more advanced and diversified along with the advance of nuclear science and technology. Besides, the requested safety for the research and test reactors grows strictly every year as well as a case of the power reactors. Under this circumstance, every effort to improve reactor performance including its safety is necessary to be sustained for allowing more effective utilization of the test and research reactors as experimental apparatus for advanced researches. In this study, the following three themes i.e., JMTR high-performance fuel element, evaluation method of fast neutron irradiation dose in the JMTR, evaluation method of performance of siphon break valve as core covering system for water-cooled test and research reactors, were investigated respectively from the views of improvement of core performance as a neutron source, utilization performance as an experimental apparatus, and safety as a reactor plant. (author)

Research Note Nutritional evaluation of Ficus thonningii Blume ...

African Journals Online (AJOL)

Research Note Nutritional evaluation of Ficus thonningii Blume leaves as ruminant livestock feed in the Ahferom district of Tigray, Ethiopia. ... Data on foliar nitrogen (N), phosphorus (P), potassium (K), dry matter (DM), crude protein (CP), digestible crude protein (DCP), ether extract (EE), crude fibre (CF), ash content and ...

The case for applying an early-lifecycle technology evaluation methodology to comparative evaluation of requirements engineering research

Science.gov (United States)

Feather, Martin S.

2003-01-01

The premise of this paper is taht there is a useful analogy between evaluation of proposed problem solutions and evaluation of requirements engineering research itself. Both of these application areas face the challenges of evaluation early in the lifecycle, of the need to consider a wide variety of factors, and of the need to combine inputs from multiple stakeholders in making thse evaluation and subsequent decisions.

Evaluating patient and stakeholder engagement in research: moving from theory to practice.

Science.gov (United States)

Esmail, Laura; Moore, Emily; Rein, Alison

2015-03-01

Despite the growing demand for research that engages stakeholders, there is limited evidence in the literature to demonstrate its value - or return on investment. This gap indicates a general lack of evaluation of engagement activities. To adequately inform engagement activities, we need to further investigate the dividends of engaged research, and how to evaluate these effects. This paper synthesizes the literature on hypothesized impacts of engagement, shares what has been evaluated and identifies steps needed to reduce the gap between engagement's promises and the underlying evidence supporting its practice. This assessment provides explicit guidance for better alignment of engagement's promised benefits with evaluation efforts and identifies specific areas for development of evaluative measures and better reporting processes.

The evaluator effect in usability studies: Problem detection and severity judgments

DEFF Research Database (Denmark)

Jacobsen, Niels Ebbe; Hertzum, Morten; John, Bonnie E.

1998-01-01

Usability studies are commonly used in industry and applied in research as a yardstick for other usability evaluation methods. Though usability studies have been studied extensively, one potential threat to their reliability has been left virtually untouched: the evaluator effect. In this study......, four evaluators individually analyzed four videotaped usability test sessions. Only 20% of the 93 detected problems were detected by all evaluators, and 46% were detected by only a single evaluator. From the total set of 93 problems the evaluators individually selected the ten problems they considered...... most severe. None of the selected severe problems appeared on all four evaluators’ top-10 lists, and 4 of the 11 problems that were considered severe by more than one evaluator were only detected by one or two evaluators. Thus, both detection of usability problems and selection of the most severe...

A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation.

Science.gov (United States)

Acosta, Joie D; Chinman, Matthew; Ebener, Patricia; Phillips, Andrea; Xenakis, Lea; Malone, Patrick S

2016-01-01

Restorative Practices in schools lack rigorous evaluation studies. As an example of rigorous school-based research, this paper describes the first randomized control trial of restorative practices to date, the Study of Restorative Practices. It is a 5-year, cluster-randomized controlled trial (RCT) of the Restorative Practices Intervention (RPI) in 14 middle schools in Maine to assess whether RPI impacts both positive developmental outcomes and problem behaviors and whether the effects persist during the transition from middle to high school. The two-year RPI intervention began in the 2014-2015 school year. The study's rationale and theoretical concerns are discussed along with methodological concerns including teacher professional development. The theoretical rationale and description of the methods from this study may be useful to others conducting rigorous research and evaluation in this area.

How journal rankings can suppress interdisciplinary research: a comparison between innovation studies and business & management

NARCIS (Netherlands)

Rafols, I.; Leydesdorff, L.; O'Hare, A.; Nightingale, P.; Stirling, A.

2012-01-01

This study provides quantitative evidence on how the use of journal rankings can disadvantage interdisciplinary research in research evaluations. Using publication and citation data, it compares the degree of interdisciplinarity and the research performance of a number of Innovation Studies units

Researches on nuclear criticality safety evaluation

Energy Technology Data Exchange (ETDEWEB)

Okuno, Hiroshi; Suyama, Kenya; Nomura, Yasushi [Japan Atomic Energy Research Inst., Tokai, Ibaraki (Japan). Tokai Research Establishment

2003-10-01

For criticality safety evaluation of burnup fuel, the general-purpose burnup calculation code, SWAT, was revised, and its precision was confirmed through comparison with other results from OECD/NEA's burnup credit benchmarks. Effect by replacing the evaluated nuclear data from JENDL-3.2 to ENDF/B-VI and JEF-2.2 was also studied. Correction factors were derived for conservative evaluation of nuclide concentrations obtained with the simplified burnup code ORIGEN2.1. The critical masses of curium were calculated and evaluated for nuclear criticality safety management of minor actinides. (author)

Researches on nuclear criticality safety evaluation

International Nuclear Information System (INIS)

Okuno, Hiroshi; Suyama, Kenya; Nomura, Yasushi

2003-01-01

For criticality safety evaluation of burnup fuel, the general-purpose burnup calculation code, SWAT, was revised, and its precision was confirmed through comparison with other results from OECD/NEA's burnup credit benchmarks. Effect by replacing the evaluated nuclear data from JENDL-3.2 to ENDF/B-VI and JEF-2.2 was also studied. Correction factors were derived for conservative evaluation of nuclide concentrations obtained with the simplified burnup code ORIGEN2.1. The critical masses of curium were calculated and evaluated for nuclear criticality safety management of minor actinides. (author)

Integrating Human Factors Engineering and Information Processing Approaches to Facilitate Evaluations in Criminal Justice Technology Research.

Science.gov (United States)

Salvemini, Anthony V; Piza, Eric L; Carter, Jeremy G; Grommon, Eric L; Merritt, Nancy

2015-06-01

Evaluations are routinely conducted by government agencies and research organizations to assess the effectiveness of technology in criminal justice. Interdisciplinary research methods are salient to this effort. Technology evaluations are faced with a number of challenges including (1) the need to facilitate effective communication between social science researchers, technology specialists, and practitioners, (2) the need to better understand procedural and contextual aspects of a given technology, and (3) the need to generate findings that can be readily used for decision making and policy recommendations. Process and outcome evaluations of technology can be enhanced by integrating concepts from human factors engineering and information processing. This systemic approach, which focuses on the interaction between humans, technology, and information, enables researchers to better assess how a given technology is used in practice. Examples are drawn from complex technologies currently deployed within the criminal justice system where traditional evaluations have primarily focused on outcome metrics. Although this evidence-based approach has significant value, it is vulnerable to fully account for human and structural complexities that compose technology operations. Guiding principles for technology evaluations are described for identifying and defining key study metrics, facilitating communication within an interdisciplinary research team, and for understanding the interaction between users, technology, and information. The approach posited here can also enable researchers to better assess factors that may facilitate or degrade the operational impact of the technology and answer fundamental questions concerning whether the technology works as intended, at what level, and cost. © The Author(s) 2015.

The Research and Evaluation of Serious Games: Toward a Comprehensive Methodology

Science.gov (United States)

Mayer, Igor; Bekebrede, Geertje; Harteveld, Casper; Warmelink, Harald; Zhou, Qiqi; van Ruijven, Theo; Lo, Julia; Kortmann, Rens; Wenzler, Ivo

2014-01-01

The authors present the methodological background to and underlying research design of an ongoing research project on the scientific evaluation of serious games and/or computer-based simulation games (SGs) for advanced learning. The main research questions are: (1) what are the requirements and design principles for a comprehensive social…

Researchers’ views on research evaluation and the Danish Bibliometric Research Indicator

DEFF Research Database (Denmark)

Brøndum, Iben

2013-01-01

it might have affected their research practice. The study was carried out in 2013 (Febr-Sept) and consisted of a web-based questionnaire sent to 500 researchers in five Danish universities. Respondents were selected using systematic random sampling. Preliminary data analysis indicates that researchers...

Workforce development to embed mental health promotion research and evaluation into organisational practice.

Science.gov (United States)

Joss, Nerida; Keleher, Helen

2007-12-01

This project engaged a mental health rehabilitation organisation in health promotion research and development to build its capacity in evaluation research. Participatory research methods were used. Staff skills development occurred through training in research and evaluation methods applied to an evaluation project in mental health promotion that they conducted. All staff had some previous training in research but little, if any, experience of research practice. Staff demonstrated commitment to the idea of embedding research practice into the organisation to strengthen its ability to demonstrate program outcomes. However, the realities of work demands eventually took precedence over the tasks involved in the research process. Staff commitment, knowledge and skills are not sufficient if an organisation lacks the capacity to provide the resources or foster support for a research culture. The health promotion capacity-building framework is relevant for efforts to build health promotion research into mental health organisations. This project demonstrated that workforce development to build the capacity for mental health promotion is more likely to be successful if it is embedded into organisational strategy and culture, has sufficient resources allocated including staff time, and is supported by management.

Building research and evaluation capacity in population health: the NSW Health approach.

Science.gov (United States)

Edwards, Barry; Stickney, Beth; Milat, Andrew; Campbell, Danielle; Thackway, Sarah

2016-02-01

Issue addressed An organisational culture that values and uses research and evaluation (R&E) evidence to inform policy and practice is fundamental to improving health outcomes. The 2016 NSW Government Program Evaluation Guidelines recommend investment in training and development to improve evaluation capacity. The purpose of this paper is to outline the approaches taken by the NSW Ministry of Health to develop R&E capacity and assess these against existing models of practice. Method The Ministry of Health's Centre for Epidemiology and Evidence (CEE) takes an evidence-based approach to building R&E capacity in population health. Strategies are informed by: the NSW Population Health Research Strategy, R&E communities of practice across the Ministry and health Pillar agencies and a review of the published evidence on evaluation capacity building (ECB). An internal survey is conducted biennially to monitor research activity within the Ministry's Population and Public Health Division. One representative from each of the six centres that make up the Division coordinates completion of the survey by relevant staff members for their centre. Results The review identified several ECB success factors including: implementing a tailored multifaceted approach; an organisational commitment to R&E; and offering experiential training and ongoing technical support to the workforce. The survey of research activity found that the Division funded a mix of research assets, research funding schemes, research centres and commissioned R&E projects. CEE provides technical advice and support services for staff involved in R&E and in 2015, 22 program evaluations were supported. R&E capacity building also includes a series of guides to assist policy makers, practitioners and researchers to commission, undertake and use policy-relevant R&E. Staff training includes workshops on critical appraisal, program logic and evaluation methods. From January 2013 to June 2014 divisional staff published 84

The Practice of Evaluation Research and the Use of Evaluation Results.

Science.gov (United States)

Van den Berg, G.; Hoeben, W. Th. J. G.

1984-01-01

Lack of use of educational evaluation results in the Netherlands was investigated by analyzing 14 curriculum evaluation studies. Results indicated that rational decision making with a technical (empirical) evaluation approach makes utilization of results most likely. Incremental decision making and a conformative approach make utilization least…

Supply Inventory Management: Property Accountability at Research , Development, Test, and Evaluation Installations

National Research Council Canada - National Science Library

2002-01-01

.... This report evaluates the Military Departments' improvement in maintaining property accountability over personal property at research, development, test, and evaluation installations, Personal...

From research methods to methodical researcher: Making use of the student voice towards a more comprehensive module evaluation

OpenAIRE

Hast, Michael

2015-01-01

It is not uncommon for undergraduate students to feel aversion towards research methods teaching. This does not change the fact that research methods play a key role in their education. Targeting module design is imperative to ensure success. However, end-of-module student evaluations may provide a false sense of security regarding satisfaction and learnt knowledge. In order to approach module design more effectively it may instead be necessary to view module evaluations from a delayed perspe...

Useful, Used, and Peer Approved: The Importance of Rigor and Accessibility in Postsecondary Research and Evaluation. WISCAPE Viewpoints

Science.gov (United States)

Vaade, Elizabeth; McCready, Bo

2012-01-01

Traditionally, researchers, policymakers, and practitioners have perceived a tension between rigor and accessibility in quantitative research and evaluation in postsecondary education. However, this study indicates that both producers and consumers of these studies value high-quality work and clear findings that can reach multiple audiences. The…

A Study of Developing an Attitude Scale towards Authentic Learning Environments and Evaluation

Science.gov (United States)

Çetinkaya, Murat

2018-01-01

The aim of the research is to improve a valid and reliable attributing scale which identifies authentic learning environments and evaluation attributes of the science teacher candidates. The study has been designed on the base of validity and reliability of the scale developed to evaluate the authentic learning environments. The research group is…

[Research about re-evaluation of screening of traditonal Chinese medicine symptoms item of post-marketing medicine Xuezhikang].

Science.gov (United States)

He, Wei; Xie, Yanming; Wang, Yongyan

2011-10-01

The purpose of post-marketing Chinese medicine re-evaluation is to identify Chinese medicine clinical indications, while designing scientific and rational of Chinese medicine symptoms items are important to the result of symptoms re-evaluation. This study give screening of traditional Chinese medicine(TCM) symptoms item of post-marketing medicine Xuezhikang re-evaluation as example that reference to principle dyslipidemia clinical research, academic dissertations, Xuezhikang directions, clinical expert practice experience etc. while standardization those symptom names and screening 41 dyslipidemia common symptoms. Furthermore, this paper discuss about the accoerdance and announcements when screening symptoms item, so as to providing a research thread to manufacture PRO chart for post-marketing medicine re-evaluation.

The contribution of case study design to supporting research on Clubhouse psychosocial rehabilitation.

Science.gov (United States)

Raeburn, Toby; Schmied, Virginia; Hungerford, Catherine; Cleary, Michelle

2015-10-01

Psychosocial Clubhouses provide recovery-focused psychosocial rehabilitation to people with serious mental illness at over 300 sites in more than 30 countries worldwide. To deliver the services involved, Clubhouses employ a complex mix of theory, programs and relationships, with this complexity presenting a number of challenges to those undertaking Clubhouse research. This paper provides an overview of the usefulness of case study designs for Clubhouse researchers; and suggests ways in which the evaluation of Clubhouse models can be facilitated. The paper begins by providing a brief explanation of the Clubhouse model of psychosocial rehabilitation, and the need for ongoing evaluation of the services delivered. This explanation is followed by an introduction to case study design, with consideration given to the way in which case studies have been used in past Clubhouse research. It is posited that case study design provides a methodological framework that supports the analysis of either quantitative, qualitative or a mixture of both types of data to investigate complex phenomena in their everyday contexts, and thereby support the development of theory. As such, case study approaches to research are well suited to the Clubhouse environment. The paper concludes with recommendations for future Clubhouse researchers who choose to employ a case study design. While the quality of case study research that explores Clubhouses has been variable in the past, if applied in a diligent manner, case study design has a valuable contribution to make in future Clubhouse research.

An evaluation of a data linkage training workshop for research ethics committees.

Science.gov (United States)

Tan, Kate M; Flack, Felicity S; Bear, Natasha L; Allen, Judy A

2015-03-04

In Australia research projects proposing the use of linked data require approval by a Human Research Ethics Committee (HREC). A sound evaluation of the ethical issues involved requires understanding of the basic mechanics of data linkage, the associated benefits and risks, and the legal context in which it occurs. The rapidly increasing number of research projects utilising linked data in Australia has led to an urgent need for enhanced capacity of HRECs to review research applications involving this emerging research methodology. The training described in this article was designed to respond to an identified need among the data linkage units in the Australian Population Health Research Network (PHRN) and HREC members in Australia. Five one-day face to face workshops were delivered in the study period to a total of 98 participants. Participants in the workshops represented all six categories of HREC membership composition listed in the National Health and Medical Research Centres' (NHMRC) National Statement on Ethical Conduct in Human Research. Participants were assessed at three time points, prior to the training (T1), immediately after the training (T2) and 8 to 17 months after the training (T3). Ninety participants completed the pre and post questionnaires; 58 of them completed the deferred questionnaire. Participants reported significant improvements in levels of knowledge, understanding and skills in each of the eight areas evaluated. The training was beneficial for those with prior experience in the area of ethics and data linkage as well as those with no prior exposure. Our preliminary work in this area demonstrates that the provision of intensive face to face ethics training in data linkage is feasible and has a significant impact on participant's confidence in reviewing HREC applications.

Regional research exploitation of the LHC a case-study of the required computing resources

CERN Document Server

Almehed, S; Eerola, Paule Anna Mari; Mjörnmark, U; Smirnova, O G; Zacharatou-Jarlskog, C; Åkesson, T

2002-01-01

A simulation study to evaluate the required computing resources for a research exploitation of the Large Hadron Collider (LHC) has been performed. The evaluation was done as a case study, assuming existence of a Nordic regional centre and using the requirements for performing a specific physics analysis as a yard-stick. Other imput parameters were: assumption for the distribution of researchers at the institutions involved, an analysis model, and two different functional structures of the computing resources.

The evaluation prescribes dosimetry for occupational exposure in research work places

International Nuclear Information System (INIS)

Cardenas Herrera, J.; Diaz Bernal, E.; Capote, E.; Manzano, J.; Villa Zulueta, R.; Fernandez Echemendia, J.; Delgado Martinez, R.; Guerra, M.; Ferriol Echevarria, M.

1998-01-01

The work discusses behavior shown by occupational exposure 65 workers underwent during a 10 years term at the Center of Applied Studies to Nuclear Development by evaluating dosimetric clinical indexes which are important for radiological occupational protection. Research results conclude that workers exposed to low radiation doses, behave the same as reported internationally. There are no clinical findings linking it to the influence ionizing radiation can have on health. This corresponds to what had been expected

Allied health research positions: a qualitative evaluation of their impact.

Science.gov (United States)

Wenke, Rachel J; Ward, Elizabeth C; Hickman, Ingrid; Hulcombe, Julie; Phillips, Rachel; Mickan, Sharon

2017-02-06

Research positions embedded within healthcare settings have been identified as an enabler to allied health professional (AHP) research capacity; however, there is currently limited research formally evaluating their impact. In 2008, a Health Practitioner industrial agreement funded a research capacity building initiative within Queensland Health, Australia, which included 15 new allied health research positions. The present project used a qualitative and realist approach to explore the impact of these research positions, as well as the mechanisms which facilitated or hindered their success within their respective organisations. Forty-four AHP employees from six governmental health services in Queensland, Australia, participated in the study. Individual interviews were undertaken, with individuals in research positions (n = 8) and their reporting line managers (n = 8). Four stakeholder focus groups were also conducted with clinicians, team leaders and professional heads who had engaged with the research positions. Nine key outcomes of the research positions were identified across individual, team/service and organisational/community levels. These outcomes included clinician skill development, increased research activity, clinical and service changes, increased research outputs and collaborations, enhanced research and workplace culture, improved profile of allied health, development of research infrastructure, and professional development of individuals in the research positions. Different mechanisms that influenced these outcomes were identified. These mechanisms were grouped by those related to the (1) research position itself, (2) organisational factors and (3) implementation factors. The present findings highlight the potential value of the research positions for individuals, teams and clinical services across different governmental healthcare services, and demonstrate the impact of the roles on building the internal and external profile of allied health

Evaluation Study of the Monitoring Result for River Water Environment Component Around U Mining Research Area at, Kalan West Kalimantan from 1997/1998 up to 2002

International Nuclear Information System (INIS)

Achmad-Sorot-Soediro

2004-01-01

The Uranium research which have been carrying out since 1980/1981 up to now and uranium processing activities which was carried out since 1981/1982 to 1996/1997 have probably decreased environment quality. Therefore the environment component would be monitored through Kalan river water every year. From 1997/1998 up to 2002 the environment quality decreased. So, the environment quality is necessarily to be evaluated doing those period. Aim of study is to recover development information of environmental quality at river water component up to 5 years. Evaluation has been done by comparing research the yearly data obtained and construct the correlation with U mining and processing activities on that year. BOD, COD, As, Ca, Mg, Fe, Ni, Zn, Cu, Pb, Mn, Mo and radioactivity of U, Th and Ra content with in Kalan water river tends to become lower in accordance with the decreasing of U mining and processing research activities. (author)

Improving methods to evaluate the impacts of plant invasions: lessons from 40 years of research

Science.gov (United States)

Stricker, Kerry Bohl; Hagan, Donald; Flory, S. Luke

2015-01-01

Methods used to evaluate the ecological impacts of biological invasions vary widely from broad-scale observational studies to removal experiments in invaded communities and experimental additions in common gardens and greenhouses. Different methods provide information at diverse spatial and temporal scales with varying levels of reliability. Thus, here we provide a synthetic and critical review of the methods used to evaluate the impacts of plant invasions and provide recommendations for future research. We review the types of methods available and report patterns in methods used, including the duration and spatial scale of studies and plant functional groups examined, from 410 peer-reviewed papers published between 1971 and 2011. We found that there has been a marked increase in papers published on plant invasion impacts since 2003 and that more than half of all studies employed observational methods while impacts of invasive forbs and graminoids while impacts, we argue that longer-term experimental research and more studies that use predictive modelling and evaluate impacts of invasions on ecosystem processes and fauna are needed. Combining broad-scale observational studies with experiments and predictive modelling may provide the most insight into invasion impacts for policy makers and land managers seeking to reduce the effects of plant invasions. PMID:25829379

Global research priorities for interpersonal violence prevention: a modified Delphi study.

Science.gov (United States)

Mikton, Christopher R; Tanaka, Masako; Tomlinson, Mark; Streiner, David L; Tonmyr, Lil; Lee, Bandy X; Fisher, Jane; Hegadoren, Kathy; Pim, Joam Evans; Wang, Shr-Jie Sharlenna; MacMillan, Harriet L

2017-01-01

To establish global research priorities for interpersonal violence prevention using a systematic approach. Research priorities were identified in a three-round process involving two surveys. In round 1, 95 global experts in violence prevention proposed research questions to be ranked in round 2. Questions were collated and organized according to the four-step public health approach to violence prevention. In round 2, 280 international experts ranked the importance of research in the four steps, and the various substeps, of the public health approach. In round 3, 131 international experts ranked the importance of detailed research questions on the public health step awarded the highest priority in round 2. In round 2, "developing, implementing and evaluating interventions" was the step of the public health approach awarded the highest priority for four of the six types of violence considered (i.e. child maltreatment, intimate partner violence, armed violence and sexual violence) but not for youth violence or elder abuse. In contrast, "scaling up interventions and evaluating their cost-effectiveness" was ranked lowest for all types of violence. In round 3, research into "developing, implementing and evaluating interventions" that addressed parenting or laws to regulate the use of firearms was awarded the highest priority. The key limitations of the study were response and attrition rates among survey respondents. However, these rates were in line with similar priority-setting exercises. These findings suggest it is premature to scale up violence prevention interventions. Developing and evaluating smaller-scale interventions should be the funding priority.

Nursing research. Components of a clinical research study.

Science.gov (United States)

Bargagliotti, L A

1988-09-01

Nursing research is the systematic collection and analysis of data about clinically important phenomena. While there are norms for conducting research and rules for using certain research procedures, the reader must always filter the research report against his or her nursing knowledge. The most common questions a reader should ask are "Does it make sense? Can I think of any other reasonable explanation for the findings? Do the findings fit what I have observed?" If the answers are reasonable, research findings from carefully conducted studies can provide a basis for making nursing decisions. One of the earliest accounts of nursing research, which indicates the power of making systematic observations, was Florence Nightingale's study. It compared deaths among soldiers in the Crimean War with deaths of soldiers in the barracks of London. Her research demonstrated that soldiers in the barracks had a much higher death rate than did the soldiers at war. On the basis of the study, sanitary conditions in the barracks were changed substantially.

The Design and Evaluation of a Front-End User Interface for Energy Researchers.

Science.gov (United States)

Borgman, Christine L.; And Others

1989-01-01

Reports on the Online Access to Knowledge (OAK) Project, which developed software to support end user access to a Department of Energy database based on the skill levels and needs of energy researchers. The discussion covers issues in development, evaluation, and the study of user behavior in designing an interface tailored to a special…

An evaluation of the interaction of place and community-based participatory research as a research methodology in the implementation of a sexually transmitted infection intervention for Greenlandic youth.

Science.gov (United States)

Rink, Elizabeth

2016-01-01

Newly emerging research suggests that the actual physical location of a study and the geographic context in which a study is implemented influences the types of research methods most appropriate to use in a study as well as the study's research outcomes. This article presents a reflection on the extent to which place influenced the use of community-based participatory research (CBPR) as a research methodology in the implementation of an intervention to address sexually transmitted infections in Greenland. An evaluation of the interaction between place and CBPR suggests that the physicality of place influenced the intervention's successes and challenges. Future research that uses CBPR as a research methodology in sexual and reproductive health research in the Arctic warrants situating the research design, implementation and outcomes within the context of place.

Development of a Technology Transfer Score for Evaluating Research Proposals: Case Study of Demand Response Technologies in the Pacific Northwest

Science.gov (United States)

Estep, Judith

researcher and recipient relationship, specific to technology transfer. In this research, the evaluation criteria of several research organizations were assessed to understand the extent to which the success attributes that were identified in literature were considered when reviewing research proposals. While some of the organizations included a few of the success attributes, none of the organizations considered all of the attributes. In addition, none of the organizations quantified the value of the success attributes. The effectiveness of the model relies extensively on expert judgments to complete the model validation and quantification. Subject matter experts ranging from senior executives with extensive experience in technology transfer to principal research investigators from national labs, universities, utilities, and non-profit research organizations were used to ensure a comprehensive and cross-functional validation and quantification of the decision model. The quantified model was validated using a case study involving demand response (DR) technology proposals in the Pacific Northwest. The DR technologies were selected based on their potential to solve some of the region's most prevalent issues. In addition, several sensitivity scenarios were developed to test the model's response to extreme case scenarios, impact of perturbations in expert responses, and if it can be applied to other than demand response technologies. In other words, is the model technology agnostic? In addition, the flexibility of the model to be used as a tool for communicating which success attributes in a research proposal are deficient and need strengthening and how improvements would increase the overall technology transfer score were assessed. The low scoring success attributes in the case study proposals (e.g. project meetings, etc.) were clearly identified as the areas to be improved for increasing the technology transfer score. As a communication tool, the model could help a research

An Implementation Research Approach to Evaluating Health Insurance Programs: Insights from India

Directory of Open Access Journals (Sweden)

Krishna D. Rao

2016-05-01

Full Text Available One of the distinguishing features of implementation research is the importance given to involve implementers in all aspects of research, and as users of research. We report on a recent implementation research effort in India, in which researchers worked together with program implementers from one of the longest serving government funded insurance schemes in India, the Rajiv Aarogyasri Scheme (RAS in the state of undivided Andhra Pradesh, that covers around 70 million people. This paper aims to both inform on the process of the collaborative research, as well as, how the nature of questions that emerged out of the collaborative exercise differed in scope from those typically asked of insurance program evaluations. Starting in 2012, and over the course of a year, staff from the Aarogyasri Health Care Trust (AHCT, and researchers held a series of meetings to identify research questions that could serve as a guide for an evaluation of the RAS. The research questions were derived from the application of a Logical Framework Approach (“log frame” to the RAS. The types of questions that emerged from this collaborative effort were compared with those seen in the published literature on evaluations of insurance programs in low- and middle-income countries (LMICs. In the published literature, 60% of the questions pertained to output/outcome of the program and the remaining 40%, relate to processes and inputs. In contrast, questions generated from the RAS participatory research process between implementers and researchers had a remarkably different distribution – 81% of questions looked at program input/processes, and 19% on outputs and outcomes. An implementation research approach can lead to a substantively different emphasis of research questions. While there are several challenges in collaborative research between implementers and researchers, an implementation research approach can lead to incorporating tacit knowledge of program implementers

The History of Women in Botany and Science at the Herbarium Library: Evaluation for Historical Research.

Science.gov (United States)

Wicker, Sandra J.

Evaluating library collections by comparing them to bibliographies has a long history in research libraries. This evaluative study examined all 107 titles within the "Women in Botany" section of the Herbarium Library at The Ohio State University (OSU). The Herbarium is not part of the OSU Library system, but functions as a satellite to…

Evaluating automatically annotated treebanks for linguistic research

NARCIS (Netherlands)

Bloem, J.; Bański, P.; Kupietz, M.; Lüngen, H.; Witt, A.; Barbaresi, A.; Biber, H.; Breiteneder, E.; Clematide, S.

2016-01-01

This study discusses evaluation methods for linguists to use when employing an automatically annotated treebank as a source of linguistic evidence. While treebanks are usually evaluated with a general measure over all the data, linguistic studies often focus on a particular construction or a group

Evaluation of socio-economic effects of R and D results at Japan Atomic Energy Research Institute. 2. Socio-economic evaluation of the basic research at JAERI

International Nuclear Information System (INIS)

2003-11-01

The Japan Atomic Energy Research Institute (JAERI), as a core organization devoted to comprehensive nuclear energy research, has steadily promoted various types of research and development (R and D) studies since its establishment in June 1956. Research activities are aimed at performing (1) R and D for nuclear energy, (2) the utilization and application of radiation-based technologies, and (3) the establishment of basic and fundamental research in the nuclear field. Last year, the socio-economic effects on items (1) and (2) were qualitatively and quantitatively evaluated. The quantitative evaluation of item (3) from the viewpoint of a socio-economic effect, however, calls for a different concept and methodology than previously used cost-benefit approach. Achievements obtained from the activities conducted over the last 10 years implied that socio-economics in basic research funded by the public could contribute to the (1) increase in useful intellectual stocks, (2) upbringing of highly skilled college graduates, (3) construction of new scientific facilities and creation of methodologies, (4) stimulation and promotion of social interrelations by networking, (5) increase of one's ability to solve scientific problems, and (6) establishment of venture companies. In this study, we focused on item (4) for the analysis because it assumed that the external economic effect has a link with the socio-economic effects accompanying the networking formation. For the criteria of socio-economic effects we assume that the external effect becomes significant in proportion to the width of networking and/or the magnitude of cooperation measured by numbers of co-writing studies between JAERI and the research bodies, namely private and governmental sectors and universities. Taking these criteria into consideration, the subsequent four items are prepared for quantitative study. They are (1) to clarify the basic research fields where JAERI has been established a significant effort to

Involving the public in epidemiological public health research: a qualitative study of public and stakeholder involvement in evaluation of a population-wide natural policy experiment.

Science.gov (United States)

Anderson de Cuevas, Rachel; Nylén, Lotta; Burström, Bo; Whitehead, Margaret

2018-04-20

Public involvement in research is considered good practice by European funders; however, evidence of its research impact is sparse, particularly in relation to large-scale epidemiological research. To explore what difference public and stakeholder involvement made to the interpretation of findings from an evaluation of a natural policy experiment to influence the wider social determinants of health: 'Flexicurity'. Stockholm County, Sweden. Members of the public from different occupational groups represented by blue-collar and white-collar trade union representatives. Also, members of three stakeholder groups: the Swedish national employment agency; an employers' association and politicians sitting on a national labour market committee. Total: 17 participants. Qualitative study of process and outcomes of public and stakeholder participation in four focused workshops on the interpretation of initial findings from the flexicurity evaluation. New insights from participants benefiting the interpretation of our research findings or conceptualisation of future research. Participants sensed more drastic and nuanced change in the Swedish welfare system over recent decades than was evident from our literature reviews and policy analysis. They also elaborated hidden developments in the Swedish labour market that were increasingly leading to 'insiders' and 'outsiders', with differing experiences and consequences for financial and job security. Their explanation of the differential effects of the various collective agreements for different occupational groups was new and raised further potential research questions. Their first-hand experience provided new insights into how changes to the social protection system were contributing to the increasing trends in poverty among unemployed people with limiting long-standing illness. The politicians provided further reasoning behind some of the policy changes and their intended and unintended consequences. These insights fed into

Evaluation of research projects and studies on nuclear safety in the context of implementation of the German Atomic Energy Act (AtG). Vol. 9

International Nuclear Information System (INIS)

Casper, H.

2000-01-01

The content of this report is a collection of research projects and investigations in the field of nuclear safety evaluated in 1999 and 2000 with regard to the application of the Atomic Energy Act (Atomgesetz). In addition the report gives an overview on objectives and procedures used for the evaluation. The purpose of this project, being executed for the Federal Ministry for Environment, Nature Conservation and Nuclear Safety (BMU) of the Federal Republic of Germany is to inform all parties involved in the licensing procedure as well as the consulting councils on the latest nuclear safety research results and the status of their verification in a precise short manner. In addition experts' opinions are given with regard to the relevance of these research results to nuclear rules and guidelines as well as to the execution of the Atomic Energy Act. The information consists of precise and short evaluations of final research reports or technical reports. These evaluations are prepared by specialists who are acquainted with the technical aspects of the licensing procedure of nuclear plants in the Federal Republic of Germany. This volume is the ninth report of this series. (orig.) [de

Case Study Research Methodology in Nursing Research.

Science.gov (United States)

Cope, Diane G

2015-11-01

Through data collection methods using a holistic approach that focuses on variables in a natural setting, qualitative research methods seek to understand participants' perceptions and interpretations. Common qualitative research methods include ethnography, phenomenology, grounded theory, and historic research. Another type of methodology that has a similar qualitative approach is case study research, which seeks to understand a phenomenon or case from multiple perspectives within a given real-world context.

Evaluating care from a care ethical perspective:: A pilot study.

Science.gov (United States)

Kuis, Esther E; Goossensen, Anne

2017-08-01

Care ethical theories provide an excellent opening for evaluation of healthcare practices since searching for (moments of) good care from a moral perspective is central to care ethics. However, a fruitful way to translate care ethical insights into measurable criteria and how to measure these criteria has as yet been unexplored: this study describes one of the first attempts. To investigate whether the emotional touchpoint method is suitable for evaluating care from a care ethical perspective. An adapted version of the emotional touchpoint interview method was used. Touchpoints represent the key moments to the experience of receiving care, where the patient recalls being touched emotionally or cognitively. Participants and research context: Interviews were conducted at three different care settings: a hospital, mental healthcare institution and care facility for older people. A total of 31 participants (29 patients and 2 relatives) took part in the study. Ethical considerations: The research was found not to be subject to the (Dutch) Medical Research Involving Human Subjects Act. A three-step care ethical evaluation model was developed and described using two touchpoints as examples. A focus group meeting showed that the method was considered of great value for partaking institutions in comparison with existing methods. Reflection and discussion: Considering existing methods to evaluate quality of care, the touchpoint method belongs to the category of instruments which evaluate the patient experience. The touchpoint method distinguishes itself because no pre-defined categories are used but the values of patients are followed, which is an essential issue from a care ethical perspective. The method portrays the insider perspective of patients and thereby contributes to humanizing care. The touchpoint method is a valuable instrument for evaluating care; it generates evaluation data about the core care ethical principle of responsiveness.

An Undergraduate Research Experience on Studying Variable Stars

Science.gov (United States)

Amaral, A.; Percy, J. R.

2016-06-01

We describe and evaluate a summer undergraduate research project and experience by one of us (AA), under the supervision of the other (JP). The aim of the project was to sample current approaches to analyzing variable star data, and topics related to the study of Mira variable stars and their astrophysical importance. This project was done through the Summer Undergraduate Research Program (SURP) in astronomy at the University of Toronto. SURP allowed undergraduate students to explore and learn about many topics within astronomy and astrophysics, from instrumentation to cosmology. SURP introduced students to key skills which are essential for students hoping to pursue graduate studies in any scientific field. Variable stars proved to be an excellent topic for a research project. For beginners to independent research, it introduces key concepts in research such as critical thinking and problem solving, while illuminating previously learned topics in stellar physics. The focus of this summer project was to compare observations with structural and evolutionary models, including modelling the random walk behavior exhibited in the (O-C) diagrams of most Mira stars. We found that the random walk could be modelled by using random fluctuations of the period. This explanation agreed well with observations.

Methods of investigation for cardiac autonomic dysfunction in human research studies

DEFF Research Database (Denmark)

Bernardi, Luciano; Spallone, Vincenza; Stevens, Martin

2011-01-01

This consensus document provides evidence-based guidelines regarding the evaluation of diabetic cardiovascular autonomic neuropathy (CAN) for human research studies as a result of the work of the CAN Subcommittee of the Toronto Diabetic Neuropathy Expert Group. The CAN subcommittee critically...... reviewed the limitations and strengths of the available diagnostic approaches for CAN and the need for developing new tests for autonomic function. It was concluded that the most sensitive and specific approaches currently available to evaluate CAN in clinical research are: 1) heart rate variability, 2......) baroreflex sensitivity, 3) muscle sympathetic nerve activity, 4) plasma catecholamines, and 5) heart sympathetic imaging. It was also recommended that efforts should be undertaken to develop new non-invasive and safe CAN tests to be used in clinical research, with a higher sensitivity and specificity...

Report of the summative evaluation by the advisory committee on research and development of nuclear energy technology

International Nuclear Information System (INIS)

2005-03-01

The Research Evaluation Committee of the Japan Atomic Energy Research Institute (JAERI) set up an advisory Committee on Research and Development of Nuclear Energy Technology in accordance with the 'Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations. The Advisory Committee on Research and Development of Nuclear Energy Technology evaluated the adequacy of the plans of safety research to be succeeded from JAERI to a new research institute which will be established by integration of JAERI and the Japan Nuclear Cycle Development Institute (JNC). The Advisory Committee consisted of nine specialists from outside the JAERI conducted its activities from July 2004 to August 2004. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Advisory Committee meeting which was held on August 10, 2004, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Advisory Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on December 1, 2004. This report describes the result of the evaluation by the Advisory Committee on Research and Development on Nuclear Energy Technology. (author)

Evaluating radiographers' diagnostic accuracy in screen-reading mammograms: what constitutes a quality study?

International Nuclear Information System (INIS)

Debono, Josephine C; Poulos, Ann E

2015-01-01

The aim of this study was to first evaluate the quality of studies investigating the diagnostic accuracy of radiographers as mammogram screen-readers and then to develop an adapted tool for determining the quality of screen-reading studies. A literature search was used to identify relevant studies and a quality evaluation tool constructed by combining the criteria for quality of Whiting, Rutjes, Dinnes et al. and Brealey and Westwood. This constructed tool was then applied to the studies and subsequently adapted specifically for use in evaluating quality in studies investigating diagnostic accuracy of screen-readers. Eleven studies were identified and the constructed tool applied to evaluate quality. This evaluation resulted in the identification of quality issues with the studies such as potential for bias, applicability of results, study conduct, reporting of the study and observer characteristics. An assessment of the applicability and relevance of the tool for this area of research resulted in adaptations to the criteria and the development of a tool specifically for evaluating diagnostic accuracy in screen-reading. This tool, with further refinement and rigorous validation can make a significant contribution to promoting well-designed studies in this important area of research and practice

[Taking evaluation of post-marketing as point of cut-in to promote systematic research of traditional Chinese medicine].

Science.gov (United States)

Wang, Yong-yan; Wang, Zhi-fei; Xie, Yan-ming

2014-09-01

Research on post-marketing Chinese medicine should be the systematic study from application to mechanism. Clinical evaluation is the basis of mechanism study, we can find the clue from clinical evaluation, then make a mechanism study to find the reason, then apply the results to clinic. So it is a virtuous circle. In order to achieve it, we cannot be limited to traditional Chinese medicine, we should form multi-disciplinary team under the direction of grand science thinking, try hard to put industry-university-research institute collaboration association to use, and if necessary, explore the new model of the whole nation system. An appropriate operation mechanism is very important.

Childhood Obesity Research Demonstration project: Cross-site evaluation method

Science.gov (United States)

The Childhood Obesity Research Demonstration (CORD) project links public health and primary care interventions in three projects described in detail in accompanying articles in this issue of Childhood Obesity. This article describes a comprehensive evaluation plan to determine the extent to which th...

The International Endometriosis Evaluation Program (IEEP Study) – A Systematic Study for Physicians, Researchers and Patients

Science.gov (United States)

Burghaus, S.; Fehm, T.; Fasching, P. A.; Blum, S.; Renner, S. K.; Baier, F.; Brodkorb, T.; Fahlbusch, C.; Findeklee, S.; Häberle, L.; Heusinger, K.; Hildebrandt, T.; Lermann, J.; Strahl, O.; Tchartchian, G.; Bojahr, B.; Porn, A.; Fleisch, M.; Reicke, S.; Füger, T.; Hartung, C.-P.; Hackl, J.; Beckmann, M. W.; Renner, S. P.

2016-01-01

Introduction: Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. Material and Methods: To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. Results: A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. Conclusion: The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers. PMID:27582581

The assessment of scientific research: a case-study of CERN

International Nuclear Information System (INIS)

Martin, B.R.; Minchin, Nigel; Skea, Jim; Peacock, Tim; Crouch, David

1987-01-01

The review aims to demonstrate that formal methods of evaluating research performance can play a valuable role in overcoming some of the problems with decision-making in basic science based on peer review. An approach which combines a number of research output indicators, including bibliometric measures derived from publication and citation analysis, is first outlined and then applied in a case study of the European Laboratory for Particle Physics, CERN, over the period 1961-1984. (author)

Visual soil evaluation and soil compaction research

DEFF Research Database (Denmark)

M.L. Guimarães, Rachel; Keller, Thomas; Munkholm, Lars Juhl

2017-01-01

Following on from discussions that took place during the 19th International Conference of the International Soil Tillage Research Organization (ISTRO) in Montevideo, Uruguay, in 2012, the ISTRO working groups “Visual Soil Examination and Evaluation” (VSEE) and “Subsoil Compaction” decided...... to organize a joint workshop. The present special issue is an outcome from the workshop on “Soil structural quality of tropical soils: Visual evaluation methods and soil compaction prevention strategies” that was held 26–29 May 2014 in Maringá, Paraná, Brazil. There has been a long-lasting interest in Visual...... Soil Evaluation (VSE). An ISTRO working group was established more than 30 years ago with the objectives to exchange knowledge and experiences on field methods of visual-tactile soil assessment and to foster international cooperation on new or refined methods. The three previous meeting of the group...

The critical assessment of research traditional and new methods of evaluation

CERN Document Server

Bailin, Alan

2010-01-01

This book examines the following factors: sponsorship of research, control of the dissemination of research, effects of dominant research paradigms, financial interests of authors, publishers, and editors, role of new technologies (for example, Web 2.0).It is widely accepted among researchers and educators that the peer review process, the reputation of the publisher and examination of the author's credentials are the gold standards for assessing the quality of research and information. However, the traditional gold standards are not sufficient, and the effective evaluation of information req

Methodological Reflections on the Contribution of Qualitative Research to the Evaluation of Clinical Ethics Support Services.

Science.gov (United States)

Wäscher, Sebastian; Salloch, Sabine; Ritter, Peter; Vollmann, Jochen; Schildmann, Jan

2017-05-01

This article describes a process of developing, implementing and evaluating a clinical ethics support service intervention with the goal of building up a context-sensitive structure of minimal clinical-ethics in an oncology department without prior clinical ethics structure. Scholars from different disciplines have called for an improvement in the evaluation of clinical ethics support services (CESS) for different reasons over several decades. However, while a lot has been said about the concepts and methodological challenges of evaluating CESS up to the present time, relatively few empirical studies have been carried out. The aim of this article is twofold. On the one hand, it describes a process of development, modifying and evaluating a CESS intervention as part of the ETHICO research project, using the approach of qualitative-formative evaluation. On the other hand, it provides a methodological analysis which specifies the contribution of qualitative empirical methods to the (formative) evaluation of CESS. We conclude with a consideration of the strengths and limitations of qualitative evaluation research with regards to the evaluation and development of context sensitive CESS. We further discuss our own approach in contrast to rather traditional consult or committee models. © 2017 John Wiley & Sons Ltd.

Scientific and Ethical Reflections on Academic Corruption in Universities: On the Science Research Evaluation System in China's Universities

Science.gov (United States)

Xiaochun, Wu; Dan, Jia

2007-01-01

A study of the science research activities in China's institutions of higher learning in recent years indicates that there is a major connection between the current instances of corruption in scientific research at colleges and universities and the evaluations system for scientific research implemented at many of the colleges and universities.…

Heterogeneity of Human Research Ethics Committees and Research Governance Offices across Australia: An observational study.

Science.gov (United States)

De Smit, Elisabeth; Kearns, Lisa S; Clarke, Linda; Dick, Jonathan; Hill, Catherine L; Hewitt, Alex W

2016-01-01

Conducting ethically grounded research is a fundamental facet of all investigations. Nevertheless, the administrative burdens of current ethics review are substantial, and calls have been made for a reduction in research waste. To describe the heterogeneity in administration and documentation required by Human Research Ethics Committees (HRECs) and Research Governance Offices (RGOs) across Australia. In establishing a nationwide study to investigate the molecular aetiology of Giant Cell Arteritis (GCA), for which archived pathological specimens from around Australia are being recruited, we identified variation across separate HREC and RGO requirements. Submission paperwork and correspondence from each collaborating site and its representative office for research were reviewed. This data was interrogated to evaluate differences in current guidelines. Twenty-five pathology departments across seven Australian States collaborated in this study. All states, except Victoria, employed a single ethics review model. There was discrepancy amongst HRECs as to which application process applied to our study: seven requested completion of a "National Ethics Application Form" and three a "Low Negligible Risk" form. Noticeable differences in guidelines included whether electronic submission was sufficient. There was variability in the total number of documents submitted (range five to 22) and panel review turnaround time (range nine to 136 days). We demonstrate the challenges and illustrate the heavy workload involved in receiving widespread ethics and governance approval across Australia. We highlight the need to simplify, homogenise, and nationalise human ethics for non-clinical trial studies. Reducing unnecessary administration will enable investigators to achieve research aims more efficiently.

Heterogeneity of Human Research Ethics Committees and Research Governance Offices across Australia: An observational study

Directory of Open Access Journals (Sweden)

Elisabeth De Smit

2016-02-01

Full Text Available Background Conducting ethically grounded research is a fundamental facet of all investigations. Nevertheless, the administrative burdens of current ethics review are substantial, and calls have been made for a reduction in research waste. Aims To describe the heterogeneity in administration and documentation required by Human Research Ethics Committees (HRECs and Research Governance Offices (RGOs across Australia. Methods In establishing a nationwide study to investigate the molecular aetiology of Giant Cell Arteritis (GCA, for which archived pathological specimens from around Australia are being recruited, we identified variation across separate HREC and RGO requirements. Submission paperwork and correspondence from each collaborating site and its representative office for research were reviewed. This data was interrogated to evaluate differences in current guidelines. Results Twenty-five pathology departments across seven Australian States collaborated in this study. All states, except Victoria, employed a single ethics review model. There was discrepancy amongst HRECs as to which application process applied to our study: seven requested completion of a “National Ethics Application Form” and three a “Low Negligible Risk” form. Noticeable differences in guidelines included whether electronic submission was sufficient. There was variability in the total number of documents submitted (range five to 22 and panel review turnaround time (range nine to 136 days. Conclusion We demonstrate the challenges and illustrate the heavy workload involved in receiving widespread ethics and governance approval across Australia. We highlight the need to simplify, homogenise, and nationalise human ethics for non-clinical trial studies. Reducing unnecessary administration will enable investigators to achieve research aims more efficiently

Published research studies conducted amongst Indian medical undergraduate students: Bibliometric Analysis

Directory of Open Access Journals (Sweden)

Sandeep Sachdeva

2017-09-01

Full Text Available Objective: Evaluation of published original research conducted amongst Indian medical undergraduate students. Methodology: A systematic review was undertaken using keywords “MBBS students” or “medical students” or “health students” or “university students” and “India” through search engines, PUBMED and Google scholar. Considering feasibility, time frame of published original research article was restricted to one-year only i.e. 2016. Research domain, research design, author and other bibliometric details of research manuscript were captured using check-list and analysis carried out using descriptive statistics. Results: A total of 99 suitable original research articles were identified under certain criteria and considered in present analysis. With regard to thematic research domain, highest, 29 (29.2% articles were related to teaching and learning process followed by 13 (13.1% to mental health (depression, anxiety, sleep, spirituality of students; 07 (7.0% were based on physical fitness/ exercise/yoga; and substance abuse (6.0% amongst medical students etc. Nearly, 86 (86.8% of articles were cross-sectional descriptive based studies while 13 (13.1% had intervention based research design. A total of 34 (34.3% research articles could be labeled as “KAP” (knowledge, attitude and practice survey. Department wise detail of corresponding author was largely dominated by faculty from pre and para-clinical departments. Highest was community medicine in (35.3% articles, pharmacology (23.2%, physiology (17.1%, microbiology (6.0%, and biochemistry (4.0% etc. The studies covered an average sample size of 188.8 MBBS students (20-360, range; 57.5% of research article covered students from only one professional year. However, in 42 (42.4% articles there was no further mention of gender based sample information. Out of all the references used in research articles, only 57.3% were of recent (2005-2015 origin while the rest were from older

Evaluation system of Research and Development projects and services from ININ

International Nuclear Information System (INIS)

Reglero, R.

1994-01-01

To make a plan for a project is one thing; to control it are a hundred things at the same time. Because of this fact, the enterprises and Research and Development Institutions have searched better ways to manage this activities. The management system of Research and Development projects and services from ININ, is used as a recording, evaluation tracking, information and control of result instrument for these activities. The need to have update information of different activities in the working areas of ININ, such as: Projects, technical or technological services either internal or external; diffusion programs and human resources training programs; and departmental activities, has taken to the development of uniform methods of recording, evaluation tracking and control of events, which allow the standardization, compilation, analysis and reporting of the results in an easy and quick way. The elaboration of an original scheme for the evaluation system of assessment for Research and Development projects and services was started in July 1988, and the data acquisition was manual. The use of Personal Computers began at 1992. (Author)

A Conceptual Framework for Graduate Teaching Assistant Professional Development Evaluation and Research.

Science.gov (United States)

Reeves, Todd D; Marbach-Ad, Gili; Miller, Kristen R; Ridgway, Judith; Gardner, Grant E; Schussler, Elisabeth E; Wischusen, E William

2016-01-01

Biology graduate teaching assistants (GTAs) are significant contributors to the educational mission of universities, particularly in introductory courses, yet there is a lack of empirical data on how to best prepare them for their teaching roles. This essay proposes a conceptual framework for biology GTA teaching professional development (TPD) program evaluation and research with three overarching variable categories for consideration: outcome variables, contextual variables, and moderating variables. The framework's outcome variables go beyond GTA satisfaction and instead position GTA cognition, GTA teaching practice, and undergraduate learning outcomes as the foci of GTA TPD evaluation and research. For each GTA TPD outcome variable, key evaluation questions and example assessment instruments are introduced to demonstrate how the framework can be used to guide GTA TPD evaluation and research plans. A common conceptual framework is also essential to coordinating the collection and synthesis of empirical data on GTA TPD nationally. Thus, the proposed conceptual framework serves as both a guide for conducting GTA TPD evaluation at single institutions and as a means to coordinate research across institutions at a national level. © 2016 T. D. Reeves et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Evaluating Community College Personnel: A Research Report.

Science.gov (United States)

Deegan, William L.; And Others

A statewide survey was conducted of local evaluation policies, procedures, and problems of implementing evaluation programs on the campuses of California community colleges. The following areas were studied: (1) the process of development of the evaluation program; (2) procedures utilized in the first year of implementing Senate Bill 696…

Project monitoring and evaluation: an enhancing method for health research system management.

Science.gov (United States)

Djalalinia, Shirin; Owlia, Parviz; Malekafzali, Hossein; Ghanei, Mostafa; Babamahmoodi, Abdolreza; Peykari, Niloofar

2014-04-01

Planning, organizing, staffing, leading and monitoring are the basic functional component of management. In present article, we aim to define the project monitoring and evaluation in health research system (HRS) considering its success and challenges based on our national experience. IN THIS STUDY BASED ON THE INFORMATION OF ANNUAL MEDICAL SCIENCE UNIVERSITIES EVALUATION DURING THE LAST DECADE THE HRS INDICATORS HAVE BEEN SCORED IN THREE AXES BASED ON HRS FUNCTIONS: Stewardship, capacity building and knowledge production. In this article, we will focus on the results of HRS evaluation from 2002 to 2010, also on its success and challenges. In an overall view, the main results are the experiences of the designing and implantation of such process after pre-project preparation, all parts followed under the whole supervision of the aims of the HRS evaluation. Project management light the way of practical application of knowledge, skills, tools and techniques for better HRS evaluation and management. We concluded that; although monitoring and evaluation as an essential part of HRS Management light the improvement ahead way but we still need to advantage of the new project management advances.

Women's erotic rape fantasies: an evaluation of theory and research.

Science.gov (United States)

Critelli, Joseph W; Bivona, Jenny M

2008-01-01

This article is the first systematic review of the research literature on women's rape fantasies. Current research indicates that between 31% and 57% of women have fantasies in which they are forced into sex against their will, and for 9% to 17% of women these are a frequent or favorite fantasy experience. Erotic rape fantasies are paradoxical: they do not appear to make sense. Why would a person have an erotic and pleasurable fantasy about an event that, in real life, would be abhorrent and traumatic? In this article, the major theories of women's rape fantasies are evaluated both rationally and empirically. These theories explain rape fantasies in terms of masochism, sexual blame avoidance, openness to sexuality, sexual desirability, male rape culture, biological predisposition to surrender, sympathetic physiological activation, and adversary transformation. This article evaluates theory and research, makes provisional judgments as to which theories appear to be most viable, and begins the task of theoretical integration to arrive at a more complete and internally consistent explanation for why many women engage in erotic rape fantasies. Methodological critiques and programs for future research are presented throughout.

An Evaluation View of an Ensemble Artefact for Decision Support using Action Design Research

Directory of Open Access Journals (Sweden)

Dale MacKrell

2016-11-01

Full Text Available This paper investigates the integration of content, context and process (CCP into the Action Design Research (ADR framework to account for the interplay of organisational issues in artefact design and development. The investigation is conducted through a case study in which successive ICT student teams incrementally build, over several semesters, a tailored, low cost business intelligence (BI system as an ensemble artefact for an organisation in the not-for-profit (NFP sector. During project development, CCP’s human-centred approach to evaluation complements ADR’s more prescribed technology-driven software testing. The integration of CCP into ADR as an evaluation view offers an holistic approach to assessing an ensemble artefact. The resultant conceptual framework is presented as a model with an explication of unexpected design and research outcomes.

Incidental Findings in Imaging Research: Evaluating Incidence, Benefit and Burden

Science.gov (United States)

Orme, Nicholas M.; Fletcher, Joel G.; Siddiki, Hassan A.; Harmsen, W. Scott; O’Byrne, Megan M.; Port, John D.; Tremaine, William J.; Pitot, Henry C.; McFarland, Beth; Robinson, Marguerite E.; Koenig, Barabara A.; King, Bernard F.; Wolf, Susan M.

2013-01-01

Context Little information exists concerning the frequency of clinically significant incidental findings (IFs) identified in the course of imaging research across a broad spectrum of imaging modalities and body regions. Objective To estimate the frequency with which research imaging IFs generate further clinical action, and the medical benefit/burden of identifying these IFs. Design, Setting, and Participants Retrospective review of subjects undergoing a research imaging exam that was interpreted by a radiologist for IFs in the first quarter of 2004, with 3-year clinical follow-up. An expert panel reviewed IFs generating clinical action to determine medical benefit/burden based on predefined criteria. Main Outcome Measures Frequency of (1) IFs that generated further clinical action by modality, body part, age, gender, and (2) IFs resulting in clear medical benefit or burden. Results 1376 patients underwent 1426 research imaging studies. 40% (567/1426) of exams had at least one IF (1055 total). Risk of an IF increased significantly by age (OR=1.5; [1.4–1.7=95% C.I.] per decade increase). Abdominopelvic CT generated more IFs than other exams (OR=18.9 compared with ultrasound; 9.2% with subsequent clinical action), with CT Thorax and MR brain next (OR=11.9 and 5.9; 2.8% and 2.2% with action, respectively). Overall 6.2% of exams (35/567) with an IF generated clinical action, resulting in clear medical benefit in 1.1% (6/567) and clear medical burden in 0.5% (3/567). In most instances, medical benefit/burden was unclear (4.6%; 26/567). Conclusions The frequency of IFs in imaging research exams varies significantly by imaging modality, body region and age. Research imaging studies at high risk for generating IFs can be identified. Routine evaluation of research images by radiologists may result in identification of IFs in a substantial number of cases and subsequent clinical action to address them in much smaller number. Such clinical action can result in medical

A Study on the Role of Web Technology in Enhancing Research Pursuance among University Academia

Science.gov (United States)

Hussain, Irshad; Durrani, Muhammad Ismail

2012-01-01

The purpose of this study was to evaluate the role of web technologies in promoting research pursuance among university teachers, examine the use of web technologies by university teachers in conducting research and identify the problems of university academia in using web technologies for research. The study was delimited to academia of social…

Evaluation and Comparison Research on the Support of Websites to Enterprise's E-Commerce

Institute of Scientific and Technical Information of China (English)

SHAO Peiji; HUANG Yixiao; WAN Jie; YANG Jing

2004-01-01

This paper comparatively analyzes the existing evaluation index of websites, and puts forward the evaluation index and method about the support of a website to enterprise's e-commerce.Through researching on 56 super enterprises of information industry in Sichuan province, throughout China and the world, analyzing and comparatively studying the support ability of a website to an enterprise's e-commerce, this paper brings forward using five levels to categorize the support ability of a website to enterprise's e-commerce. In the end, the flaw of enterprise's e-commerce practice in Sichuan province and corresponding countermeasure will be illustrated.

Facilitating comparative effectiveness research in cancer genomics: evaluating stakeholder perceptions of the engagement process.

Science.gov (United States)

Deverka, Patricia A; Lavallee, Danielle C; Desai, Priyanka J; Armstrong, Joanne; Gorman, Mark; Hole-Curry, Leah; O'Leary, James; Ruffner, B W; Watkins, John; Veenstra, David L; Baker, Laurence H; Unger, Joseph M; Ramsey, Scott D

2012-07-01

The Center for Comparative Effectiveness Research in Cancer Genomics completed a 2-year stakeholder-guided process for the prioritization of genomic tests for comparative effectiveness research studies. We sought to evaluate the effectiveness of engagement procedures in achieving project goals and to identify opportunities for future improvements. The evaluation included an online questionnaire, one-on-one telephone interviews and facilitated discussion. Responses to the online questionnaire were tabulated for descriptive purposes, while transcripts from key informant interviews were analyzed using a directed content analysis approach. A total of 11 out of 13 stakeholders completed both the online questionnaire and interview process, while nine participated in the facilitated discussion. Eighty-nine percent of questionnaire items received overall ratings of agree or strongly agree; 11% of responses were rated as neutral with the exception of a single rating of disagreement with an item regarding the clarity of how stakeholder input was incorporated into project decisions. Recommendations for future improvement included developing standard recruitment practices, role descriptions and processes for improved communication with clinical and comparative effectiveness research investigators. Evaluation of the stakeholder engagement process provided constructive feedback for future improvements and should be routinely conducted to ensure maximal effectiveness of stakeholder involvement.

48 CFR 225.7016 - Restriction on Ballistic Missile Defense research, development, test, and evaluation.

Science.gov (United States)

2010-10-01

... Missile Defense research, development, test, and evaluation. 225.7016 Section 225.7016 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SOCIOECONOMIC PROGRAMS... Acquisition 225.7016 Restriction on Ballistic Missile Defense research, development, test, and evaluation. [68...

Making Explicit the Formalism Underlying Evaluation in Music Information Retrieval Research

DEFF Research Database (Denmark)

Sturm, Bob L.

2014-01-01

We make explicit the formalism underlying evaluation in music information retrieval research. We define a ``system,'' what it means to ``analyze'' one, and make clear the aims, parts, design, execution, interpretation, assumptions and limitations of its ``evaluation.'' We apply this formalism...... to discuss the MIREX automatic mood classification task....

Task-Based Language Learning and Teaching: An Action-Research Study

Science.gov (United States)

Calvert, Megan; Sheen, Younghee

2015-01-01

The creation, implementation, and evaluation of language learning tasks remain a challenge for many teachers, especially those with limited experience with using tasks in their teaching. This action-research study reports on one teacher's experience of developing, implementing, critically reflecting on, and modifying a language learning task…

The Implementation and Evaluation of Teacher Training in Gaming Instruction for Secondary Science: An Action Research Project

Science.gov (United States)

Sanders, Veronica

2016-01-01

This study implemented and evaluated gaming instruction as a professional development for science teachers at a Georgia high school. It was guided by four research questions that (a) assessed the impact of training in gaming instruction and evaluation of that training on science teachers' ability to use games; (b) examined evidence showing that…

Evaluation and perceived results of moral case deliberation: A mixed methods study

NARCIS (Netherlands)

Janssens, R.; van Zadelhoff, E.; van Loo, G.; Widdershoven, G.A.; Molewijk, A.C.

2015-01-01

Background: Moral case deliberation is increasingly becoming part of various Dutch healthcare organizations. Although some evaluation studies of moral case deliberation have been carried out, research into the results of moral case deliberation within aged care is scarce. Research questions: How did

How journal rankings can suppress interdisciplinary research. A comparison between Innovation Studies and Business & Management

OpenAIRE

Rafols, Ismael; Leydesdorff, Loet; O'Hare, Alice; Nightingale, Paul; Stirling, Andy

2011-01-01

This study provides quantitative evidence on how the use of journal rankings can disadvantage interdisciplinary research in research evaluations. Using publication and citation data, it compares the degree of interdisciplinarity and the research performance of a number of Innovation Studies units with that of leading Business & Management schools in the UK. On the basis of various mappings and metrics, this study shows that: (i) Innovation Studies units are consistently more interdisciplinary...

SKB's program for societal research 2004-2011. An evaluation

International Nuclear Information System (INIS)

Soederberg, Olof

2012-04-01

This evaluation of the program of societal research that SKB conducted the years 2004-2011 has been performed on behalf of Swedish Nuclear Fuel and Waste Management Company (SKB). The review has focused on answers to a series of questions as follows: General questions - Why was a program started? - What was SKB's purpose with the program? - Does the result mean that the objective has been achieved? - Has the program had effects (positive or negative) that were not anticipated when the purpose was formulated? - Strengths and weaknesses of the program? Questions about the implementation - How did announcement and selection procedures work? - Which forms were used for reporting results from the research projects? Questions about the continued investment in societal research - Are there such needs? - In that case, is it in SKB's interest to contribute financially to such research? - What forms might be appropriate if SKB sees interest to contribute financially to such research?

Aspects of the Iea-R1 research reactor seismic evaluation

International Nuclear Information System (INIS)

Mattar Neto, Miguel

1996-01-01

Codes and standards for the seismic evaluation of the research reactor IEA-R1 are presented. An approach to define the design basis earthquake based on the local seismic map and on simplified analysis methods is proposed. The site seismic evaluation indicates that the design earthquake intensity is IV MM. Therefore, according to the used codes and standards, no buildings, systems, and components seismic analysis are required. (author)

Education research: evaluating the use of podcasting for residents during EEG instruction: a pilot study.

Science.gov (United States)

Bensalem-Owen, Meriem; Chau, Destiny F; Sardam, Sean C; Fahy, Brenda G

2011-08-23

Educational methods for residents are shifting toward greater learner independence aided by technological advances. A Web-based program using a podcast was created for resident EEG instruction, replacing conventional didactics. The EEG curriculum also consisted of EEG interpretations under the tutelage of a neurophysiologist. This pilot study aimed to objectively evaluate the effectiveness of the podcast as a new teaching tool. A podcast for resident EEG instruction was implemented on the Web, replacing the traditional lecture. After Institutional Review Board approval, consent was obtained from the participating residents. Using 25-question evaluation tools, participants were assessed at baseline before any EEG instruction, and reassessed after podcasting and after 10 clinical EEG exposures. Each 25-item evaluation tool contained tracings used for clinical EEG interpretations. Scores after podcast training were also compared to scores after traditional didactic training from a previous study among anesthesiology trainees. Ten anesthesiology residents completed the study. The mean scores with standard deviations are 9.50 ± 2.92 at baseline, 13.40 ± 3.31 (p = 0.034) after the podcast, and 16.20 ± 1.87 (p = 0.019) after interpreting 10 EEGs. No differences were noted between the mean educational tool scores for those who underwent podcasting training compared to those who had undergone traditional didactic training. In this pilot study, podcast training was as effective as the prior conventional lecture in meeting the curricular goals of increasing EEG knowledge after 10 EEG interpretations as measured by assessment tools.

Reported credibility techniques in higher education evaluation studies that use qualitative methods: A research synthesis.

Science.gov (United States)

Liao, Hongjing; Hitchcock, John

2018-06-01

This synthesis study examined the reported use of credibility techniques in higher education evaluation articles that use qualitative methods. The sample included 118 articles published in six leading higher education evaluation journals from 2003 to 2012. Mixed methods approaches were used to identify key credibility techniques reported across the articles, document the frequency of these techniques, and describe their use and properties. Two broad sets of techniques were of interest: primary design techniques (i.e., basic), such as sampling/participant recruitment strategies, data collection methods, analytic details, and additional qualitative credibility techniques (e.g., member checking, negative case analyses, peer debriefing). The majority of evaluation articles reported use of primary techniques although there was wide variation in the amount of supporting detail; most of the articles did not describe the use of additional credibility techniques. This suggests that editors of evaluation journals should encourage the reporting of qualitative design details and authors should develop strategies yielding fuller methodological description. Copyright © 2018 Elsevier Ltd. All rights reserved.

FIRE (facilitating implementation of research evidence: a study protocol

Directory of Open Access Journals (Sweden)

Seers Kate

2012-03-01

Full Text Available Abstract Background Research evidence underpins best practice, but is not always used in healthcare. The Promoting Action on Research Implementation in Health Services (PARIHS framework suggests that the nature of evidence, the context in which it is used, and whether those trying to use evidence are helped (or facilitated affect the use of evidence. Urinary incontinence has a major effect on quality of life of older people, has a high prevalence, and is a key priority within European health and social care policy. Improving continence care has the potential to improve the quality of life for older people and reduce the costs associated with providing incontinence aids. Objectives This study aims to advance understanding about the contribution facilitation can make to implementing research findings into practice via: extending current knowledge of facilitation as a process for translating research evidence into practice; evaluating the feasibility, effectiveness, and cost-effectiveness of two different models of facilitation in promoting the uptake of research evidence on continence management; assessing the impact of contextual factors on the processes and outcomes of implementation; and implementing a pro-active knowledge transfer and dissemination strategy to diffuse study findings to a wide policy and practice community. Setting and sample Four European countries, each with six long-term nursing care sites (total 24 sites for people aged 60 years and over with documented urinary incontinence Methods and design Pragmatic randomised controlled trial with three arms (standard dissemination and two different programmes of facilitation, with embedded process and economic evaluation. The primary outcome is compliance with the continence recommendations. Secondary outcomes include proportion of residents with incontinence, incidence of incontinence-related dermatitis, urinary tract infections, and quality of life. Outcomes are assessed at baseline

Trends in contemporary orthodontic research publications: Evaluation of three major orthodontic journals

Directory of Open Access Journals (Sweden)

M P Kumar Prasanna

2017-01-01

Full Text Available Background: In this study, we aimed to evaluate the inclination of orthodontic research published in original articles in three of the most popular and recognized orthodontic journals with high impact factor; American Journal of Orthodontics and Dentofacial Orthopedics (AJODO, the Angle Orthodontist (AO, and European Journal of Orthodontics (EJO published in a 5-year duration time frame (2010–2014. Materials and Methods: Online search with supplementary hand searching was undertaken for original research articles in these three orthodontic journals from 2010 to 2014. Classification of data was completed autonomously by manual and direct appraisal of the manuscript of each journal. Results and Conclusion: Three thousand one hundred and forty articles published in AJODO, AO, and EJO in the particular time period were selected, out of which 1783 original research study articles (56.78% were appraised for classification in their various respective knowledge domains. AO (82.73% and EJO (76.99% were relatively more committed toward publication of research work in comparison to AJODO (34.55%. Research articles based on perception and questionnaires (12%, temporary anchorage devices (11%, cone-beam computed tomography (8%, invisible orthodontics (lingual orthodontics, clear aligners, esthetic brackets, and wires (5%, and airway examination (5% were the five most recurrently selected subjects of interest (41% in these three journals during the observation period. The total number of research articles published in the three journals reduced statistically significantly in 2014 when compared to 2010.

Evaluating the High School Lunar Research Projects Program

Science.gov (United States)

Shaner, A. J.; Shipp, S. S.; Allen, J.; Kring, D. A.

2012-12-01

The Center for Lunar Science and Exploration (CLSE), a collaboration between the Lunar and Planetary Institute and NASA's Johnson Space Center, is one of seven member teams of the NASA Lunar Science Institute (NLSI). In addition to research and exploration activities, the CLSE team is deeply invested in education and outreach. In support of NASA's and NLSI's objective to train the next generation of scientists, CLSE's High School Lunar Research Projects program is a conduit through which high school students can actively participate in lunar science and learn about pathways into scientific careers. The objectives of the program are to enhance 1) student views of the nature of science; 2) student attitudes toward science and science careers; and 3) student knowledge of lunar science. In its first three years, approximately 140 students and 28 teachers from across the United States have participated in the program. Before beginning their research, students undertake Moon 101, a guided-inquiry activity designed to familiarize them with lunar science and exploration. Following Moon 101, and guided by a lunar scientist mentor, teams choose a research topic, ask their own research question, and design their own research approach to direct their investigation. At the conclusion of their research, teams present their results to a panel of lunar scientists. This panel selects four posters to be presented at the annual Lunar Science Forum held at NASA Ames. The top scoring team travels to the forum to present their research. Three instruments have been developed or modified to evaluate the extent to which the High School Lunar Research Projects meets its objectives. These three instruments measure changes in student views of the nature of science, attitudes towards science and science careers, and knowledge of lunar science. Exit surveys for teachers, students, and mentors were also developed to elicit general feedback about the program and its impact. The nature of science

Linking Teacher Evaluation to Professional Development: Focusing on Improving Teaching and Learning. Research & Policy Brief

Science.gov (United States)

Goe, Laura; Biggers, Kietha; Croft, Andrew

2012-01-01

Recently, teacher evaluation has become a major focus in educational policy debates and research efforts. This increased attention to teacher evaluation has raised questions about the relationship between evaluation and student outcomes. Rivkin, Hanushek, and Kain (2005) and others have demonstrated with value-added research that there are…

Evaluating Community-Academic Partnerships of the South Carolina Healthy Brain Research Network.

Science.gov (United States)

Soltani, Suzan Neda; Kannaley, Kristie; Tang, Weizhou; Gibson, Andrea; Olscamp, Kate; Friedman, Daniela B; Khan, Samira; Houston, Julie; Wilcox, Sara; Levkoff, Sue E; Hunter, Rebecca H

2017-07-01

Community-academic partnerships have a long history of support from public health researchers and practitioners as an effective way to advance research and solutions to issues that are of concern to communities and their citizens. Data on the development and evaluation of partnerships focused on healthy aging and cognitive health were limited. The purpose of this article is to examine how community partners view the benefits and barriers of a community-academic partner group established to support activities of the South Carolina Healthy Brain Research Network (SC-HBRN). The SC-HBRN is part of the national Healthy Brain Research Network, a thematic research network funded by the Centers for Disease Control and Prevention (CDC). It is focused on improving the scientific and research translation agenda on cognitive health and healthy aging. Semistructured interviews, conducted at end of Year 2 of the 5-year partnership, were used to collect data from partners of the SC-HBRN. Reported benefits of the partnership were information sharing and networking, reaching a broader audience, and humanizing research. When asked to describe what they perceived as barriers to the collaborative, partners described some lack of clarity regarding goals of the network and opportunities to contribute to the partnership. Study results can guide and strengthen other public health-focused partnerships.

Evaluation of the Treatment of Diabetic Retinopathy A Research Project

Science.gov (United States)

Kupfer, Carl

1973-01-01

Evaluated is the treatment of diabetic retinopathy (blindness due to ruptured vessels of the retina as a side effect of diabetes), and described is a research project comparing two types of photocoagulation treatment. (DB)

Involving students in real-world research: a pilot study for teaching public health and research skills

Directory of Open Access Journals (Sweden)

Wilson Nick

2009-07-01

Full Text Available Abstract Background There is some evidence that medical students consider population health issues less important than other domains in the health sciences and attitudes to this field may become more negative as training progresses. A need to improve research skills among medical students has also been suggested. Therefore we piloted an integrative teaching exercise that combined teaching of research skills and public health, with real-world research. Methods Third year medical students at the University of Otago (Dunedin, New Zealand filled in a questionnaire on their housing conditions and health. The students were given the results of the survey to discuss in a subsequent class. Student response to this teaching exercise was assessed using a Course Evaluation Questionnaire. Results Of the 210 students in the class, 136 completed the Course Evaluation Questionnaire (65%. A majority of those who responded (77% greatly supported or supported the use of the survey and seminar discussion for future third year classes. Most (70% thought that the session had made them more aware and concerned about societal problems, and 72% felt that they now had an improved understanding of the environmental determinants of health. Students liked the relevance and interaction of the session, but thought it could be improved by the inclusion of small group discussion. The findings of the students' housing and health were considered by the tutors to be of sufficient value to submit to a scientific journal and are now contributing to community action to improve student housing in the city. Conclusion In this pilot study it was feasible to integrate medical student teaching with real-world research. A large majority of the students responded favourably to the teaching exercise and this was generally successful in raising the profile of public health and research. This approach to integrated teaching/research should be considered further in health sciences training and

Introducing problem-based learning into research methods teaching: student and facilitator evaluation.

Science.gov (United States)

Carlisle, Caroline; Ibbotson, Tracy

2005-10-01

The evidence base for the effectiveness of problem-based learning (PBL) has never been substantively established, although PBL is a generally accepted approach to learning in health care curricula. PBL is believed to encourage transferable skills, including problem-solving and team-working. PBL was used to deliver a postgraduate research methods module and a small evaluation study to explore its efficacy was conducted amongst the students (n = 51) and facilitators (n = 6). The study comprised of an evaluation questionnaire, distributed after each themed group of PBL sessions, and a group discussion conducted 4 weeks after the conclusion of the module, which was attended by student representatives and the facilitators. Questionnaire data was analysed using SPSS, and a transcript of the interview was subjected to content analysis. The results indicated that students felt that a PBL approach helped to make the subject matter more interesting to them and they believed that they would retain knowledge for a longer period than if their learning had used a more traditional lecture format. Students also perceived that PBL was effective in its ability to enhance students' understanding of the group process. All those involved in the PBL process reinforced the pivotal role of the facilitator. This study indicates that there is potential for PBL to be used beyond the more usual clinical scenarios constructed for health care professional education and further exploration of its use in areas such as building research capability should be undertaken.

Interdisciplinary research and education in the Vienna Doctoral Programme on Water Resource Systems: a framework for evaluation

Science.gov (United States)

Bloeschl, G.; Carr, G.; Loucks, D. P.

2017-12-01

Greater understanding of how interdisciplinary research and education evolves is critical for identifying and implementing appropriate programme management strategies. We propose a program evaluation framework that is based on social learning processes (individual learning, interdisciplinary research practices, and interaction between researchers with different backgrounds); social capital outcomes (ability to interact, interpersonal connectivity, and shared understanding); and knowledge and human capital outcomes (new knowledge that integrates multiple research fields). The framework is tested on established case study doctoral program: the Vienna Doctoral Program on Water Resource Systems. Data are collected via mixed qualitative/quantitative methods that include semi-structured interviews, publication co-author analysis, analysis of research proposals, categorisation of the interdisciplinarity of publications and graduate analysis. Through the evaluation and analysis, several interesting findings about how interdisciplinary research evolves and can be supported are identified. Firstly, different aspects of individual learning seem to contribute to a researcher's ability to interact with researchers from other research fields and work collaboratively. These include learning new material from different research fields, learning how to learn new material and learning how to integrate different material. Secondly, shared interdisciplinary research practices can be identified that may be common to other programs and support interaction and shared understanding between different researchers. They include clarification and questioning, harnessing differences and setting defensible research boundaries. Thirdly, intensive interaction between researchers from different backgrounds support connectivity between the researchers, further enabling cross-disciplinary collaborative work. The case study data suggest that social learning processes and social capital outcomes

The Evaluation of Relationship between Self-efficacy in Research and Research Performance of Dental Student, of Yazd Dental College in 2014

Directory of Open Access Journals (Sweden)

AR Davari

2015-09-01

Full Text Available Introduction: Achieve to maximum progress and improvement, just depends on addressing targeted research investment and investment of researchers and students. So, the present study was accomplished by the aim of evaluation of the relationship between self-efficacy in research and research performance of dental student of Yazd Dental College in 2014.   Methods: In this cross-sectional study, all interns and assistants in Yazd Dental School were participated. The required data were collected by using the Self-efficacy in Research and Research Performance questionnaire plus demographic variables (age, sex and duration of using denture. The data were analyzed by SPSS ver.16 using ANOVA, T-test and Pearson's correlation coefficient.   Results: In the present study, 80 students with the mean age 27.30±4.67 years were participated. Twenty-two students (27.5% were males and 58 (72.5% were females. The overall mean of self-efficacy in research was 159.79 ± 27.69. And the mean of research performance was 11.02 ± 16.37. The results showed that there was a significant and positive relationship between the overall scale of self-efficacy and research (p-value=0.004,r= .03. Based on the age, there was no significant difference in the mean score of self-efficacy in research in all aspects but in the areas of skills and expertise   (p>0.05. There was a significant difference in the mean score of research performance in terms of the age(p-value=0.023. There was no statistical significant between the overall mean score and the score of seven parts of self-efficacy in research and research performance in the terms of sex (P>0.05.   Conclusions: Regarding the association of self-efficacy in research with research performance of dental students, it can be stated that awareness of the level of self efficacy in research can lead to better planning for improving the research performance.

Describing the implementation of an innovative intervention and evaluating its effectiveness in increasing research capacity of advanced clinical nurses: using the consolidated framework for implementation research.

Science.gov (United States)

McKee, Gabrielle; Codd, Margaret; Dempsey, Orla; Gallagher, Paul; Comiskey, Catherine

2017-01-01

Despite advanced nursing roles having a research competency, participation in research is low. There are many barriers to participation in research and few interventions have been developed to address these. This paper aims to describe the implementation of an intervention to increase research participation in advanced clinical nursing roles and evaluate its effectiveness. The implementation of the intervention was carried out within one hospital site. The evaluation utilised a mixed methods design and a implementation science framework. All staff in advanced nursing roles were invited to take part, all those who were interested and had a project in mind could volunteer to participate in the intervention. The intervention consisted of the development of small research groups working on projects developed by the nurse participant/s and supported by an academic and a research fellow. The main evaluation was through focus groups. Output was analysed using thematic analysis. In addition, a survey questionnaire was circulated to all participants to ascertain their self-reported research skills before and after the intervention. The results of the survey were analysed using descriptive statistics. Finally an inventory of research outputs was collated. In the first year, twelve new clinical nurse-led research projects were conducted and reported in six peer reviewed papers, two non-peer reviewed papers and 20 conference presentations. The main strengths of the intervention were its promptness to complete research, to publish and to showcase clinical innovations. Main barriers identified were time, appropriate support from academics and from peers. The majority of participants had increased experience at scientific writing and data analysis. This study shows that an intervention, with minor financial resources; a top down approach; support of a hands on research fellow; peer collaboration with academics; strong clinical ownership by the clinical nurse researcher

[Establish research model of post-marketing clinical safety evaluation for Chinese patent medicine].

Science.gov (United States)

Zheng, Wen-ke; Liu, Zhi; Lei, Xiang; Tian, Ran; Zheng, Rui; Li, Nan; Ren, Jing-tian; Du, Xiao-xi; Shang, Hong-cai

2015-09-01

The safety of Chinese patent medicine has become a focus of social. It is necessary to carry out work on post-marketing clinical safety evaluation for Chinese patent medicine. However, there have no criterions to guide the related research, it is urgent to set up a model and method to guide the practice for related research. According to a series of clinical research, we put forward some views, which contained clear and definite the objective and content of clinical safety evaluation, the work flow should be determined, make a list of items for safety evaluation project, and put forward the three level classification of risk control. We set up a model of post-marketing clinical safety evaluation for Chinese patent medicine. Based this model, the list of items can be used for ranking medicine risks, and then take steps for different risks, aims to lower the app:ds:risksrisk level. At last, the medicine can be managed by five steps in sequence. The five steps are, collect risk signal, risk recognition, risk assessment, risk management, and aftereffect assessment. We hope to provide new ideas for the future research.

The Impact of Evaluation Use on Accounting Programs’ Performance: An Exploratory Study

Directory of Open Access Journals (Sweden)

Sheizi Calheira de Freitas

2016-11-01

Full Text Available The Brazilian program of higher education evaluation, broadly known as the National Exam of Students’ Performance (ENADE, represents a governmental effort to gather information on undergraduate educational quality. As a product of that evaluation, reports are made available to each program evaluated. Our present research addresses the impact of ENADE evaluation report utilization on multiple higher education accounting programs’ performance in their subsequent evaluation. Based upon theoretical support from literature about evaluation use, a web-based survey was developed and provided across the country to the coordinators of accounting programs. From a response rate of 62% of the study target population and using multiple regressions, we found that there was a positive correlation between usage of the ENADE evaluation report and the performance of undergraduate accounting programs in their subsequent evaluation. Based upon the reviewed literature and, in accordance with these research results, it is possible to infer that the use of evaluation reports derived from the higher education evaluation system promoted by the Brazilian government can influence the decisions of educational institutions and promote improvement.

Methods, measures and indicators for evaluating benefits of transportation research

CSIR Research Space (South Africa)

Du Plessis, Louw

2016-04-01

Full Text Available The purpose of this article is to provide updated information by identifying and discussing methods, measures and indicators for evaluating benefits appropriate for transportation-related research facilities/programmes. The information has been...

Evaluating the informatics for integrating biology and the bedside system for clinical research

Directory of Open Access Journals (Sweden)

Meystre Stéphane M

2009-10-01

Full Text Available Abstract Background Selecting patient cohorts is a critical, iterative, and often time-consuming aspect of studies involving human subjects; informatics tools for helping streamline the process have been identified as important infrastructure components for enabling clinical and translational research. We describe the evaluation of a free and open source cohort selection tool from the Informatics for Integrating Biology and the Bedside (i2b2 group: the i2b2 hive. Methods Our evaluation included the usability and functionality of the i2b2 hive using several real world examples of research data requests received electronically at the University of Utah Health Sciences Center between 2006 - 2008. The hive server component and the visual query tool application were evaluated for their suitability as a cohort selection tool on the basis of the types of data elements requested, as well as the effort required to fulfill each research data request using the i2b2 hive alone. Results We found the i2b2 hive to be suitable for obtaining estimates of cohort sizes and generating research cohorts based on simple inclusion/exclusion criteria, which consisted of about 44% of the clinical research data requests sampled at our institution. Data requests that relied on post-coordinated clinical concepts, aggregate values of clinical findings, or temporal conditions in their inclusion/exclusion criteria could not be fulfilled using the i2b2 hive alone, and required one or more intermediate data steps in the form of pre- or post-processing, modifications to the hive metadata, etc. Conclusion The i2b2 hive was found to be a useful cohort-selection tool for fulfilling common types of requests for research data, and especially in the estimation of initial cohort sizes. For another institution that might want to use the i2b2 hive for clinical research, we recommend that the institution would need to have structured, coded clinical data and metadata available that can be

From Action Research to Practice Research

Directory of Open Access Journals (Sweden)

Goran Goldkuhl

2012-04-01

Full Text Available Action research (AR has gained more acceptance as an approach to qualitative research in information systems (IS. The complexities of organisational and technical change makes this approach a suitable one in IS research. There are, however, still some controversies and confusions about the relation between “action” and “research”. The many types of AR and similar approaches (not labelled as AR that have emerged demands further conceptual clarification of AR. A conceptual inquiry of AR, presented in the paper, has led to the identification of several unresolved issues concerning intervention research like AR. An alternative research approach is presented: practice research. This research approach is well founded in pragmatism and it builds on the two premises: 1 to contribute to general practice through abstract and useful knowledge and 2 to study the empirical field as interconnected practices. Several important concepts of practice research are described as: local practice contribution vs. general practice contribution; theorizing vs. situational inquiry. Practice research is seen as a broader notion encompassing AR and other research approaches as e.g. design research and evaluation research. Two case examples of practice research are briefly presented and compared: one AR-based study in the social welfare sector and one evaluation study of a taxation e-service.

Evaluation of online accessed systems: example of qualitative research of Fast Addresses of GeaBios System

Directory of Open Access Journals (Sweden)

Aleš Klemen

2006-01-01

Full Text Available An efficient online information service user interface enables independent use of these online. Designers of the GeaBios Internet information system intended to evaluate the user-friendliness of their service »Fast adresses« (»Hitri naslovi«. In December 2003, as a research project for a graduation thesis, an evaluation of »Fast adresses« was conducted. The study consisted of 10 study participants performing assigned tasks and a survey of the same individuals. During the study research questions were developed as well as list of tasks to be assigned to the participants for the observations. Each observation was performed using a qualitative research paradigm. This paradigm was enhanced with an adaptation of Shneiderman’s (1998 questionnaire. Identified difficulties participants had in using »Fast adresses« fell into four types: (1 formulation of queries, (2 display of results, (3 the influence of the operating system, Windows, and, (4 the color and design of the display background and elements of the Web page. Results indicate that the difficulties encountered were not limited to the inappropriate design of the user interface, but also are attributable to user error.

Digital Libraries and Repositories in India: An Evaluative Study

Science.gov (United States)

Mittal, Rekha; Mahesh, G.

2008-01-01

Purpose: The purpose of this research is to identify and evaluate the collections within digital libraries and repositories in India available in the public domain. Design/methodology/approach: The digital libraries and repositories were identified through a study of the literature, as well as internet searching and browsing. The resulting digital…

A Cluster-Randomized Trial of Restorative Practices: An Illustration to Spur High-Quality Research and Evaluation