Evaluation electric bicycles; Evaluation velos electriques

Energy Technology Data Exchange (ETDEWEB)

NONE

2002-10-01

Leovelo service is the first measure in favor of the bicycle to control the air pollution and to conserve energy. It provides in the city of Clermont-Ferrand (France) a service of bicycle hiring. This document evaluates the project after two years of operating. It provides a technical evaluation (maintenance, equipment, financing) and also the socio-economic impacts. (A.L.B.)

Reframing Evaluation: Defining an Indigenous Evaluation Framework

Science.gov (United States)

LaFrance, Joan; Nichols, Richard

2008-01-01

The American Indian Higher Education Consortium (AIHEC), comprising 34 American Indian tribally controlled colleges and universities, has undertaken a comprehensive effort to develop an "Indigenous Framework for Evaluation" that synthesizes Indigenous ways of knowing and Western evaluation practice. To ground the framework, AIHEC engaged…

Comprehensive Psychiatric Evaluation

Science.gov (United States)

... Facts for Families Guide Facts for Families - Vietnamese Comprehensive Psychiatric Evaluation No. 52; Updated October 2017 Evaluation ... with serious emotional and behavioral problems need a comprehensive psychiatric evaluation. Comprehensive psychiatric evaluations usually require a ...

Evaluation Strategies in Financial Education: Evaluation with Imperfect Instruments

Science.gov (United States)

Robinson, Lauren; Dudensing, Rebekka; Granovsky, Nancy L.

2016-01-01

Program evaluation often suffers due to time constraints, imperfect instruments, incomplete data, and the need to report standardized metrics. This article about the evaluation process for the Wi$eUp financial education program showcases the difficulties inherent in evaluation and suggests best practices for assessing program effectiveness. We…

Neoliberalization by Evaluation: Explaining the Making of Neoliberal Evaluative State

Directory of Open Access Journals (Sweden)

Diego Giannone

2016-09-01

Full Text Available Starting from the late seventies neoliberalism has emerged as the new global hegemonic par-adigm. Several studies demonstrated that different factors facilitated the global spread of neoliberalism, but little attention has been paid to the role played by evaluation both in legitimizing the neoliberalization of the state and in explaining the resilience of neoliberalism. The article argues that evaluation is a strategy of action which is able to emphasize the adaptive capacity of neoliberalism to different socio-political con-texts and the neoliberal purpose to depoliticize public action. The contribution aims to illustrate how eval-uation works on a twofold level. On the one hand, evaluation is a tool of global governance that acts nor-matively to homogenize states’ action consistently with some neoliberal values, such as competitiveness and economic efficiency. On the other hand, to conform to such values, variegated forms of evaluation are implemented by each state in order to introduce market rationality in non-economic domains, such as ed-ucation and health system. Referring to some empirical cases, these two overlapping processes are termed as the "evaluated state" and "evaluative state". As a result, neoliberalization by evaluation is a process in-volving the elevation of market-based principles and techniques of evaluation to the level of state-endorsed norms

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Unbundling Evaluation Use.

Science.gov (United States)

Alkin, Marvin; Taut, Sandy

2003-01-01

Provides a conceptual framework for considering the distinction between evaluation use and evaluation influence and the relationship between evaluation use and knowledge use. Clarifies and expands some of the established definitions of concepts related to evaluation use. (SLD)

Empowerment evaluation: An approach that has literally altered the landscape of evaluation.

Science.gov (United States)

Donaldson, Stewart I

2017-08-01

The quest for credible and actionable evidence to improve decision making, foster improvement, enhance self-determination, and promote social betterment is now a global phenomenon. Evaluation theorists and practitioners alike have responded to and overcome the challenges that limited the effectiveness and usefulness of traditional evaluation approaches primarily focused on seeking rigorous scientific knowledge about social programs and policies. No modern evaluation approach has received a more robust welcome from stakeholders across the globe than empowerment evaluation. Empowerment evaluation has been a leader in the development of stakeholder involvement approaches to evaluation, setting a high bar. In addition, empowerment evaluation's respect for community knowledge and commitment to the people's right to build their own evaluation capacity has influenced the evaluation mainstream, particularly concerning evaluation capacity building. Empowerment evaluation's most significant contributions to the field have been to improving evaluation use and knowledge utilization. Copyright © 2016. Published by Elsevier Ltd.

Affective Evaluations of Exercising: The Role of Automatic-Reflective Evaluation Discrepancy.

Science.gov (United States)

Brand, Ralf; Antoniewicz, Franziska

2016-12-01

Sometimes our automatic evaluations do not correspond well with those we can reflect on and articulate. We present a novel approach to the assessment of automatic and reflective affective evaluations of exercising. Based on the assumptions of the associative-propositional processes in evaluation model, we measured participants' automatic evaluations of exercise and then shared this information with them, asked them to reflect on it and rate eventual discrepancy between their reflective evaluation and the assessment of their automatic evaluation. We found that mismatch between self-reported ideal exercise frequency and actual exercise frequency over the previous 14 weeks could be regressed on the discrepancy between a relatively negative automatic and a more positive reflective evaluation. This study illustrates the potential of a dual-process approach to the measurement of evaluative responses and suggests that mistrusting one's negative spontaneous reaction to exercise and asserting a very positive reflective evaluation instead leads to the adoption of inflated exercise goals.

Report of the evaluation by the Ad Hoc Review Committee on advance science research. Result evaluation, interim evaluation, in-advance evaluation in fiscal year 2003

International Nuclear Information System (INIS)

2003-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Advanced Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the accomplishments of the research completed in Fiscal Year 2002, the accomplishments of the research started in Fiscal Year 2001, and the adequacy of the programs of the research to be started in Fiscal Year 2004 at Advanced Science Research Center of JAERI. The Ad Hoc Review Committee consisted of nine specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from May to July 2003. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 24, 2003, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on August 4, 2003. This report describes the result of the evaluation by the Ad Hoc Review Committee on Advanced Science Research. (author)

Report of the evaluation by the Ad Hoc Review Committee on Advance Science Research. Result evaluation, interim evaluation, in-advance evaluation in fiscal year 2002

Energy Technology Data Exchange (ETDEWEB)

NONE

2002-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Advanced Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the accomplishments of the research completed in Fiscal Year 2001, the accomplishments of the research started in Fiscal Year 2000, and the adequacy of the programs of the research to be started in Fiscal Year 2003 at Advanced Science Research Center of JAERI. The Ad Hoc Review Committee consisted of eight specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from May to July 2002. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 4, 2002, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on August 5, 2002. This report describes the result of the evaluation by the Ad Hoc Review Committee on Advanced Science Research. (author)

Evaluating psychodiagnostic decisions.

Science.gov (United States)

Witteman, Cilia L M; Harries, Clare; Bekker, Hilary L; Van Aarle, Edward J M

2007-02-01

Several frameworks can be used to evaluate decision making. These may relate to different aspects of the decision-making process, or concern the decision outcome. Evaluations of psychodiagnostic decisions have shown diagnosticians to be poor decision makers. In this essay we argue that this finding results from the evaluation of only one part of the diagnostic process. We put forward that evaluations are typically carried out by comparing clinicians' behaviour to one of several normative models, for example hypothetico-deductive reasoning. These models make strong assumptions about human reasoning capabilities, which make it almost impossible for people to measure up to them. The subsequent two parts of the psychodiagnostic process (causal explanation and treatment decisions), are typically not included in these evaluation studies. Treatment decisions are evaluated in effectiveness studies; that is, they are evaluated in terms of their outcomes, not in terms of the diagnosticians' decision processes. Psychodiagnosticians' causal explanation has hardly ever been the subject of evaluation. We argue that in order to achieve clinical excellence, this part of the psychodiagnostic process should also be well understood. In this essay we first describe evaluation of psychodiagnostic decision making. We then propose a framework to describe causal explanation, that is, a situation assessment in terms of a causal schema or a story or script. We identify and discuss the tools available for evaluating this part of the psychodiagnostic process.

Evaluate Yourself. Evaluation: Research-Based Decision Making Series, Number 9304.

Science.gov (United States)

Fetterman, David M.

This document considers both self-examination and external evaluation of gifted and talented education programs. Principles of the self-examination process are offered, noting similarities to external evaluation models. Principles of self-evaluation efforts include the importance of maintaining a nonjudgmental orientation, soliciting views from…

Combining Internal and External Evaluation: A Case for School-Based Evaluation.

Science.gov (United States)

Nevo, David

1994-01-01

School-based evaluation, the focus of this article, is conceived of as neither a synonym for internal evaluation nor an antonym for external evaluation, but as a combination that is examined through a review of recent research. A school-based evaluation in Israel illustrates combining these approaches in a complementary way. (SLD)

Measure Evaluation Dataverse

Data.gov (United States)

US Agency for International Development — The MEASURE Evaluation Dataverse is a collection of innovative evaluation data sets assembled in order to increase the evidence-base on program impact and evaluate...

Evaluation Program initiative

International Nuclear Information System (INIS)

Rich, B.L.

1987-01-01

The purpose of this paper is to provide the Department of Energy's (DOE) safeguards and security community with some insights on an important management initiative by the Office of Security Evaluations (OSE). The paper will present the ''what, where, who, when, and why'' of a new Evaluation Program. The Evaluation Program will be comprised of a continuing series of regular and special evaluations of DOE safeguards and security programs and policies. The evaluations will be integrative and ''crosscutting,'' i.e. will extend across DOE organizational lines. Evaluations will be offered as positive advisories to DOE managers with safeguards and security responsibilities and will not be rated. They will complement the ongoing OSE Inspection Program of inspections conducted by OSE's Inspection Division. The purpose for the evaluations is to establish an accurate and current assessment of the effectiveness and status of safeguards and security programs and policies and to provide DOE managers with required information on program and policy effectiveness

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Evaluation of the quality of CR mammography images in Chugoku Rosai Hospital. Visual evaluation and digital evaluation

International Nuclear Information System (INIS)

Makihata, Hiroshi; Fukuda, Tomoya; Aomori, Masaji; Hara, Shinji

2005-01-01

New mammography system (50-micrometer system) composed of Fuji computed tomography (FCR) both sides IP, 5000MA and dry imager was introduced in the Department of Physical Checkup of Chugoku Rosai Hospital in 2003. We performed visual evaluation and digital evaluation using 50-micrometer system in accordance with (the quality control guidance of) Non-Profit Organization the Central Committee on Quality Control of Mammographic Screening. In visual evaluation using RMI156 phantom the system cleared the quality control guidance about a fiber, calcification, and masses. On step phantom, it passed about 10 steps, masses, and calcifications. Since a success standard was not announced officially, the performance in digital evaluation cannot be judged and only the result is presented. In digital evaluation, signal-to-noise ratio (SNR) is 14.9, root of mean squares (RMS) is 32.9, SNRC is 16.4, SNRT is 3.65. This system image has high sharpness and is considered from the result in visual evaluation to have the ability of offering images with a high degree of information. (author)

Evaluating the "Evaluative State": Implications for Research in Higher Education.

Science.gov (United States)

Dill, David D.

1998-01-01

Examines the "evaluative state" that is, public management-based evaluation systems--in the context of experiences in the United Kingdom and New Zealand, and suggests that further research is needed to examine problems in the evaluative state itself, in how market competition impacts upon it, and how academic oligarchies influence the…

Descriptive sensory evaluations

DEFF Research Database (Denmark)

Dehlholm, Christian

A recent trend in descriptive sensory evaluation methodology has been the application of rapid evaluation techniques. The ease in use makes the techniques extremely easy to implement by industry and university environments. Thus, one might not consider validity in the choice of method. The overall...... aim of this thesis is to compare and evaluate selected rapid evaluation techniques for sensory profiling. Method variations have been suggested for evaluations in product development and quality control, and method insight is provided. The thesis includes three original studies, designed...... as a consequence of the current practices and needs faced in the industry. Study I compared applicability and validity of rapid methods across several panels of trained assessors. Two rapid approaches were introduced for the evaluation of foods. The first method, ‘Free Multiple Sorting’, allows subjects to perform...

Support for system connectivity –Learning from evaluating an evaluation

DEFF Research Database (Denmark)

Christensen, Jesper Lindgaard

been sparse on investigat-ing effects of these as well as on the broader criteria to evaluate the innovation networks and functioning of the system. This paper discusses what are such criteria for evaluating innovation policies that rely on enhanc-ing system connectivity and repair system failures......Innovation is said to be dependent upon collaboration and networks. The innovation system thinking empha-sizes networks but also their supporting informal institutions, learning processes, and the relations between actors in the system. Despite the importance of networks, evaluation studies have......? By way of illustration, and as a mean to be specific on these criteria, the paper discusses the possible rationale for governments to support business angel networks (BAN) and what criteria to apply when evaluating such networks. It is found that applying traditional evaluation criteria for assessing...

Mini-clinical evaluation exercise til evaluering af kommunikation og samarbejde i ambulatoriet

DEFF Research Database (Denmark)

Eriksen, Jesper Grau; Simonsen, Dorit; Bastholt, Lars

2009-01-01

INTRODUCTION: In the revised Danish medical specialist training increased focus has been placed on competences which are hard to evaluate such as communication skills. Mini-CEX seems promising as an evaluation tool. Our aim was to test: 1) whether mini-CEX was useable in the evaluation of communi......INTRODUCTION: In the revised Danish medical specialist training increased focus has been placed on competences which are hard to evaluate such as communication skills. Mini-CEX seems promising as an evaluation tool. Our aim was to test: 1) whether mini-CEX was useable in the evaluation...

Broadening the Educational Evaluation Lens with Communicative Evaluation

Science.gov (United States)

Brooks-LaRaviere, Margaret; Ryan, Katherine; Miron, Luis; Samuels, Maurice

2009-01-01

Outcomes-based accountability in the form of test scores and performance indicators are a primary lever for improving student achievement in the current educational landscape. The article presents communicative evaluation as a complementary evaluation approach that may be used along with the primary methods of school accountability to provide a…

Evaluation and Policy Learning

DEFF Research Database (Denmark)

Borrás, Susana; Højlund, Steven

2015-01-01

This article examines how evaluation induces policy learning – a question largely neglected by the scholarly literature on evaluation and policy learning. Following a learner's perspective, the article attempts to ascertain who the learners are, and what, and how, learners actually learn from...... evaluations. In so doing, it focuses on what different types of learners actually learn within the context of the evaluation framework (the set of administrative structures defining the evaluation goals and process). Taking the empirical case of three EU programme evaluations, the patterns of policy learning...... emanating from them are examined. The findings are that only two types of actors involved in the evaluation are actually learning (programme units and external evaluators), that learners learn different things (programme overview, small-scale programme adjustments, policy change and evaluation methods...

Development, evaluation, and utility of a peer evaluation form for online teaching.

Science.gov (United States)

Gaskamp, Carol D; Kintner, Eileen

2014-01-01

Formative assessment of teaching by peers is an important component of quality improvement for educators. Teaching portfolios submitted for promotion and tenure are expected to include peer evaluations. Faculty resources designed for peer evaluation of classroom teaching are often inadequate for evaluating online teaching. The authors describe development, evaluation, and utility of a new peer evaluation form for formative assessment of online teaching deemed relevant, sound, feasible, and beneficial.

Evaluating impact of clinical guidelines using a realist evaluation framework.

Science.gov (United States)

Reddy, Sandeep; Wakerman, John; Westhorp, Gill; Herring, Sally

2015-12-01

The Remote Primary Health Care Manuals (RPHCM) project team manages the development and publication of clinical protocols and procedures for primary care clinicians practicing in remote Australia. The Central Australian Rural Practitioners Association Standard Treatment Manual, the flagship manual of the RPHCM suite, has been evaluated for accessibility and acceptability in remote clinics three times in its 20-year history. These evaluations did not consider a theory-based framework or a programme theory, resulting in some limitations with the evaluation findings. With the RPHCM having an aim of enabling evidence-based practice in remote clinics and anecdotally reported to do so, testing this empirically for the full suite is vital for both stakeholders and future editions of the RPHCM. The project team utilized a realist evaluation framework to assess how, why and for what the RPHCM were being used by remote practitioners. A theory regarding the circumstances in which the manuals have and have not enabled evidence-based practice in the remote clinical context was tested. The project assessed this theory for all the manuals in the RPHCM suite, across government and aboriginal community-controlled clinics, in three regions of Australia. Implementing a realist evaluation framework to generate robust findings in this context has required innovation in the evaluation design and adaptation by researchers. This article captures the RPHCM team's experience in designing this evaluation. © 2015 John Wiley & Sons, Ltd.

Evaluation Influence: The Evaluation Event and Capital Flow in International Development.

Science.gov (United States)

Bell, David A

2017-12-01

Assessing program effectiveness in human development is central to informing foreign aid policy-making and organizational learning. Foreign aid effectiveness discussions have increasingly given attention to the devaluing effects of aid flow volatility. This study reveals that the external evaluation event influences actor behavior, serving as a volatility-constraining tool. A case study of a multidonor aid development mechanism served examining the influence of an evaluation event when considering anticipatory effects. The qualitative component used text and focus group data combined with individual interview data (organizations n = 10, including 26 individuals). Quantitative data included financial information on all 75 capital investments. The integrated theory of influence and model of alternative mechanisms used these components to identify the linkage between the evaluation event and capital flow volatility. Aid approved in the year of the midterm evaluation was disbursed by the mechanism with low capital volatility. Anticipating the evaluation event influenced behavior resulting in an empirical record that program outcomes were enhanced and the mechanism was an improved organization. Formative evaluations in a development program can trigger activity as an interim process. That activity provides for a more robust assessment of ultimate consequence of interest. Anticipating an evaluation can stimulate donor reality testing. The findings inform and strengthen future research on the influence of anticipating an evaluation. Closely examining activities before, during, and shortly after the evaluation event can aid development of other systematic methods to improve understanding this phenomenon, as well as improve donor effectiveness strategies.

Prototype of evaluation guidance system in Integrated Nuclear Data Evaluation System

International Nuclear Information System (INIS)

Fukahori, T.; Nakagawa, T.

1992-01-01

Integrated Nuclear Data Evaluation System (INDES) is being developed to keep experiences of nuclear data evaluation for JENDL-3 and to support new evaluations. One of the INDES functions is to set up input data of theoretical calculation codes automatically. In order to use INDES effectively, a prototype of nuclear data evaluation guidance system (E.T.; Evaluation Tutor) was made to help users in selecting a set of suitable theoretical calculation codes by applying knowledge engineering technology. E.T. consists of an inference engine, frames, a rule-base, two example-bases and calculating modules of certainty factors. The inference engine and the calculating modules are written in FORTRAN77. (author)

Constructionism, postmodernism and evaluation theory. The strategic function of evaluation

Directory of Open Access Journals (Sweden)

Baltasar Fernández-Ramírez

2009-05-01

Full Text Available "Testing"  and "evaluating" are money-making activities that offer a rewarding professional career; perhaps it is no surprise that the field includes numbers of self-styled "evaluators" who provide services without the required training. Evaluation means the systematic application of given criteria for judging the merit or value of a variety of 'assessables' - capacities, powers and services, including social policy interventions. The conventional perspective is rationalist (in diagnosis, planning, intervention and impact analysis, even though rationalism have lost their pre-eminence in the social sciences, in favour of political, symbolic or chaotic alternatives, as the history of organizational thought reveals. Alternatively, from a constructionist perspective, we see the power of evaluation criteria to reify what they ostensibly assess. Evaluations suggest or impose what is right; criteria of value define, give meaning and prioritize just one way of understanding social relations, program goals or individual and organizational behaviour. The suggestion in this article is to make a positive virtue of this inevitable pragmatic consequence of evaluation: to openly embrace it as an agent of change, emphasizing a strategical function beyond the traditional purposes of enhancement and accountability. 

Evaluation der ärztlichen Ausbildung [Evaluation of medical education

Directory of Open Access Journals (Sweden)

van den Bussche, Hendrik

2006-05-01

Full Text Available [english] Background: The importance of evaluation is increasing, not only in medical education. Apart from giving feedback to the teachers the results of evaluations can be used for allocation of educational funds. At the medical faculty of the University of Hamburg the evaluation of medical education has been performed since ten years. Results: An analysis of the Hamburg experience in the standardized evaluation of medical education shows a series of problems. 1. The cumulative evaluation of curriculum parts tends to turn out different than the detailed evaluation of its consisting parts. 2. Theoretical courses tend to be assessed worse than clinical courses - irrespective of their real quality. The reason for this "handicap" of theoretical courses is that students tend to rate their benefit for clinical practice lower. 3. There are differences between prompt and delayed assessments of the same courses. 4. Students' assessment also depends on the stage of their training and on the didactic type of the evaluated course. Conclusion: Ranking of courses should be performed with caution. To improve reliability and validity of results the following suggestions are made: 1. Results of cumulative evaluation of curriculum parts should be interpreted with care. 2. Unequal opportunities of theoretical and clinical courses to gain good results should be considered. 3. Repeated assessments and longitudinal comparisons are essential. 4. Comparisons should be made only between similar didactical types of courses. 5. Results should be analysed with respect to their possible causes, preferably by mixed evaluation commissions. 6. It is recommended to evaluate aspects of process quality rather than of result quality. [german] Hintergrund: Die Evaluation von Lehrveranstaltungen und curricularen Abschnitten durch Studierende nimmt nicht nur in der ärztlichen Ausbildung zu. Neben der Rückmeldung an die Dozenten können die Ergebnisse eine wichtige Basis f

Information Retrieval Evaluation

CERN Document Server

Harman, Donna

2011-01-01

Evaluation has always played a major role in information retrieval, with the early pioneers such as Cyril Cleverdon and Gerard Salton laying the foundations for most of the evaluation methodologies in use today. The retrieval community has been extremely fortunate to have such a well-grounded evaluation paradigm during a period when most of the human language technologies were just developing. This lecture has the goal of explaining where these evaluation methodologies came from and how they have continued to adapt to the vastly changed environment in the search engine world today. The lecture

The Practice of Evaluation Research and the Use of Evaluation Results.

Science.gov (United States)

Van den Berg, G.; Hoeben, W. Th. J. G.

1984-01-01

Lack of use of educational evaluation results in the Netherlands was investigated by analyzing 14 curriculum evaluation studies. Results indicated that rational decision making with a technical (empirical) evaluation approach makes utilization of results most likely. Incremental decision making and a conformative approach make utilization least…

Evaluating human resource interventions

Directory of Open Access Journals (Sweden)

Joha Louw-Potgieter

2012-07-01

Research purpose: The purpose of this special edition is to introduce readers to the evaluation of human resource (HR programmes. Motivation for the study: There are few comprehensive evaluations of HR programmes despite many publications on functional efficiency measures of HR (i.e. measures of cost, time, quantity, error and quality. Research design, approach and method: This article provides a value chain for HR activities and introduces the reader to programme theory-driven evaluation. Main findings: In summarising all of the contributions in this edition, one of the main findings was the lack of programme evaluation experience within HR functions and the difficulty this posed for the evaluators. Practical/managerial implications: This introductory article presents answers to two simple questions: What does HR do? and, What is programme evaluation? These answers will enable practitioners to understand what programme evaluators mean when we say that programme evaluation seeks to determine the merit of a programme. Contribution/value-add: The main contribution of this introductory article is to set the scene for the HR evaluations that follow. It alerts the reader to the rich theory contribution in HR literature and how to apply this in a theory-driven evaluation.

Politics in evaluation: Politically responsive evaluation in high stakes environments.

Science.gov (United States)

Azzam, Tarek; Levine, Bret

2015-12-01

The role of politics has often been discussed in evaluation theory and practice. The political influence of the situation can have major effects on the evaluation design, approach and methods. Politics also has the potential to influence the decisions made from the evaluation findings. The current study focuses on the influence of the political context on stakeholder decision making. Utilizing a simulation scenario, this study compares stakeholder decision making in high and low stakes evaluation contexts. Findings suggest that high stakes political environments are more likely than low stakes environments to lead to reduced reliance on technically appropriate measures and increased dependence on measures better reflect the broader political environment. Copyright © 2015 Elsevier Ltd. All rights reserved.

Data modeling and evaluation

International Nuclear Information System (INIS)

Bauge, E.; Hilaire, S.

2006-01-01

This lecture is devoted to the nuclear data evaluation process, during which the current knowledge (experimental or theoretical) of nuclear reactions is condensed and synthesised into a computer file (the evaluated data file) that application codes can process and use for simulation calculations. After an overview of the content of evaluated nuclear data files, we describe the different methods used for evaluating nuclear data. We specifically focus on the model based approach which we use to evaluate data in the continuum region. A few examples, coming from the day to day practice of data evaluation will illustrate this lecture. Finally, we will discuss the most likely perspectives for improvement of the evaluation process in the next decade. (author)

Evaluated Nuclear Data

Energy Technology Data Exchange (ETDEWEB)

Oblozinsky, P.; Oblozinsky,P.; Herman,M.; Mughabghab,S.F.

2010-10-01

This chapter describes the current status of evaluated nuclear data for nuclear technology applications. We start with evaluation procedures for neutron-induced reactions focusing on incident energies from the thermal energy up to 20 MeV, though higher energies are also mentioned. This is followed by examining the status of evaluated neutron data for actinides that play dominant role in most of the applications, followed by coolants/moderators, structural materials and fission products. We then discuss neutron covariance data that characterize uncertainties and correlations. We explain how modern nuclear evaluated data libraries are validated against an extensive set of integral benchmark experiments. Afterwards, we briefly examine other data of importance for nuclear technology, including fission yields, thermal neutron scattering and decay data. A description of three major evaluated nuclear data libraries is provided, including the latest version of the US library ENDF/B-VII.0, European JEFF-3.1 and Japanese JENDL-3.3. A brief introduction is made to current web retrieval systems that allow easy access to a vast amount of up-to-date evaluated nuclear data for nuclear technology applications.

The City Intelligence Quotient (City IQ Evaluation System: Conception and Evaluation

Directory of Open Access Journals (Sweden)

Zhiqiang Wu

2016-06-01

Full Text Available After a systematic review of 38 current intelligent city evaluation systems (ICESs from around the world, this research analyzes the secondary and tertiary indicators of these 38 ICESs from the perspectives of scale structuring, approaches and indicator selection, and determines their common base. From this base, the fundamentals of the City Intelligence Quotient (City IQ Evaluation System are developed and five dimensions are selected after a clustering analysis. The basic version, City IQ Evaluation System 1.0, involves 275 experts from 14 high-end research institutions, which include the Chinese Academy of Engineering, the National Academy of Science and Engineering (Germany, the Royal Swedish Academy of Engineering Sciences, the Planning Management Center of the Ministry of Housing and Urban-Rural Development of China, and the Development Research Center of the State Council of China. City IQ Evaluation System 2.0 is further developed, with improvements in its universality, openness, and dynamic adjustment capability. After employing deviation evaluation methods in the IQ assessment, City IQ Evaluation System 3.0 was conceived. The research team has conducted a repeated assessment of 41 intelligent cities around the world using City IQ Evaluation System 3.0. The results have proved that the City IQ Evaluation System, developed on the basis of intelligent life, features more rational indicators selected from data sources that can offer better universality, openness, and dynamics, and is more sensitive and precise.

The EMEFS model evaluation

International Nuclear Information System (INIS)

Barchet, W.R.; Dennis, R.L.; Seilkop, S.K.; Banic, C.M.; Davies, D.; Hoff, R.M.; Macdonald, A.M.; Mickle, R.E.; Padro, J.; Puckett, K.; Byun, D.; McHenry, J.N.; Karamchandani, P.; Venkatram, A.; Fung, C.; Misra, P.K.; Hansen, D.A.; Chang, J.S.

1991-12-01

The binational Eulerian Model Evaluation Field Study (EMEFS) consisted of several coordinated data gathering and model evaluation activities. In the EMEFS, data were collected by five air and precipitation monitoring networks between June 1988 and June 1990. Model evaluation is continuing. This interim report summarizes the progress made in the evaluation of the Regional Acid Deposition Model (RADM) and the Acid Deposition and Oxidant Model (ADOM) through the December 1990 completion of a State of Science and Technology report on model evaluation for the National Acid Precipitation Assessment Program (NAPAP). Because various assessment applications of RADM had to be evaluated for NAPAP, the report emphasizes the RADM component of the evaluation. A protocol for the evaluation was developed by the model evaluation team and defined the observed and predicted values to be used and the methods by which the observed and predicted values were to be compared. Scatter plots and time series of predicted and observed values were used to present the comparisons graphically. Difference statistics and correlations were used to quantify model performance. 64 refs., 34 figs., 6 tabs

The EMEFS model evaluation

Energy Technology Data Exchange (ETDEWEB)

Barchet, W.R. (Pacific Northwest Lab., Richland, WA (United States)); Dennis, R.L. (Environmental Protection Agency, Research Triangle Park, NC (United States)); Seilkop, S.K. (Analytical Sciences, Inc., Durham, NC (United States)); Banic, C.M.; Davies, D.; Hoff, R.M.; Macdonald, A.M.; Mickle, R.E.; Padro, J.; Puckett, K. (Atmospheric Environment Service, Downsview, ON (Canada)); Byun, D.; McHenry, J.N.

1991-12-01

The binational Eulerian Model Evaluation Field Study (EMEFS) consisted of several coordinated data gathering and model evaluation activities. In the EMEFS, data were collected by five air and precipitation monitoring networks between June 1988 and June 1990. Model evaluation is continuing. This interim report summarizes the progress made in the evaluation of the Regional Acid Deposition Model (RADM) and the Acid Deposition and Oxidant Model (ADOM) through the December 1990 completion of a State of Science and Technology report on model evaluation for the National Acid Precipitation Assessment Program (NAPAP). Because various assessment applications of RADM had to be evaluated for NAPAP, the report emphasizes the RADM component of the evaluation. A protocol for the evaluation was developed by the model evaluation team and defined the observed and predicted values to be used and the methods by which the observed and predicted values were to be compared. Scatter plots and time series of predicted and observed values were used to present the comparisons graphically. Difference statistics and correlations were used to quantify model performance. 64 refs., 34 figs., 6 tabs.

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Reading Evaluation

Science.gov (United States)

Fagan, W. T.

1978-01-01

The Canadian Institute for Research in Behavioral and Social Sciences of Calgary was awarded a contract by the Provincial Government of Alberta to assess student skills and knowledge in reading and written composition. Here evaluation is defined and the use of standardized and criterion referenced tests for evaluating reading performance are…

Evaluation, Language, and Untranslatables

DEFF Research Database (Denmark)

Dahler-Larsen, Peter; Dahler-Larsen, Peter

2017-01-01

The issue of translatability is pressing in international evaluation, in global transfer of evaluative instruments, in comparative performance management, and in culturally responsive evaluation. Terms that are never fully understood, digested, or accepted may continue to influence issues, problems......, and social interactions in and around and after evaluations. Their meanings can be imposed or reinvented. Untranslatable terms are not just “lost in translation” but may produce overflows that do not go away. The purpose of this article is to increase attention to the issue of translatability in evaluation...... of relevance that appear to be “foreign”; increase the language skills of evaluators; and make research on frictions in translation an articulate part of the agenda for research on evaluation....

Presidential Address: Empowerment Evaluation.

Science.gov (United States)

Fetterman, David

1994-01-01

Empowerment evaluation is the use of evaluation concepts and techniques to foster self-determination, focusing on helping people help themselves. This collaborative evaluation approach requires both qualitative and quantitative methodologies. It is a multifaceted approach that can be applied to evaluation in any area. (SLD)

Scientific evaluation at the CEA; Evaluation scientifique au CEA

Energy Technology Data Exchange (ETDEWEB)

NONE

1999-11-01

This report presents a statement of the scientific and technical activity of the French atomic energy commission (CEA) for the year 1998. This evaluation is made by external and independent experts and requires some specific dispositions for the nuclear protection and safety institute (IPSN) and for the direction of military applications (DAM). The report is divided into 5 parts dealing successively with: part 1 - the CEA, a public research organization (civil nuclear research, technology research and transfers, defence activities); the scientific and technical evaluation at the CEA (general framework, evaluation of the IPSN and DAM); part 2 - the scientific and technical councils (directions of fuel cycle, of nuclear reactors, and of advanced technologies); part 3 - the scientific councils (directions of matter and of life sciences); the nuclear protection and safety institute; the direction of military applications; part 4 - the corresponding members of the evaluation; part 5 - the list of scientific and technical councils and members. (J.S.)

Peer Evaluation of Teaching or "Fear" Evaluation: In Search of Compatibility

Science.gov (United States)

Salih, Abdel Rahman Abdalla

2013-01-01

Peer evaluation or review of teaching is one of the factors of quality assurance system at the present time. However, peer evaluation is sometimes approached with trepidation and with the feeling that it may not be fair and free of bias. This paper examines teachers' perceptions of peer evaluation as an enhancement for quality teaching. A…

Organizational use of evaluations

DEFF Research Database (Denmark)

Hansson, Finn

2004-01-01

Organizations perform evaluations in order to demonstrate their trustworthiness to theoutside world and to produce knowledge for use by the management of the organization.In the planning and application of specific evaluations in the organization, differentparticipants or stakeholders very often...... as part of the evaluation process and the long-term impact of this new systematicallyorganised set of data on organizational activities are normally not taken seriously intoconsideration when the use of evaluations in organizations are discussed. Saiddifferently, evaluations have become a major factor...... of organizational sociology, that people tend to adapt to external behaviouraldemands especially when related to power relations in the organization.keywords: research evaluation, governance, social control, publication counts....

Plaidoyer pour l'auto-evaluation (Avocating Student Self-Evaluation).

Science.gov (United States)

Holec, Henri

1981-01-01

Advocates student self-evaluation as a practice that can impart new vigor to language courses and benefit both student and teacher as well as their relationship. Cautions, however, that self-evaluation procedures must be learned and that students must acquire a clear perception of the relevant criteria and objectives. (MES)

Adaptation, Evaluation and Inclusion

Science.gov (United States)

Basson, R.

2011-01-01

In this article I reflect on a recent development currently shaping programme evaluation as field, which makes the case for evaluators facilitating evaluation training evaluees to self-evaluate and improve the programmes they teach. Fetterman argues persuasively that the practice was incipient in the field and required formalization and acceptance…

Health services research evaluation principles. Broadening a general framework for evaluating health information technology.

Science.gov (United States)

Sockolow, P S; Crawford, P R; Lehmann, H P

2012-01-01

Our forthcoming national experiment in increased health information technology (HIT) adoption funded by the American Recovery and Reinvestment Act of 2009 will require a comprehensive approach to evaluating HIT. The quality of evaluation studies of HIT to date reveals a need for broader evaluation frameworks that limits the generalizability of findings and the depth of lessons learned. Develop an informatics evaluation framework for health information technology (HIT) integrating components of health services research (HSR) evaluation and informatics evaluation to address identified shortcomings in available HIT evaluation frameworks. A systematic literature review updated and expanded the exhaustive review by Ammenwerth and deKeizer (AdK). From retained studies, criteria were elicited and organized into classes within a framework. The resulting Health Information Technology Research-based Evaluation Framework (HITREF) was used to guide clinician satisfaction survey construction, multi-dimensional analysis of data, and interpretation of findings in an evaluation of a vanguard community health care EHR. The updated review identified 128 electronic health record (EHR) evaluation studies and seven evaluation criteria not in AdK: EHR Selection/Development/Training; Patient Privacy Concerns; Unintended Consequences/ Benefits; Functionality; Patient Satisfaction with EHR; Barriers/Facilitators to Adoption; and Patient Satisfaction with Care. HITREF was used productively and was a complete evaluation framework which included all themes that emerged. We can recommend to future EHR evaluators that they consider adding a complete, research-based HIT evaluation framework, such as HITREF, to their evaluation tools suite to monitor HIT challenges as the federal government strives to increase HIT adoption.

Technical Evaluation Report 30: Vendor-Assisted Evaluation of a Learning Management System

Directory of Open Access Journals (Sweden)

Adrienne De Schutter

2004-04-01

Full Text Available A product evaluation was conducted of Desire2Learn, an online learning management system gaining popularity in educational institutions. Since an online trial version of the software was not available for evaluation, an inspection meeting with the vendor was arranged. This provided the evaluation team with an opportunity to examine the precautions necessary for ensuring the objectivity of a product evaluation based on vendor-supplied information. The report outlines the team’s use of evaluator-driven enquiry and a triangulated approach to information checking. The Desire2Learn product is assessed as a flexible and useful addition to the range of learning management system options.

Evaluation of health promotion in schools: a realistic evaluation approach using mixed methods

Science.gov (United States)

2010-01-01

Background Schools are key settings for health promotion (HP) but the development of suitable approaches for evaluating HP in schools is still a major topic of discussion. This article presents a research protocol of a program developed to evaluate HP. After reviewing HP evaluation issues, the various possible approaches are analyzed and the importance of a realistic evaluation framework and a mixed methods (MM) design are demonstrated. Methods/Design The design is based on a systemic approach to evaluation, taking into account the mechanisms, context and outcomes, as defined in realistic evaluation, adjusted to our own French context using an MM approach. The characteristics of the design are illustrated through the evaluation of a nationwide HP program in French primary schools designed to enhance children's social, emotional and physical health by improving teachers' HP practices and promoting a healthy school environment. An embedded MM design is used in which a qualitative data set plays a supportive, secondary role in a study based primarily on a different quantitative data set. The way the qualitative and quantitative approaches are combined through the entire evaluation framework is detailed. Discussion This study is a contribution towards the development of suitable approaches for evaluating HP programs in schools. The systemic approach of the evaluation carried out in this research is appropriate since it takes account of the limitations of traditional evaluation approaches and considers suggestions made by the HP research community. PMID:20109202

MINERGY CORPORATION GLASS FURNACE TECHNOLOGY EVALUATION: INNOVATION TECHNOLOGY EVALUATION REPORT

Science.gov (United States)

This report presents performance and economic data for a U.S. Environmental Protection Agency (EPA) Superfund Innovative Technology Evaluation (SITE) Program demonstration of the Minergy Corporation (Minergy) Glass Furnace Technology (GFT). The demonstration evaluated the techno...

Evaluation in Context

DEFF Research Database (Denmark)

Jaap, Kamps; Lalmas, Mounia; Larsen, Birger

All search happens in a particular context - such as the particular collection of a digital library, its associated search tasks, and its associated users. Information retrieval researchers usually agree on the importance of context, but they rarely address the issue. In particular, evaluation in......, e.g. those that suit a particular task scenario, and zoom in on the relative performance for such a group of topics.......All search happens in a particular context - such as the particular collection of a digital library, its associated search tasks, and its associated users. Information retrieval researchers usually agree on the importance of context, but they rarely address the issue. In particular, evaluation....../assessors - by designing targeted questionnaires. The questionnaire data becomes part of the evaluation test-suite as valuable data on the context of the search requests.We have experimented with this questionnaire approach during the evaluation campaign of the INitiative for the Evaluation of XML Retrieval (INEX...

Radiological evaluation of tumor response in oncological studies (tumor response evaluation)

International Nuclear Information System (INIS)

Gebauer, B.; Riess, H.

2011-01-01

Purpose: Radiological-morphological response evaluation plays a major role in oncological therapy and studies for approval. Specific criteria have been developed for some tumor entities and chemotherapeutics. Application, limitations and definitions of the most frequently used criteria for tumor response evaluation will be presented. Materials and Methods: Review based on a selective literature research. Results: In clinical oncological therapy studies, WHO and RECIST are the most frequently used criteria to evaluate morphological therapy response. RECIST criteria have been modified recently, especially with respect to the evaluation of lymph nodes, and were published as RECIST 1.1 in 2009. All criteria were originally developed and defined to review clinical multicenter trials for approval. Using these criteria in a clinical situation, certain limitations have to be considered. To evaluate response, a baseline scan before therapy start is mandatory. Special tumor response criteria have been defined for some certain tumor entities. Oncologists and radiologists should define in advance which criteria are used before starting therapy. Conclusion: The use of defined criteria is very important in oncology response evaluation. In-depth knowledge of the criteria and their limits is required for correct usage. (orig.)

Practice-centred evaluation and the privileging of care in health information technology evaluation.

Science.gov (United States)

Darking, Mary; Anson, Rachel; Bravo, Ferdinand; Davis, Julie; Flowers, Steve; Gillingham, Emma; Goldberg, Lawrence; Helliwell, Paul; Henwood, Flis; Hudson, Claire; Latimer, Simon; Lowes, Paul; Stirling, Ian

2014-06-05

Our contribution, drawn from our experience of the case study provided, is a protocol for practice-centred, participative evaluation of technology in the clinical setting that privileges care. In this context 'practice-centred' evaluation acts as a scalable, coordinating framework for evaluation that recognises health information technology supported care as an achievement that is contingent and ongoing. We argue that if complex programmes of technology-enabled service innovation are understood in terms of their contribution to patient care and supported by participative, capability-building evaluation methodologies, conditions are created for practitioners and patients to realise the potential of technologies and make substantive contributions to the evidence base underpinning health innovation programmes. Electronic Patient Records (EPRs) and telemedicine are positioned by policymakers as health information technologies that are integral to achieving improved clinical outcomes and efficiency savings. However, evaluating the extent to which these aims are met poses distinct evaluation challenges, particularly where clinical and cost outcomes form the sole focus of evaluation design. We propose that a practice-centred approach to evaluation - in which those whose day-to-day care practice is altered (or not) by the introduction of new technologies are placed at the centre of evaluation efforts - can complement and in some instances offer advantages over, outcome-centric evaluation models. We carried out a regional programme of innovation in renal services where a participative approach was taken to the introduction of new technologies, including: a regional EPR system and a system to support video clinics. An 'action learning' approach was taken to procurement, pre-implementation planning, implementation, ongoing development and evaluation. Participants included clinicians, technology specialists, patients and external academic researchers. Whilst undergoing these

Evaluation Use: Results from a Survey of U.S. American Evaluation Association Members

Science.gov (United States)

Fleischer, Dreolin N.; Christie, Christina A.

2009-01-01

This paper presents the results of a cross-sectional survey on evaluation use completed by 1,140 U.S. American Evaluation Association members. This study had three foci: evaluators' current attitudes, perceptions, and experiences related to evaluation use theory and practice, how these data are similar to those reported in a previous study…

Evaluating the future of HCI: challenges for the evaluation of emerging applications

NARCIS (Netherlands)

Poppe, Ronald Walter; Rienks, R.J.

2007-01-01

Current evaluation methods are inappropriate for emerging HCI applications. In this paper, we give three examples of these applications and show that traditional evaluation methods fail. We identify trends in HCI development and discuss the issues that arise with evaluation. We aim at achieving

Evaluating the Future of HCI : Challenges for the Evaluation of Emerging Applications

NARCIS (Netherlands)

Poppe, Ronald Walter; Rienks, R.J.; van Dijk, Elisabeth M.A.G.; Huang, T.S; Nijholt, Antinus; Pantic, Maja; Pentland, A.

2007-01-01

Current evaluation methods are inappropriate for emerging HCI applications. In this paper, we give three examples of these applications and show that traditional evaluation methods fail. We identify trends in HCI development and discuss the issues that arise with evaluation. We aim at achieving

ADMS Evaluation Platform

Energy Technology Data Exchange (ETDEWEB)

2018-01-23

Deploying an ADMS or looking to optimize its value? NREL offers a low-cost, low-risk evaluation platform for assessing ADMS performance. The National Renewable Energy Laboratory (NREL) has developed a vendor-neutral advanced distribution management system (ADMS) evaluation platform and is expanding its capabilities. The platform uses actual grid-scale hardware, large-scale distribution system models, and advanced visualization to simulate realworld conditions for the most accurate ADMS evaluation and experimentation.

Where Local and National Evaluators Meet: Unintended Threats to Ethical Evaluation Practice

Science.gov (United States)

Rodi, Michael S.; Paget, Kathleen D.

2007-01-01

The ethical work of program evaluators is based on a covenant of honesty and transparency among stakeholders. Yet even under the most favorable evaluation conditions, threats to ethical standards exist and muddle that covenant. Unfortunately, ethical issues associated with different evaluation structures and contracting arrangements have received…

Airborne Evaluation Facility

Data.gov (United States)

Federal Laboratory Consortium — AFRL's Airborne Evaluation Facility (AEF) utilizes Air Force Aero Club resources to conduct test and evaluation of a variety of equipment and concepts. Twin engine...

Fission product yield evaluation for the USA evaluated nuclear data files

International Nuclear Information System (INIS)

Rider, B.F.; England, T.R.

1994-01-01

An evaluated set of fission product yields for use in calculation of decay heat curves with improved accuracy has been prepared. These evaluated yields are based on all known experimental data through 1992. Unmeasured fission product yields are calculated from charge distribution, pairing effects, and isomeric state models developed at Los Alamos National Laboratory. The current evaluation has been distributed as the ENDF/B-VI fission product yield data set

Evaluation as institution: a contractarian argument for needs-based economic evaluation.

Science.gov (United States)

Rogowski, Wolf H

2018-06-13

There is a gap between health economic evaluation methods and the value judgments of coverage decision makers, at least in Germany. Measuring preference satisfaction has been claimed to be inappropriate for allocating health care resources, e.g. because it disregards medical need. The existing methods oriented at medical need have been claimed to disregard non-consequentialist fairness concerns. The aim of this article is to propose a new, contractarian argument for justifying needs-based economic evaluation. It is based on consent rather than maximization of some impersonal unit of value to accommodate the fairness concerns. This conceptual paper draws upon contractarian ethics and constitution economics to show how economic evaluation can be viewed as an institution to overcome societal conflicts in the allocation of scarce health care resources. For this, the problem of allocating scarce health care resources in a society is reconstructed as a social dilemma. Both disadvantaged patients and affluent healthy individuals can be argued to share interests in a societal contract to provide technologies which ameliorate medical need, based on progressive funding. The use of needs-based economic evaluation methods for coverage determination can be interpreted as institutions for conflict resolution as far as they use consented criteria to ensure the social contract's sustainability and avoid implicit rationing or unaffordable contribution rates. This justifies the use of needs-based evaluation methods by Pareto-superiority and consent (rather than by some needs-based value function per se). The view of economic evaluation presented here may help account for fairness concerns in the further development of evaluation methods. This is because it directs the attention away from determining some unit of value to be maximized towards determining those persons who are most likely not to consent and meeting their concerns. Following this direction in methods development is

Systematic evaluation program. Status report and initial evaluation

International Nuclear Information System (INIS)

1983-06-01

The MHB Ongoing Systematic Evaluation Program (SEP) Assessment Study was initiated by the Swedish Nuclear Power Inspectorate (SKI) in 1980. This MHB report is a status report and initial evaluation of SEP. The methodology and results of SEP are disscused with particular emphasis on the first two SEP plant reviews - the Palisades and R.E. Ginna nuclear power plants. The comments of cognizant persons in the NRC and the ACRS, as well as private consultants, are included herein. MHBs major findings are as follows: The SEP plant review methodology was acceptable to the NRC Commissioners, the ACRS, and the NRC Staffs consultants who evaluated the first two SEP plant reviews. A concern raised by all who commented on SEP was the absence of Three Mile Island Action Plan Items and Unresolved Safety Issues from current SEP reviews. The SEP reviews of the Palisades and R.E. Ginna plants concluded that the two plant designs were adequate with respect to a majority of safety topics. Several topics remain unresolved in both the Palisades and R.E. Ginna SEP reviews. In the case of the Ginna plant, several related topics have been grouped together in a major structural reevaluation study. In general, due to the number of unresolved and excluded topics, SEP has not at this time produced a plant safety evaluation which can be considered complete and integrated. (author)

Navigating Theory and Practice through Evaluation Fieldwork: Experiences of Novice Evaluation Practitioners

Science.gov (United States)

Chouinard, Jill Anne; Boyce, Ayesha S.; Hicks, Juanita; Jones, Jennie; Long, Justin; Pitts, Robyn; Stockdale, Myrah

2017-01-01

To explore the relationship between theory and practice in evaluation, we focus on the perspectives and experiences of student evaluators, as they move from the classroom to an engagement with the social, political, and cultural dynamics of evaluation in the field. Through reflective journals, postcourse interviews, and facilitated group…

Is evaluating complementary and alternative medicine equivalent to evaluating the absurd?

Science.gov (United States)

Greasley, Pete

2010-06-01

Complementary and alternative therapies such as reflexology and acupuncture have been the subject of numerous evaluations, clinical trials, and systematic reviews, yet the empirical evidence in support of their efficacy remains equivocal. The empirical evaluation of a therapy would normally assume a plausible rationale regarding the mechanism of action. However, examination of the historical background and underlying principles for reflexology, iridology, acupuncture, auricular acupuncture, and some herbal medicines, reveals a rationale founded on the principle of analogical correspondences, which is a common basis for magical thinking and pseudoscientific beliefs such as astrology and chiromancy. Where this is the case, it is suggested that subjecting these therapies to empirical evaluation may be tantamount to evaluating the absurd.

Evaluation matters: lessons learned on the evaluation of surgical teaching.

Science.gov (United States)

Woods, Nicole N

2011-01-01

The traditional system of academic promotion and tenure can make it difficult to reward those who excel at surgical teaching. A successful faculty evaluation process can provide the objective measures of teaching performance needed for performance appraisals and promotion decisions. Over the course of two decades, an extensive faculty evaluation process has been developed in the Department of Surgery at the University of Toronto. This paper presents some of the non-psychometric characteristics of that system. Faculty awareness of the evaluation process, the consistency of its application, trainee anonymity and the materiality of the results are described key factors of a faculty evaluation system that meets the assessment needs of individual teachers and raises the profile of teaching in surgical departments. Copyright © 2010 Royal College of Surgeons of Edinburgh (Scottish charity number SC005317) and Royal College of Surgeons in Ireland. Published by Elsevier Ltd. All rights reserved.

Study on team evaluation. Team process model for team evaluation

International Nuclear Information System (INIS)

Sasou Kunihide; Ebisu, Mitsuhiro; Hirose, Ayako

2004-01-01

Several studies have been done to evaluate or improve team performance in nuclear and aviation industries. Crew resource management is the typical example. In addition, team evaluation recently gathers interests in other teams of lawyers, medical staff, accountants, psychiatrics, executive, etc. However, the most evaluation methods focus on the results of team behavior that can be observed through training or actual business situations. What is expected team is not only resolving problems but also training younger members being destined to lead the next generation. Therefore, the authors set the final goal of this study establishing a series of methods to evaluate and improve teams inclusively such as decision making, motivation, staffing, etc. As the first step, this study develops team process model describing viewpoints for the evaluation. The team process is defined as some kinds of power that activate or inactivate competency of individuals that is the components of team's competency. To find the team process, the authors discussed the merits of team behavior with the experienced training instructors and shift supervisors of nuclear/thermal power plants. The discussion finds four team merits and many components to realize those team merits. Classifying those components into eight groups of team processes such as 'Orientation', 'Decision Making', 'Power and Responsibility', 'Workload Management', 'Professional Trust', 'Motivation', 'Training' and 'staffing', the authors propose Team Process Model with two to four sub processes in each team process. In the future, the authors will develop methods to evaluate some of the team processes for nuclear/thermal power plant operation teams. (author)

STRUCTURED CLINICAL EVALUATION

Directory of Open Access Journals (Sweden)

Arabela Maria Barbosa Sampaio

2014-05-01

Full Text Available In a world experiencing profound technological and socio-political changes in areas of knowledge and capacity, healthcare can not remain static. A new kind of professional is required, whose practice is based on ethics, scientific standards, integrity, citizenship, and health promotion, who develops skills beyond healthcare, such as decision making, communication,leadership, management, and continuing education. No single method can assess all of these elements (knowledge, skills, and attitudes, and only a combination of methods is able to produce a valid evaluation. An alternative method exists: structured clinical assessments based on observation of "to do, or how to do" that aim to complete this evaluation by focusing attention on the performance of specific skills. In order to broaden the scope of evaluation methods that have been used in health education, this article, a literature review, intends to offer readers an overview of the diverse types of structured clinical evaluation, emphasizing Objective Structured Clinical Examination, the most widely used in Brazil, with a goal of advancing opportunities for health professionals to make use of this evaluative tool.

Evaluating a federated medical search engine: tailoring the methodology and reporting the evaluation outcomes.

Science.gov (United States)

Saparova, D; Belden, J; Williams, J; Richardson, B; Schuster, K

2014-01-01

Federated medical search engines are health information systems that provide a single access point to different types of information. Their efficiency as clinical decision support tools has been demonstrated through numerous evaluations. Despite their rigor, very few of these studies report holistic evaluations of medical search engines and even fewer base their evaluations on existing evaluation frameworks. To evaluate a federated medical search engine, MedSocket, for its potential net benefits in an established clinical setting. This study applied the Human, Organization, and Technology (HOT-fit) evaluation framework in order to evaluate MedSocket. The hierarchical structure of the HOT-factors allowed for identification of a combination of efficiency metrics. Human fit was evaluated through user satisfaction and patterns of system use; technology fit was evaluated through the measurements of time-on-task and the accuracy of the found answers; and organization fit was evaluated from the perspective of system fit to the existing organizational structure. Evaluations produced mixed results and suggested several opportunities for system improvement. On average, participants were satisfied with MedSocket searches and confident in the accuracy of retrieved answers. However, MedSocket did not meet participants' expectations in terms of download speed, access to information, and relevance of the search results. These mixed results made it necessary to conclude that in the case of MedSocket, technology fit had a significant influence on the human and organization fit. Hence, improving technological capabilities of the system is critical before its net benefits can become noticeable. The HOT-fit evaluation framework was instrumental in tailoring the methodology for conducting a comprehensive evaluation of the search engine. Such multidimensional evaluation of the search engine resulted in recommendations for system improvement.

Smartphone-based evaluations of clinical placements—a useful complement to web-based evaluation tools

Directory of Open Access Journals (Sweden)

Jesper Hessius

2015-11-01

Full Text Available Purpose: Web-based questionnaires are currently the standard method for course evaluations. The high rate of smartphone adoption in Sweden makes possible a range of new uses, including course evaluation. This study examines the potential advantages and disadvantages of using a smartphone app as a complement to web-based course evaluationsystems. Methods: An iPhone app for course evaluations was developed and interfaced to an existing web-based tool. Evaluations submitted using the app were compared with those submitted using the web between August 2012 and June 2013, at the Faculty of Medicine at Uppsala University, Sweden. Results: At the time of the study, 49% of the students were judged to own iPhones. Over the course of the study, 3,340 evaluations were submitted, of which 22.8% were submitted using the app. The median of mean scores in the submitted evaluations was 4.50 for the app (with an interquartile range of 3.70-5.20 and 4.60 (3.70-5.20 for the web (P=0.24. The proportion of evaluations that included a free-text comment was 50.5% for the app and 49.9% for the web (P=0.80. Conclusion: An app introduced as a complement to a web-based course evaluation system met with rapid adoption. We found no difference in the frequency of free-text comments or in the evaluation scores. Apps appear to be promising tools for course evaluations. web-based course evaluation system met with rapid adoption. We found no difference in the frequency of free-text comments or in the evaluation scores. Apps appear to be promising tools for course evaluations.

Smartphone-based evaluations of clinical placements-a useful complement to web-based evaluation tools.

Science.gov (United States)

Hessius, Jesper; Johansson, Jakob

2015-01-01

Web-based questionnaires are currently the standard method for course evaluations. The high rate of smartphone adoption in Sweden makes possible a range of new uses, including course evaluation. This study examines the potential advantages and disadvantages of using a smartphone app as a complement to web-based course evaluationsystems. An iPhone app for course evaluations was developed and interfaced to an existing web-based tool. Evaluations submitted using the app were compared with those submitted using the web between August 2012 and June 2013, at the Faculty of Medicine at Uppsala University, Sweden. At the time of the study, 49% of the students were judged to own iPhones. Over the course of the study, 3,340 evaluations were submitted, of which 22.8% were submitted using the app. The median of mean scores in the submitted evaluations was 4.50 for the app (with an interquartile range of 3.70-5.20) and 4.60 (3.70-5.20) for the web (P=0.24). The proportion of evaluations that included a free-text comment was 50.5% for the app and 49.9% for the web (P=0.80). An app introduced as a complement to a web-based course evaluation system met with rapid adoption. We found no difference in the frequency of free-text comments or in the evaluation scores. Apps appear to be promising tools for course evaluations. web-based course evaluation system met with rapid adoption. We found no difference in the frequency of free-text comments or in the evaluation scores. Apps appear to be promising tools for course evaluations.

Covariance evaluation system

International Nuclear Information System (INIS)

Kawano, Toshihiko; Shibata, Keiichi.

1997-09-01

A covariance evaluation system for the evaluated nuclear data library was established. The parameter estimation method and the least squares method with a spline function are used to generate the covariance data. Uncertainties of nuclear reaction model parameters are estimated from experimental data uncertainties, then the covariance of the evaluated cross sections is calculated by means of error propagation. Computer programs ELIESE-3, EGNASH4, ECIS, and CASTHY are used. Covariances of 238 U reaction cross sections were calculated with this system. (author)

The DLESE Evaluation Toolkit Project

Science.gov (United States)

Buhr, S. M.; Barker, L. J.; Marlino, M.

2002-12-01

The Evaluation Toolkit and Community project is a new Digital Library for Earth System Education (DLESE) collection designed to raise awareness of project evaluation within the geoscience education community, and to enable principal investigators, teachers, and evaluators to implement project evaluation more readily. This new resource is grounded in the needs of geoscience educators, and will provide a virtual home for a geoscience education evaluation community. The goals of the project are to 1) provide a robust collection of evaluation resources useful for Earth systems educators, 2) establish a forum and community for evaluation dialogue within DLESE, and 3) disseminate the resources through the DLESE infrastructure and through professional society workshops and proceedings. Collaboration and expertise in education, geoscience and evaluation are necessary if we are to conduct the best possible geoscience education. The Toolkit allows users to engage in evaluation at whichever level best suits their needs, get more evaluation professional development if desired, and access the expertise of other segments of the community. To date, a test web site has been built and populated, initial community feedback from the DLESE and broader community is being garnered, and we have begun to heighten awareness of geoscience education evaluation within our community. The web site contains features that allow users to access professional development about evaluation, search and find evaluation resources, submit resources, find or offer evaluation services, sign up for upcoming workshops, take the user survey, and submit calendar items. The evaluation resource matrix currently contains resources that have met our initial review. The resources are currently organized by type; they will become searchable on multiple dimensions of project type, audience, objectives and evaluation resource type as efforts to develop a collection-specific search engine mature. The peer review

Which Way Is Better for Teacher Evaluation? The Discourse on Teacher Evaluation in Taiwan

Science.gov (United States)

Wang, Juei-Hsin; Chen, Yen-Ting

2016-01-01

There are no summative evaluations for compulsory and basic education in Taiwan. This research discusses and analyzes present teacher evaluation implementation. The implementation of policy nowadays means "Teacher evaluation for professional development". Teacher evaluation for professional development is a voluntary growing project of…

Evaluation Guide for the Evaluated Spent Nuclear Fuel Assay Database (SFCOMPO)

International Nuclear Information System (INIS)

Ortego, P.; Boulanger, D.; Gauld, I.; Gysemans, M.; Hennebach, M.; Mennerdahl, D.; Neuber, J.C.; Tore, C.; Tittelbach, S.; Van Winckel, S.; Zwicky, H.-U.

2016-01-01

The Expert Group on Assay Data for Spent Nuclear Fuel (EGADSNF) of the Working Party on Nuclear Criticality Safety (WPNCS) under the auspices of the NEA Nuclear Science Committee was set up in 2007 with the objective of compiling and evaluating experimental data on the nuclide compositions of irradiated nuclear fuel. Experimental data refer not only to the measured nuclide inventories and uncertainties as determined mainly by destructive radiochemical assay of spent fuel samples, but also the fuel assembly design data, reactor design information, and operating data necessary to develop benchmark models. These data provide an important basis for validating calculation methods (computer codes and nuclear data) used in fuel burn-up analyses applied to spent fuel criticality safety analyses using burnup credit, thermal analysis, radiation shielding, accident dose consequence analysis, fuel cycle safety, reprocessing, and deep geological repository safety studies. The quality and usefulness of the experimental data for methods validation can be improved by developing complete descriptions of the experiments, providing benchmark specifications, and by performing independent evaluations of the experimental and benchmark data. Evaluations of the experimental data have been identified as an important task to verify the quality of the information in the spent fuel composition (SFCOMPO) database maintained by the Nuclear Energy Agency (NEA) Data Bank. This guide defines the evaluation document format and data review procedures for evaluators tasked with reviewing the experimental data. Guidance is developed to provide recommended procedures and criteria developed by experts in the field on how to perform standardised reviews, how to identify potential problems in the measurement data and gaps in the experimental description, and provide guidance on how to resolve these issues, when possible, using a consistent technical basis. Procedures for deriving benchmark data and models

Age Differences in Voice Evaluation: From Auditory-Perceptual Evaluation to Social Interactions

Science.gov (United States)

Lortie, Catherine L.; Deschamps, Isabelle; Guitton, Matthieu J.; Tremblay, Pascale

2018-01-01

Purpose: The factors that influence the evaluation of voice in adulthood, as well as the consequences of such evaluation on social interactions, are not well understood. Here, we examined the effect of listeners' age and the effect of talker age, sex, and smoking status on the auditory-perceptual evaluation of voice, voice-related psychosocial…

Definitions of Evaluation Use and Misuse, Evaluation Influence, and Factors Affecting Use

Science.gov (United States)

Alkin, Marvin C.; King, Jean A.

2017-01-01

The second article in this series on the history of evaluation use has three sections. The first and longest develops a functional definition of the term "use," noting that a thorough definition of evaluation use includes the initial stimulus (i.e., evaluation findings or process), the user, the way people use the information, the aspect…

Type-Directed Partial Evaluation

DEFF Research Database (Denmark)

Danvy, Olivier

1998-01-01

Type-directed partial evaluation uses a normalization function to achieve partial evaluation. These lecture notes review its background, foundations, practice, and applications. Of specific interest is the modular technique of offline and online type-directed partial evaluation in Standard ML...

Type-Directed Partial Evaluation

DEFF Research Database (Denmark)

Danvy, Olivier

1998-01-01

Type-directed partial evaluation uses a normalization function to achieve partial evaluation. These lecture notes review its background, foundations, practice, and applications. Of specific interest is the modular technique of offline and online type-directed partial evaluation in Standard ML of ...

40 CFR 57.502 - Evaluation.

Science.gov (United States)

2010-07-01

... 40 Protection of Environment 5 2010-07-01 2010-07-01 false Evaluation. 57.502 Section 57.502... NONFERROUS SMELTER ORDERS Fugitive Emission Evaluation and Control § 57.502 Evaluation. (a) Evaluation at the... their effects upon ambient air quality. (b) Evaluation during the first 6 months of the NSO. The design...

Mini-clinical evaluation exercise til evaluering af kommunikation og samarbejde i ambulatoriet

DEFF Research Database (Denmark)

Eriksen, Jesper Grau; Simonsen, Dorit; Bastholt, Lars

2009-01-01

INTRODUCTION: In the revised Danish medical specialist training increased focus has been placed on competences which are hard to evaluate such as communication skills. Mini-CEX seems promising as an evaluation tool. Our aim was to test: 1) whether mini-CEX was useable in the evaluation...... of communicative and cooperative skills and 2) whether mini-CEX would provide reproducible data. MATERIAL AND METHODS: Twenty-one residents were evaluated by mini-CEX by trained observers. Seventeen residents had at least two observations within a short period of time and these data were used to estimate the mini...

40 CFR 63.2354 - What performance tests, design evaluations, and performance evaluations must I conduct?

Science.gov (United States)

2010-07-01

... evaluations, and performance evaluations must I conduct? 63.2354 Section 63.2354 Protection of Environment... tests, design evaluations, and performance evaluations must I conduct? (a)(1) For each performance test... procedures specified in subpart SS of this part. (3) For each performance evaluation of a continuous emission...

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

Language of Evaluation: How PLA Evaluators Write about Student Learning

Science.gov (United States)

Travers, Nan L.; Smith, Bernard; Ellis, Leslie; Brady, Tom; Feldman, Liza; Hakim, Kameyla; Onta, Bhuwan; Panayotou, Maria; Seamans, Laurie; Treadwell, Amanda

2011-01-01

Very few studies (e.g., Arnold, 1998; Joosten-ten Brinke, et al., 2009) have examined the ways in which evaluators assess students' prior learning. This investigation explored the ways that evaluators described students' prior learning in final assessment reports at a single, multiple-location institution. Results found four themes; audience,…

Disposal systems evaluations and tool development : Engineered Barrier System (EBS) evaluation.

Energy Technology Data Exchange (ETDEWEB)

Rutqvist, Jonny (LBNL); Liu, Hui-Hai (LBNL); Steefel, Carl I. (LBNL); Serrano de Caro, M. A. (LLNL); Caporuscio, Florie Andre (LANL); Birkholzer, Jens T. (LBNL); Blink, James A. (LLNL); Sutton, Mark A. (LLNL); Xu, Hongwu (LANL); Buscheck, Thomas A. (LLNL); Levy, Schon S. (LANL); Tsang, Chin-Fu (LBNL); Sonnenthal, Eric (LBNL); Halsey, William G. (LLNL); Jove-Colon, Carlos F.; Wolery, Thomas J. (LLNL)

2011-01-01

Key components of the nuclear fuel cycle are short-term storage and long-term disposal of nuclear waste. The latter encompasses the immobilization of used nuclear fuel (UNF) and radioactive waste streams generated by various phases of the nuclear fuel cycle, and the safe and permanent disposition of these waste forms in geological repository environments. The engineered barrier system (EBS) plays a very important role in the long-term isolation of nuclear waste in geological repository environments. EBS concepts and their interactions with the natural barrier are inherently important to the long-term performance assessment of the safety case where nuclear waste disposition needs to be evaluated for time periods of up to one million years. Making the safety case needed in the decision-making process for the recommendation and the eventual embracement of a disposal system concept requires a multi-faceted integration of knowledge and evidence-gathering to demonstrate the required confidence level in a deep geological disposal site and to evaluate long-term repository performance. The focus of this report is the following: (1) Evaluation of EBS in long-term disposal systems in deep geologic environments with emphasis on the multi-barrier concept; (2) Evaluation of key parameters in the characterization of EBS performance; (3) Identification of key knowledge gaps and uncertainties; and (4) Evaluation of tools and modeling approaches for EBS processes and performance. The above topics will be evaluated through the analysis of the following: (1) Overview of EBS concepts for various NW disposal systems; (2) Natural and man-made analogs, room chemistry, hydrochemistry of deep subsurface environments, and EBS material stability in near-field environments; (3) Reactive Transport and Coupled Thermal-Hydrological-Mechanical-Chemical (THMC) processes in EBS; and (4) Thermal analysis toolkit, metallic barrier degradation mode survey, and development of a Disposal Systems

Disposal systems evaluations and tool development: Engineered Barrier System (EBS) evaluation

International Nuclear Information System (INIS)

Rutqvist, Jonny; Liu, Hui-Hai; Steefel, Carl I.; Serrano de Caro, M.A.; Caporuscio, Florie Andre; Birkholzer, Jens T.; Blink, James A.; Sutton, Mark A.; Xu, Hongwu; Buscheck, Thomas A.; Levy, Schon S.; Tsang, Chin-Fu; Sonnenthal, Eric; Halsey, William G.; Jove-Colon, Carlos F.; Wolery, Thomas J.

2011-01-01

Key components of the nuclear fuel cycle are short-term storage and long-term disposal of nuclear waste. The latter encompasses the immobilization of used nuclear fuel (UNF) and radioactive waste streams generated by various phases of the nuclear fuel cycle, and the safe and permanent disposition of these waste forms in geological repository environments. The engineered barrier system (EBS) plays a very important role in the long-term isolation of nuclear waste in geological repository environments. EBS concepts and their interactions with the natural barrier are inherently important to the long-term performance assessment of the safety case where nuclear waste disposition needs to be evaluated for time periods of up to one million years. Making the safety case needed in the decision-making process for the recommendation and the eventual embracement of a disposal system concept requires a multi-faceted integration of knowledge and evidence-gathering to demonstrate the required confidence level in a deep geological disposal site and to evaluate long-term repository performance. The focus of this report is the following: (1) Evaluation of EBS in long-term disposal systems in deep geologic environments with emphasis on the multi-barrier concept; (2) Evaluation of key parameters in the characterization of EBS performance; (3) Identification of key knowledge gaps and uncertainties; and (4) Evaluation of tools and modeling approaches for EBS processes and performance. The above topics will be evaluated through the analysis of the following: (1) Overview of EBS concepts for various NW disposal systems; (2) Natural and man-made analogs, room chemistry, hydrochemistry of deep subsurface environments, and EBS material stability in near-field environments; (3) Reactive Transport and Coupled Thermal-Hydrological-Mechanical-Chemical (THMC) processes in EBS; and (4) Thermal analysis toolkit, metallic barrier degradation mode survey, and development of a Disposal Systems

Distributed usability evaluation

DEFF Research Database (Denmark)

Christensen, Lars; Frøkjær, Erik

2010-01-01

We present DUE (Distributed Usability Evaluation), a technique for collecting and evaluating usability data. The DUE infrastructure involves a client-server network. A client-based tool resides on the workstation of each user, providing a screen video recording, microphone input of voice commentary......, and a window for a severity rating. The idea is for the user to work naturalistically, clicking a button when a usability problem or point of uncertainty is encountered, to describe it verbally along with illustrating it on screen, and to rate its severity. These incidents are accumulated on a server......, providing access to an evaluator (usability expert) and to product developers or managers who want to review the incidents and analyse them. DUE supports evaluation in the development stages from running prototypes and onwards. A case study of the use of DUE in a corporate environment is presented...

A Guidebook for Evaluating Organizations in the Nuclear Industry - an example of safety culture evaluation

International Nuclear Information System (INIS)

Oedewald, Pia; Pietikaeinen, Elina; Reiman, Teemu

2011-06-01

Organizations in the nuclear industry need to maintain an overview on their vulnerabilities and strengths with respect to safety. Systematic periodical self assessments are necessary to achieve this overview. This guidebook provides suggestions and examples to assist power companies but also external evaluators and regulators in carrying out organizational evaluations. Organizational evaluation process is divided into five main steps. These are: 1) planning the evaluation framework and the practicalities of the evaluation process, 2) selecting data collection methods and conducting the data acquisition, 3) structuring and analysing the data, 4) interpreting the findings and 5) reporting the evaluation results with possible recommendations. The guidebook emphasises the importance of a solid background framework when dealing with multifaceted phenomena like organisational activities and system safety. The validity and credibility of the evaluation stem largely from the evaluation team's ability to crystallize what they mean by organization and safety when they conduct organisational safety evaluations - and thus, what are the criteria for the evaluation. Another important and often under-considered phase in organizational evaluation is interpretation of the findings. In this guidebook a safety culture evaluation in a Nordic nuclear power plant is presented as an example of organizational evaluation. With the help of the example, challenges of each step in the organizational evaluation process are described. Suggestions for dealing with them are presented. In the case example, the DISC (Design for Integrated Safety culture) model is used as the evaluation framework. The DISC model describes the criteria for a good safety culture and the organizational functions necessary to develop a good safety culture in the organization

Evaluating music emotion recognition

DEFF Research Database (Denmark)

Sturm, Bob L.

2013-01-01

A fundamental problem with nearly all work in music genre recognition (MGR)is that evaluation lacks validity with respect to the principal goals of MGR. This problem also occurs in the evaluation of music emotion recognition (MER). Standard approaches to evaluation, though easy to implement, do...... not reliably differentiate between recognizing genre or emotion from music, or by virtue of confounding factors in signals (e.g., equalization). We demonstrate such problems for evaluating an MER system, and conclude with recommendations....

The IIR evaluation model

DEFF Research Database (Denmark)

Borlund, Pia

2003-01-01

An alternative approach to evaluation of interactive information retrieval (IIR) systems, referred to as the IIR evaluation model, is proposed. The model provides a framework for the collection and analysis of IR interaction data. The aim of the model is two-fold: 1) to facilitate the evaluation ...

Evaluating meeting support tools

NARCIS (Netherlands)

Post, W.M.; Huis in't Veld, M.A.A.; Boogaard, S.A.A. van den

2008-01-01

Many attempts are underway for developing meeting support tools, but less attention is paid to the evaluation of meetingware. This article describes the development and testing of an instrument for evaluating meeting tools. First, we specified the object of evaluation - meetings - by means of a set

Evaluating meeting support tools

NARCIS (Netherlands)

Post, W.M.; Huis in 't Veld, M. M.A.; Boogaard, S.A.A. van den

2007-01-01

Many attempts are underway for developing meeting support tools, but less attention is paid to the evaluation of meetingware. This article describes the development and testing of an instrument for evaluating meeting tools. First, we specified the object of evaluation -meetings- by means of a set of

Evaluation, Language, and Untranslatables

Science.gov (United States)

Dahler-Larsen, Peter; Abma, Tineke; Bustelo, María; Irimia, Roxana; Kosunen, Sonja; Kravchuk, Iryna; Minina, Elena; Segerholm, Christina; Shiroma, Eneida; Stame, Nicoletta; Tshali, Charlie Kabanga

2017-01-01

The issue of translatability is pressing in international evaluation, in global transfer of evaluative instruments, in comparative performance management, and in culturally responsive evaluation. Terms that are never fully understood, digested, or accepted may continue to influence issues, problems, and social interactions in and around and after…

Learning while evaluating: the use of an electronic evaluation portfolio in a geriatric medicine clerkship

Science.gov (United States)

Duque, Gustavo; Finkelstein, Adam; Roberts, Ayanna; Tabatabai, Diana; Gold, Susan L; Winer, Laura R

2006-01-01

Background Electronic evaluation portfolios may play a role in learning and evaluation in clinical settings and may complement other traditional evaluation methods (bedside evaluations, written exams and tutor-led evaluations). Methods 133 third-year medical students used the McGill Electronic Evaluation Portfolio (MEEP) during their one-month clerkship rotation in Geriatric Medicine between September 2002 and September 2003. Students were divided into two groups, one who received an introductory hands-on session about the electronic evaluation portfolio and one who did not. Students' marks in their portfolios were compared between both groups. Additionally, students self-evaluated their performance and received feedback using the electronic portfolio during their mandatory clerkship rotation. Students were surveyed immediately after the rotation and at the end of the clerkship year. Tutors' opinions about this method were surveyed once. Finally, the number of evaluations/month was quantified. In all surveys, Likert scales were used and were analyzed using Chi-square tests and t-tests to assess significant differences in the responses from surveyed subjects. Results The introductory session had a significant effect on students' portfolio marks as well as on their comfort using the system. Both tutors and students reported positive notions about the method. Remarkably, an average (± SD) of 520 (± 70) evaluations/month was recorded with 30 (± 5) evaluations per student/month. Conclusion The MEEP showed a significant and positive effect on both students' self-evaluations and tutors' evaluations involving an important amount of self-reflection and feedback which may complement the more traditional evaluation methods. PMID:16409640

An Evaluation Framework and Instrument for Evaluating e-Assessment Tools

Science.gov (United States)

Singh, Upasana Gitanjali; de Villiers, Mary Ruth

2017-01-01

e-Assessment, in the form of tools and systems that deliver and administer multiple choice questions (MCQs), is used increasingly, raising the need for evaluation and validation of such systems. This research uses literature and a series of six empirical action research studies to develop an evaluation framework of categories and criteria called…

Evaluation report no.1; Rapport d`evaluation no.1

Energy Technology Data Exchange (ETDEWEB)

NONE

1995-06-01

This document, which is the first evaluation report from the French National Evaluation Commission about research on radioactive waste management, was sent to the French Government on June 30, 1995. The Commission was created in January 1994 and started its investigations on April 1994. The evaluation concerns the three axes of the 91-1381 law from December 30, 1991 (1 - separation-transmutation and minimization of wastes, 2 - underground disposal, 3 - choices for conditioning, storage and disposal). The document has been written after hearing of the principal French research organisms. The report focusses on the necessity for a scientific and technical coordination between all the organisms concerned, for a consistent and open analysis of all research topics. This implies a compatibility between schedules and specifications, and with the 15 years allowed by the law. (J.S.). 15 figs., 14 tabs., 4 annexes., 1 glossary.

Self-Evaluation

DEFF Research Database (Denmark)

Simonsen, Jesper

This self-evaluation report, requested by the Pro-rector of Roskilde University, has been written by Jesper Simonsen. The report is presented in a dedicated template and describes and evaluates the strategic research initiative Designing Human Technologies (DHT). DHT was formally approved...... by the Rectorship in February 2013. DHT was funded by Roskilde University with a 3,000,000 DKK grant for the period of 2013– 2015. In 2015 this was extended to June 2016....

Textbooks evaluation

OpenAIRE

Tauchmannová, Iva

2009-01-01

This thesis deals with an evaluation of textbooks and their operation at school. The theoretical part clarifies the purport of the term a textbook, functions and a structure of textbooks, and describes a text of textbooks, parameters of its evaluation, and the extratextual components of textbooks. It presents methods of work with a textbook and research into textbooks. The empirical part describes a research that was aimed to learn whether textbooks fit to modern parameters of textbooks. Furt...

Empowerment evaluation: a collaborative approach to evaluating and transforming a medical school curriculum.

Science.gov (United States)

Fetterman, David M; Deitz, Jennifer; Gesundheit, Neil

2010-05-01

Medical schools continually evolve their curricula to keep students abreast of advances in basic, translational, and clinical sciences. To provide feedback to educators, critical evaluation of the effectiveness of these curricular changes is necessary. This article describes a method of curriculum evaluation, called "empowerment evaluation," that is new to medical education. It mirrors the increasingly collaborative culture of medical education and offers tools to enhance the faculty's teaching experience and students' learning environments. Empowerment evaluation provides a method for gathering, analyzing, and sharing data about a program and its outcomes and encourages faculty, students, and support personnel to actively participate in system changes. It assumes that the more closely stakeholders are involved in reflecting on evaluation findings, the more likely they are to take ownership of the results and to guide curricular decision making and reform. The steps of empowerment evaluation include collecting evaluation data, designating a "critical friend" to communicate areas of potential improvement, establishing a culture of evidence, encouraging a cycle of reflection and action, cultivating a community of learners, and developing reflective educational practitioners. This article illustrates how stakeholders used the principles of empowerment evaluation to facilitate yearly cycles of improvement at the Stanford University School of Medicine, which implemented a major curriculum reform in 2003-2004. The use of empowerment evaluation concepts and tools fostered greater institutional self-reflection, led to an evidence-based model of decision making, and expanded opportunities for students, faculty, and support staff to work collaboratively to improve and refine the medical school's curriculum.

Validity in Qualitative Evaluation

Directory of Open Access Journals (Sweden)

Vasco Lub

2015-12-01

Full Text Available This article provides a discussion on the question of validity in qualitative evaluation. Although validity in qualitative inquiry has been widely reflected upon in the methodological literature (and is still often subject of debate, the link with evaluation research is underexplored. Elaborating on epistemological and theoretical conceptualizations by Guba and Lincoln and Creswell and Miller, the article explores aspects of validity of qualitative research with the explicit objective of connecting them with aspects of evaluation in social policy. It argues that different purposes of qualitative evaluations can be linked with different scientific paradigms and perspectives, thus transcending unproductive paradigmatic divisions as well as providing a flexible yet rigorous validity framework for researchers and reviewers of qualitative evaluations.

Usage of performance measurement and evaluation systems : the impact of evaluator characteristics

OpenAIRE

Gelderman, Maarten

1998-01-01

This paper discusses the relation between characteristics of the evaluating manager and the way performance measurement and evaluation information is used. First a discussion is provided about the dependent variable. It is recognized that categorization into archetypes (e.g., evaluative styles) is unsatisfactory. Instead the information content/emphasis dimensions financial-non- financial, quantitative-qualitative, process-outcome, past-future and external-internal, along with the dimension f...

Evaluating professional development

CERN Document Server

Guskey, Thomas R

2000-01-01

This is a practical guide to evaluating professional development programs at five increasing levels of sophistication: participants' reaction to professional development; how much participants learned; evaluating organizational support and change; how participants use their new knowledge and skills; and improvements in student learning.

"System evaluates system": method for evaluating the efficiency of IS

Directory of Open Access Journals (Sweden)

Dita Blazkova

2016-10-01

Full Text Available In paper I deal with the possible solution of evaluating the efficiency of information systems in companies. The large number of existing methods used to address the efficiency of information systems is dependent on the subjective responses of the user that may distort output evaluation. Therefore, I propose a method that eliminates the subjective opinion of a user as the primary data source. Applications, which I suggests as part of the method, collects relevant data. In this paper I describe the application in detail. This is a follow-on program on any system that runs parallel with it. The program automatically collects data for evaluation. Data include mainly time data, positions the mouse cursor, printScreens, i-grams of previous, etc. I propose a method of evaluation of the data, which identifies the degree of the friendliness of the information system to the user. Thus, the output of the method is the conclusion whether users, who work with the information system, can handle effectively work with it.

Empowerment Evaluation: Yesterday, Today, and Tomorrow

Science.gov (United States)

Fetterman, David; Wandersman, Abraham

2007-01-01

Empowerment evaluation continues to crystallize central issues for evaluators and the field of evaluation. A highly attended American Evaluation Association conference panel, titled "Empowerment Evaluation and Traditional Evaluation: 10 Years Later," provided an opportunity to reflect on the evolution of empowerment evaluation. Several…

CAPTURED India Country Evaluation

NARCIS (Netherlands)

O'Donoghue, R.; Brouwers, J.H.A.M.

2012-01-01

This report provides the findings of the India Country Evaluation and is produced as part of the overall CAPTURED End Evaluation. After five years of support by the CAPTURED project the End Evaluation has assessed that results are commendable. I-AIM was able to design an approach in which health

A Fuzzy Comprehensive Evaluation Model for Sustainability Risk Evaluation of PPP Projects

Directory of Open Access Journals (Sweden)

Libiao Bai

2017-10-01

Full Text Available Evaluating the sustainability risk level of public–private partnership (PPP projects can reduce project risk incidents and achieve the sustainable development of the organization. However, the existing studies about PPP projects risk management mainly focus on exploring the impact of financial and revenue risks but ignore the sustainability risks, causing the concept of “sustainability” to be missing while evaluating the risk level of PPP projects. To evaluate the sustainability risk level and achieve the most important objective of providing a reference for the public and private sectors when making decisions on PPP project management, this paper constructs a factor system of sustainability risk of PPP projects based on an extensive literature review and develops a mathematical model based on the methods of fuzzy comprehensive evaluation model (FCEM and failure mode, effects and criticality analysis (FMECA for evaluating the sustainability risk level of PPP projects. In addition, this paper conducts computational experiment based on a questionnaire survey to verify the effectiveness and feasibility of this proposed model. The results suggest that this model is reasonable for evaluating the sustainability risk level of PPP projects. To our knowledge, this paper is the first study to evaluate the sustainability risk of PPP projects, which would not only enrich the theories of project risk management, but also serve as a reference for the public and private sectors for the sustainable planning and development. Keywords: sustainability risk eva

Proactively evaluating training effectiveness

International Nuclear Information System (INIS)

Fetterman, Harry E.

2003-01-01

A common model of the five phase Systematic Approach to Training (SAT) displays the fifth phase, evaluation, feeding back into the previous four phases: analysis, design, development, and implementation. Evaluating training effectiveness in PP and L's Nuclear Department is not simply the fifth phase of the SAT. PP and L has demonstrated a more effective methodology is realized when evaluation is built into each of the other four phases. At PP and L, evaluation is conducted formatively throughout the first four phases of the SAT process and summatively after implementation. (author)

Evaluated nuclear data library

International Nuclear Information System (INIS)

Howerton, R.J.; Dye, R.E.; Perkins, S.T.

1981-01-01

The Lawrence Livermore National Laboratory (LLNL) collection of evaluated data for neutron-, photon-, and charged-particle-induced reactions is maintained in a computer-oriented system. In this report we recount the history of Evaluated Nuclear Data Library, describe the methods of evaluation, and give examples of input and output representation of the data

Transport Project Evaluation

DEFF Research Database (Denmark)

Leleur, Steen

1996-01-01

Two main project evaluation approaches exist: cost-benefit analysis (CBA) and multi-criteria analysis (MCA). Related to a European road evaluation method (EURET 1.1) and the MCA-method, WARP, the paper proposes a set of so-called segregated investment return rates (SIRR) to integrate advantages...

Evaluating energy saving system of data centers based on AHP and fuzzy comprehensive evaluation model

Science.gov (United States)

Jiang, Yingni

2018-03-01

Due to the high energy consumption of communication, energy saving of data centers must be enforced. But the lack of evaluation mechanisms has restrained the process on energy saving construction of data centers. In this paper, energy saving evaluation index system of data centers was constructed on the basis of clarifying the influence factors. Based on the evaluation index system, analytical hierarchy process was used to determine the weights of the evaluation indexes. Subsequently, a three-grade fuzzy comprehensive evaluation model was constructed to evaluate the energy saving system of data centers.

Applied evaluative informetrics

CERN Document Server

Moed, Henk F

2017-01-01

This book focuses on applied evaluative informetric artifacts or topics. It explains the base notions and assumptions of evaluative informetrics by discussing a series of important applications. The structure of the book is therefore not organized by methodological characteristics, but is centered around popular, often discussed or used informetric artifacts - indicators, methodologies, products, databases - or so called hot topics in which informetric indicators play an important role. Most of the artifacts and topics emerged during the past decade. The principal aim of the book is to present a state of the art in applied evaluative informetrics, and to inform the readers about the pros and cons, potentialities and limitations of the use of informetric/bibliometric indicators in research assessment. The book is a continuation of the book Citation Analysis in Research Evaluation (Springer, 2005). It is of interest to non-specialists, especially research students at advanced master level and higher, all thos...

First Grade Baseline Evaluation

Science.gov (United States)

Center for Innovation in Assessment (NJ1), 2013

2013-01-01

The First Grade Baseline Evaluation is an optional tool that can be used at the beginning of the school year to help teachers get to know the reading and language skills of each student. The evaluation is composed of seven screenings. Teachers may use the entire evaluation or choose to use those individual screenings that they find most beneficial…

Internal Evaluation, Historically Speaking

Science.gov (United States)

Mathison, Sandra

2011-01-01

The author analyzes the growth and nature of internal evaluation from the 1960s to the present and suggests that internal evaluation has been on the increase because of its perceived importance. Although the 1960s were characterized by a rich intellectual development of evaluation theory and practice, the fiscal conservatism of the 1980s ushered…

Inventory differences: An evaluation methodology

International Nuclear Information System (INIS)

Heinberg, C.L.; Roberts, N.J.

1987-01-01

This paper discusses an evaluation methodology which is used for inventory differences at the Los Alamos National Laboratory. It is recognized that there are various methods which can be, and are being, used to evaluate process inventory differences at DOE facilities. The purpose of this paper is to share our thoughts on the subject and our techniques with those who are responsible for the evaluation of inventory differences at their facility. One of the most dangerous aspects of any evaluation technique, especially one as complex as most inventory difference evaluations tend to be, is to fail to look at the tools being used as indicators. There is a tendency to look at the results of an evaluation by one technique as an absolute. At the Los Alamos National Laboratory, several tools are used and the final evaluation is based on a combination of the observed results of a many-faceted evaluation. The tools used and some examples are presented

Measurement evaluation

CERN Document Server

Boros, A

1990-01-01

The information obtained about a measured object is called ``crude'' measurement information and must be related to the conditions under which the measurement took place. Using ``crude'' measurement information as a starting point, evaluation produces physically correctly interpreted data with their estimated (or corrected) error. Although a number of works deal with the evaluation of measurements, they either appeared a long time ago or serve essentially different aims. This book gives a comprehensive and current overview on the basic principles, aids, devices, and methods in the eval

Objective and automated protocols for the evaluation of biomedical search engines using No Title Evaluation protocols.

Science.gov (United States)

Campagne, Fabien

2008-02-29

The evaluation of information retrieval techniques has traditionally relied on human judges to determine which documents are relevant to a query and which are not. This protocol is used in the Text Retrieval Evaluation Conference (TREC), organized annually for the past 15 years, to support the unbiased evaluation of novel information retrieval approaches. The TREC Genomics Track has recently been introduced to measure the performance of information retrieval for biomedical applications. We describe two protocols for evaluating biomedical information retrieval techniques without human relevance judgments. We call these protocols No Title Evaluation (NT Evaluation). The first protocol measures performance for focused searches, where only one relevant document exists for each query. The second protocol measures performance for queries expected to have potentially many relevant documents per query (high-recall searches). Both protocols take advantage of the clear separation of titles and abstracts found in Medline. We compare the performance obtained with these evaluation protocols to results obtained by reusing the relevance judgments produced in the 2004 and 2005 TREC Genomics Track and observe significant correlations between performance rankings generated by our approach and TREC. Spearman's correlation coefficients in the range of 0.79-0.92 are observed comparing bpref measured with NT Evaluation or with TREC evaluations. For comparison, coefficients in the range 0.86-0.94 can be observed when evaluating the same set of methods with data from two independent TREC Genomics Track evaluations. We discuss the advantages of NT Evaluation over the TRels and the data fusion evaluation protocols introduced recently. Our results suggest that the NT Evaluation protocols described here could be used to optimize some search engine parameters before human evaluation. Further research is needed to determine if NT Evaluation or variants of these protocols can fully substitute

Evaluation Survivor: How to Outwit, Outplay, and Outlast as an Internal Government Evaluator

Science.gov (United States)

Kniker, Ted

2011-01-01

This chapter describes the author's experience and insights as the chief of evaluation for public diplomacy at the U.S. Department of State, and as a consultant assisting federal agencies in a multitude of evaluation activities relating what helps and hinders internal evaluation functions. The article discusses the challenges faced by the internal…

Evaluation methods for hospital facilities

DEFF Research Database (Denmark)

Fronczek-Munter, Aneta

2013-01-01

according to focus areas and proposes which evaluation methods to use in different building phases of healthcare facilities. Hospital evaluations with experts and users are also considered; their subjective view on space, function, technology, usability and aesthetics. Results & solutions: This paper...... presents the different methods for evaluating buildings in use in a new model, the Evaluation Focus Flower, and proposes which evaluation methods are suitable for various aims and building phases, i.e. which is giving best input for the initial briefing process of new hospital facilities with ambition...... of creating buildings with enhanced usability. Additionally various evaluation methods used in hospital cases in Denmark and Norway are presented. Involvement of users is proposed, not just in defining requirements but also in co-creation/design and evaluation of solutions. The theories and preliminary...

Problem Prioritization in Usability Evaluation:

DEFF Research Database (Denmark)

Hertzum, Morten

2006-01-01

Severity assessments enable prioritization of problems encountered during usability evaluations and thereby provide a device for guiding the utilization of design resources. However, designers' response to usability evaluations is also influenced by other factors, which may overshadow severity....... With the purpose of enhancing the impact of severity assessments, this study combines a field study of factors that influence the impact of evaluations with an experimental study of severity assessments made during usability inspections. The results show that even in a project receptive to input from evaluations...... their impact was highly dependent on conducting evaluations early. This accorded with an informal method that blended elements of usability evaluation and participatory design and could be extended with user-made severity assessments. The major cost associated with the evaluations was not finding but fixing...

Authentic And Concurrent Evaluation-refining

DEFF Research Database (Denmark)

Eriksson, Carina Ihlström; Åkesson, Maria; Kautz, Karlheinz

2011-01-01

This paper addresses the need for more detailed accounts for evaluation in design science research literature. By revisiting a design project regarding the future e-newspaper we give detailed descriptions of its authentic and concurrent evaluation approach by illustrating the what, why and how...... of all evaluation activities throughout the whole project. The project produced seven different design artifacts that were evaluated. The utility and theoretical outcomes of the evaluation activities clearly influenced design decisions regarding newspaper design, user value and business model design...... as well as decisions on strategic levels. We emphasize a holistic and concurrent approach to evaluation compared to the general design science research thinking and argue that reflecting on how to seek authenticity is important. By authenticity we refer to the notion of how closely an evaluation captures...

Individual performance evaluation of the Brazilian Nuclear Energy Commission (CNEN): a meta-evaluative study

International Nuclear Information System (INIS)

Bezerra, Leonardo Ferreira

2017-01-01

The present study is a summative meta-evaluation that had as objective to evaluate the quality of the process of evaluation of individual performance of the servers of the National Commission of Nuclear Energy, being guided by the scientific curiosity to know to what extent the evaluation of performance the National Commission for Nuclear Energy meets the quality standards disseminated by the Joint Committee on Standards for Educational Evaluation. The methodology chosen to be used was based on the management approach and had as a guiding principle of the study the elaboration of a framework of criteria considering the aforementioned standards. The criteria established in the criteria framework guided the preparation of the items of the questionnaire sent to the National Commission of Nuclear Energy servers. In addition to the questionnaire, the observation of this author was considered in the context where the phenomenon occurred, which allowed a better reflective analysis of the data collected by the questionnaire. Regarding the results, it can be inferred that the performance evaluation developed at the National Commission of Nuclear Energy can be considered of quality, highlighting the servers' trust for the data, the communication process of the program stages, the credibility of the evaluators, the process of negotiation of goals and adaptability of the instrument over the course of the cycle. However, there are some opportunities for improvement, considering the relevance of evaluation as a tool to improve the performance of the autarchy's servers. Among the points that need to be improved is that there is currently a lack of knowledge about the legal basis and justification of the process of evaluation process by the servers and the lack of clarity regarding the content of the final evaluation report. Among the recommendations of this study, one can consider as the most relevant the need to: disseminate the results of this meta-evaluation to the

48 CFR 17.206 - Evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Evaluation. 17.206 Section... CONTRACT TYPES SPECIAL CONTRACTING METHODS Options 17.206 Evaluation. (a) In awarding the basic contract... officer need not evaluate offers for any option quantities when it is determined that evaluation would not...

28 CFR 90.65 - Evaluation.

Science.gov (United States)

2010-07-01

... 28 Judicial Administration 2 2010-07-01 2010-07-01 false Evaluation. 90.65 Section 90.65 Judicial... Cases § 90.65 Evaluation. (a) The National Institute of Justice will conduct evaluations and studies of... with such federally-sponsored research and evaluation studies of their projects. In addition, grant...

The Future of Principal Evaluation

Science.gov (United States)

Clifford, Matthew; Ross, Steven

2012-01-01

The need to improve the quality of principal evaluation systems is long overdue. Although states and districts generally require principal evaluations, research and experience tell that many state and district evaluations do not reflect current standards and practices for principals, and that evaluation is not systematically administered. When…

Evaluation of Science.

Science.gov (United States)

Usmani, Adnan Mahmmood; Meo, Sultan Ayoub

2011-01-01

Scientific achievement by publishing a scientific manuscript in a peer reviewed biomedical journal is an important ingredient of research along with a career-enhancing advantages and significant amount of personal satisfaction. The road to evaluate science (research, scientific publications) among scientists often seems complicated. Scientist's career is generally summarized by the number of publications / citations, teaching the undergraduate, graduate and post-doctoral students, writing or reviewing grants and papers, preparing for and organizing meetings, participating in collaborations and conferences, advising colleagues, and serving on editorial boards of scientific journals. Scientists have been sizing up their colleagues since science began. Scientometricians have invented a wide variety of algorithms called science metrics to evaluate science. Many of the science metrics are even unknown to the everyday scientist. Unfortunately, there is no all-in-one metric. Each of them has its own strength, limitation and scope. Some of them are mistakenly applied to evaluate individuals, and each is surrounded by a cloud of variants designed to help them apply across different scientific fields or different career stages [1]. A suitable indicator should be chosen by considering the purpose of the evaluation, and how the results will be used. Scientific Evaluation assists us in: computing the research performance, comparison with peers, forecasting the growth, identifying the excellence in research, citation ranking, finding the influence of research, measuring the productivity, making policy decisions, securing funds for research and spotting trends. Key concepts in science metrics are output and impact. Evaluation of science is traditionally expressed in terms of citation counts. Although most of the science metrics are based on citation counts but two most commonly used are impact factor [2] and h-index [3].

21 CFR 900.23 - Evaluation.

Science.gov (United States)

2010-04-01

... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Evaluation. 900.23 Section 900.23 Food and Drugs... STANDARDS ACT MAMMOGRAPHY States as Certifiers § 900.23 Evaluation. FDA shall evaluate annually the performance of each certification agency. The evaluation shall include the use of performance indicators that...

Flaw evaluation charts

International Nuclear Information System (INIS)

Korosec, D.; Vojvodic Tuma, J.

1999-01-01

The structural integrity of the primary components in pressurized water reactor nuclear power plant is very important in the respect of safe and efficient operation. These components have to be subjected to periodic controls. In the light of fracture mechanics concept, the acceptance criteria for defects (flaws) are developed. Flaw evaluation procedure is necessary, to evaluate the defects regarding their acceptability for further operation. The objective of the flaw evaluation charts is to provide a series of simple graphs as decision maps. that immediate decision may be taken regarding the acceptability of a detected defects, on the basis of ASME Code XI criteria.(author)

Conceptualizing Programme Evaluation

Science.gov (United States)

Hassan, Salochana

2013-01-01

The main thrust of this paper deals with the conceptualization of theory-driven evaluation pertaining to a tutor training programme. Conceptualization of evaluation, in this case, is an integration between a conceptualization model as well as a theoretical framework in the form of activity theory. Existing examples of frameworks of programme…

Evaluation and Communication: Using a Communication Audit to Evaluate Organizational Communication

Science.gov (United States)

Hogard, Elaine; Ellis, Roger

2006-01-01

This article identifies a surprising dearth of studies that explicitly link communication and evaluation at substantive, theoretical, and methodological levels. A three-fold typology of evaluation studies referring to communication is proposed and examples given. The importance of organizational communication in program delivery is stressed and…

Organizational Capacity to Do and Use Evaluation: Results of a Pan-Canadian Survey of Evaluators

Science.gov (United States)

Cousins, J. Bradley; Elliott, Catherine; Amo, Courtney; Bourgeois, Isabelle; Chouinard, Jill; Goh, Swee C.; Lahey, Robert

2008-01-01

Despite increasing interest in the integration of evaluative inquiry into organizational functions and culture, the availability of empirical research addressing organizational capacity building to do and use evaluation is limited. This exploratory descriptive survey of internal evaluators in Canada asked about evaluation capacity building in the…

21 CFR 900.5 - Evaluation.

Science.gov (United States)

2010-04-01

... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Evaluation. 900.5 Section 900.5 Food and Drugs... STANDARDS ACT MAMMOGRAPHY Accreditation § 900.5 Evaluation. FDA shall evaluate annually the performance of each accreditation body. Such evaluation shall include an assessment of the reports of FDA or State...

Evaluating Web Usability

Science.gov (United States)

Snider, Jean; Martin, Florence

2012-01-01

Web usability focuses on design elements and processes that make web pages easy to use. A website for college students was evaluated for underutilization. One-on-one testing, focus groups, web analytics, peer university review and marketing focus group and demographic data were utilized to conduct usability evaluation. The results indicated that…

Report of the evaluation by the project evaluation committee on research and development of FBR structural materials. Result intermediate evaluation in fiscal year 2002

International Nuclear Information System (INIS)

2003-03-01

The project evaluation committee of FBR (Fast Breeder Reactor) and fuel cycle evaluated the problem under the evaluation method defined by the committee on the basis of material and supplementary data produced by JNC (Japan Nuclear Cycle Development Institute) and discussion. This report consists of summary, construction of the committee, investigation process, evaluation method, opinion of object, plan, research system, results, relation to practical use, public offering of results, development and others and total evaluation. Each opinion of the committee member are reported. Development of structural material is important problem of R and D of FBR. The estimation techniques of materials, high temperature structural and earthquake-resistant design techniques are evaluated to obtain the fruitful results. The remarkable results are development of materials of 316FR, using plate to reactor, estimation method of thermal striping, improvement of earthquake-resistant analysis technology, contribution to evaluation analysis of Monju second liner and basic information to develop quantity technique of material damage. (S.Y.)

Programme Evaluation Toolbox: Effective Evaluation Principles and Considerations in Career Practice

Science.gov (United States)

Nassar-McMillan, Sylvia; Conley, Abigail Holland

2011-01-01

In our ever-present age of accountability, career development professionals are increasingly called upon to document evidence-based outcomes and other metrics of programme effectiveness. In this article, we will review the key components of effective programme evaluation, including purposes and types of evaluation. Our review will span empirical…

Are You Being Evaluated? Need for New Approaches in Evaluation Practices

DEFF Research Database (Denmark)

Bar-Ilan, Judit; Hartmann, Frank; Havemann, Frank

2014-01-01

the evaluators to reach decision based on richer evidence. To make our model more concrete, we will present evaluation scenarios and personas at different stages of their career. The scenarios and personas will motivate the audience to become involved, and a significant part of the event will be dedicated...

Evaluation Systems, Ethics, and Development Evaluation

Science.gov (United States)

Thomas, Vinod

2010-01-01

After some 65 years of international development assistance, it is still difficult to show the effectiveness of aid in ways that are fully convincing. In part, this reflects inadequacies in the evaluation systems of the bilateral, multilateral, and global organizations that provide official development aid. Underlying these weaknesses often are a…

Precision Clock Evaluation Facility

Data.gov (United States)

Federal Laboratory Consortium — FUNCTION: Tests and evaluates high-precision atomic clocks for spacecraft, ground, and mobile applications. Supports performance evaluation, environmental testing,...

Noninvasive Urodynamic Evaluation

Directory of Open Access Journals (Sweden)

Carlos Arturo Levi D'Ancona

2012-09-01

Full Text Available The longevity of the world's population is increasing, and among male patients, complaints of lower urinary tract symptoms (LUTS are growing. Testing to diagnose LUTS and to differentiate between the various causes should be quick, easy, cheap, specific, not too bothersome for the patient, and noninvasive or minimally so. Urodynamic evaluation is the gold standard for diagnosing bladder outlet obstruction (BOO but presents some inconveniences such as embarrassment, pain, and dysuria; furthermore, 19% of cases experience urinary retention, macroscopic hematuria, or urinary tract infection. A greater number of resources in the diagnostic armamentarium could increase the opportunity for selecting less invasive tests. A number of groups have risen to this challenge and have formulated and developed ideas and technologies to improve noninvasive methods to diagnosis BOO. These techniques start with flowmetry, an increase in the interest of ultrasound, and finally the performance of urodynamic evaluation without a urethral catheter. Flowmetry is not sufficient for confirming a diagnosis of BOO. Ultrasound of the prostate and the bladder can help to assess BOO noninvasively in all men and can be useful for evaluating the value of BOO at assessment and during treatment of benign prostatic hyperplasia patients in the future. The great advantages of noninvasive urodynamics are as follows: minimal discomfort, minimal risk of urinary tract infection, and low cost. This method can be repeated many times, permitting the evaluation of obstruction during clinical treatment. A urethral connector should be used to diagnose BOO, in evaluation for surgery, and in screening for treatment. In the future, noninvasive urodynamics can be used to identify patients with BOO to initiate early medical treatment and evaluate the results. This approach permits the possibility of performing surgery before detrusor damage occurs.

Systematic, Cooperative Evaluation.

Science.gov (United States)

Nassif, Paula M.

Evaluation procedures based on a systematic evaluation methodology, decision-maker validity, new measurement and design techniques, low cost, and a high level of cooperation on the part of the school staff were used in the assessment of a public school mathematics program for grades 3-8. The mathematics curriculum was organized into Spirals which…

Evaluating Teachers' Professional Development Initiatives: Towards an Extended Evaluative Framework

Science.gov (United States)

Merchie, Emmelien; Tuytens, Melissa; Devos, Geert; Vanderlinde, Ruben

2018-01-01

Evaluating teachers' professional development initiatives (PDI) is one of the main challenges for the teacher professionalisation field. Although different studies have focused on the effectiveness of PDI, the obtained effects and evaluative methods have been found to be widely divergent. By means of a narrative review, this study provides an…

Casing Out Evaluation: Expanding Student Interest in Program Evaluation through Case Competitions.

Science.gov (United States)

Obrecht, Michael; Porteous, Nancy; Haddock, Blair

1998-01-01

Describes the authors' experiences in organizing bilingual evaluation case competitions for the National Capital Chapter of the Canadian Evaluation Society for three years. Competition structure, eligibility, judging, contestant recruiting, and preparing cases are outlined. (SLD)

Health Economic Evaluation of Telehealthcare

DEFF Research Database (Denmark)

Udsen, Flemming Witt

for decision making meant to inform adaptation of the health economic evaluation approach. Based on developments in realist evaluation and experiences with conducting the evaluation of TeleCare North, four principles for health economic evaluation of complex telehealthcare interventions is outlined in order....... The results from the TeleCare North trial were used directly in a national decision to implement the telehealthcare solution to patients with severe COPD in Denmark and lead to considerable debate nationally. This debate could be viewed as an actual account of the usefulness of health economic evaluation...

1999 scientific evaluation at the CEA; L'evaluation scientifique 1999 au CEA

Energy Technology Data Exchange (ETDEWEB)

NONE

1999-07-01

This report presents a statement of the scientific and technical activity of the French atomic energy commission (CEA) for the year 1999. This evaluation is made by external and independent experts and requires some specific dispositions for the nuclear protection and safety institute (IPSN) and for the direction of military applications (DAM). The report is divided into 4 parts dealing successively with: 1)the CEA, a public research organization (strategy, research programs, new organization of the CEA activities, civil nuclear research, technology research and transfer, defence activities, transfer of knowledge) 2)the scientific evaluation at the CEA (evaluations of the civil applications of the CEA, IPSN, DAM, INSTN (national institute for nuclear sciences and techniques) 3)synthesis of the 1999 scientific and technical evaluation for each operational directions of the CEA (directions of fuel cycle, of nuclear reactors, of advanced technologies, of materials sciences, of life sciences, of military applications, of the nuclear protection and safety institute and of the national institute for nuclear sciences and techniques) 4)the corresponding members of the evaluation and the list of scientific and technical councils and members.

UN Women’s experience with strengthening evaluation systems in Africa: Enhancing quantity, quality and use of evaluations

Directory of Open Access Journals (Sweden)

Caspar Merkle

2016-12-01

Full Text Available Background: Following the adoption of the Women Evaluation Policy in 2012, a series of systems and mechanisms were introduced in the organisation to strengthen the evaluation function at both central and decentralised levels. They were based on a systemic approach and a Theory of Change for building an enabling environment for evaluation in UN Women. Objectives: The purpose of this article was to analyse progress made and challenges with respect to establishing evaluation systems and institutionalising an evaluation culture in the UN Women Africa region. Method: The article draws on UN Women evaluation performance data collected over the past five years, discussions and practical experience by the author of working on evaluation with UN Women since 2009. It also analyses UN Women documents and the broader literature on the topic. Results: The findings illustrate that the different mechanisms to strengthen the evaluation function in UN Women show progress in the Africa region on four out of the five selected evaluation performance indicators. The Theory of Change to strengthen the UN Women evaluation function is largely validated by the wider literature on evaluation use. External assessments confirm that the UN Women evaluation function is sound overall. Conclusion: The article concludes that evaluation performance indicators only provide a partial snapshot of the many different factors that help or undermine evaluative thinking and a learning culture within an organisation. Institutional systems and mechanisms are necessary but not sufficient for nurturing an evaluation culture and ensuring utilisation of evaluation for better development effectiveness.

Evaluating Domestic Violence Initiatives

OpenAIRE

Parmar, Alpa; Sampson, Alice

2006-01-01

This paper critiques the approach of identifying ‘best practice’ projects and discusses the problem with simply transferring projects into different contexts. The argument is illustrated by explaining the evaluation process of three domestic violence projects which all had the same aim, which was to reduce domestic violence. The evaluated projects all delivered advocacy programmes and were located in disadvantaged areas in the United Kingdom. A more suitable evaluation approach is proposed wh...

Three-agent Peer Evaluation

OpenAIRE

Vicki Knoblauch

2008-01-01

I show that every rule for dividing a dollar among three agents impartially (so that each agent's share depends only on her evaluation by her associates) underpays some agent by at least one-third of a dollar for some consistent profile of evaluations. I then produce an impartial division rule that never underpays or overpays any agent by more than one-third of a dollar, and for most consistent evaluation profiles does much better.

Hawaii-Okinawa Building Evaluations

Energy Technology Data Exchange (ETDEWEB)

Metzger, I.; Salasovich, J.

2013-05-01

NREL conducted energy evaluations at the Itoman City Hall building in Itoman, Okinawa Prefecture, Japan, and the Hawaii State Capitol building in Honolulu, Hawaii. This report summarizes the findings from the evaluations, including the best practices identified at each site and opportunities for improving energy efficiency and renewable energy. The findings from this evaluation are intended to inform energy efficient building design, energy efficiency technology, and management protocols for buildings in subtropical climates.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

GIS in Evaluation: Utilizing the Power of Geographic Information Systems to Represent Evaluation Data

Science.gov (United States)

Azzam, Tarek; Robinson, David

2013-01-01

This article provides an introduction to geographic information systems (GIS) and how the technology can be used to enhance evaluation practice. As a tool, GIS enables evaluators to incorporate contextual features (such as accessibility of program sites or community health needs) into evaluation designs and highlights the interactions between…

Case study of evaluations that go beyond clinical outcomes to assess quality improvement diabetes programmes using the Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE).

Science.gov (United States)

Paquette-Warren, Jann; Harris, Stewart B; Naqshbandi Hayward, Mariam; Tompkins, Jordan W

2016-10-01

Investments in efforts to reduce the burden of diabetes on patients and health care are critical; however, more evaluation is needed to provide evidence that informs and supports future policies and programmes. The newly developed Diabetes Evaluation Framework for Innovative National Evaluations (DEFINE) incorporates the theoretical concepts needed to facilitate the capture of critical information to guide investments, policy and programmatic decision making. The aim of the study is to assess the applicability and value of DEFINE in comprehensive real-world evaluation. Using a critical and positivist approach, this intrinsic and collective case study retrospectively examines two naturalistic evaluations to demonstrate how DEFINE could be used when conducting real-world comprehensive evaluations in health care settings. The variability between the cases and the evaluation designs are described and aligned to the DEFINE goals, steps and sub-steps. The majority of the theoretical steps of DEFINE were exemplified in both cases, although limited for knowledge translation efforts. Application of DEFINE to evaluate diverse programmes that target various chronic diseases is needed to further test the inclusivity and built-in flexibility of DEFINE and its role in encouraging more comprehensive knowledge translation. This case study shows how DEFINE could be used to structure or guide comprehensive evaluations of programmes and initiatives implemented in health care settings and support scale-up of successful innovations. Future use of the framework will continue to strengthen its value in guiding programme evaluation and informing health policy to reduce the burden of diabetes and other chronic diseases. © 2016 The Authors. Journal of Evaluation in Clinical Practice published by John Wiley & Sons, Ltd.

Fear of negative evaluation modulates electrocortical and behavioral responses when anticipating social evaluative feedback

Directory of Open Access Journals (Sweden)

Melle J.W. Van Der Molen

2014-01-01

Full Text Available Cognitive models posit that the fear of negative evaluation (FNE is a hallmark feature of social anxiety. As such, individuals with high FNE may show biased information processing when faced with social evaluation. The aim of the current study was to examine the neural underpinnings of anticipating and processing of social-evaluative feedback, and its correlates with FNE. We used a social judgment paradigm in which female participants (N=31 were asked to indicate whether they believed to be socially accepted or rejected by their peers. Anticipatory attention was indexed by the stimulus preceding negativity (SPN, while the feedback-related negativity and P3 were used to index the processing of social-evaluative feedback. Results provided evidence of an optimism bias in social peer evaluation, as participants more often predicted to be socially accepted than rejected. Participants with high levels of FNE needed more time to provide their judgments about the social-evaluative outcome. While anticipating social-evaluative feedback, SPN amplitudes were larger for anticipated social acceptance than for social rejection feedback. Interestingly, the SPN during anticipated social acceptance was larger in participants with high levels of FNE. None of the feedback-related brain potentials correlated with the FNE. Together, the results provide evidence of biased information processing in individuals with high levels of FNE when anticipating (rather than processing social-evaluative feedback. The delayed response times in high FNE individuals were interpreted to reflect augmented vigilance imposed by the upcoming social evaluative threat. Allegedly, the SPN constitutes a neural marker of this vigilance in females with higher FNE levels, particularly when anticipating social acceptance feedback.

Fear of negative evaluation modulates electrocortical and behavioral responses when anticipating social evaluative feedback

Science.gov (United States)

Van der Molen, Melle J. W.; Poppelaars, Eefje S.; Van Hartingsveldt, Caroline T. A.; Harrewijn, Anita; Gunther Moor, Bregtje; Westenberg, P. Michiel

2014-01-01

Cognitive models posit that the fear of negative evaluation (FNE) is a hallmark feature of social anxiety. As such, individuals with high FNE may show biased information processing when faced with social evaluation. The aim of the current study was to examine the neural underpinnings of anticipating and processing social-evaluative feedback, and its correlates with FNE. We used a social judgment paradigm in which female participants (N = 31) were asked to indicate whether they believed to be socially accepted or rejected by their peers. Anticipatory attention was indexed by the stimulus preceding negativity (SPN), while the feedback-related negativity and P3 were used to index the processing of social-evaluative feedback. Results provided evidence of an optimism bias in social peer evaluation, as participants more often predicted to be socially accepted than rejected. Participants with high levels of FNE needed more time to provide their judgments about the social-evaluative outcome. While anticipating social-evaluative feedback, SPN amplitudes were larger for anticipated social acceptance than for social rejection feedback. Interestingly, the SPN during anticipated social acceptance was larger in participants with high levels of FNE. None of the feedback-related brain potentials correlated with the FNE. Together, the results provided evidence of biased information processing in individuals with high levels of FNE when anticipating (rather than processing) social-evaluative feedback. The delayed response times in high FNE individuals were interpreted to reflect augmented vigilance imposed by the upcoming social-evaluative threat. Possibly, the SPN constitutes a neural marker of this vigilance in females with higher FNE levels, particularly when anticipating social acceptance feedback. PMID:24478667

Geoscientific evaluation factors and criteria for siting and site evaluation. Progress report

International Nuclear Information System (INIS)

Stroem, A.; Ericsson, Lars O.; Svemar, C.; Almen, K.E.; Andersson, Johan

1999-03-01

The purposes of the present report are to: present the work that has been done to identify the parameters that need to be determined in a geoscientific site investigation and that serve as the basis for the work with geoscientific evaluation factors; give a progress report from the project that was initiated in 1997 named Siting Factors and Criteria for Site Evaluation, with an emphasis on definitions, outline and structure for the execution of the work; present geoscientific requirements on function both general and in detail in the form of an example for the discipline rock mechanics; present geoscientific evaluation factors associated with different stages in the siting work in the form of an example for the discipline hydrogeochemical composition; present plans for further work as regards criteria for site evaluation in different siting stages. The project is under way, and this is to be regarded as a progress report since e.g. criteria for site evaluation will be presented at a later date. The long-term performance and safety of the deep repository must always be evaluated by means of an integrated safety assessment. The work with factors and criteria can never take the place of such an assessment, but can provide guidance regarding its outcome. Requirements and preferences regarding the function of the rock in the deep repository have been clarified in this progress report. What is new here is the structuring that has been carried out, with a classification into different geoscientific disciplines, and the formalism that has been given to the terms requirement, preference and function. Based on fundamental safety and construction functions, requirements on function have been specified for the disciplines geology, thermal properties, hydro-geology, rock mechanics, chemistry and transport properties. Furthermore, function analyses have been identified by means of which it is possible to concretize requirements on function and which geoscientific parameters are

Geoscientific evaluation factors and criteria for siting and site evaluation. Progress report

Energy Technology Data Exchange (ETDEWEB)

Stroem, A.; Ericsson, Lars O.; Svemar, C. [Swedish Nuclear Fuel and Waste Management Co., Stockholm (Sweden); Almen, K.E. [KEA GEO-konsult AB (Sweden); Andersson, Johan [Golder Grundteknik KB (Sweden)

1999-03-01

The purposes of the present report are to: present the work that has been done to identify the parameters that need to be determined in a geoscientific site investigation and that serve as the basis for the work with geoscientific evaluation factors; give a progress report from the project that was initiated in 1997 named Siting Factors and Criteria for Site Evaluation, with an emphasis on definitions, outline and structure for the execution of the work; present geoscientific requirements on function both general and in detail in the form of an example for the discipline rock mechanics; present geoscientific evaluation factors associated with different stages in the siting work in the form of an example for the discipline hydrogeochemical composition; present plans for further work as regards criteria for site evaluation in different siting stages. The project is under way, and this is to be regarded as a progress report since e.g. criteria for site evaluation will be presented at a later date. The long-term performance and safety of the deep repository must always be evaluated by means of an integrated safety assessment. The work with factors and criteria can never take the place of such an assessment, but can provide guidance regarding its outcome. Requirements and preferences regarding the function of the rock in the deep repository have been clarified in this progress report. What is new here is the structuring that has been carried out, with a classification into different geoscientific disciplines, and the formalism that has been given to the terms requirement, preference and function. Based on fundamental safety and construction functions, requirements on function have been specified for the disciplines geology, thermal properties, hydro-geology, rock mechanics, chemistry and transport properties. Furthermore, function analyses have been identified by means of which it is possible to concretize requirements on function and which geoscientific parameters are

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Evaluating the Evaluators: Comparative Study of High School Newspaper Critique Services.

Science.gov (United States)

Davis, Nancy

High school publication staffs depend on national critique services as a major means of evaluation and recognition, but most have no measure of how one critique service compares to the others, because they can afford the entry fee for only one evaluation. Thus, a study was conducted to test the validity of three major national critique…

Tutorial on Online Partial Evaluation

Directory of Open Access Journals (Sweden)

William R. Cook

2011-09-01

Full Text Available This paper is a short tutorial introduction to online partial evaluation. We show how to write a simple online partial evaluator for a simple, pure, first-order, functional programming language. In particular, we show that the partial evaluator can be derived as a variation on a compositionally defined interpreter. We demonstrate the use of the resulting partial evaluator for program optimization in the context of model-driven development.

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Evaluation and Learning Policy

International Development Research Centre (IDRC) Digital Library (Canada)

Amy Etherington

decisions. More broadly, evaluation generates knowledge about research and development. ... toward common goals; evaluations are part of our commitment to document and assess our joint .... of both qualitative and quantitative measures.

[Patient evaluation and outcome measures].

Science.gov (United States)

Nieto Pol, Enrique

2014-01-01

Both the initial evaluation and follow-up of patients with osteoarthritis require systematic evaluation of the indicators that provide information on the degree of involvement of the disease and allow its quantification. Reliable measures of disease progression help decision-making by clinicians and provide valid information on treatment response and the effectiveness of the distinct therapeutic interventions. The instruments recommended in research, as outcome measures in osteoarthritis, are pain evaluation, assessment of physical function, and self-reported global evaluation. In studies lasting more than 1 year, structural changes are evaluated through simple X-ray. Self-reported quality of life assessment and physician global assessment are also recommended as options. These indicators should be incorporated into routine clinical practice for adequate evaluation and correct follow-up of patients with osteoarthritis. The recommended pain evaluation method for use in clinical practice is the visual analog scale (VAS). The best instrument to evaluate physical function in patients with hip or knee osteoarthritis is the WOMAC scale (Western Ontario and McMaster Universities Osteoarthritis Index). For patient-reported global assessment in routine practice, the recommended scales are VAS or the SF-12 (12-item short-form health survey). Copyright © 2014 Elsevier España, S.L. All rights reserved.

How to Teach Health IT Evaluation: Recommendations for Health IT Evaluation Courses

NARCIS (Netherlands)

Ammenwerth, Elske; de Keizer, Nicolet; Brender McNair, Jytte; Craven, Catherine K.; Eisenstein, Eric; Georgiou, Andrew; Khairat, Saif; Magrabi, Farah; Nykänen, Pirkko; Otero, Paula; Rigby, Michael; Scott, Philip; Weir, Charlene

2017-01-01

Systematic health IT evaluation studies are needed to ensure system quality and safety and to provide the basis for evidence-based health informatics. Well-trained health informatics specialists are required to guarantee that health IT evaluation studies are conducted in accordance with robust

Test, measurement and evaluation with the mine boot test and evaluation system

CSIR Research Space (South Africa)

Ramaloko, PM

2014-09-01

Full Text Available Protective footwear that mitigates the shock transferred to the victim’s leg during an antipersonnel landmine blast need to be evaluated to verify their protection levels. The Mine Boot Test and Evaluation System which include a surrogate lower leg...

Evaluation of subsidy for electricity savings in households; Evaluering av tilskuddsordning for elektrisitetssparing i husholdninger

Energy Technology Data Exchange (ETDEWEB)

2010-04-15

Ramboll Management Consulting (Ramboll) has on behalf of Enova SF (Enova) conducted an evaluation of the 'Grant Scheme for electricity savings in households'. The evaluation is conducted in the period January to March 2009, Ramboll is solely responsible for all the analysis, conclusions and recommendations in the report. The evaluation conducted on the basis of a review of the grant assessed on the basis of six evaluation themes. The evaluation will form the basis for further work on the grant by Enova and in their reporting to the Ministry of Petroleum and Energy (OED). (AG)

Evaluating Methods for Evaluating Instruction: The Case of Higher Education

OpenAIRE

Bruce A. Weinberg; Belton M. Fleisher; Masanori Hashimoto

2007-01-01

This paper develops an original measure of learning in higher education, based on grades in subsequent courses. Using this measure of learning, this paper shows that student evaluations are positively related to current grades but unrelated to learning once current grades are controlled. It offers evidence that the weak relationship between learning and student evaluations arises, in part, because students are unaware of how much they have learned in a course. The paper concludes with a discu...

Institutional Tendencies of Legitimate Evaluation: A Comparison of Finnish and English Higher Education Evaluations

Science.gov (United States)

Vartiainen, Pirkko

2005-01-01

This article analyses institutional evaluations of higher education in England and Finland through the concept of legitimacy. The focus of the article is on the institutional tendencies of legitimacy. This author's hypothesis is that evaluation is legitimate when the evaluation process is of a good quality and accepted both morally and in practice…

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Relational responsibilities in responsive evaluation

NARCIS (Netherlands)

Visse, M.A.; Abma, T.A.; Widdershoven, G.A.M.

2012-01-01

This article explores how we can enhance our understanding of the moral responsibilities in daily, plural practices of responsive evaluation. It introduces an interpretive framework for understanding the moral aspects of evaluation practice. The framework supports responsive evaluators to better

Dimensions of Creative Evaluation

DEFF Research Database (Denmark)

Christensen, Bo; Ball, Linden J.

2016-01-01

We examined evaluative reasoning taking place during expert ‘design critiques’. We focused on key dimensions of creative evaluation (originality, functionality and aesthetics) and ways in which these dimensions impact reasoning strategies and suggestions offered by experts for how the student could...... continue. Each dimension was associated with a specific underpinning ‘logic’ determining how these dimensions were evaluated in practice. Our analysis clarified how these dimensions triggered reasoning strategies such as running mental simulations or making design suggestions, ranging from ‘go...

Critical self-evaluation for excellence

International Nuclear Information System (INIS)

Mullee, G.R.

1988-01-01

This paper discusses the use of critical self-evaluation of performance as a stimulus for excellence. Self-evaluation inherently provides acceptance and ownership of a problem, thereby motivating change. Some of the key elements of self-evaluation are discussed such as unbiased observations and appropriate performance standards. As circumstances change, an ongoing self-appraisal approach provides continuing feedback to maintain and further excellence. Two examples of critical self-evaluation in use at the Tennessee Valley Authority (TVA) are discussed

Unintended outcomes evaluation approach: A plausible way to evaluate unintended outcomes of social development programmes.

Science.gov (United States)

Jabeen, Sumera

2018-06-01

Social development programmes are deliberate attempts to bring about change and unintended outcomes can be considered as inherent to any such intervention. There is now a solid consensus among the international evaluation community regarding the need to consider unintended outcomes as a key aspect in any evaluative study. However, this concern often equates to nothing more than false piety. Exiting evaluation theory suffers from overlap of terminology, inadequate categorisation of unintended outcomes and lack of guidance on how to study them. To advance the knowledge of evaluation theory, methods and practice, the author has developed an evaluation approach to study unintended effects using a theory building, testing and refinement process. A comprehensive classification of unintended outcomes on the basis of knowability, value, distribution and temporality helped specify various type of unintended outcomes for programme evaluation. Corresponding to this classification, a three-step evaluation process was proposed including a) outlining programme intentions b) forecasting likely unintended effects c) mapping the anticipated and understanding unanticipated unintended outcomes. This unintended outcomes evaluation approach (UOEA) was then trialled by undertaking a multi-site and multi-method case study of a poverty alleviation programme in Pakistan and refinements were made to the approach.The case study revealed that this programme was producing a number of unintended effects, mostly negative, affecting those already disadvantaged such as the poorest, women and children. The trialling process demonstrated the effectiveness of the UOEA and suggests that this can serve as a useful guide for future evaluation practice. It also provides the discipline of evaluation with an empirically-based reference point for further theoretical developments in the study of unintended outcomes. Copyright © 2017 Elsevier Ltd. All rights reserved.

Evaluation in School Districts; Organizational Perspectives. CSE Monograph Series in Evaluation, 10.

Science.gov (United States)

Bank, Adrianne, Ed.; Williams, Richard C., Ed.

This monograph focuses on educational evaluation and how it occurs within a specific setting--school districts' central administrative offices--examining the relationships between evaluation activities and district organizational features that impinge upon such activities. The various chapter authors worked with the Center for the Study of…

Participatory Training Evaluation Method (PATEM) as a Collaborative Evaluation Capacity Building Strategy

Science.gov (United States)

Kuzmin, Alexey

2012-01-01

This article describes Participatory Training Evaluation Method (PATEM) of measuring participants' reaction to the training. PATEM provides rich information; allows to document evaluation findings; becomes organic part of the training that helps participants process their experience individually and as a group; makes sense to participants; is an…

A structured expert evaluation method for the evaluation of children's computer games

NARCIS (Netherlands)

Baauw, E.; Bekker, M.M.; Barendregt, W.; Costabile, M.F.; Paternò, F.

2005-01-01

Inspection-based evaluation methods predicting usability problems can be applied for evaluating products without involving users. A new method (named SEEM), inspired by Norman’s theory-of-action model [18] and Malone’s concepts of fun [15], is described for predicting usability and fun problems in

Evaluative conditioning of food technologies

DEFF Research Database (Denmark)

Loebnitz, Natascha; Grunert, Klaus G

2015-01-01

Consumer attitudes play an important role in the acceptance of new technologies. The success of food innovations depends on understanding how consumers form and change attitudes toward food technologies. Earlier post hoc explanations suggest that evaluative conditioning can change consumer...... attitudes toward food technologies. The present study tests how evaluative conditioning can affect consumer acceptance of new food technologies. Furthermore, authors investigate whether evaluative conditioning is resistant to extinction after a two-month period and whether the evaluative conditioning effect...... prevails in a product-related context. Within an evaluative conditioning paradigm including between-subjects control groups in addition to standard within-subjects control conditions, participants were presented with three food technologies (conventional, enzyme, and genetic technology) paired...

Systematization of simplified J-integral evaluation method for flaw evaluation at high temperature

International Nuclear Information System (INIS)

Miura, Naoki; Takahashi, Yukio; Nakayama, Yasunari; Shimakawa, Takashi

2000-01-01

J-integral is an effective inelastic fracture parameter for the flaw evaluation of cracked components at high temperature. The evaluation of J-integral for an arbitrary crack configuration and an arbitrary loading condition can be generally accomplished by detailed numerical analysis such as finite element analysis, however, it is time-consuming and requires a high degree of expertise for its implementation. Therefore, it is important to develop simplified J-integral estimation techniques from the viewpoint of industrial requirements. In this study, a simplified J-integral evaluation method is proposed to estimate two types of J-integral parameters. One is the fatigue J-integral range to describe fatigue crack propagation behavior, and the other is the creep J-integral to describe creep crack propagation behavior. This paper presents the systematization of the simplified J-integral evaluation method incorporated with the reference stress method and the concept of elastic follow-up, and proposes a comprehensive evaluation procedure. The verification of the proposed method is presented in Part II of this paper. (author)

Are anonymous evaluations a better assessment of faculty teaching performance? A comparative analysis of open and anonymous evaluation processes.

Science.gov (United States)

Afonso, Nelia M; Cardozo, Lavoisier J; Mascarenhas, Oswald A J; Aranha, Anil N F; Shah, Chirag

2005-01-01

We compared teaching performance of medical school faculty using anonymous evaluations and open evaluations (in which the evaluator was not anonymous) and examined barriers to open evaluation. Residents and medical students evaluated faculty using an open evaluation instrument in which their identity was indicated in the evaluation. Following this, they completed anonymous evaluation on the same faculty members. Aggregate outcomes using the two evaluation systems were compared. Outcomes by group of evaluators (residents and students) were analyzed. Trainees were also asked to rate the barriers to the open evaluation process. A statistically significant difference between the open and anonymous evaluations was noted across all items, with faculty receiving lower scores on the anonymous evaluations. The mean score for all the items on the open evaluations was 4.45 +/- 0.65, compared to mean score of 4.07 +/- 0.80 on the anonymous evaluations. There was also a statistically significant difference between open and anonymous evaluations in five clinical teaching domains that were evaluated individually. Residents perceived that the three most common barriers to optimal evaluation were an apprehension of possible encounters with the same attending physician in the future, destruction of working relationships with the attending, and a feeling of frustration with the evaluation system. The evaluation of faculty teaching performance is complex. Most academic medical centers use the open evaluation format. This study supports the case for the use of the anonymous evaluation method as a more accurate reflection of teaching performance.

Students' Evaluations about Climate Change

Science.gov (United States)

Lombardi, Doug; Brandt, Carol B.; Bickel, Elliot S.; Burg, Colin

2016-01-01

Scientists regularly evaluate alternative explanations of phenomena and solutions to problems. Students should similarly engage in critical evaluation when learning about scientific and engineering topics. However, students do not often demonstrate sophisticated evaluation skills in the classroom. The purpose of the present study was to…

Exploring Enterprise Architecture Evaluation Practices

DEFF Research Database (Denmark)

Andersen, Peter; Carugati, Andrea; Grue Sørensen, Morten

2015-01-01

EA evaluation has received very little attention in academic publications on EA. While EA evaluation to some extent has been described in the literature, the different ways of evaluating architecture have mainly used a top-down approach deriving measures from theory rather than a bottom-up approa...

11 CFR 6.110 - Evaluation.

Science.gov (United States)

2010-01-01

... 11 Federal Elections 1 2010-01-01 2010-01-01 false Evaluation. 6.110 Section 6.110 Federal... OR ACTIVITIES CONDUCTED BY THE FEDERAL ELECTION COMMISSION § 6.110 Evaluation. (a) Within one year of... persons, including handicapped persons and organizations representing handicapped persons, and evaluation...

28 CFR 90.58 - Evaluation.

Science.gov (United States)

2010-07-01

... 28 Judicial Administration 2 2010-07-01 2010-07-01 false Evaluation. 90.58 Section 90.58 Judicial Administration DEPARTMENT OF JUSTICE (CONTINUED) VIOLENCE AGAINST WOMEN Indian Tribal Governments Discretionary Program § 90.58 Evaluation. The National Institute of Justice will conduct an evaluation of these programs. ...

Evaluating a Federated Medical Search Engine

Science.gov (United States)

Belden, J.; Williams, J.; Richardson, B.; Schuster, K.

2014-01-01

Summary Background Federated medical search engines are health information systems that provide a single access point to different types of information. Their efficiency as clinical decision support tools has been demonstrated through numerous evaluations. Despite their rigor, very few of these studies report holistic evaluations of medical search engines and even fewer base their evaluations on existing evaluation frameworks. Objectives To evaluate a federated medical search engine, MedSocket, for its potential net benefits in an established clinical setting. Methods This study applied the Human, Organization, and Technology (HOT-fit) evaluation framework in order to evaluate MedSocket. The hierarchical structure of the HOT-factors allowed for identification of a combination of efficiency metrics. Human fit was evaluated through user satisfaction and patterns of system use; technology fit was evaluated through the measurements of time-on-task and the accuracy of the found answers; and organization fit was evaluated from the perspective of system fit to the existing organizational structure. Results Evaluations produced mixed results and suggested several opportunities for system improvement. On average, participants were satisfied with MedSocket searches and confident in the accuracy of retrieved answers. However, MedSocket did not meet participants’ expectations in terms of download speed, access to information, and relevance of the search results. These mixed results made it necessary to conclude that in the case of MedSocket, technology fit had a significant influence on the human and organization fit. Hence, improving technological capabilities of the system is critical before its net benefits can become noticeable. Conclusions The HOT-fit evaluation framework was instrumental in tailoring the methodology for conducting a comprehensive evaluation of the search engine. Such multidimensional evaluation of the search engine resulted in recommendations for

MODULAR CONSTRUCTION SYSTEM EVALUATION

International Nuclear Information System (INIS)

Gillespie, S.

2002-01-01

The purpose of this study is to respond to U.S. Department of Energy (DOE) Technical Direction Letter (TDL) 02-003 (Waisley 2001), which directs Bechtel SAIC Company, LLC (BSC) to complete a design study to recommend repository design options to support receipt and/or emplacement of any or all of the following: commercial spent nuclear fuel (CSNF), high-level radioactive waste (HLW), DOE-managed spent nuclear fuel (DSNF) (including naval spent nuclear fuel [SNF]), and immobilized plutonium (if available), as soon as practicable, but no later than 2010. From the possible design options, a recommended approach will be determined for further evaluation to support the preliminary design of the repository. This study integrates the results of the repository Design Evolution Study (Rowe 2002) with supporting studies concerning national transportation options (BSC 2002b) and Nevada transportation options (Gehner 2002). The repository Design Evolution Study documents the processes used to reevaluate the design, construction, operation, and cost of the repository in response to TDL 02-003 (Waisley 2001), and to determine possible repository conceptual design options. The transportation studies evaluate the national and Nevada transportation options that support the repository conceptual design options. An evaluation methodology was established, based on Program-level requirements developed for the study in reference BSC 2001a, to allow the repository and system design options to be evaluated on a consistent basis. The transportation options and the design components were integrated into system design implementation options, which were evaluated using receipt and emplacement scenarios. The scenarios tested the ability of the design concept to adapt to changes in funding, waste receipt rate, and Nevada rail transportation availability. The results of the evaluation (in terms of system throughput, cost, and schedule) were then compared to the Program-level requirements, and

Strengthening safeguards information evaluation

International Nuclear Information System (INIS)

Harry, J.; Hudson, P.

2001-01-01

The strengthening of safeguards should not be limited to the verification of explicit declarations made by the States. Additional information should guide the IAEA to set priorities for further investigations. Not only all aspects of the State's nuclear programme, including the application of safe, secure and transparent nuclear management, but also the level of compliance with other verifiable treaties, political motivation, economic capabilities, international relations and ties, co-operative attitude to safeguards, and general openness and transparency should be included. The evaluation of the diverse forms of information from different sources requires new reliable processes that will result in a high credibility and detection probability. The IAEA uses the physical model for the evaluation of the technical information, and proposed also Fuzzy Logic, or Calculation with Words, to handle the information. But for the evaluation it is questioned whether fuzziness could lead to a crisp judgement. In this paper an objective method of information evaluation is proposed, which allows to integrate different kinds of information and to include calibration and tests in the establishment of the evaluation process. This method, Delta, uses elicitation of a syndicate of experienced inspectors to integrate obvious indicators together with apparently innocent indicators, into a database that forms the core of the evaluation process. Nominal or ordinal scales could be applied to come to an objective and quantifiable result. Experience with this method can in the course of time result in predictive conclusions. 9 refs

Software for Evaluation of Conceptual Design

DEFF Research Database (Denmark)

Hartvig, Susanne C

1998-01-01

by the prototype, it addresses the requirements that the methods imply, and it explains the actual implementation of the prototype. Finally it discusses what have been learned from developing and testing the prototype. In this paper it is suggested, that a software tool which supports evaluation of design can...... be developed with a limited effort, and that such tools could support a structured evaluation process as opposed to no evaluation. Compared to manual evaluation, the introduced software based evaluation tool offers automation of tasks, such as performing assessments, when they are based on prior evaluations...

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

An Evaluation Framework for CALL

Science.gov (United States)

McMurry, Benjamin L.; Williams, David Dwayne; Rich, Peter J.; Hartshorn, K. James

2016-01-01

Searching prestigious Computer-assisted Language Learning (CALL) journals for references to key publications and authors in the field of evaluation yields a short list. The "American Journal of Evaluation"--the flagship journal of the American Evaluation Association--is only cited once in both the "CALICO Journal and Language…

Evaluating Technology Transfer and Diffusion.

Science.gov (United States)

Bozeman, Barry; And Others

1988-01-01

Four articles discuss the evaluation of technology transfer and diffusion: (1) "Technology Transfer at the U.S. National Laboratories: A Framework for Evaluation"; (2) "Application of Social Psychological and Evaluation Research: Lessons from Energy Information Programs"; (3) "Technology and Knowledge Transfer in Energy R and D Laboratories: An…

End User Evaluations

Science.gov (United States)

Jay, Caroline; Lunn, Darren; Michailidou, Eleni

As new technologies emerge, and Web sites become increasingly sophisticated, ensuring they remain accessible to disabled and small-screen users is a major challenge. While guidelines and automated evaluation tools are useful for informing some aspects of Web site design, numerous studies have demonstrated that they provide no guarantee that the site is genuinely accessible. The only reliable way to evaluate the accessibility of a site is to study the intended users interacting with it. This chapter outlines the processes that can be used throughout the design life cycle to ensure Web accessibility, describing their strengths and weaknesses, and discussing the practical and ethical considerations that they entail. The chapter also considers an important emerging trend in user evaluations: combining data from studies of “standard” Web use with data describing existing accessibility issues, to drive accessibility solutions forward.

Four Approaches to Project Evaluation

DEFF Research Database (Denmark)

Laursen, Markus; Svejvig, Per; Rode, Anna Le Gerstrøm

. Each of the framework’s four approaches provides a distinct evaluation that sheds light on some issues while leaving others unattended. Following these lines, the paper calls for more multi-faceted project evaluations. Introducing a framework that can help analyze existing evaluations and structure......There are many theoretical and practical reasons for evaluating projects – including explorative arguments focusing on expanding descriptive knowledge on project work as well as normative arguments focusing on improving prescriptive models of project performance. Despite the need for project...... management methodologies that work and combat project failure, and research methods that can assess effective project management and methodologies, as well as empirical research on the actuality of projects as practice, evaluation research on projects including project management and methodologies is scarce...

Performance Evaluations in Audit Firms

DEFF Research Database (Denmark)

Riise Johansen, Thomas; Christoffersen, Jeppe

2017-01-01

Previous research has only minimally examined the association between the behaviour and performance evaluations of individual auditors beyond the use of efficiency-focused evaluations. We examine the association between dysfunctional auditor behaviour and three evaluation foci: an efficiency focus......, a client focus and a quality focus. Our results, which are based on questionnaire responses from 196 auditors, demonstrate that an efficiency focus is not associated with dysfunctional behaviour. A client focus is found to be associated with dysfunctional behaviour. Finally, and perhaps most importantly......, our results show that it seems possible to limit dysfunctional behaviours through a quality focus in performance evaluations. Our results provide insights of use to practitioners and regulators on how performance evaluations may not only induce but also reduce dysfunctional auditor behaviours....

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Training effectiveness evaluation model

International Nuclear Information System (INIS)

Penrose, J.B.

1993-01-01

NAESCO's Training Effectiveness Evaluation Model (TEEM) integrates existing evaluation procedures with new procedures. The new procedures are designed to measure training impact on organizational productivity. TEEM seeks to enhance organizational productivity through proactive training focused on operation results. These results can be identified and measured by establishing and tracking performance indicators. Relating training to organizational productivity is not easy. TEEM is a team process. It offers strategies to assess more effectively organizational costs and benefits of training. TEEM is one organization's attempt to refine, manage and extend its training evaluation program

Evaluation of learning materials

DEFF Research Database (Denmark)

Bundsgaard, Jeppe; Hansen, Thomas Illum

2011-01-01

This paper presents a holistic framework for evaluating learning materials and designs for learning. A holistic evaluation comprises investigations of the potential learning potential, the actualized learning potential, and the actual learning. Each aspect is explained and exemplified through...

Comparison of two heuristic evaluation methods for evaluating the usability of health information systems.

Science.gov (United States)

Khajouei, Reza; Hajesmaeel Gohari, Sadrieh; Mirzaee, Moghaddameh

2018-04-01

In addition to following the usual Heuristic Evaluation (HE) method, the usability of health information systems can also be evaluated using a checklist. The objective of this study is to compare the performance of these two methods in identifying usability problems of health information systems. Eight evaluators independently evaluated different parts of a Medical Records Information System using two methods of HE (usual and with a checklist). The two methods were compared in terms of the number of problems identified, problem type, and the severity of identified problems. In all, 192 usability problems were identified by two methods in the Medical Records Information System. This was significantly higher than the number of usability problems identified by the checklist and usual method (148 and 92, respectively) (p information systems. The results demonstrated that the checklist method had significantly better performance in terms of the number of identified usability problems; however, the performance of the usual method for identifying problems of higher severity was significantly better. Although the checklist method can be more efficient for less experienced evaluators, wherever usability is critical, the checklist should be used with caution in usability evaluations. Copyright © 2018 Elsevier Inc. All rights reserved.

WP5 Evaluation: D54-D55 Evaluation Results V2 (V3)

NARCIS (Netherlands)

Van Rosmalen, Peter

2011-01-01

Van Rosmalen, P. (2010, 19 May). WP5 Evaluation: D54-D55 Evaluation Results V2 (V3). Presentation at idSpace Final Review, Heerlen, The Netherlands: Open University of the Netherlands. idSpace-project.

48 CFR 436.604 - Performance evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 4 2010-10-01 2010-10-01 false Performance evaluation... Performance evaluation. Preparation of performance evaluation reports. (a) In addition to the requirements of FAR 36.604, performance evaluation reports shall be prepared for indefinite-delivery type contracts...

48 CFR 2936.604 - Performance evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Performance evaluation... Performance evaluation. (a) The HCA must establish procedures to evaluate architect-engineer contractor... reports must be made using Standard Form 1421, Performance Evaluation (Architect-Engineer) as prescribed...

76 FR 30696 - Technology Evaluation Process

Science.gov (United States)

2011-05-26

...-NOA-0039] Technology Evaluation Process AGENCY: Office of Energy Efficiency and Renewable Energy... (DOE) seeks comments and information related to a commercial buildings technology evaluation process... evaluation efforts. The goal of creating this standard process is to evaluate energy-saving technologies in a...

The Evaluator Effect in Usability Tests

DEFF Research Database (Denmark)

Jacobsen, Niels Ebbe; Hertzum, Morten; John, Bonnie E.

1998-01-01

Usability tests are applied in industry to evaluate systems and in research as a yardstick for other usability evaluation methods. However, one potential threat to the reliability of usability tests has been left unaddressed: the evaluator effect. In this study, four evaluators analyzed four vide...

The Evaluation of Teaching and Learning.

Science.gov (United States)

Potocki-Malicet, Danielle; Holmesland, Icara; Estrela, Maria-Teresa; Veiga-Simao, Ana-Margarida

1999-01-01

Three different approaches to the evaluation of higher education in European and Scandinavian countries are examined: evaluation of a single discipline across institutions (Finland, Norway, Portugal, Spain, United Kingdom, northern Germany); evaluation of several disciplines within certain institutions (France, Germany); and internal evaluation of…

48 CFR 25.504 - Evaluation Examples.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Evaluation Examples. 25... PROGRAMS FOREIGN ACQUISITION Evaluating Foreign Offers-Supply Contracts 25.504 Evaluation Examples. The following examples illustrate the application of the evaluation procedures in 25.502 and 25.503. The...

Fear of negative evaluation biases social evaluation inference: evidence from a probabilistic learning task.

Science.gov (United States)

Button, Katherine S; Kounali, Daphne; Stapinski, Lexine; Rapee, Ronald M; Lewis, Glyn; Munafò, Marcus R

2015-01-01

Fear of negative evaluation (FNE) defines social anxiety yet the process of inferring social evaluation, and its potential role in maintaining social anxiety, is poorly understood. We developed an instrumental learning task to model social evaluation learning, predicting that FNE would specifically bias learning about the self but not others. During six test blocks (3 self-referential, 3 other-referential), participants (n = 100) met six personas and selected a word from a positive/negative pair to finish their social evaluation sentences "I think [you are / George is]…". Feedback contingencies corresponded to 3 rules, liked, neutral and disliked, with P[positive word correct] = 0.8, 0.5 and 0.2, respectively. As FNE increased participants selected fewer positive words (β = -0.4, 95% CI -0.7, -0.2, p = 0.001), which was strongest in the self-referential condition (FNE × condition 0.28, 95% CI 0.01, 0.54, p = 0.04), and the neutral and dislike rules (FNE × condition × rule, p = 0.07). At low FNE the proportion of positive words selected for self-neutral and self-disliked greatly exceeded the feedback contingency, indicating poor learning, which improved as FNE increased. FNE is associated with differences in processing social-evaluative information specifically about the self. At low FNE this manifests as insensitivity to learning negative self-referential evaluation. High FNE individuals are equally sensitive to learning positive or negative evaluation, which although objectively more accurate, may have detrimental effects on mental health.

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Evaluation of Two ESP Textbooks

Science.gov (United States)

Al Fraidan, Abdullah

2012-01-01

This paper evaluated two ESP textbooks using the evaluation of McDonough and Shaw (2003) based on external and internal evaluation. The first textbook is "Business Objectives" (1996) by Vicki Hollett, and the second textbook is "Business Studies, Second Edition" (2002) by Alain Anderton. To avoid repetition, I will use BO and…

28 CFR 90.21 - Evaluation.

Science.gov (United States)

2010-07-01

... 28 Judicial Administration 2 2010-07-01 2010-07-01 false Evaluation. 90.21 Section 90.21 Judicial...¢ Officers ⢠Prosecutors) Violence Against Women Formula Grant Program § 90.21 Evaluation. (a) The National Institute of Justice will conduct an evaluation of these programs. A portion of the overall funds authorized...

Lessons learned from completed evaluation reviews (1983 to mid-1993). Special evaluation review

International Nuclear Information System (INIS)

1993-01-01

With this in mind, the Agency in 1983 set up in the Department of Technical Co-operation an Evaluation Unit (upgraded to Section rank in 1986), to assist already existing self-evaluation efforts through a more systematic and independent approach and thus provide senior management with the information required for more efficient and effective programme planning and implementation. A first analysis of the lessons learned through technical co-operation evaluation was carried out after five years, in mid-1988. It included both lessons learned with regard to the procedures and components of the programme, in general, as well as the findings specific to individual projects or groups of projects, and reported on the resulting administrative changes introduced by the Agency with a view to improving the programme. The current review, covering the second five-year period, from mid-1988 to mid-1993, continued along the same lines, while also illustrating the changing pattern in the work of the Evaluation Section itself. In order to present a full picture of the activities and results of ten years of TC evaluation, this report combines the results of both reviews

1999 scientific evaluation at the CEA; L'evaluation scientifique 1999 au CEA

Energy Technology Data Exchange (ETDEWEB)

NONE

1999-07-01

This report presents a statement of the scientific and technical activity of the French atomic energy commission (CEA) for the year 1999. This evaluation is made by external and independent experts and requires some specific dispositions for the nuclear protection and safety institute (IPSN) and for the direction of military applications (DAM). The report is divided into 4 parts dealing successively with: 1)the CEA, a public research organization (strategy, research programs, new organization of the CEA activities, civil nuclear research, technology research and transfer, defence activities, transfer of knowledge) 2)the scientific evaluation at the CEA (evaluations of the civil applications of the CEA, IPSN, DAM, INSTN (national institute for nuclear sciences and techniques) 3)synthesis of the 1999 scientific and technical evaluation for each operational directions of the CEA (directions of fuel cycle, of nuclear reactors, of advanced technologies, of materials sciences, of life sciences, of military applications, of the nuclear protection and safety institute and of the national institute for nuclear sciences and techniques) 4)the corresponding members of the evaluation and the list of scientific and technical councils and members.

Software product family evaluation

NARCIS (Netherlands)

van der Linden, F; Bosch, J; Kamsties, E; Kansala, K; Krzanik, L; Obbink, H; VanDerLinden, F

2004-01-01

This paper proposes a 4-dimensional software product family engineering evaluation model. The 4 dimensions relate to the software engineering concerns of business, architecture, organisation and process. The evaluation model is meant to be used within organisations to determine the status of their

Reflections on Empowerment Evaluation: Learning from Experience.

Science.gov (United States)

Fetterman, David M.

1999-01-01

Reflects on empowerment evaluation, the use of evaluation to foster improvement and self-determination. Empowerment evaluation uses quantitative and qualitative methods, and usually focuses on program evaluation. Discusses the growth in empowerment evaluation as a result of interest in participatory evaluation. (SLD)

13 CFR 304.4 - Performance evaluations.

Science.gov (United States)

2010-01-01

... 13 Business Credit and Assistance 1 2010-01-01 2010-01-01 false Performance evaluations. 304.4... ECONOMIC DEVELOPMENT DISTRICTS § 304.4 Performance evaluations. (a) EDA shall evaluate the management... of at least one (1) other District Organization in the performance evaluation on a cost-reimbursement...

48 CFR 3015.606-2 - Evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Evaluation. 3015.606-2... Unsolicited Proposals 3015.606-2 Evaluation. (a) Comprehensive evaluations should be completed within sixty... contact point shall advise the offeror accordingly and provide a new evaluation completion date. The...

17 CFR 200.610 - Self-evaluation.

Science.gov (United States)

2010-04-01

... 17 Commodity and Securities Exchanges 2 2010-04-01 2010-04-01 false Self-evaluation. 200.610...-evaluation. (a) The agency shall, by September 6, 1989, evaluate its current policies and practices, and the... handicaps or organizations representing individuals with handicaps, to participate in the self-evaluation...

Evaluation of Probabilistic Disease Forecasts.

Science.gov (United States)

Hughes, Gareth; Burnett, Fiona J

2017-10-01

The statistical evaluation of probabilistic disease forecasts often involves calculation of metrics defined conditionally on disease status, such as sensitivity and specificity. However, for the purpose of disease management decision making, metrics defined conditionally on the result of the forecast-predictive values-are also important, although less frequently reported. In this context, the application of scoring rules in the evaluation of probabilistic disease forecasts is discussed. An index of separation with application in the evaluation of probabilistic disease forecasts, described in the clinical literature, is also considered and its relation to scoring rules illustrated. Scoring rules provide a principled basis for the evaluation of probabilistic forecasts used in plant disease management. In particular, the decomposition of scoring rules into interpretable components is an advantageous feature of their application in the evaluation of disease forecasts.

Nuclear models relevant to evaluation

International Nuclear Information System (INIS)

Arthur, E.D.; Chadwick, M.B.; Hale, G.M.; Young, P.G.

1991-01-01

The widespread use of nuclear models continues in the creation of data evaluations. The reasons include extension of data evaluations to higher energies, creation of data libraries for isotopic components of natural materials, and production of evaluations for radiative target species. In these cases, experimental data are often sparse or nonexistent. As this trend continues, the nuclear models employed in evaluation work move towards more microscopically-based theoretical methods, prompted in part by the availability of increasingly powerful computational resources. Advances in nuclear models applicable to evaluation will be reviewed. These include advances in optical model theory, microscopic and phenomenological state and level density theory, unified models that consistently describe both equilibrium and nonequilibrium reaction mechanism, and improved methodologies for calculation of prompt radiation from fission. 84 refs., 8 figs

Constructive eHealth evaluation

DEFF Research Database (Denmark)

Høstgaard, Anna Marie Balling; Bertelsen, Pernille Scholdan; Nøhr, Christian

2017-01-01

Abstract Background: Information and communication sources in the healthcare sector are replaced with new eHealth technologies. This has led to problems arising from the lack of awareness of the importance of end-user involvement in eHealth development and of the difficulties caused by using...... traditional summative evaluation methods. The Constructive eHealth evaluation method (CeHEM) provides a solution to these problems by offering an evaluation framework for supporting and facilitating end-user involvement during all phases of eHealth development. The aim of this paper is to support this process...... by sharing experiences of the eHealth evaluation method used in the introduction of electronic health records (EHR) in the North Denmark Region of Denmark. It is the first time the fully developed method and the experiences on using the CeHEM in all five phases of a full lifecycle framework is presented...

Process evaluation distributed system

Science.gov (United States)

Moffatt, Christopher L. (Inventor)

2006-01-01

The distributed system includes a database server, an administration module, a process evaluation module, and a data display module. The administration module is in communication with the database server for providing observation criteria information to the database server. The process evaluation module is in communication with the database server for obtaining the observation criteria information from the database server and collecting process data based on the observation criteria information. The process evaluation module utilizes a personal digital assistant (PDA). A data display module in communication with the database server, including a website for viewing collected process data in a desired metrics form, the data display module also for providing desired editing and modification of the collected process data. The connectivity established by the database server to the administration module, the process evaluation module, and the data display module, minimizes the requirement for manual input of the collected process data.

How to Evaluate Smart Cities’ Construction? A Comparison of Chinese Smart City Evaluation Methods Based on PSF

Directory of Open Access Journals (Sweden)

Hongbo Shi

2017-12-01

Full Text Available With the rapid development of smart cities in the world, research relating to smart city evaluation has become a new research hotspot in academia. However, there are general problems of cognitive deprivation, lack of planning experience, and low level of coordination in smart cities construction. It is necessary for us to develop a set of scientific, reasonable, and effective evaluation index systems and evaluation models to analyze the development degree of urban wisdom. Based on the theory of the urban system, we established a comprehensive evaluation index system for urban intelligent development based on the people-oriented, city-system, and resources-flow (PSF evaluation model. According to the characteristics of the comprehensive evaluation index system of urban intelligent development, the analytic hierarchy process (AHP combined with the experts’ opinions determine the index weight of this system. We adopted the neural network model to construct the corresponding comprehensive evaluation model to characterize the non-linear characteristics of the comprehensive evaluation indexes system, thus to quantitatively quantify the comprehensive evaluation indexes of urban intelligent development. Finally, we used the AHP, AHP-BP (Back Propagation, and AHP-ELM (Extreme Learning Machine models to evaluate the intelligent development level of 151 cities in China, and compared them from the perspective of model accuracy and time cost. The final simulation results show that the AHP-ELM model is the best evaluation model.

Use Case Evaluation (UCE): A Method for Early Usability Evaluation in Software Development

DEFF Research Database (Denmark)

Stage, Jan; Høegh, Rune Thaarup; Hornbæk, K.

2007-01-01

t is often argued that usability problems should be identified as early as possible during software development, but many usability evaluation methods do not fit well in early development activities. We propose a method for usability evaluation of use cases, a widely used representation of design...... ideas produced early in software development processes. The method proceeds by systematic inspection of use cases with reference to a set of guidelines for usable design. To validate the method, four evaluators inspected a set of use cases for a health care application....

Evaluation of components and systems of RSG-GAS and developing of maintenance evaluation software

International Nuclear Information System (INIS)

Pane, Jupiter-Sitorus; Kadarusmanto

2003-01-01

In order to enhance the evaluation of components and systems, inventarization of failure and repair data has been performed. The evaluation was done by calculating distribution function of failure, failure rate, MTTF, MTTR, and unavailability. The evaluation was comprehend in a code program of SYSCOM-RSG-GAS, that are able to performed statistical analysis, reliability parameters, and Fault Tree Analysis. This paper will describe some results of the program

Evaluation of English Websites on Dental Caries by Using Consumer Evaluation Tools.

Science.gov (United States)

Blizniuk, Anastasiya; Furukawa, Sayaka; Ueno, Masayuki; Kawaguchi, Yoko

2016-01-01

To evaluate the quality of patient-oriented online information about dental caries using existing consumer evaluation tools and to judge the efficacy of these tools in quality assessment. The websites for the evaluation were pooled by using two general search engines (Google and Yahoo!). The search terms were: 'dental caries', 'tooth decay' and 'tooth cavity'. Three assessment tools (LIDA, DISCERN and FRES) were used to evaluate the quality of the information in the areas of accessibility, usability, reliability and readability. In total, 77 websites were analysed. The median scores of LIDA accessibility and usability were 45.0 and 8.0, respectively, which corresponded to a medium level of quality. The median reliability scores for LIDA (12.0) and DISCERN (20.0) both corresponded to low level of quality. The readability was high with the median FRES score 59.7. The websites on caries had good accessibility, usability and readability, while reliability of the information was poor. The LIDA instrument was found to be more convenient than DISCERN and can be recommended to lay people for quick quality assessment.

15 CFR 286.7 - Evaluation process.

Science.gov (United States)

2010-01-01

... 15 Commerce and Foreign Trade 1 2010-01-01 2010-01-01 false Evaluation process. 286.7 Section 286... VOLUNTARY CONFORMITY ASSESSMENT SYSTEM EVALUATION (NVCASE) PROGRAM § 286.7 Evaluation process. (a) Each applicant requesting to be evaluated under NVCASE is expected to initiate the process and assume designated...

25 CFR 720.110 - Self-evaluation.

Science.gov (United States)

2010-04-01

... 25 Indians 2 2010-04-01 2010-04-01 false Self-evaluation. 720.110 Section 720.110 Indians THE...-evaluation. (a) The agency shall, by August 24, 1987, evaluate its current policies and practices, and the... or organizations representing handicapped persons, to participate in the self-evaluation process by...

Alternative Aviation Jet Fuel Sustainability Evaluation Report Task 1 : Report Evaluating Existing Sustainability Evaluation Programs

Science.gov (United States)

2011-10-25

This report describes how existing biofuel sustainability evaluation programs meet requirements that are under consideration or are in early phases of adoption and implementation in various US and international contexts. Biofuel sustainability evalua...

SHDAS Production Seismometer Evaluation.

Energy Technology Data Exchange (ETDEWEB)

Slad, George William [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Merchant, Bion J. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2017-11-01

The Seismo - Hydroacoustic Data Acquisition System (SHDAS) is undergoing evaluation in preparation for its engineering, development, and deployment by the U.S Navy as an ocean bottom seismic monitoring system. At the current stage of development, the production seismometers are being evaluated to confirm their performance prior to packaging and assembly for deployment. The testing of the seismometers is being conducted at the Pinon Flats Observatory (PFO) , supervised by Sandia National Laboratories, U.S Navy, and RP Kromer Consulting. SNL will conduct evaluation of the collected seismometer data and comment on the performance of the seismometers.

37 CFR 150.4 - Evaluation.

Science.gov (United States)

2010-07-01

... 37 Patents, Trademarks, and Copyrights 1 2010-07-01 2010-07-01 false Evaluation. 150.4 Section 150...(a)(2) § 150.4 Evaluation. (a) Upon submission of a request by a foreign government for the issuance... Director to initiate independently an evaluation pursuant to § 150.2(a) of this part, a notice will be...

Preliminary evaluation of alternative waste form solidification processes. Volume II. Evaluation of the processes

International Nuclear Information System (INIS)

1980-08-01

This Volume II presents engineering feasibility evaluations of the eleven processes for solidification of nuclear high-level liquid wastes (HHLW) described in Volume I of this report. Each evaluation was based in a systematic assessment of the process in respect to six principal evaluation criteria: complexity of process; state of development; safety; process requirements; development work required; and facility requirements. The principal criteria were further subdivided into a total of 22 subcriteria, each of which was assigned a weight. Each process was then assigned a figure of merit, on a scale of 1 to 10, for each of the subcriteria. A total rating was obtained for each process by summing the products of the subcriteria ratings and the subcriteria weights. The evaluations were based on the process descriptions presented in Volume I of this report, supplemented by information obtained from the literature, including publications by the originators of the various processes. Waste form properties were, in general, not evaluated. This document describes the approach which was taken, the developent and application of the rating criteria and subcriteria, and the evaluation results. A series of appendices set forth summary descriptions of the processes and the ratings, together with the complete numerical ratings assigned; two appendices present further technical details on the rating process

48 CFR 570.306 - Evaluating offers.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 4 2010-10-01 2010-10-01 false Evaluating offers. 570.306... Real Property 570.306 Evaluating offers. (a) You must evaluate offers solely in accordance with the... solicitation. The file must include the basis for evaluation, an analysis of each offer, and a summary of...

49 CFR 807.110 - Self-evaluation.

Science.gov (United States)

2010-10-01

... 49 Transportation 7 2010-10-01 2010-10-01 false Self-evaluation. 807.110 Section 807.110... TRANSPORTATION SAFETY BOARD § 807.110 Self-evaluation. (a) The agency shall, by April 9, 1987, evaluate its... participate in the self-evaluation process by submitting comments (both oral and written). (c) The agency...

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

Bid specifications and bid evaluations

International Nuclear Information System (INIS)

Zijl, N.A. van

1977-01-01

Bid specifications are in view of the size of these projects important and comprehensive documents. The basic content and set up of the specifications are discussed such as: 1) Bid invitation letter, 2) instruction to bidders, 3) draft contract (terms and conditions), 4) technical specifications, 5) side data and information. - The evaluations of bids for nuclear power stations is due to the complexity of such bids a difficult undertaking. Evaluation methods and approaches which can be applied for such bid evaluations are discussed as well as the preparations which are required for carrying out such evaluations. (orig.) [de

CEA SMAD 2016 Digitizer Evaluation.

Energy Technology Data Exchange (ETDEWEB)

Merchant, Bion J. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2017-08-01

Sandia National Laboratories has tested and evaluated an updated SMAD digitizer, developed by the French Alternative Energies and Atomic Energy Commission (CEA). The SMAD digitizers are intended to record sensor output for seismic and infrasound monitoring applications. The purpose of this digitizer evaluation is to measure the performance characteristics in such areas as power consumption, input impedance, sensitivity, full scale, self-noise, dynamic range, system noise, response, passband, and timing. The SMAD digitizers have been updated since their last evaluation by Sandia to improve their performance when recording at a sample rate of 20 Hz for infrasound applications and 100 Hz for hydro-acoustic seismic stations. This evaluation focuses primarily on the 20 Hz and 100 Hz sample rates. The SMAD digitizers are being evaluated for potential use in the International Monitoring System (IMS) of the Comprehensive Nuclear Test- Ban-Treaty Organization (CTBTO).

MVP and Faculty Evaluation

Science.gov (United States)

Theall, Michael

2017-01-01

This chapter considers faculty evaluation and motivational and volitional issues. The focus is on the ways in which faculty evaluation influences not only faculty attitudes and beliefs but also willingness to engage in professional development and instructional improvement programs. Recommendations for effective practice that enhances motivation…

Evaluating Distributed Timing Constraints

DEFF Research Database (Denmark)

Kristensen, C.H.; Drejer, N.

1994-01-01

In this paper we describe a solution to the problem of implementing time-optimal evaluation of timing constraints in distributed real-time systems.......In this paper we describe a solution to the problem of implementing time-optimal evaluation of timing constraints in distributed real-time systems....

22 CFR 711.110 - Self-evaluation.

Science.gov (United States)

2010-04-01

... 22 Foreign Relations 2 2010-04-01 2010-04-01 true Self-evaluation. 711.110 Section 711.110 Foreign... CORPORATION § 711.110 Self-evaluation. (a) The agency shall, by September 6, 1989, evaluate its current... participate in the self-evaluation process by submitting comments (both oral and written). (c) The agency...

20 CFR 365.110 - Self-evaluation.

Science.gov (United States)

2010-04-01

... 20 Employees' Benefits 1 2010-04-01 2010-04-01 false Self-evaluation. 365.110 Section 365.110... § 365.110 Self-evaluation. (a) The agency shall, by December 27, 1989, evaluate its current policies and... self-evaluation process by submitting comments (both oral and written). (c) The agency shall, until at...

29 CFR 100.510 - Self-evaluation.

Science.gov (United States)

2010-07-01

... 29 Labor 2 2010-07-01 2010-07-01 false Self-evaluation. 100.510 Section 100.510 Labor Regulations... § 100.510 Self-evaluation. (a) The agency shall, by September 6, 1989, evaluate its current policies and... participate in the self-evaluation process by submitting comments (both oral and written). (c) The agency...

19 CFR 201.110 - Self-evaluation.

Science.gov (United States)

2010-04-01

... 19 Customs Duties 3 2010-04-01 2010-04-01 false Self-evaluation. 201.110 Section 201.110 Customs... Commission § 201.110 Self-evaluation. (a) The agency shall, by April 9, 1987, evaluate its current policies... in the self-evaluation process by submitting comments (both oral and written). (c) The agency shall...

Fear of Negative Evaluation Biases Social Evaluation Inference: Evidence from a Probabilistic Learning Task

Science.gov (United States)

Button, Katherine S.; Kounali, Daphne; Stapinski, Lexine; Rapee, Ronald M.; Lewis, Glyn; Munafò, Marcus R.

2015-01-01

Background Fear of negative evaluation (FNE) defines social anxiety yet the process of inferring social evaluation, and its potential role in maintaining social anxiety, is poorly understood. We developed an instrumental learning task to model social evaluation learning, predicting that FNE would specifically bias learning about the self but not others. Methods During six test blocks (3 self-referential, 3 other-referential), participants (n = 100) met six personas and selected a word from a positive/negative pair to finish their social evaluation sentences “I think [you are / George is]…”. Feedback contingencies corresponded to 3 rules, liked, neutral and disliked, with P[positive word correct] = 0.8, 0.5 and 0.2, respectively. Results As FNE increased participants selected fewer positive words (β = −0.4, 95% CI −0.7, −0.2, p = 0.001), which was strongest in the self-referential condition (FNE × condition 0.28, 95% CI 0.01, 0.54, p = 0.04), and the neutral and dislike rules (FNE × condition × rule, p = 0.07). At low FNE the proportion of positive words selected for self-neutral and self-disliked greatly exceeded the feedback contingency, indicating poor learning, which improved as FNE increased. Conclusions FNE is associated with differences in processing social-evaluative information specifically about the self. At low FNE this manifests as insensitivity to learning negative self-referential evaluation. High FNE individuals are equally sensitive to learning positive or negative evaluation, which although objectively more accurate, may have detrimental effects on mental health. PMID:25853835

University Teacher’s Evaluation in Spain

Directory of Open Access Journals (Sweden)

Francisco Javier Tejedor Tejedor

2008-08-01

Full Text Available This article intends to make a brief overview about the performance evaluation for university teachers in democratic Spain. It contents: a considerations about teaching evaluation, in order to delimit the authors’ position in this matter, due to the fact that this position obviously conditions any revision; b a brief summary of the history of university teachers evaluation in Spain during the last years, since the Spanish Constitution of 1978 approval; c a typology of the evaluation plans, in order to define a map of the planning lines for evaluations applied in Spain; d the technical guidelines for teachers´ evaluation and presentation of the current model, exampled by its application in the university of Salamanca; and e as a conclusion, some considerations about the consequences of evaluation and its entailment with the professionalization of university teachers.

Enhanced sludge washing evaluation plan

Energy Technology Data Exchange (ETDEWEB)

Jensen, R.D.

1994-09-01

The Tank Waste Remediation System (TWRS) Program mission is to store, treat, and immobilize highly radioactive Hanford Site waste (current and future tank waste and the strontium/cesium capsules) in an environmentally sound, safe, and cost-effective manner. The scope of the TWRS Waste Pretreatment Program is to treat tank waste and separate that waste into HLW and LLW fractions and provide additional treatment as required to feed LLW and HLW immobilization facilities. Enhanced sludge washing was chosen as the baseline process for separating Hanford tank waste sludge. Section 1.0 briefly discusses the purpose of the evaluation plan and provides the background that led to the choice of enhanced sludge washing as the baseline process. Section 2.0 provides a brief summary of the evaluation plan details. Section 3.0 discusses, in some detail, the technical work planned to support the evaluation of enhanced sludge washing. Section 4.0 briefly discusses the potential important of policy issues to the evaluation. Section 5.0 discusses the methodology to be used in the evaluation process. Section 6.0 summarizes the milestones that have been defined to complete the enhanced sludge washing evaluation and provides a summary schedule to evaluate the performance of enhanced sludge washing. References are identified in Section 7.0, and additional schedule and milestone information is provided in the appendices.

Environmental indicators for evaluating properties

Directory of Open Access Journals (Sweden)

Mario Grosso

2015-06-01

Full Text Available Property evaluation for tax purposes has traditionally relied on urban and building criteria, mostly resulting from concepts driven by the commercial attractiveness of the property under evaluation, its building and the site itself. Due to the world climate and ecological crisis, awareness has risen about the need for other indicators, which can evaluate the quality of a property, even referring to its potential environmental impact. Technical standards for the evaluation of buildings’ environmental sustainability, which have been developed since the first years of this century, both nationally and internationally, take into account the impact of the building and its relevance for the life-cycle of materials and elements, with reference to the three sectors of sustainability: environmental, economic and social. The social sector includes indicators referring to the user’s health and comfort, which also interact with the morphological and spatial characteristics of the building. However, there is a lack of methodological tools for the evaluation of said indicators and existing ones are mainly of a qualitative type. This paper suggests a methodological approach for the quantitative evaluation of sustainability indicators, relying on the accessibility of a site’s climate resources by the property, as a criterion to evaluate the potential for the reduction of negative environmental impact, as well as a criterion to improve users’ life quality.

Enhanced sludge washing evaluation plan

International Nuclear Information System (INIS)

Jensen, R.D.

1994-09-01

The Tank Waste Remediation System (TWRS) Program mission is to store, treat, and immobilize highly radioactive Hanford Site waste (current and future tank waste and the strontium/cesium capsules) in an environmentally sound, safe, and cost-effective manner. The scope of the TWRS Waste Pretreatment Program is to treat tank waste and separate that waste into HLW and LLW fractions and provide additional treatment as required to feed LLW and HLW immobilization facilities. Enhanced sludge washing was chosen as the baseline process for separating Hanford tank waste sludge. Section 1.0 briefly discusses the purpose of the evaluation plan and provides the background that led to the choice of enhanced sludge washing as the baseline process. Section 2.0 provides a brief summary of the evaluation plan details. Section 3.0 discusses, in some detail, the technical work planned to support the evaluation of enhanced sludge washing. Section 4.0 briefly discusses the potential important of policy issues to the evaluation. Section 5.0 discusses the methodology to be used in the evaluation process. Section 6.0 summarizes the milestones that have been defined to complete the enhanced sludge washing evaluation and provides a summary schedule to evaluate the performance of enhanced sludge washing. References are identified in Section 7.0, and additional schedule and milestone information is provided in the appendices

Integrated Assessment Model Evaluation

Science.gov (United States)

Smith, S. J.; Clarke, L.; Edmonds, J. A.; Weyant, J. P.

2012-12-01

Integrated assessment models of climate change (IAMs) are widely used to provide insights into the dynamics of the coupled human and socio-economic system, including emission mitigation analysis and the generation of future emission scenarios. Similar to the climate modeling community, the integrated assessment community has a two decade history of model inter-comparison, which has served as one of the primary venues for model evaluation and confirmation. While analysis of historical trends in the socio-economic system has long played a key role in diagnostics of future scenarios from IAMs, formal hindcast experiments are just now being contemplated as evaluation exercises. Some initial thoughts on setting up such IAM evaluation experiments are discussed. Socio-economic systems do not follow strict physical laws, which means that evaluation needs to take place in a context, unlike that of physical system models, in which there are few fixed, unchanging relationships. Of course strict validation of even earth system models is not possible (Oreskes etal 2004), a fact borne out by the inability of models to constrain the climate sensitivity. Energy-system models have also been grappling with some of the same questions over the last quarter century. For example, one of "the many questions in the energy field that are waiting for answers in the next 20 years" identified by Hans Landsberg in 1985 was "Will the price of oil resume its upward movement?" Of course we are still asking this question today. While, arguably, even fewer constraints apply to socio-economic systems, numerous historical trends and patterns have been identified, although often only in broad terms, that are used to guide the development of model components, parameter ranges, and scenario assumptions. IAM evaluation exercises are expected to provide useful information for interpreting model results and improving model behavior. A key step is the recognition of model boundaries, that is, what is inside

Creating Robust Evaluation of ATE Projects

Science.gov (United States)

Eddy, Pamela L.

2017-01-01

Funded grant projects all involve some form of evaluation, and Advanced Technological Education (ATE) grants are no exception. Program evaluation serves as a critical component not only for evaluating if a project has met its intended and desired outcomes, but the evaluation process is also a central feature of the grant application itself.…

Using Social Scientific Criteria to Evaluate Cultural Theories: Encoding/Decoding Evaluated

OpenAIRE

Evan L. Kropp

2015-01-01

This article transcends the issue of conflicting theoretical schools of thought to formulate a method of social scientific style theory evaluation for cultural studies. It is suggested that positivist social scientific models of theory critique can be used to assess cultural models of communication to determine if they should be classified as theories. A set of evaluation criteria is formulated as a guide and applied to Stuart Hall’s Encoding/Decoding to determine if it is a theory. Conclusio...

Measuring Evaluation Fears in Adolescence: Psychometric Validation of the Portuguese Versions of the Fear of Positive Evaluation Scale and the Specific Fear of Negative Evaluation Scale

Science.gov (United States)

Vagos, Paula; Salvador, Maria do Céu; Rijo, Daniel; Santos, Isabel M.; Weeks, Justin W.; Heimberg, Richard G.

2016-01-01

Modified measures of Fear of Negative Evaluation and Fear of Positive Evaluation were examined among Portuguese adolescents. These measures demonstrated replicable factor structure, internal consistency, and positive relationships with social anxiety and avoidance. Gender differences were found. Implications for evaluation and intervention are…

Impact of Digital Tooth Preparation Evaluation Technology on Preclinical Dental Students' Technical and Self-Evaluation Skills.

Science.gov (United States)

Gratton, David G; Kwon, So Ran; Blanchette, Derek; Aquilino, Steven A

2016-01-01

The aim of this study was to evaluate the effect of digital tooth preparation imaging and evaluation technology on dental students' technical abilities, self-evaluation skills, and the assessment of their simulated clinical work. A total of 80 second-year students at one U.S. dental school were assigned to one of three groups: control (n=40), E4D Compare (n=20), and Sirona prepCheck (n=20). Students in the control group were taught by traditional teaching methodologies, and the technology-assisted groups received both traditional training and supplementary feedback from the corresponding digital system. Three outcomes were measured: faculty technical score, self-evaluation score, and E4D Compare scores at 0.30 mm tolerance. Correlations were determined between the groups' scores from visual assessment and self-evaluation and between the visual assessment and digital scores. The results showed that the visual assessment and self-evaluation scores did not differ among groups (p>0.05). Overall, correlations between visual and digital assessment scores were modest though statistically significant (5% level of significance). These results suggest that the use of digital tooth preparation evaluation technology did not impact the students' prosthodontic technical and self-evaluation skills. Visual scores given by faculty and digital assessment scores correlated moderately in only two instances.

Evaluation Use in the Organizational Context

DEFF Research Database (Denmark)

Højlund, Steven

2014-01-01

betterment. The article explains why the paradox exists and suggests applying organizational institutional theory to explain evaluation use. The key argument is that in order to explain all types of evaluation uses, including non-use and justificatory uses, the focus needs to be on the evaluating...... organization and its conditioning factors, rather than the evaluation itself....

Empirically evaluating decision-analytic models.

Science.gov (United States)

Goldhaber-Fiebert, Jeremy D; Stout, Natasha K; Goldie, Sue J

2010-08-01

Model-based cost-effectiveness analyses support decision-making. To augment model credibility, evaluation via comparison to independent, empirical studies is recommended. We developed a structured reporting format for model evaluation and conducted a structured literature review to characterize current model evaluation recommendations and practices. As an illustration, we applied the reporting format to evaluate a microsimulation of human papillomavirus and cervical cancer. The model's outputs and uncertainty ranges were compared with multiple outcomes from a study of long-term progression from high-grade precancer (cervical intraepithelial neoplasia [CIN]) to cancer. Outcomes included 5 to 30-year cumulative cancer risk among women with and without appropriate CIN treatment. Consistency was measured by model ranges overlapping study confidence intervals. The structured reporting format included: matching baseline characteristics and follow-up, reporting model and study uncertainty, and stating metrics of consistency for model and study results. Structured searches yielded 2963 articles with 67 meeting inclusion criteria and found variation in how current model evaluations are reported. Evaluation of the cervical cancer microsimulation, reported using the proposed format, showed a modeled cumulative risk of invasive cancer for inadequately treated women of 39.6% (30.9-49.7) at 30 years, compared with the study: 37.5% (28.4-48.3). For appropriately treated women, modeled risks were 1.0% (0.7-1.3) at 30 years, study: 1.5% (0.4-3.3). To support external and projective validity, cost-effectiveness models should be iteratively evaluated as new studies become available, with reporting standardized to facilitate assessment. Such evaluations are particularly relevant for models used to conduct comparative effectiveness analyses.

Using organisational memory in evaluations

Directory of Open Access Journals (Sweden)

Madri S. Jansen van Rensburg

2014-12-01

Full Text Available This article uses the case of a regional intermediary organisation to investigate organisational memory (OM and its contribution to knowledge management and activities in evaluations. Understanding of, and accessing OM is critical for participatory evaluations. The aim of the article is to reflect on the OM of a non-governmental organisation (NGO and what implicationsthe structural changes in OM over the organisation’s life cycle have for evaluators. It further aims to advocate an awareness of OM and explains how evaluators can access and utilise it more effectively. Evaluators need to have an understanding of OM, and to take more responsibility for disseminating results to enhance it. This case study reflects on a retrospective case example of a regional NGO. The report reflects the development and structure of the life cycle of the organisation. The data collection included in-depth interviews with staff members and other key stakeholders, engagement with beneficiary organisations and donors, and analyses of documents, electronic files and audio-visual material. Since OM survives after the demise of an organisation, and is accessible through directories, it is important for the evaluator to include historical information. Specific implications for evaluators include the ability to access OM through directories and networks of the organisation. As evaluators hold OM of all the organisations they have engaged with, they also have a responsibility to share knowledge. The key findings of this study illustrate the importance of accessing the memory and historical information of the organisation. Understanding OM enhances the in-depth comprehension of the activity, project or programme under investigation, and the collective knowledge generated as a result of it.

What and How Are We Evaluating? Meta-Evaluation Study of the NASA Innovations in Climate Education (NICE) Portfolio

Science.gov (United States)

Martin, A. M.; Barnes, M. H.; Chambers, L. H.; Pippin, M. R.

2013-12-01

As part of NASA's Minority University Research and Education Program (MUREP), the NASA Innovations in Climate Education (NICE) project at Langley Research Center has funded 71 climate education initiatives since 2008. The funded initiatives span across the nation and contribute to the development of a climate-literate public and the preparation of a climate-related STEM workforce through research experiences, professional development opportunities, development of data access and modeling tools, and educational opportunities in both K-12 and higher education. Each of the funded projects proposes and carries out its own evaluation plan, in collaboration with external or internal evaluation experts. Using this portfolio as an exemplar case, NICE has undertaken a systematic meta-evaluation of these plans, focused primarily on evaluation questions, approaches, and methods. This meta-evaluation study seeks to understand the range of evaluations represented in the NICE portfolio, including descriptive information (what evaluations, questions, designs, approaches, and methods are applied?) and questions of value (do these evaluations meet the needs of projects and their staff, and of NASA/NICE?). In the current climate, as federal funders of climate change and STEM education projects seek to better understand and incorporate evaluation into their decisions, evaluators and project leaders are also seeking to build robust understanding of program effectiveness. Meta-evaluations like this provide some baseline understanding of the current status quo and the kinds of evaluations carried out within such funding portfolios. These explorations are needed to understand the common ground between evaluative best practices, limited resources, and agencies' desires, capacity, and requirements. When NASA asks for evaluation of funded projects, what happens? Which questions are asked and answered, using which tools? To what extent do the evaluations meet the needs of projects and

Stream Evaluation

Data.gov (United States)

Kansas Data Access and Support Center — Digital representation of the map accompanying the "Kansas stream and river fishery resource evaluation" (R.E. Moss and K. Brunson, 1981.U.S. Fish and Wildlife...

Thermal environment evaluation. Evaluation de l'ambiance thermique

Energy Technology Data Exchange (ETDEWEB)

Tilley, B

1988-01-01

This document describes interior thermal environment analysis and the techniques involved at three applicable stages of evaluation. They range from the study of plans and archives to physical measurement with sophisticated instrumentation. Environmental factors that influence the thermal state of the building occupant are measured. The occupant's perception of the thermal environment may also be investigated. One of the most important building functions is to isolate the occupants from adverse exterior thermal conditions and provide a productive and healthy interior environment. The thermal environment is determined by clothing level, activity level, air velocity, ambient air temperature, mean radiant temperature and moisture level. Since an optimal thermal environment may not be optimal in terms of the building's energy efficiency, the evaluation process will have to draw upon expertise in energy use and other disciplines at the stage where solutions are recommended. 16 refs., 4 figs., 2 tabs.

Data-Intensive Evaluation: The Concept, Methods, and Prospects of Higher Education Monitoring Evaluation

Science.gov (United States)

Wang, Zhanjun; Qiao, Weifeng; Li, Jiangbo

2016-01-01

Higher education monitoring evaluation is a process that uses modern information technology to continually collect and deeply analyze relevant data, visually present the state of higher education, and provide an objective basis for value judgments and scientific decision making by diverse bodies Higher education monitoring evaluation is…

Evaluated data collections from ENSDF

International Nuclear Information System (INIS)

Ewbank, W.B.

1979-01-01

For several years the Nuclear Data Project has been maintaining an Evaluated Nuclear Structure Data File (ENSDF), which is designed to include critically evaluated values for most nuclear spectroscopic quantities. The information in ENSDF is the same as in the Nuclear Data Sheets, which illustrates two particular output formats (drawings and tables). Spectroscopic information for nuclei with A < 45 is put into ENSDF from the evaluations of Aizenberg-Selove and of Endt and van der Leun. An international network was organized to provide regular revisions of the data file. Computer facilities were developed to retrieve collections of evaluated data for special calculations or detailed examination

Evaluation of IP Portfolios

DEFF Research Database (Denmark)

Søberg, Peder Veng

2009-01-01

As a result of an inquiry concerning how to evaluate IP (intellectual property) portfolios in order to enable the best possible use of IP resources within organizations, an IP evaluation approach primarily applicable for patents and utility models is developed. The developed approach is useful...... of the organization owning the IP....

Evaluating New Technology.

Science.gov (United States)

Carniol, Paul J; Heffelfinger, Ryan N; Grunebaum, Lisa D

2018-05-01

There are multiple complex issues to consider when evaluating any new technology. First evaluate the efficacy of the device. Then considering your patient population decide whether this technology brings an added benefit to your patients. If it meets these 2 criteria, then proceed to the financial analysis of acquiring this technology. The complete financial analysis has several important components that include but are not limited to cost, value, alternatives, return on investment, and associated marketing expense. Copyright © 2018 Elsevier Inc. All rights reserved.

Institutional design and utilization of evaluation: a contribution to a theory of evaluation influence based on Swiss experience.

Science.gov (United States)

Balthasar, Andreas

2009-06-01

Growing interest in the institutionalization of evaluation in the public administration raises the question as to which institutional arrangement offers optimal conditions for the utilization of evaluations. Institutional arrangement denotes the formal organization of processes and competencies, together with procedural rules, that are applicable independently of individual evaluation projects. It reflects the evaluation practice of an institution and defines the distance between evaluators and evaluees. This article outlines the results of a broad-based study of all 300 or so evaluations that the Swiss Federal Administration completed from 1999 to 2002. On this basis, it derives a theory of the influence of institutional factors on the utilization of evaluations.

A human-machine interface evaluation method: A difficulty evaluation method in information searching (DEMIS)

International Nuclear Information System (INIS)

Ha, Jun Su; Seong, Poong Hyun

2009-01-01

A human-machine interface (HMI) evaluation method, which is named 'difficulty evaluation method in information searching (DEMIS)', is proposed and demonstrated with an experimental study. The DEMIS is based on a human performance model and two measures of attentional-resource effectiveness in monitoring and detection tasks in nuclear power plants (NPPs). Operator competence and HMI design are modeled to be most significant factors to human performance. One of the two effectiveness measures is fixation-to-importance ratio (FIR) which represents attentional resource (eye fixations) spent on an information source compared to importance of the information source. The other measure is selective attention effectiveness (SAE) which incorporates FIRs for all information sources. The underlying principle of the measures is that the information source should be selectively attended to according to its informational importance. In this study, poor performance in information searching tasks is modeled to be coupled with difficulties caused by poor mental models of operators or/and poor HMI design. Human performance in information searching tasks is evaluated by analyzing the FIR and the SAE. Operator mental models are evaluated by a questionnaire-based method. Then difficulties caused by a poor HMI design are evaluated by a focused interview based on the FIR evaluation and then root causes leading to poor performance are identified in a systematic way.

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation of high-performance computing software

Energy Technology Data Exchange (ETDEWEB)

Browne, S.; Dongarra, J. [Univ. of Tennessee, Knoxville, TN (United States); Rowan, T. [Oak Ridge National Lab., TN (United States)

1996-12-31

The absence of unbiased and up to date comparative evaluations of high-performance computing software complicates a user`s search for the appropriate software package. The National HPCC Software Exchange (NHSE) is attacking this problem using an approach that includes independent evaluations of software, incorporation of author and user feedback into the evaluations, and Web access to the evaluations. We are applying this approach to the Parallel Tools Library (PTLIB), a new software repository for parallel systems software and tools, and HPC-Netlib, a high performance branch of the Netlib mathematical software repository. Updating the evaluations with feed-back and making it available via the Web helps ensure accuracy and timeliness, and using independent reviewers produces unbiased comparative evaluations difficult to find elsewhere.

Evaluating Usability

DEFF Research Database (Denmark)

Nørgaard, Mie; Høegh, Rune T.

2008-01-01

Usability evaluation is widely accepted as a valuable activity in software development. However, how results effectively are fed back to developers is still a relatively unexplored area. We argue that usability feedback can be understood as an argument for a series of usability problems......, and that basic concepts from argumentation theory can help us understand how to create persuasive feedback. We revisit two field studies on usability feedback to study if concepts from Toulmin's model for argumentation and Aristotle's modes of persuasion can explain why some feedback formats outperform others....... We recommend that evaluators specifically back up the warrants behind their usability claims, that their arguments use several modes of persuasion, and that they present feedback in browsable amounts not to overwhelm developers with information. For complex and controversial problems, we advise...

Can complex health interventions be evaluated using routine clinical and administrative data? - a realist evaluation approach.

Science.gov (United States)

Riippa, Iiris; Kahilakoski, Olli-Pekka; Linna, Miika; Hietala, Minni

2014-12-01

Interventions aimed at improving chronic care typically consist of multiple interconnected parts, all of which are essential to the effect of the intervention. Limited attention has been paid to the use of routine clinical and administrative data in the evolution of these complex interventions. The purpose of this study is to examine the feasibility of routinely collected data when evaluating complex interventions and to demonstrate how a theory-based, realist approach to evaluation may increase the feasibility of routine data. We present a case study of evaluating a complex intervention, namely, the chronic care model (CCM), in Finnish primary health care. Issues typically faced when evaluating the effects of a complex intervention on health outcomes and resource use are identified by using routine data in a natural setting, and we apply context-mechanism-outcome (CMO) approach from the realist evaluation paradigm to improve the feasibility of using routine data in evaluating complex interventions. From an experimentalist approach that dominates the medical literature, routine data collected from a single centre offered a poor starting point for evaluating complex interventions. However, the CMO approach offered tools for identifying indicators needed to evaluate complex interventions. Applying the CMO approach can aid in a typical evaluation setting encountered by primary care managers: one in which the intervention is complex, the primary data source is routinely collected clinical and administrative data from a single centre, and in which randomization of patients into two research arms is too resource consuming to arrange. © 2014 John Wiley & Sons, Ltd.

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Evaluation guide for the international reactor physics experiments evaluation project (IRPhEP)

International Nuclear Information System (INIS)

Yamaji, Akifumi

2013-01-01

At present, there is an urgent need to preserve integral reactor physics experimental data including separate or special effects data for nuclear energy and technology applications and the knowledge and competence contained therein. The International Reactor Physics Evaluation Project (IRPhEP) was initiated as a pilot activity in 1999 by the Organization of Economic Cooperation and Development (OECD) Nuclear Energy Agency (NEA) Nuclear Science Committee (NSC). The project was endorsed as an official activity of the NSC in June of 2003. While coordination and administration of the IRPhEP takes place at an international level, each participating country is responsible for the administration, technical direction, and priorities of the project within their respective countries. This document outlines the general presentation guidelines that evaluators should follow for the description of the experiments and all relevant experimental data in order to ensure the consistency between the evaluations published in the final Handbook. Publication templates will be used to ensure this consistency and will follow the general scheme below: 1 - Experiment identification number; 2- Date; 3 - Name of experiment (Purpose of experiment, Phenomena measured and scope); 4 - Name or designation of experimental programme; 5 - Description of facility; 6 - Description of test or experiment (Experimental configuration, Core life cycle, Experimental limitations or shortcomings); 7 - Phenomena measured (Description of results and analysis, Special features and characteristics of experiment, Measurement systems/methods and uncertainties); 8 - Duplicate or complementary experiments / other related experiments; 9 - Status of completion of the evaluation; 10 - References (pointer to evaluation, archive if available, otherwise generic bibliographic reference); 11 - Authors/ organisers 12 - Material available

Theory-Based Stakeholder Evaluation

Science.gov (United States)

Hansen, Morten Balle; Vedung, Evert

2010-01-01

This article introduces a new approach to program theory evaluation called theory-based stakeholder evaluation or the TSE model for short. Most theory-based approaches are program theory driven and some are stakeholder oriented as well. Practically, all of the latter fuse the program perceptions of the various stakeholder groups into one unitary…

Evaluation of the Neutron Data Standards

Science.gov (United States)

Carlson, A. D.; Pronyaev, V. G.; Capote, R.; Hale, G. M.; Chen, Z.-P.; Duran, I.; Hambsch, F.-J.; Kunieda, S.; Mannhart, W.; Marcinkevicius, B.; Nelson, R. O.; Neudecker, D.; Noguere, G.; Paris, M.; Simakov, S. P.; Schillebeeckx, P.; Smith, D. L.; Tao, X.; Trkov, A.; Wallner, A.; Wang, W.

2018-02-01

With the need for improving existing nuclear data evaluations, (e.g., ENDF/B-VIII.0 and JEFF-3.3 releases) the first step was to evaluate the standards for use in such a library. This new standards evaluation made use of improved experimental data and some developments in the methodology of analysis and evaluation. In addition to the work on the traditional standards, this work produced the extension of some energy ranges and includes new reactions that are called reference cross sections. Since the effort extends beyond the traditional standards, it is called the neutron data standards evaluation. This international effort has produced new evaluations of the following cross section standards: the H(n,n), 6Li(n,t), 10B(n,α), 10B(n,α1 γ), natC(n,n), Au(n,γ), 235U(n,f) and 238U(n,f). Also in the evaluation process the 238U(n,γ) and 239Pu(n,f) cross sections that are not standards were evaluated. Evaluations were also obtained for data that are not traditional standards: the Maxwellian spectrum averaged cross section for the Au(n,γ) cross section at 30 keV; reference cross sections for prompt γ-ray production in fast neutron-induced reactions; reference cross sections for very high energy fission cross sections; the 252Cf spontaneous fission neutron spectrum and the 235U prompt fission neutron spectrum induced by thermal incident neutrons; and the thermal neutron constants. The data and covariance matrices of the uncertainties were obtained directly from the evaluation procedure.

Updating the FORECAST formative evaluation approach and some implications for ameliorating theory failure, implementation failure, and evaluation failure

Science.gov (United States)

Katz, Jason; Wandersman, Abraham; Goodman, Robert M.; Griffin, Sarah; Wilson, Dawn K.; Schillaci, Michael

2013-01-01

Historically, there has been considerable variability in how formative evaluation has been conceptualized and practiced. FORmative Evaluation Consultation And Systems Technique (FORECAST) is a formative evaluation approach that develops a set of models and processes that can be used across settings and times, while allowing for local adaptations and innovations. FORECAST integrates specific models and tools to improve limitations in program theory, implementation, and evaluation. In the period since its initial use in a federally funded community prevention project in the early 1990s, evaluators have incorporated important formative evaluation innovations into FORECAST, including the integration of feedback loops and proximal outcome evaluation. In addition, FORECAST has been applied in a randomized community research trial. In this article, we describe updates to FORECAST and the implications of FORECAST for ameliorating failures in program theory, implementation, and evaluation. PMID:23624204

Research status and evaluation system of heat source evaluation method for central heating

Science.gov (United States)

Sun, Yutong; Qi, Junfeng; Cao, Yi

2018-02-01

The central heating boiler room is a regional heat source heating center. It is also a kind of the urban environment pollution, it is an important section of building energy efficiency. This article through to the evaluation method of central heating boiler room and overviews of the researches during domestic and overseas, summarized the main influence factors affecting energy consumption of industrial boiler under the condition of stable operation. According to the principle of establishing evaluation index system. We can find that is great significance in energy saving and environmental protection for the content of the evaluation index system of the centralized heating system.

Economic bid evaluation

International Nuclear Information System (INIS)

Bode, T.

1975-01-01

When it is intended to install a new nuclear power station, the usual procedure is to invite for tenders. In due course, bids will be received from various manufacturers, out of which the most favourable one is then to be selected. Appraisal is concluded in the Economic Bid Evaluation, the purpose of which is to define the economically most favourable bid by comparing overall costs and benefits of the various alternatives. Thus, Economic Bid Evaluation is a most important instrument for deciding on award of contract. (orig.) [de

Advancing Physics evaluated

Science.gov (United States)

Ogborn, Jon

2003-07-01

The first phase of an evaluation of the new AS/A-level course Advancing Physics, sponsored by the Institute of Physics, is now complete. It shows that the course has achieved very high satisfaction ratings from teachers of the course, and that a majority of these teachers see it as achieving its main aims. The first phase of the evaluation was designed to pinpoint aspects of Advancing Physics that offer scope for improvement. Two such aspects have been identified: course planning and use of the CD-ROM material, and arrangements for coursework in the examination.

Evaluation and processing of nuclear data

International Nuclear Information System (INIS)

Pearlstein, S.

1980-01-01

The role a nuclear data evaluator plays in obtaining evaluated nuclear data, needed for applications, from measured nuclear data is surveyed. Specific evaluation objectives, problems, and procedures are discussed. The use of nuclear systematics to complement nuclear experiment and theory is described. With the Evaluated Nuclear Data File (ENDF) as an example, the formatting, checking, and processing of nuclear data are discussed as well as the testing of evaluated nuclear data in the calculation of integral benchmark experiments. Other important topics such as the Probability Table Method and interrelation between differential and integral data are also discussed. 25 figures

Evaluation and processing of nuclear data

International Nuclear Information System (INIS)

Pearlstein, S.

1981-01-01

The role a nuclear data evaluator plays in obtaining evaluated nuclear data, needed for applications, from measured nuclear data is surveyed. Specific evaluation objectives, problems, and procedures are discussed. The use of nuclear systematics to complement nuclear experiment and theory is described. Using the Evaluated Nuclear Data File (ENDF) as an example the formatting, checking, and processing of nuclear data is discussed as well as the testing of evaluated nuclear data in the calculation of integral benchmark experiments. Other important topics such as the Probability Table Method and interrelation between differential and integral data are also discussed. (author)

US evaluation of anterior urethra

International Nuclear Information System (INIS)

Perini, L.; Cavallo, A.; Perin, B.; Natale, F.

1989-01-01

A simple method of sonographic (US) evaluation of penile and bulbous urethra is reported. Twenty-three dysuric patients were examined. They were divided into 2 groups according to their pathology. The US patterns of normal urethra were evaluated in 10 patients (first group) with no obstructive lesions. Urethral and periurethral structure were examined in 13 patients (second group) with urethral obstructive pathology. All patients underwent conventional cystourethrography. The diagnostic parameters considered were urethral gauge and thickness, echogenicity of the urethral wall, and Cowper's glands. US evaluation of obstructive lesions provided the same findings as conventional radiological techniques. Moreover, US allowed the evaluation of both thickness and echogenicity of the urethral wall and of normal/injured Cowper's glands

Public health interventions: evaluating the economic evaluations

Directory of Open Access Journals (Sweden)

Martin Forster

2013-10-01

Full Text Available Recent years have witnessed much progress in the incorporation of economic considerations into the evaluation of public health interventions. In England, the Centre for Public Health Excellence within the National Institute for Health and Care Excellence works to develop guidance for preventing illness and assessing which public health interventions are most effective and provide best value for money...

The Urban Intensive Land-use Evaluation in Xi’an, Based on Fuzzy Comprehensive Evaluation

Science.gov (United States)

Shi, Ru; Kang, Zhiyuan

2018-01-01

The intensive land-use is the basis of urban “stock optimization”, and scientific and reasonable evaluation is the important content of the land-intensive utilization. In this paper, through the survey of Xi’an urban land-use condition, we construct the suitable evaluation index system of Xi’an’ intensive land-use, by using Analytic Hierarchy Process (AHP) and Fuzzy Comprehensive Evaluation (FCE) of combination. And through the analysis of the influencing factors of land-intensive utilization, we provide a reference for the future development direction.

Evaluation of accountability measurements

International Nuclear Information System (INIS)

Cacic, C.G.

1988-01-01

The New Brunswick Laboratory (NBL) is programmatically responsible to the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) for providing independent review and evaluation of accountability measurement technology in DOE nuclear facilities. This function is addressed in part through the NBL Safegaurds Measurement Evaluation (SME) Program. The SME Program utilizes both on-site review of measurement methods along with material-specific measurement evaluation studies to provide information concerning the adequacy of subject accountability measurements. This paper reviews SME Program activities for the 1986-87 time period, with emphasis on noted improvements in measurement capabilities. Continued evolution of the SME Program to respond to changing safeguards concerns is discussed

Evaluation of gamma-ray intensities

International Nuclear Information System (INIS)

Yoshizawa, Yasukazu; Inoue, Hikaru; Hoshi, Masaharu; Shizuma, Kiyoshi; Iwata, Yosei.

1978-03-01

Results of literature survey and evaluation of relative intensities and intensities per decay of gamma rays are presented. Evaluations were made for 22 Na, 24 Na, 46 Sc, 48 Sc, 48 V, 54 Mn, 57 Co, 60 Co, 85 Sr, 88 Y, 95 Nb, 95 Zr, sup(108m)Ag, 134 Cs, 137 Cs, 144 Ce, 144 Pr, 203 Hg, and 207 Bi. For eight of the nuclides, the half-lives were also evaluated. (auth.)

Analytical evaluation of actinide sensitivities

International Nuclear Information System (INIS)

Sola, A.

1977-01-01

The analytical evaluation of the sensitivities of actinides to various parameters such as cross sections, decay constants, flux and time is presented. The formulae are applied to isotopes of the Uranium, Neptunium, Plutonium and Americium series. The agreement between analytically obtained and computer evaluated sensitivities being always good, it is throught that the formulation includes all the important parameters entering in the evaluation of sensitivities. A study of the published data is made

The case for applying an early-lifecycle technology evaluation methodology to comparative evaluation of requirements engineering research

Science.gov (United States)

Feather, Martin S.

2003-01-01

The premise of this paper is taht there is a useful analogy between evaluation of proposed problem solutions and evaluation of requirements engineering research itself. Both of these application areas face the challenges of evaluation early in the lifecycle, of the need to consider a wide variety of factors, and of the need to combine inputs from multiple stakeholders in making thse evaluation and subsequent decisions.

Effect of evaluation threat on procrastination behavior.

Science.gov (United States)

Bui, Ngoc H

2007-06-01

The author evaluated the effects of evaluation apprehension and trait procrastination on behaviors. The author examined private university students from southern California (N = 72) on two independent variables: evaluation threat (manipulated) and trait procrastination (nonmanipulated). The author found a significant interaction effect between type of evaluation threat and level of trait procrastination on the number of days to complete an assigned essay. Post hoc analyses showed high trait procrastinators in the high evaluation threat group significantly delayed returning essays compared with those in the low evaluation threat group. Also, in the low evaluation threat group, low trait procrastinators delayed more than did high trait procrastinators. These results suggest that educators can reduce behavioral delays by increasing evaluation threat, depending on a student's level of trait procrastination.

Improving evaluation at two medical schools.

Science.gov (United States)

Schiekirka-Schwake, Sarah; Dreiling, Katharina; Pyka, Katharina; Anders, Sven; von Steinbüchel, Nicole; Raupach, Tobias

2017-08-03

Student evaluations of teaching can provide useful feedback for teachers and programme coordinators alike. We have designed a novel evaluation tool assessing teacher performance and student learning outcome. This tool was implemented at two German medical schools. In this article, we report student and teacher perceptions of the novel tool, and the implementation process. Focus group discussions as well as one-to-one interviews involving 22 teachers and 31 undergraduate medical students were conducted. Following adjustments to the feedback reports (e.g. the colour coding of results) at one medical school, 42 teachers were asked about their perceptions of the revised report and the personal benefit of the evaluation tool. Teachers appreciated the individual feedback provided by the evaluation tool and stated that they wanted to improve their teaching, based on the results; however, they missed most of the preparative communication. Students were unsure about the additional benefit of the instrument compared with traditional evaluation tools. A majority was unwilling to complete evaluation forms in their spare time, and some felt that the new questionnaire was too long and that the evaluations occurred too often. They were particularly interested in feedback on how their comments have helped to further improve teaching. Student evaluations of teaching can provide useful feedback CONCLUSION: Despite evidence of the utility of the tool for individual teachers, implementation of changes to the process of evaluation appears to have been suboptimal, mainly owing to a perceived lack of communication. In order to motivate students to provide evaluation data, feedback loops including aims and consequences should be established. © 2017 John Wiley & Sons Ltd and The Association for the Study of Medical Education.

Psychobiological responses to critically evaluated multitasking.

Science.gov (United States)

Wetherell, Mark A; Craw, Olivia; Smith, Kenny; Smith, Michael A

2017-12-01

In order to understand psychobiological responses to stress it is necessary to observe how people react to controlled stressors. A range of stressors exist for this purpose; however, laboratory stressors that are representative of real life situations provide more ecologically valid opportunities for assessing stress responding. The current study assessed psychobiological responses to an ecologically valid laboratory stressor involving multitasking and critical evaluation. The stressor elicited significant increases in psychological and cardiovascular stress reactivity; however, no cortisol reactivity was observed. Other socially evaluative laboratory stressors that lead to cortisol reactivity typically require a participant to perform tasks that involve verbal responses, whilst standing in front of evaluative others. The current protocol contained critical evaluation of cognitive performance; however, this was delivered from behind a seated participant. The salience of social evaluation may therefore be related to the response format of the task and the method of evaluation. That is, the current protocol did not involve the additional vulnerability associated with in person, face-to-face contact, and verbal delivery. Critical evaluation of multitasking provides an ecologically valid technique for inducing laboratory stress and provides an alternative tool for assessing psychological and cardiovascular reactivity. Future studies could additionally use this paradigm to investigate those components of social evaluation necessary for eliciting a cortisol response.

Veterinary and human vaccine evaluation methods

Science.gov (United States)

Knight-Jones, T. J. D.; Edmond, K.; Gubbins, S.; Paton, D. J.

2014-01-01

Despite the universal importance of vaccines, approaches to human and veterinary vaccine evaluation differ markedly. For human vaccines, vaccine efficacy is the proportion of vaccinated individuals protected by the vaccine against a defined outcome under ideal conditions, whereas for veterinary vaccines the term is used for a range of measures of vaccine protection. The evaluation of vaccine effectiveness, vaccine protection assessed under routine programme conditions, is largely limited to human vaccines. Challenge studies under controlled conditions and sero-conversion studies are widely used when evaluating veterinary vaccines, whereas human vaccines are generally evaluated in terms of protection against natural challenge assessed in trials or post-marketing observational studies. Although challenge studies provide a standardized platform on which to compare different vaccines, they do not capture the variation that occurs under field conditions. Field studies of vaccine effectiveness are needed to assess the performance of a vaccination programme. However, if vaccination is performed without central co-ordination, as is often the case for veterinary vaccines, evaluation will be limited. This paper reviews approaches to veterinary vaccine evaluation in comparison to evaluation methods used for human vaccines. Foot-and-mouth disease has been used to illustrate the veterinary approach. Recommendations are made for standardization of terminology and for rigorous evaluation of veterinary vaccines. PMID:24741009

The Evaluation Methodology of Information Support

Directory of Open Access Journals (Sweden)

Lubos Necesal

2016-01-01

Full Text Available Knowledge, information and people are the motive force in today's organizations. Successful organizations need to find the right employees and provide them with the right and highquality information. This is a complex problem. In the world where information plays more and more important role, employees have to be skilled at information activities (searching, processing, saving, etc. of information and information system/-s (IS they work with. Organizations have to cover both these areas. Therefore, we need an effective instrument, which could be used to evaluate new employees within admission or as regular evaluating of current employees, to evaluate information system, whether it is an appropriate tool for fulfilling the employee’s tasks within the organization, and to evaluate how the organization covers the foregoing areas. Such instrument is the “Evaluation methodology of information support in organization”. This paper defines the term “information support“ and its role in organization. The body of the paper proposes the “Evaluation methodology of information support in organization”. The conclusion discusses contributions of information support evaluation

Solar Thermal System Evaluation in China

Directory of Open Access Journals (Sweden)

Xinyu Zhang

2015-01-01

Full Text Available More than 581 solar thermal systems (STSs, 98 counties, and 47 renewable application demonstration cites in China need to be inspected by the end of 2015. In this study, the baseline for performance and economic evaluation of STSs are presented based on the site test data and related references. An index used to evaluate STSs was selected, and methods to acquire the parameters used to calculate the related index were set. The requirements for sensors for testing were specified. The evaluation method was applied to three systems and the result shows that the evaluation method is suitable for the evaluation of STSs in China.

Evaluating financial education initiatives in South Africa: The importance of multiple evaluation approaches

Directory of Open Access Journals (Sweden)

Emily Massey

2016-06-01

Objectives: This study aims to show that, particularly in a South African context, where investment in financial education interventions is mandated by the Financial Sector Codes, impact should not be the only criterion assessed when evaluating financial education projects. Research method and design: This study was informed by a literature review, a synthesis of team experience on a range of financial education projects in South Africa and the development of case studies. Results: Describing the success or failure of a project needs to go beyond impact and explore factors such as project relevance, design and quality. In order to verify these other factors, different types of evaluations are necessary at the various stages of the project’s life-cycle. Conclusion: Expanding the learning objective beyond the exclusive identification of whether financial behaviour was achieved is particularly important where financial education projects, and the monitoring and evaluation thereof, is mandated. In the African context, where resources are scarce, money for monitoring and evaluation should be selectively channelled into determining project relevance, effectiveness, efficiency and then only impact.

Functional Capacity Evaluation Research : Report from the Third International Functional Capacity Evaluation Research Meeting

NARCIS (Netherlands)

James, C. L.; Reneman, M. F.; Gross, D. P.

Introduction Functional capacity evaluations are an important component of many occupational rehabilitation programs and can play a role in facilitating reintegration to work thus improving health and disability outcomes. The field of functional capacity evaluation (FCE) research has continued to

Meta–Evaluation in the Higher Education Agenda

Directory of Open Access Journals (Sweden)

Susana Marcipar Katz

2017-11-01

Full Text Available Based on the impact of learning assessment on educational processes, the idea of assessing learning evaluations to turn evaluation into a tool for change in education becomes relevant (Ravela,2009. This article intends to communicate the methodological design to apply a meta–evaluation on two subjects, English for Special Purposes and Basic Mathematics, which belong to the Accounting studies at Universidad Nacional del Litoral. The investigative objective is to evaluate the learning evaluations, i.e. meta–evaluation, in the above mentioned subjects to reach two goals. On the one hand, identify the reinforcement or changes necessary to improve the quality of the evaluation processes so that they become evaluation as learning, evaluation for learning and evaluation of learning. On the other hand, determine the epistemological, didactic, cultural and technological conditions adequate to promote the improvement of teaching and learning in those subjects. The complete methodological design has the characteristics of an illuminative evaluation (Parlett and Hamilton, 1972, which assumes a research line oriented to discovery and application (Arnal et ál., 1992. The meta–evaluation design presented here can become an institutional strategy for academic decision–making that envisages the continuous construction of a culture of self–reflection on learning quality.

Computer-implemented security evaluation methods, security evaluation systems, and articles of manufacture

Science.gov (United States)

Muller, George; Perkins, Casey J.; Lancaster, Mary J.; MacDonald, Douglas G.; Clements, Samuel L.; Hutton, William J.; Patrick, Scott W.; Key, Bradley Robert

2015-07-28

Computer-implemented security evaluation methods, security evaluation systems, and articles of manufacture are described. According to one aspect, a computer-implemented security evaluation method includes accessing information regarding a physical architecture and a cyber architecture of a facility, building a model of the facility comprising a plurality of physical areas of the physical architecture, a plurality of cyber areas of the cyber architecture, and a plurality of pathways between the physical areas and the cyber areas, identifying a target within the facility, executing the model a plurality of times to simulate a plurality of attacks against the target by an adversary traversing at least one of the areas in the physical domain and at least one of the areas in the cyber domain, and using results of the executing, providing information regarding a security risk of the facility with respect to the target.

Classification and Quality Evaluation of Tobacco Leaves Based on Image Processing and Fuzzy Comprehensive Evaluation

Science.gov (United States)

Zhang, Fan; Zhang, Xinhong

2011-01-01

Most of classification, quality evaluation or grading of the flue-cured tobacco leaves are manually operated, which relies on the judgmental experience of experts, and inevitably limited by personal, physical and environmental factors. The classification and the quality evaluation are therefore subjective and experientially based. In this paper, an automatic classification method of tobacco leaves based on the digital image processing and the fuzzy sets theory is presented. A grading system based on image processing techniques was developed for automatically inspecting and grading flue-cured tobacco leaves. This system uses machine vision for the extraction and analysis of color, size, shape and surface texture. Fuzzy comprehensive evaluation provides a high level of confidence in decision making based on the fuzzy logic. The neural network is used to estimate and forecast the membership function of the features of tobacco leaves in the fuzzy sets. The experimental results of the two-level fuzzy comprehensive evaluation (FCE) show that the accuracy rate of classification is about 94% for the trained tobacco leaves, and the accuracy rate of the non-trained tobacco leaves is about 72%. We believe that the fuzzy comprehensive evaluation is a viable way for the automatic classification and quality evaluation of the tobacco leaves. PMID:22163744

76 FR 37344 - Technology Evaluation Process

Science.gov (United States)

2011-06-27

...-NOA-0039] Technology Evaluation Process AGENCY: Office of Energy Efficiency and Renewable Energy... seeks comments and information related to a commercial buildings technology evaluation process. DOE is seeking to create a process for evaluating emerging and underutilized energy efficient technologies for...

Development and Evaluation of the Teamwork Competencies

Science.gov (United States)

Furukawa, Tetsuro; Matsuishi, Masakatu; Matsumoto, Shigeo; Takemata, Kazuya; Yamakawa, Taketo

At the subject that aims to develop the student's teamwork competencies which is one of the most important ability as an engineer, the appraisal method was investigated. Almost all the team activities were evaluated, and correlations with that result and the peer evaluation, the self-evaluation and the team peer evaluation were examined. It was found that the correlation between the quality of the team activities and the team peer evaluation which is evaluated by other team members is highest.

Sponsorship evaluation in South Africa

Directory of Open Access Journals (Sweden)

Adele D. Berndt

2001-12-01

Full Text Available Sponsorships are regarded as a marketing communications activity. This is seem as an investment made by an organisation that need to be evaluated in terms of its return and contribution. Sport sponsorships have increased in South Africa since re-admittance to the international sports arena. There are various objectives for sponsorships. The identification of these objectives is important for the evaluation of sponsorships. The articles proposes some guidelines for the evaluation of sponsorships.

Evaluating the appropriateness of speech input in marine applications : a field evaluation

OpenAIRE

Lumsden, Jo; Langton, Nathan; Kondratova, Irina

2008-01-01

This paper discusses the first of three studies which collectively represent a convergence of two ongoing research agendas: (1) the empirically-based comparison of the effects of evaluation environment on mobile usability evaluation results; and (2) the effect of environment - in this case lobster fishing boats - on achievable speech-recognition accuracy. We describe, in detail, our study and outline our results to date based on preliminary analysis. Broadly speaking, the potential for effect...

Operational Area Environmental Evaluations

Energy Technology Data Exchange (ETDEWEB)

Bailey-White, Brenda Eileen [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Nagy, Michael David [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Wagner, Katrina Marie [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Goodman, Thomas Richard [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Herring, Allen [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Catechis, Christopher S. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Kinghorn, Aubrianna Nicole [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Johnson, Ellie [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Barthel, Michael David [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States); Casaus, Benito [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2017-08-01

The Operational Area Environmental Evaluation update provides a description of activities that have the potential to adversely affect natural and cultural resources, including soil, air, water, biological, ecological, and historical resources. The environmental sensitivity of an area is evaluated and summarized, which may facilitate informed management decisions as to where development may be prohibited, restricted, or subject to additional requirements.

Sensorial evaluation genuineness of wine

Directory of Open Access Journals (Sweden)

Ivo Tomášek

2008-01-01

Full Text Available The qualitative indicators of wine are also sensoric properties besides analytic properties. The specimens were evaluated immediately after their stabilization. Of course, by the time the sensoric properties are changing and can influence later evaluation, even customers in their desicion for repeating purchase. Specialists evaluated specimen of white wines such as: rhine Riesling, Sauvignon blanc and gruner Veltliner from three locations of Znojmo winery region. All specimen weren´t fermented to dry and they weren´t procesed the same technology, in spite of this, the speciments were evaluated objectively as possilble. The common parameters of vineyards were: exhibition, evaluation above sea-level and average annual temperatrature. The climatic factors had minimum differences in both monitoring vintages of growing season. A different parametr had soils, their geological origin, type of soil, structure and po­wer of topsoil. The acquired results were evaluated and graphically displayed.Gruner Veltliner – specimen No. 1 – this variety was covered in smell and taste by used technology. An outstanding location was a vineyard Weinperky with paleozoic sediments of neogene and higher pH and deeper arable level provides this location incommutable feature in contrast to from other recognizing vineyards of future wine. More likely geological-soil features have even specimens No. 3 and 4, which showed balance characteristic features in recognizing vintage. The specimens No. 2 and 1 had quantity untypical variety shades and they showed balance large differences both in evaluating committees and in recognizing vintages.Sauvignon blanc – the most suitable location was a vineyard Knížecí vrch – a specimen No. 6, which lies on lighter limy soils of Dyje massif together with higher pH created nice feature of variety. A spe­cimen No. 8 had more likely characteristics of location than a specimen No. 6. That express in evaluation. A specimen No. 7

Discounting in Economic Evaluations.

Science.gov (United States)

Attema, Arthur E; Brouwer, Werner B F; Claxton, Karl

2018-05-19

Appropriate discounting rules in economic evaluations have received considerable attention in the literature and in national guidelines for economic evaluations. Rightfully so, as discounting can be quite influential on the outcomes of economic evaluations. The most prominent controversies regarding discounting involve the basis for and height of the discount rate, whether costs and effects should be discounted at the same rate, and whether discount rates should decline or stay constant over time. Moreover, the choice for discount rules depends on the decision context one adopts as the most relevant. In this article, we review these issues and debates, and describe and discuss the current discounting recommendations of the countries publishing their national guidelines. We finish the article by proposing a research agenda.

Evaluation of EIT system performance.

Science.gov (United States)

Yasin, Mamatjan; Böhm, Stephan; Gaggero, Pascal O; Adler, Andy

2011-07-01

An electrical impedance tomography (EIT) system images internal conductivity from surface electrical stimulation and measurement. Such systems necessarily comprise multiple design choices from cables and hardware design to calibration and image reconstruction. In order to compare EIT systems and study the consequences of changes in system performance, this paper describes a systematic approach to evaluate the performance of the EIT systems. The system to be tested is connected to a saline phantom in which calibrated contrasting test objects are systematically positioned using a position controller. A set of evaluation parameters are proposed which characterize (i) data and image noise, (ii) data accuracy, (iii) detectability of single contrasts and distinguishability of multiple contrasts, and (iv) accuracy of reconstructed image (amplitude, resolution, position and ringing). Using this approach, we evaluate three different EIT systems and illustrate the use of these tools to evaluate and compare performance. In order to facilitate the use of this approach, all details of the phantom, test objects and position controller design are made publicly available including the source code of the evaluation and reporting software.

Crescent Evaluation : appendix B : state case study evaluation report

Science.gov (United States)

1994-02-01

The state case study evaluation approach uniquely captured an understanding of the potential of such a system by documenting the experiences, issues, and opportunities of selected key state government personnel from a cross-section of involved agenci...

Building a community-based culture of evaluation.

Science.gov (United States)

Janzen, Rich; Ochocka, Joanna; Turner, Leanne; Cook, Tabitha; Franklin, Michelle; Deichert, Debbie

2017-12-01

In this article we argue for a community-based approach as a means of promoting a culture of evaluation. We do this by linking two bodies of knowledge - the 70-year theoretical tradition of community-based research and the trans-discipline of program evaluation - that are seldom intersected within the evaluation capacity building literature. We use the three hallmarks of a community-based research approach (community-determined; equitable participation; action and change) as a conceptual lens to reflect on a case example of an evaluation capacity building program led by the Ontario Brian Institute. This program involved two community-based groups (Epilepsy Southwestern Ontarioand the South West Alzheimer Society Alliance) who were supported by evaluators from the Centre for Community Based Research to conduct their own internal evaluation. The article provides an overview of a community-based research approach and its link to evaluation. It then describes the featured evaluation capacity building initiative, including reflections by the participating organizations themselves. We end by discussing lessons learned and their implications for future evaluation capacity building. Our main argument is that organizations that strive towards a community-based approach to evaluation are well placed to build and sustain a culture of evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

Effects of mid-term student evaluations of teaching as measured by end-of-term evaluations: An emperical study of course evaluations

DEFF Research Database (Denmark)

Clemmensen, Line Katrine Harder; Sliusarenko, Tamara; Ersbøll, Bjarne Kjær

2013-01-01

Universities have varying policies on how and when to perform student evaluations of courses and teachers. More empirical evidence of the consequences of such policies on quality enhancement of teaching and learning is needed. A study (35 courses at the Technical University of Denmark....... The evaluations generally showed positive improvements over the semester for courses with access, and negative improvements for those without access. Improvements related to: Student learning, student satisfaction, teaching activities, and communication showed statistically significant average differences of 0.......1-0.2 points between the two groups. These differences are relatively large compared to the standard deviation of the scores when student effect is removed (approximately 0.7). We conclude that university policies on course evaluations seem to have an impact on the development of the teaching and learning...

48 CFR 36.604 - Performance evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Performance evaluation. 36.604 Section 36.604 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SPECIAL... Performance evaluation. See 42.1502(f) for the requirements for preparing past performance evaluations for...

48 CFR 236.604 - Performance evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false Performance evaluation... Architect-Engineer Services 236.604 Performance evaluation. (a) Preparation of performance reports. Use DD Form 2631, Performance Evaluation (Architect-Engineer), instead of SF 1421. (2) Prepare a separate...

Quality and Research Evaluation in Organizations

DEFF Research Database (Denmark)

Hansson, Finn

A central issue in science policy today is the changing role and function ofresearch evaluation. How is quality selected, has local organizational traditionsand managerial practices influence on the research evaluation? Who isperceived as peers or evaluators by the researchers and by managers...

Performance evaluation and financial market runs

NARCIS (Netherlands)

Wagner, W.B.

2013-01-01

This paper develops a model in which performance evaluation causes runs by fund managers and results in asset fire sales. Performance evaluation nonetheless is efficient as it disciplines managers. Optimal performance evaluation combines absolute and relative components in order to make runs less

Distance measures for image segmentation evaluation

OpenAIRE

Monteiro, Fernando C.; Campilho, Aurélio

2012-01-01

In this paper we present a study of evaluation measures that enable the quantification of the quality of an image segmentation result. Despite significant advances in image segmentation techniques, evaluation of these techniques thus far has been largely subjective. Typically, the effectiveness of a new algorithm is demonstrated only by the presentation of a few segmented images and is otherwise left to subjective evaluation by the reader. Such an evaluation criterion can be useful for differ...

10CFR50.59 safety evaluations

International Nuclear Information System (INIS)

Grime, L.; Page, E.

1987-01-01

As a plant changes from the design phase to the operational phase, new regulations and standards apply. One such regulation is 10CFR50.59 on safety evaluations. Once an operating license is issued, it is mandatory to submit all applicable changes, tests, and experiments to the safety evaluation process. As preparation for this transition, Detroit Edison had procedures in place and conducted personnel training. Reviews of the safety engineering were conducted by the on-site review board. The off-site board delegated detailed reviews of most safety evaluations to the independent safety evaluation group (ISEG). The on-site group review included presentation of complete design packages by engineers. The ISEG and off-site review group's activity focused on safety evaluation. This paper addresses industry trends that were studied, Detroit Edison's recent actions, and industry issues related to 10CFR50.59 safety evaluations

Students' gender bias in teaching evaluations

Directory of Open Access Journals (Sweden)

Narissra Punyanunt-Carter

2015-09-01

Full Text Available The goal of this study was to investigate if there is gender bias in student evaluations. Researchers administered a modified version of the teacher evaluation forms to 58 students (male=30; female=28 in a basic introductory communications class. Half the class was instructed to fill out the survey about a male professor, and the other half a female professor. Researchers broke down the evaluation results question by question in order to give a detailed account of the findings. Results revealed that there is certainly some gender bias at work when students evaluate their instructors. It was also found that gender bias does not significantly affect the evaluations. The results align with other findings in the available literature, which point to some sort of pattern regarding gender bias in evaluations, but it still seems to be inconsequential.  DOI: 10.18870/hlrc.v5i3.234

Layered Graph Drawing for Visualizing Evaluation Structures.

Science.gov (United States)

Onoue, Yosuke; Kukimoto, Nobuyuki; Sakamoto, Naohisa; Misue, Kazuo; Koyamada, Koji

2017-01-01

An evaluation structure is a hierarchical structure of human cognition extracted from interviews based on the evaluation grid method. An evaluation structure can be defined as a directed acyclic graph (DAG). The authors propose a layer-assignment method that is part of the Sugiyama framework, a popular method for drawing DAGs, to satisfy the requirements for drawing evaluation structures. Their evaluations demonstrate that the layered graph drawing produced by the proposed layer-assignment method is preferred by users and aids in the understanding of evaluation structures.

Walkthrough screening evaluation field guide

International Nuclear Information System (INIS)

Eder, S.J.; Eli, M.W.; Salmon, M.W.

1993-11-01

The US Department of Energy (DOE) has a large inventory of existing facilities. Many of these facilities were not designed and constructed to current natural phenomena hazard (NPH) criteria. The NPH events include earthquakes, extreme winds and tornadoes, and floods. DOE Order 5480.28 establishes policy and requirements for NPH mitigation for DOE facilities. DOE is conducting a multiyear project to develop evaluation guidelines for assessing the condition and determining the need for upgrades at DOE facilities. One element of the NPH evaluation guidelines' development involves the existing systems and components at DOE facilities. This effort is described in detail in a cited reference. In the interim period prior to availability of the final guidelines, DOE facilities are encouraged to implement an NPH walk through screening evaluation process by which systems and components that need attention can be rapidly identified. Guidelines for conducting the walk through screening evaluations are contained herein. The result of the NPH walk through screening evaluation should be a prioritized list of systems and components that need further action. Simple and inexpensive fixes for items identified in the walk through as marginal or inadequate should be implemented without further study. By implementing an NPH walk through screening evaluation, DOE facilities may realize significant reduction in risk from NPH in the short term

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review.

Science.gov (United States)

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; "simulation," "practice," "drill," "exercise," "instrument," "tool," "questionnaire," " measurement," "checklist," "scale," "test," "inventory," "battery," "evaluation," "assessment," "appraisal," "emergency," "disaster," "cricise," "hazard," "catastrophe,: "hospital", "prehospital," "health centers," "treatment centers," were used in combination with Boolean operators OR and AND. The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages.

Evaluative Conditioning is Insensitive to Blocking

Directory of Open Access Journals (Sweden)

Tom Beckers

2009-01-01

Full Text Available Evaluative conditioning has been claimed to have a number of functional characteristics that set it apart from other forms of associative learning in humans, such as insensitivity to extinction and contingency, independence of contingency awareness, and insensitivity to modulation. Despite its potential theoretical importance, until now few data are available concerning the susceptibility of evaluative conditioning to cue competition effects such as blocking. In the present study, we assessed the susceptibility of acquired preferences and evaluations to blocking in a candy game. Results suggest that evaluative conditioning is not susceptible to blocking. We discuss this observation in the light of theoretical accounts of evaluative conditioning and associative learning in humans.

Evaluation of an Eating Disorder Curriculum.

Science.gov (United States)

Moriarty, Dick; And Others

1990-01-01

A qualitative and quantitative evaluation of "A Preventive Curriculum for Anorexia Nervosa and Bulimia" is reported. The evaluation, which included teachers, researchers, health professionals, and students, included development of the curriculum as well as pilot testing activities. The curriculum development and evaluation consisted of…

48 CFR 225.504 - Evaluation examples.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false Evaluation examples. 225.504 Section 225.504 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM... 225.504 Evaluation examples. For examples that illustrate the evaluation procedures in 225.502(c)(ii...

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

7 CFR 4284.512 - Evaluation process.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation process. 4284.512 Section 4284.512 Agriculture Regulations of the Department of Agriculture (Continued) RURAL BUSINESS-COOPERATIVE SERVICE AND....512 Evaluation process. (a) Applications will be evaluated by qualified reviewers appointed by the...

7 CFR 4284.912 - Evaluation process.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation process. 4284.912 Section 4284.912 Agriculture Regulations of the Department of Agriculture (Continued) RURAL BUSINESS-COOPERATIVE SERVICE AND... Evaluation process. (a) Applications will be evaluated by agricultural economists or other technical experts...

48 CFR 1315.606-2 - Evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 5 2010-10-01 2010-10-01 false Evaluation. 1315.606-2... CONTRACT TYPES CONTRACTING BY NEGOTIATION Unsolicited Proposals 1315.606-2 Evaluation. (a) If the... 15.606-1, the contracting officer will acknowledge receipt of the proposal, coordinate evaluation...

48 CFR 1215.606-2 - Evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 5 2010-10-01 2010-10-01 false Evaluation. 1215.606-2... AND CONTRACT TYPES CONTRACTING BY NEGOTIATION Unsolicited Proposals 1215.606-2 Evaluation. (a) Comprehensive evaluations should be completed within sixty calendar days after making the initial review...

2017 Guralp Affinity Digitizer Evaluation.

Energy Technology Data Exchange (ETDEWEB)

Merchant, Bion J.

2018-03-01

Sandia National Laboratories has tested and evaluated two Guralp Affinity digitizers. The Affinity digitizers are intended to record sensor output for seismic and infrasound monitoring applications. The purpose of this digitizer evaluation is to measure the performance characteristics in such areas as power consumption, input impedance, sensitivity, full scale, self- noise, dynamic range, system noise, response, passband, and timing. The Affinity digitizers are being evaluated for potential use in the International Monitoring System (IMS) of the Comprehensive Nuclear Test-Ban-Treaty Organization (CTBTO).

Safety evaluation of Tokai reprocessing plant (TRP). Report of safety evaluation of Tokai reprocessing plant

International Nuclear Information System (INIS)

Yamauchi, Takamichi; Maki, Akira; Nojiri, Ichiro

1999-02-01

The fire and explosion incident of the bituminization facility happened in March 1997 although JNC had taken enough care of the safety of TRP. JNC reflected on it and decided to evaluate the safety of TRP voluntarily. This evaluation has included five activities, that is, (1) confirmation of the structure and organization of TRP, (2) research of the data for operation, radiation and maintenance of TRP, (3) research of reflection of the accidents and troubles which have happened at the past, (4) evaluation on the prevention system, (5) evaluation on the mitigation system. We publish this report to contribute to inheritance of accumulated knowledge and techniques from generation to generation, and remind us of lesson from the fire and explosion incident of the bituminization. (author)

Development of material balance evaluation technique(2)

International Nuclear Information System (INIS)

Lee, Byung Doo

2000-06-01

IAEA considers that the evaluation on material balance is one of the important activities for detecting the diversion of nuclear materials as well as measurement uncertainties and measurement bias. Nuclear material accounting reports, the results of DA and NDA, the summarized lists of material stratified by inspector are necessary for the material balance evaluation. In this report, the concepts and evaluation methods of material balance evaluation such as the estimation techniques of random and systematic errors, MUF, D and MUF-D are described. As a conclusion, it is possible for national inspection to evaluate the material balance by applying the evaluation methods of the IAEA such as error estimation using operator-inspector paired data, inspector MUF(IMUF) evaluation

Policy evaluation and democracy: Do they fit?

Science.gov (United States)

Sager, Fritz

2017-08-05

The papers assembled in this special issue shed light on the question of the interrelation between democracy and policy evaluation by discussing research on the use of evaluations in democratic processes. The collection makes a case for a stronger presence of evaluation in democracy beyond expert utilization. Parliamentarians prove to be more aquainted with evaluations than expected and the inclusion of evaluations in policy arguments increases the deliberative quality of democratic campaigns. In sum, evaluation and democracy turn out to be well compatible after all. Copyright © 2017 Elsevier Ltd. All rights reserved.

An evaluation scheme for nanotechnology policies

International Nuclear Information System (INIS)

Soltani, Ali M.; Tabatabaeian, Seyed H.; Hanafizadeh, Payam; Bamdad Soofi, Jahanyar

2011-01-01

Dozens of countries are executing national nanotechnology plans. No rigorous evaluation scheme for these plans exists, although stakeholders—especially policy makers, top-level agencies and councils, as well as the society at large—are eager to learn the outcome of these policies. In this article, we recommend an evaluation scheme for national nanotechnology policies that would be used to review the whole or any component part of a national nanotechnology plan. In this scheme, a component at any level of aggregation is evaluated. The component may be part of the plan’s overarching policy goal, which for most countries is to create wealth and improve the quality of life of their nation with nanotechnology. Alternatively, the component may be a programme or an activity related to a programme. The evaluation could be executed at different times in the policy’s life cycle, i.e., before the policy is formulated, during its execution or after its completion. The three criteria for policy evaluation are appropriateness, efficiency and effectiveness. The evaluator should select the appropriate qualitative or quantitative methods to evaluate the various components of national nanotechnology plans.

Empirical evaluation methods in computer vision

CERN Document Server

Christensen, Henrik I

2002-01-01

This book provides comprehensive coverage of methods for the empirical evaluation of computer vision techniques. The practical use of computer vision requires empirical evaluation to ensure that the overall system has a guaranteed performance. The book contains articles that cover the design of experiments for evaluation, range image segmentation, the evaluation of face recognition and diffusion methods, image matching using correlation methods, and the performance of medical image processing algorithms. Sample Chapter(s). Foreword (228 KB). Chapter 1: Introduction (505 KB). Contents: Automate

Evaluation of multi-outcome longitudinal studies

DEFF Research Database (Denmark)

Jensen, Signe Marie; Pipper, Christian Bressen; Ritz, Christian

2015-01-01

Evaluation of intervention effects on multiple outcomes is a common scenario in clinical studies. In longitudinal studies, such evaluation is a challenge if one wishes to adequately capture simultaneous data behavior. In this situation, a common approach is to analyze each outcome separately...... conservative conclusions. We propose an alternative approach for multiplicity adjustment that incorporates dependence between outcomes, resulting in an appreciably less conservative evaluation. The ability of the proposed method to control the familywise error rate is evaluated in a simulation study...

Monitoring 'monitoring' and evaluating 'evaluation': an ethical framework for monitoring and evaluation in public health.

Science.gov (United States)

Gopichandran, Vijayaprasad; Indira Krishna, Anil Kumar

2013-01-01

Monitoring and evaluation (M&E) is an essential part of public health programmes. Since M&E is the backbone of public health programmes, ethical considerations are important in their conduct. Some of the key ethical considerations are avoiding conflicts of interest, maintaining independence of judgement, maintaining fairness, transparency, full disclosure, privacy and confidentiality, respect, responsibility, accountability, empowerment and sustainability. There are several ethical frameworks in public health, but none focusing on the monitoring and evaluation process. There is a need to institutionalise the ethical review of M&E proposals. A theoretical framework for ethical considerations is proposed in this paper. This proposed theoretical framework can act as the blueprint for building the capacity of ethics committees to review M&E proposals. A case study is discussed in this context. After thorough field testing, this practical and field-based ethical framework can be widely used by donor agencies, M&E teams, institutional review boards and ethics committees.

Evaluating Ambient Displays in the Wild

DEFF Research Database (Denmark)

Messeter, Jörn; Molenaar, Daryn

A prominent issue for evaluating ambient displays has been the conflict between the relative intrusiveness of evaluation methods and the intention to keep the display at the periphery of the user’s attention. There is a general lack of research discussing the difficulties of evaluating ambient di...

Pragmatism, Evidence, and Mixed Methods Evaluation

Science.gov (United States)

Hall, Jori N.

2013-01-01

Mixed methods evaluation has a long-standing history of enhancing the credibility of evaluation findings. However, using mixed methods in a utilitarian way implicitly emphasizes convenience over engaging with its philosophical underpinnings (Denscombe, 2008). Because of this, some mixed methods evaluators and social science researchers have been…

Mood and the evaluation of leaders

NARCIS (Netherlands)

Schyns, Birgit; Sanders, Karin

2003-01-01

Research on the evaluation of leaders has shown that evaluation ratings are prone to several biases. The present study deals with one possible bias, namely, the relationship between mood and the perception or evaluation of a leader. The affect-as-information framework, which indicates that mood

1 CFR 500.110 - Self-evaluation.

Science.gov (United States)

2010-01-01

... 1 General Provisions 1 2010-01-01 2010-01-01 false Self-evaluation. 500.110 Section 500.110... PROGRAMS OR ACTIVITIES CONDUCTED BY THE NATIONAL COMMISSION FOR EMPLOYMENT POLICY § 500.110 Self-evaluation... or organizations representing handicapped persons, to participate in the self-evaluation process by...

44 CFR 16.110 - Self-evaluation.

Science.gov (United States)

2010-10-01

... 44 Emergency Management and Assistance 1 2010-10-01 2010-10-01 false Self-evaluation. 16.110... ACTIVITIES CONDUCTED BY THE FEDERAL EMERGENCY MANAGEMENT AGENCY § 16.110 Self-evaluation. (a) The agency... handicaps or organizations representing individuals with handicaps, to participate in the self-evaluation...

48 CFR 15.606-2 - Evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false Evaluation. 15.606-2... AND CONTRACT TYPES CONTRACTING BY NEGOTIATION Unsolicited Proposals 15.606-2 Evaluation. (a) Comprehensive evaluations shall be coordinated by the agency contact point, who shall attach or imprint on each...

1 CFR 457.110 - Self-evaluation.

Science.gov (United States)

2010-01-01

... 1 General Provisions 1 2010-01-01 2010-01-01 false Self-evaluation. 457.110 Section 457.110... PROGRAMS OR ACTIVITIES CONDUCTED BY THE NATIONAL CAPITAL PLANNING COMMISSION § 457.110 Self-evaluation. (a... organizations representing handicapped persons, to participate in the self-evaluation process by submitting...

Evaluation And Selection Process of Suppliers Through Analytical Framework: An Emprical Evidence of Evaluation Tool

Directory of Open Access Journals (Sweden)

Imeri Shpend

2015-09-01

Full Text Available The supplier selection process is very important to companies as selecting the right suppliers that fit companies strategy needs brings drastic savings. Therefore, this paper seeks to address the key area of supplies evaluation from the supplier review perspective. The purpose was to identify the most important criteria for suppliers’ evaluation and develop evaluation tool based on surveyed criteria. The research was conducted through structured questionnaire and the sample focused on small to medium sized companies (SMEs in Greece. In total eighty companies participated in the survey answering the full questionnaire which consisted of questions whether these companies utilize some suppliers’ evaluation criteria and what criteria if any is applied. The main statistical instrument used in the study is Principal Component Analysis (PCA. Thus, the research has shown that the main criteria are: the attitude of the vendor towards the customer, supplier delivery time, product quality and price. Conclusions are made on the suitability and usefulness of suppliers’ evaluation criteria and in way they are applied in enterprises.

Unsupervised Performance Evaluation of Image Segmentation

Directory of Open Access Journals (Sweden)

Chabrier Sebastien

2006-01-01

Full Text Available We present in this paper a study of unsupervised evaluation criteria that enable the quantification of the quality of an image segmentation result. These evaluation criteria compute some statistics for each region or class in a segmentation result. Such an evaluation criterion can be useful for different applications: the comparison of segmentation results, the automatic choice of the best fitted parameters of a segmentation method for a given image, or the definition of new segmentation methods by optimization. We first present the state of art of unsupervised evaluation, and then, we compare six unsupervised evaluation criteria. For this comparative study, we use a database composed of 8400 synthetic gray-level images segmented in four different ways. Vinet's measure (correct classification rate is used as an objective criterion to compare the behavior of the different criteria. Finally, we present the experimental results on the segmentation evaluation of a few gray-level natural images.

Status and the evaluation of workplace deviance.

Science.gov (United States)

Bowles, Hannah Riley; Gelfand, Michele

2010-01-01

Bias in the evaluation of workplace misbehavior is hotly debated in courts and corporations, but it has received little empirical attention. Classic sociological literature suggests that deviance by lower-status actors will be evaluated more harshly than deviance by higher-status actors. However, more recent psychological literature suggests that discrimination in the evaluation of misbehavior may be moderated by the relative status of the evaluator because status influences both rule observance and attitudes toward social hierarchy. In Study 1, the psychological experience of higher status decreased rule observance and increased preferences for social hierarchy, as we theorized. In three subsequent experiments, we tested the hypothesis that higher-status evaluators would be more discriminating in their evaluations of workplace misbehavior, evaluating fellow higher-status deviants more leniently than lower-status deviants. Results supported the hypothesized interactive effect of evaluator status and target status on the evaluation of workplace deviance, when both achieved status characteristics (Studies 2a and 2b) and ascribed status characteristics (i.e., race and gender in Study 3) were manipulated.

Image quality evaluation of full reference algorithm

Science.gov (United States)

He, Nannan; Xie, Kai; Li, Tong; Ye, Yushan

2018-03-01

Image quality evaluation is a classic research topic, the goal is to design the algorithm, given the subjective feelings consistent with the evaluation value. This paper mainly introduces several typical reference methods of Mean Squared Error(MSE), Peak Signal to Noise Rate(PSNR), Structural Similarity Image Metric(SSIM) and feature similarity(FSIM) of objective evaluation methods. The different evaluation methods are tested by Matlab, and the advantages and disadvantages of these methods are obtained by analyzing and comparing them.MSE and PSNR are simple, but they are not considered to introduce HVS characteristics into image quality evaluation. The evaluation result is not ideal. SSIM has a good correlation and simple calculation ,because it is considered to the human visual effect into image quality evaluation,However the SSIM method is based on a hypothesis,The evaluation result is limited. The FSIM method can be used for test of gray image and color image test, and the result is better. Experimental results show that the new image quality evaluation algorithm based on FSIM is more accurate.

The EMEFS model evaluation. An interim report

Energy Technology Data Exchange (ETDEWEB)

Barchet, W.R. [Pacific Northwest Lab., Richland, WA (United States); Dennis, R.L. [Environmental Protection Agency, Research Triangle Park, NC (United States); Seilkop, S.K. [Analytical Sciences, Inc., Durham, NC (United States); Banic, C.M.; Davies, D.; Hoff, R.M.; Macdonald, A.M.; Mickle, R.E.; Padro, J.; Puckett, K. [Atmospheric Environment Service, Downsview, ON (Canada); Byun, D.; McHenry, J.N. [Computer Sciences Corp., Research Triangle Park, NC (United States); Karamchandani, P.; Venkatram, A. [ENSR Consulting and Engineering, Camarillo, CA (United States); Fung, C.; Misra, P.K. [Ontario Ministry of the Environment, Toronto, ON (Canada); Hansen, D.A. [Electric Power Research Inst., Palo Alto, CA (United States); Chang, J.S. [State Univ. of New York, Albany, NY (United States). Atmospheric Sciences Research Center

1991-12-01

The binational Eulerian Model Evaluation Field Study (EMEFS) consisted of several coordinated data gathering and model evaluation activities. In the EMEFS, data were collected by five air and precipitation monitoring networks between June 1988 and June 1990. Model evaluation is continuing. This interim report summarizes the progress made in the evaluation of the Regional Acid Deposition Model (RADM) and the Acid Deposition and Oxidant Model (ADOM) through the December 1990 completion of a State of Science and Technology report on model evaluation for the National Acid Precipitation Assessment Program (NAPAP). Because various assessment applications of RADM had to be evaluated for NAPAP, the report emphasizes the RADM component of the evaluation. A protocol for the evaluation was developed by the model evaluation team and defined the observed and predicted values to be used and the methods by which the observed and predicted values were to be compared. Scatter plots and time series of predicted and observed values were used to present the comparisons graphically. Difference statistics and correlations were used to quantify model performance. 64 refs., 34 figs., 6 tabs.

Evaluating Scientific Work by Means of Diffusion

Directory of Open Access Journals (Sweden)

Dan Ophir

2013-10-01

Full Text Available There are two approaches for evaluating scientific papers. The classic way is to choose well established representatives of the specific scientific community and have them evaluate their colleague's work. The other method of evaluation, the so called peer-evaluation method, is where peers (famous or otherwise of the author evaluate the paper. Peer-evaluation resembles the diffusion process in which a new substance spreads out to the whole solution. Similarly the new author and article are diffused among the scientific community, smoothing the level for accepting scientific papers. Using the classic-evaluation system of accepting new papers, the average starting scientists writes their first number of articles as collaborators with a renowned scientist, thus gradually building up their image. Only afterwards do these authors dare to independently publish. What are the pros and cons of both these types of scientific article evaluations?

Recommended evaluation procedure for photonuclear cross section

Energy Technology Data Exchange (ETDEWEB)

Lee, Young-Ouk; Chang, Jonghwa; Fukahori, Tokio [Japan Atomic Energy Research Inst., Tokai, Ibaraki (Japan). Tokai Research Establishment

1998-03-01

In order to generate photonuclear cross section library for the necessary applications, data evaluation is combined with theoretical evaluation, since photonuclear cross sections measured cannot provide all necessary data. This report recommends a procedure consisting of four steps: (1) analysis of experimental data, (2) data evaluation, (3) theoretical evaluation and, if necessary, (4) modification of results. In the stage of analysis, data obtained by different measurements are reprocessed through the analysis of their discrepancies to a representative data set. In the data evaluation, photonuclear absorption cross sections are evaluated via giant dipole resonance and quasi-deutron mechanism. With photoabsorption cross sections from the data evaluation, theoretical evaluation is applied to determine various decay channel cross sections and emission spectra using equilibrium and preequilibrium mechanism. After this, the calculated results are compared with measured data, and in some cases the results are modified to better describe measurements. (author)

EIA and EINP. Evaluation study

International Nuclear Information System (INIS)

Lande, R.W.I. van der; De Vries, E.F.

2001-01-01

The evaluation study on the title subjects concerns two subsidy tools in the Netherlands: the Energy Investment Rebate (EIA, abbreviated in Dutch) and the Subsidy for Energy in the non-profit sector and other special sectors (EINP, abbreviated in Dutch). The central question in the evaluation was to what extent did the EIA and EINP contribute to the original policy targets and at what costs. The evaluation has been carried out by means of a desk study, interviews, and an analysis of bottlenecks and possible solutions. [nl

Development of integrity evaluation technology for pressurized components in nuclear power plant and IT based integrity evaluation system

International Nuclear Information System (INIS)

Kim, Young Jin; Choi, Jae Boong; Shim, Do Jun

2004-02-01

The objective of this research is to develop on efficient integrity evaluation technology and to investigate the applicability of the newly-developed technology such as internet-based cyber platform etc. to Nuclear Power Plant(NPP) components. The development of an efficient structural integrity evaluation system is necessary for safe operation of NPP as the increase of operating periods. Moreover, material test data as well as emerging structural integrity assessment technology are also needed for the evaluation of aged components. The following five topics are covered in this project: development of the wall-thinning evaluation program for nuclear piping; development of structural integrity evaluation criteria for steam generator tubes with cracks of various shape; development of fatigue life evaluation system for major components of NPP; ingegration of internet-based cyber platform and integrity evaluation program for primary components of NPP; effects of aging on strength of dissimilar welds

Development of integrity evaluation technology for pressurized components in nuclear power plant and IT based integrity evaluation system

Energy Technology Data Exchange (ETDEWEB)

Kim, Young Jin; Choi, Jae Boong; Shim, Do Jun [Sungkyunkwan Univ., Seoul (Korea, Republic of)] (and others)

2004-02-15

The objective of this research is to develop on efficient integrity evaluation technology and to investigate the applicability of the newly-developed technology such as internet-based cyber platform etc. to Nuclear Power Plant(NPP) components. The development of an efficient structural integrity evaluation system is necessary for safe operation of NPP as the increase of operating periods. Moreover, material test data as well as emerging structural integrity assessment technology are also needed for the evaluation of aged components. The following five topics are covered in this project: development of the wall-thinning evaluation program for nuclear piping; development of structural integrity evaluation criteria for steam generator tubes with cracks of various shape; development of fatigue life evaluation system for major components of NPP; ingegration of internet-based cyber platform and integrity evaluation program for primary components of NPP; effects of aging on strength of dissimilar welds.

Bridging the Evaluation Gap

Directory of Open Access Journals (Sweden)

Paul Wouters

2017-02-01

Full Text Available Paul Wouters’ essay is concerned with bridging the gap between what we value in our academic work and how we are assessed in formal evaluation exercises. He reflects on the recent evaluation of his own center, and reminds us that it is productive to see evaluations not as the (obviously impossible attempt to produce a true representation of past work, but rather as the exploration and performance of “who one wants to be.” Reflecting on why STS should do more than just play along to survive in the indicator game, he suggests that our field should contribute to changing its very rules. In this endeavor, the attitude and sensibilities developed in our field may be more important than any specific theoretical concepts or methodologies.

Multidisciplinary eHealth Survey Evaluation Methods

Science.gov (United States)

Karras, Bryant T.; Tufano, James T.

2006-01-01

This paper describes the development process of an evaluation framework for describing and comparing web survey tools. We believe that this approach will help shape the design, development, deployment, and evaluation of population-based health interventions. A conceptual framework for describing and evaluating web survey systems will enable the…

45 CFR 617.5 - Self-evaluation.

Science.gov (United States)

2010-10-01

... 45 Public Welfare 3 2010-10-01 2010-10-01 false Self-evaluation. 617.5 Section 617.5 Public... Self-evaluation. (a) Each recipient (including subrecipients) employing the equivalent of fifteen or more full-time employees shall complete a written self-evaluation of its compliance under this part...

6 CFR 15.10 - Self-evaluation.

Science.gov (United States)

2010-01-01

... 6 Domestic Security 1 2010-01-01 2010-01-01 false Self-evaluation. 15.10 Section 15.10 Domestic... Self-evaluation. (a) Except as provided in paragraph (d) of this section, the Department shall, not... organizations representing individuals with disabilities, to participate in the self-evaluation process. (c) The...

46 CFR 30.30-9 - Evaluation.

Science.gov (United States)

2010-10-01

... 46 Shipping 1 2010-10-01 2010-10-01 false Evaluation. 30.30-9 Section 30.30-9 Shipping COAST GUARD, DEPARTMENT OF HOMELAND SECURITY TANK VESSELS GENERAL PROVISIONS Interim Procedures for Evaluating Vessel Personnel Licensing and Certification Programs of Foreign Countries § 30.30-9 Evaluation. Materials...

34 CFR 105.10 - Self-evaluation.

Science.gov (United States)

2010-07-01

... 34 Education 1 2010-07-01 2010-07-01 false Self-evaluation. 105.10 Section 105.10 Education... DEPARTMENT OF EDUCATION § 105.10 Self-evaluation. (a) The Department shall, within one year of the effective... organizations representing individuals with handicaps to participate in the self-evaluation process by...

State Teacher Evaluation and Teacher Education

Science.gov (United States)

Marchant, Gregory J.; David, Kristine A.; Rodgers, Deborah; German, Rachel L.

2015-01-01

Current accountability trends suggest an increasing role in state mandates regarding teacher evaluation. With various evaluation models and components serving as the basis for quality teaching, teacher education programs need to recognize the role teacher evaluation plays and incorporate aspects where appropriate. This article makes that case and…

Large Scale Multi-view Stereopsis Evaluation

DEFF Research Database (Denmark)

Jensen, Rasmus Ramsbøl; Dahl, Anders Bjorholm; Vogiatzis, George

2014-01-01

positions and reference structured light scans, all acquired by a 6-axis industrial robot. To apply this dataset we propose an extension of the evaluation protocol from the Middlebury evaluation, reflecting the more complex geometry of some of our scenes. The proposed dataset is used to evaluate the state...

Comparison of evaluated data for chromium-52, iron-56 and nickel-58 - International Evaluation Co-operation Volume 1

International Nuclear Information System (INIS)

Fu, C.Y.; Larson, Duane C.; Hetrick, David M.; Vonach, Herbert; Maino, G.; Menapace, Enzo; Mengoni, I.; Asami, T.; Chiba, Satoshi; Shibata, Keiichi Kanagawa; Iijima, S.; Yamamuro, N.; Kopecky, J.

1992-01-01

A Working Party on International Evaluation Co-operation was established under the sponsorship of the OECD/NEA Nuclear Science Committee (NSC) to promote the exchange of information on nuclear data evaluations, validation, and related topics. Its aim is also to provide a framework for co-operative activities between members of the major nuclear data evaluation projects. This includes the possible exchange of scientists in order to encourage co-operation. Requirements for experimental data resulting from this activity are compiled. The Working Party determines common criteria for evaluated nuclear data files with a view to assessing and improving the quality and completeness of evaluated data. The Parties to the project are: ENDF (United States), JEFF/EFF (NEA Data Bank Member countries), and JENDL (Japan). Co-operation with evaluation projects of non-OECD countries are organised through the Nuclear Data Section of the International Atomic Energy Agency (IAEA). This report is issued by a Subgroup investigating discrepancies in different evaluations of the major structural materials. The isotopes selected are Chromium-52, Iron-56 and Nickel-58. Graphical overlay comparisons between cross-sections, and also energy-angle correlated particle distributions, in different evaluated libraries was performed. Benefits from these comparisons include information useful for improving structural material evaluations in individual data libraries, for assessing differences associated with present-day evaluation techniques and for development of techniques for graphical representation of the energy-angle correlated data

OERL: A Tool For Geoscience Education Evaluators

Science.gov (United States)

Zalles, D. R.

2002-12-01

The Online Evaluation Resource Library (OERL) is a Web-based set of resources for improving the evaluation of projects funded by the Directorate for Education and Human Resources (EHR) of the National Science Foundation (NSF). OERL provides prospective project developers and evaluators with material that they can use to design, conduct, document, and review evaluations. OERL helps evaluators tackle the challenges of seeing if a project is meeting its implementation and outcome-related goals. Within OERL is a collection of exemplary plans, instruments, and reports from evaluations of EHR-funded projects in the geosciences and in other areas of science and mathematics. In addition, OERL contains criteria about good evaluation practices, professional development modules about evaluation design and questionnaire development, a dictionary of key evaluation terms, and links to evaluation standards. Scenarios illustrate how the resources can be used or adapted. Currently housed in OERL are 137 instruments, and full or excerpted versions of 38 plans and 60 reports. 143 science and math projects have contributed to the collection so far. OERL's search tool permits the launching of precise searches based on key attributes of resources such as their subject area and the name of the sponsoring university or research institute. OERL's goals are to 1) meet the needs for continuous professional development of evaluators and principal investigators, 2) complement traditional vehicles of learning about evaluation, 3) utilize the affordances of current technologies (e.g., Web-based digital libraries, relational databases, and electronic performance support systems) for improving evaluation practice, 4) provide anytime/anyplace access to update-able resources that support evaluators' needs, and 5) provide a forum by which professionals can interact on evaluation issues and practices. Geoscientists can search the collection of resources from geoscience education projects that have

An inventory of evaluation studies of information technology in health care - Trends in evaluation research 1982-2002

NARCIS (Netherlands)

Ammenwerth, E.; de Keizer, N.

2005-01-01

Objectives: During the last years the significance of evaluation studies as well as the interest in adequate Methods and approaches for evaluation has grown in medical informatics. In order to put this discussion into historical perspective of evaluation research, we conducted a systematic review on

Project evaluation: one framework - four approaches

DEFF Research Database (Denmark)

Rode, Anna Le Gerstrøm; Svejvig, Per

. Introducing a framework that can help structure such evaluations, the aim of this paper is to contribute to project theory and practice by inspiring project researchers and aiding project workers in their efforts to open up the black box of projects and deliver relevant and valuable results......There are many theoretical and practical reasons for evaluating projects – including explorative arguments focusing on expanding descriptive knowledge on projects as well as normative arguments focusing on developing prescriptive knowledge of project management. Despite the need for effective...... project management and research methods that can assess effective project management methodologies, extant literature on evaluation procedures or guidelines on how to evaluate projects and/or project management is scarce. To address this challenge, this paper introduces an evaluation framework consisting...

Unpaid work in health economic evaluations.

Science.gov (United States)

Krol, Marieke; Brouwer, Werner

2015-11-01

Given its societal importance, unpaid work should be included in economic evaluations of health care technology aiming to take a societal perspective. However, in practice this does not often appear to be the case. This paper provides an overview of the current place of unpaid work in economic evaluations in theory and in practice. It does so first by summarizing recommendations regarding the inclusion of unpaid labor reported in health economic textbooks and national guidelines for economic evaluations. In total, three prominent health economic text-books were studied and 28 national health economic guidelines. The paper, moreover, provides an overview of the instruments available to measure lost unpaid labor and reports on a review of the place of unpaid labor in applied economic evaluations in the area of rheumatoid arthritis. The review was conducted by examining methodology of evaluations published between 1 March 2008 and 1 March 2013. The results of this study show that little guidance is offered regarding the inclusion of unpaid labor in economic evaluations in textbooks and guidelines. The review identified five productivity costs instruments including questions about unpaid work and 33 economic evaluations of treatments for rheumatoid arthritis of which only one included unpaid work. The results indicate that unpaid work is rarely included in applied economic evaluations of treatments for rheumatoid arthritis, despite this disease expecting to be associated with lost unpaid work. Given the strong effects of certain diseases and treatments on the ability to perform unpaid work, unpaid work currently receives less attention in economic evaluations than it deserves. Copyright © 2015 Elsevier Ltd. All rights reserved.

Educational Evaluation: The State of the Field.

Science.gov (United States)

Wolf, Richard M., Ed.

1987-01-01

Educational evaluation is discussed. Topics include: an evaluation framework, educational objectives and study design from a 20-year perspective, a sample study, educational evaluation for local school improvement, decision-oriented evaluation studies, reporting study results, and professional standards for assuring the quality of educational…

The AME2003 atomic mass evaluation (I). Evaluation of input data, adjustment procedures

International Nuclear Information System (INIS)

Wapstra, A.H.; Audi, G.; Thibault, C.

2003-01-01

This paper is the first of two parts presenting the result of a new evaluation of atomic masses (AME2003). In this first part we give full information on the used and rejected input data and on the procedures used in deriving the tables in the second part. We first describe the philosophy and procedures used in selecting nuclear-reaction, decay, and mass spectrometric results as input values in a least-squares evaluation of best values for atomic masses. The calculation procedures and particularities of the AME are then described. All accepted data, and rejected ones with a reported precision still of interest, are presented in a table and compared there with the adjusted values. The differences with the earlier evaluation are briefly discussed and information is given of interest for the users of this AME. The second paper for the AME2003, last in this issue, gives a table of atomic masses, tables and graphs of derived quantities, and the list of references used in both this evaluation and the NUBASE2003 table (first paper in this issue). AMDC: http://csnwww.in2p3.fr/AMDC/

Quality dimensions in health evaluation: manager's conceptions.

Science.gov (United States)

Bosi, Maria Lúcia Magalhães; Pontes, Ricardo José Soares; Vasconcelos, Suziana Martins de

2010-04-01

To understand manager's perceptions and experiences in regards to qualitative evaluations in basic health care. A qualitative study, based on the critical interpretive approach, was performed in 2006, in the city of Fortaleza, Northeastern Brazil. The sample consisted of the group responsible for planning basic health care at the state level. In order to obtain the empirical data, the focus group technique was utilized. Two central themes emerged concerning the perceptions about quality and the dimensions of quality employed in health evaluations, which were revealed in distinct ways. The concepts of quality evaluation and qualitative evaluation did not appear clearly understood, confusing qualitative evaluation with formal quality evaluations. Likewise, the inherent multidimensionality of quality was not recognized. Despite the criticism expressed by the participants regarding the improper quantification of certain dimensions, the necessary technical skills and understanding were not observed for the approach to include the distinct dimensions of quality in the evaluation process. The conceptions of managers responsible for the planning of basic health care at the state level revealed an important disassociation from the premises of qualitative evaluation, especially those evaluations oriented by the fourth generation approach. Therefore, the model adopted by these actors for the evaluation of program and service quality did not consider their multidimensionality.

Squale: evaluation criteria of functioning safety; Squale: criteres d`evaluation de la surete de fonctionnement

Energy Technology Data Exchange (ETDEWEB)

Deswarte, Y; Kaaniche, M [Centre National de la Recherche Scientifique (CNRS), 31 - Toulouse (France). Laboratoire d` Analyse et d` Architecture des Systemes; Corneillie, P [CE2A-DI, 92 - Courbevoie (France); Benoit, P [Matra Transport International, 92 - Montrouge (France)

1998-05-01

The SQUALE (security, safety and quality evaluation for dependable systems) project is part of the ACTS (advanced communications, technologies and services) European program. Its aim is to develop confidence evaluation criteria to test the functioning safety of systems. All industrial sectors that use critical applications (nuclear, railway, aerospace..) are concerned. SQUALE evaluation criteria differ from the classical evaluation methods: they are independent of the application domains and industrial sectors, they take into account the overall functioning safety attributes, and they can progressively change according to the level of severity required. In order to validate the approach and to refine the criteria, a first experiment is in progress with the METEOR automatic underground railway and another will be carried out on a telecommunication system developed by Bouygues company. (J.S.) 15 refs.

Decay data evaluation project: Evaluation of 52Mn and 52mMn nuclear decay data

Science.gov (United States)

Luca, Aurelian

2017-09-01

All nuclear decay data within the 52Fe-52m,52Mn-52Cr decay chain have been evaluated at IFIN-HH, Romania, as part of an IAEA coordinated research project (F41029) and incorporated into the Decay Data Evaluation Project (DDEP). Both 52Fe and daughter 52Mn are two potentially promising radionuclides to be incorporated into suitable radiopharmaceuticals for PET and SPECT imaging. The decay data evaluation of 52Fe has previously been published and reported to the IAEA Nuclear Data Section. Equivalent DDEP evaluations for 52Mn and 52mMn have also been completed recently, and are presented in summary form below. These improved decay data sets have also been reported to the IAEA in detail, and are highly suitable in dose rate calculations for their application in nuclear medicine.

34 CFR 1200.110 - Self-evaluation.

Science.gov (United States)

2010-07-01

... 34 Education 3 2010-07-01 2010-07-01 false Self-evaluation. 1200.110 Section 1200.110 Education Regulations of the Offices of the Department of Education (Continued) NATIONAL COUNCIL ON DISABILITY... COUNCIL ON DISABILITY § 1200.110 Self-evaluation. (a) The agency shall, by November 28, 1994, evaluate its...

10 CFR 4.510 - Self-evaluation.

Science.gov (United States)

2010-01-01

... 10 Energy 1 2010-01-01 2010-01-01 false Self-evaluation. 4.510 Section 4.510 Energy NUCLEAR... Programs or Activities Conducted by the U.S. Nuclear Regulatory Commission § 4.510 Self-evaluation. (a) The... representing handicapped persons, to participate in the self-evaluation process by submitting comments (both...

22 CFR 530.110 - Self-evaluation.

Science.gov (United States)

2010-04-01

... 22 Foreign Relations 2 2010-04-01 2010-04-01 true Self-evaluation. 530.110 Section 530.110 Foreign... PROGRAMS OR ACTIVITIES CONDUCTED BY THE BROADCASTING BOARD OF GOVERNORS § 530.110 Self-evaluation. (a) The... representing handicapped persons, to participate in the self-evaluation process by submitting comments (both...

The current status of theory evaluation in nursing.

Science.gov (United States)

Im, Eun-Ok

2015-10-01

To identify the current status of theory evaluation in nursing and provide directions for theory evaluation for future development of theoretical bases of nursing discipline. Theory evaluation is an essential component in development of nursing knowledge, which is a critical element in development of nursing discipline. Despite earlier significant efforts for theory evaluation in nursing, a recent decline in the number of theory evaluation articles was noted and there have been few updates on theory evaluation in nursing. Discussion paper. A total of 58 articles published from 2003-2014 were retrieved through searches using the PUBMED, PsyInfo and CINAHL. The articles were sorted by the area of evaluation and analysed to identify themes reflecting the theory evaluation process. Diverse ways of theory evaluation need to be continuously used in future theory evaluation efforts. Six themes reflecting the theory evaluation process were identified: (a) rarely using existing theory evaluation criteria; (b) evaluating specifics; (c) using various statistical analysis methods; (d) developing instruments; (e) adopting in practice and education; and (f) evaluating mainly middle-range theories and situation-specific theories. © 2015 John Wiley & Sons Ltd.

An inventory of evaluation studies of information technology in health care: trends in evaluation research 1982-2002

NARCIS (Netherlands)

Ammenwerth, Elske; de Keizer, Nicolette

2004-01-01

During the last years the significance of evaluation studies as well as the interest in adequate methods and approaches for evaluation has grown in medical informatics. In order to put this discussion into the historical context of evaluation research, we conducted a systematic overview on trends in

An Evaluation Use Framework and Empirical Assessment

Science.gov (United States)

Peck, Laura R.; Gorzalski, Lindsey M.

2009-01-01

Background: Research on evaluation use focuses on putting evaluation recommendations into practice. Prior theoretical research proposes varied frameworks for understanding the use (or lack) of program evaluation results. Purpose: Our purpose is to create and test a single, integrated framework for understanding evaluation use. This article relies…

Presentation of economic evaluation results.

Science.gov (United States)

Chaikledkaew, Usa

2014-05-01

The first HTA guidelines for Thailand included a chapter outlining a set of guidelines on how best to report the findings of health economic evaluations, based on a review of best practice and existing guidelines on the presentation of economic evaluation results from around the world. In this second edition of HTA guidelines for Thailand, the recommendations build on the first edition by using a case study to illustrate how the guidelines can be applied in a real research context. The guidelines propose that all reporting include ten key elements: defining the scope of the study, selection of comparator(s), defining the type of economic evaluation, measurement of costs, measurement of clinical effects, handling time in economic evaluation studies, handling uncertainty and sensitivity analysis, presentation of the results, discussion of the results, and disclosure of funding and authors conflict of interest.

User-Centered Evaluation of Visual Analytics

Energy Technology Data Exchange (ETDEWEB)

Scholtz, Jean C.

2017-10-01

Visual analytics systems are becoming very popular. More domains now use interactive visualizations to analyze the ever-increasing amount and heterogeneity of data. More novel visualizations are being developed for more tasks and users. We need to ensure that these systems can be evaluated to determine that they are both useful and usable. A user-centered evaluation for visual analytics needs to be developed for these systems. While many of the typical human-computer interaction (HCI) evaluation methodologies can be applied as is, others will need modification. Additionally, new functionality in visual analytics systems needs new evaluation methodologies. There is a difference between usability evaluations and user-centered evaluations. Usability looks at the efficiency, effectiveness, and user satisfaction of users carrying out tasks with software applications. User-centered evaluation looks more specifically at the utility provided to the users by the software. This is reflected in the evaluations done and in the metrics used. In the visual analytics domain this is very challenging as users are most likely experts in a particular domain, the tasks they do are often not well defined, the software they use needs to support large amounts of different kinds of data, and often the tasks last for months. These difficulties are discussed more in the section on User-centered Evaluation. Our goal is to provide a discussion of user-centered evaluation practices for visual analytics, including existing practices that can be carried out and new methodologies and metrics that need to be developed and agreed upon by the visual analytics community. The material provided here should be of use for both researchers and practitioners in the field of visual analytics. Researchers and practitioners in HCI and interested in visual analytics will find this information useful as well as a discussion on changes that need to be made to current HCI practices to make them more suitable to

Health Information Technology Evaluation Framework (HITREF) Comprehensiveness as Assessed in Electronic Point-of-Care Documentation Systems Evaluations.

Science.gov (United States)

Sockolow, Paulina S; Bowles, Kathryn H; Rogers, Michelle

2015-01-01

We assessed the Health Information Technology (HIT) Reference-based Evaluation Framework (HITREF) comprehensiveness in two HIT evaluations in settings different from that in which the HITREF was developed. Clinician satisfaction themes that emerged from clinician interviews in the home care and the hospital studies were compared to the framework components. Across both studies, respondents commented on 12 of the 20 HITREF components within 5 of the 6 HITREF concepts. No new components emerged that were missing from the HITREF providing evidence that the HITREF is a comprehensive framework. HITREF use in a range of HIT evaluations by researchers new to the HITREF demonstrates that it can be used as intended. Therefore, we continue to recommend the HITREF as a comprehensive, research-based HIT evaluation framework to increase the capacity of informatics evaluators' use of best practice and evidence-based practice to support the credibility of their findings for fulfilling the purpose of program evaluation.

Validity in Qualitative Evaluation

OpenAIRE

Vasco Lub

2015-01-01

This article provides a discussion on the question of validity in qualitative evaluation. Although validity in qualitative inquiry has been widely reflected upon in the methodological literature (and is still often subject of debate), the link with evaluation research is underexplored. Elaborating on epistemological and theoretical conceptualizations by Guba and Lincoln and Creswell and Miller, the article explores aspects of validity of qualitative research with the explicit objective of con...

Radiologic evaluation of the myelomeningocele patient

International Nuclear Information System (INIS)

Byrd, S.E.; Radkowski, M.A.; McLone, D.G.; Storrs, B.B.

1988-01-01

The only radiologic procedure that is useful in the newborn with a fresh myelomeningocele is US or CT of the head to evaluate ventricular size. The imaging procedures become extremely important in the evaluation of the postoperative patient with myelomeningocele. US and/or CT is used to evaluate for hydrocephalus. MR is used to evaluate the spinal axis to determine the position of the cervicomedullary kink, hydromyelia, arachnoid cyst, inclusion epidermoids, and tethering of the spinal cord. US and myelography with CT are needed in subtle cases of tethering, diastematomyelia, arachnoid cyst, and severe scoliosis

Researches on nuclear criticality safety evaluation

Energy Technology Data Exchange (ETDEWEB)

Okuno, Hiroshi; Suyama, Kenya; Nomura, Yasushi [Japan Atomic Energy Research Inst., Tokai, Ibaraki (Japan). Tokai Research Establishment

2003-10-01

For criticality safety evaluation of burnup fuel, the general-purpose burnup calculation code, SWAT, was revised, and its precision was confirmed through comparison with other results from OECD/NEA's burnup credit benchmarks. Effect by replacing the evaluated nuclear data from JENDL-3.2 to ENDF/B-VI and JEF-2.2 was also studied. Correction factors were derived for conservative evaluation of nuclide concentrations obtained with the simplified burnup code ORIGEN2.1. The critical masses of curium were calculated and evaluated for nuclear criticality safety management of minor actinides. (author)

Researches on nuclear criticality safety evaluation

International Nuclear Information System (INIS)

Okuno, Hiroshi; Suyama, Kenya; Nomura, Yasushi

2003-01-01

For criticality safety evaluation of burnup fuel, the general-purpose burnup calculation code, SWAT, was revised, and its precision was confirmed through comparison with other results from OECD/NEA's burnup credit benchmarks. Effect by replacing the evaluated nuclear data from JENDL-3.2 to ENDF/B-VI and JEF-2.2 was also studied. Correction factors were derived for conservative evaluation of nuclide concentrations obtained with the simplified burnup code ORIGEN2.1. The critical masses of curium were calculated and evaluated for nuclear criticality safety management of minor actinides. (author)

International scope of data evaluation

International Nuclear Information System (INIS)

Pearlstein, S.

1985-01-01

This paper summarizes the principal national and international evaluation activities that contributed to the widespread use of evaluated data files. Emphasis is placed on those efforts that have become best known through the availability of data, documentation, and computer codes. Early attempts at nuclear data evaluation consisted of improving communication among measurers of similar information. As reactor methodology proceeded from a four factor formula to multi-group theory the demand for detailed representation of nuclear data increased. The systematic access to large volumes of data required placing the information in computer readable formats

Reserve evaluation of minerals at NUCLEBRAS

International Nuclear Information System (INIS)

Marques, J.P.M.; Guerra, P.A.G.; Vinha, C.A.G. da

1980-10-01

The method used for the reserve evaluation of minerals, particularly of uranium, as used worldwide, and specially at NUCLEBRAS is described. This is done through a series of procedures envolving basic definitions, reserve evaluation methods (conventional, statistical and geoestatistical), data management, use of computer systems, classification and evaluation of reserves. (Author) [pt

On the evaluation of Web Radio

OpenAIRE

Field, A.N.; Hartel, Pieter H.

2001-01-01

We develop an evaluation method for Web radio, and perform it to see what we can be learnt about seven prominent Web radio sites. We also evaluate a commercial FM radio station for control purposes. We present a taxonomy of Web radio, and we give our observations and conclusions on this evaluation.

10 CFR 1003.45 - OHA evaluation.

Science.gov (United States)

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false OHA evaluation. 1003.45 Section 1003.45 Energy DEPARTMENT... OHA evaluation. (a)(1) The OHA may initiate an investigation of any statement in an application and utilize in its evaluation any relevant facts obtained by such investigation. The OHA may order the...

10 CFR 501.163 - OFE evaluation.

Science.gov (United States)

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false OFE evaluation. 501.163 Section 501.163 Energy DEPARTMENT... OFE evaluation. (a) The record shall consist of the complaint and any supporting documents and all..., and may utilize in its evaluation any relevant facts obtained by such investigation or from any other...

45 CFR 606.10 - Self-evaluation.

Science.gov (United States)

2010-10-01

... 45 Public Welfare 3 2010-10-01 2010-10-01 false Self-evaluation. 606.10 Section 606.10 Public... § 606.10 Self-evaluation. (a) The Foundation shall, within one year of the effective date of this part... with handicaps, to participate in the self-evaluation process by submitting comments (both oral and...

10 CFR 1003.36 - OHA evaluation.

Science.gov (United States)

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false OHA evaluation. 1003.36 Section 1003.36 Energy DEPARTMENT....36 OHA evaluation. (a)(1) The OHA may initiate an investigation of any statement in an appeal and utilize in its evaluation any relevant facts obtained by such investigation. The OHA may solicit and...

Does supplier evaluation impact process improvement?

Directory of Open Access Journals (Sweden)

Shiva Prasad h c

2016-09-01

Full Text Available Purpose: The research explores and examines factors for supplier evaluation and its impact on process improvement particularly aiming on a steel pipe manufacturing firm in Gujarat, India. Design/Methodology/approach: The conceptual research framework was developed and hypotheses were stated considering the analysis of literature and discussions with the managers and engineers of a steel pipe manufacturing company in Gujarat, India. Data was collected using in-depth interview. The questionnaire primarily involves the perception of evaluation of supplier. Factors influencing supplier evaluation and its influence on process improvement is also examined in this study. The model testing and validation was done using partial least square method. Outcomes signified that the factors that influence evaluation of the supplier are quality, cost, delivery and supplier relationship management. Findings: The study depicted that quality and cost factors for supplier evaluation are insignificant. The delivery and supplier relationship management have significant influence on evaluation of the supplier. The research also depicted that supplier evaluation has significant influence on process improvement. Research limitations/implications: The study has been made specifically for ABC steel pipe manufacturing industry in Gujarat, India and may not be appropriate to the other industries or any parts of the world. There is a possibility of response bias as the conclusions of this research was interpreted on survey responses taken from the employees of case study company, so it is suggested that future research can overcome this problem by employing various methodologies in addition to surveys like carrying out focus group and in-depth interviews, brainstorming sessions with the experts etc. Originality/value: Many researchers have considered quality, cost and delivery as the factors for evaluating the suppliers. But for a company it is quintessential to have good

A Marketing Approach to Evaluation: Four Lessons for Evaluators from the Honda Motor Company.

Science.gov (United States)

Mangano, Michael F.

1992-01-01

Describes lessons evaluators can learn from the Honda Motor Company and how an evaluation office within the Department of Health and Human Services has applied these lessons. The lessons include (1) sound market research; (2) creating top-notch production capabilities; (3) building a better mousetrap; and (4) aggressive product selling. (SLD)

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

The Ame2012 atomic mass evaluation. Pt. 1. Evaluation of input data, adjustment procedures

International Nuclear Information System (INIS)

Audi, G; Wang, M.; Wapstra, A.H.; Kondev, F.G.; MacCormick, M.; Xu, X.; Pfeiffer, B.

2012-01-01

This paper is the first of two articles (Part I and Part II) that presents the results of the new atomic mass evaluation, Ame2012. It includes complete information on the experimental input data (including not used and rejected ones), as well as details on the evaluation procedures used to derive the tables with recommended values given in the second part. This article describes the evaluation philosophy and procedures that were implemented in the selection of specific nuclear reaction, decay and mass-spectrometer results. These input values were entered in the least-squares adjustment procedure for determining the best values for the atomic masses and their uncertainties. Calculation procedures and particularities of the AME are then described. All accepted and rejected data, including outweighed ones, are presented in a tabular format and compared with the adjusted values (obtained using the adjustment procedure). Differences with the previous Ame2003 evaluation are also discussed and specific information is presented for several cases that may be of interest to various AME users. The second Ame2012 article, the last one in this issue, gives a table with recommended values of atomic masses, as well as tables and graphs of derived quantities, along with the list of references used in both this Ame2012 evaluation and the Nubase2012 one (the first paper in this issue). (authors)

Responding to the UNDP Evaluations Unit

Science.gov (United States)

Lempert, David H.

2012-01-01

The author of an indicator that tests evaluation system compliance with good governance principles addresses the UNDP's response to his article by offering an empirical test of the UNDP's commitment to reform. While the UNDP Evaluations Office claims to be working on reforms, the test exposes the unwillingness of the UNDP Evaluations Office to…

31 CFR 17.110 - Self-evaluation.

Science.gov (United States)

2010-07-01

... 31 Money and Finance: Treasury 1 2010-07-01 2010-07-01 false Self-evaluation. 17.110 Section 17... § 17.110 Self-evaluation. (a) The agency shall, by two years after the effective date of this part... handicaps, to participate in the self-evaluation process. (c) The agency shall, until three years following...

45 CFR 1151.42 - Self evaluation.

Science.gov (United States)

2010-10-01

... 45 Public Welfare 3 2010-10-01 2010-10-01 false Self evaluation. 1151.42 Section 1151.42 Public... Self evaluation. (a) A recipient shall within six months of the effective date of this part: (1... Endowment upon request, for at least three years following completion of the self-evaluation: (i) A list of...

10 CFR 1003.55 - OHA evaluation.

Science.gov (United States)

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false OHA evaluation. 1003.55 Section 1003.55 Energy DEPARTMENT... Rescission § 1003.55 OHA evaluation. (a)(1) The OHA may initiate an investigation of any statement in an application and utilize in its evaluation any relevant facts obtained by such investigation. The OHA may...

10 CFR 1003.25 - OHA evaluation.

Science.gov (United States)

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false OHA evaluation. 1003.25 Section 1003.25 Energy DEPARTMENT... § 1003.25 OHA evaluation. (a)(1) OHA may initiate an investigation of any statement in an application and utilize in its evaluation any relevant facts obtained by such investigation. The OHA may solicit and...

45 CFR 1156.12 - Self-evaluation.

Science.gov (United States)

2010-10-01

... 45 Public Welfare 3 2010-10-01 2010-10-01 false Self-evaluation. 1156.12 Section 1156.12 Public... Endowment Recipients § 1156.12 Self-evaluation. (a) Each recipient employing the equivalent of 15 or more full time employees may be required to complete a written self-evaluation, in a manner specified by the...

10 CFR 501.133 - DOE evaluation.

Science.gov (United States)

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false DOE evaluation. 501.133 Section 501.133 Energy DEPARTMENT... Interpretation § 501.133 DOE evaluation. (a)(1) The record shall consist of the request for an interpretation and... investigate and corroborate any statement in a request or related documents and may utilize in its evaluation...

Evaluation of School Education in Serbia

Science.gov (United States)

Hebib, Emina; Spasenovic, Vera; Šaljic, Zorica

2015-01-01

In the education system of Serbia significant results have been achieved in the last ten years regarding the establishment and development of the evaluation system in education and the practical application of various types and procedures of evaluation. This paper gives a short overview of ways in which evaluation is carried out on elementary,…

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

Protocol for the effect evaluation of independent medical evaluation after six months sick leave: a randomized controlled trial of independent medical evaluation versus treatment as usual in Norway.

Science.gov (United States)

Husabo, Elisabeth; Monstad, Karin; Holmås, Tor Helge; Oyeflaten, Irene; Werner, Erik L; Maeland, Silje

2017-06-14

It has been discussed whether the relationship between a patient on sick leave and his/her general practitioner (GP) is too close, as this may hinder the GP's objective evaluation of need for sick leave. Independent medical evaluation involves an independent physician consulting the patient. This could lead to new perspectives on sick leave and how to follow-up the patient. The current study is a randomized controlled trial in a Norwegian primary care context, involving an effect evaluation, a cost/benefit analysis, and a qualitative evaluation. Independent medical evaluation will be compared to treatment as usual, i.e., the physicians' and social insurance agencies' current management of long-term sick-listed patients. Individuals aged 18-65 years, sick listed by their GP and on full or partial sick leave for the past 6 months in Hordaland county will be included. Exclusion criteria are pregnancy, cancer, dementia or an ICD-10 diagnosis. A total sample of 3800 will be randomly assigned to either independent medical evaluation or treatment as usual. Official register data will be used to measure the primary outcome; change in sickness benefits at 7, 9 and 12 months. Sick listed in other counties will serve as a second control group, if appropriate under the "common trend" assumption. The Norwegian effect evaluation of independent medical evaluation after 6 months sick leave is a large randomized controlled trial, and the first of its kind, to evaluate this type of intervention as a means of getting people back to work after long-term sickness absence. ClinicalTrials.gov NCT02524392 . Registered June 23, 2015.

Evaluation report no.1

International Nuclear Information System (INIS)

1995-06-01

This document, which is the first evaluation report from the French National Evaluation Commission about research on radioactive waste management, was sent to the French Government on June 30, 1995. The Commission was created in January 1994 and started its investigations on April 1994. The evaluation concerns the three axes of the 91-1381 law from December 30, 1991 (1 - separation-transmutation and minimization of wastes, 2 - underground disposal, 3 - choices for conditioning, storage and disposal). The document has been written after hearing of the principal French research organisms. The report focusses on the necessity for a scientific and technical coordination between all the organisms concerned, for a consistent and open analysis of all research topics. This implies a compatibility between schedules and specifications, and with the 15 years allowed by the law. (J.S.). 15 figs., 14 tabs., 4 annexes., 1 glossary

Probabilistic evaluation of design S-N curve and reliability assessment of ASME code-based evaluation

International Nuclear Information System (INIS)

Zhao Yongxiang

1999-01-01

A probabilistic evaluating approach of design S-N curve and a reliability assessment approach of the ASME code-based evaluation are presented on the basis of Langer S-N model-based P-S-N curves. The P-S-N curves are estimated by a so-called general maximum likelihood method. This method can be applied to deal with the virtual stress amplitude-crack initial life data which have a characteristics of double random variables. Investigation of a set of the virtual stress amplitude-crack initial life (S-N) data of 1Cr18Ni9Ti austenitic stainless steel-welded joint reveals that the P-S-N curves can give a good prediction of scatter regularity of the S-N data. Probabilistic evaluation of the design S-N curve with 0.9999 survival probability has considered various uncertainties, besides of the scatter of the S-N data, to an appropriate extent. The ASME code-based evaluation with 20 reduction factor on the mean life is much more conservative than that with 2 reduction factor on the stress amplitude. Evaluation of the latter in 666.61 MPa virtual stress amplitude is equivalent to 0.999522 survival probability and in 2092.18 MPa virtual stress amplitude equivalent to 0.9999999995 survival probability. This means that the evaluation in the low loading level may be non-conservative and in contrast, too conservative in the high loading level. Cause is that the reduction factors are constants and the factors can not take into account the general observation that scatter of the N data increases with the loading level decreasing. This has indicated that it is necessary to apply the probabilistic approach to the evaluation of design S-N curve

Human Reliability Data Bank: evaluation results

International Nuclear Information System (INIS)

Comer, M.K.; Donovan, M.D.; Gaddy, C.D.

1985-01-01

The US Nuclear Regulatory Commission (NRC), Sandia National Laboratories (SNL), and General Physics Corporation are conducting a research program to determine the practicality, acceptability, and usefulness of a Human Reliability Data Bank for nuclear power industry probabilistic risk assessment (PRA). As part of this program, a survey was conducted of existing human reliability data banks from other industries, and a detailed concept of a Data Bank for the nuclear industry was developed. Subsequently, a detailed specification for implementing the Data Bank was developed. An evaluation of this specification was conducted and is described in this report. The evaluation tested data treatment, storage, and retrieval using the Data Bank structure, as modified from NUREG/CR-2744, and detailed procedures for data processing and retrieval, developed prior to this evaluation and documented in the test specification. The evaluation consisted of an Operability Demonstration and Evaluation of the data processing procedures, a Data Retrieval Demonstration and Evaluation, a Retrospective Analysis that included a survey of organizations currently operating data banks for the nuclear power industry, and an Internal Analysis of the current Data Bank System

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

QUALITY OF AN ACADEMIC STUDY PROGRAMME - EVALUATION MODEL

Directory of Open Access Journals (Sweden)

Mirna Macur

2016-01-01

Full Text Available Quality of an academic study programme is evaluated by many: employees (internal evaluation and by external evaluators: experts, agencies and organisations. Internal and external evaluation of an academic programme follow written structure that resembles on one of the quality models. We believe the quality models (mostly derived from EFQM excellence model don’t fit very well into non-profit activities, policies and programmes, because they are much more complex than environment, from which quality models derive from (for example assembly line. Quality of an academic study programme is very complex and understood differently by various stakeholders, so we present dimensional evaluation in the article. Dimensional evaluation, as opposed to component and holistic evaluation, is a form of analytical evaluation in which the quality of value of the evaluand is determined by looking at its performance on multiple dimensions of merit or evaluation criteria. First stakeholders of a study programme and their views, expectations and interests are presented, followed by evaluation criteria. They are both joined into the evaluation model revealing which evaluation criteria can and should be evaluated by which stakeholder. Main research questions are posed and research method for each dimension listed.

Interim report on nodel evaluation methodology and the evaluation of LEAP

Energy Technology Data Exchange (ETDEWEB)

Alsmiller, R.G. Jr.; Barish, J.; Bjornstad, D.

1980-04-01

This report describes progress made at ORNL toward development and demonstration of a methodology for evaluating energy-economic modeling codes and important results derived from these codes. To bolster traditional evaluation methods with more-quantitative procedures of interest to the Energy Information Administration, ORNL is applying sensitivity theory as part of a comprehensive effort to quantify the importance of various data and model parameters to the key results that are of interest. The Long-Term Energy Analysis Program (LEAP) was chosen as the initial focus for the research. LEAP is an energy-economy model which resides in the Long-Term Energy Analysis Division (LTEAD) of the Integrative Analysis Group in the Office of Applied Analysis, EIA. LTEAD developed Model 22C of LEAP for two reasons: (1) to prepare projections through the year 2020, which were needed for the 1978 EIA Annual Report to Congress and (2) to develop a base for analyses of specific options for Federal action. LEAP Model 22C and its uses are described to provide the background for this interim description of the model evaluation effort at ORNL. 19 figures, 10 tables.

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

Comparison of evaluation results of piping thermal fatigue evaluation method based on equivalent stress amplitude

International Nuclear Information System (INIS)

Suzuki, Takafumi; Kasahara, Naoto

2012-01-01

In recent years, reports have increased about failure cases caused by high cycle thermal fatigue both at light water reactors and fast breeder reactors. One of the reasons of the cases is a turbulent mixing at a Tee-junction, where hot and cold temperature fluids are mixed, in a coolant system. In order to prevent thermal fatigue failures at Tee-junctions. The Japan Society of Mechanical Engineers published the guideline which is an evaluation method of high cycle thermal fatigue damage at nuclear pipes. In order to justify safety margin and make the procedure of the guideline concise, this paper proposes a new evaluation method of thermal fatigue damage with use of the 'equivalent stress amplitude.' Because this new method makes procedure of evaluation clear and concise, it will contribute to improving the guideline for thermal fatigue evaluation. (author)

Evaluation Methods for Prevention Education.

Science.gov (United States)

Blue, Amy V.; Barnette, J. Jackson; Ferguson, Kristi J.; Garr, David R.

2000-01-01

Discusses the importance of assessing medical students' competence in prevention knowledge, skills, and attitudes. Provides general guidance for programs interested in evaluating their prevention instructional efforts, and gives specific examples of possible methods for evaluating prevention education. Stresses the need to tailor assessment…

Holistic evaluations of learning materials

DEFF Research Database (Denmark)

Bundsgaard, Jeppe; Hansen, Thomas Illum

2011-01-01

The aim of this paper is to present a holistic framework for evaluating learning materials and designs for learning. A holistic evaluation of learning material comprises investigations of - the potential learning potential, i.e. the affordances and challenges of the learning material...

Thick Slice and Thin Slice Teaching Evaluations

Science.gov (United States)

Tom, Gail; Tong, Stephanie Tom; Hesse, Charles

2010-01-01

Student-based teaching evaluations are an integral component to institutions of higher education. Previous work on student-based teaching evaluations suggest that evaluations of instructors based upon "thin slice" 30-s video clips of them in the classroom correlate strongly with their end of the term "thick slice" student evaluations. This study's…

Evaluation of alternate magnetic fusion concepts, 1977

International Nuclear Information System (INIS)

1978-05-01

The objective of this exercise was to evaluate all of the alternate concepts supported by DMFE with regard to: (1) confidence in the physics assumptions; (2) confidence in the development of the requisite technologies; and (3) the desirability of its pure fusion reactor configuration. A primary concern in developing the evaluation technique described in this section was the need to obtain a uniform, critical evaluation. Motivated by this concern, it was decided to have all of the concepts evaluated on the same basis or criteria and to have all concepts evaluated by the same group of experts. The evaluation criteria and procedures which were developed for this purpose are described. The concepts evaluated were the EBT, RFP, TORMAC, field reversing ion rings, linear theta pinch, laser heated solenoid, e-beam heated solenoid, multiple mirrors, fast linear reactor, LINUS, and SURMAC

Fission yield data evaluation system FYDES

International Nuclear Information System (INIS)

Liu Tingjin

1998-01-01

Taking account of some features of fission yield data, to do the fission yield data evaluation conveniently, a fission yield data evaluation system FYDES has been developed for last two years. Outline of the system, data retrieval and data table standardization, data correction codes, data averaging code, simultaneous evaluation code and data fit programs were introduced

Evaluation and processing of covariance data

International Nuclear Information System (INIS)

Wagner, M.

1993-01-01

These proceedings of a specialists'meeting on evaluation and processing of covariance data is divided into 4 parts bearing on: part 1- Needs for evaluated covariance data (2 Papers), part 2- generation of covariance data (15 Papers), part 3- Processing of covariance files (2 Papers), part 4-Experience in the use of evaluated covariance data (2 Papers)

Investigating Heuristic Evaluation: A Case Study.

Science.gov (United States)

Goldman, Kate Haley; Bendoly, Laura

When museum professionals speak of evaluating a web site, they primarily mean formative evaluation, and by that they primarily mean testing the usability of the site. In the for-profit world, usability testing is a multi-million dollar industry, while non-profits often rely on far too few dollars to do too much. Hence, heuristic evaluation is one…

Leak before break piping evaluation diagram

International Nuclear Information System (INIS)

Fabi, R.J.; Peck, D.A.

1994-01-01

Traditionally Leak Before Break (LBB) has been applied to the evaluation of piping in existing nuclear plants. This paper presents a simple method for evaluating piping systems for LBB during the design process. This method produces a piping evaluation diagram (PED) which defines the LBB requirements to the piping designer for use during the design process. Several sets of LBB analyses are performed for each different pipe size and material considered in the LBB application. The results of this method are independent of the actual pipe routing. Two complete LBB evaluations are performed to determine the maximum allowable stability load, one evaluation for a low normal operating load, and the other evaluation for a high normal operating load. These normal operating loads span the typical loads for the particular system being evaluated. In developing the allowable loads, the appropriate LBB margins are included in the PED preparation. The resulting LBB solutions are plotted as a set of allowable curves for the maximum design basis load, such is the seismic load versus the normal operating load. Since the required margins are already accounted for in the LBB PED, the piping designer can use the diagram directly with the results of the piping analysis and determine immediately if the current piping arrangement passes LBB. Since the LBB PED is independent of pipe routing, changes to the piping system can be evaluated using the existing PED. For a particular application, all that remains is to confirm that the actual materials and pipe sizes assumed in creating the particular design are built into the plant

Using Social Scientific Criteria to Evaluate Cultural Theories: Encoding/Decoding Evaluated

Directory of Open Access Journals (Sweden)

Evan L. Kropp

2015-12-01

Full Text Available This article transcends the issue of conflicting theoretical schools of thought to formulate a method of social scientific style theory evaluation for cultural studies. It is suggested that positivist social scientific models of theory critique can be used to assess cultural models of communication to determine if they should be classified as theories. A set of evaluation criteria is formulated as a guide and applied to Stuart Hall’s Encoding/Decoding to determine if it is a theory. Conclusions find the sharing of criteria between schools of thought is judicious, Encoding/Decoding fits the established criteria, and Encoding/Decoding should be referred to as a theory.

Health economic evaluation in Greece.

Science.gov (United States)

Rovithis, Dimitrios

2006-01-01

There is a growing volume of literature on health economic evaluation, with this form of analysis becoming increasingly influential at the decision-making level worldwide. The purpose of this study was to review the current state of health economic evaluation in Greece, with a view to uncovering reasons why its use in this country is limited. A search of the NHS Economic Evaluation Database was undertaken. The search included cost, cost-of-illness, cost-minimization, cost-effectiveness, cost-consequences, cost-utility, and cost-benefit analyses and was narrowed only to Greek authors undertaking solo or joint health economic evaluation in Greece. The search revealed that, in Greece, very little health economic evaluation has been undertaken. The main reason for the lack of interest is that the current chaotic healthcare system structure and financing does not provide the appropriate incentives to stimulate a powerful interest in this type of research. This condition is a result of the lack of a long-term national health policy and the hesitation of the present and past Greek governments to date to proceed to large-scale reforms because of political considerations. The Greek governments have also been content with the good health indicators being achieved. Even if it is accepted that good health prevails in Greece, slower economic growth rates, an ageing population, and the continuous immigration will place increasing pressure on healthcare resources and will necessitate a more rational use of these resources. Health economic evaluation, by weighing benefits against costs, therefore, has an important role to play.

The opportunities and challenges of multi-site evaluations: lessons from the jail diversion and trauma recovery national cross-site evaluation.

Science.gov (United States)

Stainbrook, Kristin; Penney, Darby; Elwyn, Laura

2015-06-01

Multi-site evaluations, particularly of federally funded service programs, pose a special set of challenges for program evaluation. Not only are there contextual differences related to project location, there are often relatively few programmatic requirements, which results in variations in program models, target populations and services. The Jail Diversion and Trauma Recovery-Priority to Veterans (JDTR) National Cross-Site Evaluation was tasked with conducting a multi-site evaluation of thirteen grantee programs that varied along multiple domains. This article describes the use of a mixed methods evaluation design to understand the jail diversion programs and client outcomes for veterans with trauma, mental health and/or substance use problems. We discuss the challenges encountered in evaluating diverse programs, the benefits of the evaluation in the face of these challenges, and offer lessons learned for other evaluators undertaking this type of evaluation. Copyright © 2015 Elsevier Ltd. All rights reserved.

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Evaluation of high temperature pressure sensors

International Nuclear Information System (INIS)

Choi, In-Mook; Woo, Sam-Yong; Kim, Yong-Kyu

2011-01-01

It is becoming more important to measure the pressure in high temperature environments in many industrial fields. However, there is no appropriate evaluation system and compensation method for high temperature pressure sensors since most pressure standards have been established at room temperature. In order to evaluate the high temperature pressure sensors used in harsh environments, such as high temperatures above 250 deg. C, a specialized system has been constructed and evaluated in this study. The pressure standard established at room temperature is connected to a high temperature pressure sensor through a chiller. The sensor can be evaluated in conditions of changing standard pressures at constant temperatures and of changing temperatures at constant pressures. According to the evaluation conditions, two compensation methods are proposed to eliminate deviation due to sensitivity changes and nonlinear behaviors except thermal hysteresis.

Evaluation in Radiology as a pedagogic contribution

International Nuclear Information System (INIS)

Ros Mendoza, L. H.

2012-01-01

After defining evaluation (a systematic process of data collection and analysis in order to take decisions in a specific field; in our case, radiology training at medical school), we should specify the characteristics of such evaluation, which include the aim (what for?), subject-matter (which content?), benchmarks (i.e., the standards against which we are comparing), when to evaluate, and how strictly or at what cost. Once these questions have been answered, we are able to select the most appropriate procedures for evaluation, bearing in mind that evaluation is a process, while grading implies an already made decision. There are different types of evaluation: the initial evaluation, which is not necessarily nominal, is performed to define the student’s level at the beginning of the course; the normative or norm-referenced evaluation has a relative nature, as it compares student achievement to that of others; and the absolute or criterion-referenced evaluation, which is based on established criteria, where the goals which should be achieved become the key element for designing teaching and evaluation. Evaluation may be used to generate motivation. This requires the establishment of clear and relevant objectives as well as knowledge on how to correct mistakes. Oral questions in the classroom may also be motivating. Within the triple domain to be taken into account (cognitive, affective and psychomotor), the objectives to be measured should be considered in a hierarchical order from simple to complex: necessary knowledge, comprehension of such concepts, practical application (in a context that is different from that where knowledge has been gained), and the so-called “superior operations” (analysis, synthesis and grading). Then, the technical features of evaluation will be defined: internal and external validity in relation to difficulty and discrimination; reliability, i.e. accuracy and consistency according to the degree of objectivity; and finally

34 CFR 300.122 - Evaluation.

Science.gov (United States)

2010-07-01

... 34 Education 2 2010-07-01 2010-07-01 false Evaluation. 300.122 Section 300.122 Education Regulations of the Offices of the Department of Education (Continued) OFFICE OF SPECIAL EDUCATION AND... DISABILITIES State Eligibility Additional Eligibility Requirements § 300.122 Evaluation. Children with...

Evaluated neutronic file for indium

International Nuclear Information System (INIS)

Smith, A.B.; Chiba, S.; Smith, D.L.; Meadows, J.W.; Guenther, P.T.; Lawson, R.D.; Howerton, R.J.

1990-01-01

A comprehensive evaluated neutronic data file for elemental indium is documented. This file, extending from 10 -5 eV to 20 MeV, is presented in the ENDF/B-VI format, and contains all neutron-induced processes necessary for the vast majority of neutronic applications. In addition, an evaluation of the 115 In(n,n') 116m In dosimetry reaction is presented as a separate file. Attention is given in quantitative values, with corresponding uncertainty information. These files have been submitted for consideration as a part of the ENDF/B-VI national evaluated-file system. 144 refs., 10 figs., 4 tabs

Protocol for the effect evaluation of independent medical evaluation after six months sick leave: a randomized controlled trial of independent medical evaluation versus treatment as usual in Norway

Directory of Open Access Journals (Sweden)

Elisabeth Husabo

2017-06-01

Full Text Available Abstract Background It has been discussed whether the relationship between a patient on sick leave and his/her general practitioner (GP is too close, as this may hinder the GP’s objective evaluation of need for sick leave. Independent medical evaluation involves an independent physician consulting the patient. This could lead to new perspectives on sick leave and how to follow-up the patient. Methods/design The current study is a randomized controlled trial in a Norwegian primary care context, involving an effect evaluation, a cost/benefit analysis, and a qualitative evaluation. Independent medical evaluation will be compared to treatment as usual, i.e., the physicians’ and social insurance agencies’ current management of long-term sick-listed patients. Individuals aged 18–65 years, sick listed by their GP and on full or partial sick leave for the past 6 months in Hordaland county will be included. Exclusion criteria are pregnancy, cancer, dementia or an ICD-10 diagnosis. A total sample of 3800 will be randomly assigned to either independent medical evaluation or treatment as usual. Official register data will be used to measure the primary outcome; change in sickness benefits at 7, 9 and 12 months. Sick listed in other counties will serve as a second control group, if appropriate under the “common trend” assumption. Discussion The Norwegian effect evaluation of independent medical evaluation after 6 months sick leave is a large randomized controlled trial, and the first of its kind, to evaluate this type of intervention as a means of getting people back to work after long-term sickness absence. Trial registration ClinicalTrials.gov NCT02524392 . Registered June 23, 2015.

Hazard Evaluation for 244-CR Vault

Energy Technology Data Exchange (ETDEWEB)

GRAMS, W.H.

1999-08-19

This document presents the results of a hazards identification and evaluation performed on the 244-CR Vault to close a USQ (USQ No.TF-98-0785, Potential Inadequacy in Authorization Basis (PIAB): To Evaluate Miscellaneous Facilities Listed In HNF-2503 And Not Addressed In The TWRS Authorization Basis) that was generated as part of an evaluation of inactive TWRS facilities.

Hazard Evaluation for 244-CR Vault

International Nuclear Information System (INIS)

GRAMS, W.H.

1999-01-01

This document presents the results of a hazards identification and evaluation performed on the 244-CR Vault to close a USQ (USQ No.TF-98-0785, Potential Inadequacy in Authorization Basis (PIAB): To Evaluate Miscellaneous Facilities Listed In HNF-2503 And Not Addressed In The TWRS Authorization Basis) that was generated as part of an evaluation of inactive TWRS facilities

A Study on Developing Evaluation Criteria for Electronic Resources in Evaluation Indicators of Libraries

Science.gov (United States)

Noh, Younghee

2010-01-01

This study aimed to improve the current state of electronic resource evaluation in libraries. While the use of Web DB, e-book, e-journal, and other e-resources such as CD-ROM, DVD, and micro materials is increasing in libraries, their use is not comprehensively factored into the general evaluation of libraries and may diminish the reliability of…

Constructive eHealth evaluation: lessons from evaluation of EHR development in 4 Danish hospitals.

Science.gov (United States)

Høstgaard, Anna Marie Balling; Bertelsen, Pernille; Nøhr, Christian

2017-04-20

Information and communication sources in the healthcare sector are replaced with new eHealth technologies. This has led to problems arising from the lack of awareness of the importance of end-user involvement in eHealth development and of the difficulties caused by using traditional summative evaluation methods. The Constructive eHealth evaluation method (CeHEM) provides a solution to these problems by offering an evaluation framework for supporting and facilitating end-user involvement during all phases of eHealth development. The aim of this paper is to support this process by sharing experiences of the eHealth evaluation method used in the introduction of electronic health records (EHR) in the North Denmark Region of Denmark. It is the first time the fully developed method and the experiences on using the CeHEM in all five phases of a full lifecycle framework is presented. A case study evaluation of the EHR development process in the North Denmark Region was conducted from 2004 to 2010. The population consisted of clinicians, IT professionals, administrators, and vendors. The study involved 4 hospitals in the region. Data were collected using questionnaires, observations, interviews, and insight gathered from relevant documents. The evaluation showed a need for a) Early involvement of clinicians, b) The best possible representation of clinicians, and c) Workload reduction for those involved. The consequences of not providing this were a lack of ownership of decisions and negative attitudes towards the clinical benefits related to these decisions. Further, the result disclosed that by following the above recommendations, and by providing feedback to the 4 actor groups, the physicians' involvement was improved. As a result they took ownership of decisions and gained a positive attitude to the clinical benefits. The CeHEM has proven successful in formative evaluation of EHR development and can point at important issues that need to be taken care of by management

Status report on seismic re-evaluation

International Nuclear Information System (INIS)

1998-01-01

In May 1997, a meeting of the PWG 3 Sub Group on the Seismic Behaviour of Structures agreed several priority objectives, of which one was the production of a status report on seismic re-evaluation. Seismic re-evaluation is identified as the process of carrying out a re-assessment of the safety of existing nuclear power plants for a specified seismic hazard. This may be necessary when no seismic hazard was considered in the original design of the plant, the relevant codes and regulations have been revised, the seismic hazard for the site has been re-assessed or there is a need to assess the capacity of the plant for severe accident conditions and behaviour beyond the design basis. Re-evaluation may also be necessary to resolve an issue, or to assess the impact of new findings or knowledge. A questionnaire on the subject was issued to all members of the Seismic Sub Group in the summer of 1997, and responses to the questionnaire had been received from most members by the end of 1997. This report is based on the responses to the questionnaire, together with comment and discussion within the group. The questionnaire covered the following main topics of interest in relation to seismic re-evaluation: General and Legislative Framework, Overall Approach, Input Definition and Analysis Methods, Scope of Plant and Assessment of As-built Situation, Assessment criteria, Outcome of Re-evaluations, Research. The responses to the questionnaire have been collated and reviewed with the objective of comparing current practice in the field of seismic re-evaluation in member countries, and a number of important points have been identified in relation to the position of seismic re-evaluation in the nuclear power industry throughout the world. It is evident that seismic re-evaluation is a relatively mature process that has been developing for some time, with most countries adopting similar practices, often based on principles which have been developed in the US nuclear industry. Seismic

Systematic Review of Health Economic Impact Evaluations of Risk Prediction Models : Stop Developing, Start Evaluating

NARCIS (Netherlands)

van Giessen, Anoukh; Peters, Jaime; Wilcher, Britni; Hyde, Chris; Moons, Carl; de Wit, Ardine; Koffijberg, Erik

2017-01-01

Background: Although health economic evaluations (HEEs) are increasingly common for therapeutic interventions, they appear to be rare for the use of risk prediction models (PMs). Objectives: To evaluate the current state of HEEs of PMs by performing a comprehensive systematic review. Methods: Four

Software component quality evaluation

Science.gov (United States)

Clough, A. J.

1991-01-01

The paper describes a software inspection process that can be used to evaluate the quality of software components. Quality criteria, process application, independent testing of the process and proposed associated tool support are covered. Early results indicate that this technique is well suited for assessing software component quality in a standardized fashion. With automated machine assistance to facilitate both the evaluation and selection of software components, such a technique should promote effective reuse of software components.

Task oriented evaluation system for maintenance robots

International Nuclear Information System (INIS)

Asame, Hajime; Endo, Isao; Kotosaka, Shin-ya; Takata, Shozo; Hiraoka, Hiroyuki; Kohda, Takehisa; Matsumoto, Akihiro; Yamagishi, Kiichiro.

1994-01-01

The adaptability evaluation of maintenance robots to autonomous plants has been discussed. In this paper, a new concept of autonomous plant with maintenance robots are introduced, and a framework of autonomous maintenance system is proposed. Then, task-oriented evaluation of robot arms is discussed for evaluating their adaptability to maintenance tasks, and a new criterion called operability is proposed for adaptability evaluation. The task-oriented evaluation system is implemented and applied to structural design of robot arms. Using genetic algorithm, an optimal structure adaptable to a pump disassembly task is obtained. (author)

Gender bias in teaching evaluations

NARCIS (Netherlands)

Mengel, Friederike; Sauermann, Jan; Zölitz, Ulf Zoelitz

2017-01-01

This paper provides new evidence on gender bias in teaching evaluations. We exploit a quasi-experimental dataset of 19,952 student evaluations of university faculty in a context where students are randomly allocated to female or male instructors. Despite the fact that neither students’ grades nor

48 CFR 1417.206 - Evaluation.

Science.gov (United States)

2010-10-01

... 48 Federal Acquisition Regulations System 5 2010-10-01 2010-10-01 false Evaluation. 1417.206 Section 1417.206 Federal Acquisition Regulations System DEPARTMENT OF THE INTERIOR CONTRACTING METHODS AND CONTRACT TYPES SPECIAL CONTRACTING METHODS Options 1417.206 Evaluation. The determination in FAR 17.206(b...

Radionuclide calibrators performance evaluation

International Nuclear Information System (INIS)

Mora Ramirez, E.; Zeledon Fonseca, P.; Jimenez Cordero, M.

2008-01-01

Radionuclide calibrators are used to estimate accurately activity prior to administration to a patient, so it is very important that this equipment meets its performance requirements. The purpose of this paper is to compare the commercially available 'Calicheck' (Calcorp. Inc), used to assess linearity, versus the well-known source decay method, and also to show our results after performing several recommended quality control tests. The parameters that we wanted to evaluate were carried on using the Capintec CRC-15R and CRC-15 β radionuclide calibrators. The evaluated tests were: high voltage, display, zero adjust, background, reproducibility, source constancy, accuracy, precision and linearity. The first six tests were evaluated on the daily practice, here we analyzed the 2007 recorded data; and the last three were evaluated once a year. During the daily evaluation both calibrators performance were satisfactory comparing with the manufacture's requirements. The accuracy test show result within the ± 10% allowed for a field instrument. Precision performance is within the ± 1 % allowed. On the other hand, the linearity test shows that using the source decay method the relative coefficient is 0.9998, for both equipment and using the Calicheck the relative coefficient is 0.997. However, looking the percentage of error, during the 'Calicheck' test, its range goes from 0.0 % up to -25.35%, and using the source decay method, the range goes from 0.0 % up to -31.05 %, taking into account both instruments. Checking the 'Calicheck' results we can see that the results varying randomly, but using the source decay method the percentage of error increase as the source activity decrease. We conclude that both devices meet its manufactures requirements, in the case of the linearity using the decay method, decreasing the activity source, increasing the percentage of error, this may happen because of the equipment age. (author)

Motivational condition in educational evaluation

Directory of Open Access Journals (Sweden)

Julio Fernando Acosta Muñoz

2012-01-01

Full Text Available This is a reflection article, methodologically based on research into and theoretical and conceptual review of the motivational condition in educational evaluation. At the same time, some inquiries about the motivational problems in this education process are made. The objective is to examine what the motivational condition within the process ofeducational evaluation is. On the one hand, educational evaluation is a tool that attests to the knowledge, on the other hand, however, it prevents students from strengthening their interest both in the participation in the specific testing activity and in their learning, since it lays emphasis on extrinsic factors, such as grade, which make students lose and distort their intrinsic motivation to learn. Therefore, the evaluation proposal arisen from the construct of motivation is thought to generate in students positive sensations standing even after goals are obtained. Likewise, it must promote liveliness, integration and psychological health, in order to get students to fulfill their needs and obtain psychological welfare in the classroom.

Scientific evaluation at the CEA

International Nuclear Information System (INIS)

1999-01-01

This report presents a statement of the scientific and technical activity of the French atomic energy commission (CEA) for the year 1998. This evaluation is made by external and independent experts and requires some specific dispositions for the nuclear protection and safety institute (IPSN) and for the direction of military applications (DAM). The report is divided into 5 parts dealing successively with: part 1 - the CEA, a public research organization (civil nuclear research, technology research and transfers, defence activities); the scientific and technical evaluation at the CEA (general framework, evaluation of the IPSN and DAM); part 2 - the scientific and technical councils (directions of fuel cycle, of nuclear reactors, and of advanced technologies); part 3 - the scientific councils (directions of matter and of life sciences); the nuclear protection and safety institute; the direction of military applications; part 4 - the corresponding members of the evaluation; part 5 - the list of scientific and technical councils and members. (J.S.)

Evaluation in science teachers training

Directory of Open Access Journals (Sweden)

Melina Gabriela Furman

2012-06-01

Full Text Available This research analyzes the final evaluations of the major in Biology Teaching in an institution in northeastern Argentina. The evaluation circumstances were observed, and the professors were subsequently interviewed. The questions formulated by the professors in the test were analyzed according to the objective of their speech and the dimension of the evaluated sciences, by using the categories of science as a product (set of knowledge and as a process (ways to know. 78% of the questions correspond to the category of science as a product compared to 22% as a process. Most of the formulated questions aimed to lowcomplex cognitive processes such as the enunciation of definitions or descriptions, and simple scientific skills as classifying. These results contradict professors’ concern about their students’ low level of reading comprehension and their stated objective of ‘teaching them to think’. This paper brings evidences as for the imperative need of strengthening the work with teacher trainers in learning evaluation aspects.

Structural building screening and evaluation

Science.gov (United States)

Kurniawandy, Alex; Nakazawa, Shoji; Hendry, Andy; Ridwan, Firdaus, Rahmatul

2017-10-01

An earthquake is a disaster that can be harmful to the community, such as financial loss and also dead injuries. Pekanbaru is a city that located in the middle of Sumatera Island. Even though the city of Pekanbaru is a city that rarely occurs earthquake, but Pekanbaru has ever felt the impact of the big earthquake that occurred in West Sumatera on September 2009. As we know, Indonesia located between Eurasia plate, Pacific plate, and Indo-Australian plate. Particularly the Sumatera Island, It has the Semangko fault or the great Sumatra fault along the island from north to south due to the shift of Eurasia and Indo-Australian Plates. An earthquake is not killing people but the building around the people that could be killing them. The failure of the building can be early prevented by doing an evaluation. In this research, the methods of evaluation have used a guideline for the Federal Emergency Management Agency (FEMA) P-154 and Applied Technology Council (ATC) 40. FEMA P-154 is a rapid visual screening of buildings for potential seismic hazards and ATC-40 is seismic evaluation and retrofit of Concrete Buildings. ATC-40 is a more complex evaluation rather than FEMA P-154. The samples to be evaluated are taken in the surroundings of Universitas Riau facility in Pekanbaru. There are four buildings as case study such as the rent student building, the building of mathematics and natural science faculty, the building teacher training and education faculty and the buildings in the faculty of Social political sciences. Vulnerability for every building facing an earthquake is different, this is depending on structural and non-structural components of the building. Among all of the samples, only the building of mathematics and the natural science faculty is in critical condition according to the FEMA P-154 evaluation. Furthermore, the results of evaluation using ATC-40 for the teacher training building are in damage control conditions, despite the other three buildings are

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Urolithiasis: evaluation, dietary factors, and medical management

DEFF Research Database (Denmark)

Jung, Helene; Andonian, Sero; Assimos, Dean

2017-01-01

PURPOSE: The aim of this review was to provide current best evidence for evaluation, dietary, and medical management of patients with urolithiasis. METHODS: Literature addressing evaluation, dietary, and medical management of urolithiasis was searched. Papers were analyzed and rated according...... the life of stone-forming individuals very differently, and that evaluation and medical management should be personalized according to risk of recurrence, severity of stone disease, presence of associated medical conditions, and patient's motivation. With regard to evaluation, dietary and medical...... management of patients with urolithiasis evidence from the literature suggest that selective metabolic evaluation may lead to rational dietary and medical management. Statements based on LOE and GOR are provided to guide clinical practice. CONCLUSION: The provided evidence for evaluation of patients...