Pain assessement and management in surgical cancer patients: pilot and evaluation of a continuing education program.

NARCIS (Netherlands)

Francke, A.L.; Huijer-Abu Saad, H.; Grypdonck, M.

1995-01-01

In a pilot study, a continuing education program on pain assessment and management was implemented and evaluated. Questionnaires were completed by the nurse participants at the beginning, the end, and 2 months after the end of the pilot program. After the pilot program, participants reported having

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Manipulator system man-machine interface evaluation program. [technology assessment

Science.gov (United States)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

NASA Aviation Safety Program Systems Analysis/Program Assessment Metrics Review

Science.gov (United States)

Louis, Garrick E.; Anderson, Katherine; Ahmad, Tisan; Bouabid, Ali; Siriwardana, Maya; Guilbaud, Patrick

2003-01-01

The goal of this project is to evaluate the metrics and processes used by NASA's Aviation Safety Program in assessing technologies that contribute to NASA's aviation safety goals. There were three objectives for reaching this goal. First, NASA's main objectives for aviation safety were documented and their consistency was checked against the main objectives of the Aviation Safety Program. Next, the metrics used for technology investment by the Program Assessment function of AvSP were evaluated. Finally, other metrics that could be used by the Program Assessment Team (PAT) were identified and evaluated. This investigation revealed that the objectives are in fact consistent across organizational levels at NASA and with the FAA. Some of the major issues discussed in this study which should be further investigated, are the removal of the Cost and Return-on-Investment metrics, the lack of the metrics to measure the balance of investment and technology, the interdependencies between some of the metric risk driver categories, and the conflict between 'fatal accident rate' and 'accident rate' in the language of the Aviation Safety goal as stated in different sources.

Satellite power system concept development and evaluation program system definition technical assessment report

Energy Technology Data Exchange (ETDEWEB)

1980-12-01

The results of the system definition studies conducted by NASA as a part of the Department of Energy/National Aeronautics and Space Administration SPS Concept Development and Evaluation Program are summarized. The purpose of the system definition efforts was to identify and define candidate SPS concepts and to evaluate the concepts in terms of technical and cost factors. Although the system definition efforts consisted primarily of evaluation and assessment of alternative technical approaches, a reference system was also defined to facilitate economic, environmental, and societal assessments by the Department of Energy. This reference system was designed to deliver 5 GW of electrical power to the utility grid. Topics covered include system definition; energy conversion and power management; power transmission and reception; structures, controls, and materials; construction and operations; and space transportation.

Developing and Using a Logic Model for Evaluation and Assessment of University Student Affairs Programming: A Case Study

Science.gov (United States)

Cooper, Jeff

2009-01-01

This dissertation addresses theory and practice of evaluation and assessment in university student affairs, by applying logic modeling/program theory to a case study. I intend to add knowledge to ongoing dialogue among evaluation scholars and practitioners on student affairs program planning and improvement as integral considerations that serve…

Military Emergency Medical Service System Assessment: Application of the National Park Service Needs Assessment and Program Audit to Objectively Evaluate the Military EMS System of Okinawa, Japan.

Science.gov (United States)

Ross, Elliot M; Harper, Stephen A; Cunningham, Cord; Walrath, Benjamin D; DeMers, Gerard; Kharod, Chetan U

2017-03-01

As part of a Military Emergency Medical Services (EMS) system process improvement initiative, the authors sought to objectively evaluate the U.S. military EMS system for the island of Okinawa. They applied a program evaluation tool currently utilized by the U.S. National Park Service (NPS). A comprehensive needs assessment was conducted to evaluate the current Military EMS system in Okinawa, Japan. The NPS EMS Program Audit Worksheet was used to get an overall "score" of our assessment. After all the data had been collected, a joint committee of Military EMS physicians reviewed the findings and made formal recommendations. From 2011 to 2014, U.S. military EMS on Okinawa averaged 1,345 ± 137 patient transports annually. An advanced life support (ALS) provider would have been dispatched on 558 EMS runs (38%) based on chief complaint in 2014 had they been available. Over 36,000 man-hours were expended during this period to provide National Registry Emergency Medical Technician (EMT)-accredited instruction to certify 141 Navy Corpsman as EMT Basics. The NPS EMS Program Audit Worksheet was used and the program scored a total of 31, suggesting the program is well planned and operating within standards. This evaluation of the Military EMS system on Okinawa using the NPS program assessment and audit worksheet demonstrates the NPS evaluation instruments may offer a useful assessment tool for the evaluation of Military EMS systems. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Assessing a GTA professional development program

OpenAIRE

Alicea-Muñoz, Emily; Masip, Joan Espar; Sullivan, Carol Subiño; Schatz, Michael F.

2018-01-01

For the last four years, the School of Physics at Georgia Tech have been preparing new Graduate Teaching Assistants (GTAs) through a program that integrates pedagogy, physics content, and professional development strategies. Here we discuss various assessments we have used to evaluate the program, among them surveys, GTA self-reporting, and end-of-semester student evaluations. Our results indicate that GTAs who participate in the program find its practical activities useful, feel better prepa...

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Pacific Northwest regional assessment program

International Nuclear Information System (INIS)

Anon.

1976-01-01

The Pacific Northwest (comprised of the states of Alaska, Idaho, Montana, Oregon, Washington and Wyoming) can by several measures be regarded as a national warehouse of fossil energy resources. This condition coupled with an evolving national policy stressing utilization of fossil fuels in the near term prior to development of more advanced technologies for energy supply, could result in the imposition of major changes in the region's environmental, socioeconomic and possibly health status. The objective of the Pacific Northwest Regional Assessment Program is to establish and exercise an integrated analytical assessment program for evaluation of these potential changes that may result from various energy development or conservation scenarios. After consideration of a variety of approaches to integrated assessment at a regional level, Pacific Northwest Laboratories (PNL) has concluded that dynamic simulation techniques provide the best available approach to evaluating the issues pertinent to the Northwest. As a result, the PNW Regional Assessment Program has been structured in a framework involving ten sectors. Each of these sectors involve their own submodels that receive information either from outside the model as exogenous inputs or from other sector submodels

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Environmental assessment for the satellite power system concept development and evaluation program: atmospheric effects

International Nuclear Information System (INIS)

Rote, D.M.; Brubaker, K.L.; Lee, J.L.

1980-11-01

The US Department of Energy (DOE) has undertaken a preliminary, three-year program to investigate the impacts of the construction and operation of a satellite power system, of unprecedented scale. The Department of Energy's program, titled The Concept Development and Evaluation Program, focused its investigations on a Reference System description that calls for the use of either silicon (Si) or gallium aluminum-arsenide (GaAlAs) photovoltaic cells on 60 satellites to be constructed in GEO over a 30-yr period. Rectennas would be constructed on the ground to receive microwave energy from the satellites. Each satellite-rectenna pair is designed to produce 5 GW of power on an essentially continuous basis for use as a baseload power source for an electric power distribution system. The environmental assessment part of the program was divided into five interdependent task areas. The present document constitutes the final technical report on one of the five task areas, the Assessment of the Atmospheric Effects, and as such presents an in-depth summary of work performed during the assessment program. The issues associated with SPS activities in the troposphere are examined. These include tropospheric weather modification related to rectenna operations and rocket launches, and air quality impacts related to rocketlaunch ground clouds. Then progressing upward through the various levels of the atmosphere, the principal middle and upper atmospheric effects associated with rocket effluents are analyzed. Finally, all of the potential SPS atmospheric effects are summarized

The Use of Workforce Assessment as a Component of Career and Technical Education Program Evaluation

Science.gov (United States)

Bartlett, Kenneth R.; Schleif, Nicole L.; Bowen, Mauvalyn M.

2011-01-01

This research project examined the extent to which Career and Technical Education (CTE)-related programs use workforce needs assessment as a component of their evaluation activities. An employer perspective was used to develop a conceptual framework drawing on strategic human resource management theory. The extent and methods utilized for…

Socioeconomic impact assessment in ex ante evaluations: a case study on the rural development programs of the European Union.

Science.gov (United States)

Vidueira, Pablo; Díaz-Puente, José M; Rivera, María

2014-08-01

Ex ante impact assessment has become a fundamental tool for effective program management, and thus, a compulsory task when establishing a new program in the European Union (EU). This article aims to analyze benefits from ex ante impact assessment, methodologies followed, and difficulties encountered. This is done through the case study on the rural development programs (RDPs) in the EU. Results regarding methodologies are then contrasted with the international context in order to provide solid insights to evaluators and program managing authorities facing ex ante impact assessment. All European RDPs from the period 2007 through 2013 (a total of 88) and their corresponding available ex ante evaluations (a total of 70) were analyzed focusing on the socioeconomic impact assessment. Only 46.6% of the regions provide quantified impact estimations on socioeconomic impacts in spite of it being a compulsory task demanded by the European Commission (EC). Recommended methods by the EC are mostly used, but there is a lack of mixed method approaches since qualitative methods are used in substitution of quantitative ones. Two main difficulties argued were the complexity of program impacts and the lack of needed program information. Qualitative approaches on their own have been found as not suitable for ex ante impact assessment, while quantitative approaches-such as microsimulation models-provide a good approximation to actual impacts. However, time and budgetary constraints make that quantitative and mixed methods should be mainly applied on the most relevant impacts for the program success. © The Author(s) 2014.

Performance Assessment Strategy Plan for the Geologic Repository Program

International Nuclear Information System (INIS)

1990-01-01

Performance assessment is a major constituent of the program being conducted by the US Department of Energy (DOE) to develop a geologic repository. Performance assessment is the set of activities needed for quantitative evaluations to assess compliance with the performance requirements in the regulations for a geologic repository and to support the development of the repository. The strategy for these evaluations has been documented in the Performance Assessment Strategy Plan (DOE, 1989). The implementation of the performance assessment strategy is defined in this document. This paper discusses the scope and objectives of the implementation plan, the relationship of the plan to other program plans, summarizes the performance assessment areas and the integrated strategy of the performance assessment program. 1 fig., 3 tabs

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Defense Logistics Agency Disposition Services Needs to Improve Demilitarization Program Self-Assessment Evaluations - Redacted

Science.gov (United States)

2016-12-20

from mandatory disclosure under the Freedom of Information Act. Defense Logistics Agency Disposition Services Needs to Improve Demilitarization...Project No. D2016-D000RD-0057.000) │ i Results in Brief Defense Logistics Agency Disposition Services Needs to Improve Demilitarization Program Self...Assessment Evaluations Visit us at www.dodig.mil December 20, 2016 Objective Our audit objective was to determine whether the Defense Logistics Agency

Developing and implementing an assessment method to evaluate a virtual canine anatomy program.

Science.gov (United States)

Linton, Andrea; Schoenfeld-Tacher, Regina; Whalen, L Ray

2005-01-01

A computer-based anatomy program, Virtual Canine Anatomy: The Head, was incorporated into a first-year veterinary dissection laboratory two years ago to address challenges inherent in the traditional pedagogical approach. The program uses specimen photographs, QuickTime Virtual Reality, and interactive features to help students study the dissection, osteology, and radiology of the canine head. Photographs of each phase of dissection are displayed in the program, along with dissection instructions. Students can click on anatomical structures in each photograph to highlight the selected structure and display a complete description of it. Related structures and views are accessible through hyperlinks. This study was designed to measure student and faculty attitudes toward the instructional software, to gauge its effect on student achievement, and to propose evaluation methodology and instrumentation for similar projects. Observations, interviews, focus groups, surveys, and test results were used for this assessment. Results suggest positive student and faculty attitudes toward the program. Students felt the program met their needs, increased their confidence and efficiency, and was easy to use. Both students and instructors felt the program was beneficial during dissection. There was no significant change in student achievement on course tests. Future research will measure the program's effect on student-instructor interactions.

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Determining the quality of Competence Assessment Programs: A self-evaluation procedure

NARCIS (Netherlands)

Baartman, L.K.J.; Prins, F.J.; Kirschner, P.A.; Vleuten, van der C.P.M.

2007-01-01

As assessment methods are changing, the way to determine their quality needs to be changed accordingly. This article argues for the use Competence Assessment Programs (CAPs), combinations of traditional tests and new assessment methods which involve both formative and summative assessments. To

Integrated plant safety assessment. Systematic evaluation program, Big Rock Point Plant (Docket No. 50-155). Final report

International Nuclear Information System (INIS)

1984-05-01

The Systematic Evaluation Program was initiated in February 1977 by the U.S. Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety when the supplement to the Final Integrated Plant Safety Assessment Report has been issued. This report documents the review of the Big Rock Point Plant, which is one of ten plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. It also addresses a majority of the pending licensing actions for Big Rock Point, which include TMI Action Plan requirements and implementation criteria for resolved generic issues. Equipment and procedural changes have been identified as a result of the review

Integrated Plant Safety Assessment, Systematic Evaluation Program: Yankee Nuclear Power Station (Docket No. 50-29)

International Nuclear Information System (INIS)

1987-10-01

The US Nuclear Regulatory Commission (NRC) has prepared Supplement 1 to the final Integrated Plant Safety Assessment Report (IPSAR) (NUREG-0825), under the scope of the Systematic Evaluation Program (SEP), for Yankee Atomic Electric Company's Yankee Nuclear Power Station located in Rowe, Massachusetts. The SEP was initiated by the NRC to review the design of older operating nuclear power plants to reconfirm and document their safety. This report documents the review completed under the SEP for those issues that required refined engineering evaluations or the continuation of ongoing evaluations after the Final IPSAR for the Yankee plant was issued. The review has provided for (1) an assessment of the significance of differences between current technical positions on selected safety issues and those that existed when Yankee was licensed, (2) a basis for deciding how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. 2 tabs

MRI assessment program

International Nuclear Information System (INIS)

1987-09-01

The MRI Assessment Program involves installation and operation of five MRI units in Australian public hospitals and the evaluation at each unit of the cost and efficacy of the technology over a period of two years. This first report in a series presents preliminary usage and cost data for the year to 30 June 1987 as well as describing the background and the data set. 6 figs., tabs

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Evaluation of the Enhanced Assessment Grants (EAGs) SimScientists Program: Site Visit Findings. CRESST Report 791

Science.gov (United States)

Herman, Joan; Dai, Yunyun; Htut, Aye Mon; Martinez, Marcela; Rivera, Nichole

2011-01-01

This evaluation report addresses the implementation, utility, and feasibility of SimScientists' simulation-based assessments for middle school science classrooms, with particular attention to the use of accommodations available in the program. Data were collected from a convenience sample of five schools and eight teachers across three states…

Outcomes Assessment in Accredited Health Information Management Programs

Science.gov (United States)

Bennett, Dorine

2010-01-01

The purpose of this study was to determine the use and perceived usefulness of outcomes assessment methods in health information management programs. Additional characteristics of the outcomes assessment practices were recognized. The findings were evaluated for significant differences in results based on age of the program, type of institution,…

Retaining minorities in engineering: Assessment of a program prototype

Science.gov (United States)

Good, Jennifer Marie (Phillips)

Program assessment is an essential part of healthy program development. Assessment should include multiple considerations, dimensions, and outcomes that match the program's objectives. As a newly formed retention program, the Auburn University Minority Engineering Program, designed to help pre-engineering minority students make the transition into their freshman year of university studies, incorporated evaluation and assessment into all three components of the program (the interactive learning laboratory, critical-thinking workshops, and Sunday-evening tutorials) from the program's inception. If students successfully adapted to the university environment and the demands of the pre-engineering course of study, then retention of minority students in the College of Engineering should improve. Data were gathered on the students involved in the various program components. Students who entered the Minority Engineering Program were pre- and posttested on three standardized subtests (critical thinking, mathematics, and science reasoning) of the Collegiate Assessment of Academic Proficiency. The first-quarter grade-point averages of the students were also gathered to compare their grades to freshman students in previous quarters within the College of Engineering. Qualitative data were also gathered on this same group of students. An analysis of the data revealed that student achievement is affected by involvement in the Minority Engineering Program. Specifically, the first quarter grade point averages of students involved in the program exceeded those of their peers in earlier years of study prior to the program's existence. In addition, mathematics and science reasoning scores on standardized tests increased pre- to postintervention. Comments collected in journals and files also demonstrated use of critical-thinking and problem-solving skills employed by the students. Recommendations for alterations of the program were made based on the outcome of the program evaluation

Assessment of military population-based psychological resilience programs.

Science.gov (United States)

Morgan, Brenda J; Bibb, Sandra C Garmon

2011-09-01

Active duty service members' (ADSMs) seemingly poor adaptability to traumatic stressors is a risk to force health. Enhancing the psychological resilience of ADSMs has become a key focus of Department of Defense (DoD) leaders and the numbers of military programs for enhancing psychological resilience have increased. The purpose of this article is to describe the results of an assessment conducted to determine comprehensiveness of current psychological resilience building programs that target ADSMs. A modified six-step, population-based needs assessment was used to evaluate resilience programs designed to meet the psychological needs of the ADSM population. The assessment results revealed a gap in published literature regarding program outcomes. DoD leaders may benefit from targeted predictive research that assesses program effectiveness outcomes. The necessity of including preventive, evidence-based interventions in new programs, such as positive emotion interventions shown to enhance psychological resilience in civilian samples, is also recommended.

Environmental assessment for the satellite power system concept development and evaluation program: nonmicrowave health and ecological effects

Energy Technology Data Exchange (ETDEWEB)

White, M R

1980-11-01

A Concept Development and Evaluation Program is being carried out for a proposed Satellite Power System (SPS). For purposes of this evaluation, a preliminary reference system has been developed. SPS, as described in the reference system, would collect solar energy on satellites in geosychronous orbit in space. The energy would be converted to microwaves and beamed to an earth-receiving antenna (rectenna). One task in the environmental part of the program is the assessment of the nonmicrowave effects on health and the environment. These effects would result from all phases of SPS development and operation. This report covers the current knowledge regarding these effects, and is based on the reference system. The assessment is summarized as to scope, methodology, impacts of terrestrial development, launch and recovery of spacecraft, space activities (including health effects of the space environment, ionizing radiation, electromagnetic exposure, spacecraft charging and environmental interactions, occupational hazards, etc.) and construction and operation of rectenna (ground receiving station).

Environmental assessment for the satellite power system concept development and evaluation program: nonmicrowave health and ecological effects

International Nuclear Information System (INIS)

White, M.R.

1980-11-01

A Concept Development and Evaluation Program is being carried out for a proposed Satellite Power System (SPS). For purposes of this evaluation, a preliminary reference system has been developed. SPS, as described in the reference system, would collect solar energy on satellites in geosychronous orbit in space. The energy would be converted to microwaves and beamed to an earth-receiving antenna (rectenna). One task in the environmental part of the program is the assessment of the nonmicrowave effects on health and the environment. These effects would result from all phases of SPS development and operation. This report covers the current knowledge regarding these effects, and is based on the reference system. The assessment is summarized as to scope, methodology, impacts of terrestrial development, launch and recovery of spacecraft, space activities (including health effects of the space environment, ionizing radiation, electromagnetic exposure, spacecraft charging and environmental interactions, occupational hazards, etc.) and construction and operation of rectenna

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

Social Science at the Center for Adaptive Optics: Synergistic Systems of Program Evaluation, Applied Research, Educational Assessment, and Pedagogy

Science.gov (United States)

Goza, B. K.; Hunter, L.; Shaw, J. M.; Metevier, A. J.; Raschke, L.; Espinoza, E.; Geaney, E. R.; Reyes, G.; Rothman, D. L.

2010-12-01

This paper describes the interaction of four elements of social science as they have evolved in concert with the Center for Adaptive Optics Professional Development Program (CfAO PDP). We hope these examples persuade early-career scientists and engineers to include social science activities as they develop grant proposals and carry out their research. To frame our discussion we use a metaphor from astronomy. At the University of California Santa Cruz (UCSC), the CfAO PDP and the Educational Partnership Center (EPC) are two young stars in the process of forming a solar system. Together, they are surrounded by a disk of gas and dust made up of program evaluation, applied research, educational assessment, and pedagogy. An idea from the 2001 PDP intensive workshops program evaluation developed into the Assessing Scientific Inquiry and Leadership Skills (AScILS) applied research project. In iterative cycles, AScILS researchers participated in subsequent PDP intensive workshops, teaching social science while piloting AScILS measurement strategies. Subsequent "orbits" of the PDP program evaluation gathered ideas from the applied research and pedagogy. The denser regions of this disk of social science are in the process of forming new protoplanets as tools for research and teaching are developed. These tools include problem-solving exercises or simulations of adaptive optics explanations and scientific reasoning; rubrics to evaluate the scientific reasoning simulation responses, knowledge regarding inclusive science education, and student explanations of science/engineering inquiry investigations; and a scientific reasoning curriculum. Another applied research project is forming with the design of a study regarding how to assess engineering explanations. To illustrate the mutual shaping of the cross-disciplinary, intergenerational group of educational researchers and their projects, the paper ends with a description of the professional trajectories of some of the

Waste isolation safety assessment program

International Nuclear Information System (INIS)

Brandstetter, A.; Harwell, M.A.

1979-05-01

Associated with commercial nuclear power production in the United States is the generation of potentially hazardous radioactive wastes. The Department of Energy (DOE), through the National Waste Terminal Storage (NWTS) Program, is seeking to develop nuclear waste isolation systems in geologic formations that will preclude contact with the biosphere of waste radionuclides in concentrations which are sufficient to cause deleterious impact on humans or their environments. Comprehensive analyses of specific isolation systems are needed to assess the expectations of meeting that objective. The Waste Isolation Safety Assessment Program (WISAP) has been established at the Pacific Northwest Laboratory (operated by Battelle Memorial Institute) for developing the capability of making those analyses. Among the analyses required for isolation system evaluation is the detailed assessment of the post-closure performance of nuclear waste repositories in geologic formations. This assessment is essential, since it is concerned with aspects of the nuclear power program which previously have not been addressed. Specifically, the nature of the isolation systems (e.g., involving breach scenarios and transport through the geosphere), and the time-scales necessary for isolation, dictate the development, demonstration and application of novel assessment capabilities. The assessment methodology needs to be thorough, flexible, objective, and scientifically defensible. Further, the data utilized must be accurate, documented, reproducible, and based on sound scientific principles

Program Evaluation - Automotive Lightweighting Materials Program Research and Development Projects Assessment of Benefits - Case Studies No. 2

Energy Technology Data Exchange (ETDEWEB)

Das, S.

2003-01-23

This report is the second of a series of studies to evaluate research and development (R&D) projects funded by the Automotive Lightweighting Materials (ALM) Program of the Office of Advanced Automotive Technologies (OAAT) of the U.S. Department of Energy (DOE). The objectives of the program evaluation are to assess short-run outputs and long-run outcomes that may be attributable to the ALM R&D projects. The ALM program focuses on the development and validation of advanced technologies that significantly reduce automotive vehicle body and chassis weight without compromising other attributes such as safety, performance, recyclability, and cost. Funded projects range from fundamental materials science research to applied research in production environments. Collaborators on these projects include national laboratories, universities, and private sector firms, such as leading automobile manufacturers and their suppliers. Three ALM R&D projects were chosen for this evaluation: Design and Product Optimization for Cast Light Metals, Durability of Lightweight Composite Structures, and Rapid Tooling for Functional Prototyping of Metal Mold Processes. These projects were chosen because they have already been completed. The first project resulted in development of a comprehensive cast light metal property database, an automotive application design guide, computerized predictive models, process monitoring sensors, and quality assurance methods. The second project, the durability of lightweight composite structures, produced durability-based design criteria documents, predictive models for creep deformation, and minimum test requirements and suggested test methods for establishing durability properties and characteristics of random glass-fiber composites for automotive structural composites. The durability project supported Focal Project II, a validation activity that demonstrates ALM program goals and reduces the lead time for bringing new technology into the marketplace. Focal

Quantitative Evaluation of the Community Research Fellows Training Program

Directory of Open Access Journals (Sweden)

Lucy eD'Agostino McGowan

2015-07-01

Full Text Available Context: The Community Research Fellows Training (CRFT program is a community-based participatory research (CBPR initiative for the St. Louis area. This fifteen week program, based on a Master in Public Health curriculum, was implemented by the Division of Public Health Sciences at Washington University School of Medicine in partnership with the Siteman Cancer Center. Objectives: We measure the knowledge gained by participants and evaluate participant and faculty satisfaction of the CRFT program both in terms of meeting learning objectives and actively engaging the community in the research process.Participants: We conducted analyses on 44 community members who participated in the CRFT program and completed the baseline and follow-up knowledge assessments.Main Outcome Measures: Knowledge gain is measured by a baseline and follow-up assessment given at the first and final session. Additionally, pre- and post-tests are given after the first 12 sessions. To measure satisfaction, program evaluations are completed by both the participants and faculty after each topic. Mid-way through the program, a mid-term assessment was administered to assess the program’s community engagement. We analyzed the results from the assessments, pre- and post-tests, and evaluations.Results: The CRFT participants’ knowledge increased at follow-up as compared with baseline on average by a 16.5 point difference (p<0.0001. Post-test scores were higher than pre-test scores for 11 of the 12 sessions. Both participants and faculty enjoyed the training and rated all session well.Conclusions: The CRFT program was successful in increasing community knowledge, in participant satisfaction, and in faculty satisfaction. This success has enhanced the infrastructure for CBPR as well as led to CBPR pilot projects that address health disparities in the St. Louis Greater Metropolitan Area.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emeral Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2007-03-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Professional Development through Organizational Assessment: Using APPA's Facilities Management Evaluation Program

Science.gov (United States)

Medlin, E. Lander; Judd, R. Holly

2013-01-01

APPA's Facilities Management Evaluation Program (FMEP) provides an integrated system to optimize organizational performance. The criteria for evaluation not only provide a tool for organizational continuous improvement, they serve as a compelling leadership development tool essential for today's facilities management professional. The senior…

Defence Health Service Mentoring Program Evaluation 2001

National Research Council Canada - National Science Library

Highfield, Jane

2002-01-01

...). DHS commissioned the Directorate of Strategic Personnel Planning and Research (DSPPR) to evaluate a recent Mentoring Program trial in order to assess the effectiveness and organizational value of Mentoring within DHS...

Screening for caries in targeted schools in the Blue Mountains and Hawkesbury districts, New South Wales, Australia: an evaluation of the School Assessment Program.

Science.gov (United States)

Chong, Gabriel Tse Feng; Evans, Robin Wendell; Dennison, Peter John

2011-11-01

  To determine if the school dental screening program in New South Wales, the School Assessment Program, achieved its aim of being the key entry point for high-risk children to receive care.   A secondary analysis was conducted on epidemiological data gathered in 16 primary schools in New South Wales (10 for the School Assessment Program and six for the non-School Assessment Program) in 2003. The validity of the School Assessment Program targeting criteria in identifying high-risk schools was determined. Post-screening treatment outcomes were evaluated from the assessment of treatment ratios.   There were negligible differences in the caries experience and proportions of high-risk children, irrespective of their School Assessment Program status. Sensitivity and specificity values were approximately 60% and 40%, respectively, using various case definitions of high risk applied to both children and schools. Deciduous dentition treatment ratios for School Assessment Program and non-School Assessment Program children with decayed, missing, and filled teeth (dmft) ≥1 ranged from 0.48 to 0.79 and from 0.47 to 0.73, respectively. Respective permanent dentition treatment ratios for School Assessment Program and non-School Assessment Program children with Decayed, Missing, and Filled Teeth (DMFT) ≥1 were 0.49-0.82 and 0.64-1.08.   The School Assessment Program failed to identify schools with high caries-risk children or confer post-screening caries treatment benefits. © 2011 Blackwell Publishing Asia Pty Ltd.

A CAD (Classroom Assessment Design) of a Computer Programming Course

Science.gov (United States)

Hawi, Nazir S.

2012-01-01

This paper presents a CAD (classroom assessment design) of an entry-level undergraduate computer programming course "Computer Programming I". CAD has been the product of a long experience in teaching computer programming courses including teaching "Computer Programming I" 22 times. Each semester, CAD is evaluated and modified…

38 CFR 1.15 - Standards for program evaluation.

Science.gov (United States)

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... intent, contain a method to measure fulfillment of the objectives, ascertain the degree to which goals... the data. (f) Each program evaluation requires a systematic research design to collect the data...

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

Laboratory Cooperative Program: an assessment

International Nuclear Information System (INIS)

1979-11-01

The Laboratory Cooperative Program (Lab Coop Program) was initiated by the US AEC over 20 years ago to promote the transfer of technical information from the national laboratories to the academic community utilizing the facilities and staff capabilities of the labs. Under the AEC, ERDA and DOE, the goals of the program have broadened gradually. Therefore, the program was examined to determine the extent to which it contributes to the current objectives of the DOE and to develop recommendations for any program changes. The assessment of the Lab Coop Program was based on a combination of review of program activity data and publications, review of general information regarding laboratory operations, and extensive interviews. The major findings of this evaluation were that: the program lacks a clear statement of purpose; program plans, priorities, and procedures are not explicit and operations tend to follow historical patterns; and the program is generally accepted as beneficial, but its benefits are difficult to quantify. It is recommended that the focus of the Lab Coop Program be limited and clearly defined, that performance plans be developed and measured against accomplishments, and that a national informational effort be initiated

IPEP: Laboratory performance evaluation reports for management of DOE EM programs

International Nuclear Information System (INIS)

Hensley, J.E.; Lindahl, P.C.; Streets, W.E.

1995-01-01

Environmental restoration program/project managers at DOE's Office of Environmental Management (EM) are making important decisions based on analytical data generated by contracted laboratories. The Analytical Services Division, EM-263, is developing the Integrated Performance Evaluation Program (IPEP) to assess the performance of those laboratories, based on results from Performance Evaluation (PE) programs. The IPEP reports will be used by the laboratories to foster self-assessment and improvement. In addition, IPEP will produce PE reports for three levels of EM management (Operations/Project Offices, Area Program Offices, and Deputy Assistant Secretary Office). These reports will be used to assess whether contracted analytical laboratories have the capability to produce environmental data of the quality necessary for making environmental restoration and waste management decisions

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

Radiation detection technology assessment program (RADTAP)

International Nuclear Information System (INIS)

Smith, D.E.

1998-01-01

The U.S. Customs Service and the U.S. Department of Energy (DOE) conducted a technical and operational assessment of gamma ray radiation detection equipment during the period May 5-16, 1997 at a testing facility in North Carolina. The effort was entitled, ''Radiation Detection Technology Assessment Program (RADTAP)'', and was conducted for the purpose of assessing the applicability, sensitivity and robustness of a diverse suite of gamma ray detection and identification equipment for possible use by Customs and other law enforcement agencies. Thirteen companies entered 25 instruments into the assessment program. All detection equipment entered had to exhibit a minimum sensitivity of 20 micro-R per hour (background included) from a Cesium-137 point source. Isotope identifying spectrometers entered were man portable and operable at room temperature with read-out that could be interpreted by non-technical personnel. Radioactive sources used in the assessment included special nuclear material, industrial and health isotopes. Evaluators included Customs inspectors and technical experts from DOE and Customs. No conclusions or recommendations were issued based on the quantitative and qualitative test results, however, the results of the program provided law enforcement agencies with the necessary data to select equipment that best meets their operational needs and budgets. (author)

Meeting the Pepsi Challenge: Preparing Evaluation Programs for Scholastic Improvement.

Science.gov (United States)

Hopkins, Mona S.

This document provides guidelines for preparing evaluation programs for scholastic improvement. The philosophy underlying assessment and accountability is discussed, with specific reference to the positive and negative aspects of assessment. The design of a curriculum evaluation model is presented, including goal identification, data gathering,…

Specialization-Specific Course Assessments Integrated for Program Assessment

OpenAIRE

Qurban A. Memon; Adnan Harb; Shakeel Khoja

2012-01-01

The program assessment process combines assessments from individual courses to generate final program assessment to match accreditation benchmarks. In developing countries, industrial environment is not diversified to allow graduating engineers to seek jobs in all disciplines or specializations of an engineering program. Hence, it seems necessary to seek evolution of an engineering program assessment for specialized requirements of the industry. This paper describes how specialization-specifi...

Using program logic model analysis to evaluate and better deliver what works

International Nuclear Information System (INIS)

Megdal, Lori; Engle, Victoria; Pakenas, Larry; Albert, Scott; Peters, Jane; Jordan, Gretchen

2005-01-01

There is a rich history in using program theories and logic models (PT/LM) for evaluation, monitoring, and program refinement in a variety of fields, such as health care, social and education programs. The use of these tools to evaluate and improve energy efficiency programs has been growing over the last 5-7 years. This paper provides an overview of the state-of-the-art methods of logic model development, with analysis that significantly contributed to: Assessing the logic behind how the program expects to be able to meets its ultimate goals, including the 'who', the 'how', and through what mechanism. In doing so, gaps and questions that still need to be addressed can be identified. Identifying and prioritize the indicators that should be measured to evaluate the program and program theory. Determining key researchable questions that need to be answered by evaluation/research, to assess whether the mechanism assumed to cause the changes in actions, attitudes, behaviours, and business practices is workable and efficient. Also will assess the validity in the program logic and the likelihood that the program can accomplish its ultimate goals. Incorporating analysis of prior like programs and social science theories in a framework to identify opportunities for potential program refinements. The paper provides an overview of the tools, techniques and references, and uses as example the energy efficiency program analysis conducted for the New York State Energy Research and Development Authority's (NYSERDA) New York ENERGY $MART SM programs

Evaluation Methodologies for Estimating the Likelihood of Program Implementation Failure

Science.gov (United States)

Durand, Roger; Decker, Phillip J.; Kirkman, Dorothy M.

2014-01-01

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

Integrated plant safety assessment: systematic evaluation program. Haddam Neck Plant, Connecticut Yankee Atomic Power Company. Docket No. 50-213

International Nuclear Information System (INIS)

1983-03-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of Haddam Neck Plant, operated by Connecticut Yankee Atomic Power Company. The Haddam Neck Plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Integrated plant safety assessment: Systematic Evaluation Program. LaCrosse Boiling Water Reactor, Dairyland Power Cooperative, Docket No. 50-409

International Nuclear Information System (INIS)

1983-04-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the La Crosse Boiling Water Reactor, operated by Dairyland Power Cooperative. The La Crosse plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addresed. Equipment and procedural changes have been identified as a result of the review

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

Preparing for terrorism: tools for evaluating the Metropolitan Medical Response System Program

National Research Council Canada - National Science Library

Manning, Frederick J; Goldfrank, Lewis R

2002-01-01

.... DHHS asked the Institute of Medicine (IOM) to assist in assessing the effectiveness of the MMRS program by developing appropriate evaluation methods, tools, and processes to assess both its own management of the program and local preparedness...

Evaluating and Enhancing Outcomes Assessment Quality in Higher Education Programs

Science.gov (United States)

Wolf, Kenneth; Goodwin, Laura

2007-01-01

Accreditation is a mark of distinction indicating that an institution has met high standards set by the profession, and an increasingly important feature of the accreditation process in higher education is "outcomes assessment." This article presents two rubrics for evaluating the quality of an institution's outcomes assessment system. One rubric…

Evaluation of Clark County School District's Alternative Route to Licensure Program from the Program Participants' Perspectives

Science.gov (United States)

Kenyon, James J., Jr.

2013-01-01

This evaluation assesses the Alternative Route to Licensure (ARL) program of the Clark County School District (CCSD), in Clark County, Nevada from the program participants' perspectives. The program was implemented to reduce teacher shortages in the school district and allow persons with non-education-related Bachelor's Degrees to obtain teaching…

Evaluating Nutrition Education Programming by Using a Dietary Screener

Science.gov (United States)

Schultz, Jennifer; Litchfield, Ruth

2016-01-01

Short dietary assessment instruments known as screeners have potential for use in evaluating nutrition education programming because detecting change in dietary intake can demonstrate movement toward program goals. Using screeners results in objective dietary intake data but involves less administrative time, training, and cost than other…

A self-assessment program for Commonwealth Edison Company

International Nuclear Information System (INIS)

Garner, D.; Krowzak, F.; Wishau, R.

1987-01-01

This paper explains the assessment program developed by Commonwealth Edison Company (CECo) to evaluate the effectiveness of technical activities at its nuclear generating stations. The technical activities evaluated are in the areas of chemistry, emergency planning, radiation protection, and radioactive waste operations. The stations have technical programs for each of these areas and are set up to comply with applicable governmental laws and regulations, industry guidelines, and corporate policies and procedures. Reviews and audits need to be performed to ensure that technical program objectives are being met and that the programs are progressing as intended. Many organizations, including the Institute of Nuclear Power Operations, U.S. Nuclear Regulatory Commission, American Nuclear Insurers, and the CECo Quality Assurance Department perform such reviews and audits, which generate a wide variety of information on the stations' activities

Probabilistic safety assessment of Tehran Research Reactor using systems analysis programs for hands-on integrated reliability evaluations

International Nuclear Information System (INIS)

Hosseini, M.H.; Nematollahi, M.R.; Sepanloo, K.

2004-01-01

Probabilistic safety assessment application is found to be a practical tool for research reactor safety due to intense involvement of human interactions in an experimental facility. In this document the application of the probabilistic safety assessment to the Tehran Research Reactor is presented. The level 1 practicabilities safety assessment application involved: Familiarization with the plant, selection of accident initiators, mitigating functions and system definitions, event tree constructions and quantifications, fault tree constructions and quantification, human reliability, component failure data base development and dependent failure analysis. Each of the steps of the analysis given above is discussed with highlights from the selected results. Quantification of the constructed models is done using systems analysis programs for hands-on integrated reliability evaluations software

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Integrated plant safety assessment, Systematic Evaluation Program: Dresden Nuclear Power Station, Unit 2 (Docket No. 50-237)

International Nuclear Information System (INIS)

1989-10-01

The US Nuclear Regulatory Commission (NRC) has prepared Supplement 1 to the final Integrated Plant Safety Assessment Report (IPSAR) (NUREG-0823), under the scope of the Systematic Evaluation Program (SEP), for the Commonwealth Edison Company (CECo) Dresden Nuclear Power Station, Unit 2 located in Grundy County, Illinois. The NRC initiated the SEP to provide the framework for reviewing the design of older operating nuclear reactor plants to reconfirm and document their safety. This report documents the review completed by means of the SEP for those issues that required refined engineering evaluations or the continuation of ongoing evaluations subsequent to issuing the final IPSAR for Dresden Unit 2. The review was provided for (1) an assessment of the significance of differences between current technical positions on selected issues and those that existed when Dresden Unit 2 was licensed, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. The final IPSAR and this supplement forms part of the bases for considering the conversion of the existing provisional operating license to a full-term operating license. 83 refs., 9 tabs

How and when will self-assessment improve maintenance of CANDU plants - evaluator's view

International Nuclear Information System (INIS)

Mika, K.

1997-01-01

Learning organizations use self-evaluation programs to compare their actual performance with their management's expectations and industry standards. In general, self-evaluations identify areas needing improvement. Self-evaluation activities in maintenance departments include self-assessments, management monitoring observations, root cause analyses, event investigations, benchmarking, use of operating experience, self-checking, and problem reporting systems. In Ontario Hydro Nuclear (OHN) we have used almost all forms of self-evaluation with mixed success. However, we did not use self-assessments. With emphasis on excellent maintenance this powerful form of self-evaluation is being introduced to all our plants. Because of its recency and relative inexperience with it, this paper is focused on self-assessment. The paper provides the author's perspective on how a self-assessment program would be evaluated by an independent internal evaluation and what attributes should be in place in order for maintenance departments to succeed in the implementation and successful continuation of the program. (author)

Toward an Evaluation Framework for Doctoral Education in Social Work: A 10-Year Retrospective of One PhD Program's Assessment Experiences

Science.gov (United States)

Bentley, Kia J.

2013-01-01

This article presents a framework for evaluation in social work doctoral education and details 10 years of successes and challenges in one PhD program's use of the framework, including planning and implementing specific assessment activities around student learning outcomes and larger program goals. The article argues that a range of…

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Implementation of Portfolio Assessment in a Competency-based Dental Hygiene Program.

Science.gov (United States)

Gadbury-Amyot, Cynthia C.; Holt, Lorie P.; Overman, Pamela R.; Schmidt, Colleen R.

2000-01-01

Describes the implementation of a portfolio assessment program in the dental hygiene program at the University of Missouri School of Dentistry. Tables provide examples of program competencies and related portfolio entries, the complete scoring rubric for portfolios, and the student portfolio evaluation survey. Concludes that although portfolio…

Evaluation of Monticello Nuclear Power Plant, Environmental Impact Prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1976-11-01

This report evaluates quantitatively the nonradiological environmental monitoring programs at Monticello Nuclear Generating Plant. The general objective of the study is to assess the effectiveness of monitoring programs in the measurement of environmental impacts. Specific objectives include the following: (1) Assess the validity of environmental impact predictions made in the Environmental Statement by analysis of nonradiological monitoring data; (2) evaluate the general adequacy of environmental monitoring programs for detecting impacts and their responsiveness to Technical Specifications objectives; (3) assess the adequacy of preoperational monitoring programs in providing a sufficient data base for evaluating operational impacts; (4) identify possible impacts that were not predicted in the environmental statement and identify monitoring activities that need to be added, modified or deleted; and (5) assist in identifying environmental impacts, monitoring methods, and measurement problems that need additional research before quantitative predictions can be attempted. Preoperational as well as operational monitoring data were examined to test the usefulness of baseline information in evaluating impacts. This included an examination of the analytical methods used to measure ecological and physical parameters, and an assessment of sampling periodicity and sensitivity where appropriate data were available

Physical protection evaluation methodology program development and application

International Nuclear Information System (INIS)

Seo, Janghoon; Yoo, Hosik

2015-01-01

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Physical protection evaluation methodology program development and application

Energy Technology Data Exchange (ETDEWEB)

Seo, Janghoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2015-10-15

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Fiduciary Systems Assessment : Maharashtra Rural Water Supply and Sanitation Program

OpenAIRE

World Bank

2014-01-01

A fiduciary systems assessment (FSA) was carried out to evaluate the arrangements relevant to the program and to determine whether they provide reasonable assurance that the program funds will be used for their intended purpose. Taking into account the improvements required and the agreement on the actions required to strengthen the systems (which are reflected in the program action plan (...

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

Science.gov (United States)

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Evaluation of Current Assessment Methods in Engineering Entrepreneurship Education

Science.gov (United States)

Purzer, Senay; Fila, Nicholas; Nataraja, Kavin

2016-01-01

Quality assessment is an essential component of education that allows educators to support student learning and improve educational programs. The purpose of this study is to evaluate the current state of assessment in engineering entrepreneurship education. We identified 52 assessment instruments covered in 29 journal articles and conference…

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

IPEP: The integrated performance evaluation program for the Department of Energy's Office of Environmental Management

International Nuclear Information System (INIS)

Lindahl, P.C.; Streets, W.E.; Bass, D.A.

1995-01-01

The quality of the analytical data being provided to DOE's Office of Environmental Management (EM) for environmental restoration activities and the extent to which these data meet the data quality objectives are critical in the decision-making process. One of several quality metrics that can be used in evaluating a laboratory is its performance in performance evaluation (PE) programs. In support of DOE's environmental restoration and waste management efforts, EM has been charged with developing and implementing a program to assess the performance of participating laboratories. Argonne National Laboratory (ANL) and DOE's Environmental Measurements Laboratory (EML) and Radiological and Environmental Sciences Laboratory (RESL) have been collaborating on the development and implementation of a comprehensive Integrated Performance Evaluation Program (IPEP) for DOE-wide implementation. The IPEP will use results from existing inorganic, organic, and radiological PE programs when these are available and appropriate for the analytes and matrices being determined for DOE's EM activities. Existing programs include the U.S. Environmental Protection Agency's (EPA's) Contract Laboratory Program (CLP), the Water Supply (WS) and Water Pollution (WP) PE studies for inorganic and organic analytes, and DOE's Quality Assessment Program (QAP) for radiological analytes. In addition, DOE has begun the development of the Mixed Analyte Performance Evaluation Program (MAPEP) to address the needs of the DOE Complex. These PE programs provide a spectrum of matrices and analytes covering the various inorganic, organic, and low-level radiologic categories found in routine environmental and waste samples. These PE programs already provide some assessment of laboratory performance; IPEP will expand these assessments by evaluating historical performance, as well as results from multiple PE programs, thereby providing an enhanced usage of the PE program information

Methods for evaluating a mature substance abuse prevention/early intervention program.

Science.gov (United States)

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Integrated plant safety assessment. Systematic Evaluation Program. La Crosse Boiling Water Reactor. Dairyland Power Cooperative, Docket No. 50-409. Final report

International Nuclear Information System (INIS)

1983-06-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the La Crosse Boiling Water Reactor, operated by Dairyland Power Cooperative. The La Crosse plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Integrated Plant Safety Assessment: Systematic Evaluation Program. Yankee Nuclear Power Station, Yankee Atomic Electric Company, Docket No. 50-29. Final report

International Nuclear Information System (INIS)

1983-06-01

The Systematic Evaluation program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of Yankee Nuclear Power Station, operated by Yankee Atomic Electric Company. The Yankee plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Integrated Plant Safety Assessment, Systematic Evaluation Program. Yankee Nuclear Power Station, Yankee Atomic Electric Company, Docket No. 50-29. Draft report

International Nuclear Information System (INIS)

1983-02-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of Yankee Nuclear Power Station, operated by Yankee Atomic Electric Company. The Yankee plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia.

Science.gov (United States)

Alkhayal, Abdullah; Aldhukair, Shahla; Alselaim, Nahar; Aldekhayel, Salah; Alhabdan, Sultan; Altaweel, Waleed; Magzoub, Mohi Elden; Zamakhshary, Mohammed

2012-01-01

After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills. This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated. Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65). The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

An Evaluation of an Alternative Teacher Certification Program: A Matter of Trust

Science.gov (United States)

Grubbs, Scott T.

2009-01-01

For the internal evaluator, the issue of trust can be one of the more difficult ethical matters to manage. An organization might choose to conduct an internal program evaluation for a variety of reasons, including capitalizing on the abilities of invested stakeholders to assess aspects of a program, building an institutional culture oriented…

Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program

Directory of Open Access Journals (Sweden)

Ebrahim Jaafaripooyan

2014-09-01

Full Text Available Background Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs and professionals were approached for two-stage process of data collection. Results Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Boron neutron capture therapy: Brain Tumor Treatment Evaluation Program

International Nuclear Information System (INIS)

Griebenow, M.L.; Dorn, R.V. III; Gavin, P.R.; Spickard, J.H.

1988-01-01

The United States (US) Department of Energy (DOE) recently initiated a focused, multidisciplined program to evaluate Boron Neutron Capture Therapy (BNCT) for the treatment of brain tumors. The program, centered at the DOE/endash/Idaho National Engineering Laboratory (INEL), will develop the analytical, diagnostic and treatment tools, and the database required for BNCT technical assessment. The integrated technology will be evaluated in a spontaneously-occurring canine brain-tumor model. Successful animal studies are expected to lead to human clinical trials within four to five years. 2 refs., 3 figs

NASA Occupational Health Program FY98 Self-Assessment

Science.gov (United States)

Brisbin, Steven G.

1999-01-01

The NASA Functional Management Review process requires that each NASA Center conduct self-assessments of each functional area. Self-Assessments were completed in June 1998 and results were presented during this conference session. During FY 97 NASA Occupational Health Assessment Team activities, a decision was made to refine the NASA Self-Assessment Process. NASA Centers were involved in the ISO registration process at that time and wanted to use the management systems approach to evaluate their occupational health programs. This approach appeared to be more consistent with NASA's management philosophy and would likely confer status needed by Senior Agency Management for the program. During FY 98 the Agency Occupational Health Program Office developed a revised self-assessment methodology based on the Occupational Health and Safety Management System developed by the American Industrial Hygiene Association. This process was distributed to NASA Centers in March 1998 and completed in June 1998. The Center Self Assessment data will provide an essential baseline on the status of OHP management processes at NASA Centers. That baseline will be presented to Enterprise Associate Administrators and DASHO on September 22, 1998 and used as a basis for discussion during FY 99 visits to NASA Centers. The process surfaced several key management system elements warranting further support from the Lead Center. Input and feedback from NASA Centers will be essential to defining and refining future self assessment efforts.

Readiness for Residency: A Survey to Evaluate Undergraduate Medical Education Programs.

Science.gov (United States)

Peterson, Linda N; Rusticus, Shayna A; Wilson, Derek A; Eva, Kevin W; Lovato, Chris Y

2015-11-01

Health professions programs continue to search for meaningful and efficient ways to evaluate the quality of education they provide and support ongoing program improvement. Despite flaws inherent in self-assessment, recent research suggests that aggregated self-assessments reliably rank aspects of competence attained during preclerkship MD training. Given the novelty of those observations, the purpose of this study was to test their generalizability by evaluating an MD program as a whole. The Readiness for Residency Survey (RfR) was developed and aligned with the published Readiness for Clerkship Survey (RfC), but focused on the competencies expected to be achieved at graduation. The RfC and RfR were administered electronically four months after the start of clerkship and six months after the start of residency, respectively. Generalizability and decision studies examined the extent to which specific competencies were achieved relative to one another. The reliability of scores assigned by a single resident was G = 0.32. However, a reliability of G = 0.80 could be obtained by averaging over as few as nine residents. Whereas highly rated competencies in the RfC resided within the CanMEDS domains of professional, communicator, and collaborator, five additional medical expert competencies emerged as strengths when the program was evaluated after completion by residents. Aggregated resident self-assessments obtained using the RfR reliably differentiate aspects of competence attained over four years of undergraduate training. The RfR and RfC together can be used as evaluation tools to identify areas of strength and weakness in an undergraduate medical education program.

Process evaluation of the Regional Biomass Energy Program

Energy Technology Data Exchange (ETDEWEB)

Wilson, C.R.; Brown, M.A.; Perlack, R.D.

1994-03-01

The U.S. Department of Energy (DOE) established the Regional Biomass Energy Program (RBEP) in 1983 to increase the production and use of biomass energy resources. Through the creation of five regional program (the Great Lakes, Northeast, Pacific Northwest, Southeast, and West), the RBEP focuses on regionally specific needs and opportunities. In 1992, Oak Ridge National (ORNL) conducted a process evaluation of the RBEP Program designed to document and explain the development of the goals and strategies of the five regional programs; describe the economic and market context surrounding commercialization of bioenergy systems; assess the criteria used to select projects; describe experiences with cost sharing; identify program accomplishments in the transfer of information and technology; and offer recommendations for program improvement.

Development of the Office of Civilian Radioactive Waste Management's Self-Assessment Program

International Nuclear Information System (INIS)

Vlahakis, J.G.; Palabrica, R.J.; Goldsmith, S.

1993-01-01

This paper describes the development and implementation of the Self-Assessment (SA) Program of the Office of Civilian Radioactive Waste Management (RW). The basis for RW's SA Program is discussed, as well as RW's approach for meeting self-assessment requirements, RW's organization for self-assessment, actions to establish RW's SA Program, and planned RW SA implementation activities. This paper also discusses how self-assessment can support programmatic decisions and actions. The RW Director has approved and issued the Self-Assessment Management Plan that describes how RW will organize and manage its SA program. He has directed Associate/Office Directors to prepare individual Implementation Plans to provide specifics on how their Offices will meet the requirements of the RW SA Program. To assist in the preparation of these Implementation Plans, the RW Self-Assessment Unit (SAU), which manages the SA Program on behalf of the RW Director, has conducted a series of SA Implementation Workshops. The SAU has also developed an Annotated Outline for SA Implementation Plans. Following issuance of Office-specific Implementation Plans, independent evaluations by the SAU are planned

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

Science.gov (United States)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

A Computer Program for Assessing Nuclear Safety Culture Impact

Energy Technology Data Exchange (ETDEWEB)

Han, Kiyoon; Jae, Moosung [Hanyang Univ., Seoul (Korea, Republic of)

2014-10-15

Through several accidents of NPP including the Fukushima Daiichi in 2011 and Chernobyl accidents in 1986, a lack of safety culture was pointed out as one of the root cause of these accidents. Due to its latent influences on safety performance, safety culture has become an important issue in safety researches. Most of the researches describe how to evaluate the state of the safety culture of the organization. However, they did not include a possibility that the accident occurs due to the lack of safety culture. Because of that, a methodology for evaluating the impact of the safety culture on NPP's safety is required. In this study, the methodology for assessing safety culture impact is suggested and a computer program is developed for its application. SCII model which is the new methodology for assessing safety culture impact quantitatively by using PSA model. The computer program is developed for its application. This program visualizes the SCIs and the SCIIs. It might contribute to comparing the level of the safety culture among NPPs as well as improving the management safety of NPP.

Surgeons' attitude toward a competency-based training and assessment program: results of a multicenter survey.

Science.gov (United States)

Hopmans, Cornelis J; den Hoed, Pieter T; Wallenburg, Iris; van der Laan, Lijkckle; van der Harst, Erwin; van der Elst, Maarten; Mannaerts, Guido H H; Dawson, Imro; van Lanschot, Jan J B; Ijzermans, Jan N M

2013-01-01

Currently, most surgical training programs are focused on the development and evaluation of professional competencies. Also in the Netherlands, competency-based training and assessment programs were introduced to restructure postgraduate medical training. The current surgical residency program is based on the Canadian Medical Education Directives for Specialists (CanMEDS) competencies and uses assessment tools to evaluate residents' competence progression. In this study, we examined the attitude of surgical residents and attending surgeons toward a competency-based training and assessment program used to restructure general surgical training in the Netherlands in 2009. In 2011, all residents (n = 51) and attending surgeons (n = 108) in 1 training region, consisting of 7 hospitals, were surveyed. Participants were asked to rate the importance of the CanMEDS competencies and the suitability of the adopted assessment tools. Items were rated on a 5-point Likert scale and considered relevant when at least 80% of the respondents rated an item with a score of 4 or 5 (indicating a positive attitude). Reliability was evaluated by calculating the Cronbach's α, and the Mann-Whitney test was applied to assess differences between groups. The response rate was 88% (n = 140). The CanMEDS framework demonstrated good reliability (Cronbach's α = 0.87). However, the importance of the competencies 'Manager' (78%) and 'Health Advocate' (70%) was undervalued. The assessment tools failed to achieve an acceptable reliability (Cronbach's α = 0.55), and individual tools were predominantly considered unsuitable for assessment. Exceptions were the tools 'in-training evaluation report' (91%) and 'objective structured assessment of technical skill' (82%). No significant differences were found between the residents and the attending surgeons. This study has demonstrated that, 2 years after the reform of the general surgical residency program, residents and attending surgeons in a large

Opening the Conversation on REU Assessment and Evaluation

Science.gov (United States)

Pressley, S. N.; LeBeau, J. E.

2015-12-01

Project evaluation is a key component to ensuring success of any Research Experience for Undergraduates (REU) program. The Washington State University (WSU) Regional Atmospheric Chemistry: State-of-the-art Measurement and Modeling in the Pacific Northwest REU Site employs a mixed method approach to determine what is working well and what can use improvement (formative evaluation) and to determine impact and effectiveness of the project in reaching the stated goals (summative evaluation). Quantitative data is collected via a pre-/post-test measuring participants' research self-efficacy (RSE), motivation, background information, extent of socialization, and their interpretation of the value of the REU experience. Qualitative data is gathered through individual interviews with the REU students (at the beginning and end of the program) and faculty mentors (at the end). Beginning interviews focus on expectations for the REU program and student backgrounds. End interviews focus on student RSE development, interpretations of their experience, and the value of the experience. Faculty mentors are interviewed to gather insight on student performance in the program and perspectives on the overall success of the program in meeting the proposed goals. Students are provided an opportunity to comment on the strengths and weaknesses of workshops, providing critical feedback to the particular instructor and enabling the faculty to modify the workshop content and activities in future years. Finally, research results are evaluated during the final poster presentation, and faculty are interviewed to report on their perception of how each student learned and gained knowledge during the program. To evaluate the retention of students in engineering and science and identify chosen career paths, a longitudinal survey was created and it is administered via email each year. Many REU programs also employ the Undergraduate Research Students Self-Assessment (URSSA) online tool designed for

Evaluating the Quality of Competency Assessment in Pharmacy: A Framework for Workplace Learning

Directory of Open Access Journals (Sweden)

Shailly Shah

2016-01-01

Full Text Available Demonstration of achieved competencies is critical in the pharmacy workplace. The purpose of this study was to evaluate the quality of the competency assessment program for pharmacy residents at an academic medical center. The competency assessment program (CAP survey is a validated, 48-item instrument that evaluates the quality of an assessment program based on 12 criteria, each measured by four questions on a scale of 0 to 100. The CAP was completed by residents (n = 23 and preceptors (n = 28 from the pharmacy residency program between 2010 and 2013. Results were analyzed using descriptive statistics, Cronbach’s alpha, and non-parametric tests. Educational Consequences was the only quality criteria falling below the standard for “good quality.” Participants that completed residency training elsewhere rated the Comparability (0.04 and Meaningfulness (0.01 of the assessment program higher than those that completed residency at the academic medical center. There were no significant differences between resident and preceptor scores. Overall, the quality of the assessment program was rated highly by residents and preceptors. The process described here provides a useful framework for understanding the quality of workplace learning assessments in pharmacy practice.

Food Sanitation and Safety Self-Assessment Instrument for School Nutrition Programs.

Science.gov (United States)

California State Dept. of Education, Sacramento.

Like food-service establishments, child nutrition programs are responsible for preserving the quality and wholesomeness of food. Proper food-handling practices prevent contamination and job-related accidents. Application of the evaluation instrument presented in this document to individual programs helps to define proper practices, assess the…

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Systematic Assessment for University Sexuality Programming.

Science.gov (United States)

Westefeld, John S.; Winkelpleck, Judy M.

1982-01-01

Suggests systematic empirical assessment is needed to plan university sexuality programing. Proposes the traditional approach of asking about students' attitudes, knowledge, and behavior is useful for developing specific programing content. Presents an assessment model emphasizing assessment of students' desires for sexuality programing in terms…

How and when will self-assessment improve maintenance of CANDU plants - evaluator's view

Energy Technology Data Exchange (ETDEWEB)

Mika, K. [Ontario Hydro. Bruce Nuclear Station. Tiverton, ON (Canada)

1997-07-01

Learning organizations use self-evaluation programs to compare their actual performance with their management's expectations and industry standards. In general, self-evaluations identify areas needing improvement. Self-evaluation activities in maintenance departments include self-assessments, management monitoring observations, root cause analyses, event investigations, benchmarking, use of operating experience, self-checking, and problem reporting systems. In Ontario Hydro Nuclear (OHN) we have used almost all forms of self-evaluation with mixed success. However, we did not use self-assessments. With emphasis on excellent maintenance this powerful form of self-evaluation is being introduced to all our plants. Because of its recency and relative inexperience with it, this paper is focused on self-assessment. The paper provides the author's perspective on how a self-assessment program would be evaluated by an independent internal evaluation and what attributes should be in place in order for maintenance departments to succeed in the implementation and successful continuation of the program. (author)

Issues in assessing the cost-effectiveness of coordinated DSM programs

International Nuclear Information System (INIS)

Hill, L.J.; Brown, M.A.

1995-01-01

Coordinated demand-side management (DSM) programs, co-administered by government agencies and electric and gas utilities, are likely to grow in importance in the coming years. Because of the unique features of these types of DSM programs, special care must be taken in assessing their cost-effectiveness. In this paper, we discuss these features, suggest how standard cost-effectiveness measures must be adapted to accommodate them, and show how important these adaptations are in assessing the cost-effectiveness of coordinated programs. At first, we use a least-cost, financial approach. The discussion indicates that failure to account properly for the special features of coordinated programs materially affects estimates of cost-effectiveness and, in extreme cases, may lead to rejection of otherwise cost-effective programs. Then extending the analysis to include economic factors, we speculate that most types of coordinated programs are more attractive than when evaluated on a financial basis. (author)

Evaluation as a critical factor of success in local public health accreditation programs.

Science.gov (United States)

Tremain, Beverly; Davis, Mary; Joly, Brenda; Edgar, Mark; Kushion, Mary L; Schmidt, Rita

2007-01-01

This article presents the variety of approaches used to conduct evaluations of performance improvement or accreditation systems, while illustrating the complexity of conducting evaluations to inform local public health practice. We, in addition, hope to inform the Exploring Accreditation Program about relevant experiences involving accreditation and performance assessment processes, specifically evaluation, as it debates and discusses a national voluntary model. A background of each state is given. To further explore these issues, interviews were conducted with each state's evaluator to gain more in-depth information on the many different evaluation strategies and approaches used. On the basis of the interviews, the authors provide several overall themes, which suggest that evaluation is a critical tool and success factor for performance assessment or accreditation programs.

Implementing an effective self-assessment program at Millstone Station

International Nuclear Information System (INIS)

Venable, J.M.

1996-01-01

The nuclear industry is becoming ever more reliant on self-assessments to ensure operational safety and to meet our increasingly competitive business challenges. This trend includes utility assessments modeled after major U.S. Nuclear Regulatory Commission (NRC) inspections such as safety system functional inspections (SSFI). Utility conducted SSFIs leveraged the limited resources of the NRC, making possible many evaluations that simply would not have been conducted otherwise. This report describes a self-assessment program at the Millstone Station plant

An evaluation of the Australian Rotavirus Surveillance Program.

Science.gov (United States)

Roberts-Witteveen, April R; Patel, Mahomed S; Roche, Paul W

2008-09-01

The Australian Rotavirus Serotyping Program (ARSP) serotypes rotavirus isolates obtained from stool samples sent from Australian laboratories. In collaboration with ARSP the Australian Government Department of Health and Ageing evaluated the program for its utility and capacity to monitor effectiveness of the rotavirus vaccines recently introduced into the Australian National Immunisation Program. The system was described using ARSP annual reports and staff interviews. The attributes of the system were assessed by adapting standard guidelines for evaluating a surveillance system. Email surveys or face to face interviews were conducted with staff of ARSP, participating laboratories, rotavirus vaccine manufacturing companies and representatives of the Communicable Diseases Network Australia. The ability of the ARSP to monitor changes in rotavirus serotype epidemiology was assessed. ARSP serotypes rotavirus isolates received from participating laboratories at least bi-annually, with results being reported at least as often. Serotype analyses have informed formulation of rotavirus vaccines and contributed to forecasting the extent of outbreaks caused by novel serotypes. The ARSP will be able to monitor changes in rotavirus serotype epidemiology and identify probable vaccination failures. Enhancement of the representativeness and sensitivity of the system are needed for the data to remain useful in the public health context. Methods for transferring data between the program and state and territory health departments need to be developed.

Chemical Exposure Assessment Program at Los Alamos National Laboratory: A risk based approach

International Nuclear Information System (INIS)

Stephenson, D.J.

1996-01-01

The University of California Contract And DOE Order 5480.10 require that Los Alamos National Laboratory (LANL) perform health hazard assessments/inventories of all employee workplaces. In response to this LANL has developed the Chemical Exposure Assessment Program. This program provides a systematic risk-based approach to anticipation, recognition, evaluation and control of chemical workplace exposures. Program implementation focuses resources on exposures with the highest risks for causing adverse health effects. Implementation guidance includes procedures for basic characterization, qualitative risk assessment, quantitative validation, and recommendations and reevaluation. Each component of the program is described. It is shown how a systematic method of assessment improves documentation, retrieval, and use of generated exposure information

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya.

Science.gov (United States)

Cole, Donald C; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

2016-06-01

Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners' meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

River Protection Project waste feed delivery program technical performance measurement assessment plan

International Nuclear Information System (INIS)

O'TOOLE, S.M.

1999-01-01

This plan establishes a formal technical performance-monitoring program. Technical performance is assessed by establishing requirements based performance goals at the beginning of a program and routinely evaluating progress in meeting these goals at predetermined milestones throughout the project life cycle

NRC systematic evaluation program: seismic review

International Nuclear Information System (INIS)

Levin, H.A.

1980-01-01

The NRC Systematic Evaluation Program is currently making an assessment of the seismic design safety of 11 older nuclear power plant facilities. The general review philosophy and review criteria relative to seismic input, structural response, and equipment functionability are presented, including the rationale for the development of these guidelines considering the significant evolution of seismic design criteria since these plants were originally licensed. Technical approaches thought more realistic in light of current knowledge are utilized. Initial findings for plants designed to early seismic design procedures suggest that with minor exceptions, these plants possess adequate seismic design margins when evaluated against the intent of current criteria. However, seismic qualification of electrical equipment has been identified as a subject which requires more in-depth evaluation

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

ITAC, an insider threat assessment computer program

International Nuclear Information System (INIS)

Eggers, R.F.; Giese, E.W.

1988-01-01

The insider threat assessment computer program, ITAC, is used to evaluate the vulnerability of nuclear material processing facilities to theft of special nuclear material by one or more authorized insider adversaries. The program includes two main parts: one is used to determine the timeliness of nuclear material accounting tests for loss of special nuclear material, and the other determines pathway aggregate detection probabilities for physical protection systems and material control procedures that could detect the theft. Useful features of ITAC include its ability to (1) evaluate and quantify the timeliness of material accounting tests, (2) analyze branching systems of physical pathways and adversary strategies, (3) analyze trickle or abrupt theft situations for combinations of insiders, (4) accept input probabilities and times in the form of ranges rather than discrete points, and (5) simulate input data using Monte Carlo methods to produce statistically distributed aggregate delay times and detection probabilities. The ITAC program was developed by the Security Applications Center of Westinghouse Hanford Comapny and Boeing Computer Services, Richland, WA

Integrated-plant-safety assessment Systematic Evaluation Program. Dresden Nuclear Power Station, Unit 2, Commonwealth Edison Company, Docket No. 50-237

International Nuclear Information System (INIS)

1982-10-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues; (2) a basis for deciding on how these differences should be resolved in an integrated plant review; and (3) a documented evaluation of plant safety. This report documents the review of Dresden Nuclear Generating Station, Unit 2 owned and operated by the Commonwealth Edison Company and located in Grundy County, Illinois. Dresden Unit 2 is one of ten plants reviewed under Phase II of this program, which indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. It is expected that this report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license

Intergrated plant safety assessment. Systematic evaluation program. Palisades plant, Consumers Power Company, Docket No. 50-255. Final report

International Nuclear Information System (INIS)

1982-10-01

The Nuclear Regulatory Commission (NRC) has published its Final Integrated Plant Safety Assessment Report (IPSAR) (NUREG-0820), under the scope of the Systematic Evaluation Program (SEP), for Consumers Power Company's Palisades Plant located in Covert, Van Buren County, Michigan. The SEP was initiated by the NRC to review the design of older operating nuclear reactor plants to reconfirm and document their safety. This report documents the review completed under the SEP for the Palisades Plant. The review has provided for (1) as assessment of the significance of differences between current technical positions on selected safety issues and those that existed when the Palisades Plant was licensed, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety when all supplements to the Final IPSAR and the Safety Evaluation Report for converting the license from a provisional to a full-term license have been issued. The report also addresses the comments and recommendations made by the Advisory Committee on Reactor Safeguards in connection with its review of the Draft Report, issued in April 1982

Evaluating Realized Impacts of DOE/EERE R&D Programs. Standard impact evaluation method

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc. (United States); O' Connor, Alan C. [RTI International, Research Triangle Park, NC (United States); Loomis, Ross J. [RTI International, Research Triangle Park, NC (United States)

2014-08-01

This document provides guidance for evaluators who conduct impact assessments of research and development (R&D) programs for the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE). It is also targeted at EERE program staff responsible for initiating and managing commissioned impact studies. The guide specifies how to estimate economic benefits and costs, energy saved and installed or generated, environmental impacts, energy security impacts, and knowledge impacts of R&D investments in advanced energy technologies.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Handbook for nuclear power plant self-assessment programs. Final report, July 1991

International Nuclear Information System (INIS)

1991-07-01

EPRI has prepared this handbook to help utilities with their Self-Assessment Programs at nuclear power plants. Self-assessments are independent reviews performed by nuclear plant utilities to identify trends in operational activities that are important to safety, and to assess the impact of these trends on plant safety. Activities performed as self-assessments include reviews and evaluations of plant performance and abnormal events, technical evaluations of plant activities to identify potential problem areas, and reviews of other sources of plant design and operating experience for applicability to safety. This handbook is based on information obtained from utilities and includes examples of activities and methods that have proven effective. The handbook includes a summary of NRC requirements, guidelines for self-assessment program planning, descriptions and examples of investigative techniques, and key references that can be consulted for additional information. It can serve as a training guide for plant staff members who are assigned to self-assessment activities. (author)

Operating experience review for nuclear power plants in the Systematic Evaluation Program

International Nuclear Information System (INIS)

Mays, G.T.; Harrington, K.H.

1982-01-01

The Systematic Evaluation Program Branch (SEPB) of the Nuclear Regulatory Commission (NRC) is conducting the Systematic Evaluation Program (SEP) whose purpose is to determine the safety margins of the design and operation of the eleven oldest operating commercial nuclear power plants in the United States. This paper describes the methodology and results of the operational experience review portion of the SEP evaluation. SEPB will combine the results from these operational reviews with other safety topic evaluations to perform an integrated assessment of the SEP plants

Heuristic Evaluation for Novice Programming Systems

OpenAIRE

Kölling, Michael; McKay, Fraser

2016-01-01

The past few years has seen a proliferation of novice programming tools. The availability of a large number of systems has made it difficult for many users to choose among them. Even for education researchers, comparing the relative quality of these tools, or judging their respective suitability for a given context, is hard in many instances. For designers of such systems, assessing the respective quality of competing design decisions can be equally difficult.\\ud Heuristic evaluation provides...

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

Science.gov (United States)

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Implementing and evaluating a program to facilitate chronic disease prevention and screening in primary care: a mixed methods program evaluation.

Science.gov (United States)

Manca, Donna Patricia; Aubrey-Bassler, Kris; Kandola, Kami; Aguilar, Carolina; Campbell-Scherer, Denise; Sopcak, Nicolette; O'Brien, Mary Ann; Meaney, Christopher; Faria, Vee; Baxter, Julia; Moineddin, Rahim; Salvalaggio, Ginetta; Green, Lee; Cave, Andrew; Grunfeld, Eva

2014-10-08

The objectives of this paper are to describe the planned implementation and evaluation of the Building on Existing Tools to Improve Chronic Disease Prevention and Screening in Primary Care (BETTER 2) program which originated from the BETTER trial. The pragmatic trial, informed by the Chronic Care Model, demonstrated the effectiveness of an approach to Chronic Disease Prevention and Screening (CDPS) involving the use of a new role, the prevention practitioner. The desired goals of the program are improved clinical outcomes, reduction in the burden of chronic disease, and improved sustainability of the health-care system through improved CDPS in primary care. The BETTER 2 program aims to expand the implementation of the intervention used in the original BETTER trial into communities across Canada (Alberta, Ontario, Newfoundland and Labrador, the Northwest Territories and Nova Scotia). This proactive approach provides at-risk patients with an intervention from the prevention practitioner, a health-care professional. Using the BETTER toolkit, the prevention practitioner determines which CDPS actions the patient is eligible to receive, and through shared decision-making and motivational interviewing, develops a unique and individualized 'prevention prescription' with the patient. This intervention is 1) personalized; 2) addressing multiple conditions; 3) integrated through linkages to local, regional, or national resources; and 4) longitudinal by assessing patients over time. The BETTER 2 program brings together primary care providers, policy/decision makers and researchers to work towards improving CDPS in primary care. The target patient population is adults aged 40-65. The reach, effectiveness, adoption, implementation, maintain (RE-AIM) framework will inform the evaluation of the program through qualitative and quantitative methods. A composite index will be used to quantitatively assess the effectiveness of the prevention practitioner intervention. The CDPS actions

25 CFR 36.50 - Standard XVII-School program evaluation and needs assessment.

Science.gov (United States)

2010-04-01

... MINIMUM ACADEMIC STANDARDS FOR THE BASIC EDUCATION OF INDIAN CHILDREN AND NATIONAL CRITERIA FOR DORMITORY... process evaluation methods. The areas to be reviewed will include, but not be limited to, the following... planning and implementation. (4) Curriculum development and instruction. (5) Primary education. (6) Program...

Technology Assessment and Roadmap for the Emergency Radiation Dose Assessment Program

International Nuclear Information System (INIS)

Turteltaub, K W; Hartman-Siantar, C; Easterly, C; Blakely, W

2005-01-01

A Joint Interagency Working Group (JIWG) under the auspices of the Department of Homeland Security Office of Research and Development conducted a technology assessment of emergency radiological dose assessment capabilities as part of the overall need for rapid emergency medical response in the event of a radiological terrorist event in the United States. The goal of the evaluation is to identify gaps and recommend general research and development needs to better prepare the Country for mitigating the effects of such an event. Given the capabilities and roles for responding to a radiological event extend across many agencies, a consensus of gaps and suggested development plans was a major goal of this evaluation and road-mapping effort. The working group consisted of experts representing the Departments of Homeland Security, Health and Human Services (Centers for Disease Control and the National Institutes of Health), Food and Drug Administration, Department of Defense and the Department of Energy's National Laboratories (see appendix A for participants). The specific goals of this Technology Assessment and Roadmap were to: (1) Describe the general context for deployment of emergency radiation dose assessment tools following terrorist use of a radiological or nuclear device; (2) Assess current and emerging dose assessment technologies; and (3) Put forward a consensus high-level technology roadmap for interagency research and development in this area. This report provides a summary of the consensus of needs, gaps and recommendations for a research program in the area of radiation dosimetry for early response, followed by a summary of the technologies available and on the near-term horizon. We then present a roadmap for a research program to bring present and emerging near-term technologies to bear on the gaps in radiation dose assessment and triage. Finally we present detailed supporting discussion on the nature of the threats we considered, the status of technology

Technology Assessment and Roadmap for the Emergency Radiation Dose Assessment Program

Energy Technology Data Exchange (ETDEWEB)

Turteltaub, K W; Hartman-Siantar, C; Easterly, C; Blakely, W

2005-10-03

A Joint Interagency Working Group (JIWG) under the auspices of the Department of Homeland Security Office of Research and Development conducted a technology assessment of emergency radiological dose assessment capabilities as part of the overall need for rapid emergency medical response in the event of a radiological terrorist event in the United States. The goal of the evaluation is to identify gaps and recommend general research and development needs to better prepare the Country for mitigating the effects of such an event. Given the capabilities and roles for responding to a radiological event extend across many agencies, a consensus of gaps and suggested development plans was a major goal of this evaluation and road-mapping effort. The working group consisted of experts representing the Departments of Homeland Security, Health and Human Services (Centers for Disease Control and the National Institutes of Health), Food and Drug Administration, Department of Defense and the Department of Energy's National Laboratories (see appendix A for participants). The specific goals of this Technology Assessment and Roadmap were to: (1) Describe the general context for deployment of emergency radiation dose assessment tools following terrorist use of a radiological or nuclear device; (2) Assess current and emerging dose assessment technologies; and (3) Put forward a consensus high-level technology roadmap for interagency research and development in this area. This report provides a summary of the consensus of needs, gaps and recommendations for a research program in the area of radiation dosimetry for early response, followed by a summary of the technologies available and on the near-term horizon. We then present a roadmap for a research program to bring present and emerging near-term technologies to bear on the gaps in radiation dose assessment and triage. Finally we present detailed supporting discussion on the nature of the threats we considered, the status of

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Evaluating the effect of learning style and student background on self-assessment accuracy

Science.gov (United States)

Alaoutinen, Satu

2012-06-01

This study evaluates a new taxonomy-based self-assessment scale and examines factors that affect assessment accuracy and course performance. The scale is based on Bloom's Revised Taxonomy and is evaluated by comparing students' self-assessment results with course performance in a programming course. Correlation has been used to reveal possible connections between student information and both self-assessment and course performance. The results show that students can place their knowledge along the taxonomy-based scale quite well and the scale seems to fit engineering students' learning style. Advanced students assess themselves more accurately than novices. The results also show that reflective students were better in programming than active. The scale used in this study gives a more objective picture of students' knowledge than general scales and with modifications it can be used in other classes than programming.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond's Checklist: A Narrative Review.

Science.gov (United States)

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-09-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond's checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles' structure was analyzed by Drummond's standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond's criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE), Version 5.0. Volume 5, Systems Analysis and Risk Assessment (SARA) tutorial manual

International Nuclear Information System (INIS)

Sattison, M.B.; Russell, K.D.; Skinner, N.L.

1994-07-01

The Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) refers to a set of several microcomputer programs that were developed to create and analyze probabilistic risk assessments (PRAs) primarily for nuclear power plants. This volume is the tutorial manual for the Systems Analysis and Risk Assessment (SARA) System Version 5.0, a microcomputer-based system used to analyze the safety issues of a open-quotes familyclose quotes [i.e., a power plant, a manufacturing facility, any facility on which a probabilistic risk assessment (PRA) might be performed]. A series of lessons is provided that guides the user through some basic steps common to most analyses performed with SARA. The example problems presented in the lessons build on one another, and in combination, lead the user through all aspects of SARA sensitivity analysis capabilities

25 CFR 36.12 - Standard III-Program needs assessment.

Science.gov (United States)

2010-04-01

...., (1) Perceptions of the parents, tribes, educators, and the students with regard to the relevance and....12 Indians BUREAU OF INDIAN AFFAIRS, DEPARTMENT OF THE INTERIOR EDUCATION MINIMUM ACADEMIC STANDARDS... Program Evaluation. This assessment shall include at least the following: (a) A clear statement of student...

Evaluating the Student Learning Outcomes Assessment Process in Undergraduate Parks and Recreation Academic Programs

Science.gov (United States)

Ross, Craig M.; Young, Sarah J.; Sturts, Jill R.

2012-01-01

Institutions of higher education are increasingly being held more accountable for assessing student learning both in and out of their classrooms along with reporting results to their stakeholders. The purpose of this study, which examined assessment of student learning outcomes in undergraduate park and recreation academic programs, was two-fold:…

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

Assessment Practices in Undergraduate Accounting Programs

Science.gov (United States)

Lusher, Anna L.

2010-01-01

This study examined accounting program assessment plans at 102 colleges and universities in the United States. The research focused on identifying assessment practices in undergraduate accounting programs by examining the skills and competencies assessed and determining the methods of assessment used. The study also investigated what course and/or…

Program SYVAC, for stochastic assessment of nuclear fuel waste disposal

International Nuclear Information System (INIS)

Sherman, G.R.; Hoffman, K.J.; Donahue, D.C.

1985-01-01

In this paper, the computer program SYVAC, used to assess concepts for the disposal of nuclear fuel waste, is described with regard to the development approach, the basic program structure, and quality assurance. The interrelationships of these aspects are illustrated by detailed descriptions of two concepts of fundamental importance to the program: the method of selecting parameter values from input probability density functions, and the numerical evaluation of the convolution integral. Quality assurance procedures, including different types of comparisons and peer review, are presented

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia

Directory of Open Access Journals (Sweden)

Alkhayal A

2012-10-01

Full Text Available Abdullah Alkhayal,1 Shahla Aldhukair,2 Nahar Alselaim,1 Salah Aldekhayel,1 Sultan Alhabdan,1 Waleed Altaweel,3 Mohi Elden Magzoub,4 Mohammed Zamakhshary1,21Department of Surgery, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi Arabia; 2Public Health Section, King Abdullah International Medical Research Center, Riyadh, Saudi Arabia; 3Urology Department, King Faisal Specialist Hospital and Research Center, Riyadh, Saudi Arabia; 4Department of Medical Education, King Saud bin Abdulaziz University for Health Sciences, Riyadh, Saudi ArabiaBackground: After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors’ perspective, and program directors’ attitudes toward the available objective tools to assess technical skills.Methods: This study was a cross-sectional survey of surgical program directors (PDs. The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs’ perspective and the PDs’ attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated.Results: Seventy-one (61% participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative

Evaluation of Nuclear Facility Decommissioning Projects program

International Nuclear Information System (INIS)

Baumann, B.L.

1983-01-01

The objective of the Evaluation of Nuclear Facility Decommissioning Projects (ENFDP) program is to provide the NRC licensing staff with data which will allow an assessment of radiation exposure during decommissioning and the implementation of ALARA techniques. The data will also provide information to determine the funding level necessary to ensure timely and safe decommissioning operations. Actual decommissioning costs, methods and radiation exposures are compared with those estimated by the Battelle-PNL and ORNL NUREGs on decommissioning. Exposure reduction techniques applied to decommissioning activities to meet ALARA objectives are described. The lessons learned concerning various decommissioning methods are evaluated

Integrated Plant Safety Assessment: Systematic Evaluation Program. Haddam Neck Plant, Connecticut Yankee Atomic Power Company, Docket No. 50-213. Final report

International Nuclear Information System (INIS)

1983-01-01

The Systematic Evaluation Progam was initiated in February 1977 by the US Nuclear Regulatory Commission review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides: (1) an assessment of how these plants compare with curent licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of Haddam Neck Plant, operated by Connecticut Yankee Atomic Power Company. The Haddam Neck Plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Integrated plant safety assessment systematic evaluation program. R.E. Ginna Nuclear Power Plant, Rochester Gas and Electric Corporation, Docket No. 50-244

International Nuclear Information System (INIS)

1982-05-01

The Systematic Evaluation Program was initiated in February 1978 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the R.E. Ginna Nuclear Power Plant (located in Wayne County near Rochester, NY), one of ten plants reviewed under Phase II of this program, and indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. It is expected that this report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license

Designing faculty development to support the evaluation of resident competency in the intrinsic CanMEDS roles: practical outcomes of an assessment of program director needs.

Science.gov (United States)

Puddester, Derek; MacDonald, Colla J; Clements, Debbie; Gaffney, Jane; Wiesenfeld, Lorne

2015-06-05

The Royal College of Physicians and Surgeons of Canada and the College of Family Physicians of Canada mandate that faculty members demonstrate they are evaluating residents on all CanMEDS (Canadian Medical Education Directions for Specialists) roles as part of the accreditation process. Postgraduate Medical Education at the University of Ottawa initiated a 5-year project to develop and implement a comprehensive system to assess the full spectrum of CanMEDS roles. This paper presents the findings from a needs assessment with Program Directors, in order to determine how postgraduate medical faculty can be motivated and supported to evaluate residents on the intrinsic CanMEDS roles. Semi-structured individual interviews were conducted with 60 Postgraduate Program Directors in the Faculty of Medicine. Transcribed interviews were analyzed using qualitative analysis. Once the researchers were satisfied the identified themes reflected the views of the participants, the data was assigned to categories to provide rich, detailed, and comprehensive information that would indicate what faculty need in order to effectively evaluate their residents on the intrinsic roles. Findings indicated faculty members need faculty development and shared point of care resources to support them with how to not only evaluate, but also teach, the intrinsic roles. Program Directors expressed the need to collaborate and share resources across departments and national specialty programs. Based on our findings, we designed and delivered workshops with companion eBooks to teach and evaluate residents at the point of care (Developing the Professional, Health Advocate and Scholar). Identifying stakeholder needs is essential for designing effective faculty development. By sharing resources, faculties can prevent 'reinventing the wheel' and collaborate to meet the Colleges' accreditation requirements more efficiently.

Evaluating Additionality of an Innovation Subsidy Program Targeted at SMEs: An Exploratory Study

Directory of Open Access Journals (Sweden)

Sonja Radas

2013-04-01

Full Text Available This paper explores the effectiveness of a recently introduced innovation subsidy program targeted at SMEs in Croatia. Three aspects of program additionality were evaluated: input, output and behavioral aspects. Both qualitative and survey research was employed, and four case studies with selected recipient companies were conducted. This study is a response to the policy-makers’ need for early program assessment. It attempts to show that even with early evaluation and small population of recipients it is possible to gain insight into program effectiveness. The analysis suggests that the effects of programs targeted at innovative SMEs might need to be evaluated differently than general subsidies. This is especially evident in the evaluation of input additionality. The analysis indicates that SMEs which started with a higher R&D capability tend to increase R&D intensity while participating in the program. The program raised R&D and innovation capability of the participating SMEs, but commercialization of project results remains a concern.

Results from a Multi-Modal Program Evaluation of a Four Year Statewide Juvenile Sex Offender Treatment and Reentry Program

Science.gov (United States)

Underwood, Lee A.; Dailey, Frances L. L.; Merino, Carrie; Crump, Yolanda

2015-01-01

The results of the Program Evaluation show the OJJ Statewide Sex Offender Treatment program is exceptionally productive in meeting over 90% of its established performance markers. These markers included successful screening and assessment of risk and psychosocial needs, completion of initial and master treatment plans, establishment of sex…

Integrated plant safety assessment: Systematic Evaluation Program, San Onofre Nuclear Generating Station, Unit 1 (Docket No. 50-206): Final report

International Nuclear Information System (INIS)

1986-12-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues; (2) a basis for deciding on how these differences should be resolved in an integrated plant review; and (3) a documented evaluation of plant safety. This report documents the review of San Onofre Nuclear Generating Station, Unit 1, operated by Southern California Edison Company. The San Onofre plant is one of ten plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. This report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license. This report also addresses the comments and recommendations made by the Advisory Committee on Reactor Safeguards in connection with its review of the draft report issued in April 1985

Integrated-plant-safety assessment Systematic Evaluation program. Millstone Nuclear Power Station, Unit 1, Northeast Nuclear Energy Company, Docket No. 50-245

International Nuclear Information System (INIS)

1982-11-01

The Systematic Evaluation Program was initiated in February 1977 to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the Millstone Nuclear Power Station, Unit 1, operated by Northeast Nuclear Energy Company (located in Waterford, Connecticut). Millstone Nuclear Power Station, Unit 1, is one of ten plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. It is expected that this report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

Science.gov (United States)

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Is Something Better than Nothing? An Evaluation of Early Childhood Programs in Cambodia

Science.gov (United States)

Rao, Nirmala; Sun, Jin; Pearson, Veronica; Pearson, Emma; Liu, Hongyun; Constas, Mark A.; Engle, Patrice L.

2012-01-01

This study evaluated the relative effectiveness of home-based, community-based, and state-run early childhood programs across Cambodia. A total of 880 five-year-olds (55% girls) from 6 rural provinces in Cambodia attending State Preschools, Community Preschools, Home-Based Programs, or no programs were assessed twice using the Cambodian…

Data Availability in Appliance Standards and Labeling Program Development and Evaluation

Energy Technology Data Exchange (ETDEWEB)

Romankiewicz, John [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Khanna, Nina [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Vine, Edward [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Zhou, Nan [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

2013-05-01

In this report, we describe the necessary data inputs for both standards development and program evaluation and perform an initial assessment of the availability and uncertainty of those data inputs in China. For standards development, we find that China and its standards and labeling program administrators currently has access to the basic market and technical data needed for conducting market and technology assessment and technological and economic analyses. Some data, such as shipments data, is readily available from the China Energy Label product registration database while the availability of other data, including average unit energy consumption, prices and design options, needs improvement. Unlike some other countries such as the United States, most of the necessary data for conducting standards development analyses are not publicly available or compiled in a consolidated data source. In addition, improved data on design and efficiency options as well as cost data (e.g., manufacturing costs, mark-ups, production and product use-phase costs) – key inputs to several technoeconomic analyses – are particularly in need given China’s unconsolidated manufacturing industry. For program evaluation, we find that while China can conduct simple savings evaluations on its incentive programs with the data it currently has available from the Ministry of Finance – the program administrator, the savings estimates produced by such an evaluation will carry high uncertainty. As such, China could benefit from an increase in surveying and metering in the next one to three years to decrease the uncertainty surrounding key data points such as unit energy savings and free ridership.

Onsite assessments for the Department of Energy Laboratory Accreditation Program

International Nuclear Information System (INIS)

McMahan, K.L.

1992-01-01

For Department of Energy (DOE) facilities, compliance with DOE Order 5480.11 became a requirement in January 1989. One of the requirements of this Order is that personal external dosimetry programs be accredited under the Department of Energy's Laboratory Accreditation Program (DOELAP) in Personnel Dosimetry. The accreditation process, from the facility's perspective, is two-fold: dosimeters must meet performance criteria in radiation categories appropriate for each facility, and personnel administering and carrying out the program must demonstrate good operating practices. The DOELAP onsite assessment is designed to provide an independent evaluation of the latter

"Doing Geography": Evaluating an Independent Geographic Inquiry Assessment Task in an Initial Teacher Education Program

Science.gov (United States)

Harte, Wendy; Reitano, Paul

2016-01-01

The assessment task of the final course in a bachelor of secondary education program is examined for opportunities for preservice geography teachers to achieve the course aims of integrating, consolidating, applying, and reflecting on the knowledge and skills they have learned during their initial teacher education program. The results show that…

Limited economic evaluation to assess the effectiveness of a university-wide office ergonomics program.

Science.gov (United States)

Bidassie, Balmatee; McGlothlin, James D; Goh, Alina; Feyen, Robert G; Barany, James W

2010-05-01

The objective of this research was to evaluate the effectiveness and provide a limited economic evaluation of an office ergonomics program at a major university from 1995 to 2007. The relationship between office-related recordable injuries, reported lost time, severity of these injuries, and the Workers' Compensation (WC) paid was analyzed and the corresponding incident cost was calculated. Two major datasets analyzed were OSHA 200/300 logs (1991-2007) and WC claims paid (1999-2007). Since the beginning of the office ergonomics program in 1995 and through 2007 (13-year period), the number of office cumulative trauma disorder (CTD) cases decreased by 53%. Since the official start (in 1999) of a 50-50 cost share agreement for office equipment purchases between the university's Safety and Health Department (SHD) and the university departments evaluated, it was observed that the incident rate decreased by 63%, Total Days Away/restrict or Transfer (DART) rate decreased by 41%, Lost Time Case (LTC) rate decreased by 71% and office-related carpal tunnel syndrome decreased by almost 50%. The long-term goal of this research is to demonstrate the self-sustainability of an office ergonomics program by showing that equipment costs are eventually offset by a decrease in WC claims paid and lost time from office-related injuries and illnesses. While limited, this research helps in cost-justifying the implementation of future office ergonomics programs for large organizations. Copyright (c) 2009 Elsevier Ltd. All rights reserved.

Program to assess the effects of extraordinary environments on radioactive material shipping systems

International Nuclear Information System (INIS)

Sandoval, R.P.; Reese, R.T.

1980-01-01

The highlights of the Transportation System Safety Evaluation (TSSE) Program at Sandia National Laboratories are reviewed and the origins of the program and the relationships to other programs addressing safety concerns are outlined. The areas of current activity in the assessment of possible effects an intentional act or extreme environment could have on nuclear material shipping systems are described. Early information has been obtained on the formation of aerosols, and a significant body of experimentally determined source term data will be available for radiological consequence evaluations

An evaluation of the nursing success program: reading comprehension, graduation rates, and diversity.

Science.gov (United States)

Symes, Lene; Tart, Kathryn; Travis, Lucille

2005-01-01

The Nursing Success Program was developed to enhance retention of baccalaureate nursing students. Reading comprehension scores are used to identify students who are at risk for failure and direct them into the retention program that addresses their skill deficits. To evaluate the program, the authors assessed reading comprehension, graduation rates, and ethnic diversity.

Psychological Assessment Training in Clinical Psychology Doctoral Programs.

Science.gov (United States)

Mihura, Joni L; Roy, Manali; Graceffo, Robert A

2017-01-01

We surveyed American Psychological Association-accredited clinical psychology doctoral programs' (n = 83) training in psychological assessment-specifically, their coverage of various assessment topics and tests in courses and practica, and whether the training was optional or required. We report results overall and separately per training model (clinical science, scientist-practitioner, and practitioner-focused). Overall, our results suggest that psychological assessment training is as active, or even more active, than in previous years. Areas of increased emphasis include clinical interviewing and psychometrics; multimethod, outcomes, health, and collaborative or therapeutic assessment; and different types of cognitive and self-report personality tests. All or almost all practice-focused programs offered training with the Thematic Apperception Test and Rorschach compared to about half of the scientist-practitioner programs and a third of the clinical science programs. Although almost all programs reported teaching multimethod assessment, what constitutes different methods of assessing psychopathology should be clarified in future studies because many programs appear to rely on one method-self-report (especially clinical science programs). Although doctoral programs covered many assessment topics and tests in didactic courses, there appears to be a shortage of program-run opportunities for students to obtain applied assessment training. Finally, we encourage doctoral programs to be familiar with (a) internships' assessment expectations and opportunities, (b) the professional guidelines for assessment training, and (c) the American Psychological Association's requirements for preinternship assessment competencies.

Methodology for value/impact assessment of nuclear regulatory research programs

International Nuclear Information System (INIS)

Carlson, D.D.

1978-12-01

A methodology for conducting a value/impact assessment of research programs has been developed to provide the Nuclear Regulatory Commission (NRC) an improved capability for allocating resources for confirmatory research. This report presents a seven-step evaluation process and applies it to selected units of research. The methodology is intended to provide insight into the technical merits of the programs, one dimension of the complex problem of resource allocation for confirmatory research

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Programmatic Environmental Scans: A Survey Based on Program Planning and Evaluation Concepts

Directory of Open Access Journals (Sweden)

Donna J. Peterson

2015-10-01

Full Text Available Within Extension, environmental scans are most commonly used to assess community or organizational issues or for strategic planning purposes. However, Extension has expanded the use of environmental scans to systematically identify “what programs exist” on a given topic or focus area. Yet, despite recent attention to the topic of environmental scanning in Extension, survey instruments used to conduct environmental scans have not been published. Given the emphasis on implementation of evidence-based practices and programs, having a ready-made survey that can be used to identify programs on a specific topic and that could subsequently lead to an evaluability assessment of those programs would be a useful resource. To encourage the use of environmental scans to identify existing evidence-based programs, this article describes a survey instrument developed for the purpose of scanning for 4-H Healthy Living programs ready for rigorous outcome evaluation and/or national replication. It focuses on the rationale for survey items, as well as provides a summary and definition of those items. The survey tool can be easily adapted for future programmatic environmental scans both within and outside Extension.

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Risk assessment of medical devices: evaluation of microbiological and toxicological safety

International Nuclear Information System (INIS)

Dorpema, J.W.

1995-01-01

Safety assessment of medical devices includes sterilization and biological evaluation or biocompatability testing. Sterilization by ETO gas is criticised for their carcinogenic potency or even banned. Mutual acceptance of biological evaluation test results is promoted by a laboratory accreditation and qualification program. (Author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

A prospective study assessing agreement and reliability of a geriatric evaluation

OpenAIRE

Locatelli, Isabella; Monod, St?fanie; Cornuz, Jacques; B?la, Christophe J.; Senn, Nicolas

2017-01-01

Background The present study takes place within a geriatric program, aiming at improving the diagnosis and management of geriatric syndromes in primary care. Within this program it was of prime importance to be able to rely on a robust and reproducible geriatric consultation to use as a gold standard for evaluating a primary care brief assessment tool. The specific objective of the present study was thus assessing the agreement and reliability of a comprehensive geriatric consultation. Method...

[Resident evaluation of general surgery training programs].

Science.gov (United States)

Espinoza G, Ricardo; Danilla E, Stefan; Valdés G, Fabio; San Francisco R, Ignacio; Llanos L, Osvaldo

2009-07-01

The profile of the general surgeon has changed, aiming to incorporate new skills and to develop new specialties. To assess the quality of postgraduate General Surgery training programs given by Chilean universities, the satisfaction of students and their preferences after finishing the training period. A survey with multiple choice and Likert type questions was designed and applied to 77 surgery residents, corresponding to 59% of all residents of general surgery specialization programs of Chilean universities. Fifty five per cent of residents financed with their own resources the specialization program. Thirty nine percent disagreed partially or totally with the objectives and rotations of programs. The opportunity to perform surgical interventions and the support by teachers was well evaluated. However, 23% revealed teacher maltreatment. Fifty six percent performed research activities, 73% expected to continue training in a derived specialty and 69% was satisfied with the training program. Residents considered that the quality and dedication of professors and financing of programs are issues that must be improved. The opportunity to perform surgical interventions, obtaining a salary for their work and teacher support is considered of utmost importance.

The development and evaluation of a program for leg-strengthening exercises and balance assessment using Kinect

OpenAIRE

Choi, Jin-Seung; Kang, Dong-Won; Seo, Jeong-Woo; Kim, Dae-Hyeok; Yang, Seung-Tae; Tack, Gye-Rae

2016-01-01

[Purpose] In this study, a program was developed for leg-strengthening exercises and balance assessment using Microsoft Kinect. [Subjects and Methods] The program consists of three leg-strengthening exercises (knee flexion, hip flexion, and hip extension) and the one-leg standing test (OLST). The program recognizes the correct exercise posture by comparison with the range of motion of the hip and knee joints and provides a number of correct action examples to improve training. The program mea...

Reflections on performance assessment in the Civilian Radioactive Waste Management Program

International Nuclear Information System (INIS)

Fecht, K.R.; Sonnichsen, J.C.; Woods, T.W.

1988-01-01

The national program to develop a high-level waste management system is passing through a period of transition---legislative, political, organizational, and contractual. With the changes that have already occurred and those still under consideration, it is time to examine what ha been done well, in what areas there are now unfulfilled needs in the program, and what improvements might be helpful in the future. The approach and methods with which to assess the performance of the high-level waste management system deserve and enjoy the utmost respect throughout the technical community. Probabilistic risk assessment (PRA) techniques have been conceived, developed and implemented that enable comparative evaluation of various subsystem alternatives, especially geologic media for the repository. This paper argues that the program has need of additional measures of performance important in decision-making processes and suggests additional analytical tools to help assess that performance

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

The IEAGHG Power Plant Assessment Program (PPAP). Development and testing June 2002-October 2005

Energy Technology Data Exchange (ETDEWEB)

NONE

2005-12-15

The Power Plant Assessment Program (PPAP) is an Excel based program which allows alternative CO{sub 2} capture technologies for centralised power generation to be compared using multi-criteria analysis. This report outlines recent development work on the program and the results obtained from evaluating a range of novel capture processes with it.

Process and Outcome Evaluation of an Art Therapy Program for People Living with HIV/AIDS

Science.gov (United States)

Feldman, Matthew B.; Betts, Donna J.; Blausey, Daniel

2014-01-01

Program evaluation offers an opportunity for improving the implementation and impact of art therapy. This article describes a process and outcomes evaluation of an art therapy program within the mental health services unit of a community-based organization for people living with HIV/AIDS. The aims were to assess utilization patterns and program…

Evaluating Value Chain Development Programs: Assessing Effectiveness, Efficiency, and Equity Effects of Contract Choice

NARCIS (Netherlands)

Ruben, R.

2015-01-01

Provides insights regarding the possible procedures for assessing welfare, efficiency, and equity effects of value chain development (VCD) programs, taking advantage of available analytical tools derived from impact analysis, transaction cost theory, and contract choice approaches and briefly

Evaluation of the Super Efficient Refrigerator Program (SERP) in the Bonneville Power Administration service territory

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-06-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. it is one of the first examples of large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the evaluation of SERP ({open_quotes}the Program{close_quotes}) in the Bonneville Power Administration`s (Bonneville`s) service territory. Pacific Northwest National Laboratory (PNNL) conducted this evaluation for Bonneville. This study includes the process evaluation, preliminary impact evaluation, and market transformation assessment. It is based on site visits and interviews with refrigerator dealers and manufacturers, industry data, and Bonneville information. Results from this study are compared with those from a parallel study that examines the Program across the 24 participating utilities.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond’s Checklist: A Narrative Review

Directory of Open Access Journals (Sweden)

Aziz Rezapour

2017-09-01

Full Text Available Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond’s checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles’ structure was analyzed by Drummond’s standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond’s criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Evaluating a Nutrition Education Program for Pregnant Teen-Agers: Cognitive vs. Behavioral Outcomes.

Science.gov (United States)

Perkin, Judy

1983-01-01

A manual on nutrition during pregnancy and lactation was developed and used with pregnant teenagers. Evaluation of the program showed that, while participants' knowledge of nutrition improved, their eating habits did not. The need for behavioral assessment of nutrition education programs is pointed out. (Author/PP)

State Program Integrity Assessment (SPIA)

Data.gov (United States)

U.S. Department of Health & Human Services — The State Program Integrity Assessment (SPIA) is the Centers for Medicare and Medicaid Services (CMS) first national data collection on state Medicaid program...

Evaluation of a preschool nutrition education program based on the theory of multiple intelligences.

Science.gov (United States)

Cason, K L

2001-01-01

This report describes the evaluation of a preschool nutrition education program based on the theory of multiple intelligences. Forty-six nutrition educators provided a series of 12 lessons to 6102 preschool-age children. The program was evaluated using a pretest/post-test design to assess differences in fruit and vegetable identification, healthy snack choices, willingness to taste foods, and eating behaviors. Subjects showed significant improvement in food identification and recognition, healthy snack identification, willingness to taste foods, and frequency of fruit, vegetable, meat, and dairy consumption. The evaluation indicates that the program was an effective approach for educating preschool children about nutrition.

Evaluating Psychiatry Residents as Physician-Managers: Development of an Assessment Tool

Science.gov (United States)

Sockalingam, Sanjeev; Stergiopoulos, Vicky; Maggi, Julie D.; Zaretsky, Ari; Stovel, Laura; Hodges, Brian

2013-01-01

Objectives: With the emergence of physician-manager (PM) curricula in medical education, more effective assessment tools are needed to evaluate psychiatry trainees in this role. The aim of this study was to determine psychiatry residents', program directors', and PM educators' perceptions about PM role-assessment. Methods: Psychiatry residents at…

Process evaluation of a school-based weight gain prevention program: the Dutch Obesity Intervention in Teenagers (DOiT)

NARCIS (Netherlands)

Singh, A.S.; Chin A Paw, J.M.M.; Brug, J.; Mechelen, van W.

2009-01-01

Health promotion programs benefit from an accompanying process evaluation since it can provide more insight in the strengths and weaknesses of a program. A process evaluation was conducted to assess the reach, implementation, satisfaction and maintenance of a school-based program aimed at the

Seismic safety margin assessment program (Annual safety research report, JFY 2010)

International Nuclear Information System (INIS)

Suzuki, Kenichi; Iijima, Toru; Inagaki, Masakatsu; Taoka, Hideto; Hidaka, Shinjiro

2011-01-01

Seismic capacity test data, analysis method and evaluation code provided by Seismic Safety Margin Assessment Program have been utilized for the support of seismic back-check evaluation of existing plants. The summary of the program in 2010 is as follows. 1. Component seismic capacity test and quantitative seismic capacity evaluation. Many seismic capacity tests of various snubbers were conducted and quantitative seismic capacities were evaluated. One of the emergency diesel generator partial-model seismic capacity tests was conducted and quantitative seismic capacity was evaluated. Some of the analytical evaluations of piping-system seismic capacities were conducted. 2. Analysis method for minute evaluation of component seismic response. The difference of seismic response of large components such as primary containment vessel and reactor pressure vessel when they were coupled with 3-dimensional FEM building model or 1-dimensional lumped mass building model, was quantitatively evaluated. 3. Evaluation code for quantitative evaluation of seismic safety margin of systems, structures and components. As the example, quantitative evaluation of seismic safety margin of systems, structures and components were conducted for the reference plant. (author)

Gendered Citizenship and the Individualization of Environmental Responsibility: Evaluating a Campus Common Reading Program

Science.gov (United States)

Kennedy, Emily Huddart; Boyd, Amanda

2018-01-01

Campus common reading programs are intended to stimulate critical thinking and dialogue across disciplines yet scarce evidence exists to evaluate the success of such programs. We assess the extent to which engagement in an environmentally-themed common reading program is related to (1) concern for waste-related issues, (2) beliefs that addressing…

CHOOZ-A expert assessment program

International Nuclear Information System (INIS)

Bouat, M.; Godin, R.

1993-01-01

CHOOZ-A Nuclear Power Plant, the first French-Belgian PWR unit (300 MWe) was definitively shut down at the end of October 1991, after 24 years in operation. Since summer 1991, the steering committee of the French (EDF) Lifetime Project has initiated a large inquiry to the different technical specialists of EDF and external organizations, trying to define a wide expert assessment program on this plant. The aim is to improve the knowledge of aging mechanisms such as those observed on the 52 PWR French nuclear power plants (900 and 1,300 MWe), and contribute to the validation of non-destructive in-service testing methods. This paper presents the retained CHOOZ-A expert assessment program and technical lines followed during its set up. First major project stages are described, then technical choices are explained, and at last the final program is presented with the specific content of each expert assessment. The definitive program is scheduled for a three year period starting at the moment of final shutdown license acquisition, with a provisional total budget of more than US $10 million

Efficiency evaluation of grant policy in sport by principles of program financing

Directory of Open Access Journals (Sweden)

Vladimír Hobza

2010-03-01

Full Text Available The paper concerns with mutual interconnection of goals of municipal development concepts and methods of their assessment. Based on grant policy of selected municipalities (regions, communities and on the principles of program financing, a specific method of evaluation performance is suggested, which enables to evaluate closer control of sport development, visions, proclaimed goals and sport support programs. The principle of the proposed procedure is based on the use of indicators and methods: CEA, CBA, CUA and CMA in program financing of sport - a field where it is not possible to calculate only direct economic results but it is necessary to consider the impact of externalities (benefits. The authors suggest procedures, which lead to a higher level of control, transparency and efficiency of public spending in the municipal sphere. The goal of this contribution is to point out possible means of assessing grant proposals, as a support tool for decision-making and subsequent control.

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

Science.gov (United States)

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

Use of an Integrated Pest Management Assessment Administered through Turningpoint as an Educational, Needs Assessment, and Evaluation Tool

Science.gov (United States)

Stahl, Lizabeth A. B.; Behnken, Lisa M.; Breitenbach, Fritz R.; Miller, Ryan P.; Nicolai, David; Gunsolus, Jeffrey L.

2016-01-01

University of Minnesota educators use an integrated pest management (IPM) survey conducted during private pesticide applicator training as an educational, needs assessment, and evaluation tool. By incorporating the IPM Assessment, as the survey is called, into a widely attended program and using TurningPoint audience response devices, Extension…

Development of engineering program for integrity evaluation of pipes with local wall thinned defects

International Nuclear Information System (INIS)

Park, Chi Yong; Lee, Sung Ho; Kim, Tae Ryong; Park, Sang Kyu

2008-01-01

Integrity evaluation of pipes with local wall thinning by erosion and corrosion is increasingly important in maintenance of wall thinned carbon steel pipes in nuclear power plants. Though a few program for integrity assessment of wall thinned pipes have been developed in domestic nuclear field, however those are limited to straight pipes and methodology proposed in ASME Sec.XI Code Case N-597. Recently, the engineering program for integrity evaluation of pipes with all kinds of local wall defects such as straight, elbow, reducer and branch pipes was developed successfully. The program was designated as PiTEP (Pipe Thinning Evaluation Program), which name was registered as a trademark in the Korea Intellectual Property Office. A developed program is carried out by sequential step of four integrity evaluation methodologies, which are composed of construction code, code case N-597, its engineering method and two developed owner evaluation method. As PiTEP program will be performed through GUI (Graphic User Interface) with user's familiarity, it would be conveniently used by plant engineers with only measured thickness data, basic operation conditions and pipe data

Evaluation of the effectiveness of a school-based cannabis prevention program.

Science.gov (United States)

Ariza, Carles; Pérez, Anna; Sánchez-Martínez, Francesca; Diéguez, Marta; Espelt, Albert; Pasarín, M Isabel; Suelves, Josep M; De la Torre, Rafael; Nebot, Manuel

2013-09-01

The effectiveness of a cannabis prevention program in high school students was assessed. A quasi-experimental study was designed to evaluate the effectiveness of an intervention implemented in an intervention group (IG) with 39 schools compared with a control group (CG) of 47 schools not exposed to the intervention. Of 224 secondary schools in Barcelona, 86 were assessed in the 2005-2006 school year through a personal questionnaire administered at baseline and 15 months after the intervention. Participants consisted of 4848 ninth graders (14-15 year-olds), 2803 assigned to the IG and 2043 to the CG, according to the type and size of the school and the socioeconomic status of the school's neighborhood. The intervention consisted of a school-based cannabis prevention program (xkpts.com), with four sessions and 16 activities, implemented over 6-10h, with materials for parents and web-based student involvement. Last-month cannabis use was assessed at baseline and at 15 months' follow-up. Process evaluation indicators were assessed. At 15 months follow-up, 8.2% of boys and 8.3% of girls in the IG became last-month cannabis users versus 11.8% of boys and 11.6% of girls in the CG. These differences were statistically significant (p=0.003), representing a 29% reduction in last-month cannabis users in the IG compared with the CG. The incidence of last-month cannabis use was lowest in classrooms that adhered to the program protocol. The xkpts.com program was effective in preventing progression to last-month cannabis use. Effectiveness was higher in classrooms that adhered closely to the protocol. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Systematic evaluation program. Status report and initial evaluation

International Nuclear Information System (INIS)

1983-06-01

The MHB Ongoing Systematic Evaluation Program (SEP) Assessment Study was initiated by the Swedish Nuclear Power Inspectorate (SKI) in 1980. This MHB report is a status report and initial evaluation of SEP. The methodology and results of SEP are disscused with particular emphasis on the first two SEP plant reviews - the Palisades and R.E. Ginna nuclear power plants. The comments of cognizant persons in the NRC and the ACRS, as well as private consultants, are included herein. MHBs major findings are as follows: The SEP plant review methodology was acceptable to the NRC Commissioners, the ACRS, and the NRC Staffs consultants who evaluated the first two SEP plant reviews. A concern raised by all who commented on SEP was the absence of Three Mile Island Action Plan Items and Unresolved Safety Issues from current SEP reviews. The SEP reviews of the Palisades and R.E. Ginna plants concluded that the two plant designs were adequate with respect to a majority of safety topics. Several topics remain unresolved in both the Palisades and R.E. Ginna SEP reviews. In the case of the Ginna plant, several related topics have been grouped together in a major structural reevaluation study. In general, due to the number of unresolved and excluded topics, SEP has not at this time produced a plant safety evaluation which can be considered complete and integrated. (author)

Assessing change in perceived community leadership readiness in the Obesity Prevention and Lifestyle program.

Science.gov (United States)

Kostadinov, Iordan; Daniel, Mark; Jones, Michelle; Cargo, Margaret

2016-02-01

Issue addressed The context of community-based childhood obesity prevention programs can influence the effects of these intervention programs. Leadership readiness for community mobilisation for childhood obesity prevention is one such contextual factor. This study assessed perceived community leadership readiness (PCLR) at two time points in a state-wide, multisite community-based childhood obesity prevention program. Methods PCLR was assessed across 168 suburbs of 20 intervention communities participating in South Australia's Obesity Prevention and Lifestyle (OPAL) program. Using a validated online PCLR tool, four key respondents from each community rated each suburb within their respective community on a nine-point scale for baseline and 2015. Average PCLR and change scores were calculated using the general linear model with suburbs nested in communities. Relationships between demographic variables and change in PCLR were evaluated using multiple regression. Ease of survey use was also assessed. Results Average PCLR increased between baseline (3.51, s.d.=0.82) and 2015 (5.23, s.d.=0.89). PCLR rose in 18 of 20 intervention communities. PCLR was inversely associated with suburb population size (r 2 =0.03, P=0.03, β=-0.25) and positively associated with intervention duration (r 2 change=0.08, P=0.00, β=0.29). Only 8% of survey respondents considered the online assessment tool difficult to use. Conclusions PCLR increased over the course of the OPAL intervention. PCLR varied between and within communities. Online assessment of PCLR has utility for multisite program evaluations. So what? Use of a novel, resource-efficient online tool to measure the key contextual factors of PCLR has enabled a better understanding of the success and generalisability of the OPAL program.

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Materials balance area Custodian Performance Evaluation Program at PNL

International Nuclear Information System (INIS)

Dickman, D.A.

1991-07-01

The material balance area (MBA) custodian has primary responsibility for control and accountability of nuclear material within an MBA. In this role, the custodian operates as an extension of the facility material control and accountability (MC ampersand A) organization. To effectively meet administrative requirements and protection needs, the custodian must be fully trained in all aspects of MC ampersand A related to the MBA, and custodian performance must be periodically evaluated. DOE Policy requires that each facility provide for a program which assures that each facility provide for a program which assures that personnel performing MC ampersand A functions are (1) trained and/or qualified to perform their duties and responsibilities and (2) knowledgeable of requirements and procedures related to their functions. The MBA Custodian Performance Evaluation Program at PNL uses a variety of assessment techniques to meet this goal, including internal and independent MBA audits, periodic custodian testing, conduct of limited scope performance tests, daily monitoring of MC ampersand A documentation, and reviewing custodian performance during physical inventories. The data collected from these sources is analyzed and incorporated into an annual custodian performance evaluation document, given to each custodian and line management. Development of this program has resulted in significantly improved custodian performance and a marked decrease in finding and observations identified during MBA audits

Using the Program Sustainability Assessment Tool to Assess and Plan for Sustainability

Science.gov (United States)

Mainor, Avia; Moreland-Russell, Sarah; Maier, Ryan C.; Brossart, Laura; Luke, Douglas A.

2014-01-01

Implementing and growing a public health program that benefits society takes considerable time and effort. To ensure that positive outcomes are maintained over time, program managers and stakeholders should plan and implement activities to build sustainability capacity within their programs. We describe a 3-part sustainability planning process that programs can follow to build their sustainability capacity. First, program staff and stakeholders take the Program Sustainability Assessment Tool to measure their program’s sustainability across 8 domains. Next, managers and stakeholders use results from the assessment to inform and prioritize sustainability action planning. Lastly, staff members implement the plan and keep track of progress toward their sustainability goals. Through this process, staff can more holistically address the internal and external challenges and pressures associated with sustaining a program. We include a case example of a chronic disease program that completed the Program Sustainability Assessment Tool and engaged in program sustainability planning. PMID:24456644

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

A Retrospective Self-Assessment of the SURFO Summer Internship Program in Oceanography

Science.gov (United States)

Pockalny, R. A.; Donohue, K. A.; Fliegler, J.

2009-12-01

The Summer Undergraduate Research Fellowships in Oceanography (SURFO) program at the Graduate School of Oceanography/University of Rhode Island is an NSF-funded Research Experience for Undergraduates site program with a programmatic research niche focused on quantitative aspects of Oceanography. Each summer-cohort includes 9-12 participants (rising seniors) who are paired with a primary research advisor and often with a graduate student mentor. The primary components of the 10-week program include a 4-week introductory phase and a 6-week core research phase. A retrospective self-assessment instrument gauged the confidence, attitude and comfort level of participants with; 1) core math and science subjects, 2) oceanography-related subjects, 3) research skills, and 4) SURFO and GSO staff. SURFO participants evaluated themselves at the start of the program, after the introductory phase, and at the end of the program. Participants were also asked to reassess their initial evaluations and provide an updated score. The pre-assessment results indicate that the program recruits students from the target group (e.g., strong physics and math backgrounds, but with limited exposure to oceanography). The results also indicate that the students are initially comfortable with their advising team, but not so comfortable with their research topic and research skills. The post-introductory phase results indicate large increases in comfort level with the advising team and the local research community yet little or no change is indicated for research skills. The final assessments show large changes in oceanography-content knowledge, research topic, and research skills. The retrospective reassessment indicates an initial overconfidence in most categories. Overall, the largest changes occurred during the core research portion of the program. These results reinforce the importance/effectiveness of authentic, hands-on, inquiry-based research for higher learning and training the next

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Translating Theory Into Practice: Implementing a Program of Assessment.

Science.gov (United States)

Hauer, Karen E; O'Sullivan, Patricia S; Fitzhenry, Kristen; Boscardin, Christy

2018-03-01

A program of assessment addresses challenges in learner assessment using a centrally planned, coordinated approach that emphasizes assessment for learning. This report describes the steps taken to implement a program of assessment framework within a medical school. A literature review on best practices in assessment highlighted six principles that guided implementation of the program of assessment in 2016-2017: (1) a centrally coordinated plan for assessment aligns with and supports a curricular vision; (2) multiple assessment tools used longitudinally generate multiple data points; (3) learners require ready access to information-rich feedback to promote reflection and informed self-assessment; (4) mentoring is essential to facilitate effective data use for reflection and learning planning; (5) the program of assessment fosters self-regulated learning behaviors; and (6) expert groups make summative decisions about grades and readiness for advancement. Implementation incorporated stakeholder engagement, use of multiple assessment tools, design of a coaching program, and creation of a learner performance dashboard. The assessment team monitors adherence to principles defining the program of assessment and gathers and responds to regular feedback from key stakeholders, including faculty, staff, and students. Next steps include systematically collecting evidence for validity of individual assessments and the program overall. Iterative review of student performance data informs curricular improvements. The program of assessment also highlights technology needs that will be addressed with information technology experts. The outcome ultimately will entail showing evidence of validity that the program produces physicians who engage in lifelong learning and provide high-quality patient care.

Radiology education. The evaluation and assessment of clinical competence

International Nuclear Information System (INIS)

Hibbert, Kathryn M.; Van Deven, Teresa; Chhem, Rethy K.; Nagasaki Univ.; Wang, Shih-chang; Royal Australian and New Zealand College of Radiologists, Sydney

2012-01-01

Third volume of a trilogy devoted to radiology education and improvement of medical imaging students' learning, teaching, and scholarship. Reviews the philosophies, theories, and principles that underpin assessment and evaluation in radiology education. Includes a series of rich case studies. Written by an international group of experienced educators and medical professionals. This book reviews the philosophies, theories, and principles that underpin assessment and evaluation in radiology education, highlighting emerging practices and work done in the field. The sometimes conflicting assessment and evaluation needs of accreditation bodies, academic programs, trainees, and patients are carefully considered. The final section of the book examines assessment and evaluation in practice, through the development of rich case studies reflecting the implementation of a variety of approaches. This is the third book in a trilogy devoted to the scholarship of radiology education and is the culmination of an important initiative to improve medical imaging students' learning, teaching, and scholarship by bringing together experienced educators and medical professionals. The previous two books focused on the culture and the learning organizations in which our future radiologists are educated and on the application of educational principles in the education of radiologists. Here, the trilogy comes full circle: attending to the assessment and evaluation of the education of its members has much to offer back to the learning of the organization.

Fatality Assessment and Control Evaluation (FACE) Program

Data.gov (United States)

U.S. Department of Health & Human Services — Each day, between 12 to 13 U.S. workers die as a result of a traumatic injury on the job. Investigations conducted through the FACE program allow the identification...

Assessing the New Competencies for Resident Education: A Model from an Emergency Medicine Program.

Science.gov (United States)

Reisdorff, Earl J.; Hayes, Oliver W.; Carlson, Dale J.; Walker, Gregory L.

2001-01-01

Based on the experience of Michigan State University's emergency medicine residency program, proposes a practical method for modifying an existing student evaluation format. The model provides a template other programs could use in assessing residents' acquisition of the knowledge, skills, and attitudes reflected in the six general competencies…

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 1

Science.gov (United States)

Greenburg, J. S.; Gaelick, C.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

Commercial organizations as well as government agencies invest in spacecraft (S/C) technology programs that are aimed at increasing the performance of communications satellites. The value of these programs must be measured in terms of their impacts on the financial performane of the business ventures that may ultimately utilize the communications satellites. An economic evaluation and planning capability was developed and used to assess the impact of NASA on-orbit propulsion and space power programs on typical fixed satellite service (FSS) and direct broadcast service (DBS) communications satellite business ventures. Typical FSS and DBS spin and three-axis stabilized spacecraft were configured in the absence of NASA technology programs. These spacecraft were reconfigured taking into account the anticipated results of NASA specified on-orbit propulsion and space power programs. In general, the NASA technology programs resulted in spacecraft with increased capability. The developed methodology for assessing the value of spacecraft technology programs in terms of their impact on the financial performance of communication satellite business ventures is described. Results of the assessment of NASA specified on-orbit propulsion and space power technology programs are presented for typical FSS and DBS business ventures.

Formative Evaluation of the ACSC Distance Learning Program: A Status Study.

Science.gov (United States)

MacCuish, Donald A.

2001-01-01

Describes a formative evaluation of the Air Command and Staff College (ACSC) distance learning program, which offers professional military education (PME). Highlights include use of the status study methodology; curriculum development; course design; learning theories; instructional systems design; best practices; and student assessment. (LRW)

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

Science.gov (United States)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

Science.gov (United States)

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across

Applying Matched Sampling to Evaluate a University Tutoring Program for First-Year Students

Science.gov (United States)

Walvoord, Mark E.; Pleitz, Jacob D.

2016-01-01

Our study used a case-control matching design to assess the influence of a voluntary tutoring program in improving first-year students' Grade Point Averages (GPA). To evaluate program effectiveness, we applied case-control matching to obtain 215 pairs of students with or without participation in tutoring, but matched on high school GPA and…

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

Oak Ridge National Laboratory Embrittlement Data Base (EDB) and Dosimetry Evaluation (DE) program

International Nuclear Information System (INIS)

Pace, J.V. III; Remec, I.; Wang, J.A.; White, J.E.

1996-01-01

The objective of this program is to develop, maintain, and upgrade computerized data bases, calculational procedures, and standards relating to reactor pressure vessel fluence spectra determinations and embrittlement assessments. As part of this program, the information from radiation embrittlement research on nuclear reactor pressure vessel steels and from power reactor surveillance reports is maintained in a data base published on a periodic basis. The Embrittlement Data Base (EDB) effort consists of verifying the quality of the EDB, providing user-friendly software to access and process the data, and exploring and assessing embrittlement prediction models. The Dosimetry Evaluation effort consists of maintaining and upgrading validated neutron and gamma radiation transport procedures, maintaining cross-section libraries with the latest evaluated nuclear data, and maintaining and updating validated dosimetry procedures and data bases. The information available from this program provides data for assisting the Office of Nuclear Reactor Regulation, with support from the Office of Nuclear Regulatory Research, to effectively monitor current procedures and data bases used by vendors, utilities, and service laboratories in the pressure vessel irradiation surveillance program

Assessing the representativeness of wind data for wind turbine site evaluation

Science.gov (United States)

Renne, D. S.; Corotis, R. B.

1982-01-01

Once potential wind turbine sites (either for single installations or clusters) are identified through siting procedures, actual evaluation of the sites must commence. This evaluation is needed to obtain estimates of wind turbine performance and to identify hazards to the machine from the turbulence component of the atmosphere. These estimates allow for more detailed project planning and for preliminary financing arrangements to be secured. The site evaluation process can occur in two stages: (1) utilizing existing nearby data, and (2) establishing and monitoring an onsite measurement program. Since step (2) requires a period of at least 1 yr or more from the time a potential site has been identified, step (1) is often an essential stage in the preliminary evaluation process. Both the methods that have been developed and the unknowns that still exist in assessing the representativeness of available data to a nearby wind turbine site are discussed. How the assessment of the representativeness of available data can be used to develop a more effective onsite meteorological measurement program is also discussed.

The radiation safety self-assessment program of Ontario Hydro

International Nuclear Information System (INIS)

Armitage, G.; Chase, W.J.

1987-01-01

Ontario Hydro has developed a self-assessment program to ensure that high quality in its radiation safety program is maintained. The self-assessment program has three major components: routine ongoing assessment, accident/incident investigation, and detailed assessments of particular radiation safety subsystems or of the total radiation safety program. The operation of each of these components is described

Interim Reliability Evaluation Program procedures guide

International Nuclear Information System (INIS)

Carlson, D.D.; Gallup, D.R.; Kolaczkowski, A.M.; Kolb, G.J.; Stack, D.W.; Lofgren, E.; Horton, W.H.; Lobner, P.R.

1983-01-01

This document presents procedures for conducting analyses of a scope similar to those performed in Phase II of the Interim Reliability Evaluation Program (IREP). It documents the current state of the art in performing the plant systems analysis portion of a probabilistic risk assessment. Insights gained into managing such an analysis are discussed. Step-by-step procedures and methodological guidance constitute the major portion of the document. While not to be viewed as a cookbook, the procedures set forth the principal steps in performing an IREP analysis. Guidance for resolving the problems encountered in previous analyses is offered. Numerous examples and representative products from previous analyses clarify the discussion

Youth Can! Grow Healthy: A Formative Evaluation of a Positive Youth Development Program

Directory of Open Access Journals (Sweden)

Andrew Carberry

2013-06-01

Full Text Available This paper presents a formative evaluation of an afterschool program that combined positive youth development and school garden curricula. Novel approaches were used to teach elementary school children about gardening and nutrition, and to engage them in advocacy for healthy community physical activity and nutrition environments. The youth development curriculum included sessions on team building, community pride, healthy eating, physical activity, and advocacy. Photovoice methods were used to allow participants to assess their community and communicate findings with community leaders. The school garden curriculum included nutrition and gardening lessons. Formative evaluation was conducted for each session. Themes of the evaluation were: successful methods for engaging youth, issues in the social environment, and implications for program management. Evaluation results are discussed in relationship to relevant youth development literature to provide recommendations that will strengthen future programs.

Tactical Vulnerability Assessment Training Program

International Nuclear Information System (INIS)

Al-Ayat, R.A.; Judd, B.R.; Renis, T.A.; Paulus, W.K.; Winblad, A.G.; Graves, B.R.

1987-01-01

The Department of Energy sponsors a 9-day training program for individuals who are responsible for evaluating and planning safeguards systems and for preparing DOE Master and Security Agreements (MSSAs). These agreements between DOE headquarters and operations offices establish required levels of protection. The curriculum includes: (1) the nature of potential insider and outsider threats involving theft or diversion of special nuclear material, (2) use of computerized tools for evaluating the effectiveness of physical protection and material control and accountability systems, and (3) methods for analyzing the benefits and costs of safeguards improvements and for setting priorities among proposed upgrades. The training program is varied and high interactive. Presentations are intermixed with class discussions and ''hands-on'' analysis using computer tools. At the end of the program, participants demonstrate what they have learned in a two-and-one-half day ''field exercise,'' which is conducted on a facility scale-model. The training program has been conducted six times and has been attended by representatives of all DOE facilities. Additional sessions are planned at four-month intervals. This paper describes the training program, use of the tools in preparing MSSAs for various DOE sites, and recent extensions and refinements of the evaluation tools

Tactical Vulnerability Assessment Training Program

International Nuclear Information System (INIS)

Al-Ayat, R.A.; Judd, B.R.; Renis, T.A.; Paulus, W.K.; Winblad, A.E.; Graves, B.R.

1987-01-01

The Department of Energy sponsors a 9-day training program for individual who are responsible for evaluating and planning safeguards systems and for preparing DOE Master and Security Agreements (MSSAs). These agreements between DOE headquarters and operations offices establish required levels of protection. The curriculum includes: (1) the nature of potential insider and outsider threats involving theft or diversion of special nuclear material, (2) use of computerized tools for evaluating the effectiveness of physical protection and material control and acoountability systems, and (3) methods for analyzing the benefits and costs of safeguards improvements and for setting priorities among proposed upgrades. The training program is varied and highly interactive. Presentations are intermixed with class discussions and ''hands-on'' analysis using computer tools. At the end of the program, participants demonstrate what they have learned in a two-and-one-half day ''field excercise,'' which is conducted on a facility scale-model. The training programs has been conducted six times and has been attended by representatives of all DOE facilities. Additional sessions are planned at four-month intervals. This paper describes the training program, use of the tools in preparing MSSAs for various DOE sites, and recent extensions and refinements of the evaluation tools

The efficacy of stuttering measurement training: evaluating two training programs.

Science.gov (United States)

Bainbridge, Lauren A; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J

2015-04-01

Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of stuttering events on eight 3-min audiovisual speech samples from adults and children who stutter. Stuttering judgment training involved use of either the Stuttering Measurement System (SMS), Stuttering Measurement Assessment and Training (SMAAT) programs, or no training. To test for the reliability of any training effect, SMS training was repeated with the 4th group. Both SMS-trained groups produced approximately 34% improvement, significantly better than no training or the SMAAT program. The SMAAT program produced a mixed result. The SMS program was shown to produce a "medium" effect size improvement in the accuracy of stuttering event counts, and this improvement was almost perfectly replicated in a 2nd group. Half of the SMAAT judges produced a 36% improvement in accuracy, but the other half showed no improvement. Additional studies are needed to demonstrate the durability of the reported improvements, but these positive effects justify the importance of stuttering measurement training.

Savannah River Site peer evaluator standards: Operator assessment for restart

International Nuclear Information System (INIS)

1990-01-01

Savannah River Site has implemented a Peer Evaluator program for the assessment of certified Central Control Room Operators, Central Control Room Supervisors and Shift Technical Engineers prior to restart. This program is modeled after the nuclear Regulatory Commission's (NRC's) Examiner Standard, ES-601, for the requalification of licensed operators in the commercial utility industry. It has been tailored to reflect the unique differences between Savannah River production reactors and commercial power reactors

Using Reflections of Recent Resident Graduates and their Pediatric Colleagues to Evaluate a Residency Program

Directory of Open Access Journals (Sweden)

Robert K. Kamei, M.D.

2003-01-01

Full Text Available Background and Purposes: In response to the new Accreditation Council for Graduate Medical Education (ACGME mandate for residency programs to use feedback to improve its educational program, we piloted a novel evaluation strategy of a residency program using structured interviews of resident graduates working in a primary care practice and their physician associates. Methods: A research assistant performed a structured telephone interview. Quantitative data assessing the graduate’s self-assessment and the graduate’s clinical practice by the associate were analyzed. In addition, we performed a qualitative analysis of the interviews. Results: Thirteen resident graduates in primary care practice and seven physician practice associates participated in the study. Graduate self-assessment revealed high satisfaction with their residency training and competency. The associates judged our graduates as highly competent and mentioned independent decision-making and strong interpersonal skills (such as teamwork and communication as important. They specifically cited the graduate’s skills in intensive care medicine and adolescent medicine as well as communication and teamwork skills as important contributions to their practice. Conclusions: The ACGME Outcomes Project, which increases the emphasis on educational outcomes in the accreditation of residency education programs, requires programs to provide evidence of its effectiveness in preparing residents for practice. Direct assessment of the competency of our physician graduates in practice using structured interviews of graduates and their practice associates provide useful feedback information to a residency program as part of a comprehensive evaluation plan of our program’s curriculum and can be used to direct future educational initiatives of our training program

The Assessment, Development, Assurance Pharmacist's Tool (ADAPT) for ensuring quality implementation of health promotion programs.

Science.gov (United States)

Truong, Hoai-An; Taylor, Catherine R; DiPietro, Natalie A

2012-02-10

To develop and validate the Assessment, Development, Assurance Pharmacist's Tool (ADAPT), an instrument for pharmacists and student pharmacists to use in developing and implementing health promotion programs. The 36-item ADAPT instrument was developed using the framework of public health's 3 core functions (assessment, policy development, and assurance) and 10 essential services. The tool's content and usage was assessed and conducted through peer-review and initial validity testing processes. Over 20 faculty members, preceptors, and student pharmacists at 5 institutions involved in planning and implementing health promotion initiatives reviewed the instrument and conducted validity testing. The instrument took approximately 15 minutes to complete and the findings resulted in changes and improvements to elements of the programs evaluated. The ADAPT instrument fills a need to more effectively plan, develop, implement, and evaluate pharmacist-directed public health programs that are evidence-based, high-quality, and compliant with laws and regulations and facilitates documentation of pharmacists' contributions to public health.

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

Integrative Reiki for cancer patients: a program evaluation.

Science.gov (United States)

Fleisher, Kimberly A; Mackenzie, Elizabeth R; Frankel, Eitan S; Seluzicki, Christina; Casarett, David; Mao, Jun J

2014-01-01

This mixed methods study sought to evaluate the outcomes of an integrative Reiki volunteer program in an academic medical oncology center setting. We used de-identified program evaluation data to perform both quantitative and qualitative analyses of participants' experiences of Reiki sessions. The quantitative data were collected pre- and postsession using a modified version of the distress thermometer. The pre- and postsession data from the distress assessment were analyzed using a paired Student's : test. The qualitative data were derived from written responses to open-ended questions asked after each Reiki session and were analyzed for key words and recurring themes. Of the 213 pre-post surveys of first-time sessions in the evaluation period, we observed a more than 50% decrease in self-reported distress (from 3.80 to 1.55), anxiety (from 4.05 to 1.44), depression (from 2.54 to 1.10), pain (from 2.58 to 1.21), and fatigue (from 4.80 to 2.30) with P Reiki, we found 176 (82.6%) of participants liked the Reiki session, 176 (82.6%) found the Reiki session helpful, 157 (73.7%) plan to continue using Reiki, and 175 (82.2%) would recommend Reiki to others. Qualitative analyses found that individuals reported that Reiki induced relaxation and enhanced spiritual well-being. An integrative Reiki volunteer program shows promise as a component of supportive care for cancer patients. More research is needed to evaluate and understand the impact that Reiki may have for patients, caregivers, and staff whose lives have been affected by cancer.

Defense Acquisitions: Assessments of Selected Weapon Programs

Science.gov (United States)

2017-03-01

Figure 17: Examples of Knowledge Scorecards 61 Page vi GAO-17-333SP Assessments of Selected Weapon Programs...programs. Page 61 GAO-17-333SP Assessments of Selected Weapon Programs Figure 17: Examples of Knowledge Scorecards Pursuant to a...had direct access to the USD AT&L and other senior acquisition officials, and some approval authorities were delegated to lower levels. For example

Pollution prevention opportunity assessment for Sandia National Laboratories/California recycling programs.

Energy Technology Data Exchange (ETDEWEB)

Wrons, Ralph Jordan; Vetter, Douglas Walter

2007-07-01

This Pollution Prevention Opportunity Assessment (PPOA) was conducted for the Sandia National Laboratories/California (SNL/CA) Environmental Management Department between May 2006 and March 2007, to evaluate the current site-wide recycling program for potential opportunities to improve the efficiency of the program. This report contains a summary of the information collected and analyses performed with recommended options for implementation. The SNL/NM Pollution Prevention (P2) staff worked with the SNL/CA P2 Staff to arrive at these options.

Evaluating the effect of a reader worker program on team performance

International Nuclear Information System (INIS)

Hahn, H.A.; Alvarez, Y.P.

1994-01-01

When safety, security, or other logistical concerns prevent direct objective assessment of team performance, other evaluation techniques become necessary. In this paper, the effect of a Department of Energy-mandated reader worker program on team performance at a particular DOE facility was evaluated using unstructured observations, informal discussions with technicians, and human reliability analysis. The reader worker program is intended to enhance nuclear explosive safety by improving the reliability of team performance. The three methods used for the evaluation combine to provide a strong indication that team performance is in fact enhanced by a properly implemented reader worker procedure. Because direct quantitative data on dependent variables particular to the task of interest is not available, however, there has been some skepticism regarding the results by staff at the facility

Office of Academic Assessment provides workshops on the program assessment process

OpenAIRE

Williams, Meghan

2008-01-01

The Office of Academic Assessment is once again providing a series of workshops on the program assessment process during the spring semester. The workshops will offer a wide range of resources to assist faculty and administrators as they focus on teaching and learning in their programs.

Evaluating Student Success and Progress in the Maryland Sea Grant REU Program

Science.gov (United States)

Moser, F. C.; Allen, M. R.; Clark, J.

2012-12-01

The Maryland Sea Grant's Research Experiences for Undergraduate (REU) 12-week summer program is in its 24th year. This estuarine science-focused program has evolved, based in part on our use of assessment tools to measure the program's effectiveness. Our goal is to understand the REU program's effectiveness in such areas as improving student understanding of scientific research, scientific ethics and marine science careers. Initially, our assessment approach was limited to short surveys that used qualitative answers from students about their experience. However, in the last decade we have developed a more comprehensive approach to measure program effectiveness. Currently, we use paired pre- and post-survey questions to estimate student growth during the program. These matching questions evaluate the student's change in knowledge and perception of science research over the course of the summer program. Additionally, we administer several surveys during the 12 weeks of the program to measure immediate responses of students to program activities and to gauge the students' evolving attitudes to customize each year's program. Our 2011 cohort showed consistent improvement in numerous areas, including understanding the nature of science (pre: 4.35, post: 4.64 on a 5 point scale), what graduate school is like (3.71, 4.42), the job of a researcher (4.07, 4.50), and career options in science (3.86, 4.42). Student confidence also increased in numerous skills required for good scientists. To analyze the long-term impact of our program, we survey our alumni to assess graduate degrees earned and career choices. A large percentage (72%) of our tracked alumni have continued on to graduate school, with subsequent careers spanning the academic (51%), public (24%) and private (25%) sectors. These assessments demonstrate that our program is successful in meeting our key objectives of strengthening the training of undergraduates in the sciences and retaining them in marine science

Assessment methods for the evaluation of vitiligo.

Science.gov (United States)

Alghamdi, K M; Kumar, A; Taïeb, A; Ezzedine, K

2012-12-01

There is no standardized method for assessing vitiligo. In this article, we review the literature from 1981 to 2011 on different vitiligo assessment methods. We aim to classify the techniques available for vitiligo assessment as subjective, semi-objective or objective; microscopic or macroscopic; and as based on morphometry or colorimetry. Macroscopic morphological measurements include visual assessment, photography in natural or ultraviolet light, photography with computerized image analysis and tristimulus colorimetry or spectrophotometry. Non-invasive micromorphological methods include confocal laser microscopy (CLM). Subjective methods include clinical evaluation by a dermatologist and a vitiligo disease activity score. Semi-objective methods include the Vitiligo Area Scoring Index (VASI) and point-counting methods. Objective methods include software-based image analysis, tristimulus colorimetry, spectrophotometry and CLM. Morphometry is the measurement of the vitiliginous surface area, whereas colorimetry quantitatively analyses skin colour changes caused by erythema or pigment. Most methods involve morphometry, except for the chromameter method, which assesses colorimetry. Some image analysis software programs can assess both morphometry and colorimetry. The details of these programs (Corel Draw, Image Pro Plus, AutoCad and Photoshop) are discussed in the review. Reflectance confocal microscopy provides real-time images and has great potential for the non-invasive assessment of pigmentary lesions. In conclusion, there is no single best method for assessing vitiligo. This review revealed that VASI, the rule of nine and Wood's lamp are likely to be the best techniques available for assessing the degree of pigmentary lesions and measuring the extent and progression of vitiligo in the clinic and in clinical trials. © 2012 The Authors. Journal of the European Academy of Dermatology and Venereology © 2012 European Academy of Dermatology and Venereology.

A Final Report for the Evaluation of the Achieve3000 Programs

Science.gov (United States)

Shannon, Lisa; Grant, Billie-Jo

2015-01-01

Achieve3000 publishes a number of online literacy programs that differentiate lessons and activities based on student performance. Magnolia Consulting--an independent, third party evaluation firm--assessed Achieve3000 Solutions' impact on student learning during the 2014-15 school year. The researchers used a randomized control trial, where…

Marketing Prior Learning Assessment Programs.

Science.gov (United States)

Heeger, Gerald A.

1983-01-01

Experiential learning programs must be marketed effectively if they are to succeed. The formulation of market strategy is discussed including: strategic planning; identification of a market target; and development of a market mix. A commitment to marketing academic programs is seen as a commitment to self-assessment. (MW)

Interim reliability evaluation program (IREP)

International Nuclear Information System (INIS)

Carlson, D.D.; Murphy, J.A.

1981-01-01

The Interim Reliability Evaluation Program (IREP), sponsored by the Office of Nuclear Regulatory Research of the US Nuclear Regulatory Commission, is currently applying probabilistic risk analysis techniques to two PWR and two BWR type power plants. Emphasis was placed on the systems analysis portion of the risk assessment, as opposed to accident phenomenology or consequence analysis, since the identification of risk significant plant features was of primary interest. Traditional event tree/fault tree modeling was used for the analysis. However, the study involved a more thorough investigation of transient initiators and of support system faults than studies in the past and substantially improved techniques were used to quantify accident sequence frequencies. This study also attempted to quantify the potential for operator recovery actions in the course of each significant accident

Environmental Restoration Program waste minimization and pollution prevention self-assessment

International Nuclear Information System (INIS)

1994-10-01

The Environmental Restoration (ER) Program within Martin Marietta Energy Systems, Inc. is currently developing a more active waste minimization and pollution prevention program. To determine areas of programmatic improvements within the ER Waste Minimization and Pollution Prevention Awareness Program, the ER Program required an evaluation of the program across the Oak Ridge K-25 Site, the Oak Ridge National Laboratory, the Oak Ridge Y-12 Plant, the Paducah Environmental Restoration and Waste Minimization Site, and the Portsmouth Environmental Restoration and Waste Minimization Site. This document presents the status of the overall program as of fourth quarter FY 1994, presents pollution prevention cost avoidance data associated with FY 1994 activities, and identifies areas for improvement. Results of this assessment indicate that the ER Waste Minimization and Pollution Prevention Awareness Program is firmly established and is developing rapidly. Several procedural goals were met in FY 1994 and many of the sites implemented ER waste minimization options. Additional growth is needed, however, for the ER Waste Minimization and Pollution Prevention Awareness Program

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Outcomes Assessment in Dental Hygiene Programs.

Science.gov (United States)

Grimes, Ellen B.

1999-01-01

A survey of 22 dental-hygiene-program directors found that programs routinely and effectively assess student outcomes and use the information for program improvements and to demonstrate accountability. Both policy and faculty/administrative support were deemed important to implementation. Time constraints were a major barrier. Outcomes-assessment…

Improving clinical research and cancer care delivery in community settings: evaluating the NCI community cancer centers program.

Science.gov (United States)

Clauser, Steven B; Johnson, Maureen R; O'Brien, Donna M; Beveridge, Joy M; Fennell, Mary L; Kaluzny, Arnold D

2009-09-26

In this article, we describe the National Cancer Institute (NCI) Community Cancer Centers Program (NCCCP) pilot and the evaluation designed to assess its role, function, and relevance to the NCI's research mission. In doing so, we describe the evolution of and rationale for the NCCCP concept, participating sites' characteristics, its multi-faceted aims to enhance clinical research and quality of care in community settings, and the role of strategic partnerships, both within and outside of the NCCCP network, in achieving program objectives. The evaluation of the NCCCP is conceptualized as a mixed method multi-layered assessment of organizational innovation and performance which includes mapping the evolution of site development as a means of understanding the inter- and intra-organizational change in the pilot, and the application of specific evaluation metrics for assessing the implementation, operations, and performance of the NCCCP pilot. The assessment of the cost of the pilot as an additional means of informing the longer-term feasibility and sustainability of the program is also discussed. The NCCCP is a major systems-level set of organizational innovations to enhance clinical research and care delivery in diverse communities across the United States. Assessment of the extent to which the program achieves its aims will depend on a full understanding of how individual, organizational, and environmental factors align (or fail to align) to achieve these improvements, and at what cost.

Evaluation of an educational program on deciphering heterogeneity for medical coverage decisions.

Science.gov (United States)

Warholak, Terri L; Hilgaertner, Jianhua W; Dean, Joni L; Taylor, Ann M; Hines, Lisa E; Hurwitz, Jason; Brown, Mary; Malone, Daniel C

2014-06-01

It is increasingly important for decision makers, such as medical and pharmacy managers (or pharmacy therapeutics committee members and staff), to understand the variation and diversity in treatment response as decisions shift from an individual patient perspective to optimizing care for populations of patients. To assess the effectiveness of an instructional program on heterogeneity designed for medical and pharmacy managers. A live educational program was offered to members of the Academy of Managed Care Pharmacy at the fall 2012 educational meeting and also to medical directors and managers attending a national payer roundtable meeting in October 2012. Participants completed a retrospective pretest-posttest assessment of their knowledge, attitudes, and self-efficacy immediately following the program. Participants were offered the opportunity to participate in a follow-up assessment 6 months later. Willing participants for the follow-up assessment were contacted via e-mail and telephone. Rasch rating scale models were used to compare pre- and postscores measuring participants' knowledge about and attitude towards heterogeneity. A total of 49 individuals completed the retrospective pretest-posttest assessment and agreed to be a part of the program evaluation. Fifty percent (n = 25) of participants had heard of the phrase "heterogeneity of treatment effect," and 36 (72%) were familiar with the phrase "individualized treatment effect" prior to the live program. Participants reported a significant improvement in knowledge of heterogeneity (P  less than  0.01) and attitudes about heterogeneity (P  less than  0.01) immediately after attending the program. At the time of the educational program, participants had either never considered heterogeneity (26%) or reported not knowing (28%) whether their organizations considered it when determining basic coverage. Participants were more likely to report "sometimes" considering heterogeneity for determining

Evaluation of the MIND Research Institute's Spatial-Temporal Math (ST Math) Program in California

Science.gov (United States)

Wendt, Staci; Rice, John; Nakamoto, Jonathan

2014-01-01

The MIND Research Institute contracted with the Evaluation Research Program at WestEd to conduct an independent assessment of mathematics outcomes in elementary school grades across California that were provided with the ST Math program. Spatial-Temporal (ST) Math is a game-based instructional software designed to boost K-5 and secondary-level…

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

Design and Assessment of an Associate Degree-Level Plant Operations Technical Education Program

Science.gov (United States)

Selwitz, Jason Lawrence

Research was undertaken to develop and evaluate an associate degree-level technical education program in Plant Operations oriented towards training students in applied science, technology, engineering, and mathematics (STEM) skills and knowledge relevant to a spectrum of processing industries. This work focuses on four aspects of the curriculum and course development and evaluation research. First, the context of, and impetus for, what was formerly called vocational education, now referred to as technical or workforce education, is provided. Second, the research that was undertaken to design and evaluate an associate degree-level STEM workforce education program is described. Third, the adaptation of a student self-assessment of learning gains instrument is reviewed, and an analysis of the resulting data using an adapted logic model is provided, to evaluate the extent to which instructional approaches, in two process control/improvement-focused courses, were effective in meeting course-level intended learning outcomes. Finally, eight integrative multiscale exercises were designed from two example process systems, wastewater treatment and fast pyrolysis. The integrative exercises are intended for use as tools to accelerate the formation of an operator-technician's multiscale vision of systems, unit operations, underlying processes, and fundamental reactions relevant to multiple industries. Community and technical colleges serve a vital function in STEM education by training workers for medium- and high-skilled technical careers and providing employers the labor necessary to operate and maintain thriving business ventures. Through development of the curricular, course, and assessment-related instruments and tools, this research helps ensure associate degree-level technical education programs can engage in a continual process of program evaluation and improvement.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Guide for Conducting Benefit-Cost Evaluation of Realized Impacts of Public R&D Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emerald Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2011-08-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others. Retrospective evaluations may be contrasted to prospective evaluations that reflect expected or potential outcomes only if assumptions hold. The retrospective approach described in this Guide is based on realized results only and the extent they can be attributed to the efforts of an R&D program. While it has been prepared specifically to guide retrospective benefit-cost analysis of EERE R&D Programs, this report may be used for similar analysis of other public R&D organizations.

Survey and evaluation of aging risk assessment methods and applications

International Nuclear Information System (INIS)

Sanzo, D.; Kvam, P.; Apostolakis, G.; Wu, J.; Milici, T.; Ghoniem, N.; Guarro, S.

1994-11-01

The US Nuclear Regulatory Commission initiated the nuclear power plant aging research program about 6 years ago to gather information about nuclear power plant aging. Since then, this program has collected a significant amount of information, largely qualitative, on plant aging and its potential effects on plant safety. However, this body of knowledge has not yet been integrated into formalisms that can be used effectively and systematically to assess plant risk resulting from aging, although models for assessing the effect of increasing failure rates on core damage frequency have been proposed. This report surveys the work on the aging of systems, structures, and components (SSCs) of nuclear power plants, as well as associated data bases. We take a critical look at the need to revise probabilistic risk assessments (PRAs) so that they will include the contribution to risk from plant aging, the adequacy of existing methods for evaluating this contribution, and the adequacy of the data that have been used in these evaluation methods. We identify a preliminary framework for integrating the aging of SSCs into the PRA and include the identification of necessary data for such an integration

A risk communication case study: the Nevada risk assessment/management program

International Nuclear Information System (INIS)

Hechanova, A.E.

2000-01-01

The Nevada Risk Assessment/Management Program (NRAMP) is part of a national effort by the U.S. Department of Energy (DOE) to develop new sources of information and approaches to risk assessment, risk management, risk communication and public outreach as these objectives relate to the ecological and human health effects of radioactive and hazardous material management and site remediation activities. This paper reviews the innovation behind the NRAMP project and presents a synopsis of the NRAMP effort which occurred from 1995 to 2000. The primary goals of the DOE in awarding the cooperative agreement establishing NRAMP were to (I) use a risk-based approach to evaluate the consequences of alternative actions in DOE's Environmental Remediation Programs at sites in Nevada and (2) use a neutral and credible institution outside the DOE to perform the risk assessments and contribute to public education about environmental management issues at the Nevada Test Site. (author)

Evaluation of a Digital Game-Based Learning Program for Enhancing Youth Mental Health: A Structural Equation Modeling of the Program Effectiveness.

Science.gov (United States)

Huen, Jenny My; Lai, Eliza Sy; Shum, Angie Ky; So, Sam Wk; Chan, Melissa Ky; Wong, Paul Wc; Law, Y W; Yip, Paul Sf

2016-10-07

Digital game-based learning (DGBL) makes use of the entertaining power of digital games for educational purposes. Effectiveness assessment of DGBL programs has been underexplored and no attempt has been made to simultaneously model both important components of DGBL: learning attainment (ie, educational purposes of DGBL) and engagement of users (ie, entertaining power of DGBL) in evaluating program effectiveness. This study aimed to describe and evaluate an Internet-based DGBL program, Professor Gooley and the Flame of Mind, which promotes mental health to adolescents in a positive youth development approach. In particular, we investigated whether user engagement in the DGBL program could enhance their attainment on each of the learning constructs per DGBL module and subsequently enhance their mental health as measured by psychological well-being. Users were assessed on their attainment on each learning construct, psychological well-being, and engagement in each of the modules. One structural equation model was constructed for each DGBL module to model the effect of users' engagement and attainment on the learning construct on their psychological well-being. Of the 498 secondary school students that registered and participated from the first module of the DGBL program, 192 completed all 8 modules of the program. Results from structural equation modeling suggested that a higher extent of engagement in the program activities facilitated users' attainment on the learning constructs on most of the modules and in turn enhanced their psychological well-being after controlling for users' initial psychological well-being and initial attainment on the constructs. This study provided evidence that Internet intervention for mental health, implemented with the technologies and digital innovations of DGBL, could enhance youth mental health. Structural equation modeling is a promising approach in evaluating the effectiveness of DGBL programs.

Arctic Nuclear Waste Assessment Program

International Nuclear Information System (INIS)

Edson, R.

1995-01-01

The Arctic Nuclear Waste Assessment Program (ANWAP) was initiated in 1993 as a result of US congressional concern over the disposal of nuclear materials by the former Soviet Union into the Arctic marine environment. The program is comprised of appr. 70 different projects. To date appr. ten percent of the funds has gone to Russian institutions for research and logistical support. The collaboration also include the IAEA International Arctic Seas Assessment Program. The major conclusion from the research to date is that the largest signals for region-wide radionuclide contamination in the Arctic marine environment appear to arise from the following: 1) atmospheric testing of nuclear weapons, a practice that has been discontinued; 2) nuclear fuel reprocessing wastes carried in the Arctic from reprocessing facilities in Western Europe, and 3) accidents such as Chernobyl and the 1957 explosion at Chelyabinsk-65

Regional Environmental Monitoring and Assessment Program Data (REMAP)

Data.gov (United States)

U.S. Environmental Protection Agency — The Regional Environmental Monitoring and Assessment Program (REMAP) was initiated to test the applicability of the Environmental Monitoring and Assessment Program...

Integrated plant-safety assessment, Systematic Evaluation Program: Big Rock Point Plant (Docket No. 50-155)

International Nuclear Information System (INIS)

1983-09-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. This report documents the review of the Big Rock Point Plant, which is one of ten plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. It also addresses a majority of the pending licensing actions for Big Rock Point, which include TMI Action Plan requirements and implementation criteria for resolved generic issues. Equipment and procedural changes have been identified as a result of the review

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

Science.gov (United States)

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

NURE quadrangle evaluation and assessment

International Nuclear Information System (INIS)

Horton, R.C.

1979-01-01

The NURE program effort will continue to generate and employ improvements in assessment technology. Assessment procedures in current use are carefully documented to the extent that a useful audit trail is available; these data extend from the actual recording of field observations and identification of favorability areas to the selection of the proper control areas and application to the actual assessment function. BFEC is confident that the basic system of assessment of the unknown by analogy to the known is fully tenable. And, BFEC is proud to be a contributing party to the NURE program which is of a magnitude not hitherto undertaken by any government or private organization

Mark II containment lead plant program load evaluation and acceptance criteria

International Nuclear Information System (INIS)

1978-10-01

The report, prepared by the Office of Nuclear Reactor Regulation, addresses the portion of the Mark II owner's program that provides a generic methodology for establishing design basis LOCA and safety relief valve loads for the lead Mark II facilities (Zimmer, Shoreham, and LaSalle), i.e., the lead plant program. The report includes an evaluation of the Mark II owner's load methodology, a description of load methodologies that we find acceptable for use in the individual plant unique assessments, and the basis for the stated conclusions

Assessment of surgical competence in North American graduate periodontics programs: a survey of current practices.

Science.gov (United States)

Ghiabi, Edmond; Taylor, K Lynn

2010-08-01

This cross-sectional study was designed to document the methods utilized by North American graduate periodontics programs in assessing their residents' surgical skills. A survey of clinical skills assessment was mailed to directors of all fifty-eight graduate periodontics programs in Canada and the United States. Thirty-four programs (59 percent) responded. The data collected were analyzed using SPSS version 15.0. The results demonstrate that the most common practice for providing feedback and documenting residents' surgical skills in the programs surveyed was daily one-on-one verbal feedback given by an instructor. The next two most commonly reported methods were a standard checklist developed at program level and a combination of a checklist and verbal comments. The majority of the programs reported that the instructors met collectively once per term to evaluate the residents' progress. The results suggest that graduate periodontics programs provide their residents frequent opportunities for daily practice with verbal feedback from instructors. However, assessment strategies identified in other health professions as beneficial in fostering the integration of clinical skills practices are not employed.

Evaluating Integrative Cancer Clinics With the Claim Assessment Profile: An Example With the InspireHealth Clinic.

Science.gov (United States)

Hilton, Lara; Elfenbaum, Pamela; Jain, Shamini; Sprengel, Meredith; Jonas, Wayne B

2018-03-01

The evaluation of freestanding integrative cancer clinical programs is challenging and is rarely done. We have developed an approach called the Claim Assessment Profile (CAP) to identify whether evaluation of a practice is justified, feasible, and likely to provide useful information. A CAP was performed in order to (1) clarify the healing claims at InspireHealth, an integrative oncology treatment program, by defining the most important impacts on its clients; (2) gather information about current research capacity at the clinic; and (3) create a program theory and path model for use in prospective research. This case study design incorporates methods from a variety of rapid assessment approaches. Procedures included site visits to observe the program, structured qualitative interviews with 26 providers and staff, surveys to capture descriptive data about the program, and observational data on program implementation. The InspireHealth program is a well-established, multi-site, thriving integrative oncology clinical practice that focuses on patient support, motivation, and health behavior engagement. It delivers patient-centered care via a standardized treatment protocol. There arehigh levels of research interest from staff and resources by which to conduct research. This analysis provides the primary descriptive and claims clarification of an integrative oncology treatment program, an evaluation readiness report, a detailed logic model explicating program theory, and a clinical outcomes path model for conducting prospective research. Prospective evaluation of this program would be feasible and valuable, adding to our knowledge base of integrative cancer therapies.

The Impact of a Developed Measurement and Evaluation Development Program on Pre-Service Physical Education Teachers' Perceptions Related to Measurement and Evaluation

Science.gov (United States)

Arslan, Yunus; Erturan Ilker, Gokce; Demirhan, Giyasettin

2013-01-01

The purpose of this study was to investigate the impact of the Measurement and Evaluation Development Program on pre-service physical education teachers' general perceptions and competency perceptions related to alternative assessment in physical education, and their competency perceptions related to educational measurement and evaluation. The…

Building an evidence base for community health: a review of the quality of program evaluations.

Science.gov (United States)

Jolley, Gwyn M; Lawless, Angela P; Baum, Fran E; Hurley, Catherine J; Fry, Denise

2007-11-01

An assessment of the quality of program evaluations conducted in South Australian community health services investigated how effective evaluation reporting is in producing an evidence base for community health. Evaluation reports were assessed by a team of reviewers. Practitioner workshops allowed an understanding of the uses of evaluation and what promotes or acts as a barrier to undertaking evaluations. Community health services do undertake a good deal of evaluation. However, reports were not generally explicit in dealing with the principles that underpin community health. Few engaged with program theory or rationale. Typically, reports were of short-term projects with uncertain futures so there may seem little point in considering issues of long-term health outcomes and transferability to other settings. The most important issue from our study is the lack of investment in applied health services research of the sort that will be required to produce the evidence for practice that policy makers desire. The current lack of evidence for community health reflects failure of the system to invest in research and evaluation that is adequately resourced and designed for complex community settings.

Advanced Science for Kids: Multicultural Assessment and Programming.

Science.gov (United States)

Bettac, Teresa; Huckabee, Colleen; Musser, Louise; Patton, Paulette; Yates, Joyce

1997-01-01

Describes Advanced Science for Kids (ASK), a multicultural approach to assessment and programming for a middle school advanced science program. ASK is designed to provide alternative approaches to identification and assessment, facilitate authentic instruction and assessment, and provide minority students with academic and social support as they…

Development of GoldSim Program Template for Safety Assessment of an LILW Disposal

International Nuclear Information System (INIS)

Lee, Youn Myoung; Jeong, Jong Tae

2010-08-01

A modeling study and development of a methodology, by which an assessment of safety and performance for a low- and intermediate level radioactive waste (LILW) repository could be effectively made has been carried out. With normal or abnormal nuclide release cases associated with the various FEPs and scenarios involved in the performance of the proposed repository in view of nuclide transport and transfer both in geosphere and biosphere, a total system performance assessment (TSPA) program has been developed by utilizing a commercial development tool program, GoldSim. The report especially deals much with a detailed conceptual modeling scheme by which a GoldSim program modules, all of which are integrated into a TSPA program template were able to be developed. Degradation effects of the near-field such manmade barriers as waste container and the silo on the performance of the repository are also modeled and quantitatively and deterministically/probabilistically evaluated with input data set currently available or assumed. In-depth system models that are conceptually and rather practically described and then ready for implementing into a GoldSim TSPA program are introduced with illustrations. The GoldSim TSPA template program developed through this study is expected to be successfully applied to the post closure safety assessment required for an LILW repository such as Gyeongju repository

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Evaluation of an online continuing education program from the perspective of new graduate nurses.

Science.gov (United States)

Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike

2014-05-01

The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.

Integrated plant safety assessment: systematic evaluation program. Oyster Creek nuclear generating station. GPU Nuclear Corporation and Jersey Central Power and Light Company. Docket No. 50-219

International Nuclear Information System (INIS)

1982-09-01

The Systematic Evaluation Program was initiated in February 1978 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the Oyster Creek Nuclear Generating Station (located in Ocean County, New Jersey), one of ten plants reviewed under Phase II of this program, and indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. It is expected that this report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license

Subjective Outcome Evaluation of the Project P.A.T.H.S. (Secondary 2 Program: Views of the Program Participants

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2009-01-01

Full Text Available A total of 196 secondary schools participated in the Secondary 2 Program of the Full Implementation Phase of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes. After completion of the Tier 1 Program, 30,731 students responded to the Subjective Outcome Evaluation Form (Form A to assess their perceptions of the program, instructors, and perceived effectiveness of the program. Based on the consolidated reports submitted by the schools to the funding body, the research team aggregated the consolidated data to form a “reconstructed” overall profile on the perceptions of the program participants. Findings demonstrated that high proportions of the respondents had positive perceptions of the program and the instructors, and roughly four-fifths of the respondents regarded the program as beneficial to them. Correlation analyses showed that perceived program and instructor characteristics were positively associated with perceived benefits of the program.

Improving clinical research and cancer care delivery in community settings: evaluating the NCI community cancer centers program

Directory of Open Access Journals (Sweden)

Fennell Mary L

2009-09-01

Full Text Available Abstract Background In this article, we describe the National Cancer Institute (NCI Community Cancer Centers Program (NCCCP pilot and the evaluation designed to assess its role, function, and relevance to the NCI's research mission. In doing so, we describe the evolution of and rationale for the NCCCP concept, participating sites' characteristics, its multi-faceted aims to enhance clinical research and quality of care in community settings, and the role of strategic partnerships, both within and outside of the NCCCP network, in achieving program objectives. Discussion The evaluation of the NCCCP is conceptualized as a mixed method multi-layered assessment of organizational innovation and performance which includes mapping the evolution of site development as a means of understanding the inter- and intra-organizational change in the pilot, and the application of specific evaluation metrics for assessing the implementation, operations, and performance of the NCCCP pilot. The assessment of the cost of the pilot as an additional means of informing the longer-term feasibility and sustainability of the program is also discussed. Summary The NCCCP is a major systems-level set of organizational innovations to enhance clinical research and care delivery in diverse communities across the United States. Assessment of the extent to which the program achieves its aims will depend on a full understanding of how individual, organizational, and environmental factors align (or fail to align to achieve these improvements, and at what cost.

Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience.

Science.gov (United States)

Bennett, Sara; Ozawa, Sachiko; Rodriguez, Daniela; Paul, Amy; Singh, Kriti; Singh, Suneeta

2015-10-01

In low and middle-income countries, programs funded and implemented by international donors frequently transition to local funding and management, yet such processes are rarely evaluated. We reflect upon experience evaluating the transition of a large scale HIV/AIDS prevention program in India, known as Avahan, in order to draw lessons about transition evaluation approaches and implementation challenges. In terms of conceptualizing the transition theory, the evaluation team identified tensions between the idea of institutionalizing key features of the Avahan program, and ensuring program flexibility to promote sustainability. The transition was planned in three rounds allowing for adaptations to transition intervention and program design during the transition period. The assessment team found it important to track these changes in order to understand which strategies and contextual features supported transition. A mixed methods evaluation was employed, combining semi-structured surveys of transitioning entities (conducted pre and post transition), with longitudinal case studies. Qualitative data helped explain quantitative findings. Measures of transition readiness appeared robust, but we were uncertain of the robustness of institutionalization measures. Finally, challenges to the implementation of such an evaluation are discussed. Given the scarceness of transition evaluations, the lessons from this evaluation may have widespread relevance. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Defense Programs Transportation Risk Assessment

International Nuclear Information System (INIS)

Clauss, D.B.

1994-01-01

This paper provides an overview of the methodology used in a probabilistic transportation risk assessment conducted to assess the probabilities and consequences of inadvertent dispersal of radioactive materials arising from severe transportation accidents. The model was developed for the Defense Program Transportation Risk Assessment (DPTRA) study. The analysis incorporates several enhancements relative to previous risk assessments of hazardous materials transportation including newly-developed statistics on the frequencies and severities of tractor semitrailer accidents and detailed route characterization using the 1990 Census data

Conception of programs for evaluating balance indices of operation of WWER-440 nuclear power plants

International Nuclear Information System (INIS)

Zadrazil, J.

1986-01-01

The procedures are discussed of writing computation programs for the evaluation of basic technical and economic parameters of the operation of WWER-440 nuclear power plants. The criterion of the evaluation is the maximum power supply to the grid together with the required supply of heat, with the observance of safe operating conditions. Previous procedures of evaluation are compared with present procedures based on the use of a monitoring and evaluation system of the KOMPLEX-URAN 2 M type. The mathematical model of the program is based on balance equations and relations derived for actual measuring systems and is completed with an assessment of the reliability of input and output data. The flow chart is shown of the algorithm for the evaluation of technical and economic parameters, and methods are suggested for improving and extending the program. (J.C.)

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Lack of grading agreement among international hemostasis external quality assessment programs.

Science.gov (United States)

Olson, John D; Jennings, Ian; Meijer, Piet; Bon, Chantal; Bonar, Roslyn; Favaloro, Emmanuel J; Higgins, Russell A; Keeney, Michael; Mammen, Joy; Marlar, Richard A; Meley, Roland; Nair, Sukesh C; Nichols, William L; Raby, Anne; Reverter, Joan C; Srivastava, Alok; Walker, Isobel

2018-01-01

: Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of 'pass' or 'fail' is made. EQA provider members of the international organization, external quality assurance in thrombosis and hemostasis, took part in a study to compare outcome of performance analysis using the same data set of laboratory results. Eleven EQA organizations using eight different analytical approaches participated. Data for a normal and prolonged activated partial thromboplastin time (aPTT) and a normal and reduced factor VIII (FVIII) from 218 laboratories were sent to the EQA providers who analyzed the data set using their method of evaluation for aPTT and FVIII, determining the performance for each laboratory record in the data set. Providers also summarized their statistical approach to assignment of target values and laboratory performance. Each laboratory record in the data set was graded pass/fail by all EQA providers for each of the four analytes. There was a lack of agreement of pass/fail grading among EQA programs. Discordance in the grading was 17.9 and 11% of normal and prolonged aPTT results, respectively, and 20.2 and 17.4% of normal and reduced FVIII results, respectively. All EQA programs in this study employed statistical methods compliant with the International Standardization Organization (ISO), ISO 13528, yet the evaluation of laboratory results for all four analytes showed remarkable grading discordance.

Lack of grading agreement among international hemostasis external quality assessment programs

Science.gov (United States)

Olson, John D.; Jennings, Ian; Meijer, Piet; Bon, Chantal; Bonar, Roslyn; Favaloro, Emmanuel J.; Higgins, Russell A.; Keeney, Michael; Mammen, Joy; Marlar, Richard A.; Meley, Roland; Nair, Sukesh C.; Nichols, William L.; Raby, Anne; Reverter, Joan C.; Srivastava, Alok; Walker, Isobel

2018-01-01

Laboratory quality programs rely on internal quality control and external quality assessment (EQA). EQA programs provide unknown specimens for the laboratory to test. The laboratory's result is compared with other (peer) laboratories performing the same test. EQA programs assign target values using a variety of methods statistical tools and performance assessment of ‘pass’ or ‘fail’ is made. EQA provider members of the international organization, external quality assurance in thrombosis and hemostasis, took part in a study to compare outcome of performance analysis using the same data set of laboratory results. Eleven EQA organizations using eight different analytical approaches participated. Data for a normal and prolonged activated partial thromboplastin time (aPTT) and a normal and reduced factor VIII (FVIII) from 218 laboratories were sent to the EQA providers who analyzed the data set using their method of evaluation for aPTT and FVIII, determining the performance for each laboratory record in the data set. Providers also summarized their statistical approach to assignment of target values and laboratory performance. Each laboratory record in the data set was graded pass/fail by all EQA providers for each of the four analytes. There was a lack of agreement of pass/fail grading among EQA programs. Discordance in the grading was 17.9 and 11% of normal and prolonged aPTT results, respectively, and 20.2 and 17.4% of normal and reduced FVIII results, respectively. All EQA programs in this study employed statistical methods compliant with the International Standardization Organization (ISO), ISO 13528, yet the evaluation of laboratory results for all four analytes showed remarkable grading discordance. PMID:29232255

Self-assessment program and actions in ANAV

International Nuclear Information System (INIS)

2004-01-01

Since 1999, the Association Nuclear Asco-Vandellos II, AIE (ANAV) has a self-assessment program in place and controls and tracks the actions with the support of different databases. This article describes the improvements made in the self-assessment programs and actions of ANAV between 1999 up to the present, all the fruit of the experience gained in the application of these programs, Sector guidelines and international trends, as well as standardization with the other Spanish nuclear power plants. (Author)

A multi-stakeholder evaluation of the Baltimore City virtual supermarket program.

Science.gov (United States)

Lagisetty, Pooja; Flamm, Laura; Rak, Summer; Landgraf, Jessica; Heisler, Michele; Forman, Jane

2017-10-23

Increasing access to healthy foods and beverages in disadvantaged communities is a public health priority due to alarmingly high rates of obesity. The Virtual Supermarket Program (VSP) is a Baltimore City Health Department program that uses online grocery ordering to deliver food to low-income neighborhoods. This study evaluates stakeholder preferences and barriers of program implementation. This study assessed the feasibility, sustainability and efficacy of the VSP by surveying 93 customers and interviewing 14 programmatic stakeholders who had recently used the VSP or been involved with program design and implementation. We identified the following themes: The VSP addressed transportation barriers and food availability. The VSP impacted customers and the city by including improving food purchasing behavior, creating a food justice "brand for the city", and fostering a sense of community. Customers appreciated using Supplemental Nutrition Assistance Program (SNAP) benefits to pay for groceries, but policy changes are needed allow online processing of SNAP benefits. This evaluation summarizes lessons learned and serves as a guide to other public health leaders interested in developing similar programs. Provisions in the U.S. Department of Agriculture (USDA) Farm Bill 2014 allow for select grocers to pilot online transactions with SNAP benefits. If these pilots are efficacious, the VSP model could be easily disseminated.

The Linear Programming to evaluate the performance of Oral Health in Primary Care.

Science.gov (United States)

Colussi, Claudia Flemming; Calvo, Maria Cristina Marino; Freitas, Sergio Fernando Torres de

2013-01-01

To show the use of Linear Programming to evaluate the performance of Oral Health in Primary Care. This study used data from 19 municipalities of Santa Catarina city that participated of the state evaluation in 2009 and have more than 50,000 habitants. A total of 40 indicators were evaluated, calculated using the Microsoft Excel 2007, and converted to the interval [0, 1] in ascending order (one indicating the best situation and zero indicating the worst situation). Applying the Linear Programming technique municipalities were assessed and compared among them according to performance curve named "quality estimated frontier". Municipalities included in the frontier were classified as excellent. Indicators were gathered, and became synthetic indicators. The majority of municipalities not included in the quality frontier (values different of 1.0) had lower values than 0.5, indicating poor performance. The model applied to the municipalities of Santa Catarina city assessed municipal management and local priorities rather than the goals imposed by pre-defined parameters. In the final analysis three municipalities were included in the "perceived quality frontier". The Linear Programming technique allowed to identify gaps that must be addressed by city managers to enhance actions taken. It also enabled to observe each municipal performance and compare results among similar municipalities.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

An Evaluation of the Relationship Smarts Plus Program on Adolescents in Georgia

Directory of Open Access Journals (Sweden)

Ted G. Futris

2013-10-01

Full Text Available The present study examines the impact of Relationship Smarts Plus among 1,657 adolescents age 12-18 across 25 Georgia counties. The program, aimed at increasing awareness about healthy versus unhealthy relationships and promoting smart dating strategies and the application of healthy communication and conflict resolution skills, was offered 54 times by 23 different FCS or 4-H agents during a 53-month period. After each lesson, participants completed a 5-item retrospective pre- and post-test assessing changes in awareness and understanding of the concepts and skills learned. Overall, 949 (57% youth responded to an overall post-evaluation administered at the conclusion of the program series to document confidence levels in having a healthy relationship, likelihood of using the skills learned, perceived helpfulness of the program, and changes in how youth felt about themselves. On average, youth demonstrated significant increases in knowledge for all lessons and reported positive improvements across all post-evaluation indicators following participation in the program. Implications for future youth-focused outreach programming to promote healthy relationships are shared.

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Environmental compliance assessment findings for Weldon Spring Site Remedial Action Program

International Nuclear Information System (INIS)

Sigmon, C.F.; Levine, M.B.

1990-01-01

This report presents the results of an environmental assessment conducted at Weldon Spring Site Remedial Action Project (WSSRAP) in St. Charles County, Missouri, in accordance with the Formerly Utilized Sites Remedial Action Program (FUSRAP) Environmental Compliance Assessment Checklists. The purpose of this assessment was to evaluate the compliance of the site with applicable federal and Missouri environment regulations. Assessments activities included the following: review of site records, reports ,and files; inspection of the WSSRAP storage building, other selected buildings, and the adjacent grounds; and interviews with project personnel. This assessment was conducted on August 28-30, 1989. The assessment covered five management areas as set forth in the Checklist: Hazardous Waste Management, Polychlorinated Biphenyls (PCBs) Management; Air Emissions; Wastewater Discharges and Petroleum Management. No samples were collected. 1 ref., 2 figs., 1 tab

[Evaluation of prerequisites programs for a HACCP plan for frozen sardine plant].

Science.gov (United States)

Rosas, Patricia; Reyes, Genara

2008-06-01

Good manufacturing practices (GMP) and sanitation standard operating procedures (SSOP) are prerequisites programs for the application of the Hazard Analysis and Critical Control Point (HACCP) system as a food safety approach during processing. The aim of this study was to evaluate GMP/SSOP prerequisites in processing line of frozen whole sardine (Sardinella aurita). The GMP compliance was verified according to a standard procedure of the Ministry for the Health of Venezuela, and the SSOP were assessed according to a checklist proposed by the FDA. GMP and SSOP were evaluated following a demerit-based approach. A percentage value was calculated and referred to as sanitary effectiveness. Results indicated that the plant had a good level of compliance with GMP from assessment of buildings and facilities, equipment and tools, hygienic requisites of the production, assurance of the hygiene quality, storage and transportation, and the percentage of sanitary effectiveness was 84%. The level of compliance for SSOP was 53,12% with demerits found in all assessed aspects consisting of inexistent guidelines, lack of control in the sanitary plan and lack of leadership in applying corrective actions. Thus, an improvement in the plant sanitation program was designed targeting SSOP.

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Does the Kids Cafe Program's nutrition education improve children's dietary intake? A pilot evaluation study

Science.gov (United States)

Our objective was to evaluate the Kids Café Program (KCP) nutrition education intervention and assess its impact on children's diet quality and body mass index (BMI) percentile. An experimental design consisting of pretest-posttest comparison groups using mixed methods was used to evaluate the 6-ses...

TRECII: a computer program for transportation risk assessment

International Nuclear Information System (INIS)

Franklin, A.L.

1980-05-01

A risk-based fault tree analysis method has been developed at the Pacific Northwest Laboratory (PNL) for analysis of nuclear fuel cycle operations. This methodology was developed for the Department of Energy (DOE) as a risk analysis tool for evaluating high level waste management systems. A computer package consisting of three programs was written at that time to assist in the performance of risk assessment: ACORN (draws fault trees), MFAULT (analyzes fault trees), and RAFT (calculates risk). This methodology evaluates release consequences and estimates the frequency of occurrence of these consequences. This document describes an additional risk calculating code which can be used in conjunction with two of the three codes for transportation risk assessment. TRECII modifies the definition of risk used in RAFT (prob. x release) to accommodate release consequences in terms of fatalities. Throughout this report risk shall be defined as probability times consequences (fatalities are one possible health effect consequence). This methodology has been applied to a variety of energy material transportation systems. Typically the material shipped has been radioactive, although some adaptation to fossil fuels has occurred. The approach is normally applied to truck or train transport systems with some adaptation to pipelines and aircraft. TRECII is designed to be used primarily in conjunction with MFAULT; however, with a moderate amount of effort by the user, it can be implemented independent of the risk analysis package developed at PNL. Code description and user instructions necessary for the implementation of the TRECII program are provided

Teaching children about bicycle safety: an evaluation of the New Jersey Bike School program.

Science.gov (United States)

Lachapelle, Ugo; Noland, Robert B; Von Hagen, Leigh Ann

2013-03-01

There are multiple health and environmental benefits associated with increasing bicycling among children. However, the use of bicycles is also associated with severe injuries and fatalities. In order to reduce bicycle crashes, a bicycling education program was implemented in selected New Jersey schools and summer camps as part of the New Jersey Safe Routes to School Program. Using a convenience sample of participants to the program, an opportunistic study was designed to evaluate the effectiveness of two bicycle education programs, the first a more-structured program delivered in a school setting, with no on-road component, and the other a less structured program delivered in a summer camp setting that included an on-road component. Tests administered before and after training were designed to assess knowledge acquired during the training. Questions assessed children's existing knowledge of helmet use and other equipment, bicycle safety, as well as their ability to discriminate hazards and understand rules of the road. Participating children (n=699) also completed a travel survey that assessed their bicycling behavior and their perception of safety issues. Response to individual questions, overall pre- and post-training test scores, and changes in test scores were compared using comparison of proportion, t-tests, and ordinary least-squares (OLS) regression. Improvements between the pre-training and post-training test are apparent from the frequency distribution of test results and from t-tests. Both summer camps and school-based programs recorded similar improvements in test results. Children who bicycled with their parents scored higher on the pre-training test but did not improve as much on the post-training test. Without evaluating long-term changes in behavior, it is difficult to ascertain how successful the program is on eventual behavioral and safety outcomes. Copyright © 2012 Elsevier Ltd. All rights reserved.

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Using insects for STEM outreach: Development and evaluation of the UA Insect Discovery Program

Science.gov (United States)

Beal, Benjamin D.

Science and technology impact most aspects of modern daily life. It is therefore important to create a scientifically literate society. Since the majority of Americans do not take college-level science courses, strong K-12 science education is essential. At the K-5 level, however, many teachers lack the time, resources and background for effective science teaching. Elementary teachers and students may benefit from scientist-led outreach programs created by Cooperative Extension or other institutions. One example is the University of Arizona Insect Discovery Program, which provides short-duration programing that uses insects to support science content learning, teach critical thinking and spark interest in science. We conducted evaluations of the Insect Discovery programming to determine whether the activities offered were accomplishing program goals. Pre-post tests, post program questionnaires for teachers, and novel assessments of children's drawings were used as assessment tools. Assessments were complicated by the short duration of the program interactions with the children as well as their limited literacy. In spite of these difficulties, results of the pre-post tests indicated a significant impact on content knowledge and critical thinking skills. Based on post-program teacher questionnaires, positive impacts on interest in science learning were noted as much as a month after the children participated in the program. New programming and resources developed to widen the potential for impact are also described.

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Criteria for Evaluating Alternative Network and Link Layer Protocols for the NASA Constellation Program Communication Architecture

Science.gov (United States)

Benbenek, Daniel; Soloff, Jason; Lieb, Erica

2010-01-01

Selecting a communications and network architecture for future manned space flight requires an evaluation of the varying goals and objectives of the program, development of communications and network architecture evaluation criteria, and assessment of critical architecture trades. This paper uses Cx Program proposed exploration activities as a guideline; lunar sortie, outpost, Mars, and flexible path options are described. A set of proposed communications network architecture criteria are proposed and described. They include: interoperability, security, reliability, and ease of automating topology changes. Finally a key set of architecture options are traded including (1) multiplexing data at a common network layer vs. at the data link layer, (2) implementing multiple network layers vs. a single network layer, and (3) the use of a particular network layer protocol, primarily IPv6 vs. Delay Tolerant Networking (DTN). In summary, the protocol options are evaluated against the proposed exploration activities and their relative performance with respect to the criteria are assessed. An architectural approach which includes (a) the capability of multiplexing at both the network layer and the data link layer and (b) a single network layer for operations at each program phase, as these solutions are best suited to respond to the widest array of program needs and meet each of the evaluation criteria.

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Assessment of the Fusion Energy Sciences Program. Final Report

International Nuclear Information System (INIS)

2001-01-01

An assessment of the Office of Fusion Energy Sciences (OFES) program with guidance for future program strategy. The overall objective of this study is to prepare an independent assessment of the scientific quality of the Office of Fusion Energy Sciences program at the Department of Energy. The Fusion Science Assessment Committee (FuSAC) has been appointed to conduct this study

Increasing team skills: an evaluation of program effectiveness.

Science.gov (United States)

Jacobsen-Webb, M L

1985-11-01

The need for health professionals with caring values and good communication skills is well established. To develop these skills requires building self-esteem, as is supported by the work of Carl Rogers, Maslow, and Jourard, and the development of communication skills, as is supported by Carkhuff. A six-hour developmental program was evaluated using alternate forms of the highly validated Personal Skills Map. The differences in participants' scores showed increases in self-esteem, comfort, and management skills (p less than .00), while aggression (p = .05) and deference (p less than .00) decreased. A longitudinal follow-up of participants showed that 65% continued to use the assessment tool six months to one year later. The program appears to be well suited for service settings, continuing education, and academic settings, and meets the need of a high tech, high touch era of change.

NRC performance assessment program

International Nuclear Information System (INIS)

Coplan, S.M.

1986-01-01

The U.S. Nuclear Regulatory Commission's (NRC) performance assessment program includes the development of guidance to the U.S. Department of Energy (DOE) on preparation of a license application and on conducting the studies to support a license application. The nature of the licensing requirements of 10 CFR Part 60 create a need for performance assessments by the DOE. The NRC and DOE staffs each have specific roles in assuring the adequacy of those assessments. Performance allocation is an approach for determining what testing and analysis will be needed during site characterization to assure that an adequate data base is available to support the necessary performance assessments. From the standpoint of establishing is implementable methodology, the most challenging performance assessment needed for licensing is the one that will be used to determine compliance with the U.S. Environmental Protection Agency's (EPA) containment requirement

Integrated Plant Safety Assessment, Systematic Evaluation Program, Palisades Plant (Docket No. 50-255)

International Nuclear Information System (INIS)

1983-11-01

This report documents the review completed under the SEP for those issues that required refined engineering evaluations or the continuation of ongoing evaluations after the Final IPSAR for the Palisades Plant was issued. The review has provided for (1) an assessment of the significance of differences between current technical positions on selected safety issues and those that existed when the Palisades Plant was licensed, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety when the supplement to the Final IPSAR and the Safety Evaluation Report for converting the license from a provisional to a full-term license have been issued. The Final IPSAR and its supplement will form part of the bases for considering the conversion of the provisional operating license to a full-term operating license

Pilot Evaluation of a Communication Skills Training Program for Psychiatry Residents Using Standardized Patient Assessment.

Science.gov (United States)

Ditton-Phare, Philippa; Sandhu, Harsimrat; Kelly, Brian; Kissane, David; Loughland, Carmel

2016-10-01

Mental health clinicians can experience difficulties communicating diagnostic information to patients and their families/carers, especially about distressing psychiatric disorders such as schizophrenia. There is evidence for the effectiveness of communication skills training (CST) for improving diagnostic discussions, particularly in specialties such as oncology, but only limited evidence exists about CST for psychiatry. This study evaluated a CST program specifically developed for psychiatry residents called ComPsych that focuses on conveying diagnostic and prognostic information about schizophrenia. The ComPsych program consists of an introductory lecture, module booklets for trainees, and exemplary skills videos, followed by small group role-plays with simulated patients (SPs) led by a trained facilitator. A standardized patient assessment (SPA) was digitally recorded pre- and post-training with a SP using a standardized scenario in a time-limited (15 min) period. Recorded SPAs were independently rated using a validated coding system (ComSkil) to identify frequency of skills used in five skills categories (agenda setting, checking, questioning, information organization, and empathic communication). Thirty trainees (15 males and 15 females; median age = 32) undertaking their vocational specialty training in psychiatry participated in ComPsych training and pre- and post-ComPsych SPAs. Skills increased post-training for agenda setting (d = -0.82), while questioning skills (d = 0.56) decreased. There were no significant differences in any other skills grouping, although checking, information organization, and empathic communication skills tended to increase post-training. A dose effect was observed for agenda setting, with trainees who attended more CST sessions outperforming those attending fewer. Findings support the generalization and translation of ComPsych CST to psychiatry.

Needs assessment and evaluation of a short course to improve faculties teaching skills at a former World Health Organization regional teacher training center

Directory of Open Access Journals (Sweden)

JAVAD KOJURI

2015-01-01

Full Text Available Introduction: In the design of educational programs, much attention has been paid to teaching methods, needs assessment, an important part of the development of educational programs, generally is neglected. Another important aspect in educational program design is assessing effectiveness. The aims of this study were to design a formal needs assessment program to define the core contents of a faculty development program, and to determine whether participation in the faculty development program reinforced new teaching skills. Methods: A teacher-training program was designed at Shiraz University of Medical Sciences to help medical instructors boost their teaching skills. Needs assessment was done with nominal group technique followed by a 5-point Likert scale questionnaire. The program, imparted in workshop format, covered effective teaching methods, feedback, assessing knowledge and time management. Instruction was in the form of lectures, group discussions, case simulations, video presentations and role-plays. The program was evaluated in several phases using data triangulation and multi-item assessments of overall program quality in three major dimensions: Kirkpatrick program evaluation model, evaluation of the educational environment and qualitative analysis with open-ended questions. All participants in the study belonged to the academic staff of Shiraz University of Medical Sciences (n=396. Results: Seven main categories were derived from nominal group techniques and questionnaires. After the program, participants rated the quality of the program highly. They felt that the educational intervention was appropriate and had a positive impact on their knowledge of effective teaching methods, feedback, knowledge assessment and time management. Assessment of the effectiveness of the program showed that participants reported significant improvements in their teaching abilities. Conclusion: Our faculty development program have a significant positive

Needs assessment and evaluation of a short course to improve faculties teaching skills at a former World Health Organization regional teacher training center

Science.gov (United States)

KOJURI, JAVAD; AMINI, MITRA; KARIMIAN, ZAHRA; DEHGHANI, MOHAMMAD REZA; SABER, MAHBOOBEH; BAZRAFCAN, LEILA; EBRAHIMI, SEDIGHEH; REZAEE, RITA

2015-01-01

Introduction: In the design of educational programs, much attention has been paid to teaching methods, needs assessment, an important part of the development of educational programs, generally is neglected. Another important aspect in educational program design is assessing effectiveness. The aims of this study were to design a formal needs assessment program to define the core contents of a faculty development program, and to determine whether participation in the faculty development program reinforced new teaching skills. Methods: A teacher-training program was designed at Shiraz University of Medical Sciences to help medical instructors boost their teaching skills. Needs assessment was done with nominal group technique followed by a 5-point Likert scale questionnaire. The program, imparted in workshop format, covered effective teaching methods, feedback, assessing knowledge and time management. Instruction was in the form of lectures, group discussions, case simulations, video presentations and role-plays. The program was evaluated in several phases using data triangulation and multi-item assessments of overall program quality in three major dimensions: Kirkpatrick program evaluation model, evaluation of the educational environment and qualitative analysis with open-ended questions. All participants in the study belonged to the academic staff of Shiraz University of Medical Sciences (n=396). Results: Seven main categories were derived from nominal group techniques and questionnaires. After the program, participants rated the quality of the program highly. They felt that the educational intervention was appropriate and had a positive impact on their knowledge of effective teaching methods, feedback, knowledge assessment and time management. Assessment of the effectiveness of the program showed that participants reported significant improvements in their teaching abilities. Conclusions: Our faculty development program  have a significant positive effect on

Review and evaluation of online tobacco dependence treatment training programs for health care practitioners.

Science.gov (United States)

Selby, Peter; Goncharenko, Karina; Barker, Megan; Fahim, Myra; Timothy, Valerie; Dragonetti, Rosa; Kemper, Katherine; Herie, Marilyn; Hays, J Taylor

2015-04-17

Training health care professionals is associated with increased capacity to deliver evidence-based smoking cessation interventions and increased quit rates among their patients. Online training programs hold promise to provide training but questions remain regarding the quality and usability of available programs. The aim was to assess the quality of English-language online courses in tobacco dependence treatment using a validated instrument. An environmental scan was conducted using the Google search engine to identify available online tobacco dependence treatment courses. The identified courses were then evaluated using the Peer Review Rubric for Online Learning, which was selected based on its ability to evaluate instructional design. It also has clear and concise criteria descriptions to ensure uniformity of evaluations by trained experts. A total of 39 courses were identified, of which 24 unique courses were assessed based on their accessibility and functionality during the period of evaluation. Overall, the course ratings indicated that 17 of 24 courses evaluated failed to meet minimal quality standards and none of the courses evaluated could be ranked as superior. However, many excelled in providing effective navigation, course rationale, and content. Many were weak in the use of instructional design elements, such as teaching effectiveness, learning strategies, instructor's role, and assessment and evaluation. Evaluation results and suggestions for improvement were shared with course administrators. Based on the courses evaluated in this review, course developers are encouraged to employ best practices in instructional design, such as cohesiveness of material, linearity of design, practice exercises, problem solving, and ongoing evaluation to improve existing courses and in the design of new online learning opportunities.

Evaluation of Haddam Neck (Connecticut Yankee) Nuclear Power Plant, environmental impact prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Mahaffey, J.A.; Waton, D.G.

1976-12-01

A study was undertaken by the U.S. Nuclear Regulatory Commission (NRC) to evaluate the nonradiological environmental data obtained from three nuclear power plants operating for a period of one year or longer. The document presented reports the second of three nuclear power plants to be evaluated in detail by Battelle, Pacific Northwest Laboratories. Haddam Neck (Connecticut Yankee) Nuclear Power Plant nonradiological monitoring data were assessed to determine their effectiveness in the measurement of environmental impacts. Efforts were made to determine if: (1) monitoring programs, as designed, can detect environmental impacts, (2) appropriate statistical analyses were performed and if they were sensitive enough to detect impacts, (3) predicted impacts could be verified by monitoring programs, and (4) monitoring programs satisfied the requirements of the Environmental Technical Specifications. Both preoperational and operational monitoring data were examined to test the usefulness of baseline information in evaluating impacts. This included an examination of the methods used to measure ecological, chemical, and physical parameters, and an assessment of sampling periodicity and sensitivity where appropriate data sets were available. From this type of analysis, deficiencies in both preoperational and operational monitoring programs may be identified and provide a basis for suggested improvement

Strengthening Chronic Disease Prevention Programming: the Toward Evidence-Informed Practice (TEIP) Program Assessment Tool

Science.gov (United States)

Albert, Dayna; Fortin, Rebecca; Lessio, Anne; Herrera, Christine; Hanning, Rhona; Rush, Brian

2013-01-01

Best practices identified solely on the strength of research evidence may not be entirely relevant or practical for use in community-based public health and the practice of chronic disease prevention. Aiming to bridge the gap between best practices literature and local knowledge and expertise, the Ontario Public Health Association, through the Toward Evidence-Informed Practice initiative, developed a set of resources to strengthen evidence-informed decision making in chronic disease prevention programs. A Program Assessment Tool, described in this article, emphasizes better processes by incorporating review criteria into the program planning and implementation process. In a companion paper, “Strengthening Chronic Disease Prevention Programming: The Toward Evidence-Informed Practice (TEIP) Program Evidence Tool,” we describe another tool, which emphasizes better evidence by providing guidelines and worksheets to identify, synthesize, and incorporate evidence from a range of sources (eg, peer-reviewed literature, gray literature, local expertise) to strengthen local programs. The Program Assessment Tool uses 19 criteria derived from literature on best and promising practices to assess and strengthen program planning and implementation. We describe the benefits, strengths, and challenges in implementing the tool in 22 community-based chronic disease prevention projects in Ontario, Canada. The Program Assessment Tool helps put best processes into operation to complement adoption and adaptation of evidence-informed practices for chronic disease prevention. PMID:23721789

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

Evaluation of a HACCP pilot program for the food service industry.

Science.gov (United States)

Abernathy, Tom; Hart, Robert

2004-01-01

To evaluate the efficacy and applicability of a HACCP-based program for use in restaurants. A randomly selected sample of 16 intervention and 42 control full service, "stand-alone" restaurants with a minimum of 3 full-time food handling staff on duty per shift. Six communities in Central West Ontario. The Critical Approach, a HACCP-based program for use in restaurants, was designed in consultation with health inspectors and restaurant operators. It focusses on generic risk factors (Critical Control Points, CCPs) for food handlers rather than assessing specific menu items or foods; offers appropriate training of both management and staff; and encourages self-monitoring of CCPs by operators without extensive record keeping or retention. Outcome indicators measured changes in three areas: the environment, knowledge, and behaviour. Results suggest that among a subpopulation of restaurants, the program is acceptable to operators and capable of producing tangible results. Principles and methods of the program (i.e., an initial assessment of the site, working with the operator to identify and suggest improvements, and return visits to monitor compliance) may be transferable to other types of food service operations.

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

Assessment of the NRC Enforcement Program

International Nuclear Information System (INIS)

Lieberman, J.; Coblentz, L.

1995-04-01

On May 12, 1994, the Executive Director for Operations (EDO) established a Review Team composed of senior NRC managers to re-examine the NRC enforcement program. A copy of the Review Team's charter is enclosed as Appendix A. This report presents the Team's assessment. The purpose of this review effort are: (1) to perform an assessment of the NRC's enforcement program to determine whether the defined purposes of the enforcement program are appropriate; (2) to determine whether the NRC's enforcement practices and procedures for issuing enforcement actions are consistent with those purposes; and (3) to provide recommendations on any changes the Review Team believes advisable. In accordance with its charter, the Review Team considered the following principal issues in conducting its assessment of the enforcement program: the balance between providing deterrence and incentives (both positive and negative) for the identification and correction of violations; the appropriateness of NRC sanctions; whether the commission should seek statutory authority to increase the amount of civil penalties; whether the NRC should use different enforcement policies and practices for different licensees (e.g., materials licensees in contrast to power reactors or large fuel facilities); and whether the commission should establish open enforcement conferences as the normal practice

Development of the Integrated Performance Evaluation Program (IPEP) for the Department of Energy's Office of Environmental Management

International Nuclear Information System (INIS)

Lindahl, P.; Streets, E.; Bass, D.; Hensley, J.; Newberry, R.; Carter, M.

1995-01-01

Argonne National Laboratory (ANL) and DOE's Radiological and Environmental Sciences Laboratory (RESL), Environmental Measurements Laboratory (EML), and Grand Junction Project office (GJPO) are collaborating with DOE's Office of Environmental Management (EM), Analytical Services Division (ASD, EM-263) and the Environmental Protection Agency (EPA) to develop an Integrated Performance Evaluation Program (IPEP). The purpose of the IPEP is to integrate information from existing PE programs with expanded QA activities to develop information about the quality of radiological, mixed waste, and hazardous environmental sample analyses provided by all laboratories supporting EM programs. The IPEP plans to utilize existing PE programs when available and appropriate for use by DOE; new PE programs will be developed only when no existing program meets DOEs needs. Interagency Agreements have been developed between EPA and DOE to allow DOE to use major existing PE programs developed by EPA. In addition, the DOE radiological Quality Assessment Program (QAP) administered by EML is being expanded for use in EM work. RESL and GJPO are also developing the Mixed Waste Performance Evaluation Program (MAPEP) to provide radiological, inorganic, and organic analytes of interest to EM programs. The use of information from multiple PE programs will allow a more global assessment of an individual laboratory's performance, as well as providing a means of more fairly comparing laboratories' performances in a given analytical area. The EPEP will interact with other aspects of the ASD such as audit and methods development activities to provide an integrated system for assessment and improvement of data quality

Evaluation of DOE's Partnership in Low-Income Residential Retrofit (PILIRR) Program

Energy Technology Data Exchange (ETDEWEB)

Callaway, J.W.; Lee, A.D.

1989-05-01

In July 1986, the US Department of Energy (DOE) awarded competitive grants to five states to conduct pilot projects to establish partnerships and use resource leveraging to stimulate support for low-income residential energy retrofits. The projects were conducted under DOE's Partnerships in Low-Income Residential Retrofit (PILIRR) Program. These projects have been monitored and analyzed through a concurrent process evaluation conducted by the Pacific Northwest Laboratory (PNL). This study reports the findings of that evaluation. The overriding goal of the PILIRR Program was to determine whether the states could stimulate support for low-income residential energy improvements from non-federal sources. The goal for the process evaluation was to conduct an assessment of the processes used by the states and the extent to which they successfully established partnerships and leveraged resources. Five states were selected to participate in the program: Florida, Iowa, Kentucky, Oklahoma and Washington. Each state proposed a different approach to promote non-federal support for low-income residential weatherization. Three of the five states--Florida, Iowa, and Washington--established partnerships that led to retrofits during the monitoring period (October 1986--October 1988). Kentucky established its partnership during the monitoring period, but did not accomplish its retrofits until after monitoring was complete. Oklahoma completed development of its marketing program and had begun marketing efforts by the end of the monitoring period. 16 refs., 7 figs., 1 tab.

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

A multi-stakeholder evaluation of the Baltimore City virtual supermarket program

Directory of Open Access Journals (Sweden)

Pooja Lagisetty

2017-10-01

Full Text Available Abstract Background Increasing access to healthy foods and beverages in disadvantaged communities is a public health priority due to alarmingly high rates of obesity. The Virtual Supermarket Program (VSP is a Baltimore City Health Department program that uses online grocery ordering to deliver food to low-income neighborhoods. This study evaluates stakeholder preferences and barriers of program implementation. Methods This study assessed the feasibility, sustainability and efficacy of the VSP by surveying 93 customers and interviewing 14 programmatic stakeholders who had recently used the VSP or been involved with program design and implementation. Results We identified the following themes: The VSP addressed transportation barriers and food availability. The VSP impacted customers and the city by including improving food purchasing behavior, creating a food justice “brand for the city”, and fostering a sense of community. Customers appreciated using Supplemental Nutrition Assistance Program (SNAP benefits to pay for groceries, but policy changes are needed allow online processing of SNAP benefits. Conclusions This evaluation summarizes lessons learned and serves as a guide to other public health leaders interested in developing similar programs. Provisions in the U.S. Department of Agriculture (USDA Farm Bill 2014 allow for select grocers to pilot online transactions with SNAP benefits. If these pilots are efficacious, the VSP model could be easily disseminated.

Communication Skills assessed at OSCE are not affected by Participation in the Adolescent Healthy Sexuality Program

Directory of Open Access Journals (Sweden)

Deborah Penava

2002-12-01

Full Text Available We proposed that first year medical students who voluntarily participated in the Healthy Sexuality adolescent program would perform better than their peers on an adolescent counseling station at the year-end OSCE (Objective Structured Clinical Examination. In addition we compared medical students’ communication skills at the time of the program as assessed by self, peers and participating adolescents. Methods: Nineteen first year medical students voluntarily participated in the ongoing Healthy Sexuality program. Adolescent participants, medical student peer participants and medical students assessed communication components on a 7-point Likert scale at the end of the program. At the year-end OSCE, all first year medical students at the University of Western Ontario were assessed at an adolescent counseling station by a standardized patient (SP and a physician examiner. Statistical analysis examined differences between the two groups. Results: Students who participated in the Healthy Sexuality program did not perform better than their colleagues on the year-end OSCE. A statistically significant correlation between physician examiner and SP evaluations was found (r = 0.62. Adolescent participants communication skills assessments in the Healthy Sexuality Program demonstrated no significant correlation with medical student assessments (self or peer. Conclusions:Voluntary intervention with adolescents did not result in improved communication skills at the structured year-end examination. Further investigation will be directed towards delineating differences between SP and physician examiner assessments.

Assessment of Student Outcomes in Undergraduate Health Information Administration Programs

OpenAIRE

Smith, Jody

2006-01-01

The purpose of this research was to a) determine what assessment methods are being used in undergraduate health information administration programs to assess student learning and the usefulness of those methods, b) determine to what extent programs have incorporated good student learning assessment practices. Programs use a variety of assessment tools to measure student learning; the most useful include assessments by the professional practice supervisor, course tests, assignments, presentati...

1976 Inter-university symposium on renewable resource assessment and programming: executive summary

Science.gov (United States)

Billy G. Pemberton

1977-01-01

The Forest and Rangeland Renewable Resources Planning Act of 1974 directs the Secretary of Agriculture to prepare an assessment of the nation's renewable resources and a program that will assure an adequate future supply of these resources. Responsibility for this work is assigned to the Forest Service. An inter-university symposium was held in 1976 to evaluate...

Material balance area custodian performance evaluation program at PNL

International Nuclear Information System (INIS)

Dickman, D.A.

1991-01-01

This paper reports that the material balance area (MBA) custodian has primary responsibility for control and accountability of nuclear material within an MBA. In this role, the custodian operates as an extension of the facility material control and accountability (MC and A) organization. To effectively meet administrative requirements and protection needs, the custodian must be fully trained in all aspects of MC and A related to the MBA, and custodian performance must be periodically evaluated. U.S. Department of Energy (DOE) Policy requires that each facility provide for a program which ensures that personnel performing MC and A functions are trained and/or qualified to perform their duties and responsibilities and knowledgeable of requirements and procedures related to their functions. the MBA Custodian Performance Evaluation Program at Pacific Northwest Laboratory (PNL) uses a variety of assessment techniques to meet this goal, including internal and independent MBA audits, periodic custodian testing, limited scope performance tests, daily monitoring of MC and A documentation, and reviewing custodian performance during physical inventories

Evaluation of research frame program on Energygases 2009 - 2012; Utvaerdering av Energimyndighetens kollektiv-forskningsprogram 'Energigastekniskt utvecklingsprogram 2009-2012'

Energy Technology Data Exchange (ETDEWEB)

Lilliestraale, Astrid; Johnsson, Filip

2012-07-01

This evaluation has been carried out with the purpose of evaluating the Energy Agency's collective research program 'Energigastekniskt utvecklingsprogram 2009 - 2012'. The evaluation concerning the current period (20090401 to 20130331) have focused on society, industry and universities benefit from the program. The assignment also includes assessing the working modalities of the program. The following points have been considered: 1. The program aims; a number of program-specific questions that focus on how the program helps to strengthen the relationship between industry and academia and the quality of R and D has been obtained from the Energy Authority. 2. Subareas - focus and priorities. 3. The benefits of the program, focusing on commercialization, information dissemination and international collaboration. 4. Administration of the program. The program evaluation has focused on the central and cross-cutting issues.

Development and Evaluation of a Novel Survey Tool Assessing Inpatient Consult Service Performance.

Science.gov (United States)

Miloslavsky, Eli M; Chang, Yuchiao

2017-12-01

Subspecialty consultation in inpatient medicine is increasing, and enhancing performance of consultation services may have a broad-reaching impact. Multisource feedback is an important tool in assessing competence and improving performance. A mechanism for primary team resident feedback on performance of consult services has not been described. We developed and evaluated an instrument designed to assess internal medicine (IM) subspecialty inpatient consult service performance. We hypothesized that the instrument would be feasible to administer and provide important information to fellowship directors. The instrument was administered in 2015 and 2016 at a single academic center. All IM residents were invited to evaluate 10 IM subspecialty consult services on 4 items and an overall satisfaction rating. The instrument allowed for free-text feedback to fellows. Program directors completed another survey assessing the impact of the consult service evaluation. A total of 113 residents responded (47 in 2015 and 66 in 2016, for a combined response rate of 35%). Each of the 4 items measured (communication, professionalism, teaching, and pushback) correlated significantly with the overall satisfaction rating in univariate and multivariate analyses. There were no differences in ratings across postgraduate year or year of administration. There was considerable variation in ratings among the services evaluated. The 7 program directors who provided feedback found the survey useful and made programmatic changes following evaluation implementation. A primary team resident evaluation of inpatient medicine subspecialty consult services is feasible, provides valuable information, and is associated with changes in consult service structure and curricula.

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

78 FR 59866 - New Car Assessment Program (NCAP)

Science.gov (United States)

2013-09-30

... further commented that additional consideration should be given to autonomous vehicle controls that may... [Docket No. NHTSA-2013-0076] New Car Assessment Program (NCAP) AGENCY: National Highway Traffic Safety... Car Assessment Program (NCAP) that the agency announced in its June 26, 2013 request for comments (78...

Evaluation of effects of program for improving skills and motivation for employment

Directory of Open Access Journals (Sweden)

Marić Zorica

2011-01-01

Full Text Available Contemporary programs that have been implemented in order to help unemployed reduce time for finding a job are based on clear theoretical background and empirical evidence. In addition to providing opportunities to learn necessary skills, these programs also incorporate important psychological components which will be addressed in this paper. The goal of these interventions is to reduce time for finding a job, prevent long-term unemployment and negative effects of unemployment on individuals“ mental health. The paper presents evaluation of the effects of these psychological interventions. The program was based on Ajzen’s theory of planned behavior (2005, Bandura’s social-cognitive theory (1997 and cognitive-behavior theory of behavioral change (Meichenbaum, 1993. The goal of this program was to help unemployed individuals take an active role in finding a job, reduce time for finding a job and prevent negative effects of unemployment on their mental health. The target group of the program were young unemployed individuals ages 19 - 30, with at least high school level of education. Evaluation study was conducted on a sample of 92 male and female individuals who attended 3-day psychological program. Participants filled out five short scales specifically designed to assess variables that were targeted for change, such as, active approach to finding a job, attitudes toward process of employment, self-efficacy and resilience to frustrations and obstacles. Scales were administered before and after the training. Evaluation results, based on these pre and post measures, showed significant positive effects of this program on all five variables.

Evaluating Behaviorally Oriented Aviation Maintenance Resource Management (MRM) Training and Programs: Methods, Results, and Conclusions

Science.gov (United States)

Taylor, James C.; Thomas, Robert L., III

2003-01-01

Assessment of the impact of Aviation Resource Management Programs on aviation culture and performance has compelled a considerable body of research (Taylor & Robertson, 1995; Taylor, 1998; Taylor & Patankar, 2001). In recent years new methods have been applied to the problem of maintenance error precipitated by factors such as the need for self-assessment of communication and trust. The present study - 2002 -- is an extension of that past work. This research project was designed as the conclusion of a larger effort to help understand, evaluate and validate the impact of Maintenance Resource Management (MRM) training programs, and other MRM interventions on participant attitudes, opinions, behaviors, and ultimately on enhanced safety performance. It includes research and development of evaluation methodology as well as examination of psychological constructs and correlates of maintainer performance. In particular, during 2002, three issues were addressed. First, the evaluation of two (independent & different) MRM programs for changing behaviors was undertaken. In one case we were able to further apply the approach to measuring written communication developed during 2001 (Taylor, 2002; Taylor & Thomas, 2003). Second, the MRM/TOQ surveys were made available for completion on the internet. The responses from these on-line surveys were automatically linked to a results calculator (like the one developed and described in Taylor, 2002) to aid industry users in analyzing and evaluating their local survey data on the internet. Third, the main trends and themes from our research about MRM programs over the past dozen years were reviewed.

Assessing the effects of regional payment for watershed services program on water quality using an intervention analysis model.

Science.gov (United States)

Lu, Yan; He, Tian

2014-09-15

Much attention has been recently paid to ex-post assessments of socioeconomic and environmental benefits of payment for ecosystem services (PES) programs on poverty reduction, water quality, and forest protection. To evaluate the effects of a regional PES program on water quality, we selected chemical oxygen demand (COD) and ammonia-nitrogen (NH3-N) as indicators of water quality. Statistical methods and an intervention analysis model were employed to assess whether the PES program produced substantial changes in water quality at 10 water-quality sampling stations in the Shaying River watershed, China during 2006-2011. Statistical results from paired-sample t-tests and box plots of COD and NH3-N concentrations at the 10 stations showed that the PES program has played a positive role in improving water quality and reducing trans-boundary water pollution in the Shaying River watershed. Using the intervention analysis model, we quantitatively evaluated the effects of the intervention policy, i.e., the watershed PES program, on water quality at the 10 stations. The results suggest that this method could be used to assess the environmental benefits of watershed or water-related PES programs, such as improvements in water quality, seasonal flow regulation, erosion and sedimentation, and aquatic habitat. Copyright © 2014 Elsevier B.V. All rights reserved.

What Do Students Learn when We Teach Peace? A Qualitative Assessment of a Theater Peace Program

Science.gov (United States)

Duckworth, Cheryl Lynn; Allen, Barb; Williams, Teri Triguba

2012-01-01

This is a qualitative assessment of a theater arts peace education program for high-school students. We present the results of qualitative interviews with students who participated in a peace education program. They tell us in their own words what they believe they learned. Given that most peace education evaluation is quantitative or focuses on…

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Evaluation of staff performance and interpretation of the screening program for prevention of thalassemia.

Science.gov (United States)

Prommetta, Simaporn; Sanchaisuriya, Kanokwan; Fucharoen, Goonnapa; Yamsri, Supawadee; Chaiboonroeng, Attawut; Fucharoen, Supan

2017-06-15

Thalassemia screening program has been implemented for years in Southeast Asia, but no external quality assessment program has been established. We have developed and initiated the proficiency testing (PT) program for the first time in Thailand with the aim to assess the screening performance of laboratory staff and their competency in interpretation of the screening results. Three PT cycles per year were organized. From the first to the third cycle of the PT scheme, a total number of participant laboratories increased from 59 to 67. In each cycle, 2 PT items (assigned as blood samples of the couple) were provided. Performance evaluation was based on the accuracy of screening results, i.e . mean corpuscular volume (MCV), mean corpuscular haemoglobin (MCH) and the dichlorophenolindophenol (DCIP) test for haemoglobin E, including the competency in interpretation of screening results and assessment of foetal risk. Performance was assessed by comparing the participants' result against the assigned value. Of all 3 cycles, most laboratories reported acceptable MCV and MCH values. From the first to the third cycle, incorrect DCIP test and misinterpretation rates were decreased while incorrect risk assessment varied by cycle to cycle. Combining the accuracy of thalassemia screening and the competency in interpretation and risk assessment, approximately half of participants showed excellent performance. Improved performance observed in many laboratories reflects the achievement and benefit of the PT program which should be regularly provided.

Evaluating the Accreditation Council on Graduate Medical Education core clinical competencies: techniques and feasibility in a urology training program.

Science.gov (United States)

Miller, David C; Montie, James E; Faerber, Gary J

2003-10-01

We describe several traditional and novel techniques for teaching and evaluating the Accreditation Council on Graduate Medical Education (ACGME) core clinical competencies in a urology residency training program. The evolution and underpinnings of the ACGME Outcome Project were reviewed. Several publications related to the evaluation of clinical competencies as well as current assessment techniques at our institution were also analyzed. Several tools for the assessment of clinical competencies have been developed and refined in response to the ACGME Outcome project. Standardized patient encounters and expanded patient satisfaction surveys may prove useful with regard to assessing resident professionalism, patient care and communication skills. A feasible and possibly undervalued technique for evaluating a number of core competencies is the implementation of formal written appraisals of the nature and quality of resident performance at departmental conferences. The assessment of competency in practice based learning and systems based practice may be achieved through innovative exercises, such as practice guideline development, that assess the evidence for various urologic interventions as well as the financial and administrative aspects of such care. We describe several contemporary methods for teaching and evaluating the core clinical competencies in a urology training program. While the techniques described are neither comprehensive nor feasible for every program, they nevertheless provide an important starting point for a meaningful exchange of ideas in the urological graduate medical education community.

Evaluation of the childhood obesity prevention program Kids - 'Go for your life'

Directory of Open Access Journals (Sweden)

Gibbs Lisa

2010-05-01

Full Text Available Abstract Background Kids - 'Go for your life' (K-GFYL is an award-based health promotion program being implemented across Victoria, Australia. The program aims to reduce the risk of childhood obesity by improving the socio-cultural, policy and physical environments in children's care and educational settings. Membership of the K-GFYL program is open to all primary and pre-schools and early childhood services across the State. Once in the program, member schools and services are centrally supported to undertake the health promotion (intervention activities. Once the K-GFYL program 'criteria' are reached the school/service is assessed and 'awarded'. This paper describes the design of the evaluation of the statewide K-GFYL intervention program. Methods/Design The evaluation is mixed method and cross sectional and aims to: 1 Determine if K-GFYL award status is associated with more health promoting environments in schools/services compared to those who are members only; 2 Determine if children attending K-GFYL award schools/services have higher levels of healthy eating and physical activity-related behaviors compared to those who are members only; 3 Examine the barriers to implementing and achieving the K-GFYL award; and 4 Determine the economic cost of implementing K-GFYL in primary schools Parent surveys will capture information about the home environment and child dietary and physical activity-related behaviors. Environmental questionnaires in early childhood settings and schools will capture information on the physical activity and nutrition environment and current health promotion activities. Lunchbox surveys and a set of open-ended questions for kindergarten parents will provide additional data. Resource use associated with the intervention activities will be collected from primary schools for cost analysis. Discussion The K-GFYL award program is a community-wide intervention that requires a comprehensive, multi-level evaluation. The evaluation

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Misprescribing controlled substances: An evaluation of a professional development program.

Science.gov (United States)

Dewey, Charlene M; Ghulyan, Marine V; Swiggart, William H

2016-01-01

Controlled prescription drug (CPD) abuse has reached epidemic proportions in the United States. Most physicians attending a 3-day continuing medical education (CME) professional development program (PDP) lack training in identifying risk and in managing patients who misuse CPDs. To address this issue, the authors conducted an evaluation of a PDP that trains physicians on proper prescribing, identifying substance abuse, utilizing screening, brief intervention, and referral to treatment (SBIRT), and implementing motivational interviewing (MI). The authors conducted a program evaluation to assess the efficacy and impact of the PDP on physicians' knowledge and prescribing behaviors. Participants (N = 174) were typically middle-aged (average age of 53 years), male (89%), and physicians (82%) and other health care professionals (18%). Many physicians practice in solo primary care settings (46%). Course evaluations were completed by n = 155 (89%) participants who rated the course and presenters highly (mean 4.8/5 respectively). Physicians' knowledge scores on pre/post assessments increased significantly: pretest (M = 58.7, SD = 13.12) and posttest (M = 78.28, SD = 9.83) (t(173) = 20.06, P ≤ .0001, 95% confidence interval, CI: [-21.51, -17.65]). Almost half of the participants, n = 83/174 (48%), completed the follow-up survey, and 93% agreed/strongly agreed (A/SA) they made professional practice changes. Of participants practicing with an active DEA (Drug Enforcement Administration) registration (n = 57), most agreed/strongly agreed they implemented changes to align their practices with current guidelines (89%), used CPD more appropriately (87%), implemented office policies on prescribing (81%), identified and referred more substance abuse patients to treatment (80%), shared new information/experience from course with other 25 health professionals (93%), and felt the course positively impacted their behaviors personally and professionally (90% and 96%, respectively

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Navy radon assessment and mitigation program: Final report

International Nuclear Information System (INIS)

1994-10-01

This final report encompasses the events from the beginning of the Navy Radon Assessment and Mitigation Program to the closure of the program on October 31, 1994. Included in the report are discussions of the phases of the program including screening, assessment, mitigation, and post-mitigation. The primary discussion involves screening and assessment. The report addresses recommendations made to the Naval Facilities Engineering Command by the Hazardous Waste Remedial Actions Program of Martin Marietta Energy Systems, Inc., and the final decisions that were made. Special emphasis is placed on quality assurance/quality control (QA/QC), since QA/QC was given top priority during the implementation of this program. Included in the discussion on QA/QC are ana overview of the measurement process, positive and negative controls, replicated measurements, and application of chamber exposures to data calibration. The report concludes with a discussion of testing considerations for naval facilities and radon mitigation considerations for the Department of the Navy

Peer Evaluation of Master Programs: Closing the Quality Circle of the CDIO Approach?

DEFF Research Database (Denmark)

Hussmann, Peter Munkebo; Bisi, Anita; Malmqvist, Johan

2012-01-01

programs within their field at another N5T institution. The article describes the quality enhancement tool in detail, its contribution to the development of the involved programs, and how international peer evaluation can contribute to closing the quality circle. Finally, it assesses the value......A quality assurance project was conducted within the framework of the Nordic Five Tech Alliance (N5T), a strategic alliance of the five leading technical universities in Denmark, Finland, Norway, and Sweden. The project concerned the development of a common quality enhancement tool for conducting...... peer evaluations of educational programs to enable their further development and close the quality circle. In addition, the project will contribute to the consolidation of the N5T alliance by facilitating contacts between faculty members and providing them with an in-depth knowledge of the study...

Assessment techniques for a learning-centered curriculum: evaluation design for adventures in supercomputing

Energy Technology Data Exchange (ETDEWEB)

Helland, B. [Ames Lab., IA (United States); Summers, B.G. [Oak Ridge National Lab., TN (United States)

1996-09-01

As the classroom paradigm shifts from being teacher-centered to being learner-centered, student assessments are evolving from typical paper and pencil testing to other methods of evaluation. Students should be probed for understanding, reasoning, and critical thinking abilities rather than their ability to return memorized facts. The assessment of the Department of Energy`s pilot program, Adventures in Supercomputing (AiS), offers one example of assessment techniques developed for learner-centered curricula. This assessment has employed a variety of methods to collect student data. Methods of assessment used were traditional testing, performance testing, interviews, short questionnaires via email, and student presentations of projects. The data obtained from these sources have been analyzed by a professional assessment team at the Center for Children and Technology. The results have been used to improve the AiS curriculum and establish the quality of the overall AiS program. This paper will discuss the various methods of assessment used and the results.

Systems analysis programs for hands-on integrated reliability evaluations (SAPHIRE), Version 5.0

International Nuclear Information System (INIS)

Russell, K.D.; Kvarfordt, K.J.; Hoffman, C.L.

1995-10-01

The Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) refers to a set of several microcomputer programs that were developed to create and analyze probabilistic risk assessments (PRAs), primarily for nuclear power plants. The Graphical Evaluation Module (GEM) is a special application tool designed for evaluation of operational occurrences using the Accident Sequence Precursor (ASP) program methods. GEM provides the capability for an analyst to quickly and easily perform conditional core damage probability (CCDP) calculations. The analyst can then use the CCDP calculations to determine if the occurrence of an initiating event or a condition adversely impacts safety. It uses models and data developed in the SAPHIRE specially for the ASP program. GEM requires more data than that normally provided in SAPHIRE and will not perform properly with other models or data bases. This is the first release of GEM and the developers of GEM welcome user comments and feedback that will generate ideas for improvements to future versions. GEM is designated as version 5.0 to track GEM codes along with the other SAPHIRE codes as the GEM relies on the same, shared database structure

Assessing Program Learning Objectives to Improve Undergraduate Physics Education

Science.gov (United States)

Menke, Carrie

2014-03-01

Our physics undergraduate program has five program learning objectives (PLOs) focusing on (1) physical principles, (2) mathematical expertise, (3) experimental technique, (4) communication and teamwork, and (5) research proficiency. One PLO is assessed each year, with the results guiding modifications in our curriculum and future assessment practices; we have just completed our first cycle of assessing all PLOs. Our approach strives to maximize the ease and applicability of our assessment practices while maintaining faculty's flexibility in course design and delivery. Objectives are mapped onto our core curriculum with identified coursework collected as direct evidence. We've utilized mostly descriptive rubrics, applying them at the course and program levels as well as sharing them with the students. This has resulted in more efficient assessment that is also applicable to reaccreditation efforts, higher inter-rater reliability than with other rubric types, and higher quality capstone projects. We've also found that the varied quality of student writing can interfere with our assessment of other objectives. This poster outlines our processes, resources, and how we have used PLO assessment to strengthen our undergraduate program.

Waste isolation safety assessment program. Task 4. Third contractor information meeting

International Nuclear Information System (INIS)

1980-06-01

The Contractor Information Meeting (October 14 to 17, 1979) was part of the FY-1979 effort of Task 4 of the Waste Isolation Safety Assessment Program (WISAP): Sorption/Desorption Analysis. The objectives of this task are to: evaluate sorption/desorption measurement methods and develop a standardized measurement procedure; produce a generic data bank of nuclide-geologic interactions using a wide variety of geologic media and groundwaters; perform statistical analysis and synthesis of these data; perform validation studies to compare short-term laboratory studies to long-term in situ behavior; develop a fundamental understanding of sorption/desorption processes; produce x-ray and gamma-emitting isotopes suitable for the study of actinides at tracer concentrations; disseminate resulting information to the international technical community; and provide input data support for repository safety assessment. Conference participants included those subcontracted to WISAP Task 4, representatives and independent subcontractors to the Office of Nuclear Waste Isolation, representatives from other waste disposal programs, and experts in the area of waste/geologic media interaction. Since the meeting, WISAP has been divided into two programs: Assessment of Effectiveness of Geologic Isolation Systems (AEGIS) (modeling efforts) and Waste/Rock Interactions Technology (WRIT) (experimental work). The WRIT program encompasses the work conducted under Task 4. This report contains the information presented at the Task 4, Third Contractor Information Meeting. Technical Reports from the subcontractors, as well as Pacific Northwest Laboratory (PNL), are provided along with transcripts of the question-and-answer sessions. The agenda and abstracts of the presentations are also included. Appendix A is a list of the participants. Appendix B gives an overview of the WRIT program and details the WRIT work breakdown structure for 1980

Waste isolation safety assessment program. Task 4. Third contractor information meeting

Energy Technology Data Exchange (ETDEWEB)

1980-06-01

The Contractor Information Meeting (October 14 to 17, 1979) was part of the FY-1979 effort of Task 4 of the Waste Isolation Safety Assessment Program (WISAP): Sorption/Desorption Analysis. The objectives of this task are to: evaluate sorption/desorption measurement methods and develop a standardized measurement procedure; produce a generic data bank of nuclide-geologic interactions using a wide variety of geologic media and groundwaters; perform statistical analysis and synthesis of these data; perform validation studies to compare short-term laboratory studies to long-term in situ behavior; develop a fundamental understanding of sorption/desorption processes; produce x-ray and gamma-emitting isotopes suitable for the study of actinides at tracer concentrations; disseminate resulting information to the international technical community; and provide input data support for repository safety assessment. Conference participants included those subcontracted to WISAP Task 4, representatives and independent subcontractors to the Office of Nuclear Waste Isolation, representatives from other waste disposal programs, and experts in the area of waste/geologic media interaction. Since the meeting, WISAP has been divided into two programs: Assessment of Effectiveness of Geologic Isolation Systems (AEGIS) (modeling efforts) and Waste/Rock Interactions Technology (WRIT) (experimental work). The WRIT program encompasses the work conducted under Task 4. This report contains the information presented at the Task 4, Third Contractor Information Meeting. Technical Reports from the subcontractors, as well as Pacific Northwest Laboratory (PNL), are provided along with transcripts of the question-and-answer sessions. The agenda and abstracts of the presentations are also included. Appendix A is a list of the participants. Appendix B gives an overview of the WRIT program and details the WRIT work breakdown structure for 1980.

International Code Assessment and Applications Program: Annual report

International Nuclear Information System (INIS)

Ting, P.; Hanson, R.; Jenks, R.

1987-03-01

This is the first annual report of the International Code Assessment and Applications Program (ICAP). The ICAP was organized by the Office of Nuclear Regulatory Research, United States Nuclear Regulatory Commission (USNRC) in 1985. The ICAP is an international cooperative reactor safety research program planned to continue over a period of approximately five years. To date, eleven European and Asian countries/organizations have joined the program through bilateral agreements with the USNRC. Seven proposed agreements are currently under negotiation. The primary mission of the ICAP is to provide independent assessment of the three major advanced computer codes (RELAP5, TRAC-PWR, and TRAC-BWR) developed by the USNRC. However, program activities can be expected to enhance the assessment process throughout member countries. The codes were developed to calculate the reactor plant response to transients and loss-of-coolant accidents. Accurate prediction of normal and abnormal plant response using the codes enhances procedures and regulations used for the safe operation of the plant and also provides technical basis for assessing the safety margin of future reactor plant designs. The ICAP is providing required assessment data that will contribute to quantification of the code uncertainty for each code. The first annual report is devoted to coverage of program activities and accomplishments during the period between April 1985 and March 1987

Best Practices in Physics Program Assessment: Should APS Provide Accreditation Standards for Physics?

Science.gov (United States)

Hodapp, Theodore

The Phys21 report, ``Preparing Physics Students for 21st Century Careers,'' provides guidance for physics programs to improve their degree programs to make them more relevant for student career choices. Undertaking such changes and assessing impact varies widely by institution, with many departments inventing assessments with each periodic departmental or programmatic review. American Physical Society has embarked on a process to integrate information from Phys21, the results of other national studies, and educational research outcomes to generate a best-practices guide to help physics departments conduct program review, assessment, and improvement. It is anticipated that departments will be able to use this document to help with their role in university-level accreditation, and in making the case for improvements to departmental programs. Accreditation of physics programs could stem from such a document, and I will discuss some of the thinking of the APS Committee on Education in creating this guide, and how they are advising APS to move forward in the higher education landscape that is increasingly subject to standards-based evaluations. I will describe plans for the design, review, and dissemination of this guide, and how faculty can provide input into its development. This material is based upon work supported by the National Science Foundation under Grant No. 1540570. Opinions expressed do not necessarily reflect those of the NSF.

Pilot evaluation of the Computer-Based Assessment for Sampling Personal Characteristics test.

Science.gov (United States)

Shipper, Edward S; Mazer, Laura M; Merrell, Sylvia Bereknyei; Lin, Dana T; Lau, James N; Melcher, Marc L

2017-07-01

High attrition rates hint at deficiencies in the resident selection process. The evaluation of personal characteristics representative of success is difficult. Here, we evaluate a novel tool for assessing personal characteristics. To evaluate feasibility, we used an anonymous voluntary survey questionnaire offered to study participants before and after contact with the CASPer test. To evaluate the CASPer test as a predictor of success, we compared CASPer test assessments of personal characteristics versus traditional faculty assessment of personal characteristics with applicant rank list position. All applicants (n = 77) attending an in-person interview for general surgery residency, and all faculty interviewers (n = 34) who reviewed these applications were invited to participate. Among applicants, 84.4% of respondents (65 of 77) reported that a requirement to complete the CASPer test would have no bearing or would make them more likely to apply to the program (mean = 3.30, standard deviation = 0.96). Among the faculty, 62.5% respondents (10 of 16) reported that the same condition would have no bearing or would make applicants more likely to apply to the program (mean = 3.19, standard deviation = 1.33). The Spearman's rank-order correlation coefficients for the relationships between traditional faculty assessment of personal characteristics and applicant rank list position, and novel CASPer assessment of personal characteristics and applicant rank list position, were -0.45 (P = 0.033) and -0.41 (P = 0.055), respectively. The CASPer test may be feasibly implemented as component of the resident selection process, with the potential to predict applicant rank list position and improve the general surgery resident selection process. Copyright © 2017 Elsevier Inc. All rights reserved.

Summative assessment in a doctor of pharmacy program: a critical insight

Directory of Open Access Journals (Sweden)

Wilbur K

2015-02-01