[Uses and influence of health evaluation in two studies on the Brazilian National Dengue Fever Control Program].

Science.gov (United States)

Figueiró, Ana Cláudia; Hartz, Zulmira; Samico, Isabella; Cesse, Eduarda Angela Pessoa

2012-11-01

Evaluation aims to provide information, promote improvement in programs, and determine the merit and value of the object of evaluation. However, the challenge for evaluators is not only to promote, but also to document the usefulness of studies. Given this challenge, the article aimed to systematize the uses and influence of the process and findings in two evaluations on Brazilian National Dengue Fever Control Program, for decision-making by the respective public health administrators and professionals. Based on a theoretical analytical model, an exploratory study was performed with documental analysis for identification of events and registrations in the evaluations and their circulation in terms of possible uses and influence, from 2007 to 2010. Favorable factors for the use of evaluations were the mode of production of contextual knowledge and definition of evaluations with a focus on utility. The results, indicating greater instrumental use and immediate process and collective use may indicate the studies' pertinence to stakeholders and their usefulness to program management at different levels in the health system.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

Energy Technology Data Exchange (ETDEWEB)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il [Korea Atomic Energy Research Institute, Daejeon (Korea, Republic of)

2015-10-15

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

International Nuclear Information System (INIS)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il

2015-01-01

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit

Building a patient-centered and interprofessional training program with patients, students and care professionals: study protocol of a participatory design and evaluation study.

Science.gov (United States)

Vijn, Thomas W; Wollersheim, Hub; Faber, Marjan J; Fluit, Cornelia R M G; Kremer, Jan A M

2018-05-30

A common approach to enhance patient-centered care is training care professionals. Additional training of patients has been shown to significantly improve patient-centeredness of care. In this participatory design and evaluation study, patient education and medical education will be combined by co-creating a patient-centered and interprofessional training program, wherein patients, students and care professionals learn together to improve patient-centeredness of care. In the design phase, scientific literature regarding interventions and effects of student-run patient education will be synthesized in a scoping review. In addition, focus group studies will be performed on the preferences of patients, students, care professionals and education professionals regarding the structure and content of the training program. Subsequently, an intervention plan of the training program will be constructed by combining these building blocks. In the evaluation phase, patients with a chronic disease, that is rheumatoid arthritis, diabetes and hypertension, and patients with an oncologic condition, that is colonic cancer and breast cancer, will learn together with medical students, nursing students and care professionals in training program cycles of three months. Process and effect evaluation will be performed using the plan-do-study-act (PDSA) method to evaluate and optimize the training program in care practice and medical education. A modified control design will be used in PDSA-cycles to ensure that students who act as control will also benefit from participating in the program. Our participatory design and evaluation study provides an innovative approach in designing and evaluating an intervention by involving participants in all stages of the design and evaluation process. The approach is expected to enhance the effectiveness of the training program by assessing and meeting participants' needs and preferences. Moreover, by using fast PDSA cycles and a modified control design

"Evaluation as Illumination: A New Approach to the Study of Innovatory Programs". Occasional Paper.

Science.gov (United States)

Parlett, Malcolm; Hamilton, David

Conventional approaches to program evaluation have followed the experimental and psychometric traditions dominant in educational research. Their aim (unfulfilled) of achieving fully objective methods had led to studies that are artificial and restricted in scope. Illuminative evaluation is introduced as a total re-appraisal of the rationale and…

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Pilot Evaluation Study of the Life Skills Program REBOUND

Directory of Open Access Journals (Sweden)

Henrik Jungaberle

2015-11-01

Full Text Available The main aim of the study is pilot evaluation of the life skills program REBOUND in a school context focusing on substance use, risk perception, and knowledge about psychoactive substances ( n IG + CG = 723 students in five schools and 46 classes, Mage = 14.8, range 14-18 for the total sample and in the subgroups gender, age, and school type. Main goal of the study is collecting evidence for program optimization. A controlled study was carried out with repeated measurement before and after the intervention (4-6 months. Multilevel analyses, ANCOVA, and logistic regression analyses were applied to measure the effects. Overall, significantly lower incidence rates of drunkenness (odds ratio [OR] = .55; p = .033, improved knowledge about psychoactive substances (p = .006, lower personal (p = .013 and general tobacco risk perception among users (p = .002, and lower general tobacco (p = .018 and cannabis (p = .000 risk perception in non-users were found in the total intervention group. In subgroups, significantly lower rates for the incidence of drunkenness can be shown for males (p = .008 and for younger participants (p = .004. Students at academic high school (German Gymnasium showed a decrease in 30-day prevalence for alcohol (p = .017 and cannabis (p = .014, and they improved in their knowledge about psychoactive substances (p = .000. In vocational high school classes (German Realschule, there was an increase in the relative alcohol risk perception of the students (p = .019. REBOUND contributes to a controlled use of alcohol and increases knowledge about psychoactive substances. REBOUND has various effects on the examined subgroups age, gender, and school type: Males, younger students, and students in academic high school benefitted more from the course regarding consumption-related criteria. We suggest a program optimization specific to school form and age, inclusion of a tobacco intervention, and the use of more gender-segregated interventions.

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

Developing and Using a Logic Model for Evaluation and Assessment of University Student Affairs Programming: A Case Study

Science.gov (United States)

Cooper, Jeff

2009-01-01

This dissertation addresses theory and practice of evaluation and assessment in university student affairs, by applying logic modeling/program theory to a case study. I intend to add knowledge to ongoing dialogue among evaluation scholars and practitioners on student affairs program planning and improvement as integral considerations that serve…

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

Evaluating and operationalizing an environmental auditing program: a pilot study.

Science.gov (United States)

Gordon, Laura; Bruce, Natalie; Suh, Kathryn N; Roth, Virginia

2014-07-01

Environmental auditing is an important tool to ensure consistent and effective cleaning. Our pilot study compared an alcohol-based fluorescent marking product and an adenosine-5'-triphosphate bioluminescence product for use in an environmental auditing program to determine which product was more practical and acceptable to users. Both products were tested on 15 preselected high touch objects in randomly selected patient rooms, following regular daily cleaning. A room was considered a "pass" if ≥80% of surfaces were adequately cleaned as defined by manufacturers' guidelines. A qualitative survey assessed user preference and operational considerations. Using fluorescent marking, 9 of 37 patient rooms evaluated (24%) were considered a "pass" after daily cleaning. Using adenosine-5'-triphosphate bioluminescence, 21 of 37 patient rooms passed (57%). There was great variability in results between different high touch objects. Eighty percent of users preferred the alcohol-based fluorescent marking product because it provided an effective visual aid to coach staff on proper cleaning techniques and allowed simple and consistent application. Environmental auditing using translucent, alcohol-based fluorescent marking best met the requirements of our organization. Our results reinforce the importance of involving a multidisciplinary team in evaluating and operationalizing an environmental auditing program. Copyright © 2014 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Mosby, Inc. All rights reserved.

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

Science.gov (United States)

Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

2016-03-01

Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol.

Science.gov (United States)

Ware, Patrick; Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-05-03

Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. The telemonitoring program was launched in

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

An Evaluative Study of an ICT Module for a School Leadership and Management Preparation Program

Science.gov (United States)

Musgrave, Sarietjie; De Wet, Corene

2017-01-01

This study reports on findings of an evaluative study on the effectiveness of an information and communication technology (ICT) module that forms part of the Advanced Certificate in Education: School Leadership and Management program. The study was carried out among distance education (DE) students from the University of the Free State enrolled…

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Development and evaluation of a self care program on breastfeeding in Japan: A quasi-experimental study

Directory of Open Access Journals (Sweden)

Awano Masayo

2010-08-01

Full Text Available Abstract Background Although the importance of breastfeeding is well known in Japan, in recent years less than 50% of mothers were fully breastfeeding at one month after birth. The purpose of this study was to develop a self-care program for breastfeeding aimed at increasing mothers' breastfeeding confidence and to evaluate its effectiveness. Methods A quasi-experimental pretest-posttest design was conducted in Japan. The intervention, a breastfeeding self-care program, was created to improve mothers' self-efficacy for breastfeeding. This Breastfeeding Self-Care Program included: information on the advantages and basics of breastfeeding, a breastfeeding checklist to evaluate breastfeeding by mothers and midwives, and a pamphlet and audiovisual materials on breastfeeding. Mothers received this program during their postpartum hospital stay. A convenience sample of 117 primiparous women was recruited at two clinical sites from October 2007 to March 2008. The intervention group (n = 55, who gave birth in three odd-numbered months, received standard care and the Breastfeeding Self-Care Program while the control group (n = 62 gave birth in three even numbered months and received standard breastfeeding care. To evaluate the effectiveness of the Breastfeeding Self-Care Program, breastfeeding self-efficacy and breastfeeding rate were measured early postpartum, before the intervention, and after the intervention at one month postpartum. The study used the Japanese version of The Breastfeeding Self-Efficacy Scale Short Form (BSES-SF to measure self-efficacy. Results The BSES-SF score of the intervention group rose significantly from 34.8 at early postpartum to 49.9 at one month after birth (p Conclusion Results indicate that the Breastfeeding Self-Care Program increased mothers' self-efficacy for breastfeeding and had a positive effect on the continuation of breastfeeding. Trial Registration Number UMIN000003517

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

The Effect of Persuasion on the Utilization of Program Evaluation Information: A Preliminary Study.

Science.gov (United States)

Eason, Sandra H.; Thompson, Bruce

The utilization of program evaluation may be made more effective by means of the application of contemporary persuasion theory. The Elaboration Likelihood Model--a model of cognitive processing, ability, and motivation--was used in this study to test the persuasive effects of source credibility and involvement on message acceptance of evaluation…

Study protocol for the evaluation of an Infant Simulator based program delivered in schools: a pragmatic cluster randomised controlled trial

OpenAIRE

Brinkman, Sally A; Johnson, Sarah E; Lawrence, David; Codde, James P; Hart, Michael B; Straton, Judith AY; Silburn, Sven

2010-01-01

Abstract Background This paper presents the study protocol for a pragmatic randomised controlled trial to evaluate the impact of a school based program developed to prevent teenage pregnancy. The program includes students taking care of an Infant Simulator; despite growing popularity and an increasing global presence of such programs, there is no published evidence of their long-term impact. The aim of this trial is to evaluate the Virtual Infant Parenting (VIP) program by investigating pre-c...

Manipulator system man-machine interface evaluation program. [technology assessment

Science.gov (United States)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.

2000-01-01

The action program Energy 2000 has been continually reviewed by independent experts in view of its effects. This resulted in around 50 scientific studies between 1991 and 1999, dealing with different aspects of the program. In the book 'Energy 2000: effects of the program and conclusions from its evaluation', the results of these evaluations are summarised, and conclusions for the design of the follow-up program are drawn. The organisational frame of the program is presented and the question answered whether the determining principles of the program proved practical. Besides, the effects of state intervention, of the conflict solving groups and the voluntary actions of Energy 2000 are appraised. A separate chapter is dedicated to the evaluation strategy of the program, its implementation and the benefits of the evaluations. Propositions for the evaluation of the follow-up program are formulated as well. Dr. Andreas Balthasar is President of the Swiss Evaluation Society. (author)

Program Evaluation - Automotive Lightweighting Materials Program Research and Development Projects Assessment of Benefits - Case Studies No. 2

Energy Technology Data Exchange (ETDEWEB)

Das, S.

2003-01-23

This report is the second of a series of studies to evaluate research and development (R&D) projects funded by the Automotive Lightweighting Materials (ALM) Program of the Office of Advanced Automotive Technologies (OAAT) of the U.S. Department of Energy (DOE). The objectives of the program evaluation are to assess short-run outputs and long-run outcomes that may be attributable to the ALM R&D projects. The ALM program focuses on the development and validation of advanced technologies that significantly reduce automotive vehicle body and chassis weight without compromising other attributes such as safety, performance, recyclability, and cost. Funded projects range from fundamental materials science research to applied research in production environments. Collaborators on these projects include national laboratories, universities, and private sector firms, such as leading automobile manufacturers and their suppliers. Three ALM R&D projects were chosen for this evaluation: Design and Product Optimization for Cast Light Metals, Durability of Lightweight Composite Structures, and Rapid Tooling for Functional Prototyping of Metal Mold Processes. These projects were chosen because they have already been completed. The first project resulted in development of a comprehensive cast light metal property database, an automotive application design guide, computerized predictive models, process monitoring sensors, and quality assurance methods. The second project, the durability of lightweight composite structures, produced durability-based design criteria documents, predictive models for creep deformation, and minimum test requirements and suggested test methods for establishing durability properties and characteristics of random glass-fiber composites for automotive structural composites. The durability project supported Focal Project II, a validation activity that demonstrates ALM program goals and reduces the lead time for bringing new technology into the marketplace. Focal

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

An Evaluative Study of the WOW Program on Patients' Satisfaction in Acute Psychiatric Units

Directory of Open Access Journals (Sweden)

Xie Huiting

2013-01-01

Full Text Available Background: Patient satisfaction is one of the key evidence of the quality of health-care delivery in nursing. Nursing is a patient-centered activity; although nurse-patient interaction is one of the key tenets of mental health nursing, a structured program to enhance this interaction is lacking. To address the gap, the WOW program was developed in a psychiatric hospital but its effectivenesss had not been evaluated.Objective: This study aims to compare satisfaction levels between patients who have undertaken the WOW program and those who have not.Methodology: A comparative survey design was employed for this study. A purposive sample of 91 adults was obtained from two inpatient psychiatric units: one where the WOW program had beenimplemented and the other, a matched control unit. After patients had been admitted to one of the two inpatient psychiatric units for a week, a questionnaire, modified from the Newcastle Satisfaction with Nursing Scale (NSNS, was administered to participants to assess their level of satisfaction with nursing care.Results and Conclusion: When the satisfaction scores of participants in the WOW group and the control group were compared, it was revealed that the WOW group was more satisfied with nursing care than the control group. Though the difference was not statistically significant, the potential of a structured nurse-patient interaction program to enhance patients’ satisfaction is encouraging. Theresults of this study offer valuable information that may direct the future enhancement and development of programs to improve patient satisfaction.

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

Conduct of a meta review of programme evaluations : a case study of the SEARCH Program

OpenAIRE

Dickson, Rumona; Tight, Malcolm; Saunders, Murray

2012-01-01

This thesis presents a retrospective case study that critically examines the evaluations that were undertaken as part of a continuing professional development (CPD) programme for health care professionals. The case is the SEARCH Program, an innovative CPD programme, which was designed to promote the implementation of evidence based practice (EBP) within the existing health care system in Alberta, Canada. Two approaches from the ‘using’ branch of Alkin and Chrisite’s evaluation theory tree are...

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

Quasi-Experimental Evaluation of a Student Mentoring Program

OpenAIRE

Sandner, Malte

2013-01-01

This paper presents evidence from a natural-experiment which evaluates the effectiveness of a student mentoring program. The mentoring includes several compulsory, scheduled, faceto- face appointments between a mentor and a student in the first study year. All mentors are graduated and employed by the institution. For the evaluation, I use the fact that the mentoring is only offered to students in an economics and management program, whereas it is not offered to students in an industrial engi...

Development and evaluation of a leadership training program for public health emergency response: results from a Chinese study

Directory of Open Access Journals (Sweden)

Xu Yihua

2008-10-01

Full Text Available Abstract Background Since the 9/11 attack and severe acute respiratory syndrome (SARS, the development of qualified and able public health leaders has become a new urgency in building the infrastructure needed to address public health emergencies. Although previous studies have reported that the training of individual leaders is an important approach, the systemic and scientific training model need further improvement and development. The purpose of this study was to develop, deliver, and evaluate a participatory leadership training program for emergency response. Methods Forty-one public health leaders (N = 41 from five provinces completed the entire emergency preparedness training program in China. The program was evaluated by anonymous questionnaires and semi-structured interviews held prior to training, immediately post-training and 12-month after training (Follow-up. Results The emergency preparedness training resulted in positive shifts in knowledge, self-assessment of skills for public health leaders. More than ninety-five percent of participants reported that the training model was scientific and feasible. Moreover, the response of participants in the program to the avian influenza outbreak, as well as the planned evaluations for this leadership training program, further demonstrated both the successful approaches and methods and the positive impact of this integrated leadership training initiative. Conclusion The emergency preparedness training program met its aims and objectives satisfactorily, and improved the emergency capability of public health leaders. This suggests that the leadership training model was effective and feasible in improving the emergency preparedness capability.

The International Endometriosis Evaluation Program (IEEP Study) - A Systematic Study for Physicians, Researchers and Patients.

Science.gov (United States)

Burghaus, S; Fehm, T; Fasching, P A; Blum, S; Renner, S K; Baier, F; Brodkorb, T; Fahlbusch, C; Findeklee, S; Häberle, L; Heusinger, K; Hildebrandt, T; Lermann, J; Strahl, O; Tchartchian, G; Bojahr, B; Porn, A; Fleisch, M; Reicke, S; Füger, T; Hartung, C-P; Hackl, J; Beckmann, M W; Renner, S P

2016-08-01

Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers.

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Educational Program Evaluation Model, From the Perspective of the New Theories

Directory of Open Access Journals (Sweden)

Soleiman Ahmady

2014-05-01

Full Text Available Introduction: This study is focused on common theories that influenced the history of program evaluation and introduce the educational program evaluation proposal format based on the updated theory. Methods: Literature searches were carried out in March-December 2010 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface, ERIC (Education Resources Information Center and the main journal of medical education regarding current evaluation models and theories. We included all study designs in our study. We found 810 articles related to our topic, and finally 63 with the full text article included. We compared documents and used expert consensus for selection the best model. Results: We found that the complexity theory using logic model suggests compatible evaluation proposal formats, especially with new medical education programs. Common components of a logic model are: situation, inputs, outputs, and outcomes that our proposal format is based on. Its contents are: title page, cover letter, situation and background, introduction and rationale, project description, evaluation design, evaluation methodology, reporting, program evaluation management, timeline, evaluation budget based on the best evidences, and supporting documents. Conclusion: We found that the logic model is used for evaluation program planning in many places, but more research is needed to see if it is suitable for our context.

Evaluating a Psychology Graduate Student Peer Mentoring Program

Science.gov (United States)

Fleck, Christina; Mullins, Morell E.

2012-01-01

Research on mentoring outcomes and characteristics of various types of mentoring programs in different settings is limited. The present study sampled 39 graduate students at a small Midwestern university to evaluate peer mentoring in a graduate school setting. Mentoring function and outcome relationships as well as program characteristics were…

Evaluation Study of Short-Term Programs at a Residential School for Students Who Are Blind and Visually Impaired

Science.gov (United States)

Pogrund, Rona L.; Darst, Shannon; Boland, Teryl

2013-01-01

Introduction: The results of a 2009-2010 program evaluation study that examined parents, teachers of students with visual impairments, administrators, and students regarding overall satisfaction with and effectiveness of the short-term programs at a residential school for students who are blind and visually impaired are described. The findings are…

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

Science.gov (United States)

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

Science.gov (United States)

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Women's Studies Collections: A Checklist Evaluation

Science.gov (United States)

Bolton, Brooke A.

2009-01-01

A checklist evaluation on thirty-seven Women's Studies programs conducted using the individual institutions' online public access catalogs (OPACs) is presented. Although Women's Studies collections are very difficult to build, an evaluation of existing programs shows that collections, for the most part, have managed substantial coverage of the…

Evaluating a food bank recipe-tasting program.

Science.gov (United States)

Keller-Olaman, Susan J; Edwards, Vicki; Elliott, Susan J

2005-01-01

Food banks mitigate immediate food insecurity, but their ability to promote healthy nutrition is constrained by how often recipients may visit and the range of foods available. In a descriptive study, a formative evaluation was completed of a combined heart-healthy recipe-tasting and education program that aims to promote healthy eating knowledge and skills in a group of food bank recipients in Hamilton, Ontario. Fifty-five adults were surveyed about food bank attendance, program awareness, perceived enhancement of knowledge and skills, and suggestions for program improvement. Most participants (73%) were positive about the program, and 91% wanted the program to continue. In addition, 78% would prepare the recipes sampled. In contrast, program awareness and planning food bank visits to coincide with the program were generally low. Food banks are potential sites for effective nutrition promotion programs. To reach more recipients, more frequent implementation and seeking the use of a designated room are suggested for the current program. The findings also suggest that the sampling approach to promoting healthy eating to food bank recipients deserves further study. For example, monitoring the selection of featured recipe ingredients would be a useful indicator of behaviour.

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs

Directory of Open Access Journals (Sweden)

Chloe S. Gordon

2017-02-01

Full Text Available Abstract Background Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children’s drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Methods Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews, program evaluation questionnaires completed by children (n = 166, lesson observations completed by teachers (n = 35 observations, and reflective journal entries completed by the researcher (n = 44 entries. A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Results Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students’ life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs.

Science.gov (United States)

Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J

2017-02-02

Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Evaluating the Impact of the U.S. National Toxicology Program: A Case Study on Hexavalent Chromium.

Science.gov (United States)

Xie, Yun; Holmgren, Stephanie; Andrews, Danica M K; Wolfe, Mary S

2017-02-01

Evaluating the impact of federally funded research with a broad, methodical, and objective approach is important to ensure that public funds advance the mission of federal agencies. We aimed to develop a methodical approach that would yield a broad assessment of National Toxicology Program's (NTP's) effectiveness across multiple sectors and demonstrate the utility of the approach through a case study. A conceptual model was developed with defined activities, outputs (products), and outcomes (proximal, intermediate, distal) and applied retrospectively to NTP's research on hexavalent chromium (CrVI). Proximal outcomes were measured by counting views of and requests for NTP's products by external stakeholders. Intermediate outcomes were measured by bibliometric analysis. Distal outcomes were assessed through Web and LexisNexis searches for documents related to legislation or regulation changes. The approach identified awareness of NTP's work on CrVI by external stakeholders (proximal outcome) and citations of NTP's research in scientific publications, reports, congressional testimonies, and legal and policy documents (intermediate outcome). NTP's research was key to the nation's first-ever drinking water standard for CrVI adopted by California in 2014 (distal outcome). By applying this approach to a case study, the utility and limitations of the approach were identified, including challenges to evaluating the outcomes of a research program. This study identified a broad and objective approach for assessing NTP's effectiveness, including methodological needs for more thorough and efficient impact assessments in the future. Citation: Xie Y, Holmgren S, Andrews DMK, Wolfe MS. 2017. Evaluating the impact of the U.S. National Toxicology Program: a case study on hexavalent chromium. Environ Health Perspect 125:181-188; http://dx.doi.org/10.1289/EHP21.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

AN EVALUATIVE STUDY OF AN ICT MODULE FOR A SCHOOL LEADERSHIP AND MANAGEMENT PREPARATION PROGRAM

Directory of Open Access Journals (Sweden)

Sarietjie MUSGRAVE

2017-04-01

Full Text Available This study reports on findings of an evaluative study on the effectiveness of an information and communication technology (ICT module that forms part of the Advanced Certificate in Education: School Leadership and Management program. The study was carried out among distance education (DE students from the University of the Free State enrolled for above mentioned module. Two ICT audit surveys were used to gather data. This study used two modes of evaluation: Jung and Latchem’s (2007 quality indicators for DE and comparison. The findings highlight ready access to ICT, technical support, appropriate guidance and support by knowledgeable, innovative and committed facilitators and the creation of a sense of community as imperatives for teaching education leaders ICT skills and knowledge.

Evaluation of a Hospital-Based Pneumonia Nurse Navigator Program.

Science.gov (United States)

Seldon, Lisa E; McDonough, Kelly; Turner, Barbara; Simmons, Leigh Ann

2016-12-01

The aim of this study is to evaluate the effectiveness of a hospital-based pneumonia nurse navigator program. This study used a retrospective, formative evaluation. Data of patients admitted from January 2012 through December 2014 to a large community hospital with a primary or secondary diagnosis of pneumonia, excluding aspiration pneumonia, were used. Data included patient demographics, diagnoses, insurance coverage, core measures, average length of stay (ALOS), disposition, readmission rate, financial outcomes, and patient barriers to care were collected. Descriptive statistics and parametric testing were used to analyze data. Core measure performance was sustained at the 90th percentile 2 years after the implementation of the navigator program. The ALOS did not decrease to established benchmarks; however, the SD for ALOS decreased by nearly half after implementation of the navigator program, suggesting the program decreased the number and length of extended stays. Charges per case decreased by 21% from 2012 to 2014. Variable costs decreased by 4% over a 2-year period, which increased net profit per case by 5%. Average readmission payments increased by 8% from 2012 to 2014, and the net revenue per case increased by 8.3%. The pneumonia nurse navigator program may improve core measures, reduce ALOS, and increase net revenue. Future evaluations are necessary to substantiate these findings and optimize the cost and quality performance of navigator programs.

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Effectiveness and Evaluation of Crime Prevention Programs in Minas Gerais

Directory of Open Access Journals (Sweden)

Claudio Beato

2014-05-01

Full Text Available This essay analyzes previous studies evaluating the effectiveness of the crime prevention policies adopted by the Government of Minas Gerais (Brazil. In this work, greater emphasis is placed on studies evaluating outcomes than on studies dealing with the process of setting up and implementing programs and projects. In order to allow a more systematic discussion, the Maryland Scale, which categorizes research and evaluations according to the methodological strengths and weaknesses in five levels, is employed. Subsequently, the authors draw a parallel between Brazil and other settings. Finally, this essay lays out the implications of this discussion regarding the prevention programs. 

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

Science.gov (United States)

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program

Directory of Open Access Journals (Sweden)

Ebrahim Jaafaripooyan

2014-09-01

Full Text Available Background Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs and professionals were approached for two-stage process of data collection. Results Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Evaluation of Pre-Departure English Training Program

Directory of Open Access Journals (Sweden)

Ali Saukah

2016-02-01

Full Text Available The program evaluation reported in this article covers three batches of participants, from 1996 through 1997, sponsored by the Directorate General of Higher Education projects to prepare faculty members of teacher training institutions for overseas studies. The result outcomes could be achieved when the initial English competence requirred for participating in the program was at least at the Pre-Advanced level. The criterion validity of the TOEFL-Equivalent test developed by the program was assured, and the test could, therefore, be used as a good predictor of the International TOEFL. Other recommendations are also given for the improvement of the planning and implementation of the program in the future

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

The International Endometriosis Evaluation Program (IEEP Study) – A Systematic Study for Physicians, Researchers and Patients

Science.gov (United States)

Burghaus, S.; Fehm, T.; Fasching, P. A.; Blum, S.; Renner, S. K.; Baier, F.; Brodkorb, T.; Fahlbusch, C.; Findeklee, S.; Häberle, L.; Heusinger, K.; Hildebrandt, T.; Lermann, J.; Strahl, O.; Tchartchian, G.; Bojahr, B.; Porn, A.; Fleisch, M.; Reicke, S.; Füger, T.; Hartung, C.-P.; Hackl, J.; Beckmann, M. W.; Renner, S. P.

2016-01-01

Introduction: Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. Material and Methods: To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. Results: A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. Conclusion: The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers. PMID:27582581

SISTEM PENDUKUNG KEPUTUSAN UNTUK MENGEVALUASI INTERNAL PROGRAM STUDI

Directory of Open Access Journals (Sweden)

Indhitya Rahman Padiku

2016-04-01

Full Text Available The development of major and study program cannot be separated by some internal factors weather directly influenced number of new registration students or indirectly. It needs a method to both know and to analyze internal evaluation variables in major or study program. Naive Bayes Clasifier (NBC method is the simple form of Bayesian network that assume all features are independent each other. NBC shows us a great performance entirely in accuracy and error level classification. NBC is able to differentiate irrelevance attribute and also classified some attributes in prediction needs. This research hopefully can be useful for major internal evaluating and study program in order to increase the number of new registration students. The classification by influenced of variables to evaluate the condition of both major and study program for the new registration students.

Evaluating the impacts of the clean cities program.

Science.gov (United States)

Qiu, Shiyong; Kaza, Nikhil

2017-02-01

The Department of Energy's Clean Cities program was created in 1993 to reduce petroleum usage in the transportation sector. The program promotes alternative fuels such as biofuels and fuel-saving strategies such as idle reduction and fleet management through coalitions of local government, non-profit, and private actors. Few studies have evaluated the impact of the program because of its complexity that include interrelated strategies of grants, education and training and diversity of participants. This paper uses a Difference-in-Differences (DiD) approach to evaluate the effectiveness of the program between 1990 and 2010. We quantify the effectiveness of the Clean Cities program by focusing on performance measures such as air quality, number of alternative fueling stations, private vehicle occupancy and transit ridership. We find that counties that participate in the program perform better on all these measures compared to counties that did not participate. Compared to the control group, counties in the Clean Cities program experienced a reduction in days with bad air quality (3.7%), a decrease in automobile commuters (2.9%), an overall increase in transit commuters (2.1%) and had greater numbers of new alternative fueling stations (12.9). The results suggest that the program is a qualified success. Copyright © 2016 Elsevier B.V. All rights reserved.

The SBIRT program matrix: a conceptual framework for program implementation and evaluation.

Science.gov (United States)

Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna

2017-02-01

Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

An Evaluation System for Training Programs: A Case Study Using a Four-Phase Approach

Science.gov (United States)

Lingham, Tony; Richley, Bonnie; Rezania, Davar

2006-01-01

Purpose: With the increased importance of training in organizations, creating important and meaningful programs are critical to an organization and its members. The purpose of this paper is to suggest a four-phase systematic approach to designing and evaluating training programs that promotes collaboration between organizational leaders, trainers,…

Formative Evaluation of the No-Fee Teacher Education Program from the Students' Standpoint

Science.gov (United States)

Han, Yumei; Hu, Meizhong; Li, Ling

2013-01-01

This exploratory case study applied a formative evaluation framework to evaluate the no-fee teacher education program at Southwest University. The study focused on the students' perspective and their perceptions of the program, both intrinsic and extrinsic. A self-evaluation checklist and a questionnaire were the instruments used to collect data.…

Evaluation of Medical Education virtual Program: P3 model.

Science.gov (United States)

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Clemson University Science Master's Program in Sustainable and Resilient Infrastructure: A program evaluation

Science.gov (United States)

O'Sell, Elizabeth Eberhart

The Clemson University Science Master's Program (SMP) in Sustainable and Resilient Infrastructure is a program which aims to link engineering, materials, construction, environment, architecture, business, and public policy to produce graduates with unique holistic perspective and expertise to immediately contribute to the workforce in the area of sustainable and resilient infrastructure. A program evaluation of the SMP has been performed to study the effectiveness of the SMP and identify areas where the goals and vision of the SMP are achieved and areas where improvements can be made. This was completed by analysis of trends within survey responses, review of Master's thesis reports, and review of courses taken. It was found that the SMP has facilitated new interdisciplinary research collaborations of faculty in different concentration areas within the Glenn Department of Civil Engineering, as well as collaboration with faculty in other departments. It is recommended that a course which provides instruction in all eight competency areas be required for all SMP students to provide a comprehensive overview and ensure all students are exposed to concepts of all competency areas. While all stakeholders are satisfied with the program and believe it has been successful thus far, efforts do need to be made as the program moves forward to address and improve some items that have been mentioned as needing improvement. The concerns about concentration courses, internship planning, and advising should be addressed. This evaluation provides benefits to prospective students, current SMP participants, and outside program supporters. The goal of this evaluation is to provide support that the SMP is an effective and worthwhile program for participating students, while attempting to identify any necessary program improvements and provide recommendations for achieving these improvements. This goal has been accomplished.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Evaluation of medical education virtual program: P3 model

Directory of Open Access Journals (Sweden)

RITA REZAEE

2016-10-01

Full Text Available Introduction: In e-learning, people get involved in a process and create the content (product and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76, but they declared technical support as the less desirable part (1.17±1.23. Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

School-Based Peer Mentoring in High School: A Program Evaluation Study

Science.gov (United States)

Cooper, Felicia Cecile

2017-01-01

The dissertation is an initial investigation of a peer mentoring program in a suburban high school in the southeastern United States. Additionally, the Peer Mentoring Program (PMP) study examined whether the Program improves academic performance and attendance, and decreases referrals. Utilizing an experimental design, a Participant and a…

Using GIS to evaluate a fire safety program in North Carolina.

Science.gov (United States)

Dudley, Thomas; Creppage, Kathleen; Shanahan, Meghan; Proescholdbell, Scott

2013-10-01

Evaluating program impact is a critical aspect of public health. Utilizing Geographic Information Systems (GIS) is a novel way to evaluate programs which try to reduce residential fire injuries and deaths. The purpose of this study is to demonstrate the application of GIS within the evaluation of a smoke alarm installation program in North Carolina. This approach incorporates national fire incident data which, when linked with program data, provides a clear depiction of the 10 years impact of the Get Alarmed, NC! program and estimates the number of potential lives saved. We overlapped Get Alarmed, NC! program installation data with national information on fires using GIS to identify homes that experienced a fire after an alarm was installed and calculated potential lives saved based on program documentation and average housing occupancy. We found that using GIS was an efficient and quick way to match addresses from two distinct sources. From this approach we estimated that between 221 and 384 residents were potentially saved due to alarms installed in their homes by Get Alarmed, NC!. Compared with other program evaluations that require intensive and costly participant telephone surveys and/or in-person interviews, the GIS approach is inexpensive, quick, and can easily analyze large disparate datasets. In addition, it can be used to help target the areas most at risk from the onset. These benefits suggest that by incorporating previously unutilized data, the GIS approach has the potential for broader applications within public health program evaluation.

Boron neutron capture therapy: Brain Tumor Treatment Evaluation Program

International Nuclear Information System (INIS)

Griebenow, M.L.; Dorn, R.V. III; Gavin, P.R.; Spickard, J.H.

1988-01-01

The United States (US) Department of Energy (DOE) recently initiated a focused, multidisciplined program to evaluate Boron Neutron Capture Therapy (BNCT) for the treatment of brain tumors. The program, centered at the DOE/endash/Idaho National Engineering Laboratory (INEL), will develop the analytical, diagnostic and treatment tools, and the database required for BNCT technical assessment. The integrated technology will be evaluated in a spontaneously-occurring canine brain-tumor model. Successful animal studies are expected to lead to human clinical trials within four to five years. 2 refs., 3 figs

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

Science.gov (United States)

Ewell, Bob

1998-01-01

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

Super-Efficient Refrigerator Program (SERP) evaluation volume 2: Preliminary impact and market transformation assessment

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-08-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. It is one of the first examples of a large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the preliminary impact and market transformation evaluation of SERP ({open_quotes}the Program{close_quotes}). Pacific Northwest National Laboratory (PNNL) conducted this evaluation for the U.S. Department of Energy. This study focuses on the preliminary impact evaluation and market transformation assessment, but also presents limited process evaluation information. It is based on interviews with refrigerator dealers and manufacturers, interviews with utility participants, industry data, and information from the Program administrators. Results from this study complement those from prior process evaluation also conducted by PNNL. 42 refs., 5 figs., 4 tabs.

African Social Studies Program-1, 1988-89. Final Report. A Master's Degree Program for African Social Studies Leaders.

Science.gov (United States)

Indiana Univ., Bloomington.

This paper presents the final report on a project that brought African social studies education leaders to Indiana University (Bloomington) to take part in a Master's Degree program. The report contains a brief history of the program, a description of the program, a discussion of issues relating to acculturation, an evaluation, a list of…

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Evaluation of the Super Efficient Refrigerator Program (SERP) in the Bonneville Power Administration service territory

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-06-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. it is one of the first examples of large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the evaluation of SERP ({open_quotes}the Program{close_quotes}) in the Bonneville Power Administration`s (Bonneville`s) service territory. Pacific Northwest National Laboratory (PNNL) conducted this evaluation for Bonneville. This study includes the process evaluation, preliminary impact evaluation, and market transformation assessment. It is based on site visits and interviews with refrigerator dealers and manufacturers, industry data, and Bonneville information. Results from this study are compared with those from a parallel study that examines the Program across the 24 participating utilities.

Evaluation of the Radiography Program at Caldwell Community College and Technical Institute--Summer, 1982.

Science.gov (United States)

Pipes, V. David

As part of a periodic evaluation of the occupational programs at Caldwell Community College and Technical Institute (CCC&TI), a study of the radiography program was conducted to collect information to facilitate planning, aid in program improvement, and meet accountability demands. The specific objectives of the program evaluation were to…

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

Development and evaluation of addiction treatment programs in Latin America.

Science.gov (United States)

Marín-Navarrete, Rodrigo; Medina-Mora, María Elena; Pérez-López, Alejandro; Horigian, Viviana E

2018-07-01

The aim of this article is to present a state-of-the-art review of the scientific studies that have evaluated healthcare systems, services and programs for addiction treatment in Latin America. As a secondary aim, this article presents a brief description and analysis of the addiction prevention and treatment resources and programs available in Latin America, based on information from the ATLAS on Substance Use (ATLAS-SU) project led by the WHO. Substance use disorders (SUDs) are among the main causes associated with global burden of disease. Around the world, many initiatives have been proposed to promote policies to reduce substance use and reduce the impact of SUD, including integrating treatments into healthcare systems, increasing access to treatment programs and impacting outcome measures. In Latin America, multiple efforts have been implemented to improve addiction services and programs, although little is known about the impact they have generated. International studies report the availability of strategies and public inicitatives on prevention and treatment of addiction in Latin America. These studies also report established networks of public and private services that include prevention and detoxification programs, outpatient and residential treatment, and also social reintegration initiatives. However, despite these advances, information on the evaluation of the progress, results and impact of these programs is limited.

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

National Uranium Resource Evaluation Program: the Hydrogeochemical Stream Sediment Reconnaissance Program at LLNL

International Nuclear Information System (INIS)

Higgins, G.H.

1980-08-01

From early 1975 to mid 1979, Lawrence Livermore National Laboratory (LLNL) participated in the Hydrogeochemical Stream Sediment Reconnaissance (HSSR), part of the National Uranium Resource Evaluation (NURE) program sponsored by the Department of Energy (DOE). The Laboratory was initially responsible for collecting, analyzing, and evaluating sediment and water samples from approximately 200,000 sites in seven western states. Eventually, however, the NURE program redefined its sampling priorities, objectives, schedules, and budgets, with the increasingly obvious result that LLNL objectives and methodologies were not compatible with those of the NURE program office, and the LLNL geochemical studies were not relevant to the program goal. The LLNL portion of the HSSR program was consequently terminated, and all work was suspended by June 1979. Of the 38,000 sites sampled, 30,000 were analyzed by instrumental neutron activation analyses (INAA), delayed neutron counting (DNC), optical emission spectroscopy (OES), and automated chloride-sulfate analyses (SC). Data from about 13,000 sites have been formally reported. From each site, analyses were published of about 30 of the 60 elements observed. Uranium mineralization has been identified at several places which were previously not recognized as potential uranium source areas, and a number of other geochemical anomalies were discovered

Systematic evaluation program. Status report and initial evaluation

International Nuclear Information System (INIS)

1983-06-01

The MHB Ongoing Systematic Evaluation Program (SEP) Assessment Study was initiated by the Swedish Nuclear Power Inspectorate (SKI) in 1980. This MHB report is a status report and initial evaluation of SEP. The methodology and results of SEP are disscused with particular emphasis on the first two SEP plant reviews - the Palisades and R.E. Ginna nuclear power plants. The comments of cognizant persons in the NRC and the ACRS, as well as private consultants, are included herein. MHBs major findings are as follows: The SEP plant review methodology was acceptable to the NRC Commissioners, the ACRS, and the NRC Staffs consultants who evaluated the first two SEP plant reviews. A concern raised by all who commented on SEP was the absence of Three Mile Island Action Plan Items and Unresolved Safety Issues from current SEP reviews. The SEP reviews of the Palisades and R.E. Ginna plants concluded that the two plant designs were adequate with respect to a majority of safety topics. Several topics remain unresolved in both the Palisades and R.E. Ginna SEP reviews. In the case of the Ginna plant, several related topics have been grouped together in a major structural reevaluation study. In general, due to the number of unresolved and excluded topics, SEP has not at this time produced a plant safety evaluation which can be considered complete and integrated. (author)

An Evaluation System for the Online Training Programs in Meteorology and Hydrology

Science.gov (United States)

Wang, Yong; Zhi, Xiefei

2009-01-01

This paper studies the current evaluation system for the online training program in meteorology and hydrology. CIPP model that includes context evaluation, input evaluation, process evaluation and product evaluation differs from Kirkpatrick model including reactions evaluation, learning evaluation, transfer evaluation and results evaluation in…

Children's Kindergarten Outcomes and Program Quality in the North Carolina Pre-Kindergarten Program: 2013-2014 Statewide Evaluation

Science.gov (United States)

Peisner-Feinberg, Ellen S.; Schaaf, Jennifer M.; Hildebrandt, Lisa M.; Pan, Yi; Warnaar, Bethany L.

2015-01-01

The 2013-2014 North Carolina Pre-Kindergarten (NC Pre-K) Evaluation study was designed to examine the longitudinal outcomes through kindergarten for children who attended the Pre-K program, along with comparisons to previous cohorts of program attendees. A sample of 561 children was included in the study, with data gathered at the beginning and…

The management of evaluating the European programs and policies implemented in Romania

Directory of Open Access Journals (Sweden)

Doctoral student ROMAN MIHAELA

2011-12-01

Full Text Available Starting with the reform and modernization of the public administration in Romania in the mid 1990s, an important element of this process being the development of the management process, respectively of planning and managing public policies, the Romanian government started also a process of developing the capacity for evaluating public programs and policies, both the ones with European or foreign financing and the ones with domestic financing. Up-to-date analyses and studies have showed, however, that at the level of the national public sector there is a major discrepancy between the progress made in the evaluation of European programs or the ones with foreign financing and the programs financed from public funds, namely that there is a consolidated evaluation practice as regards the first types of programs, which is virtually inexistent as regards programs financed from the public budget.This paper intends to identify the progress made at the level of the Romanian public administration as regards the management of evaluating programs with European financing, to see the characteristics of building the evaluation capacity within the national system of these programs and the motivation stimulating such approaches. The first part of this paper shall contain a presentation of the background of the current evaluation system, including both the legislative framework and the institutional framework with duties of management and evaluation of European programs; further, I shall analyze the evolution of this system in order to be able to draw conclusions regarding the evaluation capacity of Romania.

An Evaluation of the Instruction of Generalization in Elementary School Social Studies Program

Directory of Open Access Journals (Sweden)

Mükerrem AKBULUT TAŞ

2011-11-01

Full Text Available Generalizations are important content materials that should be instructed in the Social Studies program. The instruction of generalizations and the causal relationships emphasized in generalizations are important for students to have meaningful learning experiences and to gain causal reasoning and critical thinking skills. Social Studies program emphasizes the acquisition of creating scientific generalization skill as a fundamental skill to be instructed directly, and the importance of generalization instruction is highlighted. Therefore, this study is important in that it draws attention to the importance of teaching generalization and creates basis for the future research in the field. In this regard, it aims at evaluating the instruction of the generalizations in the “Our Country and the World” unit in Social Studies program for 6th grades in Primary School. In line with this general purpose, the instruction of the generalizations in the unit was analyzed qualitatively. The study was conducted with three social studies teachers working in three different schools located in Seyhan, Adana. The data were collected through the observation technique with a view to obtaining in depth data about the instruction of generalization in social studies lesson. Semi-structured observation form, prepared in the light of the generalization content elements, was used as the data collection tool. These content elements consisted of four aspects: generalization statement, concepts related to generalization, cause-effect relationships between concepts, and facts about generalization. In addition to observation, document analysis was conducted with a view to supporting results and strengthening the implications. The documentary analysis was performed based on the generalizations and previously identified elements about the generalizations in the scope of the six topics in the “Our Country and the World” unit. The data collected from the observations were

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Primary prevention research: a preliminary review of program outcome studies.

Science.gov (United States)

Schaps, E; Churgin, S; Palley, C S; Takata, B; Cohen, A Y

1980-07-01

This article reviews 35 drug abuse prevention program evaluations employing drug-specific outcome measures. Many of these evaluations assessed the effects of "new generation" prevention strategies: affective, peer-oriented, and multidimensional approaches. Only 14 studies evaluated purely informational programs. Evaluations were analyzed to ascertain (1) characteristics of the programs under study, (2) characteristics of the research designs, and (3) patterns among findings. This review provides some evidence that the newer prevention strategies may produce more positive and fewer negative outcomes than did older drug information approaches. Over 70% of the programs using the newer strategies produced some positive effects; only 29% showed negative effects. In contrast, 46% of informational programs showed positive effects; 46% showed negative effects. These findings must be approached with great caution, since the research was frequently scientifically inadequate, and since rigor of research was negatively correlated with intensity and duration of program services.

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Physiotherapists supporting self-management through health coaching: a mixed methods program evaluation.

Science.gov (United States)

Dufour, Sinéad Patricia; Graham, Shane; Friesen, Josh; Rosenblat, Michael; Rous, Colin; Richardson, Julie

2015-01-01

To evaluate a program in support of chronic disease self-management (CDSM) that is founded on a health coaching (HC) approach, includes supervised exercise and mindfulness-based stress reduction components and is delivered within a private practice physiotherapy setting. An explanatory mixed method design, framed by theory-based program evaluation, was employed to evaluate an eight-week group-based program. Standardized self-rated and performance measures were evaluated pre- and post intervention. Additionally, participant focus groups were conducted following the intervention period. An inductive thematic approach was undertaken to analyze the qualitative data. Seventeen participants (N = 17) completed the study. Improvements were seen in both self-report and performance outcomes. Participants explained how and why they felt the program was beneficial. Six themes were generated: (1) group dynamic; (2) learning versus doing; (3) holism and comprehensive care; (4) self-efficacy and empowerment; (5) previous solutions versus new management strategies; and (6) healthcare provider support. This study established that a group program in support of CDSM founded on a HC approach demonstrated potential value from participants as well as favorable outcomes. A pragmatic randomized control trial is required to determine efficacy of this intervention.

Continuous Evaluation in Ethics Education: A Case Study.

Science.gov (United States)

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

Science.gov (United States)

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Outcome Evaluation of the Hands-On Parent Empowerment (HOPE) Program

Science.gov (United States)

Leung, Cynthia; Tsang, Sandra; Dean, Suzanne

2011-01-01

This study evaluated the effectiveness of the HOPE program. Participants included 120 Chinese new immigrant parents with preschool children in Hong Kong from 13 preschools which were randomized into intervention group (HOPE) and comparison group (6-session parent education program). Parent participants completed measures on child behavior,…

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Lessons learned: Evaluating the program fidelity of UNWomen Partnership for Peace domestic violence diversion program in the Eastern Caribbean.

Science.gov (United States)

Jeremiah, Rohan D; Quinn, Camille R; Alexis, Jicinta M

2018-08-01

To date, there have been a plethora of punitive and diversion programs to address domestic violence around the world. However, the evaluative scholarship of such programs overwhelmingly reflects studies in developed countries while barely showcasing the realities of addressing domestic violence in developing countries. This paper features a multi-year (2008-2011) evaluation study that measured the fidelity of the United Nations Partnership for Peace (PfP) domestic violence diversion program in the Eastern Caribbean country of Grenada. Our findings illuminate organic engagement strategies that were built within existing multi-sectoral partnerships that included magistrate court judges, law enforcement officials, and social service agencies. Furthermore, we documented how the locally-devised implementation strategies ensured the program's fidelity within a resource-limited context. This paper contributes to the global evaluative scholarship, highlighting the lessons learned about implementing culturally-adapted and theoretically-driven domestic violence diversion within a developing country. Copyright © 2018 Elsevier Ltd. All rights reserved.

Does the Kids Cafe Program's nutrition education improve children's dietary intake? A pilot evaluation study

Science.gov (United States)

Our objective was to evaluate the Kids Café Program (KCP) nutrition education intervention and assess its impact on children's diet quality and body mass index (BMI) percentile. An experimental design consisting of pretest-posttest comparison groups using mixed methods was used to evaluate the 6-ses...

Physical protection evaluation methodology program development and application

International Nuclear Information System (INIS)

Seo, Janghoon; Yoo, Hosik

2015-01-01

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Physical protection evaluation methodology program development and application

Energy Technology Data Exchange (ETDEWEB)

Seo, Janghoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2015-10-15

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Evaluating Realized Impacts of DOE/EERE R&D Programs. Standard impact evaluation method

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc. (United States); O' Connor, Alan C. [RTI International, Research Triangle Park, NC (United States); Loomis, Ross J. [RTI International, Research Triangle Park, NC (United States)

2014-08-01

This document provides guidance for evaluators who conduct impact assessments of research and development (R&D) programs for the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE). It is also targeted at EERE program staff responsible for initiating and managing commissioned impact studies. The guide specifies how to estimate economic benefits and costs, energy saved and installed or generated, environmental impacts, energy security impacts, and knowledge impacts of R&D investments in advanced energy technologies.

The efficacy of stuttering measurement training: evaluating two training programs.

Science.gov (United States)

Bainbridge, Lauren A; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J

2015-04-01

Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of stuttering events on eight 3-min audiovisual speech samples from adults and children who stutter. Stuttering judgment training involved use of either the Stuttering Measurement System (SMS), Stuttering Measurement Assessment and Training (SMAAT) programs, or no training. To test for the reliability of any training effect, SMS training was repeated with the 4th group. Both SMS-trained groups produced approximately 34% improvement, significantly better than no training or the SMAAT program. The SMAAT program produced a mixed result. The SMS program was shown to produce a "medium" effect size improvement in the accuracy of stuttering event counts, and this improvement was almost perfectly replicated in a 2nd group. Half of the SMAAT judges produced a 36% improvement in accuracy, but the other half showed no improvement. Additional studies are needed to demonstrate the durability of the reported improvements, but these positive effects justify the importance of stuttering measurement training.

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

Evaluation of the Professional Development Program on Web Based Content Development

Science.gov (United States)

Yurdakul, Bünyamin; Uslu, Öner; Çakar, Esra; Yildiz, Derya G.

2014-01-01

The aim of this study is to evaluate the professional development program on web based content development (WBCD) designed by the Ministry of National Education (MoNE). Based on the theoretical CIPP model by Stufflebeam and Guskey's levels of evaluation, the study was carried out as a case study. The study group consisted of the courses that…

Keys to success: Ten case studies of effective weatherization programs

Energy Technology Data Exchange (ETDEWEB)

Brown, M.A.; Berry, L.G.; Kolb, J.O.; White, D.L. [Oak Ridge National Lab., TN (United States); Kinney, L.F.; Wilson, T. [Synertech Systems Corp., Syracuse, NY (United States)

1993-11-01

In 1990, DOE initiated a nationwide evaluation of its Weatherization Program, with assistance from Oak Ridge National Laboratory and an advisory group of 40 weatherization professionals, program managers, and researchers. The evaluation is comprised of three impact studies covering the Program`s major market segments: Single-family homes, mobile homes, and dwellings in small (2 to 4-unit) multifamily buildings (the Single-Family Study), Single-family homes heated primarily with fuel oil (the Fuel-Oil Study), and Dwellings in buildings with five or more units (the Multifamily Study). The Single-Family Study, the subject of this report, is a critical part of this coordinated evaluation effort. Its focus on single-family dwellings, mobile homes, and dwellings in small multifamily buildings covers 83% of the income-eligible population and 96% of the dwellings weatherized during Program Year 1989. The first phase of the Single-Family Study involved the analysis of a massive data base of information collected from 368 local weatherization agencies and 543 electric and gas utilities. This analysis resulted in energy-saving and cost-effectiveness estimates for the Weatherization Program and the identification of a set of ten high-performing agencies located throughout the country. The second phase, which is the subject of this report, involves a ``process`` evaluation of these ten high performers, aimed at identifying those weatherization practices that explain their documented success.

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

[Process evaluation in relation to effectiveness assessment: experiences with school-based programs].

Science.gov (United States)

Ariza, Carles; Villalbí, Joan R; Sánchez-Martínez, Francesca; Nebot, Manel

2011-06-01

Evaluation of public health interventions usually focus on the quality of design and research methods, and less on the quality of the intervention or process evaluation. In process evaluation of school-based interventions, key issues are how completely the intervention is carried out and adherence to the protocol. In addition, exploration of intermediate variables, such as those that influence (and often predict) preventable behavior, is highly useful. This article describes the basic concepts in this topic, using examples of the effectiveness of some preventive interventions carried out in schools. The interventions discussed were mainly quasi-experimental studies, based on data from programs promoted by public health teams in the city of Barcelona. Data from process evaluation of preventive programs in secondary schools that underwent formal assessment of their effectiveness is provided. The examples are drawn from preventive programs of HIV infection or unprotected sexual intercourse (PRESSEC program) and drug consumption prevention (the PASE, PASE.bcn and x kpts programs). These examples show why the intervention process influences the impact of the programs and their results. Thorough planning of process evaluation is essential to obtain valid indicators that will identify, in the effectiveness evaluation of the intervention, the most efficacious strategies to obtain positive outcomes. Copyright © 2011 Sociedad Española de Salud Pública y Administración Sanitaria. Published by Elsevier Espana. All rights reserved.

Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review.

Science.gov (United States)

Nicoll, Pam; MacRury, Sandra; van Woerden, Hugo C; Smyth, Keith

2018-04-11

Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner

The Efficacy of Stuttering Measurement Training: Evaluating Two Training Programs

Science.gov (United States)

Bainbridge, Lauren A.; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J.

2015-01-01

Purpose: Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Method: Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of…

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Evaluation of a complementary cyber education program for a pathophysiology class.

Science.gov (United States)

Yoo, Ji-Soo; Ryue, Sook-Hee; Lee, Jung Eun; Ahn, Jeong-Ah

2009-12-01

The goal of this study was to develop and evaluate a complementary cyber education program for a required pathophysiology class for nursing students. The cyber education program comprised electronic bulletin boards, correspondence material storage, an announcement section, a report submission section, reference sites, and statistics on learning rates. Twelve online lectures complemented five lectures in the classroom. To evaluate the course's educational effectiveness, we performed an online objective questionnaire and an open questionnaire survey anonymously, and compared the complementary cyber education program with traditional classroom education. The complementary cyber education program effected significant improvements in scores for importance with regard to major, clarity of goals and education plans for courses, professor readiness, preciseness and description of lectures, amount and efficiency of assignments, and fairness in appraisal standards compared with the traditional classroom education group. This study indicates that a complementary cyber education program provides nursing students with the flexibility of time and space, the newest information through updated lectures, efficient motivational aids through intimacy between the lecturer and students, and concrete and meaningful tasks. The complementary cyber education course also increased student effort toward studying and student satisfaction with the class.

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Evaluation of the Tier 1 Program of Project P.A.T.H.S.: Secondary Data Analyses of Conclusions Drawn by the Program Implementers

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2008-01-01

Full Text Available The Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes is a curricula-based positive youth development program. In the experimental implementation phase, 52 schools participated in the program. Based on subjective outcome evaluation data collected from the program participants (Form A and program implementers (Form B in each school, the program implementers were invited to write down five conclusions based on an integration of the evaluation findings (N = 52. The conclusions stated in the 52 evaluation reports were further analyzed via secondary data analyses in this paper. Results showed that most of the conclusions concerning perceptions of the Tier 1 Program, instructors, and effectiveness of the programs were positive in nature. There were also conclusions reflecting the respondents’ appreciation of the program. Finally, responses on the difficulties encountered and suggestions for improvements were observed. In conjunction with the previous evaluation findings, the present study suggests that the Tier 1 Program was well received by the stakeholders and the program was beneficial to the development of the program participants.

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

Interim reliability evaluation program (IREP)

International Nuclear Information System (INIS)

Carlson, D.D.; Murphy, J.A.

1981-01-01

The Interim Reliability Evaluation Program (IREP), sponsored by the Office of Nuclear Regulatory Research of the US Nuclear Regulatory Commission, is currently applying probabilistic risk analysis techniques to two PWR and two BWR type power plants. Emphasis was placed on the systems analysis portion of the risk assessment, as opposed to accident phenomenology or consequence analysis, since the identification of risk significant plant features was of primary interest. Traditional event tree/fault tree modeling was used for the analysis. However, the study involved a more thorough investigation of transient initiators and of support system faults than studies in the past and substantially improved techniques were used to quantify accident sequence frequencies. This study also attempted to quantify the potential for operator recovery actions in the course of each significant accident

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

Dissemination of Technology to Evaluate Healthy Food Incentive Programs.

Science.gov (United States)

Freedman, Darcy A; Hunt, Alan R; Merritt, Katie; Shon, En-Jung; Pike, Stephanie N

2017-03-01

Federal policy supports increased implementation of monetary incentive interventions for chronic disease prevention among low-income populations. This study describes how a Prevention Research Center, working with a dissemination partner, developed and distributed technology to support nationwide implementation and evaluation of healthy food incentive programming focused on Supplemental Nutrition Assistance Program recipients. FM Tracks, an iOS-based application and website, was developed to standardize evaluation methods for healthy food incentive program implementation at direct-to-consumer markets. This evaluation examined diffusion and adoption of the technology over 9 months (July 2015-March 2016). Data were analyzed in 2016. FM Tracks was disseminated to 273 markets affiliated with 37 regional networks in 18 states and Washington, DC. All markets adopted the sales transaction data collection feature, with nearly all recording at least one Supplemental Nutrition Assistance Program (99.3%) and healthy food incentive (97.1%) transaction. A total of 43,493 sales transactions were recorded. By the ninth month of technology dissemination, markets were entering individual sales transactions using the application (34.5%) and website (29.9%) and aggregated transactions via website (35.6%) at similar rates. Use of optional evaluation features like recording a customer ID with individual transactions increased successively with a low of 22.2% during the first month to a high of 69.2% in the ninth month. Systematic and widely used evaluation technology creates possibilities for pragmatic research embedded within ongoing, real-world implementation of food access interventions. Technology dissemination requires supportive technical assistance and continuous refinement that can be advanced through academic-practitioner partnerships. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

Science.gov (United States)

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2014-03-01

Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

Science.gov (United States)

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

Dig into Learning: A Program Evaluation of an Agricultural Literacy Innovation

Science.gov (United States)

Edwards, Erica Brown

2016-01-01

This study is a mixed-methods program evaluation of an agricultural literacy innovation in a local school district in rural eastern North Carolina. This evaluation describes the use of a theory-based framework, the Concerns-Based Adoption Model (CBAM), in accordance with Stufflebeam's Context, Input, Process, Product (CIPP) model by evaluating the…

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

Science.gov (United States)

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

Readiness for Residency: A Survey to Evaluate Undergraduate Medical Education Programs.

Science.gov (United States)

Peterson, Linda N; Rusticus, Shayna A; Wilson, Derek A; Eva, Kevin W; Lovato, Chris Y

2015-11-01

Health professions programs continue to search for meaningful and efficient ways to evaluate the quality of education they provide and support ongoing program improvement. Despite flaws inherent in self-assessment, recent research suggests that aggregated self-assessments reliably rank aspects of competence attained during preclerkship MD training. Given the novelty of those observations, the purpose of this study was to test their generalizability by evaluating an MD program as a whole. The Readiness for Residency Survey (RfR) was developed and aligned with the published Readiness for Clerkship Survey (RfC), but focused on the competencies expected to be achieved at graduation. The RfC and RfR were administered electronically four months after the start of clerkship and six months after the start of residency, respectively. Generalizability and decision studies examined the extent to which specific competencies were achieved relative to one another. The reliability of scores assigned by a single resident was G = 0.32. However, a reliability of G = 0.80 could be obtained by averaging over as few as nine residents. Whereas highly rated competencies in the RfC resided within the CanMEDS domains of professional, communicator, and collaborator, five additional medical expert competencies emerged as strengths when the program was evaluated after completion by residents. Aggregated resident self-assessments obtained using the RfR reliably differentiate aspects of competence attained over four years of undergraduate training. The RfR and RfC together can be used as evaluation tools to identify areas of strength and weakness in an undergraduate medical education program.

Evaluation of school-based reproductive health education program for adolescent girls.

Science.gov (United States)

Golbasi, Zehra; Taskin, Lale

2009-01-01

To evaluate the effectiveness of school-based reproductive health education for adolescent girls on the reproductive knowledge level of the girls. This research was carried out as a quasi-experimental study at two vocational girls high schools, one of which was used as the study school and the other as the control school. The study group (97 students) consisted of three classes representing every grade. The control group consisted of students selected likewise (92 students). Reproductive health education was given to students in the study group for 10 weeks; the control group was not subjected to any educational program. The impact of the program was evaluated with reproductive health knowledge test designed for this study. A pretest evaluated baseline knowledge, and a posttest measured the gain in knowledge. Baseline knowledge score of students in study and control group were similar and low (p > 0.05). We found that the reproductive health knowledge level of students in the study group increased significantly after the program of education. Post-test knowledge scores (75.03 +/- 13.82) of the students in the study group were higher than those of the control group (36.65 +/- 14.17). The results showed students' low baseline knowledge and a good ability to learn. A school-based reproductive health education is needed to promote knowledge and prevention in reproductive health among teenagers.

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

A Lesson in Carefully Managing Resources: A Case Study from an Evaluation of a Music Education Program

Science.gov (United States)

Hobson, Kristin A.; Burkhardt, Jason T.

2012-01-01

Background: A music education program with a goal of enhancing cognitive development of preschool-aged children enrolled in local preschools is evaluated by The Evaluation Center at Western Michigan University. The budget for the evaluation was small, and therefore presented several challenges to the evaluation team. Purpose: Through a case study…

Evaluating Quality in Associate Degree Culinary Arts Programs

Science.gov (United States)

Hertzman, Jean; Ackerman, Robert

2010-01-01

Purpose: The purpose of this study is to determine which categories and indicators of quality are best suited to evaluating associate degree culinary arts programs (ADCAP). Design/methodology/approach: The researchers surveyed a national sample of culinary educators and industry chefs in the USA. The instrument asked the participants to rate the…

Evaluation of doctoral nursing programs in Japan by faculty members and their educational and research activities.

Science.gov (United States)

Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo

2012-07-01

Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan. Copyright © 2011 Elsevier Ltd. All rights reserved.

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

An approach for evaluating the market effects of energy efficiency programs

International Nuclear Information System (INIS)

Vine, E.; Prahl, R.; Meyers, S.; Turiel, I.

2010-01-01

This paper presents work currently being carried out in California on evaluating market effects. We first outline an approach for conducting market effect studies that includes the six key steps that were developed in study plans: (1) a scoping study that characterizes a particular market, reviews relevant market effects studies, develops integrated market and program theories, and identifies market indicators; (2) analysis of market evolution, using existing data sources; (3) analysis of market effects, based on sales data and interviews with key market actors; (4) analysis of attribution; (5) estimation of energy savings; and (6) assessment of sustainability (i.e., the extent to which any observed market effects are likely to persist in the absence or reduction of public intervention, and thus has helped to transform the market). We describe the challenges in conducting this type of analysis (1) selecting a comparison state(s) to California for a baseline, (2) availability and quality of data (limiting analyses), (3) inconsistent patterns of results, and (4) conducting market effects evaluations at one point in time, without the benefit of years of accumulated research findings, and then provide some suggestions for future research on the evaluation of market effects. With the promulgation of market transformation programs, the evaluation of market effects will be critical. We envision that these market effects studies will help lay the foundation for the refinement of techniques for measuring the impacts of programs that seek to transform markets for energy efficiency products and practices.

Evaluation of an online continuing education program from the perspective of new graduate nurses.

Science.gov (United States)

Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike

2014-05-01

The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.

Engaging Street Youth in an Evaluation of a Community-Based Arts Program

Directory of Open Access Journals (Sweden)

Robin Wright

2008-06-01

Full Text Available Data from the Edmonton Arts & Youth Feasibility Study (EAYFS was used to ascertain the feasibility of engaging street youth in a structured community-based arts program and an outcome-based evaluation. The study engaged 23 street youth in a ten-week multi-media arts program focused on developing prosocial communication, team-building, and problem-solving skills. Results have shown that street youth are highly interested in artistic endeavors; will participate to the best of their circumstances; and will provide reliable data. The youth and staff reported improved art skills, problem-solving capacity, and prosocial communication as well as a decrease in drug use, depression, loneliness, and a greater sense of enjoyment about life. Strengths of the program included the arts media, the non-judgmental environment, and the support from staff. The study suggests that community-based arts programs for street youth could be subjected to a rigorous outcome-based evaluation.

Evaluation of a case-based urology learning program.

Science.gov (United States)

Mishra, Kirtishri; Snow-Lisy, Devon C; Ross, Jonathan; Goldfarb, David A; Goldman, Howard; Campbell, Steven C

2013-12-01

To address the challenges that today's trainees encounter, such as information overload and reduced immersion in the field, and recognizing their preference for novel educational resources, an electronic case-based urology learning program was developed. Each case was designed to illustrate the basic principles of the disease process and the fundamentals of evaluation and management using the Socratic method, recapitulating a prototypical patient encounter. A 21-question survey was developed after review of published reports of classroom and clinical learning environment surveys. The target group was 2 pilot urology training programs (the Cleveland Clinic and University Hospitals-Case Medical Center). The responses were entirely anonymous. A total of 32 trainees participated (8 fellows and 24 residents), representing a 53% response rate. Most trainees (79%) were able to process cases within an average of ≤ 10 minutes. Of the trainees, 91% reported referring back to particular cases for patient care, to review for examinations, or for studying. Most trainees believed a case-based urology learning program would be a potentially important resource for clinical practice (69%) and for preparing for the in-service (63%) or board (69%) examinations. Most trainees believed the program met its goals of illustrating the basics principles of the disease process (88%), outlining the fundamentals of evaluation and management (94%), and improving the trainees' knowledge base (91%). An electronic case-based urology learning program is feasible and useful and stimulates learning at all trainee levels. Copyright © 2013 Elsevier Inc. All rights reserved.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

An Evaluation of the Antibullying Program at a Public Suburban High School

Science.gov (United States)

Drury, Brian

2014-01-01

This project study addressed the problem of harassment, intimidation, and bullying (HIB) at a public suburban high school in the Northeast United States. The study school implemented the Anti-bullying Program in September 2011, yet no evaluation had been conducted on whether the program was meeting its goals. Two conceptual frameworks that drove…

Design of a study evaluating the effects, health economics, and stakeholder perspectives of a multi-component occupational rehabilitation program with an added workplace intervention - a  study protocol.

Science.gov (United States)

Rise, Marit B; Skagseth, Martin; Klevanger, Nina E; Aasdahl, Lene; Borchgrevink, Petter; Jensen, Chris; Tenggren, Hanne; Halsteinli, Vidar; Jacobsen, Trym N; Løland, Svein B; Johnsen, Roar; Fimland, Marius S

2018-02-05

Recent research has suggested that interventions at the workplace might be the most potent ingredient in return to work interventions, but few studies have investigated the different effects of workplace interventions as part of occupational rehabilitation programs. The comprehensive design described in this article includes effect (on return to work and health outcomes), and health economic evaluations of a workplace intervention added to a multicomponent rehabilitation program. Qualitative and mixed method studies will investigate sick-listed persons', rehabilitation therapists' and employers' perspectives on the usability and outcomes of the rehabilitation program and the workplace intervention. The program and intervention are provided to patients with musculoskeletal, psychological or general and unspecified diagnoses. The program is multi-component and includes Acceptance and Commitment Therapy, physical exercise, patient education and creating a plan for increased work participation. Persons who are employed, aged from 18 to 60 years, with a current sick leave status of 50% or more and a diagnosis within the musculoskeletal, psychological or general and unspecified chapters of International Classification of Primary Care-2 (ICPC-2) will be recruited to a researcher-blinded parallel-group randomized controlled trial. All participants take part in an in-patient occupational rehabilitation program, while the intervention group also takes part in an intervention at the workplace. The effect and economic evaluation will investigate the effect of the added workplace intervention. The primary outcome measures will be time until full sustainable return to work and total number of sickness absence days in the 12 months after inclusion. Health economic evaluations will investigate the cost-effectiveness and cost-utility. Qualitative studies will investigate rehabilitation therapists' experiences with working towards return to work within an ACT-approach and

An Evaluation of a Biological Slide-Tutorial Program.

Science.gov (United States)

Chan, Gordon L.

Described is an auto-tutorial slide program for zoology students. A self-paced system was devised for observing the subject matter covered in the twelve study units of a zoology course. The post-testing evaluation revealed that students with lower grade point averages achieved scores comparable with students of higher grade point averages.…

Economic evaluation of a comprehensive teenage pregnancy prevention program: pilot program.

Science.gov (United States)

Rosenthal, Marjorie S; Ross, Joseph S; Bilodeau, Roseanne; Richter, Rosemary S; Palley, Jane E; Bradley, Elizabeth H

2009-12-01

Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic support are effective in reducing births among enrolled teenagers. However, there have been limited data on the costs and cost effectiveness of such programs. The study used a community-based participatory research approach to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Using data from 1997-2003, an in-time intervention analysis was conducted to determine program cost-benefit while teenagers were enrolled; an extrapolation analysis was then used to estimate accrued economic benefits and cost-benefit up to age 30 years. The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage girls, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 years on average, with social benefits outweighing total social costs by age 20.1 years. This comprehensive teenage pregnancy prevention program is estimated to provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost effectiveness of similarly comprehensive programs when they are implemented more widely in high-risk neighborhoods.

Intervention for depression among palliative care patients and their families: A study protocol for evaluation of a training program for professional care staff.

Science.gov (United States)

Hallford, David J; McCabe, Marita P; Mellor, David; Davison, Tanya E; Goldhammer, Denisa L; George, Kuruvilla; Storer, Shane

2011-06-13

Clinical depression is highly prevalent yet under-detected and under-treated in palliative care settings and is associated with a number of adverse medical and psychological outcomes for patients and their family members. This article presents a study protocol to evaluate a training intervention for non-physician palliative care staff to improve the recognition of depression and provide support for depressed patients and their family members. Details of the hypotheses and expected outcomes, study design, training program development and evaluation measures are described. A randomised controlled trial will be implemented across two palliative care services to evaluate the "Training program for professional carers to recognise and manage depression in palliative care settings". Pre-, post- and three-month follow-up data will be collected to assess: the impact of the training on the knowledge, attitudes, self-efficacy and perceived barriers of palliative care staff when working with depression; referral rates for depression; and changes to staff practices. Quantitative and qualitative methods, in the form of self-report questionnaires and interviews with staff and family members, will be used to evaluate the effectiveness of the intervention. This study will determine the effectiveness of an intervention that aims to respond to the urgent need for innovative programs to target depression in the palliative care setting. The expected outcome of this study is the validation of an evidence-based training program to improve staff recognition and appropriate referrals for depression, as well as improve psychosocial support for depressed patients and their family members. Australia and New Zealand Clinical Trials Register (ANZCTR): ACTRN12610000183088.

[Promotion of media competence and prevention of cyberbullying using the Medienhelden program: results from an evaluation study ].

Science.gov (United States)

Scheithauer, Herbert; Schultze-Krumbholz, Anja; Wölfer, Ralf; Zagorscak, Pavle

2014-01-01

The manualized Medienhelden (engl. Media Heroes) program (Schultze-Krumbholz, Zagorscak, Siebenbrock, Scheithauer, 2012) is implemented in the school environment either as a ten-week program during lessons (curriculum; IGL) or as a single project day with reduced content of the long version (IGK). In consecutive lessons, topics of the program are, for example: definition of cyberbullying, its negative impact, how to protect oneself on the internet, and opportunities to react in appropriate ways. The program utilizes mainly cognitive-behavioral methods. In the present contribution the program and selected results from a controlled, pre-follow-up evaluation study with 570 adolescents (Ncontrolgroup = 289, NIGK = 98 and NIGL = 183), from one general high school and four college preparatory high schools from a German major city will be presented. Results show that cyberbullying decreased in both intervention groups (project day, curriculum) compared to the control group while at the same time an increase of social competencies, self-esteem, and subjective health was observed. These effects were more pronounced for the curriculum intervention group. An opposite pattern was found for the control group: Cyberbullying and empathy worsened, and no change was found for perspective-taking, self-esteem, and subjective health. The program shows both preventive and intervention effects.

Socioeconomic impact assessment in ex ante evaluations: a case study on the rural development programs of the European Union.

Science.gov (United States)

Vidueira, Pablo; Díaz-Puente, José M; Rivera, María

2014-08-01

Ex ante impact assessment has become a fundamental tool for effective program management, and thus, a compulsory task when establishing a new program in the European Union (EU). This article aims to analyze benefits from ex ante impact assessment, methodologies followed, and difficulties encountered. This is done through the case study on the rural development programs (RDPs) in the EU. Results regarding methodologies are then contrasted with the international context in order to provide solid insights to evaluators and program managing authorities facing ex ante impact assessment. All European RDPs from the period 2007 through 2013 (a total of 88) and their corresponding available ex ante evaluations (a total of 70) were analyzed focusing on the socioeconomic impact assessment. Only 46.6% of the regions provide quantified impact estimations on socioeconomic impacts in spite of it being a compulsory task demanded by the European Commission (EC). Recommended methods by the EC are mostly used, but there is a lack of mixed method approaches since qualitative methods are used in substitution of quantitative ones. Two main difficulties argued were the complexity of program impacts and the lack of needed program information. Qualitative approaches on their own have been found as not suitable for ex ante impact assessment, while quantitative approaches-such as microsimulation models-provide a good approximation to actual impacts. However, time and budgetary constraints make that quantitative and mixed methods should be mainly applied on the most relevant impacts for the program success. © The Author(s) 2014.

Integrative Reiki for cancer patients: a program evaluation.

Science.gov (United States)

Fleisher, Kimberly A; Mackenzie, Elizabeth R; Frankel, Eitan S; Seluzicki, Christina; Casarett, David; Mao, Jun J

2014-01-01

This mixed methods study sought to evaluate the outcomes of an integrative Reiki volunteer program in an academic medical oncology center setting. We used de-identified program evaluation data to perform both quantitative and qualitative analyses of participants' experiences of Reiki sessions. The quantitative data were collected pre- and postsession using a modified version of the distress thermometer. The pre- and postsession data from the distress assessment were analyzed using a paired Student's : test. The qualitative data were derived from written responses to open-ended questions asked after each Reiki session and were analyzed for key words and recurring themes. Of the 213 pre-post surveys of first-time sessions in the evaluation period, we observed a more than 50% decrease in self-reported distress (from 3.80 to 1.55), anxiety (from 4.05 to 1.44), depression (from 2.54 to 1.10), pain (from 2.58 to 1.21), and fatigue (from 4.80 to 2.30) with P Reiki, we found 176 (82.6%) of participants liked the Reiki session, 176 (82.6%) found the Reiki session helpful, 157 (73.7%) plan to continue using Reiki, and 175 (82.2%) would recommend Reiki to others. Qualitative analyses found that individuals reported that Reiki induced relaxation and enhanced spiritual well-being. An integrative Reiki volunteer program shows promise as a component of supportive care for cancer patients. More research is needed to evaluate and understand the impact that Reiki may have for patients, caregivers, and staff whose lives have been affected by cancer.

Impact of Aspect-Oriented Programming on the Quality of Novices’ Programs: A Comparative Study

Directory of Open Access Journals (Sweden)

Marija Katic

2013-06-01

Full Text Available Aspect-oriented programming has been introduced in order to increase the modularity of object-oriented programs and is claimed to improve software quality. Although there are various researches on this claim, the question to what extent aspect-oriented programming improves the quality of programs depending on a developer’s experience still remains. The purpose of this study is to investigate whether aspect-oriented programming used by novice programmers improves the quality of programs, in terms of software flexibility and readability (consequently reusability and maintainability as well. As a part of an undergraduate course in programming paradigms and languages, a systematic comparison between students’ object-oriented and aspect-oriented solutions of the same problem was driven. In order to drive this comparison we have established the basis for the development of the new quality assessment model consisting of software metrics for an objective evaluation and student survey for subjective evaluation. The results show that the use of aspect-oriented programming lead to novices’ programs that are easier to change and read (flexible and readable compared to object-oriented programs. What is more, administered survey showed that students perceive their programs as more flexible and readable.

Evaluation of Achieving a College Education Plus: A Credit-Based Transition Program

Science.gov (United States)

Luna, Gaye; Fowler, Michael

2011-01-01

This ex post facto study evaluated Achieving a College Education (ACE) Plus program, a credit-based transition program between a high school district and a community college. Achieving a College Education Plus is an early outreach program. It is designed to aid at-risk students in graduating from high school and making a smooth transition to…

An Evaluation Study of an Executive Master of Business Administration (EMBA) Program in an Urban City: Examining the Transfer of Knowledge and Leadership Practices

Science.gov (United States)

Choi, Hye Lim

2011-01-01

This study examined the effectiveness of the Executive Master of Business Administration (EMBA) degree program in terms of transfer of knowledge and leadership practices. Based on a review of literature related to adult learning theories, EMBA programs, the importance of evaluation practices, and leadership practices, this study was designed to…

A multi-stakeholder evaluation of the Baltimore City virtual supermarket program.

Science.gov (United States)

Lagisetty, Pooja; Flamm, Laura; Rak, Summer; Landgraf, Jessica; Heisler, Michele; Forman, Jane

2017-10-23

Increasing access to healthy foods and beverages in disadvantaged communities is a public health priority due to alarmingly high rates of obesity. The Virtual Supermarket Program (VSP) is a Baltimore City Health Department program that uses online grocery ordering to deliver food to low-income neighborhoods. This study evaluates stakeholder preferences and barriers of program implementation. This study assessed the feasibility, sustainability and efficacy of the VSP by surveying 93 customers and interviewing 14 programmatic stakeholders who had recently used the VSP or been involved with program design and implementation. We identified the following themes: The VSP addressed transportation barriers and food availability. The VSP impacted customers and the city by including improving food purchasing behavior, creating a food justice "brand for the city", and fostering a sense of community. Customers appreciated using Supplemental Nutrition Assistance Program (SNAP) benefits to pay for groceries, but policy changes are needed allow online processing of SNAP benefits. This evaluation summarizes lessons learned and serves as a guide to other public health leaders interested in developing similar programs. Provisions in the U.S. Department of Agriculture (USDA) Farm Bill 2014 allow for select grocers to pilot online transactions with SNAP benefits. If these pilots are efficacious, the VSP model could be easily disseminated.

Evaluation of radiological teaching programs in the Internet

International Nuclear Information System (INIS)

Seitz, J.; Schubert, S.; Voelk, M.; Scheibl, K.; Paetzel, C.; Schreyer, A.; Djavidani, B.; Feuerbach, S.; Strotzer, M.

2003-01-01

Evaluation of web based training programs,which can be contacted from the homepages of radiological departments of German universities.Material and method From june 2000 to january 2002 the 75 web based training programs of 57 providers,which can be contacted from the web pages of the radiological departments of german universities were evaluated in a prospective study.A medical student experienced in using the world wide web examined each training program three times in an interval of six months using the following criteria: availability of the web sites,target group,kind of training program,contents and structure and the technical solution. 51 of the 57 the homepages were fully available at each visit. 64 of the 75 web based training programs which could be connected from these sites were available at all three visitis.One program was only partially available at one spot check. 8 of the 75 programs were designed for physicians and medically trained personal, 23 were made for medical students and 44 addressed both target groups (partially more than once mentioned).The number of the presented cases ranged between one single and 3700. In 31 of 75 training programs links to other teaching files were found.A complete presentation of cases was presented by 48 of the 75 web sites.5 of the 75 web sites offered physiological images for comparison. In 20 training programs the pathological changes were optically marked in the x-ray images.A logical and didactical structure was found in 24 teaching files, 14 gave the possibility to check the learning results.No provider made use of the possibility to pass credits to the students or physicians acount with regard to official training programs. Multimedia techniques were used in 15 training programs.43 sites used data reduced preview images (thumbnails).The latest update of the site is mentioned in 55 of the 75 web sites. 19 of 57 providers had either no possibility of contact or did not answer to an e-mail. From the homepages

How Do US Pediatric Residency Programs Teach and Evaluate Community Pediatrics and Advocacy Training?

Science.gov (United States)

Lichtenstein, Cara; Hoffman, Benjamin D; Moon, Rachel Y

2017-07-01

In 2013, the Accreditation Council for Graduate Medical Education updated requirements for training in community pediatrics and advocacy in pediatric residency programs. In light of this update, the aim of this study was to better understand how community pediatrics is being taught and evaluated in pediatric residency programs in the United States. Cross-sectional exploratory study using a Web-based survey of pediatric residency program directors in September 2014. Questions focused on teaching and evaluation of 10 community pediatrics competencies. Of 85 programs (43% response rate), 30% offered a separate training track and/or 6-block individualized curriculum in community pediatrics or advocacy. More than 75% required all residents to learn 7 of 10 competencies queried. Respondents in urban settings were more likely to teach care of special populations (P = .02) and public speaking (P pediatrics and advocacy teaching among responding US pediatric residency programs. Although respondents reported a variety of teaching and evaluation methods, there were few statistically significant differences between programs. Copyright © 2017 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

Process Evaluation for a Prison-based Substance Abuse Program.

Science.gov (United States)

Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

2000-01-01

Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies.

Science.gov (United States)

Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F

2016-06-01

Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

Directory of Open Access Journals (Sweden)

Burgers Jako S

2007-11-01

Full Text Available Abstract Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes

EVALUASI PELAKSANAAN PEMBELAJARAN PROGRAM STUDI DESAIN KOMUNIKASI VISUAL MSD YOGYAKARTA

Directory of Open Access Journals (Sweden)

Soraya Fatmawati

2016-06-01

THE EVALUATION OF INSTRUCTIONAL IMPLEMENTATION OF VISUAL COMMUNICATION DESIGN STUDY PROGRAM IN MSD YOGYAKARTA Abstract This research aims to determine the suitability of the instructional implementation in Visual Communication Design (VCD Study Program of MSD Yogyakarta Design and Art Academy with standard or criteria which have been formulated. This research was an evaluation research study that refers to the discrepancy evaluation model. The subjects consisted of the head of study program, lecturers and students of VCD study program MSD Yogyakarta. The research was conducted in five stages: design preparation, determination of the program’s completeness, data collection, purpose measurement or data analysis, and comparison. Data were collected through observation, interviews, and document searches, and were analyzed using an interactive analysis model proposed by Miles and Huberman. The questionnaire data were analyzed using descriptive statistical analysis in the scale 4. The result of the study shows that instructional implementation in Visual Communication Design Study Program of MSD Yogyakarta is not suitable to the Minister of Education and Culture Regulation No. 49, 2014. The result of student assessment indicates that the instructional implementation in VCD MSD Yogyakarta is categorized good with the value of 3.20. The instructional implementation in Visual Communication Design Study Program of MSD Yogyakarta needs to be adjusted with the National Standards for Higher Education the Minister of Education and Culture Regulation No. 49, 2014 for the instructional implementation can be presented. Keywords: instructional implementation, instructional planning

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

Pilot Evaluation of a Sexual Abuse Prevention Program for Taiwanese Children

Science.gov (United States)

Chen, Yi-Chuen; Fortson, Beverly L.; Tseng, Kai-Wen

2012-01-01

The purpose of the current study was to develop and evaluate the efficacy of a school-based child sexual abuse prevention program for Taiwanese children. Forty-six Taiwanese children age 6 to 13 were divided into one of two groups based on their school grade and then randomly assigned to a skills-based child sexual abuse prevention program who…

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

The evaluation of a culturally appropriate, community-based lifestyle intervention program for elderly Chinese immigrants with chronic diseases: a pilot study.

Science.gov (United States)

Lu, Yifan; Dipierro, Moneika; Chen, Lingjun; Chin, Richard; Fava, Maurizio; Yeung, Albert

2014-03-01

The 'Healthy Habits Program' is a 6-month community-based program, which offers exercise facilities, training and weekly health education group to underserved elderly Chinese Americans with chronic medical diseases in their native languages. This pilot study evaluates the acceptability and the health effects of the 'Healthy Habits Program'. Ninety-nine subjects participated in the 'Healthy Habits Program' in 2011. Before and after the program, the participants were assessed in their physical and mental health using various fitness tests as well as measures of disability and psychological functioning. Participants provided overwhelmingly positive feedback on the program, which was associated with significant improvements in physical and mental health including a significant decrease in body mass index (BMI), blood pressure and increase in stamina. The participants reported lower mean scores on the Patient Health Questionnaire-9 item Scale (PHQ-9), indicating improved psychological well-being. These promising pilot study results from this lifestyle intervention program for elderly Chinese American immigrants with chronic diseases inform the design of a more definitive trial using a randomized design and larger sample size.

New approach in the evaluation of a fitness program at a worksite.

Science.gov (United States)

Shirasaya, K; Miyakawa, M; Yoshida, K; Tanaka, C; Shimada, N; Kondo, T

1999-03-01

The most common methods for the economic evaluation of a fitness program at a worksite are cost-effectiveness, cost-benefit, and cost-utility analyses. In this study, we applied a basic microeconomic theory, "neoclassical firm's problems," as the new approach for it. The optimal number of physical-exercise classes that constitute the core of the fitness program are determined using the cubic health production function. The optimal number is defined as the number that maximizes the profit of the program. The optimal number corresponding to any willingness-to-pay amount of the participants for the effectiveness of the program is presented using a graph. For example, if the willingness-to-pay is $800, the optimal number of classes is 23. Our method can be applied to the evaluation of any health care program if the health production function can be estimated.

Is Something Better than Nothing? An Evaluation of Early Childhood Programs in Cambodia

Science.gov (United States)

Rao, Nirmala; Sun, Jin; Pearson, Veronica; Pearson, Emma; Liu, Hongyun; Constas, Mark A.; Engle, Patrice L.

2012-01-01

This study evaluated the relative effectiveness of home-based, community-based, and state-run early childhood programs across Cambodia. A total of 880 five-year-olds (55% girls) from 6 rural provinces in Cambodia attending State Preschools, Community Preschools, Home-Based Programs, or no programs were assessed twice using the Cambodian…

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

Science.gov (United States)

Maher, Charles A.

1981-01-01

Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

Evaluation of the Science, Technology, and Engineering Leadership Program, Year Two

Science.gov (United States)

Wolanin, Natalie L.; Wade, Julie H.

2013-01-01

The Office of Shared Accountability (OSA) conducted an evaluation of the implementation of the second year (2011-2012) of the Science, Technology, and Engineering Leadership Program (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard Hughes Medical…

Evaluation of the Science, Technology, and Engineering Leadership Program, Year Three

Science.gov (United States)

Wolanin, Natalie; Wade, Julie

2014-01-01

The Office of Shared Accountability conducted an evaluation of the implementation of the third and final year (2012-2013) of the "Science, Technology, and Engineering Leadership Program" (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard…

How Bigelow Laboratory Measured Broader Impacts: The Case Study of the Evaluation of the Keller BLOOM Program (Invited)

Science.gov (United States)

Fowler, R. A.; Repa, J.

2010-12-01

In this presentation we discuss the impetus for, the results of the short and long term effects, and the impacts of the Keller BLOOM Program, hosted by Bigelow Laboratory for Ocean Sciences of West Boothbay Harbor, Maine. Each May, for the last 21 years, 16 bright high school juniors, one from each county in Maine, have been invited to spend five days with the research scientists at the lab conducting and reporting research on the bottom layers of the ocean’s food chain: phytoplankton and zooplankton. Bigelow has chosen to evaluate BLOOM through a series of questionnaires delivered during the program, and long term tracking of participants after the program, in order to better understand the impact of the program on participants. The short term effect of the experience, measured at the end of the week, found that participants are able to: 1) develop testable research questions, 2) collect multiple water samples from a local estuary, 3) measure various characteristics of those samples with the sophisticated instruments in Bigelow’s labs assisted by their research scientists, 4) analyze and integrate the results from the various labs, and 5) present their findings to a non-scientific audience. To measure long term participation effects, a random sample of 40 of the 332 participants were interviewed resulting in the following findings: 100% attend college; 62% have STEM majors; 88% graduate from college; 57% pursue STEM careers; and 60% live and work in Maine. Bigelow scientists include a description of the BLOOM Program and the evaluation results in their NSF Broader Impacts statements to demonstrate that their research activities are being integrated into a successful STEM education program. Evaluation results are also used by Bigelow scientists and program administrators to refine program content and delivery, to promote the program to potential applicants, and to strengthen proposals to funding agencies when seeking financial support for BLOOM.

Evaluation of otolaryngology residency program websites.

Science.gov (United States)

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42

The efficacy of an educational program for parents of children with epilepsy (FAMOSES): Results of a controlled multicenter evaluation study.

Science.gov (United States)

Hagemann, Anne; Pfäfflin, Margarete; Nussbeck, Fridtjof W; May, Theodor W

2016-11-01

The objective of this study was to evaluate the efficacy of the educational program FAMOSES (modular service package epilepsy for families) for parents of children with epilepsy. Parents of children with epilepsy from Germany and Austria were included in a controlled prospective multicenter study using a pre-post design. Participants of the FAMOSES program (FAMOSES group, n=148) completed a standardized questionnaire immediately before the program and six months later. The matched control group of parents not participating in the program (n=74, matching ratio 2:1) also answered the questionnaire twice, at an interval of six months. The questionnaire comprised epilepsy-specific outcome measures (e.g., knowledge, coping, fears) and disease-related variables (e.g., seizure frequency). The generalized estimation equation approach was used for statistical analysis. In addition, parents' satisfaction with the FAMOSES program was assessed six months after participation. Parents of the FAMOSES group significantly improved in epilepsy-specific knowledge (group×time interaction: pepilepsy-related fears (pepilepsy with their child (pepilepsy and reduce epilepsy-related fears. Copyright © 2016 Elsevier Inc. All rights reserved.

Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emeral Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2007-03-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others.

Evaluation of the content and accessibility of microsurgery fellowship program websites.

Science.gov (United States)

Silvestre, Jason; Vargas, Christina R; Ho, Olivia; Lee, Bernard T

2015-10-01

Microsurgery fellowship applicants utilize Internet-based resources such as the San Francisco Match (SF Match) to manage their applications. In deciding where to apply, applicants rely on advice from mentors and online resources including microsurgery fellowship websites (MFWs). The purpose of this study was to evaluate the content and accessibility of MFWs. While microsurgery is practiced by many surgical specialties, this study focused on MFWs for programs available in the 2014 Microsurgery Fellowship Match. Program lists from the American Society for Reconstructive Microsurgery (ASRM) and the San Francisco Match (SF Match) were analyzed for the accessibility of MFW links. MFWs were evaluated for education and recruitment content, and MFW comprehensiveness was compared on the basis of program characteristics using chi square tests. Of the 25 fellowships available, only 18 had websites (72%). SF Match and ASRM listed similar programs (96% overlap) and provided website links (89%, 76%), but only a minority connected directly to the MFW (38%, 23%). A minority of programs were responsive via email inquiry (36%). MFWs maintained minimal education and recruitment content. MFW comprehensiveness was not associated with program characteristics. MFWs are often not readily accessible and contain limited information for fellowship applicants. Given the relative low-cost of website development, MFWs may be improved to facilitate fellow recruitment. © 2015 Wiley Periodicals, Inc.

A multi-stakeholder evaluation of the Baltimore City virtual supermarket program

Directory of Open Access Journals (Sweden)

Pooja Lagisetty

2017-10-01

Full Text Available Abstract Background Increasing access to healthy foods and beverages in disadvantaged communities is a public health priority due to alarmingly high rates of obesity. The Virtual Supermarket Program (VSP is a Baltimore City Health Department program that uses online grocery ordering to deliver food to low-income neighborhoods. This study evaluates stakeholder preferences and barriers of program implementation. Methods This study assessed the feasibility, sustainability and efficacy of the VSP by surveying 93 customers and interviewing 14 programmatic stakeholders who had recently used the VSP or been involved with program design and implementation. Results We identified the following themes: The VSP addressed transportation barriers and food availability. The VSP impacted customers and the city by including improving food purchasing behavior, creating a food justice “brand for the city”, and fostering a sense of community. Customers appreciated using Supplemental Nutrition Assistance Program (SNAP benefits to pay for groceries, but policy changes are needed allow online processing of SNAP benefits. Conclusions This evaluation summarizes lessons learned and serves as a guide to other public health leaders interested in developing similar programs. Provisions in the U.S. Department of Agriculture (USDA Farm Bill 2014 allow for select grocers to pilot online transactions with SNAP benefits. If these pilots are efficacious, the VSP model could be easily disseminated.

Relevance Evaluation of Engineering Master's Program in Peru

OpenAIRE

Miñán, Erick; Lavalle, Carlos; Díaz-Puente, José M.

2012-01-01

In a context of mass higher education, it is necessary to ensure not only quality but also the relevance of engineering master's programs, namely the appropriateness of the objectives and outcomes to the needs and interests of the program beneficiaries. After a literature review we analyzed the evaluation models of three organizations in Peru: the Board of Evaluation, Accreditation and Certification of the University Education Quality CONEAU, the Institute of Quality and Accreditation of Comp...

A national study of the streamflow data-collection program

Science.gov (United States)

Benson, Manuel A.; Carter, Rolland William

1973-01-01

The streamflow data program of the U.S. Geological Survey was evaluated in a nationwide study during 1970. The principal elements of the study were (1) establishing the objectives and goals of the program, (2) analyzing all available data to determine which of the goals have already been met, (3) considering alternate means of meeting the remaining goals, and (4) identifying the elements which should be included in the future program.

Challenges to Evaluating Physical Activity Programs in American Indian/Alaska Native Communities

Science.gov (United States)

Roberts, Erica Blue; Butler, James; Green, Kerry M.

2018-01-01

Despite the importance of evaluation to successful programming, a lack of physical activity program (PAP) evaluation for American Indian/Alaska Native (AI/AN) programs exists, which is significant given the high rates of obesity and diabetes in this population. While evaluation barriers have been identified broadly among AI/AN programs, challenges…

Using student satisfaction data to evaluate a new online accelerated nursing education program.

Science.gov (United States)

Gazza, Elizabeth A; Matthias, April

2016-10-01

As increasing numbers of students enroll in online education, institutions of higher education are responsible for delivering quality online courses and programs. Agencies that accredit institutions and programs require evidence of program quality, including student satisfaction. A large state university in the Southeastern United States transitioned an online nursing education degree completion, or Registered Nurse-to-Bachelor of Science in Nursing, program to an online accelerated format in order to meet the needs of working nurses and ultimately, increase the number of nurses prepared at the baccalaureate level. This article describes a descriptive, cross-sectional study that evaluated the effectiveness of the new online accelerated program using the quality indicator of student satisfaction. Ninety-one (32%) of the 284 students who were enrolled or had been enrolled in a course within the online accelerated degree completion program between fall 2013 session 1 and summer 2014 session participated in the study. The electronic Noel-Levitz Priorities Survey for Online Learners™ was used to measure student satisfaction with the program and associated services. Results provided insight into the students' satisfaction with the new program format and served as the basis for an interdepartmental program enhancement plan aimed at maintaining and enhancing student satisfaction and overall program quality. Findings indicated that measuring and evaluating student satisfaction can provide valuable information about the effectiveness of an online program. Recommendations for using the measurement tool in online program planning and studying student satisfaction in relation to retention and program completion were identified. Copyright © 2016 Elsevier Ltd. All rights reserved.

Using ecological theory to evaluate the effectiveness of an indigenous community intervention: A study of Sexual Assault Nurse Examiner (SANE) programs.

Science.gov (United States)

Campbell, Rebecca; Patterson, Debra; Fehler-Cabral, Giannina

2010-12-01

In recent years, there has been renewed interest among community psychologists in indigenous interventions, which are programs created by local practitioners (rather than researchers) already rooted in their communities. Indigenous interventions have strong ecological validity, but their effectiveness is often unknown because so few are rigorously evaluated. The goal of this project was to use Kelly and Trickett's ecological theory as a conceptual framework for evaluating an indigenous intervention and its mediating mechanisms of effectiveness. The focal intervention was a midwestern Sexual Assault Nurse Examiner (SANE) program, which provides post-assault medical care, crisis intervention, and medical forensic exams for sexual assault survivors. Prior studies of SANE programs have suggested that these interventions may help increase sexual assault prosecution rates. In this case example, we used a mixed methods design to determine if this program contributed to increased prosecution rates, and if so, why. Based on qualitative interviews with key stakeholders, we found substantial evidence for the Principle of Interdependence such that the SANE program strengthened the interconnections between the legal and medical systems, which contributed to increased prosecution. The intervention was effective in these outcomes because it promoted Cycling of Resources throughout the systems and fostered Adaptation of new roles for legal and medical personnel. Moving beyond this specific case example, this paper also examines cross-cutting advantages and struggles of using an ecological approach in the evaluation of indigenous community interventions.

The effect of before school physical activity on child development: A study protocol to evaluate the Build Our Kids Success (BOKS) Program.

Science.gov (United States)

Pojednic, Rachele; Peabody, Stephanie; Carson, Shelley; Kennedy, Mary; Bevans, Katherine; Phillips, Edward M

2016-07-01

Most childhood physical activity interventions focus on reducing childhood obesity with varying success, indicating that body mass index (BMI) may be a limited marker of health in children. To better understand overall childhood health and wellbeing, this study is investigating BOKS (Build Our Kids Success), an established ongoing before-school physical activity program, to evaluate students' physical health, mental health, cognitive capacity, and academic performance. The study is a non-randomized controlled trial with 26 elementary and middle schools in 3 Massachusetts communities, including first through eighth grade (aged 5-14) students, their parents, and teachers. Data collection is occurring during the 2015-2016 school year. Physical fitness is being assessed via 400m run and anthropometrics via height and weight measures (BMI). Psychosocial outcomes are being assessed via student, parent, and teacher survey and include nutrition, daily activities, emotional and relationship scales, bullying and victimization, vitality and energy, student engagement, stress, positive affect, self-efficacy and life satisfaction. Academic performance is reported by grades. Statistical methods include a psychometric evaluation of study measures, Pearson correlations, Student's t-tests, ANOVA/ANCOVA and multivariate linear regression including multilevel modeling analyses to account for the hierarchical organization of the data. This study is investigating a before school physical activity program on parameters of physical health, mental health, cognitive capacity, and academic performance by employing a novel triad approach, correlating the input of the child, parent, and teacher. Outcomes will evaluate the effectiveness of a before school physical activity program in elementary and middle schools and potentially provide valuable information for schools looking to institute innovative physical activity programs. Copyright © 2016 Elsevier Inc. All rights reserved.

Evaluation of a Training Program to Reduce Stressful Trunk Postures in the Nursing Professions: A Pilot Study.

Science.gov (United States)

Kozak, Agnessa; Freitag, Sonja; Nienhaus, Albert

2017-01-01

The aim of this pilot study was to evaluate metrologically the effectiveness of a training program on the reduction of stressful trunk postures in geriatric nursing professions. A training program, consisting of instruction on body postures in nursing, practical ergonomic work methods at the bedside or in the bathroom, reorganization of work equipment, and physical exercises, was conducted in 12 wards of 6 nursing homes in Germany. The Computer-Assisted Recording and Long-Term Analysis of Musculoskeletal Loads (CUELA) measurement system was used to evaluate all movements and trunk postures adopted during work before and 6 months after the training program. In total, 23 shifts were measured. All measurements were supported by video recordings. A specific software program (WIDAAN 2.75) was used to synchronize the measurement data and video footage. The median proportion of time spent in sagittal inclinations at an angle of >20° was significantly reduced (by 29%) 6 months after the intervention [from 35.4% interquartile range (27.6-43.1) to 25.3% (20.7-34.1); P 4 s [4.4% (3.0-6.7) to 3.6% (2.5-4.5); P ergonomic measures were implemented properly, either at the bedside or in the bathroom. Stressful trunk postures could be significantly reduced by raising awareness of the physical strains that frequently occur during a shift, by changes in work practices and by redesigning the work environment. Workplace interventions aimed at preventing or reducing low back pain in nursing personnel would probably benefit from sensitizing employees to their postures during work. © The Author 2017. Published by Oxford University Press on behalf of the British Occupational Hygiene Society.

Evaluation of a Positive Youth Development Program Based on the Repertory Grid Test

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2012-01-01

Full Text Available The repertory grid test, based on personal construct psychology, was used to evaluate the effectiveness of Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes in Hong Kong. One hundred and four program participants (n=104 were randomly invited to complete a repertory grid based on personal construct theory in order to provide both quantitative and qualitative data for measuring self-identity changes after joining the program. Findings generally showed that the participants perceived that they understood themselves better and had stronger resilience after joining the program. Participants also saw themselves as closer to their ideal selves and other positive role figures (but farther away from a loser after joining the program. This study provides additional support for the effectiveness of the Tier 1 Program of Project P.A.T.H.S. in the Chinese context. This study also shows that the repertory grid test is a useful evaluation method to measure self-identity changes in participants in positive youth development programs.

Measurement and evaluation of energy efficiency programs: California and South Korea

International Nuclear Information System (INIS)

Vine, E.; Rhee, C.H.; Lee, K.D.

2006-01-01

One of the key challenges for countries facing electric utility restructuring is to ensure that key public goods, such as energy efficiency programs, do not lose support but are maintained and enhanced via regulatory policy and government action. Moreover, an infrastructure and process also needs to be designed and implemented for conducting the measurement and evaluation of energy efficiency programs. This paper describes the experiences of California and the Republic of Korea (Korea) in addressing these issues. These case studies confirm that the active involvement of regulatory bodies is needed to ensure that energy efficiency investments continue. The case studies also show that the development of an infrastructure and process for conducting rigorous measurement and evaluation takes time and needs the active participation of many stakeholders

The program success story: a valuable tool for program evaluation.

Science.gov (United States)

Lavinghouze, Rene; Price, Ann Webb; Smith, Kisha-Ann

2007-10-01

Success stories are evaluation tools that have been used by professionals across disciplines for quite some time. They are also proving to be useful in promoting health programs and their accomplishments. The increasing popularity of success stories is due to the innovative and effective way that they increase a program's visibility, while engaging potential participants, partners, and funders in public health efforts. From the community level to the federal level, program administrators are using success stories as vehicles for celebrating achievements, sharing challenges, and communicating lessons learned. Success stories are an effective means to move beyond the numbers and connect to readers-with a cause they can relate to and want to join. This article defines success stories and provides an overview of several types of story formats, how success stories can be systematically collected, and how they are used to communicate program success.

Independent auto evaluation of an operative radiological protection program

International Nuclear Information System (INIS)

Medrano L, M.A.; Rodriguez C, C.C.; Linares R, D.; Zarate M, N.; Zempoalteca B, R.

2006-01-01

The program of operative radiological protection of a nuclear power plant consists of multiple procedures and associate tasks that have as purpose the radiological protection of the workers of the power station. It is for this reason that the constant evaluation of the one it programs it is an important tool in the identification of their weaknesses (and strengths), so they can be assisted appropriately. In this work the main elements of the program of independent auto evaluation of the program of operative radiological protection of the Laguna Verde Central that has been developed and implemented by the National Institute of Nuclear Research are described. (Author)

Taiwan Teacher Preparation Program Evaluation: Some Critical Perspectives

Science.gov (United States)

Liu, Tze-Chang

2015-01-01

This paper focuses on the influences and changes of recent Taiwan teacher preparation program evaluation (TTPPE) as one of the national evaluation projects conducted by the Higher Education Evaluation and Accreditation Council of Taiwan. The main concerns are what kind of ideology is transformed through the policy by means of evaluation, and what…

A Pilot Evaluation of the Family Caregiver Support Program

Science.gov (United States)

Chen, Ya-Mei; Hedrick, Susan C.; Young, Heather M.

2010-01-01

The purposes of this study were to evaluate a federal and state-funded Family Caregiver Support Program (FCSP) and explore what types of caregiver support service are associated with what caregiver outcomes. Information was obtained on a sample of 164 caregivers' use of eleven different types of support service. Descriptive and comparative…

Study protocol for the evaluation of an Infant Simulator based program delivered in schools: a pragmatic cluster randomised controlled trial.

Science.gov (United States)

Brinkman, Sally A; Johnson, Sarah E; Lawrence, David; Codde, James P; Hart, Michael B; Straton, Judith A Y; Silburn, Sven

2010-10-21

This paper presents the study protocol for a pragmatic randomised controlled trial to evaluate the impact of a school based program developed to prevent teenage pregnancy. The program includes students taking care of an Infant Simulator; despite growing popularity and an increasing global presence of such programs, there is no published evidence of their long-term impact. The aim of this trial is to evaluate the Virtual Infant Parenting (VIP) program by investigating pre-conceptual health and risk behaviours, teen pregnancy and the resultant birth outcomes, early child health and maternal health. Fifty-seven schools (86% of 66 eligible secondary schools) in Perth, Australia were recruited to the clustered (by school) randomised trial, with even randomisation to the intervention and control arms. Between 2003 and 2006, the VIP program was administered to 1,267 participants in the intervention schools, while 1,567 participants in the non-intervention schools received standard curriculum. Participants were all female and aged between 13-15 years upon recruitment. Pre and post-intervention questionnaires measured short-term impact and participants are now being followed through their teenage years via data linkage to hospital medical records, abortion clinics and education records. Participants who have a live birth are interviewed by face-to-face interview. Kaplan-Meier survival analysis and proportional hazards regression will test for differences in pregnancy, birth and abortion rates during the teenage years between the study arms. This protocol paper provides a detailed overview of the trial design as well as initial results in the form of participant flow. The authors describe the intervention and its delivery within the natural school setting and discuss the practical issues in the conduct of the trial, including recruitment. The trial is pragmatic and will directly inform those who provide Infant Simulator based programs in school settings. ISRCTN24952438.

Evaluation of analytical results on DOE Quality Assessment Program Samples

International Nuclear Information System (INIS)

Jaquish, R.E.; Kinnison, R.R.; Mathur, S.P.; Sastry, R.

1985-01-01

Criteria were developed for evaluating the participants analytical results in the DOE Quality Assessment Program (QAP). Historical data from previous QAP studies were analyzed using descriptive statistical methods to determine the interlaboratory precision that had been attained. Performance criteria used in other similar programs were also reviewed. Using these data, precision values and control limits were recommended for each type of analysis performed in the QA program. Results of the analysis performed by the QAP participants on the November 1983 samples were statistically analyzed and evaluated. The Environmental Measurements Laboratory (EML) values were used as the known values and 3-sigma precision values were used as control limits. Results were submitted by 26 participating laboratories for 49 different radionuclide media combinations. The participants reported 419 results and of these, 350 or 84% were within control limits. Special attention was given to the data from gamma spectral analysis of air filters and water samples. both normal probability and box plots were prepared for each nuclide to help evaluate the distribution of the data. Results that were outside the expected range were identified and suggestions made that laboratories check calculations, and procedures on these results

Evolution of a multilevel framework for health program evaluation.

Science.gov (United States)

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Student Enrollment and Dropout: An Evaluation Study of DCSA Program at Bangladesh Open University

Science.gov (United States)

Rashid, Mohammad Mamunur; Jahan, Monira; Islam, Md. Anwarul; Ratna, Meherin Munjarin

2015-01-01

The aim of this study is to investigate the present status of DCSA program focusing on student enrollment, dropout, and completion trends. The study tries to explore the factors that attract or pull students to enroll in the program and push them to dropout from the program. Secondary data analysis and interview are used to generate data of the…

Organizational Structures that Support Internal Program Evaluation

Science.gov (United States)

Lambur, Michael T.

2008-01-01

This chapter explores how the structure of large complex organizations such as Cooperative Extension affects their ability to support internal evaluation of their programs and activities. Following a literature review of organizational structure and its relation to internal evaluation capacity, the chapter presents the results of interviews with…

An evaluation of a coal mining company's return to work program

International Nuclear Information System (INIS)

Allen, R.G.

1990-01-01

This study consolidates and evaluates information and data obtained from a coal mining company's return to work program called the Work Therapy Program. Organizational information and economic and statistical data were available for the study based on the company's records. Analysis of the data included descriptive statistics such as total injuries, the frequency rate of injuries, total days away from work due to injury, average days away per employee, and severity rates. A cost-benefit analysis was conducted to determine if the Program was economically beneficial to the company. Data from an opinion survey of the management at the mine where the Program was first instituted was used to determine the perceptions of mine management with respect to the Work Therapy Program. Conclusions were that the Work Therapy Program was economically beneficial to the Company and that the Program resulted in a significant reduction in compensable injuries. The Program did not significantly reduce days away from work due to mine injury. Perceptions of mine management were mostly positive

Compulsory Project-Level Involvement and the Use of Program-Level Evaluations: Evaluating the Local Systemic Change for Teacher Enhancement Program

Science.gov (United States)

Johnson, Kelli; Weiss, Iris R.

2011-01-01

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Methods for evaluating a mature substance abuse prevention/early intervention program.

Science.gov (United States)

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

An Interactive Web-Based Program for Stepfamilies: Development and Evaluation of Efficacy

Science.gov (United States)

Gelatt, Vicky A.; Adler-Baeder, Francesca; Seeley, John R.

2010-01-01

This study evaluated the efficacy of a family life education program for stepfamilies that is self-administered, interactive, and web-based. The program uses behavior-modeling videos to demonstrate effective couple, parenting, and stepparenting practices. A diverse sample of 300 parents/stepparents of a child aged 11-15 years were randomized into…

The US Department of Energy Personnel Dosimetry Evaluation and Upgrade Program

International Nuclear Information System (INIS)

Faust, L.G.; Stroud, C.M.; Swinth, K.L.; Vallario, E.J.

1987-11-01

The US Department of Energy (DOE) Personnel Dosimetry Evaluation and Upgrade Program is designed to identify and evaluate dosimetry deficiencies and to conduct innovative research and development programs that will improve overall capabilities, thus ensuring that DOE can comply with applicable standards and regulations for dose measurement. To achieve these goals, two programs were initiated to evaluate and upgrade beta measurement and neutron dosimetry. 3 refs

ANALISIS KESIAPAN PROGRAM STUDI DALAM PRODUCTION BASED EDUCATION: STUDI PADA PROGRAM STUDI D3 AKUNTANSI POLINES

Directory of Open Access Journals (Sweden)

Muhammad Noor Ardiansah

2015-03-01

Full Text Available There has been no clear studies to identify, verify and analyze readiness program resources in order to study the implementation of PBE resulted in initial position (existing point is not clear that the priority programs and activities that are carried out per year tend to be responsive and not directed priorities. These conditions resulted in analysis of resource readiness courses in the management of production-based learning pattern PBE draw conducted This study aims to identify and verify and analyze readiness resources management courses in the pattern of production based learning, particularly in the Accounting Studies Program. This research is expected to be used to increase the effectiveness of learning and vocational education to improve the quality and relevance of polytechnic graduates. Total score was 33 the existence of resources from the scale of 12-60. The average score is 2.75. The average score was shown the position of Prodi's resources have been used, but its role is unclear (repeatable tend to have clearly defined functions, communicated and documented (defined. Resources have been managed, monitored and evaluated well (managed are: curriculum resources, networking courses, lab facilities, ISO-based management. Resources have been used but not optimal role: resources module practice, the formulation of an internship, practice material / TA, the performance of IC-based lecturer

ANALISIS KESIAPAN PROGRAM STUDI DALAM PRODUCTION BASED EDUCATION: STUDI PADA PROGRAM STUDI D3 AKUNTANSI POLINES

Directory of Open Access Journals (Sweden)

Muhammad Noor Ardiansah

2014-06-01

Full Text Available There has been no clear studies to identify, verify and analyze readiness program resources in order to study the implementation of PBE resulted in initial position (existing point is not clear that the priority programs and activities that are carried out per year tend to be responsive and not directed priorities. These conditions resulted in analysis of resource readiness courses in the management of production-based learning pattern PBE draw conducted This study aims to identify and verify and analyze readiness resources management courses in the pattern of production based learning, particularly in the Accounting Studies Program. This research is expected to be used to increase the effectiveness of learning and vocational education to improve the quality and relevance of polytechnic graduates. Total score was 33 the existence of resources from the scale of 12-60. The average score is 2.75. The average score was shown the position of Prodi's resources have been used, but its role is unclear (repeatable tend to have clearly defined functions, communicated and documented (defined. Resources have been managed, monitored and evaluated well (managed are: curriculum resources, networking courses, lab facilities, ISO-based management. Resources have been used but not optimal role: resources module practice, the formulation of an internship, practice material / TA, the performance of IC-based lecturer

Child Development Program Evaluation Scale.

Science.gov (United States)

Fiene, Richard J.

The Child Development Program Evaluation Scale (CDPES) is actually two scales in one, a licensing scale and a quality scale. Licensing predictor items have been found to predict overall compliance of child day care centers with state regulations in four states. Quality scale items have been found to predict the overall quality of child day care…

Objective Evaluation in an Online Geographic Information System Certificate Program

OpenAIRE

Scott L. WALKER

2005-01-01

Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program....

Nondestructive Evaluation Program: Progress in 1986

International Nuclear Information System (INIS)

1987-07-01

The increasing cost of equipment for power generating plants and the potential increases in productivity and safety available through rapidly developing Nondestructive Evaluation (NDE) technology led EPRI to initiate a Nondestructive Evaluation Program in 1974. To date, the major focus has been on light water reactor inspection problems; however, increased application to other systems is now under way. This report presents a comprehensive review of the EPRI effort in the NDE area. Most of the report consists of contractor-supplied progress reports on each current project. An organizational plan of the program is presented in overview. In addition, organization from several viewpoints is presented, e.g., in-service inspection operators, R and D personnel, and utility representatives. The report summarizes significant progress made since the previous EPRI Special Report NP-4315-SR was issued in May 1986. Section 1 contains information about the program organization, and the sections that follow contain contractor-supplied progress reports of each current project. The progress reports are grouped by plant components - pipe, pressure vessel, steam generator and boiler tubes, and turbine. In addition, Part 6 is devoted to discussions of technology transfer

Evaluation of a program for routine implementation of shared decision-making in cancer care: study protocol of a stepped wedge cluster randomized trial.

Science.gov (United States)

Scholl, Isabelle; Hahlweg, Pola; Lindig, Anja; Bokemeyer, Carsten; Coym, Anja; Hanken, Henning; Müller, Volkmar; Smeets, Ralf; Witzel, Isabell; Kriston, Levente; Härter, Martin

2018-03-27

Shared decision-making (SDM) has become increasingly important in health care. However, despite scientific evidence, effective implementation strategies, and a prominent position on the health policy agenda, SDM is not widely implemented in routine practice so far. Therefore, we developed a program for routine implementation of SDM in oncology by conducting an analysis of the current state and a needs assessment in a pilot study based on the Consolidated Framework for Implementation Research (CFIR). Based on these results, the main aim of our current study is to evaluate the process and outcome of this theoretically and empirically grounded multicomponent implementation program designed to foster SDM in routine cancer care. We use a stepped wedge design, a variant of the cluster randomized controlled trial. The intervention to be implemented is SDM. Three participating clinics of one comprehensive cancer center will be randomized and receive the multicomponent SDM implementation program in a time-delayed sequence. The program consists of the following strategies: (a) SDM training for health care professionals, (b) individual coaching for physicians, (c) patient activation strategy, (d) provision of patient information material and decision aids, (e) revision of the clinics' quality management documents, and (f) critical reflection of current organization of multidisciplinary team meetings. We will conduct a mixed methods outcome and process evaluation. The outcome evaluation will consist of four measurement points. The primary outcome is adoption of SDM, measured by the 9-item Shared Decision Making Questionnaire. A range of other implementation outcomes will be assessed (i.e., acceptability, readiness for implementing change, appropriateness, penetration). The implementation process will be evaluated using stakeholder interviews and field notes. This will allow adapting interventions if necessary. This study is the first large study on routine implementation of

A STUDY EVALUATING THE EFFECTS OF BOMBAY HOSPITAL PHYSIOTHERAPY PROGRAM AND CONVENTIONAL PHYSIOTHERAPY EXERCISE PROGRAM ON GERIATRIC PATIENTS PRESENTING WITH CALF PAIN

OpenAIRE

Rohit Subhedar; Pallavi Dave; Priyanka Mishra; Shailee Jain

2015-01-01

Objective: To investigate the effects of (BHP-Program) on geriatric patients with calf pain. Method: This research was designed by evaluating the progress report of Geriatric Physiotherapy patients at Multi-specialty Department of Physiotherapy- Bombay Hospital-Indore. The subjects were the patients receiving Physiotherapy at Multi specialty Physiotherapy Department - Bombay Hospital, Indore. VAS scale was used for the pain evaluation. Pain Scale parameters of 30 Patients of age group 60...

Evaluating a staff training program on the interaction between staff and people with intellectual disability and challenging behaviour : An observational study

NARCIS (Netherlands)

Embregts, P.J.C.M.; Zijlmans, L.; Gerits, L.; Bosman, A.M.T.

2018-01-01

Background: The aim of this study was to evaluate the effects of a training program focusing on improvement of emotional intelligence (EI) and support staffs’ awareness of their behaviour towards people with an intellectual disability based on interactional patterns. The support provided regarding

Evaluation of the RATU2 and RETU research programs

International Nuclear Information System (INIS)

Faidy, C.; Hayns, M.R.

1998-05-01

The report is an evaluation of the Finnish RATU2 (Structural Integrity of Nuclear Power Plants) and RETU (Reactor Safety) programs. The first generation of nuclear safety research programs were started in 1988-1990. Mid-term reviews were carried out and published in 1992. Many of the recommendations from those reviews have been implemented and they are referred to in this evaluation report

Act In case of Depression: The evaluation of a care program to improve the detection and treatment of depression in nursing homes. Study Protocol

Directory of Open Access Journals (Sweden)

Vernooij-Dassen Myrra JFJ

2011-05-01

Full Text Available Abstract Background The aim of this study is evaluating the (cost- effectiveness of a multidisciplinary, evidence based care program to improve the management of depression in nursing home residents of somatic and dementia special care units. The care program is an evidence based standardization of the management of depression, including standardized use of measurement instruments and diagnostical methods, and protocolized psychosocial, psychological and pharmacological treatment. Methods/Design In a 19-month longitudinal controlled study using a stepped wedge design, 14 somatic and 14 dementia special care units will implement the care program. All residents who give informed consent on the participating units will be included. Primary outcomes are the frequency of depression on the units and quality of life of residents on the units. The effect of the care program will be estimated using multilevel regression analysis. Secondary outcomes include accuracy of depression-detection in usual care, prevalence of depression-diagnosis in the intervention group, and response to treatment of depressed residents. An economic evaluation from a health care perspective will also be carried out. Discussion The care program is expected to be effective in reducing the frequency of depression and in increasing the quality of life of residents. The study will further provide insight in the cost-effectiveness of the care program. Trial registration Netherlands Trial Register (NTR: NTR1477

24 CFR 266.115 - Program monitoring and evaluation.

Science.gov (United States)

2010-04-01

... AUTHORITIES HOUSING FINANCE AGENCY RISK-SHARING PROGRAM FOR INSURED AFFORDABLE MULTIFAMILY PROJECT LOANS Housing Finance Agency Requirements § 266.115 Program monitoring and evaluation. (a) HFA certifications... under this part, basic underwriting and closing information must be submitted in a format specified by...

Evaluation of a train-the-trainer program for stable coronary artery disease management in community settings: A pilot study.

Science.gov (United States)

Shen, Zhiyun; Jiang, Changying; Chen, Liqun

2018-02-01

To evaluate the feasibility and effectiveness of conducting a train-the-trainer (TTT) program for stable coronary artery disease (SCAD) management in community settings. The study involved two steps: (1) tutors trained community nurses as trainers and (2) the community nurses trained patients. 51 community nurses attended a 2-day TTT program and completed questionnaires assessing knowledge, self-efficacy, and satisfaction. By a feasibility and non-randomized control study, 120 SCAD patients were assigned either to intervention group (which received interventions from trained nurses) or control group (which received routine management). Pre- and post-intervention, patients' self-management behaviors and satisfaction were assessed to determine the program's overall impact. Community nurses' knowledge and self-efficacy improved (Pmanagement behaviors (Pmanagement in community settings in China was generally feasible and effective, but many obstacles remain including patients' noncompliance, nurses' busy work schedules, and lack of policy supports. Finding ways to enhance the motivation of community nurses and patients with SCAD are important in implementing community-based TTT programs for SCAD management; further multicenter and randomized control trials are needed. Copyright © 2017 Elsevier B.V. All rights reserved.

Evaluation of verifiability in HAL/S. [programming language for aerospace computers

Science.gov (United States)

Young, W. D.; Tripathi, A. R.; Good, D. I.; Browne, J. C.

1979-01-01

The ability of HAL/S to write verifiable programs, a characteristic which is highly desirable in aerospace applications, is lacking since many of the features of HAL/S do not lend themselves to existing verification techniques. The methods of language evaluation are described along with the means in which language features are evaluated for verifiability. These methods are applied in this study to various features of HAL/S to identify specific areas in which the language fails with respect to verifiability. Some conclusions are drawn for the design of programming languages for aerospace applications and ongoing work to identify a verifiable subset of HAL/S is described.

Evaluating a Graduate Professional Development Program for Informal Science Educators

Science.gov (United States)

Lake, Jeremy Paul

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the Informal Science Institutions Environmental Education Graduate Certificate Program truly provided the long term professional development needed to enhance the skills of the formal and informal educators participating so that they could contribute meaningfully to the improvement of science literacy in their respective communities. My role as an internal evaluator provided an extraordinary opportunity to know the intent of the learning opportunities and why they were constructed in a particular fashion. Through the combination of my skills, personal experiences both within the certificate's predecessor and as an educator, I was uniquely qualified to explore the outcomes of this program and evaluate its effectiveness in providing a long-term professional development for participants. After conducting a literature review that emphasized a need for greater scientific literacy in communities across America, it was evident that the formal education enterprise needs the support of informal educators working on the ground in myriad different settings in ways that provide science as both content and process, learning science facts and doing real science. Through a bridging of informal science educators with formal teachers, it was thought each could learn the culture of the other, making each more fluent in accessing community resources to help make these educators more collaborative and able to bridge the classroom with the outside world. This bridge promotes ongoing, lifelong learning, which in turn can help the national goal of greater scientific literacy. This study provided insight into the thinking involved in the learners' growth as they converted theory presented in course materials into practice. Through an iterative process of reviewing the course

Evaluation Study of VTAE Wood Technics Programs.

Science.gov (United States)

Wisconsin State Board of Vocational, Technical, and Adult Education, Madison.

A survey of former students of the Wisconsin Vocational, Technical, and Adult Education (VTAE) wood technics programs and employers in woodworking industries was conducted during spring of 1985. General objectives were to determine job classifications, types of businesses, and relative importance of tasks or duties in various woodworking-related…

["StigMa" - Evaluation of a Psychological Therapy Program for Stigma-Management].

Science.gov (United States)

Schenner, Manuela; Kohlbauer, Daniela; Meise, Ullrich; Haller, Christina; Pixner-Huber, Martina; Stürz, Kristina; Günther, Verena

2018-01-01

The project "Stigma Management - StigMa" aims on the evaluation of an adaptive therapy program for patients with psychiatric illness to help them in managing internalized stigma and self-stigmatization. The patients for this pilot-study were recruited in day-hospitals of pro mente tirol . 26 patients participated in 11 group sessions, following 6 modules: "Education", "Activation of Resources", "Social Network", "Self-Esteem", "Social competence in public places" and "My personal stigma management". The control group consisted of 20 patients who did not participate in StigMa. Pre-post-evaluation was done by the Internalized Stigma of Mental Illness-Scale 1. No significant interaction effects could be observed, although in the treatment group, the burden of perceived discrimination was significantly less pronounced after training than before it. The program, however, was evaluated as being extremely positive by the participants. The program StigMa will be adapted in accordance with the suggestions of the participants and reevaluated taking into consideration methodological optimization. © Georg Thieme Verlag KG Stuttgart · New York.

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

Science.gov (United States)

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

The Neighborhood Study Center Teacher Aide Program. 1969-1970 Evaluation.

Science.gov (United States)

Community Services Planning Council, Sacramento, CA.

The program is designed to help provide the extra help with schoolwork that educationally and economically disadvantaged children need. The project has study centers in every low-income neighborhood in Sacramento, opened at the request of an organization or agency in the area, and staffed by volunteer tutors contribute one to two hours per week to…

Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience.

Science.gov (United States)

Bennett, Sara; Ozawa, Sachiko; Rodriguez, Daniela; Paul, Amy; Singh, Kriti; Singh, Suneeta

2015-10-01

In low and middle-income countries, programs funded and implemented by international donors frequently transition to local funding and management, yet such processes are rarely evaluated. We reflect upon experience evaluating the transition of a large scale HIV/AIDS prevention program in India, known as Avahan, in order to draw lessons about transition evaluation approaches and implementation challenges. In terms of conceptualizing the transition theory, the evaluation team identified tensions between the idea of institutionalizing key features of the Avahan program, and ensuring program flexibility to promote sustainability. The transition was planned in three rounds allowing for adaptations to transition intervention and program design during the transition period. The assessment team found it important to track these changes in order to understand which strategies and contextual features supported transition. A mixed methods evaluation was employed, combining semi-structured surveys of transitioning entities (conducted pre and post transition), with longitudinal case studies. Qualitative data helped explain quantitative findings. Measures of transition readiness appeared robust, but we were uncertain of the robustness of institutionalization measures. Finally, challenges to the implementation of such an evaluation are discussed. Given the scarceness of transition evaluations, the lessons from this evaluation may have widespread relevance. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Evaluation of the Navy Master Planning Program

Science.gov (United States)

1976-05-01

Navy planning directives, interviews with Navy planning personnel, researc " of applicable literature on planning and program evaluation, and the...master planning has absorbed the additional roles of program management and public relations marketing . The Navy planner is now deeply involved in...master planning 62conducted by NAVFAC headquarters in 1972, various Navy planning directives, a " Market Survey" of NAVFAC services and customer 63

Implementation and evaluation of an incentivized Internet-mediated walking program for obese adults.

Science.gov (United States)

Zulman, Donna M; Damschroder, Laura J; Smith, Ryan G; Resnick, Paul J; Sen, Ananda; Krupka, Erin L; Richardson, Caroline R

2013-12-01

In response to rising health care costs associated with obesity rates, some health care insurers are adopting incentivized technology-enhanced wellness programs. The purpose of this study is to evaluate the large-scale implementation of an incentivized Internet-mediated walking program for obese adults and to examine program acceptance, adherence, and impact. A mixed-methods evaluation was conducted to investigate program implementation, acceptance, and adherence rates, and physical activity rates among program participants. Program implementation was shaped by national and state policies, data security concerns, and challenges related to incentivizing participation. Among 15,397 eligible individuals, 6,548 (43 %) elected to participate in the walking program, achieving an average of 6,523 steps/day (SD 2,610 steps). Participants who uploaded step counts for 75 % of days for a full year (n = 2,885) achieved an average of 7,500 steps (SD 3,093). Acceptance and participation rates in this incentivized Internet-mediated walking program suggest that such interventions hold promise for engaging obese adults in physical activity.

EVALUATION OF THE IMPLEMENTATION OF OPERATIONS AND MAINTENANCE PROGRAMS IN NEW JERSEY SCHOOLS

Science.gov (United States)

The Asbestos Hazard Emergency Response Act (AHERA) required all schools to develop and implement an asbestos management plan (AMP). The key component of the AMP is the operations and maintenance (O&M) program. A study was conducted to evaluate the implementation of O&M programs a...

38 CFR 1.15 - Standards for program evaluation.

Science.gov (United States)

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... intent, contain a method to measure fulfillment of the objectives, ascertain the degree to which goals... the data. (f) Each program evaluation requires a systematic research design to collect the data...

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

Science.gov (United States)

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

Computer programs for TRIGA calibration, burnup evaluation, and bookkeeping

International Nuclear Information System (INIS)

Nelson, George W.

1978-01-01

Several computer programs have been developed at the University of Arizona to assist the direction and operation of the TRIGA Reactor Laboratory. The programs fall into the following three categories: 1. Programs for calculation of burnup of each fuel element in the reactor core, for maintaining an inventory of fuel element location and fissile content at any time, and for evaluation of the reactivity effects of burnup or proposed fuel element rearrangement in the core. 2. Programs for evaluation, function fitting, and tabulation of control rod measurements. 3. Bookkeeping programs to summarize and tabulate reactor runs and irradiations according to time, energy release, purpose, responsible party, etc. These summarized data are reported in an annual operating report for the facility. The use of these programs has saved innumerable hours of repetitious work, assuring more accurate, objective results, and requiring a minimum of effort to repeat calculations when input data are modified. The programs are written in FORTRAN-IV, and have been used on a CDC-6400 computer. (author)

SIMS analysis: Development and evaluation program summary

International Nuclear Information System (INIS)

Groenewold, G.S.; Appelhans, A.D.; Ingram, J.C.; Delmore, J.E.; Dahl, D.A.

1996-11-01

This report provides an overview of the ''SIMS Analysis: Development and Evaluation Program'', which was executed at the Idaho National Engineering Laboratory from mid-FY-92 to the end of FY-96. It should be noted that prior to FY-1994 the name of the program was ''In-Situ SIMS Analysis''. This report will not go into exhaustive detail regarding program accomplishments, because this information is contained in annual reports which are referenced herein. In summary, the program resulted in the design and construction of an ion trap secondary ion mass spectrometer (IT-SIMS), which is capable of the rapid analysis of environmental samples for adsorbed surface contaminants. This instrument achieves efficient secondary ion desorption by use of a molecular, massive ReO 4 - primary ion particle. The instrument manages surface charge buildup using a self-discharging principle, which is compatible with the pulsed nature of the ion trap. The instrument can achieve high selectivity and sensitivity using its selective ion storage and MS/MS capability. The instrument was used for detection of tri-n-butyl phosphate, salt cake (tank cake) characterization, and toxic metal speciation studies (specifically mercury). Technology transfer was also an important component of this program. The approach that was taken toward technology transfer was that of component transfer. This resulted in transfer of data acquisition and instrument control software in FY-94, and ongoing efforts to transfer primary ion gun and detector technology to other manufacturers

Experiential Education and Empowerment Evaluation: Mars Rover Educational Program Case Example.

Science.gov (United States)

Fetterman, David; Bowman, Cassie

2002-01-01

Empowerment evaluation helps people improve their programs using self-evaluation. Empowerment evaluation has three steps: establishing a mission; taking stock of the most significant activities; and planning for the future by establishing goals, strategies, and criteria for evidence. A NASA experiential program for small, distributed groups of…

Toy Control Program evaluation.

Science.gov (United States)

Stewart, H A; Ormond, C; Seeger, B R

1991-08-01

The Toy Control Program for the Apple IIe microcomputer is a software and hardware package developed for the training of single-switch scanning skills. The specially designed scanning programs provide on screen visual feedback and activate a battery-powered toy to reinforce performance. This study examined whether the training of preschool subjects in single-switch scanning skills with the Toy Control Program would result in increased task completion scores and increased levels of attention to task, as compared with conditions of toy activation only and microcomputer programs with screen reinforcement only. The results showed that the subjects paid significantly more attention to the toys as reinforcers (p less than .01). No significant difference was found for the performance results of the three conditions. These findings support the use of a program like the Toy Control Program, which integrates the instructional capabilities of a computer with the reinforcement potential of a toy and the creativity of a therapist.

Evaluating a leadership program: a comparative, longitudinal study to assess the impact of the Executive Leadership in Academic Medicine (ELAM) Program for Women.

Science.gov (United States)

Dannels, Sharon A; Yamagata, Hisashi; McDade, Sharon A; Chuang, Yu-Chuan; Gleason, Katharine A; McLaughlin, Jean M; Richman, Rosalyn C; Morahan, Page S

2008-05-01

The Hedwig van Ameringen Executive Leadership in Academic Medicine (ELAM) program provides an external yearlong development program for senior women faculty in U.S. and Canadian medical schools. This study aims to determine the extent to which program participants, compared with women from two comparison groups, aspire to leadership, demonstrate mastery of leadership competencies, and attain leadership positions. A pre-/posttest methodology and longitudinal structure were used to evaluate the impact of ELAM participation. Participants from two ELAM cohorts were compared with women who applied but were not accepted into the ELAM program (NON) and women from the Association of American Medical Colleges (AAMC) Faculty Roster. The AAMC group was a baseline for midcareer faculty; the NON group allowed comparison for leadership aspiration. Baseline data were collected in 2002, with follow-up data collected in 2006. Sixteen leadership indicators were considered: administrative leadership attainment (four indicators), full professor academic rank (one), leadership competencies and readiness (eight), and leadership aspirations and education (three). For 15 of the indicators, ELAM participants scored higher than AAMC and NON groups, and for one indicator they scored higher than only the AAMC group (aspiration to leadership outside academic health centers). The differences were statistically significant for 12 indicators and were distributed across the categories. These included seven of the leadership competencies, three of the administrative leadership attainment indicators, and two of the leadership aspirations and education indicators. These findings support the hypothesis that the ELAM program has a beneficial impact on ELAM fellows in terms of leadership behaviors and career progression.

Strategies and policies for improving energy efficiency programs: Closing the loop between evaluation and implementation

International Nuclear Information System (INIS)

Vine, Edward

2008-01-01

Program implementers often use evaluation results to improve the performance of their programs, but, as described in this paper, this is not always the case. Based on a review of the literature, participation in workshops, and interviews with over 50 program implementers, evaluators, and regulators in the United States and Canada, the utilization of evaluation results is investigated by asking the following questions: (1) How are program evaluation results used by program implementers and other stakeholders? (2) How are program evaluation results communicated to program implementers and other stakeholders? (3) Are the needs of program implementers being met by program evaluation? (4) What is the role of the utility regulator in facilitating the use of program evaluation results? (5) What other mechanisms can facilitate the use of program evaluation results? While there is some consensus on the answers to these questions, the type of interest in and use of evaluation varies by functional role (e.g., evaluator versus implementer), maturity of the energy efficiency market, institutional context (e.g., evaluation and implementation conducted inside the same organization, or evaluation and implementation conducted by separate entities), and by regulatory demands and evaluation interests

Evaluation of a cognitive-behavioral program for chronically psychotic forensic inpatients.

NARCIS (Netherlands)

Hornsveld, R.H.J.; Nijman, H.L.I.

2005-01-01

The present study evaluated the progress of four groups of chronically psychotic patients in treatment at De Kijvelanden Forensic Psychiatric Hospital. The psychotic patients were offered a cognitive-behavioral program, including psycho education, grief processing, stress management, functional

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

Science.gov (United States)

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

IPEP: The integrated performance evaluation program for the Department of Energy's Office of Environmental Management

International Nuclear Information System (INIS)

Lindahl, P.C.; Streets, W.E.; Bass, D.A.

1995-01-01

The quality of the analytical data being provided to DOE's Office of Environmental Management (EM) for environmental restoration activities and the extent to which these data meet the data quality objectives are critical in the decision-making process. One of several quality metrics that can be used in evaluating a laboratory is its performance in performance evaluation (PE) programs. In support of DOE's environmental restoration and waste management efforts, EM has been charged with developing and implementing a program to assess the performance of participating laboratories. Argonne National Laboratory (ANL) and DOE's Environmental Measurements Laboratory (EML) and Radiological and Environmental Sciences Laboratory (RESL) have been collaborating on the development and implementation of a comprehensive Integrated Performance Evaluation Program (IPEP) for DOE-wide implementation. The IPEP will use results from existing inorganic, organic, and radiological PE programs when these are available and appropriate for the analytes and matrices being determined for DOE's EM activities. Existing programs include the U.S. Environmental Protection Agency's (EPA's) Contract Laboratory Program (CLP), the Water Supply (WS) and Water Pollution (WP) PE studies for inorganic and organic analytes, and DOE's Quality Assessment Program (QAP) for radiological analytes. In addition, DOE has begun the development of the Mixed Analyte Performance Evaluation Program (MAPEP) to address the needs of the DOE Complex. These PE programs provide a spectrum of matrices and analytes covering the various inorganic, organic, and low-level radiologic categories found in routine environmental and waste samples. These PE programs already provide some assessment of laboratory performance; IPEP will expand these assessments by evaluating historical performance, as well as results from multiple PE programs, thereby providing an enhanced usage of the PE program information

Evaluation Methodologies for Estimating the Likelihood of Program Implementation Failure

Science.gov (United States)

Durand, Roger; Decker, Phillip J.; Kirkman, Dorothy M.

2014-01-01

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

Evaluating the Effects of Virtual Pair Programming on Students’ Achievement and Satisfaction

Directory of Open Access Journals (Sweden)

Nick Zacharis

2009-09-01

Full Text Available Pair programming is a lightweight software development technique in which two programmers work together at one computer. In literature, many benefits of pair programming have been proposed, such as increased productivity, improved code quality, enhanced job satisfaction and confidence. Although pair programming provides clear pedagogical benefits, its collocation requirement and the limited time during a lab session are serious barriers in the full deployment and evaluation of this programming technique. This paper reports on a study that investigated the effectiveness of Virtual Pair Programming (VPP on student performance and satisfaction in an introductory Java course where students worked collaboratively in pairs on homework programming assignments, using online tools that integrated desktop sharing and real time communication. The results of this study support previous research findings and suggest that VPP is an effective pedagogical tool for flexible collaboration and an acceptable alternative to individual/solo programming experience, regarding productivity, code quality, academic performance and student satisfaction.

Evaluation of Monticello Nuclear Power Plant, Environmental Impact Prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1976-11-01

This report evaluates quantitatively the nonradiological environmental monitoring programs at Monticello Nuclear Generating Plant. The general objective of the study is to assess the effectiveness of monitoring programs in the measurement of environmental impacts. Specific objectives include the following: (1) Assess the validity of environmental impact predictions made in the Environmental Statement by analysis of nonradiological monitoring data; (2) evaluate the general adequacy of environmental monitoring programs for detecting impacts and their responsiveness to Technical Specifications objectives; (3) assess the adequacy of preoperational monitoring programs in providing a sufficient data base for evaluating operational impacts; (4) identify possible impacts that were not predicted in the environmental statement and identify monitoring activities that need to be added, modified or deleted; and (5) assist in identifying environmental impacts, monitoring methods, and measurement problems that need additional research before quantitative predictions can be attempted. Preoperational as well as operational monitoring data were examined to test the usefulness of baseline information in evaluating impacts. This included an examination of the analytical methods used to measure ecological and physical parameters, and an assessment of sampling periodicity and sensitivity where appropriate data were available

An Evaluation of Taiwan Vocational and Technical Education Programs in Agriculture.

Science.gov (United States)

Meaders, O. Donald; Chi-ho, Hu

Presented in both English and Chinese, this study of the system of agricultural education in Taiwan secondary and postsecondary schools resulted from the author's five-month stay in Taiwan and subsequent visits. Focus of the study is on evaluation of Taiwan's vocational agriculture education programs with information about students, faculties,…

Using Program Theory-Driven Evaluation Science to Crack the Da Vinci Code

Science.gov (United States)

Donaldson, Stewart I.

2005-01-01

Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

Systematic evaluation program, status summary report

International Nuclear Information System (INIS)

1983-01-01

Status reports are presented on the systematic evaluation program for the Big Rock Point reactor, Dresden-1 reactor, Dresden-2 reactor, Ginna-1 reactor, Connecticut Yankee reactor, LACBWR reactor, Millstone-1 reactor, Oyster Creek-1 reactor, Palisades-1 reactor, San Onofre-1 reactor, and Rowe Yankee reactor

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

Using the RE-AIM framework to evaluate physical activity public health programs in México.

Science.gov (United States)

Jauregui, Edtna; Pacheco, Ann M; Soltero, Erica G; O'Connor, Teresia M; Castro, Cynthia M; Estabrooks, Paul A; McNeill, Lorna H; Lee, Rebecca E

2015-02-19

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizational factors of public health programs. The purpose of this study was to use the RE-AIM framework to determine the degree to which PA programs in Mexico reported individual and organizational factors and to investigate whether reporting differed by the program's funding source. Public health programs promoting PA were systematically identified during 2008-2013 and had to have an active program website. Initial searches produced 23 possible programs with 12 meeting inclusion criteria. A coding sheet was developed to capture behavioral, outcome and RE-AIM indicators from program websites. In addition to targeting PA, five (42%) programs also targeted dietary habits and the most commonly reported outcome was change in body composition (58%). Programs reported an average of 11.1 (±3.9) RE-AIM indicator items (out of 27 total). On average, 45% reported reach indicators, 34% reported efficacy/effectiveness indicators, 60% reported adoption indicators, 40% reported implementation indicators, and 35% reported maintenance indicators. The proportion of RE-AIM indicators reported did not differ significantly for programs that were government supported (M = 10, SD = 3.1) and programs that were partially or wholly privately or corporately supported (M = 12.0, SD = 4.4). While reach and adoption of these programs were most commonly reported, there is a need for stronger evaluation of behavioral and health outcomes before the public health impact of these programs can be established.

A Transition Program for Underprepared Students in General Chemistry: Diagnosis, Implementation, and Evaluation

Science.gov (United States)

Shields, Shawn P.; Hogrebe, Mark C.; Spees, William M.; Handlin, Larry B.; Noelken, Greg P.; Riley, Julie M.; Frey, Regina F.

2012-01-01

We developed an online exam to diagnose students who are underprepared for college-level general chemistry and implemented a program to support them during the general chemistry sequence. This transition program consists of extended-length recitations, peer-led team-learning (PLTL) study groups, and peer-mentoring groups. We evaluated this…

The CEMHaVi program: control, evaluation, and modification of lifestyles in obese youth.

Science.gov (United States)

Vanhelst, Jérémy; Marchand, Frédéric; Fardy, Paul; Zunquin, Gautier; Loeuille, Guy-André; Renaut, Hervé; Mikulovic, Jacques; Hurdiel, Rémy; Béghin, Laurent; Theunynck, Denis

2010-01-01

Obesity in children has increased in recent years. Many studies with differing methodologies have been undertaken to treat obesity. The Control, Evaluation, and Modification of Lifestyles in Obese Youth (CEMHaVi) program is a unique 2-year health-wellness program of physical activity and health education for obese youth. Findings of this study represent results at 1-year follow-up. The purpose of this study was to evaluate the effects of the CEMHaVi program. Physician-referred subjects (N = 26) participated in the study, 14 girls (13.4 +/- 2.9 years) and 12 boys (12.3 +/- 2.8 years). Measurements included height, weight, body mass index (BMI), academic performance, sleep habits, and health knowledge. The intervention consisted of a unique program of physical activity, including a variety of games specifically selected to be enjoyable, maintain interest, and motivate subjects to adhere. Activity sessions were offered once per week, 2 hours each session, for 12 months. A health education program was offered once every 3 months for 2 hours per session. Health knowledge, academic performance, self-esteem, and sleep were assessed before and after the intervention. Means were calculated at baseline and following intervention and were compared by paired t tests. Findings suggest significant improvements in academic performance (P < .001), quality and quantity of sleep (P < .05), and obesity (P < .05). The program reduced BMI and improved health knowledge, sleep, and academic performance in obese children. The feasibility of a beneficial lifestyle intervention program is encouraging in addressing obesity and related issues in young boys and girls.

Conditional cash transfer impact evaluation: an evaluation of the costa rican secondary education program Avancemos

Directory of Open Access Journals (Sweden)

Catherine Mata

2015-07-01

Full Text Available This paper evaluates the impact of Avancemos, a conditional cash transfer program in Costa Rica. Specifically, this paper measures the impact on student desertion for the first year of the program using a panel created with the Household Surveys for Multiple Purposes for the years 2006 and 2007, elaborated by the National Institute of Statistics and Census. Using econometric tools and quasi-experimental methodologies such as Propensity Score Matching and difference-in-differences, we find a positive impact associated to the program for desertion and reinsertion. Specifically, for between 10 and 16 percent of the students who did not leave high school, it was only due to Avancemos, meaning that without the program they would have abandoned their studies. This is why we can conclude that Avancemos had a positive impact according to its planned objectives of preventing dropouts and ensuring their reinsertion.

Defence Health Service Mentoring Program Evaluation 2001

National Research Council Canada - National Science Library

Highfield, Jane

2002-01-01

...). DHS commissioned the Directorate of Strategic Personnel Planning and Research (DSPPR) to evaluate a recent Mentoring Program trial in order to assess the effectiveness and organizational value of Mentoring within DHS...

Study protocol for the evaluation of an Infant Simulator based program delivered in schools: a pragmatic cluster randomised controlled trial

Directory of Open Access Journals (Sweden)

Hart Michael B

2010-10-01

Full Text Available Abstract Background This paper presents the study protocol for a pragmatic randomised controlled trial to evaluate the impact of a school based program developed to prevent teenage pregnancy. The program includes students taking care of an Infant Simulator; despite growing popularity and an increasing global presence of such programs, there is no published evidence of their long-term impact. The aim of this trial is to evaluate the Virtual Infant Parenting (VIP program by investigating pre-conceptual health and risk behaviours, teen pregnancy and the resultant birth outcomes, early child health and maternal health. Methods and Design Fifty-seven schools (86% of 66 eligible secondary schools in Perth, Australia were recruited to the clustered (by school randomised trial, with even randomisation to the intervention and control arms. Between 2003 and 2006, the VIP program was administered to 1,267 participants in the intervention schools, while 1,567 participants in the non-intervention schools received standard curriculum. Participants were all female and aged between 13-15 years upon recruitment. Pre and post-intervention questionnaires measured short-term impact and participants are now being followed through their teenage years via data linkage to hospital medical records, abortion clinics and education records. Participants who have a live birth are interviewed by face-to-face interview. Kaplan-Meier survival analysis and proportional hazards regression will test for differences in pregnancy, birth and abortion rates during the teenage years between the study arms. Discussion This protocol paper provides a detailed overview of the trial design as well as initial results in the form of participant flow. The authors describe the intervention and its delivery within the natural school setting and discuss the practical issues in the conduct of the trial, including recruitment. The trial is pragmatic and will directly inform those who provide

An Evaluation of the Relationship Smarts Plus Program on Adolescents in Georgia

Directory of Open Access Journals (Sweden)

Ted G. Futris

2013-10-01

Full Text Available The present study examines the impact of Relationship Smarts Plus among 1,657 adolescents age 12-18 across 25 Georgia counties. The program, aimed at increasing awareness about healthy versus unhealthy relationships and promoting smart dating strategies and the application of healthy communication and conflict resolution skills, was offered 54 times by 23 different FCS or 4-H agents during a 53-month period. After each lesson, participants completed a 5-item retrospective pre- and post-test assessing changes in awareness and understanding of the concepts and skills learned. Overall, 949 (57% youth responded to an overall post-evaluation administered at the conclusion of the program series to document confidence levels in having a healthy relationship, likelihood of using the skills learned, perceived helpfulness of the program, and changes in how youth felt about themselves. On average, youth demonstrated significant increases in knowledge for all lessons and reported positive improvements across all post-evaluation indicators following participation in the program. Implications for future youth-focused outreach programming to promote healthy relationships are shared.

Evaluating disease management program effectiveness: an introduction to time-series analysis.

Science.gov (United States)

Linden, Ariel; Adams, John L; Roberts, Nancy

2003-01-01

Currently, the most widely used method in the disease management (DM) industry for evaluating program effectiveness is referred to as the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer a plausible rationale explaining the change from baseline. Furthermore, with the current inclination of DM programs to use financial indicators rather than program-specific utilization indicators as the principal measure of program success, additional biases are introduced that may cloud evaluation results. This paper presents a non-technical introduction to time-series analysis (using disease-specific utilization measures) as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

Evaluation of effects of program for improving skills and motivation for employment

Directory of Open Access Journals (Sweden)

Marić Zorica

2011-01-01

Full Text Available Contemporary programs that have been implemented in order to help unemployed reduce time for finding a job are based on clear theoretical background and empirical evidence. In addition to providing opportunities to learn necessary skills, these programs also incorporate important psychological components which will be addressed in this paper. The goal of these interventions is to reduce time for finding a job, prevent long-term unemployment and negative effects of unemployment on individuals“ mental health. The paper presents evaluation of the effects of these psychological interventions. The program was based on Ajzen’s theory of planned behavior (2005, Bandura’s social-cognitive theory (1997 and cognitive-behavior theory of behavioral change (Meichenbaum, 1993. The goal of this program was to help unemployed individuals take an active role in finding a job, reduce time for finding a job and prevent negative effects of unemployment on their mental health. The target group of the program were young unemployed individuals ages 19 - 30, with at least high school level of education. Evaluation study was conducted on a sample of 92 male and female individuals who attended 3-day psychological program. Participants filled out five short scales specifically designed to assess variables that were targeted for change, such as, active approach to finding a job, attitudes toward process of employment, self-efficacy and resilience to frustrations and obstacles. Scales were administered before and after the training. Evaluation results, based on these pre and post measures, showed significant positive effects of this program on all five variables.

APPLICATION OF THE SPERM CHROMATIN STRUCTURE ASSAY TO THE TEPLICE PROGRAM SEMEN STUDIES: A NEW METHOD FOR EVALUATING SPERM NUCLEAR CHROMATIN DAMAGE

Science.gov (United States)

ABSTRACTA measure of sperm chromatin integrity was added to the routine semen end points evaluated in the Teplice Program male reproductive health studies. To address the hypothesis that exposure to periods of elevated air pollution may be associated with abnormalities in sp...

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

Process evaluation of the Regional Biomass Energy Program

Energy Technology Data Exchange (ETDEWEB)

Wilson, C.R.; Brown, M.A.; Perlack, R.D.

1994-03-01

The U.S. Department of Energy (DOE) established the Regional Biomass Energy Program (RBEP) in 1983 to increase the production and use of biomass energy resources. Through the creation of five regional program (the Great Lakes, Northeast, Pacific Northwest, Southeast, and West), the RBEP focuses on regionally specific needs and opportunities. In 1992, Oak Ridge National (ORNL) conducted a process evaluation of the RBEP Program designed to document and explain the development of the goals and strategies of the five regional programs; describe the economic and market context surrounding commercialization of bioenergy systems; assess the criteria used to select projects; describe experiences with cost sharing; identify program accomplishments in the transfer of information and technology; and offer recommendations for program improvement.

Evaluation of a Pharmacist and Nurse Practitioner Smoking Cessation Program.

Science.gov (United States)

Afzal, Zubair; Pogge, Elizabeth; Boomershine, Virginia

2017-08-01

To evaluate the efficacy of a smoking cessation program led by a pharmacist and a nurse practitioner. During a 6-month period, patients attended 7 one-on-one face-to-face smoking cessation counseling sessions with a pharmacist and 1 to 2 one-on-one face-to-face smoking cessation counseling sessions with a nurse practitioner. The primary outcome was smoking cessation point prevalence rates at months 1, 3, and 5 post-quit date. Secondary outcomes included medication adherence rates at months 1, 3, and 5 post-quit date, nicotine dependence at baseline versus program end, and patient satisfaction. Nine (47%) of 19 total participants completed the program. Seven of the 9 patients who completed the program were smoke-free upon study completion. Point prevalence rates at months 1, 3, and 5 post-quit date were 66%, 77%, and 77%, respectively, based on patients who completed the program. Medication adherence rates were 88.6%, 54.6%, and 75% at months 1, 3, and 5 post-quit date, respectively. Based on the Fagerstrom test, nicotine dependence decreased from baseline to the end of the study, 4.89 to 0.33 ( P smoking cessation program can assist patients in becoming smoke-free.

29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

Science.gov (United States)

2010-07-01

... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

Does Implementation Follow Design? A Case Study of a Workplace Health Promotion Program Using the 4-S Program Design and the PIPE Impact Metric Evaluation Models.

Science.gov (United States)

Äikäs, Antti Hermanni; Pronk, Nicolaas P; Hirvensalo, Mirja Hannele; Absetz, Pilvikki

2017-08-01

The aim of this study was to describe the content of a multiyear market-based workplace health promotion (WHP) program and to evaluate design and implementation processes in a real-world setting. Data was collected from the databases of the employer and the service provider. It was classified using the 4-S (Size, Scope, Scalability, and Sustainability) and PIPE Impact Metric (Penetration, Implementation) models. Data analysis utilized both qualitative and quantitative methods. Program design covered well the evidence-informed best practices except for clear path toward sustainability, cooperation with occupational health care, and support from middle-management supervisors. The penetration rate among participants was high (99%) and majority (81%) of services were implemented as designed. Study findings indicate that WHP market would benefit the use of evidence-based design principles and tendentious decisions to anticipate a long-term implementation process already during the planning phase.

Evaluation of DOE's Partnership in Low-Income Residential Retrofit (PILIRR) Program

Energy Technology Data Exchange (ETDEWEB)

Callaway, J.W.; Lee, A.D.

1989-05-01

In July 1986, the US Department of Energy (DOE) awarded competitive grants to five states to conduct pilot projects to establish partnerships and use resource leveraging to stimulate support for low-income residential energy retrofits. The projects were conducted under DOE's Partnerships in Low-Income Residential Retrofit (PILIRR) Program. These projects have been monitored and analyzed through a concurrent process evaluation conducted by the Pacific Northwest Laboratory (PNL). This study reports the findings of that evaluation. The overriding goal of the PILIRR Program was to determine whether the states could stimulate support for low-income residential energy improvements from non-federal sources. The goal for the process evaluation was to conduct an assessment of the processes used by the states and the extent to which they successfully established partnerships and leveraged resources. Five states were selected to participate in the program: Florida, Iowa, Kentucky, Oklahoma and Washington. Each state proposed a different approach to promote non-federal support for low-income residential weatherization. Three of the five states--Florida, Iowa, and Washington--established partnerships that led to retrofits during the monitoring period (October 1986--October 1988). Kentucky established its partnership during the monitoring period, but did not accomplish its retrofits until after monitoring was complete. Oklahoma completed development of its marketing program and had begun marketing efforts by the end of the monitoring period. 16 refs., 7 figs., 1 tab.

Evaluating a community-based early childhood education and development program in Indonesia: study protocol for a pragmatic cluster randomized controlled trial with supplementary matched control group

NARCIS (Netherlands)

Pradhan, M.; Brinkman, S.A.; Beatty, A.; Maika, A.; Satriawan, E.; de Ree, J.; Hasan, A.

2013-01-01

Background This paper presents the study protocol for a pragmatic cluster randomized controlled trial (RCT) with a supplementary matched control group. The aim of the trial is to evaluate a community-based early education and development program launched by the Government of Indonesia. The program

Evaluating a community-based early childhood education and development program in Indonesia: study protocol for a pragmatic cluster randomized controlled trial with supplementary matched control group

NARCIS (Netherlands)

Pradhan, M.P.; Brinkman, S.A.; Beatty, A.; Maika, A.; Satriawan, E.; de Ree, J.; Hasan, A.

2013-01-01

Background: This paper presents the study protocol for a pragmatic cluster randomized controlled trial (RCT) with a supplementary matched control group. The aim of the trial is to evaluate a community-based early education and development program launched by the Government of Indonesia. The program

Evaluation of the riparian forest state program in Pitangueiras county, Parana

OpenAIRE

Peres, Marli Candalaft Alcantara Parra; Universidade Estadual de Londrina/UEL; Ralisch, Ricardo; Universidade Estadual de Londrina/UEL; Ripol, Cristovon Videira; Instituto Paranaense de Assistência Técnica e Extensão Rural do Paraná/EMATER

2009-01-01

Riparian forest restoration is fundamental for maintenance of vegetable, animal and human life. The objective of this study was to evaluate the efficiency of a Riparian Forest state program in the enlargement of the riparian forests in Pitangueiras county, state of Paraná, in the period of 2004 to 2006. Concerning the riparian reforestation, it was ansewered the reasons that convinced the farmers to join the program, the main difficulties found in its execution, and their views on environment...

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. (eds.); Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-01-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Evaluation of a Digital Game-Based Learning Program for Enhancing Youth Mental Health: A Structural Equation Modeling of the Program Effectiveness.

Science.gov (United States)

Huen, Jenny My; Lai, Eliza Sy; Shum, Angie Ky; So, Sam Wk; Chan, Melissa Ky; Wong, Paul Wc; Law, Y W; Yip, Paul Sf

2016-10-07

Digital game-based learning (DGBL) makes use of the entertaining power of digital games for educational purposes. Effectiveness assessment of DGBL programs has been underexplored and no attempt has been made to simultaneously model both important components of DGBL: learning attainment (ie, educational purposes of DGBL) and engagement of users (ie, entertaining power of DGBL) in evaluating program effectiveness. This study aimed to describe and evaluate an Internet-based DGBL program, Professor Gooley and the Flame of Mind, which promotes mental health to adolescents in a positive youth development approach. In particular, we investigated whether user engagement in the DGBL program could enhance their attainment on each of the learning constructs per DGBL module and subsequently enhance their mental health as measured by psychological well-being. Users were assessed on their attainment on each learning construct, psychological well-being, and engagement in each of the modules. One structural equation model was constructed for each DGBL module to model the effect of users' engagement and attainment on the learning construct on their psychological well-being. Of the 498 secondary school students that registered and participated from the first module of the DGBL program, 192 completed all 8 modules of the program. Results from structural equation modeling suggested that a higher extent of engagement in the program activities facilitated users' attainment on the learning constructs on most of the modules and in turn enhanced their psychological well-being after controlling for users' initial psychological well-being and initial attainment on the constructs. This study provided evidence that Internet intervention for mental health, implemented with the technologies and digital innovations of DGBL, could enhance youth mental health. Structural equation modeling is a promising approach in evaluating the effectiveness of DGBL programs.

An evaluation of an aggression management training program to cope with workplace violence in the healthcare sector

NARCIS (Netherlands)

J.K. Oostrom (Janneke); H. van Mierlo (Heleen)

2008-01-01

textabstractWorkplace violence is a major occupational hazard for healthcare workers, generating a need for effective intervention programs. The purpose of this study was to evaluate the effectiveness of an aggression management training program. The evaluation design was based on the internal

Objective Evaluation in an Online Geographic Information System Certificate Program

Directory of Open Access Journals (Sweden)

Scott L. WALKER

2005-01-01

Full Text Available Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program. The evaluation utilized several methods that strived to inject objectivity in evaluation and subsequent decision-making. A rapid multi-modal approach included evaluation methods of (1 considering the online psychosocial learning environment, (2 content analyses comparing the online version of classes to face-to-face versions, (3 cost comparisons in online vs. face-to-face classes, (4 student outcomes, (5 student retention, and (6 benchmarking. These approaches offer opportunities for departmental administrators and decision-making committees to make judgments informed by facts rather than being influenced by the emotions, beliefs, or opinions of organizational dynamics.

An Empirical Evaluation of the Florida Tax Credit Scholarship Program. School Choice Issues in the State

Science.gov (United States)

Forster, Greg; D'Andrea, Christian

2009-01-01

This study examines the Florida Tax Credit Scholarship program, one of the nation's largest school choice programs. It is the first ever completed empirical evaluation of a tax-credit scholarship program, a type of program that creates school choice through the tax code. Earlier reports, including a recent one on the Florida program, have not…

Evaluating employee assistance programs. A review of methods, outcomes, and future directions.

Science.gov (United States)

Jerrell, J M; Rightmyer, J F

1982-01-01

Renewed interest in assisting troubled employees has led to an upsurge in the development of employee assistance programs, coupled with demands for demonstrable effectiveness. This review examines the nature and scope of these programs, their administrative and methodological context, and the types and outcomes of evaluation studies conducted thus far. Proposals for improving future investigations through a number of different approaches and strategies are then made.

Impact Evaluation of an Addiction Intervention Program in a Quebec Prison

Directory of Open Access Journals (Sweden)

Catherine Arseneault

2015-01-01

Full Text Available Objectives This study evaluates the effects of a prison-based addiction intervention program. The evaluation is based on a multidimensional data collection that draws a portrait of the respondents’ substance use, and of their psychological/emotional, social, and judicial spheres. It measures the changes, or lack thereof, in substance use; the psychological/emotional, social, and judicial spheres; as well as the post-treatment services used. Method A quasi-experimental repeated measures design (0, 6 weeks, and 6 months was used. Effects of the program were identified by comparing the results obtained by a group of inmates who had participated in the program ( n = 80; experimental group with those of another group who had received no intervention ( n = 70; control group. Results The preliminary results suggested a certain treatment effect related to impulsivity and psychological distress. Conclusion Although the preliminary results were promising, the experimental and control groups did not differ significantly when more robust analyses were used.

EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

Science.gov (United States)

This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

Program Evaluation in Cost Benefit Terms.

Science.gov (United States)

Tanner, C. Kenneth

This paper advances a model, called the expected opportunity loss model, for curriculum evaluation. This decision-making technique utilizes subjective data by ranking courses according to their expected contributions to the primary objective of the total program. The model also utilizes objective data in the form of component costs, and differs…

Evaluation of a self-management patient education program for patients with fibromyalgia syndrome: study protocol of a cluster randomized controlled trial.

Science.gov (United States)

Musekamp, Gunda; Gerlich, Christian; Ehlebracht-König, Inge; Faller, Hermann; Reusch, Andrea

2016-02-03

Fibromyalgia syndrome (FMS) is a complex chronic condition that makes high demands on patients' self-management skills. Thus, patient education is considered an important component of multimodal therapy, although evidence regarding its effectiveness is scarce. The main objective of this study is to assess the effectiveness of an advanced self-management patient education program for patients with FMS as compared to usual care in the context of inpatient rehabilitation. We conducted a multicenter cluster randomized controlled trial in 3 rehabilitation clinics. Clusters are groups of patients with FMS consecutively recruited within one week after admission. Patients of the intervention group receive the advanced multidisciplinary self-management patient education program (considering new knowledge on FMS, with a focus on transfer into everyday life), whereas patients in the control group receive standard patient education programs including information on FMS and coping with pain. A total of 566 patients are assessed at admission, at discharge and after 6 and 12 months, using patient reported questionnaires. Primary outcomes are patients' disease- and treatment-specific knowledge at discharge and self-management skills after 6 months. Secondary outcomes include satisfaction, attitudes and coping competences, health-promoting behavior, psychological distress, health impairment and participation. Treatment effects between groups are evaluated using multilevel regression analysis adjusting for baseline values. The study evaluates the effectiveness of a self-management patient education program for patients with FMS in the context of inpatient rehabilitation in a cluster randomized trial. Study results will show whether self-management patient education is beneficial for this group of patients. German Clinical Trials Register, DRKS00008782 , Registered 8 July 2015.

Applying Matched Sampling to Evaluate a University Tutoring Program for First-Year Students

Science.gov (United States)

Walvoord, Mark E.; Pleitz, Jacob D.

2016-01-01

Our study used a case-control matching design to assess the influence of a voluntary tutoring program in improving first-year students' Grade Point Averages (GPA). To evaluate program effectiveness, we applied case-control matching to obtain 215 pairs of students with or without participation in tutoring, but matched on high school GPA and…

Study on chemical reactivity control of liquid sodium. Research program

International Nuclear Information System (INIS)

Saito, Jun-ichi; Ara, Kuniaki; Sugiyama, Ken-ichiro; Kitagawa, Hiroshi; Oka, Nobuki; Yoshioka, Naoki

2007-01-01

Liquid sodium has the excellent properties as coolant of the fast breeder reactor (FBR). On the other hand, it reacts high with water and oxygen. So an innovative technology to suppress the reactivity is desired. The purpose of this study is to control the chemical reactivity of liquid sodium by dispersing the nanometer-size metallic particles (we call them Nano-particles) into liquid sodium. We focus on the atomic interaction between Nano-particles and sodium atoms. And we try to apply it to suppress the chemical reactivity of liquid sodium. Liquid sodium dispersing Nano-particles is named 'Nano-fluid'. Research programs of this study are the Nano-particles production, the evaluation of reactivity suppression of liquid sodium and the feasibility study to FBR plant. In this paper, the research programs and status are described. The important factors for particle production were understood. In order to evaluate the chemical reactivity of Nano-fluid the research programs were planned. The feasibility of the application of Nano-fluid to the coolant of FBR plant was evaluated preliminarily from the viewpoint of design and operation. (author)

Preliminary Evaluation of a Practice-Based EBVM Skills Development Program

Directory of Open Access Journals (Sweden)

Ava Firth

2016-12-01

Full Text Available Whilst there is a small body of research that investigates the development of EBVM skills in veterinary undergraduates there is a paucity of research that aims to understand the development of EBVM skills in practice-based post-graduate veterinary surgeons. This paper is a small step in remedying that shortfall. In particular, the paper provides a progress report on an RCVS Knowledge funded study that is evaluating a practice-based EBVM development program. The program is being conducted with a cohort of 20 veterinary surgeons and veterinary nurses employed in a private practice veterinary company across multiple sites. The facilitated instruction approach incorporates multiple supports including; group based and one-to-one, synchronous and asynchronous, and, face-to-face and online strategies. This paper will provide details of both the facilitation and evaluation approaches that have been adopted. The paper will also report on preliminary results of the evaluation which focuses on barriers and facilitators to EBVM development.This is a podcast of Ava and Ian's talk at the Veterinary Evidence Today conference, Edinburgh November 2, 2016.

Status of beta measurement evaluation and upgrade program

International Nuclear Information System (INIS)

Swinth, K.L.

1986-01-01

In 1983, the US Department of Energy (DOE) initiated a program to evaluate and upgrade beta dosimetry capabilities at DOE and DOE-contractor facilities. The program has several elements which structure the development of improvements in beta measurement practices. In addition to Pacific Northwest Laboratory (PNL), universities, private corporations, and other DOE facilities are involved in the research efforts

Evaluation of a quality control program in radiodiagnosis

International Nuclear Information System (INIS)

Yacovenco, Alejandro; Infantosi, A.F.C.; Tauhata, L.

1996-01-01

A quality assurance program, implemented at the Radiologic Service of the Hospital of the Military Police in Rio de Janeiro, Brazil, is evaluated. The results show a reduction around of 70% in the number of rejected films and 75% in the costs. A return to the former conditions is reported as after the discontinuation of the program

Using program logic model analysis to evaluate and better deliver what works

International Nuclear Information System (INIS)

Megdal, Lori; Engle, Victoria; Pakenas, Larry; Albert, Scott; Peters, Jane; Jordan, Gretchen

2005-01-01

There is a rich history in using program theories and logic models (PT/LM) for evaluation, monitoring, and program refinement in a variety of fields, such as health care, social and education programs. The use of these tools to evaluate and improve energy efficiency programs has been growing over the last 5-7 years. This paper provides an overview of the state-of-the-art methods of logic model development, with analysis that significantly contributed to: Assessing the logic behind how the program expects to be able to meets its ultimate goals, including the 'who', the 'how', and through what mechanism. In doing so, gaps and questions that still need to be addressed can be identified. Identifying and prioritize the indicators that should be measured to evaluate the program and program theory. Determining key researchable questions that need to be answered by evaluation/research, to assess whether the mechanism assumed to cause the changes in actions, attitudes, behaviours, and business practices is workable and efficient. Also will assess the validity in the program logic and the likelihood that the program can accomplish its ultimate goals. Incorporating analysis of prior like programs and social science theories in a framework to identify opportunities for potential program refinements. The paper provides an overview of the tools, techniques and references, and uses as example the energy efficiency program analysis conducted for the New York State Energy Research and Development Authority's (NYSERDA) New York ENERGY $MART SM programs

Evaluating public involvement in the National Low-Level Radioactive Waste Management Program

International Nuclear Information System (INIS)

1982-09-01

The Department of Energy contracted with the Keystone Center to evaluate the effectiveness of the National Low-Level Radioactive Waste Management Program's public-involvement efforts. The Center chose six evaluators with diverse training and experience related to low-level waste management and public-participation programs. Keystone's evaluation was based on (a) observations by the evaluators who attended the National Program-sponsored strategy review meetings and fairs; (b) interviews with low-level waste generators, local government officials, state legislators, public-interest groups, and members of the general public; and (c) observations of the final National Program strategy task force meeting. The evaluators concluded that, overall, the public-participation processes yielded some very positive results - for policy development and for DOE and the EG and G staff. They judged the strategy document to be complete, concise, and helpful to public dialogue on low-level waste issues. They also made specific recommendations for improvements to the public-participation program

29 CFR 1960.79 - Self-evaluations of occupational safety and health programs.

Science.gov (United States)

2010-07-01

... 29 Labor 9 2010-07-01 2010-07-01 false Self-evaluations of occupational safety and health programs. 1960.79 Section 1960.79 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs...

Effective Ways to Realize the Character Education Value of Work-study Program

Directory of Open Access Journals (Sweden)

Lv Xuemei PhD Student

2013-07-01

Full Text Available This paper indicates work-study program can foster the character development of college students as an important content of social practice activities in university. It suggests strategies for realizing the character education value of work-study program. First, establish a specific character education object for every work-study program. Second, use the controllability of the classroom to make up the uncontrollability of work-study program. Third, set up an effective supervision and evaluation mechanism.

The Danish national return-to-work program - aims, content, and design of the process and effect evaluation

NARCIS (Netherlands)

Aust, Birgit; Helverskov, Trine; Nielsen, Maj Britt D.; Bjorner, Jakob Bue; Rugulies, Reiner; Nielsen, Karina; Sorensen, Ole H.; Grundtvig, Gry; Andersen, Malene F.; Hansen, Jorgen V.; Buchardt, Helle L.; Nielsen, Lisbeth; Lund, Trine L.; Andersen, Irene; Andersen, Mogens H.; Clausen, Aksel S.; Heinesen, Eskil; Mortensen, Ole S.; Ektor-Andersen, John; Orbaek, Palle; Winzor, Glen; Bultmann, Ute; Poulsen, Otto M.

The Danish national return-to-work (RTW) program aims to improve the management of municipal sickness benefit in Denmark. A study is currently ongoing to evaluate the RTW program. The purpose of this article is to describe the study protocol. The program includes 21 municipalities encompassing

Efficacy evaluation of the school program Unplugged for drug use prevention among Brazilian adolescents

Directory of Open Access Journals (Sweden)

Zila M. Sanchez

2016-11-01

Full Text Available Abstract Background Most Brazilian schools do not have a continuous program for drug use prevention and do not conduct culturally adapted activities for that purpose. This study evaluated the impact of the Unplugged program on drug use prevention among children and adolescents in public middle schools of Brazil. Methods A non-randomized controlled trial was conducted in 2013 with 2185 students in 16 public schools from 3 Brazilian cities. The intervention group attended 12 weekly classes of the Unplugged program for drug use prevention, and the control group did not attend to any school prevention programs in the same year. Multilevel analyses were used to evaluate temporal and between group changes in the consumption of each drug. Results The study suggested that there was no evidence that Unplugged effected 11- to 12-year-old students. However, the program seemed to stimulate a decrease in recent marijuana use (transition from use to non-use in 85.7% of intervention cases and 28.6% of control cases, OR = 17.5, p = 0.039 among 13- to 15-year-old students. In addition, students in this age range who received the Unplugged program had similar drug consumption levels to those observed before the program began. However, students in the control group presented a significant tendency to increase marijuana use and binge drinking. Conclusions This study adds to the evidence of program efficacy among Brazilian middle school students by presenting marginal effects on binge drinking and marijuana use. An 18-month randomized controlled trial is recommended for a future study.

The Evaluation Market in Germany: Estimating Market Size for Evaluation of Political Programs

Science.gov (United States)

Lowenbein, Oded

2008-01-01

The United States has a long tradition in evaluation of political programs. In the 1930s and 1940s, programs were initiated to reduce unemployment and improve social security as part of the "New Deal." In the late 1960s, somewhat comparable to the U. S. at that time, Germany's new government started its own "New Deal."…

AAAS Communicating Science Program: Reflections on Evaluation

Science.gov (United States)

Braha, J.

2015-12-01

The AAAS Center for Public Engagement (Center) with science builds capacity for scientists to engage public audiences by fostering collaboration among natural or physical scientists, communication researchers, and public engagement practitioners. The recently launched Leshner Leadership Institute empowers cohorts of mid-career scientists to lead public engagement by supporting their networks of scientists, researchers, and practitioners. The Center works closely with social scientists whose research addresses science communication and public engagement with science to ensure that the Communicating Science training program builds on empirical evidence to inform best practices. Researchers ( Besley, Dudo, & Storkdieck 2015) have helped Center staff and an external evaluator develop pan instrument that measures progress towards goals that are suggested by the researcher, including internal efficacy (increasing scientists' communication skills and confidence in their ability to engage with the public) and external efficacy (scientists' confidence in engagement methods). Evaluation results from one year of the Communicating Science program suggest that the model of training yields positive results that support scientists in the area that should lead to greater engagement. This talk will explore the model for training, which provides a context for strategic communication, as well as the practical factors, such as time, access to public engagement practitioners, and technical skill, that seems to contribute to increased willingness to engage with public audiences. The evaluation program results suggest willingness by training participants to engage directly or to take preliminary steps towards engagement. In the evaluation results, 38% of trained scientists reported time as a barrier to engagement; 35% reported concern that engagement would distract from their work as a barrier. AAAS works to improve practitioner-researcher-scientist networks to overcome such barriers.

Implementing and evaluating a program to facilitate chronic disease prevention and screening in primary care: a mixed methods program evaluation.

Science.gov (United States)

Manca, Donna Patricia; Aubrey-Bassler, Kris; Kandola, Kami; Aguilar, Carolina; Campbell-Scherer, Denise; Sopcak, Nicolette; O'Brien, Mary Ann; Meaney, Christopher; Faria, Vee; Baxter, Julia; Moineddin, Rahim; Salvalaggio, Ginetta; Green, Lee; Cave, Andrew; Grunfeld, Eva

2014-10-08

The objectives of this paper are to describe the planned implementation and evaluation of the Building on Existing Tools to Improve Chronic Disease Prevention and Screening in Primary Care (BETTER 2) program which originated from the BETTER trial. The pragmatic trial, informed by the Chronic Care Model, demonstrated the effectiveness of an approach to Chronic Disease Prevention and Screening (CDPS) involving the use of a new role, the prevention practitioner. The desired goals of the program are improved clinical outcomes, reduction in the burden of chronic disease, and improved sustainability of the health-care system through improved CDPS in primary care. The BETTER 2 program aims to expand the implementation of the intervention used in the original BETTER trial into communities across Canada (Alberta, Ontario, Newfoundland and Labrador, the Northwest Territories and Nova Scotia). This proactive approach provides at-risk patients with an intervention from the prevention practitioner, a health-care professional. Using the BETTER toolkit, the prevention practitioner determines which CDPS actions the patient is eligible to receive, and through shared decision-making and motivational interviewing, develops a unique and individualized 'prevention prescription' with the patient. This intervention is 1) personalized; 2) addressing multiple conditions; 3) integrated through linkages to local, regional, or national resources; and 4) longitudinal by assessing patients over time. The BETTER 2 program brings together primary care providers, policy/decision makers and researchers to work towards improving CDPS in primary care. The target patient population is adults aged 40-65. The reach, effectiveness, adoption, implementation, maintain (RE-AIM) framework will inform the evaluation of the program through qualitative and quantitative methods. A composite index will be used to quantitatively assess the effectiveness of the prevention practitioner intervention. The CDPS actions

Alternative Aviation Jet Fuel Sustainability Evaluation Report Task 1 : Report Evaluating Existing Sustainability Evaluation Programs

Science.gov (United States)

2011-10-25

This report describes how existing biofuel sustainability evaluation programs meet requirements that are under consideration or are in early phases of adoption and implementation in various US and international contexts. Biofuel sustainability evalua...

Hanford performance evaluation program for Hanford site analytical services

International Nuclear Information System (INIS)

Markel, L.P.

1995-09-01

The U.S. Department of Energy (DOE) Order 5700.6C, Quality Assurance, and Title 10 of the Code of Federal Regulations, Part 830.120, Quality Assurance Requirements, states that it is the responsibility of DOE contractors to ensure that ''quality is achieved and maintained by those who have been assigned the responsibility for performing the work.'' Hanford Analytical Services Quality Assurance Plan (HASQAP) is designed to meet the needs of the Richland Operations Office (RL) for maintaining a consistent level of quality for the analytical chemistry services provided by contractor and commmercial analytical laboratory operations. Therefore, services supporting Hanford environmental monitoring, environmental restoration, and waste management analytical services shall meet appropriate quality standards. This performance evaluation program will monitor the quality standards of all analytical laboratories supporting the Hanforad Site including on-site and off-site laboratories. The monitoring and evaluation of laboratory performance can be completed by the use of several tools. This program will discuss the tools that will be utilized for laboratory performance evaluations. Revision 0 will primarily focus on presently available programs using readily available performance evaluation materials provided by DOE, EPA or commercial sources. Discussion of project specific PE materials and evaluations will be described in section 9.0 and Appendix A

Traffic Control Device Evaluation Program : FY 2017

Science.gov (United States)

2018-03-01

This report presents findings on the activities conducted in the Traffic Control Device Evaluation Program during the 2017 fiscal year. The research on sponsored changeable message signs (continued from the previous year) was terminated by the Federa...

Evaluating Extension Based Leadership Development Programs in the Southern United States

Science.gov (United States)

Lamm, Kevan W.; Carter, Hannah S.; Lamm, Alexa J.

2016-01-01

The ability to evaluate and accurately articulate the outcomes associated with leadership development programs is critical to their continued financial and administrative support. With calls for outcome-based accountability, the need for rigorous evaluation is particularly relevant for those programs administered through the Cooperative Extension…

Integrating design science theory and methods to improve the development and evaluation of health communication programs.

Science.gov (United States)

Neuhauser, Linda; Kreps, Gary L

2014-12-01

Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.