Integrated Plant Safety Assessment, Systematic Evaluation Program: Yankee Nuclear Power Station (Docket No. 50-29)

International Nuclear Information System (INIS)

1987-10-01

The US Nuclear Regulatory Commission (NRC) has prepared Supplement 1 to the final Integrated Plant Safety Assessment Report (IPSAR) (NUREG-0825), under the scope of the Systematic Evaluation Program (SEP), for Yankee Atomic Electric Company's Yankee Nuclear Power Station located in Rowe, Massachusetts. The SEP was initiated by the NRC to review the design of older operating nuclear power plants to reconfirm and document their safety. This report documents the review completed under the SEP for those issues that required refined engineering evaluations or the continuation of ongoing evaluations after the Final IPSAR for the Yankee plant was issued. The review has provided for (1) an assessment of the significance of differences between current technical positions on selected safety issues and those that existed when Yankee was licensed, (2) a basis for deciding how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. 2 tabs

Integrated plant safety assessment: systematic evaluation program. Haddam Neck Plant, Connecticut Yankee Atomic Power Company. Docket No. 50-213

International Nuclear Information System (INIS)

1983-03-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of Haddam Neck Plant, operated by Connecticut Yankee Atomic Power Company. The Haddam Neck Plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Integrated plant safety assessment: Systematic Evaluation Program. LaCrosse Boiling Water Reactor, Dairyland Power Cooperative, Docket No. 50-409

International Nuclear Information System (INIS)

1983-04-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the La Crosse Boiling Water Reactor, operated by Dairyland Power Cooperative. The La Crosse plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addresed. Equipment and procedural changes have been identified as a result of the review

Integrated plant safety assessment. Systematic evaluation program, Big Rock Point Plant (Docket No. 50-155). Final report

International Nuclear Information System (INIS)

1984-05-01

The Systematic Evaluation Program was initiated in February 1977 by the U.S. Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety when the supplement to the Final Integrated Plant Safety Assessment Report has been issued. This report documents the review of the Big Rock Point Plant, which is one of ten plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. It also addresses a majority of the pending licensing actions for Big Rock Point, which include TMI Action Plan requirements and implementation criteria for resolved generic issues. Equipment and procedural changes have been identified as a result of the review

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

A systematic review of school-based suicide prevention programs.

Science.gov (United States)

Katz, Cara; Bolton, Shay-Lee; Katz, Laurence Y; Isaak, Corinne; Tilston-Jones, Toni; Sareen, Jitender

2013-10-01

Suicide is one of the leading causes of death among youth today. Schools are a cost-effective way to reach youth, yet there is no conclusive evidence regarding the most effective prevention strategy. We conducted a systematic review of the empirical literature on school-based suicide prevention programs. Studies were identified through MEDLINE and Scopus searches, using keywords such as "suicide, education, prevention and program evaluation." Additional studies were identified with a manual search of relevant reference lists. Individual studies were rated for level of evidence, and the programs were given a grade of recommendation. Five reviewers rated all studies independently and disagreements were resolved through discussion. Sixteen programs were identified. Few programs have been evaluated for their effectiveness in reducing suicide attempts. Most studies evaluated the programs' abilities to improve students' and school staffs' knowledge and attitudes toward suicide. Signs of Suicide and the Good Behavior Game were the only programs found to reduce suicide attempts. Several other programs were found to reduce suicidal ideation, improve general life skills, and change gatekeeper behaviors. There are few evidence-based, school-based suicide prevention programs, a combination of which may be effective. It would be useful to evaluate the effectiveness of general mental health promotion programs on the outcome of suicide. The grades assigned in this review are reflective of the available literature, demonstrating a lack of randomized controlled trials. Further evaluation of programs examining suicidal behavior outcomes in randomized controlled trials is warranted. © 2013 Wiley Periodicals, Inc.

Culturally Sensitive Risk Behavior Prevention Programs for African American Adolescents: A Systematic Analysis

Science.gov (United States)

Metzger, Isha; Cooper, Shauna M.; Zarrett, Nicole; Flory, Kate

2013-01-01

The current review conducted a systematic assessment of culturally sensitive risk prevention programs for African American adolescents. Prevention programs meeting the inclusion and exclusion criteria were evaluated across several domains: (1) theoretical orientation and foundation; (2) methodological rigor; (3) level of cultural integration; (4)…

38 CFR 1.15 - Standards for program evaluation.

Science.gov (United States)

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... intent, contain a method to measure fulfillment of the objectives, ascertain the degree to which goals... the data. (f) Each program evaluation requires a systematic research design to collect the data...

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Systematic Assessment for University Sexuality Programming.

Science.gov (United States)

Westefeld, John S.; Winkelpleck, Judy M.

1982-01-01

Suggests systematic empirical assessment is needed to plan university sexuality programing. Proposes the traditional approach of asking about students' attitudes, knowledge, and behavior is useful for developing specific programing content. Presents an assessment model emphasizing assessment of students' desires for sexuality programing in terms…

Integrated plant safety assessment. Systematic Evaluation Program. La Crosse Boiling Water Reactor. Dairyland Power Cooperative, Docket No. 50-409. Final report

International Nuclear Information System (INIS)

1983-06-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the La Crosse Boiling Water Reactor, operated by Dairyland Power Cooperative. The La Crosse plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Integrated Plant Safety Assessment: Systematic Evaluation Program. Yankee Nuclear Power Station, Yankee Atomic Electric Company, Docket No. 50-29. Final report

International Nuclear Information System (INIS)

1983-06-01

The Systematic Evaluation program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of Yankee Nuclear Power Station, operated by Yankee Atomic Electric Company. The Yankee plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Integrated Plant Safety Assessment, Systematic Evaluation Program. Yankee Nuclear Power Station, Yankee Atomic Electric Company, Docket No. 50-29. Draft report

International Nuclear Information System (INIS)

1983-02-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of Yankee Nuclear Power Station, operated by Yankee Atomic Electric Company. The Yankee plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

Parenting Programs to Prevent Corporal Punishment: A Systematic Review

Directory of Open Access Journals (Sweden)

Paolla Magioni Santini

2016-04-01

Full Text Available Abstract Studies have shown that corporal punishment against children is a common family practice, causing damage to child development. Considering that parents are the main perpetrators of this type of aggression, parenting programs are needed to raise children without violence. This study aimed at performing a systematic review of parenting programs evaluations to reduce corporal punishment. Intervention procedures, as well as design, results and limitations were identified for each study. The PRISMA protocol (Preferred Reporting Items for Systematic reviews and Meta-Analyses was used for reporting the results. A literature survey was conducted in Brazilian databases, as well as English ones from 1994-2014. One Brazilian study and eight international studies were selected as relevant, and only four used randomized controlled trials (RCT. All studies reported satisfactory results in decreasing aggression by parents against their children. Further research in the area with solid methodology is recommended.

A Systematic Review of Elderly Suicide Prevention Programs

Science.gov (United States)

Lapierre, Sylvie; Erlangsen, Annette; Waern, Margda; De Leo, Diego; Oyama, Hirofumi; Scocco, Paolo; Gallo, Joseph; Szanto, Katalin; Conwell, Yeates; Draper, Brian; Quinnett, Paul

2013-01-01

Background Suicide rates are highest among the elderly, yet research on suicide prevention in old age remains a much-neglected area. Aims We carried out a systematic review to examine the results of interventions aimed at suicidal elderly persons and to identify successful strategies and areas needing further exploration. Methods Searches through various electronic databases yielded 19 studies with an empirical evaluation of a suicide prevention or intervention program designed especially for adults aged 60 years and older. Results Most studies were centered on the reduction of risk factors (depression screening and treatment, and decreasing isolation), but when gender was considered, programs were mostly efficient for women. The empirical evaluations of programs attending to the needs of high-risk older adults seemed positive; most studies showed a reduction in the level of suicidal ideation of patients or in the suicide rate of the participating communities. However, not all studies used measures of suicidality to evaluate the outcome of the intervention, and rarely did they aim at improving protective factors. Conclusions Innovative strategies should improve resilience and positive aging, engage family and community gatekeepers, use telecommunications to reach vulnerable older adult, and evaluate the effects of means restriction and physicians education on elderly suicide. PMID:21602163

Systematic control of large computer programs

International Nuclear Information System (INIS)

Goedbloed, J.P.; Klieb, L.

1986-07-01

A package of CCL, UPDATE, and FORTRAN procedures is described which facilitates the systematic control and development of large scientific computer programs. The package provides a general tool box for this purpose which contains many conveniences for the systematic administration of files, editing, reformating of line printer output files, etc. In addition, a small number of procedures is devoted to the problem of structured development of a large computer program which is used by a group of scientists. The essence of the method is contained in three procedures N, R, and X for the creation of a new UPDATE program library, its revision, and execution, resp., and a procedure REVISE which provides a joint editor - UPDATE session which combines the advantages of the two systems, viz. speed and rigor. (Auth.)

Integrated-plant-safety assessment Systematic Evaluation Program. Dresden Nuclear Power Station, Unit 2, Commonwealth Edison Company, Docket No. 50-237

International Nuclear Information System (INIS)

1982-10-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues; (2) a basis for deciding on how these differences should be resolved in an integrated plant review; and (3) a documented evaluation of plant safety. This report documents the review of Dresden Nuclear Generating Station, Unit 2 owned and operated by the Commonwealth Edison Company and located in Grundy County, Illinois. Dresden Unit 2 is one of ten plants reviewed under Phase II of this program, which indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. It is expected that this report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license

Systematic review of economic evaluations of vaccination programs in mainland China: Are they sufficient to inform decision making?

Science.gov (United States)

Pan, Xiong-Fei; Griffiths, Ulla K; Pennington, Mark; Yu, Hongjie; Jit, Mark

2015-11-17

The purpose of the study was to systematically review economic evaluations of vaccine programs conducted in mainland China. We searched for economic evaluations of vaccination in China published prior to August 3, 2015 in eight English-language and three Chinese-language databases. Each article was appraised against the 19-item Consensus on Health Economic Criteria list (CHEC-list). We found 23 papers evaluating vaccines against hepatitis B (8 articles), Streptococcus pneumoniae (5 articles), human papillomavirus (3 articles), Japanese encephalitis (2 articles), rotavirus (2 articles), hepatitis A (1 article), Enterovirus 71 (1 article) and influenza (1 article). Studies conformed to a mean of 12 (range: 6-18) items in the CHEC-list criteria. Five of six Chinese-language articles conformed to fewer than half of the 19 criteria items. The main criteria that studies failed to conform to included: inappropriate measurement (20 articles) and valuation (18 articles) of treatment and/or vaccination costs, no discussion about distributional implications (18 articles), missing major health outcomes (14 articles), no discussion about generalizability to other contexts (14 articles), and inadequate sensitivity analysis (13 articles). In addition, ten studies did not include major cost components of vaccination programs, and nine did not report outcomes in terms of life years even in cases where QALYs or DALYs were calculated. Only 13 studies adopted a societal perspective for analysis. All studies concluded that the appraised vaccination programs were cost-effective except for one evaluation of universal 7-valent pneumococcal conjugate vaccine (PCV-7) in children. However, three of the five studies on PCV-7 showed poor overall quality, and the number of studies on vaccines other than hepatitis B vaccine and PCV-7 was limited. In conclusion, major methodological flaws and reporting problems exist in current economic evaluations of vaccination programs in China. Local

Integrated Plant Safety Assessment: Systematic Evaluation Program. Haddam Neck Plant, Connecticut Yankee Atomic Power Company, Docket No. 50-213. Final report

International Nuclear Information System (INIS)

1983-01-01

The Systematic Evaluation Progam was initiated in February 1977 by the US Nuclear Regulatory Commission review the designs of older operating nuclear reactor plants to confirm and document their safety. The review provides: (1) an assessment of how these plants compare with curent licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of Haddam Neck Plant, operated by Connecticut Yankee Atomic Power Company. The Haddam Neck Plant is one of 10 plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

Healthcare team training programs aimed at improving depression management in primary care: A systematic review.

Science.gov (United States)

Vöhringer, Paul A; Castro, Ariel; Martínez, Pablo; Tala, Álvaro; Medina, Simón; Rojas, Graciela

2016-08-01

Although evidence from Latin America and the Caribbean suggests that depression can be effectively treated in primary care settings, depression management remains unevenly performed. This systematic review evaluates all the international evidence on healthcare team training programs aimed at improving the outcomes of patients with depression. Three databases were searched for articles in English or Spanish indexed up to November 20, 2014. Studies were included if they fulfilled the following conditions: clinical trials, meta-analyses, or systematic reviews; and if they evaluated a training or educational program intended to improve the management of depression by primary healthcare teams, and assessed change in depressive symptoms, diagnosis or response rates, referral rates, patients' satisfaction and/or quality of life, and the effectiveness of treatments. Nine studies were included in this systematic review. Five trials tested the effectiveness of multi-component interventions (training included), and the remaining studies evaluated the effectiveness of specific training programs for depression management. All the studies that implemented multi-component interventions were efficacious, and half of the training trials were shown to be effective. Contribution of training programs alone to the effectiveness of multi-component interventions is yet to be established. The lack of specificity regarding health providers' characteristics might be a confounding factor. The review conducted suggests that stand-alone training programs are less effective than multi-component interventions. In applying the evidence gathered from developed countries to Latin America and the Caribbean, these training programs must consider and address local conditions of mental health systems, and therefore multi-component interventions may be warranted. Copyright © 2016 Elsevier B.V. All rights reserved.

Integrated plant safety assessment systematic evaluation program. R.E. Ginna Nuclear Power Plant, Rochester Gas and Electric Corporation, Docket No. 50-244

International Nuclear Information System (INIS)

1982-05-01

The Systematic Evaluation Program was initiated in February 1978 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the R.E. Ginna Nuclear Power Plant (located in Wayne County near Rochester, NY), one of ten plants reviewed under Phase II of this program, and indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. It is expected that this report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license

Stepping Stones to Evaluating Your Own School Literacy Program

Science.gov (United States)

Levesque, Jeri; Carnahan, Danielle

2005-01-01

Stepping Stones to Literacy is a tool for elementary school improvement teams to evaluate and strengthen their reading programs. Each Stepping Stone is a guided activity to stimulate reflection and guide systematic inquiry. It is a collaborative, active research approach to evaluation (Levesque & Hinton 2001). The goal is to eliminate the gap…

Bystander programs addressing sexual violence on college campuses: A systematic review and meta-analysis of program outcomes and delivery methods.

Science.gov (United States)

Jouriles, Ernest N; Krauss, Alison; Vu, Nicole L; Banyard, Victoria L; McDonald, Renee

2018-02-06

This systematic review and meta-analysis evaluates the effectiveness of bystander programs that address sexual violence on college campuses. Program effects on student attitudes/beliefs and bystander behavior were examined. Durability of program outcomes and the influence of program-delivery methods (e.g., facilitator-led programs vs. video, online or poster campaign programs) and program-parameters (e.g., program length) were also evaluated. Twenty-four studies met criteria for inclusion in the meta-analysis, and 207 separate results from these studies were coded. Students who participated in a bystander program, compared to those who had not, had more pro-social attitudes/beliefs about sexual violence and intervening to prevent it, and engaged in more bystander behavior. Program effects diminished over time, but meaningful changes persisted for at least three months following program delivery. Longer programs had greater effects than shorter programs on attitudes/beliefs. Bystander programs can be a valuable addition to colleges' violence prevention efforts.

Integrated plant safety assessment, Systematic Evaluation Program: Dresden Nuclear Power Station, Unit 2 (Docket No. 50-237)

International Nuclear Information System (INIS)

1989-10-01

The US Nuclear Regulatory Commission (NRC) has prepared Supplement 1 to the final Integrated Plant Safety Assessment Report (IPSAR) (NUREG-0823), under the scope of the Systematic Evaluation Program (SEP), for the Commonwealth Edison Company (CECo) Dresden Nuclear Power Station, Unit 2 located in Grundy County, Illinois. The NRC initiated the SEP to provide the framework for reviewing the design of older operating nuclear reactor plants to reconfirm and document their safety. This report documents the review completed by means of the SEP for those issues that required refined engineering evaluations or the continuation of ongoing evaluations subsequent to issuing the final IPSAR for Dresden Unit 2. The review was provided for (1) an assessment of the significance of differences between current technical positions on selected issues and those that existed when Dresden Unit 2 was licensed, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. The final IPSAR and this supplement forms part of the bases for considering the conversion of the existing provisional operating license to a full-term operating license. 83 refs., 9 tabs

Integrated-plant-safety assessment Systematic Evaluation program. Millstone Nuclear Power Station, Unit 1, Northeast Nuclear Energy Company, Docket No. 50-245

International Nuclear Information System (INIS)

1982-11-01

The Systematic Evaluation Program was initiated in February 1977 to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the Millstone Nuclear Power Station, Unit 1, operated by Northeast Nuclear Energy Company (located in Waterford, Connecticut). Millstone Nuclear Power Station, Unit 1, is one of ten plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. It is expected that this report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license

Integrated plant safety assessment: Systematic Evaluation Program, San Onofre Nuclear Generating Station, Unit 1 (Docket No. 50-206): Final report

International Nuclear Information System (INIS)

1986-12-01

The Systematic Evaluation Program was initiated in February 1977 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides: (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues; (2) a basis for deciding on how these differences should be resolved in an integrated plant review; and (3) a documented evaluation of plant safety. This report documents the review of San Onofre Nuclear Generating Station, Unit 1, operated by Southern California Edison Company. The San Onofre plant is one of ten plants reviewed under Phase II of this program. This report indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. This report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license. This report also addresses the comments and recommendations made by the Advisory Committee on Reactor Safeguards in connection with its review of the draft report issued in April 1985

Economic evaluation of vaccines in Canada: A systematic review.

Science.gov (United States)

Chit, Ayman; Lee, Jason K H; Shim, Minsup; Nguyen, Van Hai; Grootendorst, Paul; Wu, Jianhong; Van Exan, Robert; Langley, Joanne M

2016-05-03

Economic evaluations should form part of the basis for public health decision making on new vaccine programs. While Canada's national immunization advisory committee does not systematically include economic evaluations in immunization decision making, there is increasing interest in adopting them. We therefore sought to examine the extent and quality of economic evaluations of vaccines in Canada. We conducted a systematic review of economic evaluations of vaccines in Canada to determine and summarize: comprehensiveness across jurisdictions, studied vaccines, funding sources, study designs, research quality, and changes over time. Searches in multiple databases were conducted using the terms "vaccine," "economics" and "Canada." Descriptive data from eligible manuscripts was abstracted and three authors independently evaluated manuscript quality using a 7-point Likert-type scale scoring tool based on criteria from the International Society for Pharmacoeconomics and Outcomes Research (ISPOR). 42/175 articles met the search criteria. Of these, Canada-wide studies were most common (25/42), while provincial studies largely focused on the three populous provinces of Ontario, Quebec and British Columbia. The most common funding source was industry (17/42), followed by government (7/42). 38 studies used mathematical models estimating expected economic benefit while 4 studies examined post-hoc data on established programs. Studies covered 10 diseases, with 28/42 addressing pediatric vaccines. Many studies considered cost-utility (22/42) and the majority of these studies reported favorable economic results (16/22). The mean quality score was 5.9/7 and was consistent over publication date, funding sources, and disease areas. We observed diverse approaches to evaluate vaccine economics in Canada. Given the increased complexity of economic studies evaluating vaccines and the impact of results on public health practice, Canada needs improved, transparent and consistent processes

Supporting adherence and healthy lifestyles in leg ulcer patients: systematic development of the Lively Legs program for dermatology outpatient clinics.

Science.gov (United States)

Heinen, Maud M; Bartholomew, L Kay; Wensing, Michel; van de Kerkhof, Peter; van Achterberg, Theo

2006-05-01

The objective of our project was to develop a lifestyle program for leg ulcer patients at outpatient clinics for dermatology. We used the intervention-mapping (IM) framework for systematically developing theory and evidence based health promotion programs. We started with a needs-assessment. A multidisciplinary project group of health care workers and patients was involved in all five IM steps; formulating proximal program objectives, selecting methods and strategies, producing program components, planning for adoption and implementation and planning for evaluation. Several systematic literature reviews and original studies were performed to support this process. Social Cognitive Theory was selected as the main theory behind the program 'Lively Legs' and was combined with elements of Goal-Setting Theory, the precaution adoption model and motivational interviewing. The program is conducted through health counseling by dermatology nurses and was successfully pre-tested. Also, an implementation and evaluation plan were made. Intervention mapping helped us to succeed in developing a lifestyle program with clear goals and methods, operational strategies and materials and clear procedures. Coaching leg ulcer patients towards adherence with compression therapy and healthy lifestyles should be taken on without delay. Systematic development of lifestyle programs for other patient groups should be encouraged.

A Census of Prison-Based Drug Treatment Programs: Implications for Programming, Policy, and Evaluation

Science.gov (United States)

Welsh, Wayne N.; Zajac, Gary

2004-01-01

Despite a growing realization that unmeasured programmatic differences influence prison-based drug treatment effectiveness, few attempts to systematically measure such differences have been made. To improve program planning and evaluation in this area, we developed a census instrument to collect descriptive information about 118 prison-based drug…

Leadership development programs for physicians: a systematic review.

Science.gov (United States)

Frich, Jan C; Brewster, Amanda L; Cherlin, Emily J; Bradley, Elizabeth H

2015-05-01

Physician leadership development programs typically aim to strengthen physicians' leadership competencies and improve organizational performance. We conducted a systematic review of medical literature on physician leadership development programs in order to characterize the setting, educational content, teaching methods, and learning outcomes achieved. Articles were identified through a search in Ovid MEDLINE from 1950 through November 2013. We included articles that described programs designed to expose physicians to leadership concepts, outlined teaching methods, and reported evaluation outcomes. A thematic analysis was conducted using a structured data entry form with categories for setting/target group, educational content, format, type of evaluation and outcomes. We identified 45 studies that met eligibility criteria, of which 35 reported on programs exclusively targeting physicians. The majority of programs focused on skills training and technical and conceptual knowledge, while fewer programs focused on personal growth and awareness. Half of the studies used pre/post intervention designs, and four studies used a comparison group. Positive outcomes were reported in all studies, although the majority of studies relied on learner satisfaction scores and self-assessed knowledge or behavioral change. Only six studies documented favorable organizational outcomes, such as improvement in quality indicators for disease management. The leadership programs examined in these studies were characterized by the use of multiple learning methods, including lectures, seminars, group work, and action learning projects in multidisciplinary teams. Physician leadership development programs are associated with increased self-assessed knowledge and expertise; however, few studies have examined outcomes at a system level. Our synthesis of the literature suggests important gaps, including a lack of programs that integrate non-physician and physician professionals, limited use of more

AHRQ series paper 3: identifying, selecting, and refining topics for comparative effectiveness systematic reviews: AHRQ and the effective health-care program.

Science.gov (United States)

Whitlock, Evelyn P; Lopez, Sarah A; Chang, Stephanie; Helfand, Mark; Eder, Michelle; Floyd, Nicole

2010-05-01

This article discusses the identification, selection, and refinement of topics for comparative effectiveness systematic reviews within the Agency for Healthcare Research and Quality's Effective Health Care (EHC) program. The EHC program seeks to align its research topic selection with the overall goals of the program, impartially and consistently apply predefined criteria to potential topics, involve stakeholders to identify high-priority topics, be transparent and accountable, and continually evaluate and improve processes. A topic prioritization group representing stakeholder and scientific perspectives evaluates topic nominations that fit within the EHC program (are "appropriate") to determine how "important" topics are as considered against seven criteria. The group then judges whether a new comparative effectiveness systematic review would be a duplication of existing research syntheses, and if not duplicative, if there is adequate type and volume of research to conduct a new systematic review. Finally, the group considers the "potential value and impact" of a comparative effectiveness systematic review. As the EHC program develops, ongoing challenges include ensuring the program addresses truly unmet needs for synthesized research because national and international efforts in this arena are uncoordinated, as well as engaging a range of stakeholders in program decisions while also achieving efficiency and timeliness.

Structural review of the Palisades Nuclear Power Plant Unit 1 containment structure under combined loads for the Systematic Evaluation Program

International Nuclear Information System (INIS)

Liaw, C.Y.; Debeling, A.; Tsai, N.C.

1981-12-01

A structural reassessment of the containment structure of the Palisades Nuclear Power Plant Unit 1 was performed for the Nuclear Regulatory Commission as part of the Systematic Evaluation Program. Conclusions about the ability of the containment structure to withstand the Abnormal/Extreme Environment are presented. The reassessment focused mainly on the overall structural integrity of the containment building for the Abnormal/Extreme Environment. In this case, the Abnormal Environmental condition is caused by the worst case of either a Loss-of-Coolant Accident or a main steam line break. The Extreme Environmental condition is the Safe Shutdown Earthquake

Comprehensive adolescent health programs that include sexual and reproductive health services: a systematic review.

Science.gov (United States)

Kågesten, Anna; Parekh, Jenita; Tunçalp, Ozge; Turke, Shani; Blum, Robert William

2014-12-01

We systematically reviewed peer-reviewed and gray literature on comprehensive adolescent health (CAH) programs (1998-2013), including sexual and reproductive health services. We screened 36 119 records and extracted articles using predefined criteria. We synthesized data into descriptive characteristics and assessed quality by evidence level. We extracted data on 46 programs, of which 19 were defined as comprehensive. Ten met all inclusion criteria. Most were US based; others were implemented in Egypt, Ethiopia, and Mexico. Three programs displayed rigorous evidence; 5 had strong and 2 had modest evidence. Those with rigorous or strong evidence directly or indirectly influenced adolescent sexual and reproductive health. The long-term impact of many CAH programs cannot be proven because of insufficient evaluations. Evaluation approaches that take into account the complex operating conditions of many programs are needed to better understand mechanisms behind program effects.

Obesity Intervention Programs among Adolescents Using Social Cognitive Theory: A Systematic Literature Review

Science.gov (United States)

Bagherniya, Mohammad; Taghipour, Ali; Sharma, Manoj; Sahebkar, Amirhossein; Contento, Isobel R.; Keshavarz, Seyed Ali; Mostafavi Darani, Firoozeh; Safarian, Mohammad

2018-01-01

Social cognitive theory (SCT) is a well-known theory for designing nutrition education and physical activity programs for adolescents. This systematic review aimed to evaluate the efficacy of intervention studies based on SCT in reducing or preventing overweight and obesity in adolescents. An electronic literature search in PubMed-Medline, Web of…

The program success story: a valuable tool for program evaluation.

Science.gov (United States)

Lavinghouze, Rene; Price, Ann Webb; Smith, Kisha-Ann

2007-10-01

Success stories are evaluation tools that have been used by professionals across disciplines for quite some time. They are also proving to be useful in promoting health programs and their accomplishments. The increasing popularity of success stories is due to the innovative and effective way that they increase a program's visibility, while engaging potential participants, partners, and funders in public health efforts. From the community level to the federal level, program administrators are using success stories as vehicles for celebrating achievements, sharing challenges, and communicating lessons learned. Success stories are an effective means to move beyond the numbers and connect to readers-with a cause they can relate to and want to join. This article defines success stories and provides an overview of several types of story formats, how success stories can be systematically collected, and how they are used to communicate program success.

The International Endometriosis Evaluation Program (IEEP Study) - A Systematic Study for Physicians, Researchers and Patients.

Science.gov (United States)

Burghaus, S; Fehm, T; Fasching, P A; Blum, S; Renner, S K; Baier, F; Brodkorb, T; Fahlbusch, C; Findeklee, S; Häberle, L; Heusinger, K; Hildebrandt, T; Lermann, J; Strahl, O; Tchartchian, G; Bojahr, B; Porn, A; Fleisch, M; Reicke, S; Füger, T; Hartung, C-P; Hackl, J; Beckmann, M W; Renner, S P

2016-08-01

Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers.

I and C upgrades resulting from the systematic evaluation program carried out at the Central Nuclear Jose Cabrera

International Nuclear Information System (INIS)

Humphrey, J.C.

1985-01-01

Central Nuclear Jose Cabrera, also known as Zorita, is a 160 MWe nuclear power plant owned and operated by UNION ELECTRICA-FENOSA, S.A. The plant was supplied by Westinghouse Electric Corporation and commissioned in 1968. It features a unique one loop Pressurized Water Reactor design. The Spanish Licensing Authorities requested C.N. Jose Cabrera to carry out a review of their plant. The main objectives were to reassess the safety adequacy of the operating systems, provide a documented comparison of the plant design versus present day criteria and establish a rationale for departures. Another important objective was to provide prompt identification of any significant deficiency. The review known as phase 1 of the C.N. Jose Cabrera Systematic Evaluation Program, was completed and documented by April 1980

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Intergrated plant safety assessment. Systematic evaluation program. Palisades plant, Consumers Power Company, Docket No. 50-255. Final report

International Nuclear Information System (INIS)

1982-10-01

The Nuclear Regulatory Commission (NRC) has published its Final Integrated Plant Safety Assessment Report (IPSAR) (NUREG-0820), under the scope of the Systematic Evaluation Program (SEP), for Consumers Power Company's Palisades Plant located in Covert, Van Buren County, Michigan. The SEP was initiated by the NRC to review the design of older operating nuclear reactor plants to reconfirm and document their safety. This report documents the review completed under the SEP for the Palisades Plant. The review has provided for (1) as assessment of the significance of differences between current technical positions on selected safety issues and those that existed when the Palisades Plant was licensed, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety when all supplements to the Final IPSAR and the Safety Evaluation Report for converting the license from a provisional to a full-term license have been issued. The report also addresses the comments and recommendations made by the Advisory Committee on Reactor Safeguards in connection with its review of the Draft Report, issued in April 1982

A systematic review of online learning programs for nurse preceptors.

Science.gov (United States)

Wu, Xi Vivien; Chan, Yah Shih; Tan, Kimberlyn Hui Shing; Wang, Wenru

2018-01-01

Nurse preceptors guide students to integrate theory into practice, teach clinical skills, assess clinical competency, and enhance problem solving skills. Managing the dual roles of a registered nurse and preceptor poses tremendous challenges to many preceptors. Online learning is recognized as an effective learning approach for enhancing nursing knowledge and skills. The systematic review aims to review and synthesise the online learning programs for preceptors. A systematic review was designed based on the Cochrane Handbook for Systematic Reviews of Programs. Articles published between January 2000 and June 2016 were sought from six electronic databases: CINAHL, Medline OVID, PubMed, Science Direct, Scopus, and Web of Science. All papers were reviewed and quality assessment was performed. Nine studies were finally selected. Data were extracted, organized and analysed using a narrative synthesis. The review identified five overarching themes: development of the online learning programs for nurse preceptors, major contents of the programs, uniqueness of each program, modes of delivery, and outcomes of the programs. The systematic review provides insightful information on educational programs for preceptors. At this information age, online learning offers accessibility, convenience, flexibility, which could of great advantage for the working adults. In addition, the online platform provides an alternative for preceptors who face challenges of workload, time, and support system. Therefore, it is paramount that continuing education courses need to be integrated with technology, increase the flexibility and responsiveness of the nursing workforce, and offer alternative means to take up courses. Copyright © 2017 Elsevier Ltd. All rights reserved.

Conducting systematic reviews of economic evaluations.

Science.gov (United States)

Gomersall, Judith Streak; Jadotte, Yuri Tertilus; Xue, Yifan; Lockwood, Suzi; Riddle, Dru; Preda, Alin

2015-09-01

In 2012, a working group was established to review and enhance the Joanna Briggs Institute (JBI) guidance for conducting systematic review of evidence from economic evaluations addressing a question(s) about health intervention cost-effectiveness. The objective is to present the outcomes of the working group. The group conducted three activities to inform the new guidance: review of literature on the utility/futility of systematic reviews of economic evaluations and consideration of its implications for updating the existing methodology; assessment of the critical appraisal tool in the existing guidance against criteria that promotes validity in economic evaluation research and two other commonly used tools; and a workshop. The debate in the literature on the limitations/value of systematic review of economic evidence cautions that systematic reviews of economic evaluation evidence are unlikely to generate one size fits all answers to questions about the cost-effectiveness of interventions and their comparators. Informed by this finding, the working group adjusted the framing of the objectives definition in the existing JBI methodology. The shift is away from defining the objective as to determine one cost-effectiveness measure toward summarizing study estimates of cost-effectiveness and informed by consideration of the included study characteristics (patient, setting, intervention component, etc.), identifying conditions conducive to lowering costs and maximizing health benefits. The existing critical appraisal tool was included in the new guidance. The new guidance includes the recommendation that a tool designed specifically for the purpose of appraising model-based studies be used together with the generic appraisal tool for economic evaluations assessment to evaluate model-based evaluations. The guidance produced by the group offers reviewers guidance for each step of the systematic review process, which are the same steps followed in JBI reviews of other

Effectiveness and Evaluation of Crime Prevention Programs in Minas Gerais

Directory of Open Access Journals (Sweden)

Claudio Beato

2014-05-01

Full Text Available This essay analyzes previous studies evaluating the effectiveness of the crime prevention policies adopted by the Government of Minas Gerais (Brazil. In this work, greater emphasis is placed on studies evaluating outcomes than on studies dealing with the process of setting up and implementing programs and projects. In order to allow a more systematic discussion, the Maryland Scale, which categorizes research and evaluations according to the methodological strengths and weaknesses in five levels, is employed. Subsequently, the authors draw a parallel between Brazil and other settings. Finally, this essay lays out the implications of this discussion regarding the prevention programs. 

A methodology for evaluating social impact of Environmental Education Master Training Program

Directory of Open Access Journals (Sweden)

Loret de Mola, E.

2014-01-01

Full Text Available The paper is intended to describe a methodology for evaluating social impact of Environmental Education master training program by presenting its main stages. The framework serving as starting point and other empirical methods lead to systematized and define the terms of environmental professional training, professional performance of the environmental educator, evaluation, evaluation of professional performance of environmental educators and impact evaluation; as well as distinguishing the functions of impact evaluation in the postgraduate program favoring professor, tutors and trainees development. Previously appraised by consulting experts who gave it high ranks, this methodology is currently being used in evaluating second and third editions.

The International Endometriosis Evaluation Program (IEEP Study) – A Systematic Study for Physicians, Researchers and Patients

Science.gov (United States)

Burghaus, S.; Fehm, T.; Fasching, P. A.; Blum, S.; Renner, S. K.; Baier, F.; Brodkorb, T.; Fahlbusch, C.; Findeklee, S.; Häberle, L.; Heusinger, K.; Hildebrandt, T.; Lermann, J.; Strahl, O.; Tchartchian, G.; Bojahr, B.; Porn, A.; Fleisch, M.; Reicke, S.; Füger, T.; Hartung, C.-P.; Hackl, J.; Beckmann, M. W.; Renner, S. P.

2016-01-01

Introduction: Endometriosis is a heterogeneous disease characterized by a range of different presentations. It is usually diagnosed when patients present with pain and/or infertility, but it has also been diagnosed in asymptomatic patients. Because of the different diagnostic approaches and diverse therapies, time to diagnosis can vary considerably and the definitive diagnosis may be delayed, with some cases not being diagnosed for several years. Endometriosis patients have many unmet needs. A systematic registration and follow-up of endometriosis patients could be useful to obtain an insight into the course of the disease. The validation of biomarkers could contribute to the development of diagnostic and predictive tests which could help select patients for surgical assessment earlier and offer better predictions about patients who might benefit from medical, surgical or other interventions. The aim is also to obtain a better understanding of the etiology, pathogenesis and progression of the disease. Material and Methods: To do this, an online multicenter documentation system was introduced to facilitate the establishment of a prospective multicenter case-control study, the IEEP (International Endometriosis Evaluation Program) study. We report here on the first 696 patients with endometriosis included in the program between June 2013 and June 2015. Results: A documentation system was created, and the structure and course of the study were mapped out with regard to data collection and the collection of biomaterials. Conclusion: The documentation system permits the history and clinical data of patients with endometriosis to be recorded. The IEEP combines this information with biomaterials and uses it for scientific studies. The recorded data can also be used to evaluate clinical quality control measures such as the certification parameters used by the EEL (European Endometriosis League) to assess certified endometriosis centers. PMID:27582581

Integrated plant safety assessment: systematic evaluation program. Oyster Creek nuclear generating station. GPU Nuclear Corporation and Jersey Central Power and Light Company. Docket No. 50-219

International Nuclear Information System (INIS)

1982-09-01

The Systematic Evaluation Program was initiated in February 1978 by the US Nuclear Regulatory Commission to review the designs of older operating nuclear reactor plants to reconfirm and document their safety. The review provides (1) an assessment of how these plants compare with current licensing safety requirements relating to selected issues, (2) a basis for deciding on how these differences should be resolved in an integrated plant review, and (3) a documented evaluation of plant safety. This report documents the review of the Oyster Creek Nuclear Generating Station (located in Ocean County, New Jersey), one of ten plants reviewed under Phase II of this program, and indicates how 137 topics selected for review under Phase I of the program were addressed. Equipment and procedural changes have been identified as a result of the review. It is expected that this report will be one of the bases in considering the issuance of a full-term operating license in place of the existing provisional operating license

Development of a systematic career coaching program for medical students

Science.gov (United States)

2018-01-01

Purpose This study aimed to develop a systematic career-coaching program (SCCP) that can be used by medical teaching schools to address a growing need for career-coaching. The program objectives were to help students (1) develop a comprehensive self-understanding of their aptitudes, interests, and personality traits; (2) explore possible career choices and decide on a career path; and (3) develop the competencies needed to prepare for their future careers. Methods The SCCP was based on the ADDIE (analysis, design, development, implementation, and evaluation) model and decision-making questioning model. Medical professionals, medical education and career counseling experts, and students participated in designing the program. Results The SCCP describes coaching content, tools, operational methods, and appropriate timing, and identifies the professionals and specialists who can offer their expertise in the different coaching phases. It is designed to allow medical schools to offer the program in segments or in its entirety, depending on the curriculum and environment. Conclusion The SCCP represents a viable career-coaching program for medical students that can be applied in part or in its entirety, depending on a medical school’s curriculum and educational environment. PMID:29510607

Development of a systematic career coaching program for medical students

Directory of Open Access Journals (Sweden)

Yera Hur

2018-03-01

Full Text Available Purpose This study aimed to develop a systematic career-coaching program (SCCP that can be used by medical teaching schools to address a growing need for career-coaching. The program objectives were to help students (1 develop a comprehensive self-understanding of their aptitudes, interests, and personality traits; (2 explore possible career choices and decide on a career path; and (3 develop the competencies needed to prepare for their future careers. Methods The SCCP was based on the ADDIE (analysis, design, development, implementation, and evaluation model and decision-making questioning model. Medical professionals, medical education and career counseling experts, and students participated in designing the program. Results The SCCP describes coaching content, tools, operational methods, and appropriate timing, and identifies the professionals and specialists who can offer their expertise in the different coaching phases. It is designed to allow medical schools to offer the program in segments or in its entirety, depending on the curriculum and environment. Conclusion The SCCP represents a viable career-coaching program for medical students that can be applied in part or in its entirety, depending on a medical school’s curriculum and educational environment.

Development of a systematic career coaching program for medical students.

Science.gov (United States)

Hur, Yera; Cho, A Ra; Kwon, Mihye

2018-03-01

This study aimed to develop a systematic career-coaching program (SCCP) that can be used by medical teaching schools to address a growing need for career-coaching. The program objectives were to help students (1) develop a comprehensive self-understanding of their aptitudes, interests, and personality traits; (2) explore possible career choices and decide on a career path; and (3) develop the competencies needed to prepare for their future careers. The SCCP was based on the ADDIE (analysis, design, development, implementation, and evaluation) model and decision-making questioning model. Medical professionals, medical education and career counseling experts, and students participated in designing the program. The SCCP describes coaching content, tools, operational methods, and appropriate timing, and identifies the professionals and specialists who can offer their expertise in the different coaching phases. It is designed to allow medical schools to offer the program in segments or in its entirety, depending on the curriculum and environment. The SCCP represents a viable career-coaching program for medical students that can be applied in part or in its entirety, depending on a medical school's curriculum and educational environment.

A Self-Instructional Course in Student Financial Aid Administration. Module 17--Evaluation of Student Aid Management: Self-Evaluation, Audit, and Program Review. Second Edition.

Science.gov (United States)

Washington Consulting Group, Inc., Washington, DC.

The 17th module in the 17-module self-instructional course on student financial aid administration discusses the evaluation of student aid management in terms of self-evaluation, audit, and program review. The full course offers a systematic introduction to the management of federal financial aid programs authorized by Title IV of the Higher…

Father-Inclusive Perinatal Parent Education Programs: A Systematic Review.

Science.gov (United States)

Lee, Joyce Y; Knauer, Heather A; Lee, Shawna J; MacEachern, Mark P; Garfield, Craig F

2018-06-14

Fathers contribute to their children's health starting at the beginning of life. Few parent education programs include fathers. Among those that do, there is little effort to report program effects on father outcomes. In this systematic review, we examined father-inclusive perinatal parent education programs in the United States as they relate to a range of father outcomes. The databases searched were PubMed, Cumulative Index to Nursing and Allied Health Literature, Embase, Ovid Medline, Cochrane Central Register of Controlled Trials, and PsycINFO. Studies were included if they included an evaluation of a parent education program and a report of father outcomes measured within 1 year of the child's birth and were conducted within the United States. Of 1353 total articles, 21 met study criteria. The overall state of the father-inclusive perinatal parent education program literature was poor, with few interventions available to fathers. Available programs were associated with increased father involvement, coparenting relationship, partner relationship quality, father's mental health, and father's supportive behaviors. Program effects on father-infant interaction, parenting knowledge, and attitudes and parenting self-efficacy were inconclusive. Three programs emerged as best evidence-based interventions. Risk of bias was high for many studies. Outcome variability, small sample size, and publication bias contributed to the weak evidence base. There is a need for more evidence-based interventions to support fathers. Clinicians play a key role in engaging fathers in early parent education programs and health care settings. PROSPERO registration number: CRD42017050099. Copyright © 2018 by the American Academy of Pediatrics.

An Evaluation System for Training Programs: A Case Study Using a Four-Phase Approach

Science.gov (United States)

Lingham, Tony; Richley, Bonnie; Rezania, Davar

2006-01-01

Purpose: With the increased importance of training in organizations, creating important and meaningful programs are critical to an organization and its members. The purpose of this paper is to suggest a four-phase systematic approach to designing and evaluating training programs that promotes collaboration between organizational leaders, trainers,…

Potential Transferability of Economic Evaluations of Programs Encouraging Physical Activity in Children and Adolescents across Different Countries—A Systematic Review of the Literature

Directory of Open Access Journals (Sweden)

Katharina Korber

2014-10-01

Full Text Available Physical inactivity is an increasing problem. Owing to limited financial resources, one method of getting information on the cost-effectiveness of different types of prevention programs is to examine existing programs and their results. The aim of this paper is to give an overview of the transferability of cost-effectiveness results of physical activity programs for children and adolescents to other contexts. Based on a systematic review of the literature, the transferability of the studies found was assessed using a sub-checklist of the European Network of Health Economic Evaluation Databases (EURONHEED. Thirteen studies of different physical activity interventions were found and analyzed. The results for transferability ranged from “low” to “very high”. A number of different factors influence a program’s cost-effectiveness (i.e., discount rate, time horizon, etc.. Therefore, transparency with regard to these factors is one fundamental element in the transferability of the results. A major point of criticism is that transferability is often limited because of lack of transparency. This paper is the first to provide both an overview and an assessment of transferability of economic evaluations of existing programs encouraging physical activity in children and adolescents. This allows decision makers to gain an impression on whether the findings are transferable to their decision contexts, which may lead to time and cost savings.

Systematic review of positive youth development programs for adolescents with chronic illness.

Science.gov (United States)

Maslow, Gary R; Chung, Richard J

2013-05-01

The Positive Youth Development (PYD) framework has been successfully used to support at-risk youth. However, its effectiveness in fostering positive outcomes for adolescents with chronic illness has not been established. We performed a systematic review of PYD-consistent programs for adolescents with chronic illness. Data sources included PubMed, CINAHL, and PsychINFO. Guided by an analytic framework, we searched for studies of PYD-consistent programs serving adolescents and young adults aged 13 through 24 with chronic illness. References were screened iteratively with increasing depth until a focused cohort was obtained and reviewed in full. The authors separately reviewed the studies using structured analysis forms. Relevant study details were abstracted during the review process. Fifteen studies describing 14 programs were included in the analysis. Three comprehensive programs included all 3 core components of a PYD program, including opportunities for youth leadership, skill building, and sustained connections between youth and adults. Four programs were primarily mentoring programs, and 7 others focused on youth leadership. Programs served youth with a variety of chronic illnesses. The quality and type of evaluation varied considerably, with most reporting psychosocial outcomes but only a few including medical outcomes. The PYD-consistent programs identified in this review can serve as models for the development of youth development programs for adolescents with chronic illness. Additional study is needed to evaluate such programs rigorously with respect to both psychosocial and health-related outcomes. PYD-consistent programs have the potential to reach youth with chronic illness and promote positive adult outcomes broadly.

Systematic evaluation of nuclear operator team skills training

International Nuclear Information System (INIS)

Harrington, D.K.; Kello, J.E.

1991-01-01

In recent years, the nuclear industry has increasingly recognized with the technical training given its control room operators. As yet, however, little has been done to determine the actual effectiveness of such nontechnical training. Thus, the questions of how team training should be carried out for maximum impact on the safety and efficiency of control room operation and just what the benefits of such training might be remain open. We are in the early stages of establishing a systematic evaluation process that will help nuclear utilities assess the effectiveness of their existing team skills training programs for control room operators. Research focuses on defining the specific behavioral and attitudinal objectives of team skills training. Simply put, what does good practice look like and sound like in the control room environment? What specific behaviors and attitudes should the training be directed toward? Obviously, the answers to the questions have clear implications for the design of nuclear team skills training programs

Systematic Evaluation Strategies for Innovative Programs in Health Professions Education: Need, Function and Components.

Science.gov (United States)

Taft, Thomas B., Jr.; Logan, Nelson S.

As change occurs in various health sciences programs, evaluational strategies should be developed so that adaptive decisions may be made. Evaluation models taking into account inputs, methodology, and outputs (Stake, 1967, and Astin and Panes, 1971) need examination. Alternative measurement instruments for formative and summative evaluations,…

Developing a Systematic Patent Search Training Program

Science.gov (United States)

Zhang, Li

2009-01-01

This study aims to develop a systematic patent training program using patent analysis and citation analysis techniques applied to patents held by the University of Saskatchewan. The results indicate that the target audience will be researchers in life sciences, and aggregated patent database searching and advanced search techniques should be…

Evaluating clinical librarian services: a systematic review.

Science.gov (United States)

Brettle, Alison; Maden-Jenkins, Michelle; Anderson, Lucy; McNally, Rosalind; Pratchett, Tracey; Tancock, Jenny; Thornton, Debra; Webb, Anne

2011-03-01

  Previous systematic reviews have indicated limited evidence and poor quality evaluations of clinical librarian (CL) services. Rigorous evaluations should demonstrate the value of CL services, but guidance is needed before this can be achieved.   To undertake a systematic review which examines models of CL services, quality, methods and perspectives of clinical librarian service evaluations.   Systematic review methodology and synthesis of evidence, undertaken collaboratively by a group of 8 librarians to develop research and critical appraisal skills.   There are four clear models of clinical library service provision. Clinical librarians are effective in saving health professionals time, providing relevant, useful information and high quality services. Clinical librarians have a positive effect on clinical decision making by contributing to better informed decisions, diagnosis and choice of drug or therapy. The quality of CL studies is improving, but more work is needed on reducing bias and providing evidence of specific impacts on patient care. The Critical Incident Technique as part of a mixed method approach appears to offer a useful approach to demonstrating impact.   This systematic review provides practical guidance regarding the evaluation of CL services. It also provides updated evidence regarding the effectiveness and impact of CL services. The approach used was successful in developing research and critical appraisal skills in a group of librarians. © 2010 The authors. Health Information and Libraries Journal © 2010 Health Libraries Group.

Effect of Home Exercise Program in Patients With Knee Osteoarthritis: A Systematic Review and Meta-analysis.

Science.gov (United States)

Anwer, Shahnawaz; Alghadir, Ahmad; Brismée, Jean-Michel

2016-01-01

The Osteoarthritis Research Society International recommended that nonpharmacological methods include patient education programs, weight reduction, coping strategies, and exercise programs for the management of knee osteoarthritis (OA). However, neither a systematic review nor a meta-analysis has been published regarding the effectiveness of home exercise programs for the management of knee OA. The purpose of this systematic review was to examine the evidence regarding the effect of home exercise programs with and without supervised clinic-based exercises in the management of knee OA. We searched PubMed, CINAHL, Embase, Scopus, and PEDro for research articles published prior to September 2014 using key words such as pain, exercise, home exercise program, rehabilitation, supervised exercise program, and physiotherapy in combination with Medical Subject Headings "Osteoarthritis knee." We selected randomized and case-controlled trials published in English language. To verify the quality of the selected studies, we applied the PEDro Scale. Two evaluators individually selected the studies based on titles, excluding those articles that were not related to the objectives of this review. One evaluator extracted data from the included studies. A second evaluator independently verified extracted data for accuracy. A total of 31 studies were found in the search. Of these, 19 studies met the inclusion criteria and were further analyzed. Seventeen of these 19 studies reached high methodological quality on the PEDro scale. Although the methods and home exercise program interventions varied widely in these studies, most found significant improvements in pain and function in individuals with knee OA. The analysis indicated that both home exercise programs with and without supervised clinic-based exercises were beneficial in the management of knee OA. The large evidence of high-quality trials supports the effectiveness of home exercise programs with and without supervised clinic

School-based internet obesity prevention programs for adolescents: a systematic literature review.

Science.gov (United States)

Whittemore, Robin; Chao, Ariana; Popick, Rachel; Grey, Margaret

2013-03-01

In response to the childhood obesity epidemic, numerous studies on school-based Internet obesity prevention interventions have been conducted. The purpose of this systematic review is to describe, synthesize, and evaluate the research on school-based Internet obesity prevention programs for adolescents. Medline, CINAHL, and PsycInfo were searched from January 1995 to August 2012 to locate relevant studies. Ninety-one reports were initially identified, with 12 meeting the inclusion criteria. Studies had variable control groups, program content, and sample characteristics. Though few authors reported on implementation processes or body mass index (BMI) outcomes, the majority of studies were effective in improving health behaviors in the short term. Most studies were judged to have a high or unclear risk of bias in at least two domains, thus the quality of evidence for this body of literature is moderate. Further research is needed to examine programs of longer duration, optimal dose and timing of programs, cost-effectiveness, and mediators and moderators of intervention outcomes.

Meta-evaluation of published studies on evaluation of health disaster preparedness exercises through a systematic review.

Science.gov (United States)

Sheikhbardsiri, Hojjat; Yarmohammadian, Mohammad H; Khankeh, Hamid Reza; Nekoei-Moghadam, Mahmoud; Raeisi, Ahmad Reza

2018-01-01

Exercise evaluation is one of the most important steps and sometimes neglected in designing and taking exercises, in this stage of exercise, it systematically identifying, gathering, and interpreting related information to indicate how an exercise has fulfilled its objectives. The present study aimed to assess the most important evaluation techniques applied in evaluating health exercises for emergencies and disasters. This was meta-evaluation study through a systematic review. In this research, we searched papers based on specific and relevant keywords in research databases including ISI web of science, PubMed, Scopus, Science Direct, Ovid, ProQuest, Wiley, Google Scholar, and Persian database such as ISC and SID. The search keywords and strategies are followed; "simulation," "practice," "drill," "exercise," "instrument," "tool," "questionnaire," " measurement," "checklist," "scale," "test," "inventory," "battery," "evaluation," "assessment," "appraisal," "emergency," "disaster," "cricise," "hazard," "catastrophe,: "hospital", "prehospital," "health centers," "treatment centers," were used in combination with Boolean operators OR and AND. The research findings indicate that there are different techniques and methods for data collection to evaluate performance exercises of health centers and affiliated organizations in disasters and emergencies including debriefing inventories, self-report, questionnaire, interview, observation, shooting video, and photographing, electronic equipment which can be individually or collectively used depending on exercise objectives or purposes. Taking exercise in the health sector is one of the important steps in preparation and implementation of disaster risk management programs. This study can be thus utilized to improve preparedness of different sectors of health system according to the latest available evaluation techniques and methods for better implementation of disaster exercise evaluation stages.

Cyberbullying Prevention and Intervention Programs in Schools: A Systematic Review

Science.gov (United States)

Tanrikulu, Ibrahim

2018-01-01

This article presents a systematic review of school-based cyberbullying prevention and intervention programs. Research presenting empirical evidence about the effectiveness of a school-based cyberbullying prevention or intervention program published before August 2016 was searched. Seventeen studies were obtained and reviewed. The findings showed…

Teaching-skills training programs for family medicine residents: systematic review of formats, content, and effects of existing programs.

Science.gov (United States)

Lacasse, Miriam; Ratnapalan, Savithiri

2009-09-01

To review the literature on teaching-skills training programs for family medicine residents and to identify formats and content of these programs and their effects. Ovid MEDLINE (1950 to mid-July 2008) and the Education Resources Information Center database (pre-1966 to mid-July 2008) were searched using and combining the MeSH terms teaching, internship and residency, and family practice; and teaching, graduate medical education, and family practice. The initial MEDLINE and Education Resources Information Center database searches identified 362 and 33 references, respectively. Titles and abstracts were reviewed and studies were included if they described the format or content of a teaching-skills program or if they were primary studies of the effects of a teaching-skills program for family medicine residents or family medicine and other specialty trainees. The bibliographies of those articles were reviewed for unidentified studies. A total of 8 articles were identified for systematic review. Selection was limited to articles published in English. Teaching-skills training programs for family medicine residents vary from half-day curricula to a few months of training. Their content includes leadership skills, effective clinical teaching skills, technical teaching skills, as well as feedback and evaluation skills. Evaluations mainly assessed the programs' effects on teaching behaviour, which was generally found to improve following participation in the programs. Evaluations of learner reactions and learning outcomes also suggested that the programs have positive effects. Family medicine residency training programs differ from all other residency training programs in their shorter duration, usually 2 years, and the broader scope of learning within those 2 years. Few studies on teaching-skills training, however, were designed specifically for family medicine residents. Further studies assessing the effects of teaching-skills training in family medicine residents are

Evaluation Program initiative

International Nuclear Information System (INIS)

Rich, B.L.

1987-01-01

The purpose of this paper is to provide the Department of Energy's (DOE) safeguards and security community with some insights on an important management initiative by the Office of Security Evaluations (OSE). The paper will present the ''what, where, who, when, and why'' of a new Evaluation Program. The Evaluation Program will be comprised of a continuing series of regular and special evaluations of DOE safeguards and security programs and policies. The evaluations will be integrative and ''crosscutting,'' i.e. will extend across DOE organizational lines. Evaluations will be offered as positive advisories to DOE managers with safeguards and security responsibilities and will not be rated. They will complement the ongoing OSE Inspection Program of inspections conducted by OSE's Inspection Division. The purpose for the evaluations is to establish an accurate and current assessment of the effectiveness and status of safeguards and security programs and policies and to provide DOE managers with required information on program and policy effectiveness

GESAT: System for management and evaluation of training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper describe the criteria considered to design the GESAT system, the elements considered to select the relational model, selection of the database language and the main features and possibilities of this system. GESAT allow the management of training programs based on the Systematic Approach to Training. Include the information related with all SAT phases, the results of the job analysis, training plans design, development of materials, training implementation, and the subsequent evaluation

Meta-analysis and systematic review of studies on the effectiveness of HIV stigma reduction programs.

Science.gov (United States)

Mak, Winnie W S; Mo, Phoenix K H; Ma, Gloria Y K; Lam, Maggie Y Y

2017-09-01

The present study conducted a meta-analysis and systematic review on studies evaluating the effectiveness of stigma reduction programs in improving knowledge and reducing negative attitudes towards people living with HIV (PLHIV). Meta-analysis (k = 42 studies) found significant and small effect sizes in the improvement of the participants' knowledge of HIV/AIDS from interventions with (Cohen's d = 0.48, 95% CI [0.30, 0.66]) and without control groups (Cohen's d = 0.42, 95% CI [0.28, 0.57]). Significant and small effect sizes were found in the improvement of the participants' attitudes toward PLHIV from interventions with (Cohen's d = 0.39, 95% CI [0.23, 0.55]) and without control groups (Cohen's d = 0.25, 95% CI [0.11, 0.39]). Significant and small effect sizes were sustained at the follow-up assessments. Subgroup analysis showed that number of intervention sessions, intervention settings, and sample type significantly moderated the effect sizes in the meta-analysis. Findings from the systematic review of 35 studies indicated that most of the included studies showed positive results in reducing negative attitudes toward PLHIV and improving HIV-related knowledge. Most of the included studies tended to have low methodological quality. The present meta-analysis and systematic review indicated that the studies generally found small improvement in HIV-related knowledge and reduction in negative attitudes towards PLHIV among the stigma reduction programs being evaluated. High-quality stigma reduction programs with multidimensional stigma indicators and psychometrically sound outcome measures are highly warranted. Copyright © 2017 Elsevier Ltd. All rights reserved.

Efficiency of Physical Exercise Programs on Chronic Psychiatry Patients: A Systematic Review

Directory of Open Access Journals (Sweden)

Sefa Lok

2016-12-01

Full Text Available Physical activity and exercise have recently been used as an effective method for the treatment of several mental disorders. In this systematic review, the objective is to evaluate the efficiency of the physical activity programs which are applied on the chronic psychiatric patients. The review is made in direction with the Centre for Reviews and Dissemination 2009 guide which is developed by the York University, National Health Care Research Institute. Seven studies are included within the scope of this research. The patients with chronic mental disorders who participate in the physical activity programs experience positive outcomes like that they feel themselves mentally better, they are more compatible with the medical treatment and therapeutic interventions, the programs diminish the anxiety, their perceptions of physical self are strengthened, the social functionality is increased, the duration of morning sleep is decreased and the quality of night sleep is increased. Accordingly, personalized, planned and continuous physical activity programs should be developed for all the psychiatric patients and these programs should be applied on such patients. [Psikiyatride Guncel Yaklasimlar - Current Approaches in Psychiatry 2016; 8(4.000: 354-366

Estimating data from figures with a Web-based program: Considerations for a systematic review.

Science.gov (United States)

Burda, Brittany U; O'Connor, Elizabeth A; Webber, Elizabeth M; Redmond, Nadia; Perdue, Leslie A

2017-09-01

Systematic reviewers often encounter incomplete or missing data, and the information desired may be difficult to obtain from a study author. Thus, systematic reviewers may have to resort to estimating data from figures with little or no raw data in a study's corresponding text or tables. We discuss a case study in which participants used a publically available Web-based program, called webplotdigitizer, to estimate data from 2 figures. We evaluated and used the intraclass coefficient and the accuracy of the estimates to the true data to inform considerations when using estimated data from figures in systematic reviews. The estimates for both figures were consistent, although the distribution of estimates in the figure of a continuous outcome was slightly higher. For the continuous outcome, the percent difference ranged from 0.23% to 30.35% while the percent difference of the event rate ranged from 0.22% to 8.92%. For both figures, the intraclass coefficient was excellent (>0.95). Systematic reviewers should consider and be transparent when estimating data from figures when the information cannot be obtained from study authors and perform sensitivity analyses of pooled results to reduce bias. Copyright © 2017 John Wiley & Sons, Ltd.

Program for the evaluation of TL-brick dating: 'ADAM-1-EVA'

International Nuclear Information System (INIS)

Novotna, V.; Kubelik, M.; Musilek, L.

2000-01-01

Although the evaluation of the TL-mean date has presented very little diversity since first published, the error evaluation has prompted a lot of discussion. Particularly the physical, chemical, statistical and mathematical differences as reflected in the specifics of the evaluation of the individual random and systematic errors in ceramic and brick dating are undervalued in literature. The construction of an automated TL-Reader (ADAM-1) at the Czech Technical University in Prague was taken as an opportunity to create a whole new software package for the evaluation ('EVA') of TL-dates. ADAM-1 is designed primarily for brick dating, using the fine-grain technique. The philosophy of data processing is similar to that applied by the Berlin group in their research of Venetian Villas. The program was developed using Delphi, as it is user-friendlier than pure Pascal, offers a strong graphic platform and allows flexibility in data management. This was important, as the program was conceived to either interact directly with ADAM-1, or to be operated independently for data evaluation and management. The software package consists of two discrete yet combinable components: one for the calculation of the TL mean date, using all raw data obtained from ADAM-1 and peripheral measurements; the other for the evaluation of systematic, random and context errors of individual samples and sample groups. All steps in the calculations are also graphically available, e.g. glow curves, plateau test, TL vs. dose dependence and charts summarising the results of all calculations for an individual sample and a given context. (author)

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

Science.gov (United States)

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Barriers for Nonparticipation and Dropout of Women in Cardiac Rehabilitation Programs: A Systematic Review.

Science.gov (United States)

Resurrección, Davinia M; Motrico, Emma; Rigabert, Alina; Rubio-Valera, Maria; Conejo-Cerón, Sonia; Pastor, Luis; Moreno-Peral, Patricia

2017-08-01

Cardiovascular disease (CVD) is a major health problem worldwide. Cardiac rehabilitation (CR) programs are effective in reducing mortality and improving the quality of life of patients with CVD. Women are under-represented in CR and have a higher dropout rate than men. We aimed to systematically review the literature on barriers perceived by women with CVD affecting their nonparticipation in and/or dropping out from CR programs. Systematic review was done using MEDLINE, Embase, Scopus, Open Grey, and Cochrane Database from inception to September 2016. Search terms included (1) heart disease and other cardiac conditions, (2) CR and secondary prevention, and (3) nonparticipation in and/or dropout. Databases were searched following the "participants, interventions, comparisons, outcomes, and study design" method. A total of 24 studies (17 descriptive, 6 qualitative, and 1 randomized controlled trial) reporting several barriers were grouped into five broad categories: intrapersonal barriers (self-reported health, health beliefs, lack of time, motivation, and religious reasons); interpersonal barriers (lack of family/social support and work conflicts); logistical barriers (transport, distance, and availability of personal/community resources); CR program barriers (services offered, group format, exercise component, and CR sessions); and health system barriers (lack of referral, cost, negative experiences with the health system, and language). We found differences between the barriers related to nonparticipation in and dropout from CR programs. Women reported multilevel barriers for nonparticipation in and dropout from CR programs. Future clinical guidelines should evaluate and eliminate these barriers to improve adherence to CR programs in women. In addition, understanding the barriers for nonparticipation and dropout may be beneficial for future intervention trials.

Economic evaluations of Haemophilus influenzae type b (Hib) vaccine: a systematic review.

Science.gov (United States)

Chongmelaxme, Bunchai; Hammanee, Maythika; Phooaphirak, Wariya; Kotirum, Surachai; Hutubessy, Raymond; Chaiyakunapruk, Nathorn

2017-10-01

The World Health Organization (WHO) recommends the use of Haemophilus influenzae type b (Hib) conjugate vaccines, but China and Thailand have not used Hib vaccination in their national immunization programs. This systematic review aimed to update published economic evaluations of Hib vaccinations and to determine factors that potentially affected their cost-effectiveness. Searches were performed from the inception until December 2015 using 13 databases: CAB direct; CEA registry; EconLit; EMBASE; E-library; NHSEED; PAHO; POPLINE; PubMed; Redalyc project; RePEc; SciELO; and WHOLIS. Reference lists of relevant studies and grey literature were also searched. Full economic evaluations of Hib vaccination with results of costs and outcomes were included. The WHO checklist was used to evaluate the quality of the included studies. Data from eligible studies were extracted using a standardized data collection form. Out of 830 articles, 27 were included. Almost half of the studies (12/27) were conducted in high-income countries. Twelve studies (12/27) investigated the Hib vaccine as an addition to the existing vaccination program. Most studies (17/27) examined a 3-dose schedule of Hib vaccine. Nineteen studies (19/27) reported the model used, where all were decision tree models. Most of the studies (23/27) demonstrated an economic value of Hib vaccination programs, key influential parameters being incidence rates of Hib disease and vaccine price. Hib vaccination programs are mostly found to be cost-effective across geographic regions and country income levels, and Hib vaccination is recommended for inclusion into all national immunization programs. The findings are expected to support policy-makers for making decisions on allocating limited resources of the Hib vaccination program effectively.

A systematic review of health economic evaluations of vaccines in Brazil.

Science.gov (United States)

Sartori, Ana Marli Christovam; Rozman, Luciana Martins; Decimoni, Tassia Cristina; Leandro, Roseli; Novaes, Hillegonda Maria Dutilh; de Soárez, Patrícia Coelho

2017-06-03

In Brazil, since 2005, the Ministry of Health requires Health Economic Evaluation (HEE) of vaccines for introduction into the National Immunization Program. To describe and analyze the full HEE on vaccines conducted in Brazil from 1980 to 2013. Systematic review of the literature. We searched multiple databases. Two researchers independently selected the studies and extracted the data. The methodological quality of individual studies was evaluated using CHEERS items. Twenty studies were reviewed. The most evaluated vaccines were pneumococcal (25%) and HPV (15%). The most used types of HEE were cost-effectiveness analysis (45%) and cost-utility analysis (20%). The research question and compared strategies were stated in all 20 studies and the target population was clear in 95%. Nevertheless, many studies did not inform the perspective of analysis or data sources. HEE of vaccines in Brazil has increased since 2008. However, the studies still have methodological deficiencies.

Using systematic aging assessments to improve effectiveness of plant maintenance programs

International Nuclear Information System (INIS)

Watson, P.; Yang, J.X.; Dam, R.F.; Nickerson, J.H.

2003-01-01

Nuclear plant equipment aging assessment studies provided by AECL include life assessments, condition assessments or systematic assessments of maintenance. AECL has developed several tools to apply the results of aging assessment studies to improve the effectiveness of actual plant maintenance programs. The Systematic Assessment of Maintenance and the SYSTMS tool generate maintenance tasks for a system. The System Maintenance Datastore tool assesses the maintenance resources on a system basis, and can thus quantify the savings realized by optimizing the maintenance program. Long term trends in condition-based maintenance due to component aging can be predicted, and resource savings due to optimum timing of component replacement or general plant refurbishment can be quantified. The System based Adaptive Maintenance Process ensures the maintenance program is continually updated to reflect the latest plant equipment condition and maintenance strategy information. (author)

A systematic review: plyometric training programs for young children.

Science.gov (United States)

Johnson, Barbara A; Salzberg, Charles L; Stevenson, David A

2011-09-01

The purpose of this systematic review was to evaluate the efficacy and safety of plyometric training for improving motor performance in young children; to determine if this type of training could be used to improve the strength, running speed, agility, and jumping ability of children with low motor competence; and to examine the extent and quality of the current research literature. Primary research articles were selected if they (a) described the outcomes of a plyometric exercise intervention; (b) included measures of strength, balance, running speed, jumping ability, or agility; (c) included prepubertal children 5-14 years of age; and (d) used a randomized control trial or quasiexperimental design. Seven articles met the inclusion criteria for the final review. The 7 studies were judged to be of low quality (values of 4-6). Plyometric training had a large effect on improving the ability to run and jump. Preliminary evidence suggests plyometric training also had a large effect on increasing kicking distance, balance, and agility. The current evidence suggests that a twice a week program for 8-10 weeks beginning at 50-60 jumps a session and increasing exercise load weekly results in the largest changes in running and jumping performance. An alternative program for children who do not have the capability or tolerance for a twice a week program would be a low-intensity program for a longer duration. The research suggests that plyometric training is safe for children when parents provide consent, children agree to participate, and safety guidelines are built into the intervention.

Collaborative Evaluation within a Framework of Stakeholder-Oriented Evaluation Approaches

Science.gov (United States)

O'Sullivan, Rita G.

2012-01-01

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

Economic Evaluations of Multicomponent Disease Management Programs with Markov Models: A Systematic Review.

Science.gov (United States)

Kirsch, Florian

2016-12-01

Disease management programs (DMPs) for chronic diseases are being increasingly implemented worldwide. To present a systematic overview of the economic effects of DMPs with Markov models. The quality of the models is assessed, the method by which the DMP intervention is incorporated into the model is examined, and the differences in the structure and data used in the models are considered. A literature search was conducted; the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement was followed to ensure systematic selection of the articles. Study characteristics e.g. results, the intensity of the DMP and usual care, model design, time horizon, discount rates, utility measures, and cost-of-illness were extracted from the reviewed studies. Model quality was assessed by two researchers with two different appraisals: one proposed by Philips et al. (Good practice guidelines for decision-analytic modelling in health technology assessment: a review and consolidation of quality asessment. Pharmacoeconomics 2006;24:355-71) and the other proposed by Caro et al. (Questionnaire to assess relevance and credibility of modeling studies for informing health care decision making: an ISPOR-AMCP-NPC Good Practice Task Force report. Value Health 2014;17:174-82). A total of 16 studies (9 on chronic heart disease, 2 on asthma, and 5 on diabetes) met the inclusion criteria. Five studies reported cost savings and 11 studies reported additional costs. In the quality, the overall score of the models ranged from 39% to 65%, it ranged from 34% to 52%. Eleven models integrated effectiveness derived from a clinical trial or a meta-analysis of complete DMPs and only five models combined intervention effects from different sources into a DMP. The main limitations of the models are bad reporting practice and the variation in the selection of input parameters. Eleven of the 14 studies reported cost-effectiveness results of less than $30,000 per quality-adjusted life-year and

DOE Handbook: Guide to good practices evaluation instrument examples

Energy Technology Data Exchange (ETDEWEB)

NONE

1997-01-01

Training evaluation determines a training program`s effectiveness in meeting its intended purpose: producing competent employees. Evaluation is the quality assurance component of a systematic approach to training program. This guide provides information on evaluation instruments used to gather employee, supervisor, and instructor feedback to identify strengths and weaknesses of training programs at DOE facilities. It should be used in conjunction with ``DOE Training Program Handbook: A Systematic Approach to Training`` and ``DOE Handbook, Alternative Systematic Approaches to Training.``

Dissemination of Technology to Evaluate Healthy Food Incentive Programs.

Science.gov (United States)

Freedman, Darcy A; Hunt, Alan R; Merritt, Katie; Shon, En-Jung; Pike, Stephanie N

2017-03-01

Federal policy supports increased implementation of monetary incentive interventions for chronic disease prevention among low-income populations. This study describes how a Prevention Research Center, working with a dissemination partner, developed and distributed technology to support nationwide implementation and evaluation of healthy food incentive programming focused on Supplemental Nutrition Assistance Program recipients. FM Tracks, an iOS-based application and website, was developed to standardize evaluation methods for healthy food incentive program implementation at direct-to-consumer markets. This evaluation examined diffusion and adoption of the technology over 9 months (July 2015-March 2016). Data were analyzed in 2016. FM Tracks was disseminated to 273 markets affiliated with 37 regional networks in 18 states and Washington, DC. All markets adopted the sales transaction data collection feature, with nearly all recording at least one Supplemental Nutrition Assistance Program (99.3%) and healthy food incentive (97.1%) transaction. A total of 43,493 sales transactions were recorded. By the ninth month of technology dissemination, markets were entering individual sales transactions using the application (34.5%) and website (29.9%) and aggregated transactions via website (35.6%) at similar rates. Use of optional evaluation features like recording a customer ID with individual transactions increased successively with a low of 22.2% during the first month to a high of 69.2% in the ninth month. Systematic and widely used evaluation technology creates possibilities for pragmatic research embedded within ongoing, real-world implementation of food access interventions. Technology dissemination requires supportive technical assistance and continuous refinement that can be advanced through academic-practitioner partnerships. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

Use of Fictional Medical Television in Health Sciences Education: A Systematic Review

Science.gov (United States)

Hoffman, Beth L.; Hoffman, Robert; Wessel, Charles B.; Shensa, Ariel; Woods, Michelle S.; Primack, Brian A.

2018-01-01

While medical television programs are popular among health profession trainees, it is not clear to what extent these programs affect their knowledge, perceptions, and/or behaviors. Therefore, we conducted a systematic review of research evaluating associations between program exposure and outcomes. We conducted systematic literature searches in…

DOE Handbook: Guide to good practices evaluation instrument examples

International Nuclear Information System (INIS)

1997-01-01

Training evaluation determines a training program's effectiveness in meeting its intended purpose: producing competent employees. Evaluation is the quality assurance component of a systematic approach to training program. This guide provides information on evaluation instruments used to gather employee, supervisor, and instructor feedback to identify strengths and weaknesses of training programs at DOE facilities. It should be used in conjunction with ''DOE Training Program Handbook: A Systematic Approach to Training'' and ''DOE Handbook, Alternative Systematic Approaches to Training.''

A systematic writing program as a tool in the grief process: part 1.

Science.gov (United States)

Furnes, Bodil; Dysvik, Elin

2010-12-06

The basic aim of this paper is to suggest a flexible and individualized writing program as a tool for use during the grief process of bereaved adults. An open, qualitative approach following distinct steps was taken to gain a broad perspective on the grief and writing processes, as a platform for the writing program. Following several systematic methodological steps, we arrived at suggestions for the initiation of a writing program and its structure and substance, with appropriate guidelines. We believe that open and expressive writing, including free writing and focused writing, may have beneficial effects on a person experiencing grief. These writing forms may be undertaken and systematized through a writing program, with participation in a grief writing group and with diary writing, to achieve optimal results. A structured writing program might be helpful in promoting thought activities and as a tool to increase the coherence and understanding of individuals in the grief process. Our suggested program may also be a valuable guide to future program development and research.

Programmatic Environmental Scans: A Survey Based on Program Planning and Evaluation Concepts

Directory of Open Access Journals (Sweden)

Donna J. Peterson

2015-10-01

Full Text Available Within Extension, environmental scans are most commonly used to assess community or organizational issues or for strategic planning purposes. However, Extension has expanded the use of environmental scans to systematically identify “what programs exist” on a given topic or focus area. Yet, despite recent attention to the topic of environmental scanning in Extension, survey instruments used to conduct environmental scans have not been published. Given the emphasis on implementation of evidence-based practices and programs, having a ready-made survey that can be used to identify programs on a specific topic and that could subsequently lead to an evaluability assessment of those programs would be a useful resource. To encourage the use of environmental scans to identify existing evidence-based programs, this article describes a survey instrument developed for the purpose of scanning for 4-H Healthy Living programs ready for rigorous outcome evaluation and/or national replication. It focuses on the rationale for survey items, as well as provides a summary and definition of those items. The survey tool can be easily adapted for future programmatic environmental scans both within and outside Extension.

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

Science.gov (United States)

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common

Strategies to improve treatment coverage in community-based public health programs: A systematic review of the literature.

Directory of Open Access Journals (Sweden)

Katrina V Deardorff

2018-02-01

Full Text Available Community-based public health campaigns, such as those used in mass deworming, vitamin A supplementation and child immunization programs, provide key healthcare interventions to targeted populations at scale. However, these programs often fall short of established coverage targets. The purpose of this systematic review was to evaluate the impact of strategies used to increase treatment coverage in community-based public health campaigns.We systematically searched CAB Direct, Embase, and PubMed archives for studies utilizing specific interventions to increase coverage of community-based distribution of drugs, vaccines, or other public health services. We identified 5,637 articles, from which 79 full texts were evaluated according to pre-defined inclusion and exclusion criteria. Twenty-eight articles met inclusion criteria and data were abstracted regarding strategy-specific changes in coverage from these sources. Strategies used to increase coverage included community-directed treatment (n = 6, pooled percent change in coverage: +26.2%, distributor incentives (n = 2, +25.3%, distribution along kinship networks (n = 1, +24.5%, intensified information, education, and communication activities (n = 8, +21.6%, fixed-point delivery (n = 1, +21.4%, door-to-door delivery (n = 1, +14.0%, integrated service distribution (n = 9, +12.7%, conversion from school- to community-based delivery (n = 3, +11.9%, and management by a non-governmental organization (n = 1, +5.8%.Strategies that target improving community member ownership of distribution appear to have a large impact on increasing treatment coverage. However, all strategies used to increase coverage successfully did so. These results may be useful to National Ministries, programs, and implementing partners in optimizing treatment coverage in community-based public health programs.

The effectiveness and implementation of mentoring program for newly graduated nurses: A systematic review.

Science.gov (United States)

Zhang, Yuanyuan; Qian, Yan; Wu, Juemin; Wen, Fule; Zhang, Yaqing

2016-02-01

Newly graduated nurses suffer from occupational stress during the transition from school to employment as a result of inadequacy, interpersonal relationships, and the overwhelming workload. Mentoring programs have proved effective in facilitating this transition. To evaluate the effectiveness of a mentoring program on the mentor, mentee, and organization. The Cochrane Library, Medline, Ovid, Elsevier, Embase, CINAHL, CBM, CNKI, and WanFang Data databases were searched to identify relevant publications in English or Chinese up to October 2014. This is a systematic review. This review identified nine potentially eligible studies, and the methodological quality levels of the included studies were all ranked as level B. These studies revealed that the turnover rate can be decreased through a mentoring program. Additionally, mentoring can enhance nursing competency and establish a supportive workforce environment, resulting in positive outcomes. This review reveals that a mentoring program has positive effects on the mentors, mentees, and organizations. A successful mentorship program should include rigorous mentor selection and adequate training. Additionally, potential barriers such as time constraints and scheduling limitations should be taken into consideration during implementation. Copyright © 2015 Elsevier Ltd. All rights reserved.

A systematic review of economic evaluations of health and health-related interventions in Bangladesh

Science.gov (United States)

2011-01-01

Background Economic evaluation is used for effective resource allocation in health sector. Accumulated knowledge about economic evaluation of health programs in Bangladesh is not currently available. While a number of economic evaluation studies have been performed in Bangladesh, no systematic investigation of the studies has been done to our knowledge. The aim of this current study is to systematically review the published articles in peer-reviewed journals on economic evaluation of health and health-related interventions in Bangladesh. Methods Literature searches was carried out during November-December 2008 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface. The first specific interest was mapping the articles considering the areas of exploration by economic evaluation and the second interest was to scrutiny the methodological quality of studies. The methodological quality of economic evaluation of all articles has been scrutinized against the checklist developed by Evers Silvia and associates. Result Of 1784 potential articles 12 were accepted for inclusion. Ten studies described the competing alternatives clearly and only two articles stated the perspective of their articles clearly. All studies included direct cost, incurred by the providers. Only one study included the cost of community donated resources and volunteer costs. Two studies calculated the incremental cost effectiveness ratio (ICER). Six of the studies applied some sort of sensitivity analysis. Two of the studies discussed financial affordability of expected implementers and four studies discussed the issue of generalizability for application in different context. Conclusion Very few economic evaluation studies in Bangladesh are found in different areas of health and health-related interventions, which does not provide a strong basis of knowledge in the area. The

A systematic review of economic evaluations of health and health-related interventions in Bangladesh

Directory of Open Access Journals (Sweden)

Koehlmoos Tracey P

2011-07-01

Full Text Available Abstract Background Economic evaluation is used for effective resource allocation in health sector. Accumulated knowledge about economic evaluation of health programs in Bangladesh is not currently available. While a number of economic evaluation studies have been performed in Bangladesh, no systematic investigation of the studies has been done to our knowledge. The aim of this current study is to systematically review the published articles in peer-reviewed journals on economic evaluation of health and health-related interventions in Bangladesh. Methods Literature searches was carried out during November-December 2008 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface. The first specific interest was mapping the articles considering the areas of exploration by economic evaluation and the second interest was to scrutiny the methodological quality of studies. The methodological quality of economic evaluation of all articles has been scrutinized against the checklist developed by Evers Silvia and associates. Result Of 1784 potential articles 12 were accepted for inclusion. Ten studies described the competing alternatives clearly and only two articles stated the perspective of their articles clearly. All studies included direct cost, incurred by the providers. Only one study included the cost of community donated resources and volunteer costs. Two studies calculated the incremental cost effectiveness ratio (ICER. Six of the studies applied some sort of sensitivity analysis. Two of the studies discussed financial affordability of expected implementers and four studies discussed the issue of generalizability for application in different context. Conclusion Very few economic evaluation studies in Bangladesh are found in different areas of health and health-related interventions, which does not provide a strong basis

Core Professionalism Education in Surgery: A Systematic Review

Directory of Open Access Journals (Sweden)

Akile Sarıoğlu Büke

2018-03-01

Full Text Available Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

Core Professionalism Education in Surgery: A Systematic Review.

Science.gov (United States)

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-03-15

Professionalism education is one of the major elements of surgical residency education. To evaluate the studies on core professionalism education programs in surgical professionalism education. Systematic review. This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

Components of effective randomized controlled trials of hydrotherapy programs for fibromyalgia syndrome: A systematic review.

Science.gov (United States)

Perraton, Luke; Machotka, Zuzana; Kumar, Saravana

2009-11-30

Previous systematic reviews have found hydrotherapy to be an effective management strategy for fibromyalgia syndrome (FMS). The aim of this systematic review was to summarize the components of hydrotherapy programs used in randomized controlled trials. A systematic review of randomized controlled trials was conducted. Only trials that have reported significant FMS-related outcomes were included. Data relating to the components of hydrotherapy programs (exercise type, duration, frequency and intensity, environmental factors, and service delivery) were analyzed. Eleven randomized controlled trials were included in this review. Overall, the quality of trials was good. Aerobic exercise featured in all 11 trials and the majority of hydrotherapy programs included either a strengthening or flexibility component. Great variability was noted in both the environmental components of hydrotherapy programs and service delivery. Aerobic exercise, warm up and cool-down periods and relaxation exercises are common features of hydrotherapy programs that report significant FMS-related outcomes. Treatment duration of 60 minutes, frequency of three sessions per week and an intensity equivalent to 60%-80% maximum heart rate were the most commonly reported exercise components. Exercise appears to be the most important component of an effective hydrotherapy program for FMS, particularly when considering mental health-related outcomes.

[The use of systematic review to develop a self-management program for CKD].

Science.gov (United States)

Lee, Yu-Chin; Wu, Shu-Fang Vivienne; Lee, Mei-Chen; Chen, Fu-An; Yao, Yen-Hong; Wang, Chin-Ling

2014-12-01

Chronic kidney disease (CKD) has become a public health issue of international concern due to its high prevalence. The concept of self-management has been comprehensively applied in education programs that address chronic diseases. In recent years, many studies have used self-management programs in CKD interventions and have investigated the pre- and post-intervention physiological and psychological effectiveness of this approach. However, a complete clinical application program in the self-management model has yet to be developed for use in clinical renal care settings. A systematic review is used to develop a self-management program for CKD. Three implementation steps were used in this study. These steps include: (1) A systematic literature search and review using databases including CEPS (Chinese Electronic Periodical Services) of Airiti, National Digital Library of Theses and Dissertations in Taiwan, CINAHL, Pubmed, Medline, Cochrane Library, and Joanna Briggs Institute. A total of 22 studies were identified as valid and submitted to rigorous analysis. Of these, 4 were systematic literature reviews, 10 were randomized experimental studies, and 8 were non-randomized experimental studies. (2) Empirical evidence then was used to draft relevant guidelines on clinical application. (3) Finally, expert panels tested the validity of the draft to ensure the final version was valid for application in practice. This study designed a self-management program for CKD based on the findings of empirical studies. The content of this program included: design principles, categories, elements, and the intervention measures used in the self-management program. This program and then was assessed using the content validity index (CVI) and a four-point Liker's scale. The content validity score was .98. The guideline of self-management program to CKD was thus developed. This study developed a self-management program applicable to local care of CKD. It is hoped that the guidelines

Evaluating the online platform of a blended-learning pharmacist continuing education degree program

OpenAIRE

Wilbur, Kerry

2016-01-01

Background: Distance-based continuing education opportunities are increasingly embraced by health professionals worldwide. Methods: To evaluate the online component of a blended-learning degree program for pharmacists, we conducted a structured self-assessment and peer review using an instrument systematically devised according to Moore’s principles of transactional distance. The web-based platform for 14 courses was reviewed by both local and external faculty, followed by shared reflecti...

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

Directory of Open Access Journals (Sweden)

Burgers Jako S

2007-11-01

Full Text Available Abstract Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

A classification of components of workplace disability management programs: results from a systematic review.

Science.gov (United States)

Gensby, U; Labriola, M; Irvin, E; Amick, B C; Lund, T

2014-06-01

This paper presents results from a Campbell systematic review on the nature and effectiveness of workplace disability management programs (WPDM) promoting return to work (RTW), as implemented and practiced by employers. A classification of WPDM program components, based on the review results, is proposed. Twelve databases were searched between 1948 to July 2010 for peer-reviewed studies of WPDM programs provided by employers to re-entering workers with occupational or non-occupational illnesses or injuries. Screening of articles, risk of bias assessment and data extraction were conducted in pairs of reviewers. Studies were clustered around various dimensions of the design and context of programs. 16,932 records were identified by the initial search. 599 papers were assessed for relevance. Thirteen studies met inclusion criteria. Twelve peer reviewed articles (two non-randomized studies, and ten single group experimental before and after studies), including ten different WPDM programs informed the synthesis of results. Narrative descriptions of the included program characteristics provided insight on program scope, components, procedures and human resources involved. However, there were insufficient data on the characteristics of the sample and the effect sizes were uncertain. A taxonomy classifying policies and practices around WPDM programs is proposed. There is insufficient evidence to draw conclusions on the effectiveness of employer provided WPDM programs promoting RTW. It was not possible to determine if specific program components or specific sets of components are driving effectiveness. The proposed taxonomy may guide future WPDM program evaluation and clarify the setup of programs offered to identify gaps in existing company strategies.

Components of effective randomized controlled trials of hydrotherapy programs for fibromyalgia syndrome: A systematic review

OpenAIRE

Perraton, Luke; Machotka, Zuzana; Kumar, Saravana

2009-01-01

Luke Perraton, Zuzana Machotka, Saravana KumarInternational Centre for Allied Health Evidence, University of South Australia, Adelaide, South Australia, AustraliaAim: Previous systematic reviews have found hydrotherapy to be an effective management strategy for fibromyalgia syndrome (FMS). The aim of this systematic review was to summarize the components of hydrotherapy programs used in randomized controlled trials.Method: A systematic review of randomized controlled trials was conducted. Onl...

Predonation psychosocial evaluation of living kidney and liver donor candidates: a systematic literature review.

Science.gov (United States)

Duerinckx, Nathalie; Timmerman, Lotte; Van Gogh, Johan; van Busschbach, Jan; Ismail, Sohal Y; Massey, Emma K; Dobbels, Fabienne

2014-01-01

Evaluating a person's suitability for living organ donation is crucial, consisting not only of a medical but also of a thorough psychosocial screening. We performed a systematic literature review of guidelines, consensus statements, and protocols on the content and process of psychosocial screening of living kidney and liver donor candidates. We searched PubMed, Embase, CINAHL, and PsycINFO until June 22, 2011, following the PRISMA guidelines, complemented by scrutinizing guidelines databases and references of identified publications. Thirty-four publications were identified, including seven guidelines, six consensus statements, and 21 protocols or programs. Guidelines and consensus statements were inconsistent and lacked concreteness for both their content and process, possibly explaining the observed variability in center-specific evaluation protocols and programs. Overall, recommended screening criteria are not evidence-based and an operational definition of the concept "psychosocial" is missing, causing heterogeneity in terminology. Variation also exists on methods used to psychosocially evaluate potential donors. The scientific basis of predonation psychosocial evaluation needs to be strengthened. There is a need for high-quality prospective psychosocial outcome studies in living donors, a uniform terminology to label psychosocial screening criteria, and validated instruments to identify risk factors. © 2013 Steunstichting ESOT. Published by John Wiley & Sons Ltd.

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Physical protection evaluation methodology program development and application

International Nuclear Information System (INIS)

Seo, Janghoon; Yoo, Hosik

2015-01-01

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Physical protection evaluation methodology program development and application

Energy Technology Data Exchange (ETDEWEB)

Seo, Janghoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2015-10-15

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

The Elements of Language Curriculum: A Systematic Approach to Program Development.

Science.gov (United States)

Brown, James Dean

A systematic approach to second language curriculum development is outlined, enumerating the phases and activities involved in developing and implementing a sound and effective language program. The first chapter describes a system whereby all language teaching activities can be classified into approaches, syllabuses, techniques, exercises, or…

Comprehensive care programs for patients with multiple chronic conditions: a systematic literature review.

Science.gov (United States)

de Bruin, Simone R; Versnel, Nathalie; Lemmens, Lidwien C; Molema, Claudia C M; Schellevis, François G; Nijpels, Giel; Baan, Caroline A

2012-10-01

To provide insight into the characteristics of comprehensive care programs for patients with multiple chronic conditions and their impact on patients, informal caregivers, and professional caregivers. Systematic literature search in multiple electronic databases for English language papers published between January 1995 and January 2011, supplemented by reference tracking and a manual search on the internet. Wagner's chronic care model (CCM) was used to define comprehensive care. After inclusion, the methodological quality of each study was assessed. A best-evidence synthesis was applied to draw conclusions. Forty-two publications were selected describing thirty-three studies evaluating twenty-eight comprehensive care programs for multimorbid patients. Programs varied in the target patient groups, implementation settings, number of included interventions, and number of CCM components to which these interventions related. Moderate evidence was found for a beneficial effect of comprehensive care on inpatient healthcare utilization and healthcare costs, health behavior of patients, perceived quality of care, and satisfaction of patients and caregivers. Insufficient evidence was found for a beneficial effect of comprehensive care on health-related quality of life in terms of mental functioning, medication use, and outpatient healthcare utilization and healthcare costs. No evidence was found for a beneficial effect of comprehensive care on cognitive functioning, depressive symptoms, functional status, mortality, quality of life in terms of physical functioning, and caregiver burden. Because of the heterogeneity of comprehensive care programs, it is as yet too early to draw firm conclusions regarding their effectiveness. More rigorous evaluation studies are necessary to determine what constitutes best care for the increasing number of people with multiple chronic conditions. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Examining Guidelines for School-Based Breakfast Programs in Canada: A Systematic Review of the Grey Literature.

Science.gov (United States)

Godin, Katelyn M; Kirkpatrick, Sharon I; Hanning, Rhona M; Stapleton, Jackie; Leatherdale, Scott T

2017-06-01

School breakfast programs are widespread and serve varying objectives regarding youth health promotion. Evidence-based guidelines for breakfast programs may be important in maximizing their effectiveness related to student outcomes, yet it is unclear what is available in Canada. A systematic review was conducted to identify and compare Canadian guidelines related to breakfast programs. Data sources included grey literature databases, customized search engines, targeted websites, and content expert consultations. Eligible guidelines met the following criteria: government and nongovernment sources at the federal and provincial/territorial levels, current version, and intended for program coordinators. Recommendations for program delivery were extracted, categorized, and mapped onto the 4 environments outlined in the ANGELO framework, and they were classified as "common" or "inconsistent" across guidelines. Fifteen sets of guidelines were included. No guidelines were available from federal or territorial governments and 4 provincial governments. There were few references to peer-reviewed literature within the guidelines and despite many common recommendations for program delivery, conflicting recommendations were also identified. Potential barriers to program participation, including a lack of consideration of allergies and other dietary restrictions, were identified. Future research should identify how guidelines are implemented and evaluate what effect their implementation has on program delivery and student outcomes.

Hot Idea or Hot Air: A Systematic Review of Evidence for Two Widely Marketed Youth Suicide Prevention Programs and Recommendations for Implementation

Science.gov (United States)

Wei, Yifeng; Kutcher, Stan; LeBlanc, John C.

2015-01-01

Introduction: Youth suicide is highly related to mental disorders. While communities and schools are marketed to with a plethora of suicide prevention programs, they often lack the capacity to choose evidence-based programs. Methods: We conducted a systematic review of two youth suicide prevention programs to help determine if the quality of evidence available justifies their wide spread dissemination. We searched Medline, PsycINFO, EMBASE, CINAHL, the Cochrane Library, Campbell Collaboration SPECTR database, SocIndex, Sociological Abstracts, Social Services Abstracts, ERIC, Social Work Abstracts, Research Library, and Web of Science, for relevant studies. We included studies/systematic reviews/meta-analysis that evaluated the effectiveness, cost-effectiveness, and/or safety of Signs of Suicide (SOS) and Yellow Ribbon (YR) suicide prevention programs that target adolescents. We applied the Office of Justice Program What Works Repository (OJP-R) to evaluate the quality of the included studies as effective, effective with reservation, promising, inconclusive evidence, insufficient evidence, and ineffective. Two SOS studies were ranked as “inconclusive evidence” based on the OJP-R. One SOS study was ranked as having “insufficient evidence” on OJP-R. The YR study was ranked as “ineffective” using OJP-R. We only included studies in peer-reviewed journals in English and therefore may have missed reports in grey literature or non-English publications. Results: We cannot recommend that schools and communities implement either the SOS or YR suicide prevention programs. Purchasers of these programs should be aware that there is no evidence that their use prevents suicide. Conclusions: Academics and organizations should not overstate the positive impacts of suicide prevention interventions when the evidence is lacking. PMID:26336375

Maintenance procedure upgrade programs

International Nuclear Information System (INIS)

Campbell, J.J.; Zimmerman, C.M.

1988-01-01

This paper describes a systematic approach to upgrading nuclear power plant maintenance procedures. The approach consists of four phases: diagnosis, program planning, program implementation, and program evaluation. Each phase is explained as a series of steps to ensure that all factors in a procedure upgrade program are considered

The costs of critical care telemedicine programs: a systematic review and analysis.

Science.gov (United States)

Kumar, Gaurav; Falk, Derik M; Bonello, Robert S; Kahn, Jeremy M; Perencevich, Eli; Cram, Peter

2013-01-01

Implementation of telemedicine programs in ICUs (tele-ICUs) may improve patient outcomes, but the costs of these programs are unknown. We performed a systematic literature review to summarize existing data on the costs of tele-ICUs and collected detailed data on the costs of implementing a tele-ICU in a network of Veterans Health Administration (VHA) hospitals. We conducted a systematic review of studies published between January 1, 1990, and July 1, 2011, reporting costs of tele-ICUs. Studies were summarized, and key cost data were abstracted. We then obtained the costs of implementing a tele-ICU in a network of seven VHA hospitals and report these costs in light of the existing literature. Our systematic review identified eight studies reporting tele-ICU costs. These studies suggested combined implementation and first year of operation costs for a tele-ICU of $50,000 to $100,000 per monitored ICU-bed. Changes in patient care costs after tele-ICU implementation ranged from a $3,000 reduction to a $5,600 increase in hospital cost per patient. VHA data suggested a cost for implementation and first year of operation of $70,000 to $87,000 per ICU-bed, depending on the depreciation methods applied. The cost of tele-ICU implementation is substantial, and the impact of these programs on hospital costs or profits is unclear. Until additional data become available, clinicians and administrators should carefully weigh the clinical and economic aspects of tele-ICUs when considering investing in this technology.

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Evaluation of Data with Systematic Errors

International Nuclear Information System (INIS)

Froehner, F. H.

2003-01-01

Application-oriented evaluated nuclear data libraries such as ENDF and JEFF contain not only recommended values but also uncertainty information in the form of 'covariance' or 'error files'. These can neither be constructed nor utilized properly without a thorough understanding of uncertainties and correlations. It is shown how incomplete information about errors is described by multivariate probability distributions or, more summarily, by covariance matrices, and how correlations are caused by incompletely known common errors. Parameter estimation for the practically most important case of the Gaussian distribution with common errors is developed in close analogy to the more familiar case without. The formalism shows that, contrary to widespread belief, common ('systematic') and uncorrelated ('random' or 'statistical') errors are to be added in quadrature. It also shows explicitly that repetition of a measurement reduces mainly the statistical uncertainties but not the systematic ones. While statistical uncertainties are readily estimated from the scatter of repeatedly measured data, systematic uncertainties can only be inferred from prior information about common errors and their propagation. The optimal way to handle error-affected auxiliary quantities ('nuisance parameters') in data fitting and parameter estimation is to adjust them on the same footing as the parameters of interest and to integrate (marginalize) them out of the joint posterior distribution afterward

A Systematic Review of Life Skill Development Through Sports Programs Serving Socially Vulnerable Youth

NARCIS (Netherlands)

Hermens, N.J.; Super, Sabina; verkooijen, kirsten; Koelen, Maria

2017-01-01

Purpose: Despite the strong belief in sports programs as a setting in which socially vulnerable youth can develop life skills, no overview exists of life skill development in sports programs serving this youth group. Therefore, the present systematic review provides an overview of the evidence on

A Systematic Review of Life Skill Development Through Sports Programs Serving Socially Vulnerable Youth

NARCIS (Netherlands)

Hermens, Niels; Super, Sabina; Verkooijen, Kirsten T.; Koelen, Maria A.

2017-01-01

Despite the strong belief in sports programs as a setting in which socially vulnerable youth can develop life skills, no overview exists of life skill development in sports programs serving this youth group. Therefore, the present systematic review provides an overview of the evidence on life skill

[Uses and influence of health evaluation in two studies on the Brazilian National Dengue Fever Control Program].

Science.gov (United States)

Figueiró, Ana Cláudia; Hartz, Zulmira; Samico, Isabella; Cesse, Eduarda Angela Pessoa

2012-11-01

Evaluation aims to provide information, promote improvement in programs, and determine the merit and value of the object of evaluation. However, the challenge for evaluators is not only to promote, but also to document the usefulness of studies. Given this challenge, the article aimed to systematize the uses and influence of the process and findings in two evaluations on Brazilian National Dengue Fever Control Program, for decision-making by the respective public health administrators and professionals. Based on a theoretical analytical model, an exploratory study was performed with documental analysis for identification of events and registrations in the evaluations and their circulation in terms of possible uses and influence, from 2007 to 2010. Favorable factors for the use of evaluations were the mode of production of contextual knowledge and definition of evaluations with a focus on utility. The results, indicating greater instrumental use and immediate process and collective use may indicate the studies' pertinence to stakeholders and their usefulness to program management at different levels in the health system.

[Function of the present systematic evaluation in establishment of guidance for clinical practice].

Science.gov (United States)

Yang, Jin-Hong; Hu, Jing; Yang, Feng-Chun; Zhang, Ning; Wang, Bing; Li, Xin

2012-07-01

Treatment of insomnia with acupuncture is taken as an example to explore the significance and problems existed in the present systematic evaluation in establishment of guidance for clinical practice. Fifteen articles on systematic evaluation of both English and Chinese were retrieved and studied carefully, their basic information was analyzed. Through study on the establishing process of the guidance of clinical practice, researches were focused on the possible significance of the articles to the guidance as well as the notes in the reuse of those articles since problem still existed. It is held that the systematic evaluation has great significance on the establishment of the guidance from the aspects of applicable people, recommended standards of diagnosis and therapeutic evaluation, extended recommendation and methodology. Great importance should also be attached to the direct application of the research result and understanding of the evaluation result. The data should be rechecked when necessary. Great guiding function can be found on the systematic evaluation of articles to the guidance. Moreover, if information needed to be taken into a full play, specific analysis should also be done on the concrete research targets.

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Systematic safety evaluation of old nuclear power plants

International Nuclear Information System (INIS)

Dredemis, G.; Fourest, B.

1984-01-01

The French safety authorities have undertaken a systematic evaluation of the safety of old nuclear power plants. Apart from a complete revision of safety documents (safety analysis report, general operating rules, incident and accident procedures, internal emergency plan, quality organisation manual), this examination consisted of analysing the operating experience of systems frequently challenged and a systematic examination of the safety-related systems. This paper is based on an exercise at the Ardennes Nuclear Power Plant which has been in operation for 15 years. This paper also summarizes the main surveys and modifications relating to this power plant. (orig.)

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

Components of effective randomized controlled trials of hydrotherapy programs for fibromyalgia syndrome: A systematic review

Directory of Open Access Journals (Sweden)

Luke Perraton

2009-11-01

Full Text Available Luke Perraton, Zuzana Machotka, Saravana KumarInternational Centre for Allied Health Evidence, University of South Australia, Adelaide, South Australia, AustraliaAim: Previous systematic reviews have found hydrotherapy to be an effective management strategy for fibromyalgia syndrome (FMS. The aim of this systematic review was to summarize the components of hydrotherapy programs used in randomized controlled trials.Method: A systematic review of randomized controlled trials was conducted. Only trials that have reported significant FMS-related outcomes were included. Data relating to the components of hydrotherapy programs (exercise type, duration, frequency and intensity, environmental factors, and service delivery were analyzed.Results: Eleven randomized controlled trials were included in this review. Overall, the quality of trials was good. Aerobic exercise featured in all 11 trials and the majority of hydrotherapy programs included either a strengthening or flexibility component. Great variability was noted in both the environmental components of hydrotherapy programs and service delivery.Conclusions: Aerobic exercise, warm up and cool-down periods and relaxation exercises are common features of hydrotherapy programs that report significant FMS-related outcomes. Treatment duration of 60 minutes, frequency of three sessions per week and an intensity equivalent to 60%–80% maximum heart rate were the most commonly reported exercise components. Exercise appears to be the most important component of an effective hydrotherapy program for FMS, particularly when considering mental health-related outcomes.Keywords: hydrotherapy, fibromyalgia syndrome, exercise, effective, components

Regulatory licensing, status summary report; Systematic evaluation program

International Nuclear Information System (INIS)

1978-01-01

This document is part of a management information system presenting a logical flow of events that represent the evaluation of 11 of the older operating nuclear reactors. Information collected will be used to determine the degree to which the 11 plants meet current licensing requirements and to develop an overall balanced position concerning any needed backfitting of the facilities and the documentation of the results of such evaluations

Systematic Review of Health Economic Impact Evaluations of Risk Prediction Models : Stop Developing, Start Evaluating

NARCIS (Netherlands)

van Giessen, Anoukh; Peters, Jaime; Wilcher, Britni; Hyde, Chris; Moons, Carl; de Wit, Ardine; Koffijberg, Erik

2017-01-01

Background: Although health economic evaluations (HEEs) are increasingly common for therapeutic interventions, they appear to be rare for the use of risk prediction models (PMs). Objectives: To evaluate the current state of HEEs of PMs by performing a comprehensive systematic review. Methods: Four

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

A Programming Environment Evaluation Methodology for Object-Oriented Systems. Ph.D Thesis Final Report, 1 Jul. 1985 - 31 Dec. 1987

Science.gov (United States)

Dominick, Wayne D. (Editor); Moreau, Dennis R.

1987-01-01

The object-oriented design strategy as both a problem decomposition and system development paradigm has made impressive inroads into the various areas of the computing sciences. Substantial development productivity improvements have been demonstrated in areas ranging from artificial intelligence to user interface design. However, there has been very little progress in the formal characterization of these productivity improvements and in the identification of the underlying cognitive mechanisms. The development and validation of models and metrics of this sort require large amounts of systematically-gathered structural and productivity data. There has, however, been a notable lack of systematically-gathered information on these development environments. A large part of this problem is attributable to the lack of a systematic programming environment evaluation methodology that is appropriate to the evaluation of object-oriented systems.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

Energy Technology Data Exchange (ETDEWEB)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il [Korea Atomic Energy Research Institute, Daejeon (Korea, Republic of)

2015-10-15

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

International Nuclear Information System (INIS)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il

2015-01-01

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

A systematic review of the effectiveness of stroke self-management programs for improving function and participation outcomes: self-management programs for stroke survivors

NARCIS (Netherlands)

Warner, G.; Packer, T.L.; Villeneuve, M.; Audulv, A.; Versnel, J.

2015-01-01

PURPOSE: A systematic review of stroke self-management programs was conducted to: (i) identify how many and what self-management support strategies were included in stroke self-management interventions and (ii) describe whether self-management programs effectively improved outcomes, focusing

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Process variables in organizational stress management intervention evaluation research: a systematic review

NARCIS (Netherlands)

Havermans, B.M.; Schelvis, R.M.C.; Boot, C.R.L.; Brouwers, E.P.M.; Anema, J.R.; Beek, A.J. van der

2016-01-01

Objectives This systematic review aimed to explore which process variables are used in stress management intervention (SMI) evaluation research. Methods A systematic review was conducted using seven electronic databases. Studies were included if they reported on an SMI aimed at primary or secondary

Process variables in organizational stress management intervention evaluation research : A systematic review

NARCIS (Netherlands)

Havermans, B.M.; Schlevis, Roosmarijn Mc; Boot, Cécile Rl; Brouwers, E.P.M.; Anema, Johannes R; van der Beek, Allard J

2016-01-01

OBJECTIVES: This systematic review aimed to explore which process variables are used in stress management intervention (SMI) evaluation research. METHODS: A systematic review was conducted using seven electronic databases. Studies were included if they reported on an SMI aimed at primary or

Systematic Evaluation Program (SEP) at Rocky Flats Plant: An overview of practical management issues for evaluation of natural phenomena hazards

International Nuclear Information System (INIS)

Badwan, F.M.

1993-01-01

Many of the buildings at the Rocky Flats Plant were designed and built before modern standards were developed, including standards for protection against extreme natural phenomenon such as tornadoes, earthquakes, and floods. The purpose of the SEP is to establish an integrated approach to assessing the design adequacy of specific high and moderate hazard Rocky Flats facilities from a safety perspective and to establish a basis for defining any needed facility improvements. The SEP is to be carried out in three Phases. In Phase 1, topics to be evaluated and an evaluation plan for each topic were developed. Any differences between Current Design Requirements (CDR) or acceptance criteria and the design of existing facilities, will be identified during Phase 2 and assessed using an integrated systematic approach during Phase 3. The integrated assessment performed during Phase 3 provides a process for evaluating the differences between existing facility design and CDRs so that decisions on corrective actions can be made on the basis of relative risk reduction and cost effectiveness. These efforts will ensure that a balanced and integrated level of safety is achieved for long-term operation of these buildings. Through appropriate selection of topics and identification of the structures, systems, and components to be evaluated, the SEP will address outstanding design issues related to the prevention and mitigation of design basis accidents, including those arising from natural phenomena. The objective of the SEP is not to bring these buildings into strict compliance with current requirements, but rather to ensure that an adequate level of safety is achieved in an economical fashion

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

American Evaluation Association: Guiding Principles for Evaluators

Science.gov (United States)

American Journal of Evaluation, 2009

2009-01-01

The American Evaluation Association (AEA) strives to promote ethical practice in the evaluation of programs, products, personnel, and policy. This article presents the list of principles which AEA developed to guide evaluators in their professional practice. These principles are: (1) Systematic Inquiry; (2) Competence; (3) Integrity/Honesty; (4)…

Using the RE-AIM framework to evaluate physical activity public health programs in México.

Science.gov (United States)

Jauregui, Edtna; Pacheco, Ann M; Soltero, Erica G; O'Connor, Teresia M; Castro, Cynthia M; Estabrooks, Paul A; McNeill, Lorna H; Lee, Rebecca E

2015-02-19

Physical activity (PA) public health programming has been widely used in Mexico; however, few studies have documented individual and organizational factors that might be used to evaluate their public health impact. The RE-AIM framework is an evaluation tool that examines individual and organizational factors of public health programs. The purpose of this study was to use the RE-AIM framework to determine the degree to which PA programs in Mexico reported individual and organizational factors and to investigate whether reporting differed by the program's funding source. Public health programs promoting PA were systematically identified during 2008-2013 and had to have an active program website. Initial searches produced 23 possible programs with 12 meeting inclusion criteria. A coding sheet was developed to capture behavioral, outcome and RE-AIM indicators from program websites. In addition to targeting PA, five (42%) programs also targeted dietary habits and the most commonly reported outcome was change in body composition (58%). Programs reported an average of 11.1 (±3.9) RE-AIM indicator items (out of 27 total). On average, 45% reported reach indicators, 34% reported efficacy/effectiveness indicators, 60% reported adoption indicators, 40% reported implementation indicators, and 35% reported maintenance indicators. The proportion of RE-AIM indicators reported did not differ significantly for programs that were government supported (M = 10, SD = 3.1) and programs that were partially or wholly privately or corporately supported (M = 12.0, SD = 4.4). While reach and adoption of these programs were most commonly reported, there is a need for stronger evaluation of behavioral and health outcomes before the public health impact of these programs can be established.

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

A Systematic Review of the Effects of Continuing Education Programs on Providing Clinical Community Pharmacy Services

Science.gov (United States)

Marques dos Reis, Tiago; Guidoni, Camilo Molino; Girotto, Edmarlon; Guerra, Marisabelle Lima; de Oliveira Baldoni, André; Leira Pereira, Leonardo Régis

2016-01-01

Objective. To summarize the effects of media methods used in continuing education (CE) programs on providing clinical community pharmacy services and the methods used to evaluate the effectiveness of these programs. Methods. A systematic review was performed using Medline, SciELO, and Scopus databases. The timeline of the search was 1990 to 2013. Searches were conducted in English, Portuguese, and Spanish. Results. Nineteen articles of 3990 were included. Fourteen studies used only one media method, and the live method (n=11) was the most frequent (alone or in combination). Only two studies found that the CE program was ineffective or partially effective; these studies used only the live method. Most studies used nonrobust, nonvalidated, and nonstandardized methods to measure effectiveness. The majority of studies focused on the effect of the CE program on modifying the knowledge and skills of the pharmacists. One study assessed the CE program’s benefits to patients or clients. Conclusion. No evidence was obtained regarding which media methods are the most effective. Robust and validated methods, as well as assessment standardization, are required to clearly determine whether a particular media method is effective. PMID:27402991

Lessons learned using a values-engaged approach to attend to culture, diversity, and equity in a STEM program evaluation.

Science.gov (United States)

Boyce, Ayesha S

2017-10-01

Evaluation must attend meaningfully and respectfully to issues of culture, race, diversity, power, and equity. This attention is especially critical within the evaluation of science, technology, engineering, and mathematics (STEM) educational programming, which has an explicit agenda of broadening participation. The purpose of this article is to report lessons learned from the implementation of a values-engaged, educative (Greene et al., 2006) evaluation within a multi-year STEM education program setting. This meta-evaluation employed a case study design using data from evaluator weekly systematic reflections, review of evaluation and program artifacts, stakeholder interviews, and peer review and assessment. The main findings from this study are (a) explicit attention to culture, diversity, and equity was initially challenged by organizational culture and under-developed evaluator-stakeholder professional relationship and (b) evidence of successful engagement of culture, diversity, and equity emerged in formal evaluation criteria and documents, and informal dialogue and discussion with stakeholders. The paper concludes with lessons learned and implications for practice. Copyright © 2017 Elsevier Ltd. All rights reserved.

Open-Access Physical Activity Programs for Older Adults: A Pragmatic and Systematic Review.

Science.gov (United States)

Balis, Laura E; Strayer, Thomas; Ramalingam, NithyaPriya; Wilson, Meghan; Harden, Samantha M

2018-01-10

Open-access, community-based programs are recommended to assist older adults in meeting physical activity guidelines, but the characteristics, impact, and scalability of these programs is less understood. The Land-Grant University Cooperative Extension System, an organization providing education through county-based educators, functions as a delivery system for these programs. A systematic review was conducted to determine characteristics of effective older adult physical activity programs and the extent to which programs delivered in Extension employ these characteristics. A systematic review of peer-reviewed and grey literature was conducted from August 2016 to February 2017. The review was limited to open-access (available to all), community-based physical activity interventions for older adults (≥65 years of age). The peer-reviewed literature search was conducted in PubMed and EBSCOhost; the grey literature search for Extension interventions was conducted through Extension websites, Land-Grant Impacts, and the Journal of Extension. Sixteen peer-reviewed studies and 17 grey literature sources met inclusion criteria and were analyzed. Peer-reviewed and Extension programs were similar in their limited use of behavioral theories and group-based strategies. Compared to Extension programs, those in the peer-reviewed literature were more likely to use a combination of physical activity components and be delivered by trained professionals. The results indicate notable differences between peer-reviewed literature and Extension programs and present an opportunity for Extension programs to more effectively use evidence-based program characteristics, including behavioral theories and group dynamics, a combination of physical activity components, and educator/agent-trained delivery agents. © The Author(s) 2017. Published by Oxford University Press on behalf of The Gerontological Society of America. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Human Reliability Program Workshop

Energy Technology Data Exchange (ETDEWEB)

Landers, John; Rogers, Erin; Gerke, Gretchen

2014-05-18

A Human Reliability Program (HRP) is designed to protect national security as well as worker and public safety by continuously evaluating the reliability of those who have access to sensitive materials, facilities, and programs. Some elements of a site HRP include systematic (1) supervisory reviews, (2) medical and psychological assessments, (3) management evaluations, (4) personnel security reviews, and (4) training of HRP staff and critical positions. Over the years of implementing an HRP, the Department of Energy (DOE) has faced various challenges and overcome obstacles. During this 4-day activity, participants will examine programs that mitigate threats to nuclear security and the insider threat to include HRP, Nuclear Security Culture (NSC) Enhancement, and Employee Assistance Programs. The focus will be to develop an understanding of the need for a systematic HRP and to discuss challenges and best practices associated with mitigating the insider threat.

The Threat Effect of Active Labor Market Programs: A Systematic Review

DEFF Research Database (Denmark)

Filges, Trine; Hansen, Anne Toft

2017-01-01

This paper is a systematic review of the threat effect of active labor market programs for unemployed individuals. The threat effect is the induced change in the hazard rate of leaving unemployment prior to program participation. Studies included in the review all estimated a threat effect...... a hazard rate of 1.27 for the pooled estimate. It has thus been concluded that active labor market programs constitute a significant threat effect......., with the participants in all cases being unemployed individuals in receipt of benefit of some kind during their tenure of unemployment. Seven of these studies have been included in a meta-analysis: The meta-analysis, which has been carried out using a random effects model to account for heterogeneity, indicated...

Peer-led nutrition education programs for school-aged youth: a systematic review of the literature.

Science.gov (United States)

Yip, Calvin; Gates, Michelle; Gates, Allison; Hanning, Rhona M

2016-02-01

To date, the impacts of school-based, peer-led nutrition education initiatives have not been summarized or assessed collectively. This review presents the current evidence, identifies knowledge gaps, and provides recommendations for future research. PubMed, Scopus, ERIC and Google Scholar were searched for refereed Canadian and American primary studies published between January 2000 and November 2013, following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Seventeen articles (11 programs) from Canada (24%) and the United States (76%) were identified. The results were summarized in terms of the study population, program design and main outcomes. Common outcome measures included healthy eating knowledge (n = 5), self-efficacy or attitudes towards healthy eating (n = 13), dietary measures (n = 9) and body mass index (n = 4), all of which tended to improve as a result of the programs. More research is needed to ascertain the effect of improvements in knowledge, self-efficacy and attitudes towards healthy eating on food behaviors. When evaluated, programs were generally well received, while the long-term maintenance of positive impacts was a challenge. Studies of sustainability and feasibility to promote long-term impact are a logical next step. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Project evaluation and selection using fuzzy Delphi method and zero - one goal programming

Science.gov (United States)

Alias, Suriana; Adna, Nofarziah; Arsad, Roslah; Soid, Siti Khuzaimah; Ali, Zaileha Md

2014-12-01

Project evaluation and selection is a factor affecting the impotence of board director in which is trying to maximize all the possible goals. Assessment of the problem occurred in organization plan is the first phase for decision making process. The company needs a group of expert to evaluate the problems. The Fuzzy Delphi Method (FDM) is a systematic procedure to evoke the group's opinion in order to get the best result to evaluate the project performance. This paper proposes an evaluation and selection of the best alternative project based on combination of FDM and Zero - One Goal Programming (ZOGP) formulation. ZOGP is used to solve the multi-criteria decision making for final decision part by using optimization software LINDO 6.1. An empirical example on an ongoing decision making project in Johor, Malaysia is implemented for case study.

Selective prevention programs for children from substance-affected families: a comprehensive systematic review

Directory of Open Access Journals (Sweden)

Bröning Sonja

2012-06-01

Full Text Available Abstract Children from substance-affected families show an elevated risk for developing own substance-related or other mental disorders. Therefore, they are an important target group for preventive efforts. So far, such programs for children of substance-involved parents have not been reviewed together. We conducted a comprehensive systematic review to identify and summarize evaluations of selective preventive interventions in childhood and adolescence targeted at this specific group. From the overall search result of 375 articles, 339 were excluded, 36 full texts were reviewed. From these, nine eligible programs documented in 13 studies were identified comprising four school-based interventions (study 1–6, one community-based intervention (study 7–8, and four family-based interventions (study 9–13. Studies’ levels of evidence were rated in accordance with the Scottish Intercollegiate Guidelines Network (SIGN methodology, and their quality was ranked according to a score adapted from the area of meta-analytic family therapy research and consisting of 15 study design quality criteria. Studies varied in program format, structure, content, and participants. They also varied in outcome measures, results, and study design quality. We found seven RCT’s, two well designed controlled or quasi-experimental studies, three well-designed descriptive studies, and one qualitative study. There was preliminary evidence for the effectiveness of the programs, especially when their duration was longer than ten weeks and when they involved children’s, parenting, and family skills training components. Outcomes proximal to the intervention, such as program-related knowledge, coping-skills, and family relations, showed better results than more distal outcomes such as self-worth and substance use initiation, the latter due to the comparably young age of participants and sparse longitudinal data. However, because of the small overall number of studies found

School-based depression and anxiety prevention programs for young people: A systematic review and meta-analysis.

Science.gov (United States)

Werner-Seidler, Aliza; Perry, Yael; Calear, Alison L; Newby, Jill M; Christensen, Helen

2017-02-01

Depression and anxiety often emerge for the first time during youth. The school environment provides an ideal context to deliver prevention programs, with potential to offset the trajectory towards disorder. The aim of this review was to provide a comprehensive evaluation of randomised-controlled trials of psychological programs, designed to prevent depression and/or anxiety in children and adolescents delivered in school settings. Medline, PsycINFO and the Cochrane Library were systematically searched for articles published until February 2015. Eighty-one unique studies comprising 31,794 school students met inclusion criteria. Small effect sizes for both depression (g=0.23) and anxiety (g=0.20) prevention programs immediately post-intervention were detected. Small effects were evident after 12-month follow-up for both depression (g=0.11) and anxiety (g=0.13). Overall, the quality of the included studies was poor, and heterogeneity was moderate. Subgroup analyses suggested that universal depression prevention programs had smaller effect sizes at post-test relative to targeted programs. For anxiety, effect sizes were comparable for universal and targeted programs. There was some evidence that externally-delivered interventions were superior to those delivered by school staff for depression, but not anxiety. Meta-regression confirmed that targeted programs predicted larger effect sizes for the prevention of depression. These results suggest that the refinement of school-based prevention programs have the potential to reduce mental health burden and advance public health outcomes. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Antimicrobial resistance programs in canada 1995-2010: a critical evaluation

Directory of Open Access Journals (Sweden)

Conly John M

2012-02-01

Full Text Available Abstract Background In Canada, systematic efforts for controlling antibiotic resistance began in 1997 following a national Consensus Conference. The Canadian strategy produced 27 recommendations, one of which was the formation of the Canadian Committee on Antibiotic Resistance (CCAR. In addition several other organizations began working on a national or provincial basis over the ensuing years on one or more of the 3 identified core areas of the strategy. Critical evaluation of the major programs within Canada which focused on antimicrobial resistance and the identified core components has not been previously conducted. Findings Data was collected from multiple sources to determine the components of four major AMR programs that were considered national based on their scope or in the delivery of their mandates. Assessment of program components was adapted from the report from the International Forum on Antibiotic Resistance colloquium. Most of the programs used similar tools but only the Do Bugs Need Drugs Program (DBND had components directed towards day cares and schools. Surveillance programs for antimicrobial resistant pathogens have limitations and/or significant sources of bias. Overall, there has been a 25.3% decrease in oral antimicrobial prescriptions in Canada since 1995, mainly due to decreases in β lactams, sulphonamides and tetracyclines in temporal association with multiple programs with the most comprehensive and sustained national programs being CCAR and DBND. Conclusions Although there has been a substantial decrease in oral antimicrobial prescriptions in Canada since 1995, there remains a lack of leadership and co-ordination of antimicrobial resistance activities.

A prequalifying program for evaluating the analytical performance of commercial laboratories

International Nuclear Information System (INIS)

Reith, C.C.; Bishop, C.T.

1987-01-01

Soil and water samples were spiked with known activities of radionuclides and sent to seven commercial laboratories that had expressed an interest in analyzing environmental samples for the Waste Isolation Pilot Plant (WIPP). This Prequalifying Program was part of the selection process for an analytical subcontractor for a three-year program of baseline radiological surveillance around the WIPP site. Both media were spiked at three different activity levels with several transuranic radionuclides, as well as tritium, fission products, and activation products. Laboratory performance was evaluated by calculating relative error for each radionuclide in each sample, assigning grade values, and compiling grades into report cards for each candidate. Results for the five laboratories completing the Prequalifying Program were pooled to reveal differing degrees of difficulty among the treatments and radionuclides. Interlaboratory comparisons revealed systematic errors in the performance of one candidate. The final report cards contained clear differences among overall grades for the five laboratories, enabling analytical performance to be used as a quantitative criterion in the selection of an analytical subcontractor. (author)

Neurolinguistic programming: a systematic review of the effects on health outcomes

Science.gov (United States)

Sturt, Jackie; Ali, Saima; Robertson, Wendy; Metcalfe, David; Grove, Amy; Bourne, Claire; Bridle, Chris

2012-01-01

Background Neurolinguistic programming (NLP) in health care has captured the interest of doctors, healthcare professionals, and managers. Aim To evaluate the effects of NLP on health-related outcomes. Design and setting Systematic review of experimental studies. Method The following data sources were searched: MEDLINE®, PsycINFO, ASSIA, AMED, CINAHL®, Web of Knowledge, CENTRAL, NLP specialist databases, reference lists, review articles, and NLP professional associations, training providers, and research groups. Results Searches revealed 1459 titles from which 10 experimental studies were included. Five studies were randomised controlled trials (RCTs) and five were pre-post studies. Targeted health conditions were anxiety disorders, weight maintenance, morning sickness, substance misuse, and claustrophobia during MRI scanning. NLP interventions were mainly delivered across 4–20 sessions although three were single session. Eighteen outcomes were reported and the RCT sample sizes ranged from 22 to 106. Four RCTs reported no significant between group differences with the fifth finding in favour of the NLP arm (F = 8.114, Peffect. There is currently insufficient evidence to support the allocation of NHS resources to NLP activities outside of research purposes. PMID:23211179

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

Science.gov (United States)

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

Systematic evaluations of probabilistic floor response spectrum generation

International Nuclear Information System (INIS)

Lilhanand, K.; Wing, D.W.; Tseng, W.S.

1985-01-01

The relative merits of the current methods for direct generation of probabilistic floor response spectra (FRS) from the prescribed design response spectra (DRS) are evaluated. The explicit probabilistic methods, which explicitly use the relationship between the power spectral density function (PSDF) and response spectra (RS), i.e., the PSDF-RS relationship, are found to have advantages for practical applications over the implicit methods. To evaluate the accuracy of the explicit methods, the root-mean-square (rms) response and the peak factor contained in the PSDF-RS relationship are systematically evaluated, especially for the narrow-band floor spectral response, by comparing the analytical results with simulation results. Based on the evaluation results, a method is recommended for practical use for the direct generation of probabilistic FRS. (orig.)

[Systematic economic assessment and quality evaluation for traditional Chinese medicines].

Science.gov (United States)

Sun, Xiao; Guo, Li-ping; Shang, Hong-cai; Ren, Ming; Lei, Xiang

2015-05-01

To learn about the economic studies on traditional Chinese medicines in domestic literatures, in order to analyze the current economic assessment of traditional Chinese medicines and explore the existing problems. Efforts were made to search CNKI, VIP, Wanfang database and CBM by computer and include all literatures about economic assessment of traditional Chinese medicines published on professional domestic journals in the systematic assessment and quality evaluation. Finally, 50 articles were included in the study, and the systematic assessment and quality evaluation were made for them in terms of titles, year, authors' identity, expense source, disease type, study perspective, study design type, study target, study target source, time limit, cost calculation, effect indicator, analytical technique and sensitivity analysis. The finally quality score was 0.74, which is very low. The results of the study showed insufficient studies on economics of traditional Chinese medicines, short study duration and simple evaluation methods, which will be solved through unremitting efforts in the future.

The effectiveness of assertiveness communication training programs for healthcare professionals and students: A systematic review.

Science.gov (United States)

Omura, Mieko; Maguire, Jane; Levett-Jones, Tracy; Stone, Teresa Elizabeth

2017-11-01

Communication errors have a negative impact on patient safety. It is therefore essential that healthcare professionals have the skills and confidence to speak up assertively when patient safety is at risk. Although the facilitators to and barriers of assertive communication have been the subject of previous reviews, evidence regarding the effectiveness of interventions designed to enhance assertive communication is lacking. Thus, this paper reports the findings from a systematic review of the effectiveness of assertiveness communication training programs for healthcare professionals and students. The objective of this review is to identify, appraise and synthesise the best available quantitative evidence in relation to the effectiveness of assertiveness communication training programs for healthcare professionals and students on levels of assertiveness, communication competence and impact on clinicians' behaviours and patient safety. The databases included: CINAHL, Cochrane library, EMBASE, Informit health collection, MEDLINE, ProQuest nursing and allied health, PsycINFO, Scopus and Web of Science. The search for unpublished studies included: MedNar, ProQuest Dissertations & Theses A&I. Studies published in English from 2001 until 2016 inclusive were considered. The review included original quantitative research that evaluated (a) any type of independent assertiveness communication training program; and (b) programs with assertiveness training included as a core component of team skills or communication training for healthcare professionals and students, regardless of healthcare setting and level of qualification of participants. Studies selected based on eligibility criteria were assessed for methodological quality and the data were extracted by two independent researchers using the Joanna Briggs Institute critical appraisal and data extraction tools. Eleven papers were critically appraised using the Joanna Briggs Institute critical appraisal checklists. Eight

An Evaluation of State Energy Program Accomplishments: 2002 Program Year

Energy Technology Data Exchange (ETDEWEB)

Schweitzer, M.

2005-07-13

cost savings and emissions reductions associated with SEP activities performed by the states during the 2002 program year, based on primary data provided by the states themselves. This is the second systematic evaluation of SEP accomplishments performed by Oak Ridge National Laboratory (ORNL) for DOE. A report documenting the findings of the first study was published in January 2003 (Schweitzer et.al., 2003).

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Evaluating clinical ethics support in mental healthcare: a systematic literature review.

NARCIS (Netherlands)

Hem, M.H.; Pedersen, R.; Norvoll, R.; Molewijk, A.C.

2015-01-01

A systematic literature review on evaluation of clinical ethics support services in mental healthcare is presented and discussed. The focus was on (a) forms of clinical ethics support services, (b) evaluation of clinical ethics support services, (c) contexts and participants and (d) results. Five

[Ethic evaluation of sexual health programs on adolescence].

Science.gov (United States)

Jara Rascón, José; Alonso Sandoica, Esmeralda

2011-01-01

In public health services, the interest in sexuality seems to turning from traditional topics such as potential treatments for male erectile dysfunction, psychosomatic disorders, the control of premature ejaculation and contraception. Instead, an increasingly prominent role is being given to prevention strategies carried out by means of campaigns or through sexual health programme sin schools. The different teaching strategies that underlie these programmes, which in many cases lack social consensus but are often promoted by international organizations such as WHO or UNESCO, reveal not only divergent ethical conceptions and worldviews on the meaning of sexuality, but also conflicting starting points, means and goals, focusing either on barrier-contraceptive methods or on sexual abstinence and personal responsibility. There is therefore a pressing need to understand the scientific evidence underlying each educational approach and the ethical postulates of each pedagogical proposal. This paper presents an outline of a six-point adolescent sexuality education program, which is respectful of individuals' ethical convictions. Given that few works on preventive medicine issues include an ethical evaluation of the steps followed in their development, this article also proposes a systematic evaluation of strategies for sexual health in the community that is developed through four steps verifying the following aspects: 1) the accuracy of information, 2) the level of evidence, 3) efficiency and 4) non-maleficence about the target population of each health program. The methodology used in these sexual health programs is another aspect that will verify their ethical consistence or, conversely, their absence of ethical values. We emphasize the duty of designers of programme for children not to carry then out against the will of their parents or tutors, and not conceal sensitive and relevant information.

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Economic evaluation of HIV pre-exposure prophylaxis strategies: protocol for a methodological systematic review and quantitative synthesis.

Science.gov (United States)

Thavorn, Kednapa; Kugathasan, Howsikan; Tan, Darrell H S; Moqueet, Nasheed; Baral, Stefan D; Skidmore, Becky; MacFadden, Derek; Simkin, Anna; Mishra, Sharmistha

2018-03-15

Pre-exposure prophylaxis (PrEP) with antiretrovirals is an efficacious and effective intervention to decrease the risk of HIV (human immunodeficiency virus) acquisition. Yet drug and delivery costs prohibit access in many jurisdictions. In the absence of guidelines for the synthesis of economic evaluations, we developed a protocol for a systematic review of economic evaluation studies for PrEP by drawing on best practices in systematic reviews and the conduct and reporting of economic evaluations. We aim to estimate the incremental cost per health outcome of PrEP compared with placebo, no PrEP, or other HIV prevention strategies; assess the methodological variability in, and quality of, economic evaluations of PrEP; estimate the incremental cost per health outcome of different PrEP implementation strategies; and quantify the potential sources of heterogeneity in outcomes. We will systematically search electronic databases (MEDLINE, Embase) and the gray literature. We will include economic evaluation studies that assess both costs and health outcomes of PrEP in HIV-uninfected individuals, without restricting language or year of publication. Two reviewers will independently screen studies using predefined inclusion criteria, extract data, and assess methodological quality using the Philips checklist, Second Panel on the Cost-effectiveness of Health and Medicines, and the International Society for Pharmacoeconomics and Outcomes Research recommendations. Outcomes of interest include incremental costs and outcomes in natural units or utilities, cost-effectiveness ratios, and net monetary benefit. We will perform descriptive and quantitative syntheses using sensitivity analyses of outcomes by population subgroups, HIV epidemic settings, study designs, baseline intervention contexts, key parameter inputs and assumptions, type of outcomes, economic perspectives, and willingness to pay values. Findings will guide future economic evaluation of PrEP strategies in terms of

Environmental scan and evaluation of best practices for online systematic review resources.

Science.gov (United States)

Parker, Robin M N; Boulos, Leah M; Visintini, Sarah; Ritchie, Krista; Hayden, Jill

2018-04-01

Online training for systematic review methodology is an attractive option due to flexibility and limited availability of in-person instruction. Librarians often direct new reviewers to these online resources, so they should be knowledgeable about the variety of available resources. The objective for this project was to conduct an environmental scan of online systematic review training resources and evaluate those identified resources. The authors systematically searched for electronic learning resources pertaining to systematic review methods. After screening for inclusion, we collected data about characteristics of training resources and assigned scores in the domains of (1) content, (2) design, (3) interactivity, and (4) usability by applying a previously published evaluation rubric for online instruction modules. We described the characteristics and scores for each training resource and compared performance across the domains. Twenty training resources were evaluated. Average overall score of online instructional resources was 61%. Online courses (n=7) averaged 73%, web modules (n=5) 64%, and videos (n=8) 48%. The top 5 highest scoring resources were in course or web module format, featured high interactivity, and required a longer (>5hrs) time commitment from users. This study revealed that resources include appropriate content but are less likely to adhere to principles of online training design and interactivity. Awareness of these resources will allow librarians to make informed recommendations for training based on patrons' needs. Future online systematic review training resources should use established best practices for e-learning to provide high-quality resources, regardless of format or user time commitment.

Palliative care education in Latin America: A systematic review of training programs for healthcare professionals.

Science.gov (United States)

Vindrola-Padros, Cecilia; Mertnoff, Rosa; Lasmarias, Cristina; Gómez-Batiste, Xavier

2018-02-01

The integration of palliative care (PC) education into medical and nursing curricula has been identified as an international priority. PC education has undergone significant development in Latin America, but gaps in the integration of PC courses into undergraduate and postgraduate curricula remain. The aim of our review was to systematically examine the delivery of PC education in Latin America in order to explore the content and method of delivery of current PC programs, identify gaps in the availability of education opportunities, and document common barriers encountered in the course of their implementation. We carried out a systematic review of peer-reviewed academic articles and grey literature. Peer-reviewed articles were obtained from the following databases: CINAHL Plus, Embase, the Web of Science, and Medline. Grey literature was obtained from the following directories: the International Association for Hospice and Palliative Care's Global Directory of Education in Palliative Care, the Worldwide Hospice Palliative Care Alliance's lists of palliative care resources, the Latin American Association for Palliative Care's training resources, and the Latin American Atlas of Palliative Care. The inclusion criteria were that the work: (1) focused on describing PC courses; (2) was aimed at healthcare professionals; and (3) was implemented in Latin America. The PRISMA checklist was employed to guide the reporting of methods and findings. We found 36 programs that were delivered in 8 countries. Most of the programs were composed of interdisciplinary teams, taught at a postgraduate level, focused on pain and symptom management, and utilized classroom-based methods. The tools for evaluating the courses were rarely reported. The main barriers during implementation included: a lack of recognition of the importance of PC education, a lack of funding, and the unavailability of trained teaching staff. Considerable work needs to be done to improve the delivery of PC

The impact of residency programs on new nurse graduates' clinical decision-making and leadership skills: a systematic review.

Science.gov (United States)

AL-Dossary, Reem; Kitsantas, Panagiota; Maddox, P J

2014-06-01

Health care institutions have adapted residency programs to help new graduate nurses to become fully competent and transition from a student nurse to an independent practicing nurse and a bedside leader. The study's aim is to review the literature on the impact of residency programs on new graduate nurses' clinical decision-making and leadership skills. An electronic search was conducted between 1980 and 2013 using databases of the scientific literature in Medline, PubMed, Cochrane EPOC, Cumulative Index to Nursing & Allied Health Literature database guide (CINAHL), and PsychInfo using a range of keywords. Information gathered was evaluated for relevance. Thirteen studies that met the inclusion criteria were used in this systematic review. In several studies considered in this review, residency programs were developed to improve new graduates skills and promote their transition into the nursing workforce. In fact, the transition programs reduced turnover in that first year of practice and promoted professional growth of the new graduate such as hand-on nursing skills, clinical decision-making and leadership skills, satisfaction, and retention. There is a need for effective residency programs that are designed to prepare new graduate nurses in providing safe, competent and effective patient care. © 2013.

Economic Evaluation of Combined Diet and Physical Activity Promotion Programs to Prevent Type 2 Diabetes Among Persons at Increased Risk: A Systematic Review for the Community Preventive Services Task Force

Science.gov (United States)

Li, Rui; Qu, Shuli; Zhang, Ping; Chattopadhyay, Sajal; Gregg, Edward W.; Albright, Ann; Hopkins, David; Pronk, Nicolaas P.

2016-01-01

Background Diabetes is a highly prevalent and costly disease. Studies indicate that combined diet and physical activity promotion programs can prevent type 2 diabetes among persons at increased risk. Purpose To systematically evaluate the evidence on cost, cost-effectiveness, and cost-benefit estimates of diet and physical activity promotion programs. Data Sources Cochrane Library, EMBASE, MEDLINE, PsycINFO, Sociological Abstracts, Web of Science, EconLit, and CINAHL through 7 April 2015. Study Selection English-language studies from high-income countries that provided data on cost, cost-effectiveness, or cost-benefit ratios of diet and physical activity promotion programs with at least 2 sessions over at least 3 months delivered to persons at increased risk for type 2 diabetes. Data Extraction Dual abstraction and assessment of relevant study details. Data Synthesis Twenty-eight studies were included. Costs were expressed in 2013 U.S. dollars. The median program cost per participant was $653. Costs were lower for group-based programs (median, $417) and programs implemented in community or primary care settings (median, $424) than for the U.S. DPP (Diabetes Prevention Program) trial and the DPP Outcomes Study ($5881). Twenty-two studies assessed the incremental cost-effectiveness ratios (ICERs) of the programs. From a health system perspective, 16 studies reported a median ICER of $13 761 per quality-adjusted life-year (QALY) saved. Group-based programs were more cost-effective (median, $1819 per QALY) than those that used individual sessions (median, $15 846 per QALY). No cost-benefit studies were identified. Limitation Information on recruitment costs and cost-effectiveness of translational programs implemented in community and primary care settings was limited. Conclusion Diet and physical activity promotion programs to prevent type 2 diabetes are cost-effective among persons at increased risk. Costs are lower when programs are delivered to groups in community

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Test and evaluation about damping characteristics of hanger supports for nuclear power plant piping systems (Seismic Damping Ratio Evaluation Program)

International Nuclear Information System (INIS)

Shibata, H.; Ito, A.; Tanaka, K.; Niino, T.; Gotoh, N.

1981-01-01

Generally, damping phenomena of structures and equipments is caused by very complex energy dissipation. Especially, as piping systems are composed of many components, it is very difficult to evaluate damping characteristics of its system theoretically. On the other hand, the damping value for aseismic design of nuclear power plants is very important design factor to decide seismic response loads of structures, equipments and piping systems. The very extensive studies titled SDREP (Seismic Damping Ratio Evaluation Program) were performed to establish proper damping values for seismic design of piping as a joint work among a university, electric companies and plant makers. In SDREP, various systematic vibration tests were conducted to investigate factors which may contribute to damping characteristics of piping systems and to supplement the data of the pre-operating tests. This study is related to the component damping characteristics tests of that program. The object of this study is to clarify damping characteristics and mechanism of hanger supports used in piping systems, and to establish the evaluation technique of dispersing energy at hanger support points and its effect to the total damping ability of piping system. (orig./WL)

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Error evaluation method for material accountancy measurement. Evaluation of random and systematic errors based on material accountancy data

International Nuclear Information System (INIS)

Nidaira, Kazuo

2008-01-01

International Target Values (ITV) shows random and systematic measurement uncertainty components as a reference for routinely achievable measurement quality in the accountancy measurement. The measurement uncertainty, called error henceforth, needs to be periodically evaluated and checked against ITV for consistency as the error varies according to measurement methods, instruments, operators, certified reference samples, frequency of calibration, and so on. In the paper an error evaluation method was developed with focuses on (1) Specifying clearly error calculation model, (2) Getting always positive random and systematic error variances, (3) Obtaining probability density distribution of an error variance and (4) Confirming the evaluation method by simulation. In addition the method was demonstrated by applying real data. (author)

Qualitative Evaluation Methods in Ethics Education: A Systematic Review and Analysis of Best Practices.

Science.gov (United States)

Watts, Logan L; Todd, E Michelle; Mulhearn, Tyler J; Medeiros, Kelsey E; Mumford, Michael D; Connelly, Shane

2017-01-01

Although qualitative research offers some unique advantages over quantitative research, qualitative methods are rarely employed in the evaluation of ethics education programs and are often criticized for a lack of rigor. This systematic review investigated the use of qualitative methods in studies of ethics education. Following a review of the literature in which 24 studies were identified, each study was coded based on 16 best practices characteristics in qualitative research. General thematic analysis and grounded theory were found to be the dominant approaches used. Researchers are effectively executing a number of best practices, such as using direct data sources, structured data collection instruments, non-leading questioning, and expert raters. However, other best practices were rarely present in the courses reviewed, such as collecting data using multiple sources, methods, raters, and timepoints, evaluating reliability, and employing triangulation analyses to assess convergence. Recommendations are presented for improving future qualitative research studies in ethics education.

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

Economic evaluation of HBV vaccination: A systematic review of recent publications (2000-2013).

Science.gov (United States)

La Torre, Giuseppe; Mannocci, Alice; Saulle, Rosella; Colamesta, Vittoria; Meggiolaro, Angela; Mipatrini, Daniele; Sinopoli, Alessandra

2016-09-01

To conduct a systematic review of the economic evaluations (EE) of HBV vaccination, taking also into account the studies published in the new millennium. An extensive scientific literature review was conducted using two electronic medical journal databases: Scopus and PubMed engines for published studies on EE of HBV vaccination. 22 articles were reviewed, 9, 5 and 8 cost-effectiveness, cost-benefit and cost-utility analysis, respectively. Studies were mainly concerning EE of universal vaccination (UV), mostly with regards to low or low-medium income countries. For high income countries, EE were focused on the possible implementation of HBV vaccination in particular settings, such as diabetic, renal and other chronic conditions care, as well as infectious diseasesUV has usually a very good cost-effectiveness ratio (80%), ranging from cost-saving (China) or few Euro per LY/QALY gained (in Thailand, and Vietnam) to 630.00$/QALY in USA (Asian and Pacific Islands) Moreover, EE of HBV vaccination are favorable in the infectious diseases field as well as for chronic conditions. In relation to diabetes the studies gave controversial results. This systematic review highlighted the importance of introducing HBV vaccination not only for infant UV program but also for other settings in which patients are people affected by communicable and non-communicable diseases.

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

The evaluation of multi-element personal dosemeters using the linear programming method

International Nuclear Information System (INIS)

Kragh, P.; Ambrosi, P.; Boehm, J.; Hilgers, G.

1996-01-01

Multi-element dosemeters are frequently used in individual monitoring. Each element can be regarded as an individual dosemeter with its own individual dose measurement value. In general, the individual dose values of one dosemeter vary according to the exposure conditions, i. e. the energy and angle of incidence of the radiation. The (final) dose measurement value of the personal dosemeter is calculated from the individual dose values by means of an evaluation algorithm. The best possible dose value, i.e. that of the smallest systematic (type B) uncertainty if the exposure conditions are changed in the dosemeter's rated range of use, is obtained by the method of linear programming. (author)

Systematic review automation technologies

Science.gov (United States)

2014-01-01

Systematic reviews, a cornerstone of evidence-based medicine, are not produced quickly enough to support clinical practice. The cost of production, availability of the requisite expertise and timeliness are often quoted as major contributors for the delay. This detailed survey of the state of the art of information systems designed to support or automate individual tasks in the systematic review, and in particular systematic reviews of randomized controlled clinical trials, reveals trends that see the convergence of several parallel research projects. We surveyed literature describing informatics systems that support or automate the processes of systematic review or each of the tasks of the systematic review. Several projects focus on automating, simplifying and/or streamlining specific tasks of the systematic review. Some tasks are already fully automated while others are still largely manual. In this review, we describe each task and the effect that its automation would have on the entire systematic review process, summarize the existing information system support for each task, and highlight where further research is needed for realizing automation for the task. Integration of the systems that automate systematic review tasks may lead to a revised systematic review workflow. We envisage the optimized workflow will lead to system in which each systematic review is described as a computer program that automatically retrieves relevant trials, appraises them, extracts and synthesizes data, evaluates the risk of bias, performs meta-analysis calculations, and produces a report in real time. PMID:25005128

System for the quality assurance of personnel training programs

International Nuclear Information System (INIS)

Rjona, Orison; Venegas, Maria del C.; Rodriguez, Lazaro; Lopez, Miguel A.; Armenteros, Ana L.

1999-01-01

In this work are described the fundamental possibilities and characteristics of a software that allows to carry out the management and automatic evaluation of all data gotten during jobs analysis and design, development, implementation and evaluation of personnel training programs of nuclear and radioactive installations and risk industries. The system that is introduced, GESAT, proportion a tool of centralized managerial control of training data and the obtaining of the quality objectives of each installation in the training of their personnel. GESAT includes all phases of SAT method (Systematic Approach to Training). It constitutes the necessary practical support for the elaboration, implementation and evaluation of training programs, allowing the establishment of restrictions and controls and avoiding inconsistencies in the process. It offers the possibility of automatic evaluation that identify fundamental deficiencies in the planning and implementation of training programs. This evaluation facilitates the systematic feed back and the continuous improvement of the training programs.(author)

Economic Evaluation of Community-Based HIV Prevention Programs in Ontario: Evidence of Effectiveness in Reducing HIV Infections and Health Care Costs.

Science.gov (United States)

Choi, Stephanie K Y; Holtgrave, David R; Bacon, Jean; Kennedy, Rick; Lush, Joanne; McGee, Frank; Tomlinson, George A; Rourke, Sean B

2016-06-01

Investments in community-based HIV prevention programs in Ontario over the past two and a half decades are assumed to have had an impact on the HIV epidemic, but they have never been systematically evaluated. To help close this knowledge gap, we conducted a macro-level evaluation of investment in Ontario HIV prevention programs from the payer perspective. Our results showed that, from 1987 to 2011, province-wide community-based programs helped to avert a total of 16,672 HIV infections, saving Ontario's health care system approximately $6.5 billion Canadian dollars (range 4.8-7.5B). We also showed that these community-based HIV programs were cost-saving: from 2005 to 2011, every dollar invested in these programs saved about $5. This study is an important first step in understanding the impact of investing in community-based HIV prevention programs in Ontario and recognizing the impact that these programs have had in reducing HIV infections and health care costs.

Economic evaluation studies in reproductive medicine: a systematic review of methodologic quality

NARCIS (Netherlands)

Moolenaar, Lobke M.; Vijgen, Sylvia M. C.; Hompes, Peter; van der Veen, Fulco; Mol, Ben Willem J.; Opmeer, Brent C.

2013-01-01

To evaluate the methodologic quality of economic analyses published in the field of reproductive medicine. Systematic review. Centers for reproductive care. Infertility patients. We performed a Medline search to identify economic evaluation studies in reproductive medicine. We included studies that

Clinical diagnostic evaluation for scaphoid fractures: a systematic review and meta-analysis

NARCIS (Netherlands)

Mallee, Wouter H.; Henny, Erik P.; van Dijk, C. Niek; Kamminga, Sjoerd P.; van Enst, Wynanda A.; Kloen, Peter

2014-01-01

To provide an overview of available clinical evaluation tests for scaphoid fractures and to compare their diagnostic accuracies. PWe performed a systematic review of all studies assessing diagnostic characteristics of clinical evaluation in scaphoid fractures by searching MEDLINE, EMBASE, Cochrane,

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Dietary program and physical activity impact on biochemical markers in patients with type 2 diabetes: A systematic review.

Science.gov (United States)

Barreira, Eduarda; Novo, André; Vaz, Josiana A; Pereira, Ana M G

2017-10-21

Evaluate the effectiveness of the implementation of independently or combined dietary and physical activity programs on the blood glucose values and lipid profile in patients with type 2 diabetes, including participants aged 60 years and over. Systematic review. PubMed/Medline database, with language restrictions. Papers published between 2010 and 2016 were included. A total of 30 randomised controlled trials were included that focused on physical activity and dietary interventions in patients with type 2 diabetes mellitus and include participants aged 60 years and over. The selected articles have shown that the implementation of physical activity programs (aerobic, resistance, flexibility and combined exercises), and programs based on a higher intake of vegetables, grains, legumes, fruits, unsaturated fatty acids, as well as consumption of foods with low glycaemic index, calorie restriction, intake of probiotics, vitamin D supplementation and educational sessions about diabetes improves blood glucose levels, as well as the lipid profile, in patients with type 2 diabetes. Physical activity and dietary programs are fundamental in the treatment and metabolic control of type 2 diabetes mellitus. Copyright © 2017 Elsevier España, S.L.U. All rights reserved.

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Acknowledging patient heterogeneity in economic evaluation : a systematic literature review.

Science.gov (United States)

Grutters, Janneke P C; Sculpher, Mark; Briggs, Andrew H; Severens, Johan L; Candel, Math J; Stahl, James E; De Ruysscher, Dirk; Boer, Albert; Ramaekers, Bram L T; Joore, Manuela A

2013-02-01

Patient heterogeneity is the part of variability that can be explained by certain patient characteristics (e.g. age, disease stage). Population reimbursement decisions that acknowledge patient heterogeneity could potentially save money and increase population health. To date, however, economic evaluations pay only limited attention to patient heterogeneity. The objective of the present paper is to provide a comprehensive overview of the current knowledge regarding patient heterogeneity within economic evaluation of healthcare programmes. A systematic literature review was performed to identify methodological papers on the topic of patient heterogeneity in economic evaluation. Data were obtained using a keyword search of the PubMed database and manual searches. Handbooks were also included. Relevant data were extracted regarding potential sources of patient heterogeneity, in which of the input parameters of an economic evaluation these occur, methods to acknowledge patient heterogeneity and specific concerns associated with this acknowledgement. A total of 20 articles and five handbooks were included. The relevant sources of patient heterogeneity (demographics, preferences and clinical characteristics) and the input parameters where they occurred (baseline risk, treatment effect, health state utility and resource utilization) were combined in a framework. Methods were derived for the design, analysis and presentation phases of an economic evaluation. Concerns related mainly to the danger of false-positive results and equity issues. By systematically reviewing current knowledge regarding patient heterogeneity within economic evaluations of healthcare programmes, we provide guidance for future economic evaluations. Guidance is provided on which sources of patient heterogeneity to consider, how to acknowledge them in economic evaluation and potential concerns. The improved acknowledgement of patient heterogeneity in future economic evaluations may well improve the

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluating Fast Maximum Likelihood-Based Phylogenetic Programs Using Empirical Phylogenomic Data Sets

Science.gov (United States)

Zhou, Xiaofan; Shen, Xing-Xing; Hittinger, Chris Todd

2018-01-01

Abstract The sizes of the data matrices assembled to resolve branches of the tree of life have increased dramatically, motivating the development of programs for fast, yet accurate, inference. For example, several different fast programs have been developed in the very popular maximum likelihood framework, including RAxML/ExaML, PhyML, IQ-TREE, and FastTree. Although these programs are widely used, a systematic evaluation and comparison of their performance using empirical genome-scale data matrices has so far been lacking. To address this question, we evaluated these four programs on 19 empirical phylogenomic data sets with hundreds to thousands of genes and up to 200 taxa with respect to likelihood maximization, tree topology, and computational speed. For single-gene tree inference, we found that the more exhaustive and slower strategies (ten searches per alignment) outperformed faster strategies (one tree search per alignment) using RAxML, PhyML, or IQ-TREE. Interestingly, single-gene trees inferred by the three programs yielded comparable coalescent-based species tree estimations. For concatenation-based species tree inference, IQ-TREE consistently achieved the best-observed likelihoods for all data sets, and RAxML/ExaML was a close second. In contrast, PhyML often failed to complete concatenation-based analyses, whereas FastTree was the fastest but generated lower likelihood values and more dissimilar tree topologies in both types of analyses. Finally, data matrix properties, such as the number of taxa and the strength of phylogenetic signal, sometimes substantially influenced the programs’ relative performance. Our results provide real-world gene and species tree phylogenetic inference benchmarks to inform the design and execution of large-scale phylogenomic data analyses. PMID:29177474

On writing legibly: Processing fluency systematically biases evaluations of handwritten material

OpenAIRE

Greifeneder, Rainer; Alt, Alexander; Bottenberg, Konstantin; Seele, Tim; Zelt, Sarah; Wagener, Dietrich

2010-01-01

Evaluations of handwritten essays or exams are often suspected of being biased, such as by mood states or individual predilections. Although most of these influences are unsystematic, at least one bias is problematic because it systematically affects evaluations of handwritten materials. Three experiments revealed that essays in legible as compared to less legible handwriting were evaluated more positively. This robust finding was related to a basic judgmental mechanism that builds on the flu...

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Process variables in organizational stress management intervention evaluation research: a systematic review.

Science.gov (United States)

Havermans, Bo M; Schlevis, Roosmarijn Mc; Boot, Cécile Rl; Brouwers, Evelien Pm; Anema, Johannes; van der Beek, Allard J

2016-09-01

This systematic review aimed to explore which process variables are used in stress management intervention (SMI) evaluation research. A systematic review was conducted using seven electronic databases. Studies were included if they reported on an SMI aimed at primary or secondary stress prevention, were directed at paid employees, and reported process data. Two independent researchers checked all records and selected the articles for inclusion. Nielsen and Randall's model for process evaluation was used to cluster the process variables. The three main clusters were context, intervention, and mental models. In the 44 articles included, 47 process variables were found, clustered into three main categories: context (two variables), intervention (31 variables), and mental models (14 variables). Half of the articles contained no reference to process evaluation literature. The collection of process evaluation data mostly took place after the intervention and at the level of the employee. The findings suggest that there is great heterogeneity in methods and process variables used in process evaluations of SMI. This, together with the lack of use of a standardized framework for evaluation, hinders the advancement of process evaluation theory development.

Impact of disease management programs on healthcare expenditures for patients with diabetes, depression, heart failure or chronic obstructive pulmonary disease: a systematic review of the literature.

Science.gov (United States)

de Bruin, Simone R; Heijink, Richard; Lemmens, Lidwien C; Struijs, Jeroen N; Baan, Caroline A

2011-07-01

Evaluating the impact of disease management programs on healthcare expenditures for patients with diabetes, depression, heart failure or COPD. Systematic Pubmed search for studies reporting the impact of disease management programs on healthcare expenditures. Included were studies that contained two or more components of Wagner's chronic care model and were published between January 2007 and December 2009. Thirty-one papers were selected, describing disease management programs for patients with diabetes (n=14), depression (n=4), heart failure (n=8), and COPD (n=5). Twenty-one studies reported incremental healthcare costs per patient per year, of which 13 showed cost-savings. Incremental costs ranged between -$16,996 and $3305 per patient per year. Substantial variation was found between studies in terms of study design, number and combination of components of disease management programs, interventions within components, and characteristics of economic evaluations. Although it is widely believed that disease management programs reduce healthcare expenditures, the present study shows that evidence for this claim is still inconclusive. Nevertheless disease management programs are increasingly implemented in healthcare systems worldwide. To support well-considered decision-making in this field, well-designed economic evaluations should be stimulated. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

Systematic evaluation of the Cernavoda nuclear power plant physical protection system

International Nuclear Information System (INIS)

Ionescu, D.S.

2002-01-01

Full text: For three years at Cernavoda NPP is working a process to systematic evaluating the effectiveness of the Physical Protection System (PPS). Due to the fact that this evaluation has to be continuous, the first important step is to define a baseline to compare periodically the performance of PPS against it. The necessity of that process has been identified as follows: the continuous changes in the field of perceived threats against Cernavoda NPP and the necessary measures to respond to that changing climate; the needful to improve the performance of PPS against certain threats in conjunction with the needful to allocate substantially financial and human resources to cover the discovered weakness in the system; an assistant to take the appropriate measure in case of indisponibility of one or more components or parts of the PPS. The second step is the continuous tracking of the behavior of PPS in order to determine: the maintenance resource allocation and the priorities of the work; the predictive behavior of installed components to determine the future appropriate measures, including budget dimensioning. SAVI is a PC compatible program developed by SANDIA Laboratory (USA) for comprehensive analysis of PPS effectiveness. That program is organized in two modules: the Adversary Sequence Diagram (ASD) module and the outsider module modeling trough specific codes both the characteristics of PPS and of the predicted adversary. Combining the two modules related to a specific PPS and adversary is possible to find out the effectiveness of the physical protection system for each vital zone along to ten possible paths to penetrate by adversary, starting with the most vulnerable one. Because of two conservative assumption considered by the SAVI algorithm (adversary know the PPS characteristics and they use an optimal penetration strategy), the measure of effectiveness (probability of interruption - P I ) is very realistic and conservative related to the necessary

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Connect: An Effective Community-Based Youth Suicide Prevention Program

Science.gov (United States)

Bean, Gretchen; Baber, Kristine M.

2011-01-01

Youth suicide prevention is an important public health issue. However, few prevention programs are theory driven or systematically evaluated. This study evaluated Connect, a community-based youth suicide prevention program. Analysis of pre and posttraining questionnaires from 648 adults and 204 high school students revealed significant changes in…

[Characteristics of systematic reviews about the impact of pharmacists].

Science.gov (United States)

Tanguay, C; Guérin, A; Bussières, J-F

2014-11-01

The pharmacists' role is varied and numerous articles evaluate the outcomes of pharmaceutical interventions. The main objectives of this study were to establish the characteristics of systematic reviews about pharmacists' interventions that were published in the last five years. A literature search was performed on Pubmed for French and English articles published between 01-01-2008 and 31-05-2013. Systematic reviews that presented the role, the interventions and the impact of pharmacists were selected by two research assistants. A total of 46 systematic reviews was identified, amongst which one third (n=15/46, 33 %) were meta-analyses. A quarter of systematic reviews did not evaluate the quality of included articles (n=13/46, 28 %). Twelve themes were identified. A median [min-max] of 16 [2-298] articles was included per systematic review. The most frequent pharmaceutical activities were patient counseling (n=41 systematic reviews), patient chart review (n=29), pharmacotherapy evaluation (n=27) and recommendations (n=26). The least frequent activities were teaching others than patients (n=12) and medical rounds participation (n=7). Many elements can influence the completion of pharmacy practice research projects; however, there exists no link between the presence of systematic reviews and the importance of pharmacists in a given healthcare program. This study presents the characteristics of 46 systematic reviews about pharmacists interventions published since 2008. Copyright © 2014 Elsevier Masson SAS. All rights reserved.

A systematic review evaluating the impact of task shifting on access ...

African Journals Online (AJOL)

A systematic review evaluating the impact of task shifting on access to antiretroviral therapy in sub-Saharan Africa. ... Background: Task shifting, defined for this review as the shifting of ART initiation and ... AJOL African Journals Online.

mHealth for Smoking Cessation Programs: A Systematic Review

Directory of Open Access Journals (Sweden)

Koel Ghorai

2014-07-01

Full Text Available mHealth transforms healthcare delivery around the world due to its affordability and right time availability. It has been used for delivery of various smoking cessation programs and interventions over the past decade. With the proliferation of smartphone usage around the world, many smartphone applications are being developed for curbing smoking among smokers. Various interventions like SMS, progress tracking, distractions, peer chats and others are being provided to users through smartphone applications. This paper presents a systematic review that analyses the applications of mobile phones in smoking cessations. The synthesis of the diverse concepts within the literature on smoking cessations using mobile phones provides deeper insights in the emerging mHealth landscape.

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Health economic evaluations in orthodontics: a systematic review.

Science.gov (United States)

Sollenius, Ola; Petrén, Sofia; Björnsson, Liselotte; Norlund, Anders; Bondemark, Lars

2016-06-01

Economic evaluation is assuming increasing importance as an integral component of health services research. To conduct a systematic review of the literature and assess the evidence from studies presenting orthodontic treatment outcomes and the related costs. The literature review was conducted in four steps, according to Goodman's model, in order to identify all studies evaluating economic aspects of orthodontic interventions. The search covered the databases Medline, Cinahl, Cochrane, Embase, Google Scholar, National Health Service Economic Evaluation Database, and SCOPUS, for the period from 1966 to September 2014. The inclusion criteria were as follows: randomized controlled trials or controlled clinical trials comparing at least two different orthodontic interventions, evaluation of both economic and orthodontic outcomes, and study populations of all ages. The quality of each included study was assessed as limited, moderate, or high. The overall evidence was assessed according to the GRADE system (The Grading of Recommendations Assessment, Development and Evaluation). The applied terms for searches yielded 1838 studies, of which 989 were excluded as duplicates. Application of the inclusion and exclusion criteria identified 26 eligible studies for which the full-text versions were retrieved and scrutinized. At the final analysis, eight studies remained. Three studies were based on cost-effectiveness analyses and the other five on cost-minimization analysis. Two of the cost-minimization studies included a societal perspective, i.e. the sum of direct and indirect costs. The aims of most of the studies varied widely and of studies comparing equivalent treatment methods, few were of sufficiently high study quality. Thus, the literature to date provides an inadequate evidence base for economic aspects of orthodontic treatment. This systematic review disclosed that few orthodontic studies have presented both economic and clinical outcomes. There is currently

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

ERESYE - a expert system for the evaluation of uncertainties related to systematic experimental errors

International Nuclear Information System (INIS)

Martinelli, T.; Panini, G.C.; Amoroso, A.

1989-11-01

Information about systematic errors are not given In EXFOR, the data base of nuclear experimental measurements: their assessment is committed to the ability of the evaluator. A tool Is needed which performs this task in a fully automatic way or, at least, gives a valuable aid. The expert system ERESYE has been implemented for investigating the feasibility of an automatic evaluation of the systematic errors in the experiments. The features of the project which led to the implementation of the system are presented. (author)

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

The attitude of health care professionals towards accreditation: A systematic review of the literature

Directory of Open Access Journals (Sweden)

Abdullah Alkhenizan

2012-01-01

Full Text Available Accreditation is usually a voluntary program, in which authorized external peer reviewers evaluate the compliance of a health care organization with pre-established performance standards. The aim of this study was to systematically review the literature of the attitude of health care professionals towards professional accreditation. A systematic search of four databases including Medline, Embase, Healthstar, and Cinhal presented seventeen studies that had evaluated the attitudes of health care professionals towards accreditation. Health care professionals had a skeptical attitude towards accreditation. Owners of hospitals indicated that accreditation had the potential of being used as a marketing tool. Health care professionals viewed accreditation programs as bureaucratic and demanding. There was consistent concern, especially in developing countries, about the cost of accreditation programs and their impact on the quality of health care services.

Online Support Program for Parents of Children With a Chronic Kidney Disease Using Intervention Mapping: A Development and Evaluation Protocol.

Science.gov (United States)

Geense, Wytske W; van Gaal, Betsie Gi; Knoll, Jacqueline L; Cornelissen, Elisabeth Am; Schoonhoven, Lisette; Kok, Gerjo

2016-01-13

The care for children with a chronic kidney disease (CKD) is complex. Parents of these children may experience high levels of stress in managing their child's disease, potentially leading to negative effects on their child's health outcomes. Although the experienced problems are well known, adequate (online) support for these parents is lacking. The objective of the study is to describe the systematic development of an online support program for parents of children with CKD, and how this program will be evaluated. Intervention Mapping (IM) was used for the development of the program. After conducting a needs assessment, defining program objectives, searching for theories, and selecting practical applications, the online program e-Powered Parents was developed. e-Powered Parents consist of three parts: (1) an informative part with information about CKD and treatments, (2) an interactive part where parents can communicate with other parents and health care professionals by chat, private messages, and a forum, and (3) a training platform consisting of four modules: Managing stress, Setting limits, Communication, and Coping with emotions. In a feasibility study, the potential effectiveness and effect size of e-Powered Parents will be evaluated using an explorative randomized controlled trial with parents of 120 families. The outcomes will be the child's quality of life, parental stress and fatigue, self-efficacy in the communication with health care professionals, and family management. A process evaluation will provide insight in parents' experiences, including their experienced level of support. Study results are expected to be published in the summer of 2016. Although the development of e-Powered Parents using IM was time-consuming, IM has been a useful protocol. IM provided us with a systematic framework for structuring the development process. The participatory planning group was valuable as well; knowledge, experiences, and visions were shared, ensuring us that

School-Based Education Programs for the Prevention of Child Sexual Abuse: A Cochrane Systematic Review and Meta-Analysis

Science.gov (United States)

Walsh, Kerryann; Zwi, Karen; Woolfenden, Susan; Shlonsky, Aron

2018-01-01

Objective: To assess evidence of the effectiveness of school-based education programs for the prevention of child sexual abuse (CSA). The programs deliver information about CSA and strategies to help children avoid it and encourage help seeking. Methods: Systematic review including meta-analysis of randomized controlled trials (RCTs), cluster…

The effectiveness of mindful parenting programs in promoting parents' and children's wellbeing: a systematic review.

Science.gov (United States)

Townshend, Kishani; Jordan, Zoe; Stephenson, Matthew; Tsey, Komla

2016-03-01

The rationale for undertaking this review was to investigate a potential strategy to address the rising prevalence of child and adolescent mental health disorders. The central tenants of mindful parenting appear to be emotional awareness, emotional regulation, attention regulation, intentionality and non-judgmental acceptance. The primary objective of this review was to systematically evaluate the effectiveness of mindful parenting programs in promoting children's, adolescents' and parents' wellbeing, particularly in relation to the intensity of symptoms associated with internalizing (depression, anxiety, stress) and externalizing (conduct) disorders. The secondary objective was to evaluate how effective mindful parenting programs are in improving emotional regulation, attention regulation, quality of the parent-child relationship, resilience and mindfulness of the children, adolescents and parents. Children aged between 0 and 18 years and their parents who have completed a mindful parenting program were the focus of this review. Mindful parenting programs included in this review had a minimum duration of one to two hours per week for 6 to 8 weeks, delivered in a group format, by a facilitator with appropriate training. It included parenting programs that drew upon mindfulness-based stress reduction, mindfulness-based cognitive therapy, mindfulness-based cognitive behavior therapy, dialectical behavior therapy or acceptance commitment therapy. The comparator was the control or waitlist conditions. This review focused on randomized controlled trials evaluating the effectiveness of mindful parenting programs. Primary outcomes were wellbeing or intensity of symptoms associated with internalizing disorders (depression, anxiety, stress) and externalizing disorders (conduct disorders) in children, adolescents and parents. Secondary outcomes were emotional regulation, quality of the parent-child relationship, resilience and mindfulness of the children, adolescents and

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Systematic Evaluation of Uncertainty in Material Flow Analysis

DEFF Research Database (Denmark)

Laner, David; Rechberger, Helmut; Astrup, Thomas Fruergaard

2014-01-01

Material flow analysis (MFA) is a tool to investigate material flows and stocks in defined systems as a basis for resource management or environmental pollution control. Because of the diverse nature of sources and the varying quality and availability of data, MFA results are inherently uncertain....... Uncertainty analyses have received increasing attention in recent MFA studies, but systematic approaches for selection of appropriate uncertainty tools are missing. This article reviews existing literature related to handling of uncertainty in MFA studies and evaluates current practice of uncertainty analysis......) and exploratory MFA (identification of critical parameters and system behavior). Whereas mathematically simpler concepts focusing on data uncertainty characterization are appropriate for descriptive MFAs, statistical approaches enabling more-rigorous evaluation of uncertainty and model sensitivity are needed...

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

Evaluation of patient self-management outcomes in health care: a systematic review.

Science.gov (United States)

Du, S; Yuan, C

2010-06-01

The importance of self-management and its intervention for improving the ability and skill of self-management has been discussed in literatures. It is, however, unclear how to choose the fitted, objective and accurate evaluation system when assessing the outcome. The aim of this article was to establish a general evaluation system for skill and ability of self-management in chronic diseases through systematic review on different evaluation indicators and scales. A systematic search of six electronic databases was conducted. Two authors independently reviewed each qualified study for relevance and significance. Subsequently, main evaluation indicators and scales were identified and categorized into themes and sub-themes. Nineteen articles were identified in this review. Among them, six main evaluation indicators of self-management, including frequently used scales, were extracted and tabulated. Self-efficacy, health behaviour/attitude, health status, health service utilization, quality of life and psychological indicators were the main indicators in evaluating self-management outcome, and they could be used alone or in combination flexibly according to the different goals of programmes. Accurate evaluation of skill and ability of self-management is crucial not only in baseline data collection but also in proving the effectiveness of intervention. The outcomes of this study provide future researchers or caregivers with a better understanding and a series of good choices in self-management outcome evaluation.

Operating experience and systems analysis at Trillo NPP: A program intended for systematic review of plant safety systems to assess design basis requirements compliance

International Nuclear Information System (INIS)

Vega, R. de la

1996-01-01

The program was defined to apply to all plant safety systems and/or systems included in plant Technical Specifications. The goal of the program was to ensure, by systematic design, construction, and commissioning review, the adequacy of safety systems, structures and components to fulfill their safety functions. Also, as a result of the program, it was established that a complete, unambiguous, systematic, design basis definition shall take place. And finally, a complete documental review of the plant design shall result from the program execution

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Monitoring and evaluation of mental health and psychosocial support programs in humanitarian settings: a scoping review of terminology and focus.

Science.gov (United States)

Augustinavicius, Jura L; Greene, M Claire; Lakin, Daniel P; Tol, Wietse A

2018-01-01

Monitoring and evaluation of mental health and psychosocial support (MHPSS) programs is critical to facilitating learning and providing accountability to stakeholders. As part of an inter-agency effort to develop recommendations on MHPSS monitoring and evaluation, this scoping review aimed to identify the terminology and focus of monitoring and evaluation frameworks in this field. We collected program documents (logical frameworks (logframes) and theories of change) from members of the Inter-Agency Standing Committee Reference Group on MHPSS, and systematically searched the peer-reviewed literature across five databases. We included program documents and academic articles that reported on monitoring and evaluation of MHPSS in low- and middle-income countries describing original data. Inclusion and data extraction were conducted in parallel by independent reviewers. Thematic analysis was used to identify common language in the description of practices and the focus of each monitoring and evaluation framework. Logframe outcomes were mapped to MHPSS activity categories. We identified 38 program documents and 89 peer-reviewed articles, describing monitoring and evaluation of a wide range of MHPSS activities. In both program documents and peer-reviewed literature there was a lack of specificity and overlap in language used for goals and outcomes. Well-validated, reliable instruments were reported in the academic literature, but rarely used in monitoring and evaluation practices. We identified six themes in the terminology used to describe goals and outcomes. Logframe outcomes were more commonly mapped to generic program implementation activities (e.g. "capacity building") and those related to family and community support, while outcomes from academic articles were most frequently mapped to specialized psychological treatments. Inconsistencies between the language used in research and practice and discrepancies in measurement have broader implications for monitoring and

Evaluation of an Evidence-Based Tobacco Treatment Curriculum for Psychiatry Residency Training Programs

Science.gov (United States)

Prochaska, Judith J.; Fromont, Sebastien C.; Leek, Desiree; Hudmon, Karen Suchanek; Louie, Alan K.; Jacobs, Marc H.; Hall, Sharon M.

2009-01-01

Objective Smokers with mental illness and addictive disorders account for nearly one in two cigarettes sold in the United States and are at high risk for smoking-related deaths and disability. Psychiatry residency programs provide a unique arena for disseminating tobacco treatment guidelines, influencing professional norms, and increasing access to tobacco cessation services among smokers with mental illness. The current study evaluated the Rx for Change in Psychiatry curriculum, developed for psychiatry residency programs and focused on identifying and treating tobacco dependence among individuals with mental illness. Methods The 4-hour curriculum emphasized evidence-based, patient-oriented cessation treatments relevant for all tobacco users, including those not yet ready to quit. The curriculum was informed by comprehensive literature review, consultation with an expert advisory group, faculty interviews, and a focus group with psychiatry residents. This study reports on evaluation of the curriculum in 2005–2006, using a quasi-experimental design, with 55 residents in three psychiatry residency training programs in Northern California. Results The curriculum was associated with improvements in psychiatry residents’ knowledge, attitudes, confidence, and counseling behaviors for treating tobacco use among their patients, with initial changes from pre- to posttraining sustained at 3-months’ follow-up. Residents’ self-reported changes in treating patients’ tobacco use were substantiated through systematic chart review. Conclusion The evidence-based Rx for Change in Psychiatry curriculum is offered as a model tobacco treatment curriculum that can be implemented in psychiatry residency training programs and disseminated widely, thereby effectively reaching a vulnerable and costly population of smokers. PMID:19190293

Evaluating the online platform of a blended-learning pharmacist continuing education degree program.

Science.gov (United States)

Wilbur, Kerry

2016-01-01

Distance-based continuing education opportunities are increasingly embraced by health professionals worldwide. To evaluate the online component of a blended-learning degree program for pharmacists, we conducted a structured self-assessment and peer review using an instrument systematically devised according to Moore's principles of transactional distance. The web-based platform for 14 courses was reviewed by both local and external faculty, followed by shared reflection of individual and aggregate results. Findings indicated a number of course elements for modification to enhance the structure, dialog, and autonomy of the student learning experience. Our process was an important exercise in quality assurance and is worthwhile for other health disciplines developing and delivering distance-based content to pursue.

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Program TOTELA calculating basic cross sections in intermediate energy region by using systematics

International Nuclear Information System (INIS)

Fukahori, Tokio; Niita, Koji

2000-01-01

Program TOTELA can calculate neutron- and proton-induced total, elastic scattering and reaction cross sections and angular distribution of elastic scattering in the intermediate energy region from 20 MeV to 3 GeV. The TOTELA adopts the systematics modified from that by Pearlstein to reproduce the experimental data and LA150 evaluation better. The calculated results compared with experimental data and LA150 evaluation are shown in figures. The TOTELA results can reproduce those data almost well. The TOTELA was developed to fill the lack of experimental data of above quantities in the intermediate energy region and to use for production of JENDL High Energy File. In the case that there is no experimental data of above quantities, the optical model parameters can be fitted by using TOTELA results. From this point of view, it is also useful to compare the optical model calculation by using RIPL with TOTELA results, in order to verify the parameter quality. Input data of TOTELA is only atomic and mass numbers of incident particle and target nuclide and input/output file names. The output of TOTELA calculation is in ENDF-6 format used in the intermediate energy nuclear data files. It is easy to modify the main routine by users. Details are written in each subroutine and main routine

Collaborative work as a didactic strategy for teaching/learning programming: a systematic literature review

Directory of Open Access Journals (Sweden)

Oscar Revelo-Sanchez

2018-01-01

Full Text Available The incorporation of Collaborative Work into programming courses has been identified as a potential strategy that could maximize student participation and have a positive impact on learning. In the consulted sources, no study has been found to collect and analyze the results of research on this subject using a systematic method. To try to fill this gap, a systematic literature review was conducted with the aim of summarizing the studies on the use of Collaborative Work as a didactic strategy for teaching/learning programming. Initially, through a search in four (4 databases of scientific publications, 95 studies published in the last five (5 years were obtained. After careful analysis of each one of them, only 40 were found to meet the review requirements. This analysis resulted in the synthesis of eleven (11 Collaborative Learning Techniques (CLT that implement such strategy. Subsequently, they were grouped into 19 common names of strategies found in the documents, i.e. the collaborative strategies or techniques associated with each study. The review also showed a significant amount of contributions from the research community that constitute an important basis for future work. This demonstrates that Collaborative Work is increasingly consolidated as a valid and relevant didactic strategy, not only in programming teaching/learning, but also in other areas of knowledge including computer science.

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Evaluation of Role of Myofibroblasts in Oral Cancer: A Systematic Review.

Science.gov (United States)

Sekhon, Harjeet K; Sircar, Keya; Kaur, Gurbani; Marwah, Muneet

2016-01-01

To conduct a systematic review on the role of myofibroblasts in progression of oral cancer. The myofibroblast is essential for the integrity of the mammalian body by virtue of its role in wound healing, but it also plays a negative role due to their role in promoting tumor development. Systematic review. Bibliographic searches were conducted in several electronic databases using all publications in PubMed, PubMed central, EMBASE, CancerLit, Google scholar, and Cochrane CCTR between 1990 and June 2015. The search of all publications from various electronic databases revealed 1,371 citations. The total number of studies considered for systematic review was 43. The total number of patients included in the studies was 990. Myofibroblasts are a significant component in stroma of oral cancer cases, though not identified in all cases. This systematic review shows that clinical, pathological, and immunohistochemistry tests have correlated the presence of high myofibroblast count in oral cancer cell stroma. Myofibroblasts play a significant role in oral cancer invasion and progression. Various studies have demonstrated their association with oral cancer. This review tends to highlight their role in the pathogenesis of oral cancer over the decade. Sekhon HK, Sircar K, Kaur G, Marwah M. Evaluation of Role of Myofibroblasts in Oral Cancer: A Systematic Review. Int J Clin Pediatr Dent 2016;9(3):233-239.

Systematization of simplified J-integral evaluation method for flaw evaluation at high temperature

International Nuclear Information System (INIS)

Miura, Naoki; Takahashi, Yukio; Nakayama, Yasunari; Shimakawa, Takashi

2000-01-01

J-integral is an effective inelastic fracture parameter for the flaw evaluation of cracked components at high temperature. The evaluation of J-integral for an arbitrary crack configuration and an arbitrary loading condition can be generally accomplished by detailed numerical analysis such as finite element analysis, however, it is time-consuming and requires a high degree of expertise for its implementation. Therefore, it is important to develop simplified J-integral estimation techniques from the viewpoint of industrial requirements. In this study, a simplified J-integral evaluation method is proposed to estimate two types of J-integral parameters. One is the fatigue J-integral range to describe fatigue crack propagation behavior, and the other is the creep J-integral to describe creep crack propagation behavior. This paper presents the systematization of the simplified J-integral evaluation method incorporated with the reference stress method and the concept of elastic follow-up, and proposes a comprehensive evaluation procedure. The verification of the proposed method is presented in Part II of this paper. (author)

Adapting Job Analysis Methodology to Improve Evaluation Practice

Science.gov (United States)

Jenkins, Susan M.; Curtin, Patrick

2006-01-01

This article describes how job analysis, a method commonly used in personnel research and organizational psychology, provides a systematic method for documenting program staffing and service delivery that can improve evaluators' knowledge about program operations. Job analysis data can be used to increase evaluators' insight into how staffs…

Integrating Early Child Development and Violence Prevention Programs: A Systematic Review.

Science.gov (United States)

Efevbera, Yvette; McCoy, Dana C; Wuermli, Alice J; Betancourt, Theresa S

2018-03-01

Limited evidence describes promoting development and reducing violence in low- and middle-income countries (LMICs), a missed opportunity to protect children and promote development and human capital. This study presents a systematic literature review of integrated early childhood development plus violence prevention (ECD+VP) interventions in LMICs. The search yielded 5,244 unique records, of which N = 6 studies met inclusion criteria. Interventions were in Chile, Jamaica, Lebanon, Mexico, Mozambique, and Turkey. Five interventions were parent education programs, including center-based sessions (n = 3) and home visiting (n = 2), while one intervention was a teacher education program. All but one study reported improvements in both child development and maltreatment outcomes. The dearth of evidence on ECD+VP interventions suggests additional research is needed. Integrated ECD+VP interventions may improve multiple child outcome domains while leveraging limited resources in LMICs. © 2018 Wiley Periodicals, Inc.

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

A systematic review of economic evaluations of cardiac rehabilitation

Directory of Open Access Journals (Sweden)

Wong Wai

2012-08-01

Full Text Available Abstract Background Cardiac rehabilitation (CR, a multidisciplinary program consisting of exercise, risk factor modification and psychosocial intervention, forms an integral part of managing patients after myocardial infarction (MI, revascularization surgery and percutaneous coronary interventions, as well as patients with heart failure (HF. This systematic review seeks to examine the cost-effectiveness of CR for patients with MI or HF and inform policy makers in Singapore on published cost-effectiveness studies on CR. Methods Electronic databases (EMBASE, MEDLINE, NHS EED, PEDro, CINAHL were searched from inception to May 2010 for published economic studies. Additional references were identified through searching bibliographies of included studies. Two independent reviewers selected eligible publications based on the inclusion/exclusion criteria. Quality assessment of economic evaluations was undertaken using Drummond’s checklist. Results A total of 22 articles were selected for review. However five articles were further excluded because they were cost-minimization analyses, whilst one included patients with stroke. Of the final 16 articles, one article addressed both centre-based cardiac rehabilitation versus no rehabilitation, as well as home-based cardiac rehabilitation versus no rehabilitation. Therefore, nine studies compared cost-effectiveness between centre-based supervised CR and no CR; three studies examined that between centre- and home based CR; one between inpatient and outpatient CR; and four between home-based CR and no CR. These studies were characterized by differences in the study perspectives, economic study designs and time frames, as well as variability in clinical data and assumptions made on costs. Overall, the studies suggested that: (1 supervised centre-based CR was highly cost-effective and the dominant strategy when compared to no CR; (2 home-based CR was no different from centre-based CR; (3 no difference existed

Scientific Evaluation and Review of Claims in Health Care (SEaRCH): A Streamlined, Systematic, Phased Approach for Determining "What Works" in Healthcare.

Science.gov (United States)

Jonas, Wayne B; Crawford, Cindy; Hilton, Lara; Elfenbaum, Pamela

2017-01-01

Answering the question of "what works" in healthcare can be complex and requires the careful design and sequential application of systematic methodologies. Over the last decade, the Samueli Institute has, along with multiple partners, developed a streamlined, systematic, phased approach to this process called the Scientific Evaluation and Review of Claims in Health Care (SEaRCH™). The SEaRCH process provides an approach for rigorously, efficiently, and transparently making evidence-based decisions about healthcare claims in research and practice with minimal bias. SEaRCH uses three methods combined in a coordinated fashion to help determine what works in healthcare. The first, the Claims Assessment Profile (CAP), seeks to clarify the healthcare claim and question, and its ability to be evaluated in the context of its delivery. The second method, the Rapid Evidence Assessment of the Literature (REAL © ), is a streamlined, systematic review process conducted to determine the quantity, quality, and strength of evidence and risk/benefit for the treatment. The third method involves the structured use of expert panels (EPs). There are several types of EPs, depending on the purpose and need. Together, these three methods-CAP, REAL, and EP-can be integrated into a strategic approach to help answer the question "what works in healthcare?" and what it means in a comprehensive way. SEaRCH is a systematic, rigorous approach for evaluating healthcare claims of therapies, practices, programs, or products in an efficient and stepwise fashion. It provides an iterative, protocol-driven process that is customized to the intervention, consumer, and context. Multiple communities, including those involved in health service and policy, can benefit from this organized framework, assuring that evidence-based principles determine which healthcare practices with the greatest promise are used for improving the public's health and wellness.

Systematic evaluation of non-animal test methods for skin sensitisation safety assessment.

Science.gov (United States)

Reisinger, Kerstin; Hoffmann, Sebastian; Alépée, Nathalie; Ashikaga, Takao; Barroso, Joao; Elcombe, Cliff; Gellatly, Nicola; Galbiati, Valentina; Gibbs, Susan; Groux, Hervé; Hibatallah, Jalila; Keller, Donald; Kern, Petra; Klaric, Martina; Kolle, Susanne; Kuehnl, Jochen; Lambrechts, Nathalie; Lindstedt, Malin; Millet, Marion; Martinozzi-Teissier, Silvia; Natsch, Andreas; Petersohn, Dirk; Pike, Ian; Sakaguchi, Hitoshi; Schepky, Andreas; Tailhardat, Magalie; Templier, Marie; van Vliet, Erwin; Maxwell, Gavin

2015-02-01

The need for non-animal data to assess skin sensitisation properties of substances, especially cosmetics ingredients, has spawned the development of many in vitro methods. As it is widely believed that no single method can provide a solution, the Cosmetics Europe Skin Tolerance Task Force has defined a three-phase framework for the development of a non-animal testing strategy for skin sensitization potency prediction. The results of the first phase – systematic evaluation of 16 test methods – are presented here. This evaluation involved generation of data on a common set of ten substances in all methods and systematic collation of information including the level of standardisation, existing test data,potential for throughput, transferability and accessibility in cooperation with the test method developers.A workshop was held with the test method developers to review the outcome of this evaluation and to discuss the results. The evaluation informed the prioritisation of test methods for the next phase of the non-animal testing strategy development framework. Ultimately, the testing strategy – combined with bioavailability and skin metabolism data and exposure consideration – is envisaged to allow establishment of a data integration approach for skin sensitisation safety assessment of cosmetic ingredients.

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Improving evidence based practice in postgraduate nursing programs: A systematic review: Bridging the evidence practice gap (BRIDGE project).

Science.gov (United States)

Hickman, Louise D; DiGiacomo, Michelle; Phillips, Jane; Rao, Angela; Newton, Phillip J; Jackson, Debra; Ferguson, Caleb

2018-04-01

The nursing profession has a significant evidence to practice gap in an increasingly complex and dynamic health care environment. To evaluate effectiveness of teaching and learning strategies related to a capstone project within a Masters of Nursing program that encourage the development of evidence based practice capabilities. Systematic review that conforms to the PRISMA statement. Master's Nursing programs that include elements of a capstone project within a university setting. MEDLINE, CINAHL, Cochrane Database of Systematic Reviews, ERIC and PsycInfo were used to search for RCT's or quasi experimental studies conducted between 1979 and 9 June 2017, published in a peer reviewed journal in English. Of 1592 studies, no RCT's specifically addressed the development of evidence based practice capabilities within the university teaching environment. Five quasi-experimental studies integrated blended learning, guided design processes, small group work, role play and structured debate into Masters of Nursing research courses. All five studies demonstrated some improvements in evidence based practice skills and/or research knowledge translation, with three out of five studies demonstrating significant improvements. There is a paucity of empirical evidence supporting the best strategies to use in developing evidence based practice skills and/or research knowledge translation skills for Master's Nursing students. As a profession, nursing requires methodologically robust studies that are discipline specific to identify the best approaches for developing evidence-based practice skills and/or research knowledge translation skills within the university teaching environment. Provision of these strategies will enable the nursing profession to integrate the best empirical evidence into nursing practice. Copyright © 2018. Published by Elsevier Ltd.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

A Systematic Review of Biopsychosocial Training Programs for the Self-Management of Emotional Stress: Potential Applications for the Military

Science.gov (United States)

Clausen, Shawn S.; Jonas, Wayne B.; Walter, Joan A. G.

2013-01-01

Combat-exposed troops and their family members are at risk for stress reactions and related disorders. Multimodal biopsychosocial training programs incorporating complementary and alternative self-management techniques have the potential to reduce stress-related symptoms and dysfunction. Such training can preempt or attenuate the posttraumatic stress response and may be effectively incorporated into the training cycle for deploying and redeploying troops and their families. A large systematic review was conducted to survey the literature on multimodal training programs for the self-management of emotional stress. This report is an overview of the randomized controlled trials (RCTs) identified in this systematic review. Select programs such as mindfulness-Based Stress Reduction, Cognitive Behavioral Stress Management, Autogenic Training, Relaxation Response Training, and other meditation and mind-body skills practices are highlighted, and the feasibility of their implementation within military settings is addressed. PMID:24174982

A Systematic Review of Biopsychosocial Training Programs for the Self-Management of Emotional Stress: Potential Applications for the Military

Directory of Open Access Journals (Sweden)

Cindy Crawford

2013-01-01

Full Text Available Combat-exposed troops and their family members are at risk for stress reactions and related disorders. Multimodal biopsychosocial training programs incorporating complementary and alternative self-management techniques have the potential to reduce stress-related symptoms and dysfunction. Such training can preempt or attenuate the posttraumatic stress response and may be effectively incorporated into the training cycle for deploying and redeploying troops and their families. A large systematic review was conducted to survey the literature on multimodal training programs for the self-management of emotional stress. This report is an overview of the randomized controlled trials (RCTs identified in this systematic review. Select programs such as mindfulness-Based Stress Reduction, Cognitive Behavioral Stress Management, Autogenic Training, Relaxation Response Training, and other meditation and mind-body skills practices are highlighted, and the feasibility of their implementation within military settings is addressed.

A systematic review of biopsychosocial training programs for the self-management of emotional stress: potential applications for the military.

Science.gov (United States)

Crawford, Cindy; Wallerstedt, Dawn B; Khorsan, Raheleh; Clausen, Shawn S; Jonas, Wayne B; Walter, Joan A G

2013-01-01

Combat-exposed troops and their family members are at risk for stress reactions and related disorders. Multimodal biopsychosocial training programs incorporating complementary and alternative self-management techniques have the potential to reduce stress-related symptoms and dysfunction. Such training can preempt or attenuate the posttraumatic stress response and may be effectively incorporated into the training cycle for deploying and redeploying troops and their families. A large systematic review was conducted to survey the literature on multimodal training programs for the self-management of emotional stress. This report is an overview of the randomized controlled trials (RCTs) identified in this systematic review. Select programs such as mindfulness-Based Stress Reduction, Cognitive Behavioral Stress Management, Autogenic Training, Relaxation Response Training, and other meditation and mind-body skills practices are highlighted, and the feasibility of their implementation within military settings is addressed.

Programs to reduce teen pregnancy, sexually transmitted infections, and associated sexual risk behaviors: a systematic review.

Science.gov (United States)

Goesling, Brian; Colman, Silvie; Trenholm, Christopher; Terzian, Mary; Moore, Kristin

2014-05-01

This systematic review provides a comprehensive, updated assessment of programs with evidence of effectiveness in reducing teen pregnancy, sexually transmitted infections (STIs), or associated sexual risk behaviors. The review was conducted in four steps. First, multiple literature search strategies were used to identify relevant studies released from 1989 through January 2011. Second, identified studies were screened against prespecified eligibility criteria. Third, studies were assessed by teams of two trained reviewers for the quality and execution of their research designs. Fourth, for studies that passed the quality assessment, the review team extracted and analyzed information on the research design, study sample, evaluation setting, and program impacts. A total of 88 studies met the review criteria for study quality and were included in the data extraction and analysis. The studies examined a range of programs delivered in diverse settings. Most studies had mixed-gender and predominately African-American research samples (70% and 51%, respectively). Randomized controlled trials accounted for the large majority (87%) of included studies. Most studies (76%) included multiple follow-ups, with sample sizes ranging from 62 to 5,244. Analysis of the study impact findings identified 31 programs with evidence of effectiveness. Research conducted since the late 1980s has identified more than two dozen teen pregnancy and STI prevention programs with evidence of effectiveness. Key strengths of this research are the large number of randomized controlled trials, the common use of multiple follow-up periods, and attention to a broad range of programs delivered in diverse settings. Two main gaps are a lack of replication studies and the need for more research on Latino youth and other high-risk populations. In addressing these gaps, researchers must overcome common limitations in study design, analysis, and reporting that have negatively affected prior research. Copyright

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Automatic Evaluations and Exercising: Systematic Review and Implications for Future Research.

Science.gov (United States)

Schinkoeth, Michaela; Antoniewicz, Franziska

2017-01-01

The general purpose of this systematic review was to summarize, structure and evaluate the findings on automatic evaluations of exercising. Studies were eligible for inclusion if they reported measuring automatic evaluations of exercising with an implicit measure and assessed some kind of exercise variable. Fourteen nonexperimental and six experimental studies (out of a total N = 1,928) were identified and rated by two independent reviewers. The main study characteristics were extracted and the grade of evidence for each study evaluated. First, results revealed a large heterogeneity in the applied measures to assess automatic evaluations of exercising and the exercise variables. Generally, small to large-sized significant relations between automatic evaluations of exercising and exercise variables were identified in the vast majority of studies. The review offers a systematization of the various examined exercise variables and prompts to differentiate more carefully between actually observed exercise behavior (proximal exercise indicator) and associated physiological or psychological variables (distal exercise indicator). Second, a lack of transparent reported reflections on the differing theoretical basis leading to the use of specific implicit measures was observed. Implicit measures should be applied purposefully, taking into consideration the individual advantages or disadvantages of the measures. Third, 12 studies were rated as providing first-grade evidence (lowest grade of evidence), five represent second-grade and three were rated as third-grade evidence. There is a dramatic lack of experimental studies, which are essential for illustrating the cause-effect relation between automatic evaluations of exercising and exercise and investigating under which conditions automatic evaluations of exercising influence behavior. Conclusions about the necessity of exercise interventions targeted at the alteration of automatic evaluations of exercising should therefore

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

Supporting adherence and healthy lifestyles in leg ulcer patients: systematic development of the Lively Legs program for dermatology outpatient clinics.

NARCIS (Netherlands)

Heinen, M.M.; Bartholomew, L.K.; Wensing, M.J.P.; Kerkhof, P.C.M. van de; Achterberg, T. van

2006-01-01

OBJECTIVES: The objective of our project was to develop a lifestyle program for leg ulcer patients at outpatient clinics for dermatology. METHODS: We used the intervention-mapping (IM) framework for systematically developing theory and evidence based health promotion programs. We started with a

Systematic shifts of evaluated charge centroid for the cathode read-out multiwire proportional chamber

International Nuclear Information System (INIS)

Endo, I.; Kawamoto, T.; Mizuno, Y.; Ohsugi, T.; Taniguchi, T.; Takeshita, T.

1981-01-01

We have investigated the systematic error associtated with the charge centroid evaluation for the cathode read-out multiwire proportional chamber. Correction curves for the systematic error according to six centroid finding algorithms have been obtained by using the charge distribution calculated in a simple electrostatic mode. They have been experimentally examined and proved to be essential for the accurate determination of the irradiated position. (orig.)

Using a Systematic Approach and Theoretical Framework to Design a Curriculum for the Shaping Healthy Choices Program.

Science.gov (United States)

Linnell, Jessica D; Zidenberg-Cherr, Sheri; Briggs, Marilyn; Scherr, Rachel E; Brian, Kelley M; Hillhouse, Carol; Smith, Martin H

2016-01-01

To examine the use of a systematic approach and theoretical framework to develop an inquiry-based, garden-enhanced nutrition curriculum for the Shaping Healthy Choices Program. Curriculum development occurred in 3 steps: identification of learning objectives, determination of evidence of learning, and activity development. Curriculum activities were further refined through pilot-testing, which was conducted in 2 phases. Formative data collected during pilot-testing resulted in improvements to activities. Using a systematic, iterative process resulted in a curriculum called Discovering Healthy Choices, which has a strong foundation in Social Cognitive Theory and constructivist learning theory. Furthermore, the Backward Design method provided the design team with a systematic approach to ensure activities addressed targeted learning objectives and overall Shaping Healthy Choices Program goals. The process by which a nutrition curriculum is developed may have a direct effect on student outcomes. Processes by which nutrition curricula are designed and learning objectives are selected, and how theory and pedagogy are applied should be further investigated so that effective approaches to developing garden-enhanced nutrition interventions can be determined and replicated. Copyright © 2016 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

User Experience Evaluations in Rehabilitation Video Games for Children: A Systematic Mapping of the Literature.

Science.gov (United States)

Rico-Olarte, Carolina; López, Diego M; Blobel, Bernd; Kepplinger, Sara

2017-01-01

In recent years, the interest in user experience (UX) evaluation methods for assessing technology solutions, especially in health systems for children with special needs like cognitive disabilities, has increased. Conduct a systematic mapping study to provide an overview in the field of UX evaluations in rehabilitation video games for children. The definition of research questions, the search for primary studies and the extraction of those studies by inclusion and exclusion criteria lead to the mapping of primary papers according to a classification scheme. Main findings from this study include the detection of the target population of the selected studies, the recognition of two different ways of evaluating UX: (i) user evaluation and (ii) system evaluation, and UX measurements and devices used. This systematic mapping specifies the research gaps identified for future research works in the area.

Earthquake engineering programs at the Lawrence Livermore Laboratory

International Nuclear Information System (INIS)

Tokarz, F.J.

1980-01-01

Information is presented concerning assessments of current seismic design methods; systematic evaluation program for older operating reactors; seismic vulnerability of fuel reprocessing facilities; and advisability of seismic scram

Effectiveness of comprehensive care programs for patients with multiple chronic conditions or frailty : A systematic literature review

NARCIS (Netherlands)

Hopman, Petra; De Bruin, Simone R.; Forjaz, Maria João; Rodriguez-blazquez, Carmen; Tonnara, Giuseppe; Lemmens, Lidwien C.; Onder, Graziano; Baan, Caroline A.; Rijken, Mieke

2016-01-01

Objective To describe comprehensive care programs targeting multimorbid and/or frail patients and to estimate their effectiveness regarding improvement of patient and caregiver related outcomes, healthcare utilization and costs. Methods Systematic search in six electronic databases for scientific

Course Evaluation of Introduction to Computer Programming Education in the School of Engineering Evening Division at the Department of Electronic Engineering

Science.gov (United States)

Dohi, Shinichi; Miyakawa, Osamu; Konno, Noriko

It was difficult to show objectively educational effects, because there was no effective standard that is able to measure objectively the effect of the education. We focus on students' motivation, and we have measured students' motivation as the educational effects. In order to improve students' motivation, the SIEM (Systematical Information Education Method) was proposed. The SIEM applied to introduction to the computer programming education, and the time series evaluation of students' motivation has been performed over the past five years. In this paper, we describe that introduction to the computer programming education which aims at improvement of students' motivation is effective.

Neurolinguistic programming: a systematic review of the effects on health outcomes.

Science.gov (United States)

Sturt, Jackie; Ali, Saima; Robertson, Wendy; Metcalfe, David; Grove, Amy; Bourne, Claire; Bridle, Chris

2012-11-01

Neurolinguistic programming (NLP) in health care has captured the interest of doctors, healthcare professionals, and managers. To evaluate the effects of NLP on health-related outcomes. Systematic review of experimental studies. The following data sources were searched: MEDLINE, PsycINFO, ASSIA, AMED, CINAHL, Web of Knowledge, CENTRAL, NLP specialist databases, reference lists, review articles, and NLP professional associations, training providers, and research groups. Searches revealed 1459 titles from which 10 experimental studies were included. Five studies were randomised controlled trials (RCTs) and five were pre-post studies. Targeted health conditions were anxiety disorders, weight maintenance, morning sickness, substance misuse, and claustrophobia during MRI scanning. NLP interventions were mainly delivered across 4-20 sessions although three were single session. Eighteen outcomes were reported and the RCT sample sizes ranged from 22 to 106. Four RCTs reported no significant between group differences with the fifth finding in favour of the NLP arm (F = 8.114, P<0.001). Three RCTs and five pre-post studies reported within group improvements. Risk of bias across all studies was high or uncertain. There is little evidence that NLP interventions improve health-related outcomes. This conclusion reflects the limited quantity and quality of NLP research, rather than robust evidence of no effect. There is currently insufficient evidence to support the allocation of NHS resources to NLP activities outside of research purposes.

Evaluating the online platform of a blended-learning pharmacist continuing education degree program

Directory of Open Access Journals (Sweden)

Kerry Wilbur

2016-06-01

Full Text Available Background: Distance-based continuing education opportunities are increasingly embraced by health professionals worldwide. Methods: To evaluate the online component of a blended-learning degree program for pharmacists, we conducted a structured self-assessment and peer review using an instrument systematically devised according to Moore's principles of transactional distance. The web-based platform for 14 courses was reviewed by both local and external faculty, followed by shared reflection of individual and aggregate results. Results: Findings indicated a number of course elements for modification to enhance the structure, dialog, and autonomy of the student learning experience. Conclusion: Our process was an important exercise in quality assurance and is worthwhile for other health disciplines developing and delivering distance-based content to pursue.

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Impact of programming strategies aimed at reducing nonessential implantable cardioverter defibrillator therapies on mortality: a systematic review and meta-analysis.

Science.gov (United States)

Tan, Vern Hsen; Wilton, Stephen B; Kuriachan, Vikas; Sumner, Glen L; Exner, Derek V

2014-02-01

Patients who receive implantable cardioverter defibrillator therapies are at higher risk of death versus those who do not. Programmed settings to reduce nonessential implantable cardioverter defibrillator therapies (therapy reduction programming) have been developed but may have adverse effects. This systematic review and meta-analysis assessed the relationship between therapy reduction programming with the risks of death from any cause, implantable cardioverter defibrillator shocks, and syncope. MEDLINE, EMBASE, and clinicaltrials.gov databases were searched to identify relevant studies. Those that followed patients for ≥6 months and reported mortality were included. Six met the inclusion criteria; 4 randomized (Comparison of Empiric to Physician-Tailored Programming of ICDs [EMPIRIC], Multicenter Automatic Defibrillator Implantation Trial-Reduce Inappropriate Therapy [MADIT-RIT], Avoid Delivering Therapies for Non-sustained Arrhythmias in ICD Patients III [ADVANCE III], and Programming Implantable Cardioverter-Defibrillators in Patients with Primary Prevention Indication to Prolong Time to First Shock [PROVIDE]) and 2 prospective studies (Role of Long Detection Window Programming in Patients With Left Ventricular Dysfunction, Non-ischemic Etiology in Primary Prevention Treated with a Biventricular ICD [RELEVANT] and Primary Prevention Parameters Evaluation [PREPARE]). These 6 studies included 7687 (3598 conventional and 4089 therapy reduction programming) patients. Most (77%) participants were men, had a history of ischemic heart disease (56%), and were prescribed β-blockers (84%). Therapy reduction programming was associated with a 30% relative reduction in mortality (95% confidence interval, 16%-41%; Pprogramming (P=0.5). Therapy reduction programming results in a large, significant, and consistent reduction in mortality, with no apparent increase in the risk of syncope.

Scientific Evaluation and Review of Claims in Health Care (SEaRCH): A Streamlined, Systematic, Phased Approach for Determining “What Works” in Healthcare

Science.gov (United States)

Crawford, Cindy; Hilton, Lara; Elfenbaum, Pamela

2017-01-01

Abstract Background: Answering the question of “what works” in healthcare can be complex and requires the careful design and sequential application of systematic methodologies. Over the last decade, the Samueli Institute has, along with multiple partners, developed a streamlined, systematic, phased approach to this process called the Scientific Evaluation and Review of Claims in Health Care (SEaRCH™). The SEaRCH process provides an approach for rigorously, efficiently, and transparently making evidence-based decisions about healthcare claims in research and practice with minimal bias. Methods: SEaRCH uses three methods combined in a coordinated fashion to help determine what works in healthcare. The first, the Claims Assessment Profile (CAP), seeks to clarify the healthcare claim and question, and its ability to be evaluated in the context of its delivery. The second method, the Rapid Evidence Assessment of the Literature (REAL©), is a streamlined, systematic review process conducted to determine the quantity, quality, and strength of evidence and risk/benefit for the treatment. The third method involves the structured use of expert panels (EPs). There are several types of EPs, depending on the purpose and need. Together, these three methods—CAP, REAL, and EP—can be integrated into a strategic approach to help answer the question “what works in healthcare?” and what it means in a comprehensive way. Discussion: SEaRCH is a systematic, rigorous approach for evaluating healthcare claims of therapies, practices, programs, or products in an efficient and stepwise fashion. It provides an iterative, protocol-driven process that is customized to the intervention, consumer, and context. Multiple communities, including those involved in health service and policy, can benefit from this organized framework, assuring that evidence-based principles determine which healthcare practices with the greatest promise are used for improving the public's health and

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Effectiveness and Factors Determining the Success of Management Programs for Patients With Heart Failure: A Systematic Review and Meta-analysis.

Science.gov (United States)

Oyanguren, Juana; Latorre García, Pedro María; Torcal Laguna, Jesús; Lekuona Goya, Iñaki; Rubio Martín, Susana; Maull Lafuente, Elena; Grandes, Gonzalo

2016-10-01

Heart failure management programs reduce hospitalizations. Some studies also show reduced mortality. The determinants of program success are unknown. The aim of the present study was to update our understanding of the reductions in mortality and readmissions produced by these programs, elucidate their components, and identify the factors determining program success. Systematic literature review (1990-2014; PubMed, EMBASE, CINAHL, Cochrane Library) and manual search of relevant journals. The studies were selected by 3 independent reviewers. Methodological quality was evaluated in a blinded manner by an external researcher (Jadad scale). These results were pooled using random effects models. Heterogeneity was evaluated with the I 2 statistic, and its explanatory factors were determined using metaregression analysis. Of the 3914 studies identified, 66 randomized controlled clinical trials were selected (18 countries, 13 535 patients). We determined the relative risks to be 0.88 for death (95% confidence interval [95%CI], 0.81-0.96; P < .002; I 2 , 6.1%), 0.92 for all-cause readmissions (95%CI, 0.86-0.98; P < .011; I 2 , 58.7%), and 0.80 for heart failure readmissions (95%CI, 0.71-0.90; P < .0001; I 2 , 52.7%). Factors associated with program success were implementation after 2001, program location outside the United States, greater baseline use of angiotensin-converting enzyme inhibitors/angiotensin receptor blockers, a higher number of intervention team members and components, specialized heart failure cardiologists and nurses, protocol-driven education and its assessment, self-monitoring of signs and symptoms, detection of deterioration, flexible diuretic regimen, early care-seeking among patients and prompt health care response, psychosocial intervention, professional coordination, and program duration. We confirm the reductions in mortality and readmissions with heart failure management programs. Their success is associated with various structural and

Programs to Strengthen Parent-Adolescent Communication About Reproductive Health: A Systematic Review.

Science.gov (United States)

Gavin, Loretta E; Williams, Jessica R; Rivera, Maria I; Lachance, Christina R

2015-08-01

When caring for an adolescent client, providers of contraceptive services must consider whether and how to encourage parent/guardian-child communication about the adolescent's reproductive health. The objective of this systematic review was to summarize the evidence on the effectiveness of programs designed to increase parent-child communication about reproductive health. The review was used to inform national recommendations on quality family planning services. Data analysis occurred from mid-2011 through 2012. Several electronic bibliographic databases were used to identify relevant articles, including PubMed, CINAHL, PsycINFO, and Popline, published from January 1985 through February 2011. Sixteen articles met the inclusion criteria: all studies examined the impact on at least one medium- or short-term outcome, and two studies assessed the impact on teen pregnancy. One study examined the impact of a program conducted in a clinic setting; the remainder examined the impact of programs in community settings. All studies showed a positive impact on at least one short-term outcome, and 12 of 16 studies showed an increase in parent-child communication about reproductive health. Four of seven studies found an impact on sexual risk behavior. Most programs increased parent-child communication, and several resulted in reduced sexual risk behavior of adolescents. This suggests that delivering a clinic-based program that effectively helps parents/guardians talk to their adolescent child(ren) about reproductive health, or referring parents/guardians to an evidence-based program in the community, may be beneficial. However, further rigorous research on delivery of these programs in clinical settings is needed. Published by Elsevier Inc.

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

A systematic grounded approach to the development of complex interventions: the Australian WorkHealth Program--arthritis as a case study.

Science.gov (United States)

Reavley, Nicola; Livingston, Jenni; Buchbinder, Rachelle; Bennell, Kim; Stecki, Chris; Osborne, Richard Harry

2010-02-01

Despite demands for evidence-based research and practice, little attention has been given to systematic approaches to the development of complex interventions to tackle workplace health problems. This paper outlines an approach to the initial stages of a workplace program development which integrates health promotion and disease management. The approach commences with systematic and genuine processes of obtaining information from key stakeholders with broad experience of these interventions. This information is constructed into a program framework in which practice-based and research-informed elements are both valued. We used this approach to develop a workplace education program to reduce the onset and impact of a common chronic disease - osteoarthritis. To gain information systematically at a national level, a structured concept mapping workshop with 47 participants from across Australia was undertaken. Participants were selected to maximise the whole-of-workplace perspective and included health education providers, academics, clinicians and policymakers. Participants generated statements in response to a seeding statement: Thinking as broadly as possible, what changes in education and support should occur in the workplace to help in the prevention and management of arthritis? Participants grouped the resulting statements into conceptually coherent groups and a computer program was used to generate a 'cluster map' along with a list of statements sorted according to cluster membership. In combination with research-based evidence, the concept map informed the development of a program logic model incorporating the program's guiding principles, possible service providers, services, training modes, program elements and the causal processes by which participants might benefit. The program logic model components were further validated through research findings from diverse fields, including health education, coaching, organisational learning, workplace interventions

Identifying potentially cost effective chronic care programs for people with COPD

NARCIS (Netherlands)

L.M.G. Steuten (Lotte); K.M.M. Lemmens (Karin); A.P. Nieboer (Anna); H.J.M. Vrijhoef (Hubertus)

2009-01-01

textabstractObjective: To review published evidence regarding the cost effectiveness of multi-component COPD programs and to illustrate how potentially cost effective programs can be identified. Methods: Systematic search of Medline and Cochrane databases for evaluations of multicomponent disease

Structural barriers in access to medical marijuana in the USA-a systematic review protocol.

Science.gov (United States)

Valencia, Celina I; Asaolu, Ibitola O; Ehiri, John E; Rosales, Cecilia

2017-08-07

There are 43 state medical marijuana programs in the USA, yet limited evidence is available on the demographic characteristics of the patient population accessing these programs. Moreover, insights into the social and structural barriers that inform patients' success in accessing medical marijuana are limited. A current gap in the scientific literature exists regarding generalizable data on the social, cultural, and structural mechanisms that hinder access to medical marijuana among qualifying patients. The goal of this systematic review, therefore, is to identify the aforementioned mechanisms that inform disparities in access to medical marijuana in the USA. This scoping review protocol outlines the proposed study design for the systematic review and evaluation of peer-reviewed scientific literature on structural barriers to medical marijuana access. The protocol follows the guidelines set forth by the Preferred Reporting Items for Systematic review and Meta-Analysis Protocols (PRISMA-P) checklist. The overarching goal of this study is to rigorously evaluate the existing peer-reviewed data on access to medical marijuana in the USA. Income, ethnic background, stigma, and physician preferences have been posited as the primary structural barriers influencing medical marijuana patient population demographics in the USA. Identification of structural barriers to accessing medical marijuana provides a framework for future policies and programs. Evidence-based policies and programs for increasing medical marijuana access help minimize the disparity of access among qualifying patients.

Quality of systematic reviews in pediatric oncology - A systematic review

NARCIS (Netherlands)

Lundh, Andreas; Knijnenburg, Sebastiaan L.; Jørgensen, Anders W.; van Dalen, Elvira C.; Kremer, Leontien C. M.

2009-01-01

Background: To ensure evidence-based decision making in pediatric oncology systematic reviews are necessary. The objective of our study was to evaluate the methodological quality of all currently existing systematic reviews in pediatric oncology. Methods: We identified eligible systematic reviews

Promoting Excellence in Nursing Education (PENE): Pross evaluation model.

Science.gov (United States)

Pross, Elizabeth A

2010-08-01

The purpose of this article is to examine the Promoting Excellence in Nursing Education (PENE) Pross evaluation model. A conceptual evaluation model, such as the one described here, may be useful to nurse academicians in the ongoing evaluation of educational programs, especially those with goals of excellence. Frameworks for evaluating nursing programs are necessary because they offer a way to systematically assess the educational effectiveness of complex nursing programs. This article describes the conceptual framework and its tenets of excellence. Copyright 2009 Elsevier Ltd. All rights reserved.

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Measurement properties of instruments evaluating self-care and related concepts in people with chronic obstructive pulmonary disease: A systematic review.

Science.gov (United States)

Clari, Marco; Matarese, Maria; Alvaro, Rosaria; Piredda, Michela; De Marinis, Maria Grazia

2016-01-01

The use of valid and reliable instruments for assessing self-care is crucial for the evaluation of chronic obstructive pulmonary disease (COPD) management programs. The aim of this review is to evaluate the measurement properties and theoretical foundations of instruments for assessing self-care and related concepts in people with COPD. A systematic review was conducted of articles describing the development and validation of self-care instruments. The methodological quality of the measurement properties was assessed using the COSMIN checklist. Ten studies were included evaluating five instruments: three for assessing self-care and self-management and two for assessing self-efficacy. The COPD Self-Efficacy Scale was the most studied instrument, but due to poor study methodological quality, evidence about its measurement properties is inconclusive. Evidence from the COPD Self-Management Scale is more promising, but only one study tested its properties. Due to inconclusive evidence of their measurement properties, no instrument can be recommended for clinical use. Copyright © 2016 Elsevier Inc. All rights reserved.

The health economic impact of disease management programs for COPD: a systematic literature review and meta-analysis.

Science.gov (United States)

Boland, Melinde R S; Tsiachristas, Apostolos; Kruis, Annemarije L; Chavannes, Niels H; Rutten-van Mölken, Maureen P M H

2013-07-03

There is insufficient evidence of the cost-effectiveness of Chronic Obstructive Pulmonary Disease (COPD) Disease Management (COPD-DM) programs. The aim of this review is to evaluate the economic impact of COPD-DM programs and investigate the relation between the impact on healthcare costs and health outcomes. We also investigated the impact of patient-, intervention, and study-characteristics. We conducted a systematic literature review to identify cost-effectiveness studies of COPD-DM. Where feasible, results were pooled using random-effects meta-analysis and explorative subgroup analyses were performed. Sixteen papers describing 11 studies were included (7 randomized control trials (RCT), 2 pre-post, 2 case-control). Meta-analysis showed that COPD-DM led to hospitalization savings of €1060 (95% CI: €2040 to €80) per patient per year and savings in total healthcare utilization of €898 (95% CI: €1566 to €231) (excl. operating costs). In these health economic studies small but positive results on health outcomes were found, such as the St Georges Respiratory Questionnaire (SGRQ) score, which decreased with 1.7 points (95% CI: 0.5-2.9). There was great variability in DM interventions-, study- and patient-characteristics. There were indications that DM showed greater savings in studies with: severe COPD patients, patients with a history of exacerbations, RCT study design, high methodological quality, few different professions involved in the program, and study setting outside Europe. COPD-DM programs were found to have favourable effects on both health outcomes and costs, but there is considerable heterogeneity depending on patient-, intervention-, and study-characteristics.

Systematic Development of the YouRAction program, a computer-tailored Physical Activity promotion intervention for Dutch adolescents, targeting personal motivations and environmental opportunities

Directory of Open Access Journals (Sweden)

Prins Richard G

2010-08-01

Full Text Available Abstract Background Increasing physical activity (PA among adolescents is an important health promotion goal. PA has numerous positive health effects, but the majority of Dutch adolescents do not meet PA requirements. The present paper describes the systematic development of a theory-based computer-tailored intervention, YouRAction, which targets individual and environmental factors determining PA among adolescents. Design The intervention development was guided by the Intervention Mapping protocol, in order to define clear program objectives, theoretical methods and practical strategies, ensure systematic program planning and pilot-testing, and anticipate on implementation and evaluation. Two versions of YouRAction were developed: one that targets individual determinants and an extended version that also provides feedback on opportunities to be active in the neighbourhood. Key determinants that were targeted included: knowledge and awareness, attitudes, self-efficacy and subjective norms. The extended version also addressed perceived availability of neighbourhood PA facilities. Both versions aimed to increase levels of moderate-to-vigorous PA among adolescents. The intervention structure was based on self-regulation theory, comprising of five steps in the process of successful goal pursuit. Monitoring of PA behaviour and behavioural and normative feedback were used to increase awareness of PA behaviour; motivation was enhanced by targeting self-efficacy and attitudes, by means of various interactive strategies, such as web movies; the perceived environment was targeted by visualizing opportunities to be active in an interactive geographical map of the home environment; in the goal setting phase, the adolescents were guided in setting a goal and developing an action plan to achieve this goal; in the phase of active goal pursuit adolescents try to achieve their goal and in the evaluation phase the achievements are evaluated. Based on the results

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

The Impact of the FIFA 11+ Training Program on Injury Prevention in Football Players: A Systematic Review

Directory of Open Access Journals (Sweden)

Noël C. Barengo

2014-11-01

Full Text Available The FIFA 11+ is a simple, and easy to implement, sports injury prevention program comprising a warm up of 10 conditioning exercises. The aim of this systematic review was to evaluate the impact of the FIFA 11+ on injury incidence, compliance and cost effectiveness when implemented among football players. MEDLINE, EMBASE and Scopus databases were searched using the search terms “FIFA 11+”, “football”, “soccer”, “injury prevention”, and “The 11”. The titles and abstracts were screened by two independent reviewers and the data were filtered by one reviewer using a standardized extraction form and thereafter checked by another one. The risk of bias and the methodological quality of the studies were evaluated through the PEDro score and Critical Appraisal Skills Programme (CASP. A total of 911 studies were identified, of which 12 met the inclusion criteria of the review. The FIFA 11+ has demonstrated how a simple exercise program completed as part of warm-up can decrease the incidence of injuries in amateur football players. In general, considerable reductions in the number of injured players, ranging between 30% and 70%, have been observed among the teams that implemented the FIFA 11+. In addition, players with high compliance to the FIFA 11+ program had an estimated risk reduction of all injuries by 35% and show significant improvements in components of neuromuscular and motor performance when participating in structured warm-up sessions at least 1.5 times/week. Most studies had high methodological quality and a low risk of bias. Given the large number of people who play football at amateur level and the detrimental impact of sports injuries on a personal and societal level, the FIFA 11+ can be considered as a fundamental tool to minimize the risks of participation in a sport with substantial health benefits.

What's technology cooking up? A systematic review of the use of technology in adolescent food literacy programs.

Science.gov (United States)

Wickham, Catherine A; Carbone, Elena T

2018-06-01

Over one-third of adolescents are overweight or obese. Food literacy (FL), the ability to plan and manage, select, prepare, and eat healthy foods, is a contemporary concept that provides a mechanism to understand the relationship between food-related knowledge and skills and dietary intake. Innovative interventions which focus on the core concepts of FL and include generationally appropriate technology have the potential to provide positive impact on the dietary habits of adolescents. This systematic review followed PRISMA guidelines and employed the Downs and Black criteria for rating studies. Titles and abstracts of 545 articles were collected and reviewed from 13 electronic databases. Studies were selected if they were peer-reviewed, included adolescents 12-19 years-old, incorporated concepts related to FL, and employed technology as part of the intervention. Eight studies, six randomized controlled trials (RCT) and two interventions without controls were included. Seven of the interventions used Internet or web-based platforms to access program components and all RCTs incorporated game elements. Studies included between two and four constructs of FL. All reported positive changes in food intake with five reporting significant positive pre- and post-intervention changes. Few technology-driven FL-related studies exist within the literature. Although all studies reported improvements in dietary intake, due to variation in program design, delivery, and evaluation it is difficult to tease out the effect of the technology component. Continued research is needed to: 1) determine the degree to which FL should be included in interventions to effect a positive change on dietary intake; 2) develop adolescent-specific FL measures to more appropriately evaluate changes in knowledge, food-related skills, and dietary intake; and 3) design technology-driven interventions so that technology components can be analyzed separately from other program elements. Copyright © 2018

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Effects of Pilates exercise programs in people with chronic low back pain: a systematic review.

Science.gov (United States)

Patti, Antonino; Bianco, Antonino; Paoli, Antonio; Messina, Giuseppe; Montalto, Maria Alessandra; Bellafiore, Marianna; Battaglia, Giuseppe; Iovane, Angelo; Palma, Antonio

2015-01-01

The Pilates method has recently become a fast-growing popular way of exercise recommended for healthy individuals and those engaged in rehabilitation. Several published studies have examined the effects of Pilates method in people with chronic low back pain (LBP). The objective of this study is to describe and provide an extensive overview of the scientific literature comparing the effectiveness of the Pilates method on pain and disability in patients with chronic nonspecific LBP. The study is based on the data from the following sources: MEDLINE-NLM, MEDLINE-EBSCO, Scopus Elsevier, Cochrane, DOAJ, SciELO, and PLOSONE. Original articles and systematic reviews of adults with chronic nonspecific LBP that evaluated pain and/or disability were included in this study; studies in which the primary treatment was based on Pilates method exercises compared with no treatment, minimal intervention, other types of intervention, or other types of exercises. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) were adopted. The literature search included 7 electronic databases and the reference list of relevant systematic reviews and original articles to July 2014. Two independent investigators conducted the literature search and performed the synthesis as follows: Study Design; Sample (n); Disability measure; Intervention; and Main results. The searches identified a total of 128 articles. From these, 29 were considered eligible and were included in the analysis. The items were stratified as follows: Pilates method versus other kind of exercises (n = 6 trials) and Pilates method versus no treatment group or minimal intervention for short-term pain (n = 9 trials); the therapeutic effect of the Pilates method in randomized cohorts (n = 5); and analysis of reviews (n = 9). We found that there is a dearth of studies that clearly demonstrates the efficacy of a specific Pilates exercise program over another in the treatment of chronic pain. However, the

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

CONSORT to community: translation of an RCT to a large-scale community intervention and learnings from evaluation of the upscaled program.

Science.gov (United States)

Moores, Carly Jane; Miller, Jacqueline; Perry, Rebecca Anne; Chan, Lily Lai Hang; Daniels, Lynne Allison; Vidgen, Helen Anna; Magarey, Anthea Margaret

2017-11-29

Translation encompasses the continuum from clinical efficacy to widespread adoption within the healthcare service and ultimately routine clinical practice. The Parenting, Eating and Activity for Child Health (PEACH™) program has previously demonstrated clinical effectiveness in the management of child obesity, and has been recently implemented as a large-scale community intervention in Queensland, Australia. This paper aims to describe the translation of the evaluation framework from a randomised controlled trial (RCT) to large-scale community intervention (PEACH™ QLD). Tensions between RCT paradigm and implementation research will be discussed along with lived evaluation challenges, responses to overcome these, and key learnings for future evaluation conducted at scale. The translation of evaluation from PEACH™ RCT to the large-scale community intervention PEACH™ QLD is described. While the CONSORT Statement was used to report findings from two previous RCTs, the REAIM framework was more suitable for the evaluation of upscaled delivery of the PEACH™ program. Evaluation of PEACH™ QLD was undertaken during the project delivery period from 2013 to 2016. Experiential learnings from conducting the evaluation of PEACH™ QLD to the described evaluation framework are presented for the purposes of informing the future evaluation of upscaled programs. Evaluation changes in response to real-time changes in the delivery of the PEACH™ QLD Project were necessary at stages during the project term. Key evaluation challenges encountered included the collection of complete evaluation data from a diverse and geographically dispersed workforce and the systematic collection of process evaluation data in real time to support program changes during the project. Evaluation of large-scale community interventions in the real world is challenging and divergent from RCTs which are rigourously evaluated within a more tightly-controlled clinical research setting. Constructs

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

The Design, Implementation, and Evaluation of Online Credit Nutrition Courses: A Systematic Review

Science.gov (United States)

Cohen, Nancy L.; Carbone, Elena T.; Beffa-Negrini, Patricia A.

2011-01-01

Objective: To assess how postsecondary online nutrition education courses (ONEC) are delivered, determine ONEC effectiveness, identify theoretical models used, and identify future research needs. Design: Systematic search of database literature. Setting: Postsecondary education. Participants: Nine research articles evaluating postsecondary ONEC.…

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

A systematic review of the effectiveness of simulation-based education on satisfaction and learning outcomes in nurse practitioner programs.

Science.gov (United States)

Warren, Jessie N; Luctkar-Flude, Marian; Godfrey, Christina; Lukewich, Julia

2016-11-01

High-fidelity simulation (HFS) is becoming an integral component in healthcare education programs. There is considerable evidence demonstrating the effectiveness of HFS on satisfaction and learning outcomes within undergraduate nursing programs; however, there are few studies that have investigated its use and effectiveness within nurse practitioner (NP) programs. To synthesize the best available evidence about the effectiveness of HFS within NP education programs worldwide. The specific review question was: what is the effect of HFS on learner satisfaction, knowledge, attitudes, and skill performance in NP education? Joanna Briggs Institute systematic review methodology was utilized. The following databases were searched: MEDLINE, CINAHL, EMBASE, Epistemonikos, PROSPERO, HealthSTAR, AMED, Cochrane, Global Health and PsycINFO. Studies were included if they were quantitative in nature and reported on any aspect HFS within a NP program. Ten studies were included in the review. All studies were conducted in the United States and published between 2007 and 2014. Outcomes explored included: knowledge, attitudes, skills and satisfaction. The majority of studies compared HFS to online learning or traditional classroom lecture. Most study scenarios featured high acuity, low frequency events within acute care settings; only two studies utilized scenarios simulated within primary care. There is limited evidence supporting the use of HFS within NP programs. In general, HFS increases students' knowledge and confidence, and students are more satisfied with simulation-based teaching in comparison to other methods. Future studies should explore the effectiveness of simulation training within NP programs in reducing the theory to practice gap, and evaluate knowledge retention, transferability to real patient situations, and impact of simulation on patient outcomes. Copyright © 2016 Elsevier Ltd. All rights reserved.

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.

2000-01-01

The action program Energy 2000 has been continually reviewed by independent experts in view of its effects. This resulted in around 50 scientific studies between 1991 and 1999, dealing with different aspects of the program. In the book 'Energy 2000: effects of the program and conclusions from its evaluation', the results of these evaluations are summarised, and conclusions for the design of the follow-up program are drawn. The organisational frame of the program is presented and the question answered whether the determining principles of the program proved practical. Besides, the effects of state intervention, of the conflict solving groups and the voluntary actions of Energy 2000 are appraised. A separate chapter is dedicated to the evaluation strategy of the program, its implementation and the benefits of the evaluations. Propositions for the evaluation of the follow-up program are formulated as well. Dr. Andreas Balthasar is President of the Swiss Evaluation Society. (author)

The Effectiveness of Parenting Programs: A Review of Campbell Reviews

Science.gov (United States)

Barlow, Jane; Coren, Esther

2018-01-01

Parenting practices predict important outcomes for children, and parenting programs are potentially effective means of supporting parents to promote optimal outcomes for children. This review summarizes findings of systematic reviews of parenting programs published in the Campbell Library. Six reviews evaluated the effectiveness of a range of…

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

Evaluation of the integrity of SEP reactor vessels

International Nuclear Information System (INIS)

Hoge, K.G.

1979-12-01

A documented review is presented of the integrity of the 11 reactor pressure vessels covered in the Systematic Evaluation Program. This review deals primarily with the design specifications and quality assurance programs used in the vessel construction and the status of material surveillance programs, pressure-temperature operating limits, and inservice inspection programs of the applicable plants. Several generic items such as PWR overpressurization protection and BWR nozzle and safe-end cracking also are evaluated. The 11 vessels evaluated include Dresden Units 1 and 2, Big Rock Point, Haddam Neck, Yankee Rowe, Oyster Creek, San Onofre 1, LaCrosse, Ginna, Millstone 1, and Palisades

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

Quality of systematic reviews in pediatric oncology--a systematic review

DEFF Research Database (Denmark)

Lundh, Andreas; Knijnenburg, Sebastiaan L; Jørgensen, Anders W

2009-01-01

BACKGROUND: To ensure evidence-based decision making in pediatric oncology systematic reviews are necessary. The objective of our study was to evaluate the methodological quality of all currently existing systematic reviews in pediatric oncology. METHODS: We identified eligible systematic reviews...... through a systematic search of the literature. Data on clinical and methodological characteristics of the included systematic reviews were extracted. The methodological quality of the included systematic reviews was assessed using the overview quality assessment questionnaire, a validated 10-item quality...... assessment tool. We compared the methodological quality of systematic reviews published in regular journals with that of Cochrane systematic reviews. RESULTS: We included 117 systematic reviews, 99 systematic reviews published in regular journals and 18 Cochrane systematic reviews. The average methodological...

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

Science.gov (United States)

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Programs to Reduce Teen Pregnancy, Sexually Transmitted Infections, and Associated Sexual Risk Behaviors: A Systematic Review

OpenAIRE

Brian Goesling; Silvie Colman; Christopher Trenholm; Mary Terzian; Kristin Moore

2013-01-01

This paper presents findings from an ongoing systematic review of research on teen pregnancy and sexually transmitted infection prevention programs, sponsored by the U.S. Department of Health and Human Services to help support evidence-based approaches to teen pregnancy prevention. A total of 88 studies met the review criteria for study quality and were included in the analysis.

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

Defining the benefits and challenges of stakeholder engagement in systematic reviews

Directory of Open Access Journals (Sweden)

Cottrell EK

2015-04-01

Full Text Available Erika K Cottrell,1 Evelyn P Whitlock,2 Elisabeth Kato,3 Stacey Uhl,4 Suzanne Belinson,5 Christine Chang,3 Ties Hoomans,5,6 David O Meltzer,5,7 Hussein Noorani,5 Karen A Robinson,8 Makalapua Motu'apuaka,9 Johanna Anderson,9 Robin A Paynter,9 Jeanne-Marie Guise9 1Oregon Health and Sciences University, Portland, OR, USA; 2Kaiser Evidence-based Practice Center, Portland, OR, USA; 3Agency for Healthcare Research and Quality, Rockville, MD, USA; 4ECRI-Penn Evidence-based Practice Center, Plymouth Meeting, PA, USA; 5Office of Clinical Affairs, Blue Cross Blue Shield Association, Chicago, IL, USA; 6Institute of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, the Netherlands; 7University of Chicago, Chicago, IL, USA; 8Johns Hopkins University Evidence-based Practice Center, Baltimore, MD, USA; 9Scientific Resource Center for the Agency for Healthcare Research and Quality (AHRQ Effective Health Care Program, Portland Veterans Affairs (VA Research Foundation, Portland VA Medical Center, Portland, OR, USA Background: Although there is a growing literature on the process of engaging stakeholders in medical research, there are a lack of clearly-defined measures for reporting and evaluation, which limits the ability to learn from past experience, understand the effectiveness of engagement, or identify which approaches work best. Clearly defining the benefits and challenges of engaging stakeholders in the systematic review process is an integral first step toward developing a set of criteria that can be used to evaluate the impact and effectiveness on the conduct, quality, and dissemination of systematic reviews. Methods: We utilized two complementary approaches to examine the benefits and challenges of engaging stakeholders in the systematic review process: 1 a literature scan to understand the overall state of the field; and 2 a series of key informant interviews with systematic reviewers, program/policy officials, and stakeholders

Continuous Evaluation in Ethics Education: A Case Study.

Science.gov (United States)

McIntosh, Tristan; Higgs, Cory; Mumford, Michael; Connelly, Shane; DuBois, James

2018-04-01

A great need for systematic evaluation of ethics training programs exists. Those tasked with developing an ethics training program may be quick to dismiss the value of training evaluation in continuous process improvement. In the present effort, we use a case study approach to delineate how to leverage formative and summative evaluation measures to create a high-quality ethics education program. With regard to formative evaluation, information bearing on trainee reactions, qualitative data from the comments of trainees, in addition to empirical findings, can ensure that the training program operates smoothly. Regarding summative evaluation, measures examining trainee cognition, behavior, and organization-level results provide information about how much trainees have changed as a result of taking the ethics training. The implications of effective training program evaluation are discussed.

Participants' and staffs' evaluation of the Illness Management and Recovery program

DEFF Research Database (Denmark)

Dalum, Helle Stentoft; Waldemar, Anna Kristine; Korsbek, Lisa

2018-01-01

BACKGROUND: Psychoeducational interventions for people with severe mental illness are developed to enable them to manage their illness effectively to improve prognosis and recovery. AIM: The aim was to investigate the benefits and harms of the Illness Management and Recovery (IMR) program among p....... CONCLUSIONS: IMR appears not to be better than treatment as usual in any of the outcomes. Further studies with a longer follow-up period, better assessments of recovery and a systematic review of the existing trials are needed to assess if the program is effective....

Evaluation Studies of Robotic Rollators by the User Perspective: A Systematic Review.

Science.gov (United States)

Werner, Christian; Ullrich, Phoebe; Geravand, Milad; Peer, Angelika; Hauer, Klaus

2016-01-01

Robotic rollators enhance the basic functions of established devices by technically advanced physical, cognitive, or sensory support to increase autonomy in persons with severe impairment. In the evaluation of such ambient assisted living solutions, both the technical and user perspectives are important to prove usability, effectiveness and safety, and to ensure adequate device application. The aim of this systematic review is to summarize the methodology of studies evaluating robotic rollators with focus on the user perspective and to give recommendations for future evaluation studies. A systematic literature search up to December 31, 2014, was conducted based on the Cochrane Review methodology using the electronic databases PubMed and IEEE Xplore. Articles were selected according to the following inclusion criteria: evaluation studies of robotic rollators documenting human-robot interaction, no case reports, published in English language. Twenty-eight studies were identified that met the predefined inclusion criteria. Large heterogeneity in the definitions of the target user group, study populations, study designs and assessment methods was found across the included studies. No generic methodology to evaluate robotic rollators could be identified. We found major methodological shortcomings related to insufficient sample descriptions and sample sizes, and lack of appropriate, standardized and validated assessment methods. Long-term use in habitual environment was also not evaluated. Apart from the heterogeneity, methodological deficits in most of the identified studies became apparent. Recommendations for future evaluation studies include: clear definition of target user group, adequate selection of subjects, inclusion of other assistive mobility devices for comparison, evaluation of the habitual use of advanced prototypes, adequate assessment strategy with established, standardized and validated methods, and statistical analysis of study results. Assessment

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

Evaluation of team skills for control room crews

International Nuclear Information System (INIS)

Gaddy, C.D.; Koontz, J.L.

1987-01-01

Although team training has received considerable attention throughout industry, a systematic approach to team skills training has only recently been proposed for control room crews. One important step of the approach to team skills training is evaluation of team skills. This paper describes methods and resources, and program considerations in team skills evaluation. The three areas pertaining to methods and resources are: development of evaluation criteria, preparation of event scenarios, and instructor training and additional resources. The program considerations include sequencing and coordination of team skills evaluation in the context of an overall operator training program

Using systematized tacit knowledge to prioritize implementation challenges in existing maternal health programs: implications for the post MDG era.

Science.gov (United States)

Becerril-Montekio, Victor; Alcalde-Rabanal, Jacqueline; Darney, Blair G; Orozco-Nuñez, Emanuel

2016-10-01

Strategic priority setting and implementation of strategies to reduce maternal mortality are key to the post Millennium Development Goal (MDG) 2015 agenda. This article highlights the feasibility and the advantages of using a systematized tacit knowledge approach, using data from maternal health program personnel, to identify local challenges to implementing policies and programs to inform the post MDG era. Communities of practice, conceived as groups of people sharing professional interests, experiences and knowledge, were formed with diverse health personnel implementing maternal health programs in Mexico and Nicaragua. Participants attended several workshops and developed different online activities aiming to strengthen their capacities to acquire, analyze, adapt and apply research results and to systematize their experience and knowledge of the actual implementation of these programs. Concept mapping, a general method designed to organize and depict the ideas of a group on a particular topic, was used to manage, discuss and systematize their tacit knowledge about implementation problems of the programs they work in. Using a special online concept mapping platform, participants prioritized implementation problems by sorting them in conceptual clusters and rating their importance and feasibility of solution. Two hundred and thirty-one participants from three communities of practice in each country registered on the online concept mapping platform and 200 people satisfactorily completed the sorting and rating activities. Participants further discussed these results to prioritize the implementation problems of maternal health programs. Our main finding was a great similarity between the Mexican and the Nicaraguan general results highlighting the importance and the feasibility of solution of implementation problems related to the quality of healthcare. The use of rigorously organized tacit knowledge of health personnel proved to be a feasible and useful tool for

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Change in Adverse Events After Enrollment in the National Surgical Quality Improvement Program: A Systematic Review and Meta-Analysis.

Directory of Open Access Journals (Sweden)

Joshua Montroy

Full Text Available The American College of Surgeons' National Surgical Quality Improvement Program (NSQIP is the first nationally validated, risk-adjusted, outcomes-based program to measure and compare the quality of surgical care across North America. Participation in this program may provide an opportunity to reduce the incidence of adverse events related to surgery.A systematic review of the literature was performed. MedLine, EMBASE and PubMed were searched for studies relevant to NSQIP. Patient characteristics, intervention, and primary outcome measures were abstracted. The intervention was participation in NSQIP and monitoring of Individual Site Summary Reports with or without implementation of a quality improvement program. The outcomes of interest were change in peri-operative adverse events and mortality represented by pooled risk ratios (pRR and 95% confidence intervals (CI.Eleven articles reporting on 35 health care institutions were included. Nine (82% of the eleven studies implemented a quality improvement program. Minimal improvements in superficial (pRR 0.81; 95% CI 0.72-0.91, deep (pRR 0.82; 95% CI0.64-1.05 and organ space (pRR 1.15; 95% CI 0.96-1.37 infections were observed at centers that did not institute a quality improvement program. However, centers that reported formal interventions for the prevention and treatment of infections observed substantial improvements (superficial pRR 0.55, 95% CI 0.39-0.77; deep pRR 0.61, 95% CI 0.50-0.75, and organ space pRR 0.60, 95% CI 0.50-0.71. Studies evaluating other adverse events noted decreased incidence following NSQIP participation and implementation of a formal quality improvement program.These data suggest that NSQIP is effective in reducing surgical morbidity. Improvement in surgical quality appears to be more marked at centers that implemented a formal quality improvement program directed at the reduction of specific morbidities.

Effectiveness of School-Based Teen Pregnancy Prevention Programs in the USA: a Systematic Review and Meta-Analysis.

Science.gov (United States)

Marseille, Elliot; Mirzazadeh, Ali; Biggs, M Antonia; P Miller, Amanda; Horvath, Hacsi; Lightfoot, Marguerita; Malekinejad, Mohsen; Kahn, James G

2018-05-01

School-based programs have been a mainstay of youth pregnancy prevention efforts in the USA. We conducted a systematic review and meta-analysis to assess their effectiveness. Eligible studies evaluated the effect on pregnancy rates of programs delivered in elementary, middle, or high schools in the USA and Canada, published between January 1985 and September 2016. The primary outcome was pregnancy; secondary outcomes were delay in sexual initiation, condom use, and oral contraception use. Randomized controlled trials (RCTs) and non-RCTs with comparator groups were eligible. We developed a comprehensive search strategy, applied to major bibliographic databases, article bibliographies, gray literature, and contact with authors. We calculated risk ratios (RR) with 95% confidence intervals (CI) for each outcome and pooled data in random effects meta-analysis. We used Grading of Recommendations Assessment, Development and Evaluation (GRADE) to assess evidence quality. Ten RCTs and 11 non-RCTs conducted from 1984 to 2016 yielded 30 unique pooled comparisons for pregnancy, of which 24 were not statistically significant. Six showed statistically significant changes in pregnancy rates: two with increased risk (RR 1.30, 95% CI 1.02-1.65; and RR 1.39, 95% CI 1.10-1.75) and four with decreased risk ranging from RR 0.56, 95% CI 0.41-0.77, to RR 0.75, 95% CI 0.58-0.96. All studies were at high risk of bias, and the quality of evidence was low or very low. Identified evidence indicated no consistent difference in rates of pregnancies between intervention recipients and controls.

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

School-Based Smoking Prevention Programs for Adolescents in South Korea: A Systematic Review

Science.gov (United States)

Park, Eunok

2006-01-01

The number of research papers evaluating programs designed to prevent adolescent smoking have increased in the last 13 years in Korea. The purpose of this study was to evaluate these programs, to review the features of the studies and to systemically assess the results on the knowledge about, and attitude to, smoking and smoking behavior. Database…

A systematic review of the efficacy of self-management programs for increasing physical activity in community-dwelling adults with acquired brain injury (ABI).

Science.gov (United States)

Jones, Taryn M; Dean, Catherine M; Hush, Julia M; Dear, Blake F; Titov, Nickolai

2015-04-19

Individuals living with acquired brain injury, typically caused by stroke or trauma, are far less likely to achieve recommended levels of physical activity for optimal health and well-being. With a growing number of people living with chronic disease and disability globally, self-management programs are seen as integral to the management of these conditions and the prevention of secondary health conditions. However, to date, there has been no systematic review of the literature examining the efficacy of self-management programs specifically on physical activity in individuals with acquired brain injury, whether delivered face-to-face or remotely. Therefore, the purpose of this review is to evaluate the efficacy of self-management programs in increasing physical activity levels in adults living in the community following acquired brain injury. The efficacy of remote versus face-to-face delivery was also examined. A systematic review of the literature was conducted. Electronic databases were searched. Two independent reviewers screened all studies for eligibility, assessed risk of bias, and extracted relevant data. Five studies met the inclusion criteria for this review. Studies were widely heterogeneous with respect to program content and delivery characteristics and outcomes, although all programs utilized behavioral change principles. Four of the five studies examined interventions in which physical activity was a component of a multifaceted intervention, where the depth to which physical activity specific content was covered, and the extent to which skills were taught and practiced, could not be clearly established. Three studies showed favorable physical activity outcomes following self-management interventions for stroke; however, risk of bias was high, and overall efficacy remains unclear. Although not used in isolation from face-to-face delivery, remote delivery via telephone was the predominant form of delivery in two studies with support for its inclusion

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Evaluation of a new method for librarian-mediated literature searches for systematic reviews

NARCIS (Netherlands)

W.M. Bramer (Wichor); Rethlefsen, M.L. (Melissa L.); F. Mast (Frans); J. Kleijnen (Jos)

2017-01-01

textabstractObjective: To evaluate and validate the time of completion and results of a new method of searching for systematic reviews, the exhaustive search method (ESM), using a pragmatic comparison. Methods: Single-line search strategies were prepared in a text document. Term completeness was

Fatigue in patients with low grade glioma: systematic evaluation of assessment and prevalence

NARCIS (Netherlands)

E.M.P. Van Coevorden-van Loon (Ellen M. P.); Coomans, M.B. (Marijke B.); M.H. Heijenbrok-Kal (Majanka); G.M. Ribbers (Gerard); M.J. van den Bent (Martin)

2017-01-01

textabstractFatigue is the most prevalent and disabling symptom in cancer patients. Yet, scientific literature on this topic is scarce and reports disparate results. This study systematically reviews how fatigue is assessed in patients with low-grade glioma and evaluates its prevalence in LGG

Hypothermia after cardiac arrest should be further evaluated-A systematic review of randomised trials with meta-analysis and trial sequential analysis

DEFF Research Database (Denmark)

Nielsen, Niklas; Friberg, Hans; Gluud, Christian

2011-01-01

BACKGROUND: Guidelines recommend mild induced hypothermia (MIH) to reduce mortality and neurological impairment after out-of-hospital cardiac arrest. Our objective was to systematically evaluate the evidence for MIH taking into consideration the risks of systematic and random error and to GRADE...... the evidence. METHODS: Systematic review with meta-analysis and trial sequential analysis of randomised trials evaluating MIH after cardiac arrest in adults. We searched CENTRAL, MEDLINE, and EMBASE databases until May 2009. Retrieved trials were evaluated with Cochrane methodology. Meta-analytic estimates....... The substantial risk of bias and concerns with directness rated down the quality of the evidence to low. CONCLUSIONS: Evidence regarding MIH after out-of-hospital cardiac arrest is still inconclusive and associated with non-negligible risks of systematic and random errors. Using GRADE-methodology, we conclude...

The impact of transitional care programs on health services utilization in community-dwelling older adults: a systematic review.

Science.gov (United States)

Weeks, Lori E; Macdonald, Marilyn; Martin-Misener, Ruth; Helwig, Melissa; Bishop, Andrea; Iduye, Damilola F; Moody, Elaine

2018-02-01

The objective was to identify and synthesize the best available evidence on the impact of transitional care programs on various forms of health services utilization in community-dwelling older adults. There is growing evidence that transitional care programs can help address important challenges facing health care systems and our increasing older adult population in many countries by reducing unnecessary health service utilization. There is a need for a systematic review of the research evaluating the impact of transitional care programs on hospital and other health service usage. The review included studies on community-dwelling adults age 60 and over with at least one medical diagnosis, and which evaluated the outcomes of transitional care programs on health system utilization of older adults. The outcomes for this review were hospital usage including admissions and readmissions, emergency department usage, primary care/physician usage, nursing home usage, and home health care usage. The review considered experimental and epidemiological study designs including randomized controlled trials, non-randomized controlled trials, quasi-experimental studies, before and after studies, prospective and retrospective cohort studies, and case-control studies. A three-step search was utilized to find published and unpublished studies conducted in any country but reported in English. Six electronic databases were searched from inception of the database to May, 2016. A search for unpublished studies was also conducted. Methodological quality was assessed independently by two reviewers using the Joanna Briggs Institute critical appraisal checklist for systematic reviews and research synthesis. Quantitative data were extracted from included studies independently by the two reviewers using the standardized Joanna Briggs Institute data extraction tools. Due to the methodological heterogeneity of the included studies, a comprehensive meta-analysis for all outcomes was not possible

Effects of Supervised vs. Unsupervised Training Programs on Balance and Muscle Strength in Older Adults: A Systematic Review and Meta-Analysis.

Science.gov (United States)

Lacroix, André; Hortobágyi, Tibor; Beurskens, Rainer; Granacher, Urs

2017-11-01

Balance and resistance training can improve healthy older adults' balance and muscle strength. Delivering such exercise programs at home without supervision may facilitate participation for older adults because they do not have to leave their homes. To date, no systematic literature analysis has been conducted to determine if supervision affects the effectiveness of these programs to improve healthy older adults' balance and muscle strength/power. The objective of this systematic review and meta-analysis was to quantify the effectiveness of supervised vs. unsupervised balance and/or resistance training programs on measures of balance and muscle strength/power in healthy older adults. In addition, the impact of supervision on training-induced adaptive processes was evaluated in the form of dose-response relationships by analyzing randomized controlled trials that compared supervised with unsupervised trials. A computerized systematic literature search was performed in the electronic databases PubMed, Web of Science, and SportDiscus to detect articles examining the role of supervision in balance and/or resistance training in older adults. The initially identified 6041 articles were systematically screened. Studies were included if they examined balance and/or resistance training in adults aged ≥65 years with no relevant diseases and registered at least one behavioral balance (e.g., time during single leg stance) and/or muscle strength/power outcome (e.g., time for 5-Times-Chair-Rise-Test). Finally, 11 studies were eligible for inclusion in this meta-analysis. Weighted mean standardized mean differences between subjects (SMD bs ) of supervised vs. unsupervised balance/resistance training studies were calculated. The included studies were coded for the following variables: number of participants, sex, age, number and type of interventions, type of balance/strength tests, and change (%) from pre- to post-intervention values. Additionally, we coded training according

A Review of Financial-Literacy Education Programs for Children and Adolescents

Science.gov (United States)

Amagir, Aisa; Groot, Wim; Maassen van den Brink, Henriëtte; Wilschut, Arie

2018-01-01

In this systematic literature review, we evaluate the effectiveness of financial-literacy education programs and interventions for children and adolescents. Furthermore, the key characteristics of the design of a successful financial-education curriculum are described. The evidence shows that school-based financial-education programs can improve…

Analysis phase of systematic approach to training (SAT) for nuclear plant personnel

International Nuclear Information System (INIS)

2000-08-01

The IAEA and many Member States have recognized the benefits of a systematic approach when training nuclear power plant personnel. The Systematic Approach to Training (SAT) fully described in the IAEA publications, is recommended as the best practice for attaining and maintaining the competence and qualification of NPP personnel. Typically, SAT is organised into distinct phases of Analysis, Design, Development, Implementation, and Evaluation, and relies on Feedback as a process for continuous improvement This document is addressed to nuclear power operating organisations facing the challenge of developing training programs for their own personnel. The intention was to provide Member States with examples of the Analysis phase to form foundation of SAT-based training programs. This document is also available in CD form

Effects of Group Counseling Programs, Cognitive Behavioral Therapy, and Sports Intervention on Internet Addiction in East Asia: A Systematic Review and Meta-Analysis.

Science.gov (United States)

Liu, Jun; Nie, Jing; Wang, Yafeng

2017-11-28

To evaluate the effects of group counseling programs, cognitive behavioral therapy (CBT), and sports intervention on Internet addiction (IA), a systematic search in ten databases was performed to identify eligible studies without language restrictions up to January 2017. A meta-analysis and trial sequential analysis (TSA) was performed, respectively. A total of 58 randomized controlled trials (RCTs), which included 2871 participants, were incorporated into our meta-analysis. The results showed that group counseling programs, CBT, and sports intervention could significantly reduce IA levels (group counseling program: standardized mean difference (SMD), -1.37; 95% confidence interval (CI), -1.89 to -0.85; CBT: SMD, -1.88; 95% CI, -2.53 to -1.23; sports intervention: SMD, -1.70; 95% CI, -2.14 to -1.26). For group counseling programs, this treatment was more effective in four dimensions of IA, including time management, interpersonal and health issues, tolerance, and compulsive Internet use. For CBT, this treatment yielded a positive change in depression, anxiousness, aggressiveness, somatization, social insecurity, phobic anxiety, paranoid ideation, and psychoticism. For sports intervention, the significant effects were also observed in all dimensions of the IA scale. Each of group counseling programs, cognitive behavioral therapy, and sports intervention had a significant effect on IA and psychopathological symptoms. Sports intervention could improve withdrawal symptoms especially.

Evaluating clinical ethics support in mental healthcare: a systematic literature review.

Science.gov (United States)

Hem, Marit Helene; Pedersen, Reidar; Norvoll, Reidun; Molewijk, Bert

2015-06-01

A systematic literature review on evaluation of clinical ethics support services in mental healthcare is presented and discussed. The focus was on (a) forms of clinical ethics support services, (b) evaluation of clinical ethics support services, (c) contexts and participants and (d) results. Five studies were included. The ethics support activities described were moral case deliberations and ethics rounds. Different qualitative and quantitative research methods were utilized. The results show that (a) participants felt that they gained an increased insight into moral issues through systematic reflection; (b) there was improved cooperation among multidisciplinary team members; (c) it was uncertain whether clinical ethics support services led to better patient care; (d) the issue of patient and client participation is complex; and (e) the implementation process is challenging. Clinical ethics support services have mainly been studied through the experiences of the participating facilitators and healthcare professionals. Hence, there is limited knowledge of whether and how various types of clinical ethics support services influence the quality of care and how patients and relatives may evaluate clinical ethics support services. Based on the six excluded 'grey zone articles', in which there was an implicit focus on ethics reflection, other ways of working with ethical reflection in practice are discussed. Implementing and evaluating clinical ethics support services as approaches to clinical ethics support that are more integrated into the development of good practice are in focus. In order to meet some of the shortcomings of the field of clinical ethics support services, a research project that aims to strengthen ethics support in the mental health services, including patients' and caregivers' views on ethical challenges, is presented. © The Author(s) 2014.

Systematic reviews in Library and Information Science: analysis and evaluation of the search process

Directory of Open Access Journals (Sweden)

José Antonio Salvador-Oliván

2018-05-01

Full Text Available Objective: An essential component of a systematic review is the development and execution of a literature search to identify all available and relevant published studies. The main objective of this study is to analyse and evaluate whether the systematic reviews in Library and Information Science (LIS provide complete information on all the elements that make up the search process. Methods: A search was launched in WOS, Scopus, LISTA, Library Science Database, Medline databases and a wiki published from 2000 to February 2017, in order to find and identify systematic reviews. The search was designed to find those records whose titles included the words “systematic review” and/or “meta-analysis”. A list was created with the twelve items recommended from of the main publication guides, to assess the information degree on each of them. Results and conclusions: Most of the reviews in LIS are created by information professionals. From the 94 systematic reviews selected for analysis, it was found that only a 4.3% provided the complete reporting on the search method. The most frequently included item is the name of the database (95.6% and the least one is the name of the host (35.8%. It is necessary to improve and complete the information about the search processes in the complete reports from LIS systematic reviews for reproducibility, updating and quality assessment improvement.

Health benefits of aerobic training programs in adults aged 70 and over: a systematic review.

Science.gov (United States)

Bouaziz, Walid; Vogel, Thomas; Schmitt, Elise; Kaltenbach, Georges; Geny, Bernard; Lang, Pierre Olivier

Aging is intrinsically associated with a progressive decline in muscle strength and mass, and aerobic capacity. This contributes to reduced mobility and impaired quality of life (QoL) among seniors. Regular physical activity, and more particularly aerobic training (AT), has demonstrated benefits on adults' health. The aim of this review was to assess the current level of evidence regarding the health benefits of AT in the population aged 70 years and over. A comprehensive, systematic database search for manuscripts was performed. Two reviewers independently assessed interventional studies for potential inclusion. Cardiovascular, metabolic, functional, cognitive, and QoL outcomes were targeted. Fifty-three studies were included totalling 2051 seniors aged 70 years and over. Studies selected were divided into 5 categories according to their main outcomes: cardiovascular function (34 studies), metabolic outcomes (26 studies), functional fitness (19 studies), cognitive functions (8 studies), and QoL (3 studies). With a good level of evidence but a wide heterogeneity between study designs, a significant and beneficial effect of AT was measured on the 5 outcomes. For QoL results showed a significant but slighter improvement. This systematic review highlights the benefits of AT on seniors' health outcome such as cardiovascular, functional, metabolic, cognitive, and QoL outcomes although the optimal program remains unclear. When more studies regarding this specific population are needed to determine the most favourable exercise program, clinicians should nevertheless encourage older adults over 70 to participate in AT programs to favour active and healthy ageing. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Process Evaluation for a Prison-based Substance Abuse Program.

Science.gov (United States)

Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

2000-01-01

Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Anger Management - Evaluation of a Cognitive-Behavioral Training Program for Table Tennis Players

Directory of Open Access Journals (Sweden)

Steffgen Georges

2017-01-01

Full Text Available Based on a systematic review of the literature on anger and anger management in sport, there is evidence that anger might be dysfunctional, especially in sports requiring selective attention and fine-tuned motor skills. The research literature suggests that cognitive-behavioral intervention programs can be fruitful in helping athletes to understand and control dysfunctional anger. Therefore, the main goal of the present study was to evaluate the effectiveness of a brief training program for table tennis players in cognitive-behavioral anger management that aimed at changing their noneffective anger reactions. The sample comprised 18 young competitive table tennis players (age range from 16 to 22 years divided randomly into a treatment (n = 10 and a control group (n = 8. A trained group leader instructed the treatment group. Six sessions were held over a period of two months. Cognitive-relaxation coping skills associated with social skills of subjects from the treatment group were compared to no-treatment controls. Psychological measurements (i.e., self-reports on anger were applied before, during and after treatment as well as in a follow-up session. The one-year follow-up session revealed that, in contrast to the control group, the treatment group showed a significant reduction in outwardly negative anger expression as well as anger reactions specific to table tennis. Despite limitations inherent in the research design, the training program was deemed effective.

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

Systematic review of economic evaluation analyses of available vaccines in Spain from 1990 to 2012.

Science.gov (United States)

Cortés, Isabel; Pérez-Camarero, Santiago; Del Llano, Juan; Peña, Luz María; Hidalgo-Vega, Alvaro

2013-08-02

The objective of this survey was to describe the evolution of economic evaluation studies on vaccines available in Spain. We conducted a systematic review of the economic evaluations published by Spanish researchers in major bibliographic databases available online from 1990 to 2012. For all references identified, we limited them to full economic evaluation carried out in Spanish vaccine programs. The following variables were analyzed: type of study, year of publication, vaccine evaluated, the herd immunity and the main methodological aspects proposed by international guidelines. The type of vaccines studied were Hepatitis A and B, Rotavirus, Influenza, Varicella, Tetanus, Measles, Human papillomavirus, Streptococcus pneumoniae infection and Neisseria meningitides serogroup C infection. A total of 34 references was included in the study. The number of economic evaluations has been increasing over the years by 86%. For many of the vaccines there were no economic evaluations, while others such as the vaccine against S. pneumoniae infection took up most of the studies. The non-vaccinated comparison was the most used strategy. The cost-effectiveness model was selected in 60% of cases. The most common health outcome was "cost per case prevented" and in 82% of the studies did not consider herd immunity. The results showed a cost-effectiveness ratio which was below breakeven. It is clear that the existence of a huge gap in this kind of work compared to other countries. Although the quality of the work discussed here was significant, we found many areas which could be improved. The reviewed literature exposed the great benefit of vaccination for society by analysing the health outcomes achieved for decades since its implementation. However, the evidence on the efficiency and effectiveness vaccination is not very high, and there are few studies about economic evaluation. Copyright © 2013 Elsevier Ltd. All rights reserved.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

Programs to increase high school completion: a community guide systematic health equity review.

Science.gov (United States)

Hahn, Robert A; Knopf, John A; Wilson, Sandra Jo; Truman, Benedict I; Milstein, Bobby; Johnson, Robert L; Fielding, Jonathan E; Muntaner, Carles J M; Jones, Camara Phyllis; Fullilove, Mindy T; Moss, Regina Davis; Ueffing, Erin; Hunt, Pete C

2015-05-01

High school completion (HSC) is an established predictor of long-term morbidity and mortality. U.S. rates of HSC are substantially lower among students from low-income families and most racial/ethnic minority populations than students from high-income families and the non-Hispanic white population. This systematic review assesses the effectiveness of programs to increase HSC and the potential of these programs to improve lifelong health among at-risk students. A search located a meta-analysis (search period 1985-2010/2011) on the effects of programs to increase HSC or General Educational Development (GED) diploma receipt; the meta-analysis was concordant with Community Guide definitions and methodologic standards. Programs were assessed separately for the general student population (152 studies) and students who were parents or pregnant (15 studies). A search for studies published between 2010 and August 2012 located ten more recent studies, which were assessed for consistency with the meta-analysis. Analyses were conducted in 2013. The review focused on the meta-analysis. Program effectiveness was measured as the increased rate of HSC (or GED receipt) by the intervention group compared with controls. All assessed program types were effective in increasing HSC in the general student population: vocational training, alternative schooling, social-emotional skills training, college-oriented programming, mentoring and counseling, supplemental academic services, school and class restructuring, multiservice packages, attendance monitoring and contingencies, community service, and case management. For students who had children or were pregnant, attendance monitoring and multiservice packages were effective. Ten studies published after the search period for the meta-analysis were consistent with its findings. There is strong evidence that a variety of HSC programs can improve high school or GED completion rates. Because many programs are targeted to high-risk students and

Impact of Aspect-Oriented Programming on the Quality of Novices’ Programs: A Comparative Study

Directory of Open Access Journals (Sweden)

Marija Katic

2013-06-01

Full Text Available Aspect-oriented programming has been introduced in order to increase the modularity of object-oriented programs and is claimed to improve software quality. Although there are various researches on this claim, the question to what extent aspect-oriented programming improves the quality of programs depending on a developer’s experience still remains. The purpose of this study is to investigate whether aspect-oriented programming used by novice programmers improves the quality of programs, in terms of software flexibility and readability (consequently reusability and maintainability as well. As a part of an undergraduate course in programming paradigms and languages, a systematic comparison between students’ object-oriented and aspect-oriented solutions of the same problem was driven. In order to drive this comparison we have established the basis for the development of the new quality assessment model consisting of software metrics for an objective evaluation and student survey for subjective evaluation. The results show that the use of aspect-oriented programming lead to novices’ programs that are easier to change and read (flexible and readable compared to object-oriented programs. What is more, administered survey showed that students perceive their programs as more flexible and readable.

[Economic evaluation on breast cancer screening in mainland China: a systematic review].

Science.gov (United States)

Wang, L; Shi, J F; Huang, H Y; Zhu, J; Li, J; Fang, Y; Dai, M

2016-12-10

Objective: To gather available evidence related to the economic evaluation on breast cancer screening in mainland China and to provide reference for further research. Methods: A systematic review was conducted to identify articles in PubMed and three Chinese databases (CNKI, Wanfang and VIP) during 1995-2015. Data related to descriptive characteristics, rates on participation and detection for population-based studies, methods for model-based studies, types of economic evaluation and results, were extracted. A Consolidated Health Economic Evaluation Reporting Standards (CHEERS) was used to assess the reporting quality of included studies. Results: Of the 356 records searched in the databases, 13 studies (all published between 2012 and 2015) were included in the current paper involving 11 population-based studies and 3 model-based evaluations (1 study using both methods). Age of the participants who started to be engaged in the screening program ranged from 18 to 45 years old, but terminated at the age of 59 years or older. The screening modalities included single-used clinical breast examination, mammography and ultrasound or combined applications. Study persepectives were described in 7 studies, with 5 from the healthcare providers, and 2 from societal angles. Only 5 studies discounted cost or effectiveness. Out of 11 papers, 9 showed the results on cost-effectiveness analysis (CEA) that reporting the cost per breast cancer detection, with median as 145.0 thousand Chinese Yuan (CNY), ranging from 49.7 thousand to 2 293.0 thousand CNY. From 4 papers with results of cost-utility analysis (CUA), the cost per quality adjusted life year (QALY) gained or cost per disability adjusted life year (DALY) averted, were evaluated. The incremental cost-effectiveness ratio (ICER) was from 2.9 thousand to 270.7 thousand CNY (GDP per capita of China was CNY 49.3 thousand in 2015). In 13 studies, the quality of reporting varied, with an average score of 14.5 (range: 9.5-21.0). In

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

Methods for systematic reviews of health economic evaluations: a systematic review, comparison, and synthesis of method literature.

Science.gov (United States)

Mathes, Tim; Walgenbach, Maren; Antoine, Sunya-Lee; Pieper, Dawid; Eikermann, Michaela

2014-10-01

The quality of systematic reviews of health economic evaluations (SR-HE) is often limited because of methodological shortcomings. One reason for this poor quality is that there are no established standards for the preparation of SR-HE. The objective of this study is to compare existing methods and suggest best practices for the preparation of SR-HE. To identify the relevant methodological literature on SR-HE, a systematic literature search was performed in Embase, Medline, the National Health System Economic Evaluation Database, the Health Technology Assessment Database, and the Cochrane methodology register, and webpages of international health technology assessment agencies were searched. The study selection was performed independently by 2 reviewers. Data were extracted by one reviewer and verified by a second reviewer. On the basis of the overlaps in the recommendations for the methods of SR-HE in the included papers, suggestions for best practices for the preparation of SR-HE were developed. Nineteen relevant publications were identified. The recommendations within them often differed. However, for most process steps there was some overlap between recommendations for the methods of preparation. The overlaps were taken as basis on which to develop suggestions for the following process steps of preparation: defining the research question, developing eligibility criteria, conducting a literature search, selecting studies, assessing the methodological study quality, assessing transferability, and synthesizing data. The differences in the proposed recommendations are not always explainable by the focus on certain evaluation types, target audiences, or integration in the decision process. Currently, there seem to be no standard methods for the preparation of SR-HE. The suggestions presented here can contribute to the harmonization of methods for the preparation of SR-HE. © The Author(s) 2014.

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

Employer-Based Programs to Support Breastfeeding Among Working Mothers: A Systematic Review.

Science.gov (United States)

Dinour, Lauren M; Szaro, Jacalyn M

2017-04-01

Many mothers experience barriers to maintaining a breastfeeding relationship with their infants upon returning to work and, consequently, terminate breastfeeding earlier than recommended or intended. As such, employers are in a unique position to help further increase breastfeeding rates, durations, and exclusivity. The purpose of this review is to examine the literature regarding employer-based programs, policies, and interventions to support breastfeeding among working mothers. A systematic literature search was conducted for peer-reviewed articles published before April 2016. Studies were included if they focused on workplace-based lactation/breastfeeding support programs, policies, or interventions to promote breastfeeding among employees. For inclusion, articles must have measured at least one outcome, such as breastfeeding duration, breastfeeding exclusivity, or employee satisfaction. Twenty-two articles were included, representing 10 different countries and both public- and private-sector employers, including governmental offices, schools, hospitals, manufacturing/industrial companies, and financial settings, among others. Providing a lactation space was the most common employer-based support accommodation studied, followed by breastfeeding breaks and comprehensive lactation support programs. The majority of studies analyzing these three support types found at least one positive breastfeeding and/or nonbreastfeeding outcome. This review suggests that maintaining breastfeeding while working is not only possible but also more likely when employers provide the supports that women need to do so. Although some employers may have more extensive breastfeeding support policies and practices than others, all employers can implement a breastfeeding support program that fits their company's budget and resources.

Overview of the NRC performance monitoring program

International Nuclear Information System (INIS)

Jordan, E.L.

1987-01-01

In response to the accident at Three Mile Island, the NRC developed the Systematic Assessment of Licensee Performance (SALP) Program to aid in the identification of those licensees that were more likely than others to have safety problems and to provide a rational basis for allocation of inspection resources. The NRC also has an ongoing program of screening and evaluating operating reactor event reports on a daily basis for promptly identifying safety problems. Although the SALP and event report evaluation programs have been successful in identifying potential performance problems, a concern developed recently about the adequacy and timeliness of NRC programs to detect poor or declining performance. The performance indicator program as approved by the commission is in the implementation phase. The program is expected to undergo refinements as new indicators are developed and experience is gained in the use of indicators

Evaluation of a cancer exercise program: patient and physician beliefs.

Science.gov (United States)

Peeters, C; Stewart, A; Segal, R; Wouterloot, E; Scott, C G; Aubry, T

2009-08-01

Participation in an exercise intervention during cancer treatment diminishes the side effects associated with cancer therapies, although such benefits vary according to the disease and the patient characteristics. A structured exercise program providing an individualized fitness program tailored to the patients' illness, treatment, and fitness level would address this variability. However, the need, desired components, and anticipated barriers of such a program have not been systematically explored from either the point of view of cancer patients or treating oncologists. Sixty-six cancer patients and 18 medical and radiation oncologists were surveyed on the above variables. Cancer patients and oncologists alike perceived a need for a structured exercise program during and after medical treatment for cancer. Among cancer patients, the most commonly preferred feature was access to consultation with an exercise specialist who could take into account the patient's previous exercise and medical history. Over a third of patients reported interest in a hospital-based fitness program. Oncologists were in favor of appropriate supervision of patients during exercise, and noted insufficient time to discuss exercise in their practice. Respondents noted time and parking as barriers to participation. Overall, results support the need for a supervised exercise program during active treatment for cancer and highlight the desired features of such a program.

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Usability evaluation techniques in mobile commerce applications: A systematic review

Science.gov (United States)

Hussain, Azham; Mkpojiogu, Emmanuel O. C.

2016-08-01

Obviously, there are a number of literatures concerning the usability of mobile commerce (m-commerce) applications and related areas, but they do not adequately provide knowledge about usability techniques used in most of the empirical usability evaluation for m-commerce application. Therefore, this paper is aimed at producing the usability techniques frequently used in the aspect of usability evaluation for m-commerce applications. To achieve the stated objective, systematic literature review was employed. Sixty seven papers were downloaded in usability evaluation for m-commerce and related areas; twenty one most relevant studies were selected for review in order to extract the appropriate information. The results from the review shows that heuristic evaluation, formal test and think aloud methods are the most commonly used methods in m-commerce application in comparison to cognitive walkthrough and the informal test methods. Moreover, most of the studies applied control experiment (33.3% of the total studies); other studies that applied case study for usability evaluation are 14.28%. The results from this paper provide additional knowledge to the usability practitioners and research community for the current state and use of usability techniques in m-commerce application.

Mentoring Nontenured Track Nursing Faculty: A Systematic Review.

Science.gov (United States)

Cullen, Deborah; Shieh, Carol; McLennon, Susan M; Pike, Caitlin; Hartman, Taylor; Shah, Hena

The purpose of this systematic review was to evaluate the effectiveness of mentoring strategies for nursing faculty progression and productivity in the nontenure track at institutions of higher education. Sixty articles were included in the review. Findings revealed that nontenure track nursing faculty require planned programs and mentoring strategies unique to their role and abilities. Schools of nursing can improve on faculty progression, scholarship, and career growth by providing structured mentoring activity.

Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

Science.gov (United States)

Maher, Charles A.

1981-01-01

Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

Framework of Comprehensive Proliferation Resistance Evaluation Methodology

International Nuclear Information System (INIS)

Kim, Min Su; Jo, Seong Youn; Kim, Min Soo; Kim, Jae San; Lee, Hyun Kyung

2007-01-01

Civilian nuclear programs can be used as a pretext to acquire technologies, materials, equipment for military weapon programs. Consequently, international society has a strong incentive to develop a nuclear system more proliferation resistant to assure that the civilian nuclear energy system is an unattractive and least desirable route for diversion of weapon usable material. The First step developing a more proliferation resistant nuclear energy system is to develop a systematic and standardized evaluation methodology to ensure that any future nuclear energy system satisfies the proliferation resistance goals. Many attempts to develop systematic evaluation methodology have been proposed and many systems for assessing proliferation resistance have been previously studied. However, a comprehensive proliferation resistance evaluation can not be achieved by simply applying one method since complicated proliferation resistance characteristics, including inherent features and extrinsic features, should be completely evaluated. Therefore, it is necessary to develop one incorporated evaluation methodology to make up for weak points of each evaluation method. The objective of this study is to provide a framework of comprehensive proliferation resistance evaluation methodology by incorporating two generally used evaluation methods, attribute and scenario analysis