Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

Evaluation of a Positive Youth Development Program Based on the Repertory Grid Test

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2012-01-01

Full Text Available The repertory grid test, based on personal construct psychology, was used to evaluate the effectiveness of Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes in Hong Kong. One hundred and four program participants (n=104 were randomly invited to complete a repertory grid based on personal construct theory in order to provide both quantitative and qualitative data for measuring self-identity changes after joining the program. Findings generally showed that the participants perceived that they understood themselves better and had stronger resilience after joining the program. Participants also saw themselves as closer to their ideal selves and other positive role figures (but farther away from a loser after joining the program. This study provides additional support for the effectiveness of the Tier 1 Program of Project P.A.T.H.S. in the Chinese context. This study also shows that the repertory grid test is a useful evaluation method to measure self-identity changes in participants in positive youth development programs.

Evaluation of school-based reproductive health education program for adolescent girls.

Science.gov (United States)

Golbasi, Zehra; Taskin, Lale

2009-01-01

To evaluate the effectiveness of school-based reproductive health education for adolescent girls on the reproductive knowledge level of the girls. This research was carried out as a quasi-experimental study at two vocational girls high schools, one of which was used as the study school and the other as the control school. The study group (97 students) consisted of three classes representing every grade. The control group consisted of students selected likewise (92 students). Reproductive health education was given to students in the study group for 10 weeks; the control group was not subjected to any educational program. The impact of the program was evaluated with reproductive health knowledge test designed for this study. A pretest evaluated baseline knowledge, and a posttest measured the gain in knowledge. Baseline knowledge score of students in study and control group were similar and low (p > 0.05). We found that the reproductive health knowledge level of students in the study group increased significantly after the program of education. Post-test knowledge scores (75.03 +/- 13.82) of the students in the study group were higher than those of the control group (36.65 +/- 14.17). The results showed students' low baseline knowledge and a good ability to learn. A school-based reproductive health education is needed to promote knowledge and prevention in reproductive health among teenagers.

Evaluation of a preschool nutrition education program based on the theory of multiple intelligences.

Science.gov (United States)

Cason, K L

2001-01-01

This report describes the evaluation of a preschool nutrition education program based on the theory of multiple intelligences. Forty-six nutrition educators provided a series of 12 lessons to 6102 preschool-age children. The program was evaluated using a pretest/post-test design to assess differences in fruit and vegetable identification, healthy snack choices, willingness to taste foods, and eating behaviors. Subjects showed significant improvement in food identification and recognition, healthy snack identification, willingness to taste foods, and frequency of fruit, vegetable, meat, and dairy consumption. The evaluation indicates that the program was an effective approach for educating preschool children about nutrition.

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Evaluating the Navy’s Enlisted Accessions Testing Program Based on Future Talent Needs

Science.gov (United States)

2017-03-01

NAVY’S ENLISTED ACCESSIONS TESTING PROGRAM BASED ON FUTURE TALENT NEEDS by Shereka F. Riley March 2017 Thesis Advisor: Joseph Sullivan Co...REPORT TYPE AND DATES COVERED Master’s thesis 4. TITLE AND SUBTITLE EVALUATING THE NAVY’S ENLISTED ACCESSIONS TESTING PROGRAM BASED ON FUTURE TALENT ...public release. Distribution is unlimited. 12b. DISTRIBUTION CODE 13. ABSTRACT (maximum 200 words) In recent years, non-defense related industries

Theory-Based Stakeholder Evaluation

Science.gov (United States)

Hansen, Morten Balle; Vedung, Evert

2010-01-01

This article introduces a new approach to program theory evaluation called theory-based stakeholder evaluation or the TSE model for short. Most theory-based approaches are program theory driven and some are stakeholder oriented as well. Practically, all of the latter fuse the program perceptions of the various stakeholder groups into one unitary…

A School-Based Dental Program Evaluation: Comparison to the Massachusetts Statewide Survey.

Science.gov (United States)

Culler, Corinna S; Kotelchuck, Milton; Declercq, Eugene; Kuhlthau, Karen; Jones, Kari; Yoder, Karen M

2017-10-01

School-based dental programs target high-risk communities and reduce barriers to obtaining dental services by delivering care to students in their schools. We describe the evaluation of a school-based dental program operating in Chelsea, a city north of Boston, with a low-income and largely minority population, by comparing participants' oral health to a Massachusetts oral health assessment. Standardized dental screenings were conducted for students in kindergarten, third, and sixth grades. Outcomes were compared in bivariate analysis, stratified by grade and income levels. A greater percentage of Chelsea students had untreated decay and severe treatment need than students statewide. Yet, fewer Chelsea third graders had severe treatment need, and more had dental sealants. There was no significant difference in the percentage of Chelsea students having severe treatment need or dental sealants by income level. Students participating in our program do not have lower decay levels than students statewide. However, they do have lower levels of severe treatment need, likely due to treatment referrals. Our results confirm that school-based prevention programs can lead to increased prevalence of dental sealants among high-risk populations. Results provide support for the establishment of full-service school-based programs in similar communities. © 2017, American School Health Association.

Evaluating Fast Maximum Likelihood-Based Phylogenetic Programs Using Empirical Phylogenomic Data Sets

Science.gov (United States)

Zhou, Xiaofan; Shen, Xing-Xing; Hittinger, Chris Todd

2018-01-01

Abstract The sizes of the data matrices assembled to resolve branches of the tree of life have increased dramatically, motivating the development of programs for fast, yet accurate, inference. For example, several different fast programs have been developed in the very popular maximum likelihood framework, including RAxML/ExaML, PhyML, IQ-TREE, and FastTree. Although these programs are widely used, a systematic evaluation and comparison of their performance using empirical genome-scale data matrices has so far been lacking. To address this question, we evaluated these four programs on 19 empirical phylogenomic data sets with hundreds to thousands of genes and up to 200 taxa with respect to likelihood maximization, tree topology, and computational speed. For single-gene tree inference, we found that the more exhaustive and slower strategies (ten searches per alignment) outperformed faster strategies (one tree search per alignment) using RAxML, PhyML, or IQ-TREE. Interestingly, single-gene trees inferred by the three programs yielded comparable coalescent-based species tree estimations. For concatenation-based species tree inference, IQ-TREE consistently achieved the best-observed likelihoods for all data sets, and RAxML/ExaML was a close second. In contrast, PhyML often failed to complete concatenation-based analyses, whereas FastTree was the fastest but generated lower likelihood values and more dissimilar tree topologies in both types of analyses. Finally, data matrix properties, such as the number of taxa and the strength of phylogenetic signal, sometimes substantially influenced the programs’ relative performance. Our results provide real-world gene and species tree phylogenetic inference benchmarks to inform the design and execution of large-scale phylogenomic data analyses. PMID:29177474

Evaluation of Monticello Nuclear Power Plant, Environmental Impact Prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1976-11-01

This report evaluates quantitatively the nonradiological environmental monitoring programs at Monticello Nuclear Generating Plant. The general objective of the study is to assess the effectiveness of monitoring programs in the measurement of environmental impacts. Specific objectives include the following: (1) Assess the validity of environmental impact predictions made in the Environmental Statement by analysis of nonradiological monitoring data; (2) evaluate the general adequacy of environmental monitoring programs for detecting impacts and their responsiveness to Technical Specifications objectives; (3) assess the adequacy of preoperational monitoring programs in providing a sufficient data base for evaluating operational impacts; (4) identify possible impacts that were not predicted in the environmental statement and identify monitoring activities that need to be added, modified or deleted; and (5) assist in identifying environmental impacts, monitoring methods, and measurement problems that need additional research before quantitative predictions can be attempted. Preoperational as well as operational monitoring data were examined to test the usefulness of baseline information in evaluating impacts. This included an examination of the analytical methods used to measure ecological and physical parameters, and an assessment of sampling periodicity and sensitivity where appropriate data were available

Building an Evaluation Framework for a Competency-Based Graduate Program at the University Of Southern Mississippi

Science.gov (United States)

Gaudet, Cyndi H.; Annulis, Heather M.; Kmiec, John J., Jr.

2008-01-01

This article describes an ongoing project to build a comprehensive evaluation framework for the competency-based Master of Science in Workforce Training and Development (MSWTD) program at The University of Southern Mississippi (USM). First, it discusses some trends and issues in evaluating the performance of higher education programs in the United…

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Process evaluation of a school-based weight gain prevention program: the Dutch Obesity Intervention in Teenagers (DOiT)

NARCIS (Netherlands)

Singh, A.S.; Chin A Paw, J.M.M.; Brug, J.; Mechelen, van W.

2009-01-01

Health promotion programs benefit from an accompanying process evaluation since it can provide more insight in the strengths and weaknesses of a program. A process evaluation was conducted to assess the reach, implementation, satisfaction and maintenance of a school-based program aimed at the

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Development and process evaluation of a Web-based responsible beverage service training program.

Science.gov (United States)

Danaher, Brian G; Dresser, Jack; Shaw, Tracy; Severson, Herbert H; Tyler, Milagra S; Maxwell, Elisabeth D; Christiansen, Steve M

2012-09-22

Responsible beverage service (RBS) training designed to improve the appropriate service of alcohol in commercial establishments is typically delivered in workshops. Recently, Web-based RBS training programs have emerged. This report describes the formative development and subsequent design of an innovative Web-delivered RBS program, and evaluation of the impact of the program on servers' knowledge, attitudes, and self-efficacy. Formative procedures using focus groups and usability testing were used to develop a Web-based RBS training program. Professional alcohol servers (N = 112) who worked as servers and/or mangers in alcohol service settings were recruited to participate. A pre-post assessment design was used to assess changes associated with using the program. Participants who used the program showed significant improvements in their RBS knowledge, attitudes, and self-efficacy. Although the current study did not directly observe and determine impact of the intervention on server behaviors, it demonstrated that the development process incorporating input from a multidisciplinary team in conjunction with feedback from end-users resulted in creation of a Web-based RBS program that was well-received by servers and that changed relevant knowledge, attitudes, and self-efficacy. The results also help to establish a needed evidence base in support of the use of online RBS training, which has been afforded little research attention.

The development of macros program-based cognitive evaluation model via e-learning course mathematics in senior high school based on curriculum 2013

Directory of Open Access Journals (Sweden)

Djoko Purnomo

2017-02-01

Full Text Available The specific purpose of this research is: The implementation of the application of the learning tool with a form cognitive learning evaluation model based macros program via E-learning at High School grade X at july-december based on 2013 curriculum. The method used in this research followed the procedures is research and development by Borg and Gall [2]. In second year, population analysis has conducted at several universities in Semarang. The results of the research and application development of macro program-based cognitive evaluation model is effective which can be seen from (1 the student learning result is over KKM, (2 The student independency affects learning result positively, (3 the student learning a result by using macros program-based cognitive evaluation model is better than students class control. Based on the results above, the development of macros program-based cognitive evaluation model that have been tested have met quality standards according to Akker (1999. Large-scale testing includes operational phase of field testing and final product revision, i.e trials in the wider class that includes students in mathematics education major in several universities, they are the Universitas PGRI Semarang, Universitas Islam Sultan Agung and the Universitas Islam NegeriWalisongo Semarang. The positive responses is given by students at the Universitas PGRI Semarang, Universitas Islam Sultan Agung and the Universitas Islam NegeriWalisongo Semarang.

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Evaluation of the effectiveness of a school-based cannabis prevention program.

Science.gov (United States)

Ariza, Carles; Pérez, Anna; Sánchez-Martínez, Francesca; Diéguez, Marta; Espelt, Albert; Pasarín, M Isabel; Suelves, Josep M; De la Torre, Rafael; Nebot, Manuel

2013-09-01

The effectiveness of a cannabis prevention program in high school students was assessed. A quasi-experimental study was designed to evaluate the effectiveness of an intervention implemented in an intervention group (IG) with 39 schools compared with a control group (CG) of 47 schools not exposed to the intervention. Of 224 secondary schools in Barcelona, 86 were assessed in the 2005-2006 school year through a personal questionnaire administered at baseline and 15 months after the intervention. Participants consisted of 4848 ninth graders (14-15 year-olds), 2803 assigned to the IG and 2043 to the CG, according to the type and size of the school and the socioeconomic status of the school's neighborhood. The intervention consisted of a school-based cannabis prevention program (xkpts.com), with four sessions and 16 activities, implemented over 6-10h, with materials for parents and web-based student involvement. Last-month cannabis use was assessed at baseline and at 15 months' follow-up. Process evaluation indicators were assessed. At 15 months follow-up, 8.2% of boys and 8.3% of girls in the IG became last-month cannabis users versus 11.8% of boys and 11.6% of girls in the CG. These differences were statistically significant (p=0.003), representing a 29% reduction in last-month cannabis users in the IG compared with the CG. The incidence of last-month cannabis use was lowest in classrooms that adhered to the program protocol. The xkpts.com program was effective in preventing progression to last-month cannabis use. Effectiveness was higher in classrooms that adhered closely to the protocol. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Risk-based Regulatory Evaluation Program methodology

International Nuclear Information System (INIS)

DuCharme, A.R.; Sanders, G.A.; Carlson, D.D.; Asselin, S.V.

1987-01-01

The objectives of this DOE-supported Regulatory Evaluation Progrwam are to analyze and evaluate the safety importance and economic significance of existing regulatory guidance in order to assist in the improvement of the regulatory process for current generation and future design reactors. A risk-based cost-benefit methodology was developed to evaluate the safety benefit and cost of specific regulations or Standard Review Plan sections. Risk-based methods can be used in lieu of or in combination with deterministic methods in developing regulatory requirements and reaching regulatory decisions

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Shortening the Miles to the Milestones: Connecting EPA-Based Evaluations to ACGME Milestone Reports for Internal Medicine Residency Programs.

Science.gov (United States)

Choe, John H; Knight, Christopher L; Stiling, Rebekah; Corning, Kelli; Lock, Keli; Steinberg, Kenneth P

2016-07-01

The Next Accreditation System requires internal medicine training programs to provide the Accreditation Council for Graduate Medical Education (ACGME) with semiannual information about each resident's progress in 22 subcompetency domains. Evaluation of resident "trustworthiness" in performing entrustable professional activities (EPAs) may offer a more tangible assessment construct than evaluations based on expectations of usual progression toward competence. However, translating results from EPA-based evaluations into ACGME milestone progress reports has proven to be challenging because the constructs that underlay these two systems differ.The authors describe a process to bridge the gap between rotation-specific EPA-based evaluations and ACGME milestone reporting. Developed at the University of Washington in 2012 and 2013, this method involves mapping EPA-based evaluation responses to "milestone elements," the narrative descriptions within the columns of each of the 22 internal medicine subcompetencies. As faculty members complete EPA-based evaluations, the mapped milestone elements are automatically marked as "confirmed." Programs can maintain a database that tallies the number of times each milestone element is confirmed for a resident; these data can be used to produce graphical displays of resident progress along the internal medicine milestones.Using this count of milestone elements allows programs to bridge the gap between faculty assessments of residents based on rotation-specific observed activities and semiannual ACGME reports based on the internal medicine milestones. Although potentially useful for all programs, this method is especially beneficial to large programs where clinical competency committee members may not have the opportunity for direct observation of all residents.

Evaluation of Teen Cuisine: An Extension-Based Cooking Program to Increase Self-efficacy in Teens

OpenAIRE

Petty, Heather Keyronica

2016-01-01

Heather K. Petty ABSTRACT Title: Evaluation of Teen Cuisine: An Extension-Based Cooking Program to Increase Self-efficacy in Teens Background: Childhood, adolescent, and adult obesity is a major health and economic concern affecting the United States and various countries across the globe. Obese children and adolescents are at a potential risk for developing certain chronic diseases as they transition into adulthood. There are community-based cooking intervention programs designed t...

Topics in Semantics-based Program Manipulation

DEFF Research Database (Denmark)

Grobauer, Bernt

four articles in the field of semantics-based techniques for program manipulation: three articles are about partial evaluation, a method for program specialization; the fourth article treats an approach to automatic cost analysis. Partial evaluation optimizes programs by specializing them with respect...... article in this dissertation describes how the second Futamura projection can be achieved for type-directed partial evaluation (TDPE), a relatively recent approach to partial evaluation: We derive an ML implementation of the second Futamura projection for TDPE. Due to the differences between ‘traditional...... denotational semantics—allows us to relate various possible semantics to each other both conceptually and formally. We thus are able to explain goal-directed evaluation using an intuitive list-based semantics, while using a continuation semantics for semantics-based compilation through partial evaluation...

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

Science.gov (United States)

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

Approximately 474 000 Indigenous people live in 617 First Nations communities across Canada; 125 of those communities are located in Ontario, primarily in rural and remote areas. Common rural health challenges, including for palliative care, involve quality and access. The need for culturally relevant palliative care programs in First Nations communities is urgent because the population is aging with a high burden of chronic and terminal disease. Because local palliative care is lacking, most First Nations people now leave their culture, family and community to receive care in distant hospitals or long-term care homes. Due to jurisdictional issues, a policy gap exists where neither federal nor provincial governments takes responsibility for funding palliative care in First Nations communities. Further, no Canadian program models existed for how different levels of government can collaborate to fund and deliver palliative care in First Nations communities. This article describes an innovative, community-based palliative care program (Wiisokotaatiwin) developed in rural Naotkamegwanning, and presents the results of a process evaluation of its pilot implementation. The evaluation aimed to (i) document the program's pilot implementation, (ii) assess progress toward intended program outcomes and (iii) assess the perceived value of the program. The Wiisokotaatiwin Program was developed and implemented over 5 years using participatory action research (http://www.eolfn.lakeheadu.ca). A mixed-method evaluation approach was adopted. Descriptive data were extracted from program documents (eg client registration forms). Client tracking forms documented service provision data for a 4-month sample period. Quantitative and qualitative data were collected through client and family member questionnaires (n=7) and healthcare provider questionnaires (n=22). A focus group was conducted with the program leadership team responsible for program development. Quantitative data were

Development and Implementation of a Web-based Evaluation System for an Internal Medicine Residency Program.

Science.gov (United States)

Rosenberg, Mark E.; Watson, Kathleen; Paul, Jeevan; Miller, Wesley; Harris, Ilene; Valdivia, Tomas D.

2001-01-01

Describes the development and implementation of a World Wide Web-based electronic evaluation system for the internal medicine residency program at the University of Minnesota. Features include automatic entry of evaluations by faculty or students into a database, compliance tracking, reminders, extensive reporting capabilities, automatic…

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Web-based oral health promotion program for older adults: Development and preliminary evaluation.

Science.gov (United States)

Mariño, Rodrigo J; Marwaha, Parul; Barrow, Su-Yan

2016-07-01

This study reports on the impact evaluation of a Web-based oral health promotion programme aimed at improving the oral health knowledge, attitudes, practices and self-efficacy of independent-living older adults from Melbourne, Australia. With ethics approval from the University of Melbourne, a convenience sample of volunteers 55 years or older was invited to participate in a study to test a web-based oral health promotion program. Consenting volunteers were asked to undergo a structured interview as part of the pre-intervention data collection. The intervention was based on the ORHIS (Oral Health Information Seminars/Sheets) Model and involved computer interaction with six oral health presentations, with no direct oral health professional input. A one group pre-test-post-test quasi-experimental design was chosen to evaluate the intervention. A series of paired t-tests were used to compare pre-test with post-test results. Forty-seven active, independent-living older adults participated in this evaluation. After the intervention participants responded with higher levels of achievement than before participating in this Web-based oral health program. Participants showed significant improvements in oral health attitudes (4.10 vs. 4.94; p<0.01), knowledge (18.37 vs. 23.83; p<0.0001), and self-efficacy (84.37 vs.89.23; p<0.01), as well as, self-reported oral hygiene practices (i.e., frequency of use of dental floss) (p<0.05). The e-ORHIS approach was successful in improving oral health knowledge, attitudes and self-efficacy. As such, it represents a helpful approach for the design of (oral) health interventions in older adults. Further evaluation with a larger sample is required to test the long-term impact including the economic evaluation of the e-ORHIS approach. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Evaluation Program initiative

International Nuclear Information System (INIS)

Rich, B.L.

1987-01-01

The purpose of this paper is to provide the Department of Energy's (DOE) safeguards and security community with some insights on an important management initiative by the Office of Security Evaluations (OSE). The paper will present the ''what, where, who, when, and why'' of a new Evaluation Program. The Evaluation Program will be comprised of a continuing series of regular and special evaluations of DOE safeguards and security programs and policies. The evaluations will be integrative and ''crosscutting,'' i.e. will extend across DOE organizational lines. Evaluations will be offered as positive advisories to DOE managers with safeguards and security responsibilities and will not be rated. They will complement the ongoing OSE Inspection Program of inspections conducted by OSE's Inspection Division. The purpose for the evaluations is to establish an accurate and current assessment of the effectiveness and status of safeguards and security programs and policies and to provide DOE managers with required information on program and policy effectiveness

Evaluation of a Community-Based Parenting Program with the Parents of Young Children.

Science.gov (United States)

Brenner, Viktor; Nicholson, Bonnie C.; Fox, Robert A.

1999-01-01

Evaluated effectiveness of a cognitive-behavioral parenting program for parents of children ages 1 to 5 years offered through community-based family resource centers. Found that participants showed significant decreases in use of verbal and corporal punishment, and increases in nurturing behaviors as measured by the Parent Behavior Checklist.…

Design and evaluation of the computer-based training program Calcularis for enhancing numerical cognition

Directory of Open Access Journals (Sweden)

Tanja eKäser

2013-08-01

Full Text Available This article presents the design and a first pilot evaluation of the computer-based training program Calcularis for children with developmental dyscalculia (DD or difficulties in learning mathematics. The program has been designed according to insights on the typical and atypical development of mathematical abilities. The learning process is supported through multimodal cues, which encode different properties of numbers. To offer optimal learning conditions, a user model completes the program and allows flexible adaptation to a child’s individual learning and knowledge profile. 32 children with difficulties in learning mathematics completed the 6 to 12-weeks computer training. The children played the game for 20 minutes per day for 5 days a week. The training effects were evaluated using neuropsychological tests. Generally, children benefited significantly from the training regarding number representation and arithmetic operations. Furthermore, children liked to play with the program and reported that the training improved their mathematical abilities.

Evaluation of a Digital Game-Based Learning Program for Enhancing Youth Mental Health: A Structural Equation Modeling of the Program Effectiveness.

Science.gov (United States)

Huen, Jenny My; Lai, Eliza Sy; Shum, Angie Ky; So, Sam Wk; Chan, Melissa Ky; Wong, Paul Wc; Law, Y W; Yip, Paul Sf

2016-10-07

Digital game-based learning (DGBL) makes use of the entertaining power of digital games for educational purposes. Effectiveness assessment of DGBL programs has been underexplored and no attempt has been made to simultaneously model both important components of DGBL: learning attainment (ie, educational purposes of DGBL) and engagement of users (ie, entertaining power of DGBL) in evaluating program effectiveness. This study aimed to describe and evaluate an Internet-based DGBL program, Professor Gooley and the Flame of Mind, which promotes mental health to adolescents in a positive youth development approach. In particular, we investigated whether user engagement in the DGBL program could enhance their attainment on each of the learning constructs per DGBL module and subsequently enhance their mental health as measured by psychological well-being. Users were assessed on their attainment on each learning construct, psychological well-being, and engagement in each of the modules. One structural equation model was constructed for each DGBL module to model the effect of users' engagement and attainment on the learning construct on their psychological well-being. Of the 498 secondary school students that registered and participated from the first module of the DGBL program, 192 completed all 8 modules of the program. Results from structural equation modeling suggested that a higher extent of engagement in the program activities facilitated users' attainment on the learning constructs on most of the modules and in turn enhanced their psychological well-being after controlling for users' initial psychological well-being and initial attainment on the constructs. This study provided evidence that Internet intervention for mental health, implemented with the technologies and digital innovations of DGBL, could enhance youth mental health. Structural equation modeling is a promising approach in evaluating the effectiveness of DGBL programs.

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Health, community, and spirituality: evaluation of a multicultural faith-based diabetes prevention program.

Science.gov (United States)

Gutierrez, Jaime; Devia, Carlos; Weiss, Linda; Chantarat, Tongtan; Ruddock, Charmaine; Linnell, Jill; Golub, Maxine; Godfrey, Loyce; Rosen, Rosa; Calman, Neil

2014-01-01

The purpose of this study was to evaluate Fine, Fit, and Fabulous (FFF), a faith-based diabetes prevention program for black and Latino congregants at churches in low-income New York City neighborhoods. FFF includes nutrition education and fitness activities while incorporating Bible-based teachings that encourage healthy lifestyles. FFF is a 12-week, bilingual program developed by the Bronx Health REACH coalition, a Centers for Disease Control and Prevention-funded Center of Excellence for the Elimination of Disparities. This program has been implemented in 15 Bronx and Harlem churches, engaging a primarily black and Latino overweight and obese urban population. Pre-post surveys, nutrition tests, and weight logs were collected to assess knowledge, attitudes, and behaviors regarding healthy eating and physical activity. Participants (n = 183) reported statistically significant improvements in knowledge and healthy behaviors from baseline. Increased numbers of participants reported exercising in the past 30 days, eating fruit daily, being able to judge portion sizes, and reading food labels. Statistically significant numbers reported that they ate less fast food and were less likely to overeat at follow-up. The average weight loss across churches was 4.38 lbs or 2% of participants' initial body weight. Significant differences were observed when stratifying by race/ethnicity. Evaluation results show FFF's success at engaging overweight adults in behavior changes related to healthy eating and exercise. FFF demonstrates the potential of faith-based health interventions to address obesity and diabetes risk in high-need communities of color.

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

A mentor-based portfolio program to evaluate pharmacy students' self-assessment skills.

Science.gov (United States)

Kalata, Lindsay R; Abate, Marie A

2013-05-13

Objective. To evaluate pharmacy students' self-assessment skills with an electronic portfolio program using mentor evaluators. Design. First-year (P1) and second-year (P2) pharmacy students used online portfolios that required self-assessments of specific graded class assignments. Using a rubric, faculty and alumni mentors evaluated students' self-assessments and provided feedback. Assessment. Eighty-four P1 students, 74 P2 students, and 59 mentors participated in the portfolio program during 2010-2011. Both student groups performed well overall, with only a small number of resubmissions required. P1 students showed significant improvements across semesters for 2 of the self-assessment questions; P2 students' scores did not differ significantly. The P1 scores were significantly higher than P2 scores for 3 questions during spring 2011. Mentors and students had similar levels of agreement with the extent to which students put forth their best effort on the self-assessments. Conclusion. An electronic portfolio using mentors based inside and outside the school provided students with many opportunities to practice their self-assessment skills. This system represents a useful method of incorporating self-assessments into the curriculum that allows for feedback to be provided to the students.

Reliability-based maintenance evaluations and standard preventive maintenance programs

International Nuclear Information System (INIS)

Varno, M.; McKinley, M.

1993-01-01

Due to recent issuance of 10CFR50.65, the U.S. Nuclear Regulatory Commission maintenance rule (Rule), and the open-quotes Industry Guideline for Monitoring the Effectiveness of Maintenance at Nuclear Power Plantsclose quotes prepared by the Nuclear Management and Resources Council, many utilities are undertaking review or evaluation of current preventive maintenance (PM) programs. Although PM optimization and documentation are not specifically required by the Rule, an appropriate and effective PM program (PMP) will be the cornerstone of the successful and cost-effective implementation of the Rule. Currently, a project is being conducted at the Vermont Yankee Nuclear Power Station (VYNPS) in conjunction with Quadrex Energy Services to evaluate, optimize, and document the PMP. The project began in March 1993 and is scheduled for completion in mid-1995. The initial scope for the project is the evaluation of those structures, systems, and components that are within the scope of the Rule. Because of the number of systems to be evaluated (∼50), the desired completion schedule, and cost considerations, a streamlined approach to PM optimization and documentation is being utilized

Evaluation of an Evidence-Based Tobacco Treatment Curriculum for Psychiatry Residency Training Programs

Science.gov (United States)

Prochaska, Judith J.; Fromont, Sebastien C.; Leek, Desiree; Hudmon, Karen Suchanek; Louie, Alan K.; Jacobs, Marc H.; Hall, Sharon M.

2009-01-01

Objective Smokers with mental illness and addictive disorders account for nearly one in two cigarettes sold in the United States and are at high risk for smoking-related deaths and disability. Psychiatry residency programs provide a unique arena for disseminating tobacco treatment guidelines, influencing professional norms, and increasing access to tobacco cessation services among smokers with mental illness. The current study evaluated the Rx for Change in Psychiatry curriculum, developed for psychiatry residency programs and focused on identifying and treating tobacco dependence among individuals with mental illness. Methods The 4-hour curriculum emphasized evidence-based, patient-oriented cessation treatments relevant for all tobacco users, including those not yet ready to quit. The curriculum was informed by comprehensive literature review, consultation with an expert advisory group, faculty interviews, and a focus group with psychiatry residents. This study reports on evaluation of the curriculum in 2005–2006, using a quasi-experimental design, with 55 residents in three psychiatry residency training programs in Northern California. Results The curriculum was associated with improvements in psychiatry residents’ knowledge, attitudes, confidence, and counseling behaviors for treating tobacco use among their patients, with initial changes from pre- to posttraining sustained at 3-months’ follow-up. Residents’ self-reported changes in treating patients’ tobacco use were substantiated through systematic chart review. Conclusion The evidence-based Rx for Change in Psychiatry curriculum is offered as a model tobacco treatment curriculum that can be implemented in psychiatry residency training programs and disseminated widely, thereby effectively reaching a vulnerable and costly population of smokers. PMID:19190293

Evaluation of a Community-Based Program That Integrates Joyful Movement Into Fall Prevention for Older Adults

Science.gov (United States)

Carlucci, Celeste; Kardachi, Julie; Bradley, Sara M.; Prager, Jason; Wyka, Katarzyna

2018-01-01

Background: Despite the development of evidence-based fall-prevention programs, there remains a need for programming that will engage older adults in real-world settings. Objective: This study aimed to evaluate a community-based group program that integrates joyful movement into fall prevention. The curriculum emphasizes a positive experience of movement, cultivating a healthy body image, and retraining of biomechanics. Design: Program evaluation was conducted using a one-group pre–post test study design. Key outcomes were functional balance and confidence. Qualitative feedback was gathered at the final class sessions. Results: Two hundred fifteen older adults enrolled at four sites over the period from 2010 to 2014. Among 86 participants who provided feedback, most credited the program for an increased sense of optimism and/or confidence (70%), and better walking ability (50%). Among 102 participants who completed both initial and final assessments, there was evidence of significant improvements on the Functional Reach Test (d = .60, p Falls Efficacy Scale (d = .17, p balance and confidence. Future research should examine whether the positive changes encouraged by joyful movement lead to lasting reductions in fall risk and additional health benefits. PMID:29796405

A Facebook-Based Obesity Prevention Program for Korean American Adolescents: Usability Evaluation.

Science.gov (United States)

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E; Choi, Mona; Friedmann, Erika; Wilson, Marisa; Koru, Gunes

Adolescent obesity is one of the most serious global public health challenges. Social networking sites are currently popular among adolescents. Therefore, the obesity prevention program for Korean American adolescents was developed on the most popular social networking site, Facebook. The purpose of this study was to evaluate the usability of a culturally tailored Facebook-based obesity prevention program for Korean American adolescents (Healthy Teens). An explorative descriptive design of usability testing was used. Usability testing employing one-on-one observation, the think-aloud method, audio taping, screen activity capture, and surveys was performed. Twenty participants were recruited from two Korean language schools (mean age, 15.40 ± 1.50 years). Recruitment and user testing was performed between February and April 2014. Content analysis, using the inductive coding approach, was performed by three coders to analyze transcriptions. Descriptive statistics were used to analyze quantitative data including demographic characteristics, perceived usability, eHealth literacy, and health behaviors. Testing revealed several usability issues in content, appearance, and navigation. Participants' comments regarding content were positive. Although the Facebook platform provided limited flexibility with respect to building the site, participants described the program's appearance as appropriate. Most participants did not experience difficulty in navigating the program. Our preliminary findings indicated that participants perceived the Healthy Teens program as usable and useful. This program could be used as a robust platform for the delivery of health education to adolescents. Further research is required to assess the effects of Facebook-based programs on adolescent obesity prevention. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Evaluation of a community-based falls prevention program in South Florida, 2008-2009.

Science.gov (United States)

Batra, Anamica; Melchior, Michael; Seff, Laura; Frederick, Newman; Palmer, Richard C

2012-01-01

Many older adults experience fear of falling, which may reduce participation in routine activities. A Matter of Balance (MOB) and Un Asunto de Equilibrio (ADE) workshops were offered in South Florida to reduce fear of falling and increase activity levels in older adults. The objectives of this study were to evaluate the effectiveness of the lay leader model of the programs in the first year of their implementation and to further report on participant outcome measures. We analyzed reach, adoption, and implementation data for participants who attended workshops between October 1, 2008, and December 31, 2009, who were aged 60 years or older, and who had both baseline and posttest outcome data. Workshops were in English and Spanish and consisted of 8 two-hour sessions. Participants completed a 7-item baseline and posttest questionnaire that consisted of a falls management scale, a social activity item, and modified version of Physician-Based Assessment and Counseling on Exercise. We analyzed outcome data on multiple characteristics using a general linear model. A class evaluation questionnaire measured participant satisfaction. Results for 562 participants who provided both baseline and posttest data showed significant improvement on 6 of 7 questions for MOB and all questions for ADE (P < .001). The 391 participants who provided evaluation data indicated that the programs were effective, beneficial, and well organized. Lay leaders successfully implemented the programs in community settings. The programs were effective in reducing fear of falling among older adults.

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

Evaluating the Sharing Stories youth theatre program: an interactive theatre and drama-based strategy for sexual health promotion among multicultural youth.

Science.gov (United States)

Roberts, Meagan; Lobo, Roanna; Sorenson, Anne

2017-03-01

Issue addressed Rates of sexually transmissible infections among young people are high, and there is a need for innovative, youth-focused sexual health promotion programs. This study evaluated the effectiveness of the Sharing Stories youth theatre program, which uses interactive theatre and drama-based strategies to engage and educate multicultural youth on sexual health issues. The effectiveness of using drama-based evaluation methods is also discussed. Methods The youth theatre program participants were 18 multicultural youth from South East Asian, African and Middle Eastern backgrounds aged between 14 and 21 years. Four sexual health drama scenarios and a sexual health questionnaire were used to measure changes in knowledge and attitudes. Results Participants reported being confident talking to and supporting their friends with regards to safe sex messages, improved their sexual health knowledge and demonstrated a positive shift in their attitudes towards sexual health. Drama-based evaluation methods were effective in engaging multicultural youth and worked well across the cultures and age groups. Conclusions Theatre and drama-based sexual health promotion strategies are an effective method for up-skilling young people from multicultural backgrounds to be peer educators and good communicators of sexual health information. Drama-based evaluation methods are engaging for young people and an effective way of collecting data from culturally diverse youth. So what? This study recommends incorporating interactive and arts-based strategies into sexual health promotion programs for multicultural youth. It also provides guidance for health promotion practitioners evaluating an arts-based health promotion program using arts-based data collection methods.

Impact on house staff evaluation scores when changing from a Dreyfus- to a Milestone-based evaluation model: one internal medicine residency program's findings

Directory of Open Access Journals (Sweden)

Karen A. Friedman

2014-11-01

Full Text Available Purpose: As graduate medical education (GME moves into the Next Accreditation System (NAS, programs must take a critical look at their current models of evaluation and assess how well they align with reporting outcomes. Our objective was to assess the impact on house staff evaluation scores when transitioning from a Dreyfus-based model of evaluation to a Milestone-based model of evaluation. Milestones are a key component of the NAS. Method: We analyzed all end of rotation evaluations of house staff completed by faculty for academic years 2010–2011 (pre-Dreyfus model and 2011–2012 (post-Milestone model in one large university-based internal medicine residency training program. Main measures included change in PGY-level average score; slope, range, and separation of average scores across all six Accreditation Council for Graduate Medical Education (ACGME competencies. Results: Transitioning from a Dreyfus-based model to a Milestone-based model resulted in a larger separation in the scores between our three post-graduate year classes, a steeper progression of scores in the PGY-1 class, a wider use of the 5-point scale on our global end of rotation evaluation form, and a downward shift in the PGY-1 scores and an upward shift in the PGY-3 scores. Conclusions: For faculty trained in both models of assessment, the Milestone-based model had greater discriminatory ability as evidenced by the larger separation in the scores for all the classes, in particular the PGY-1 class.

Impact on house staff evaluation scores when changing from a Dreyfus- to a Milestone-based evaluation model: one internal medicine residency program's findings.

Science.gov (United States)

Friedman, Karen A; Balwan, Sandy; Cacace, Frank; Katona, Kyle; Sunday, Suzanne; Chaudhry, Saima

2014-01-01

As graduate medical education (GME) moves into the Next Accreditation System (NAS), programs must take a critical look at their current models of evaluation and assess how well they align with reporting outcomes. Our objective was to assess the impact on house staff evaluation scores when transitioning from a Dreyfus-based model of evaluation to a Milestone-based model of evaluation. Milestones are a key component of the NAS. We analyzed all end of rotation evaluations of house staff completed by faculty for academic years 2010-2011 (pre-Dreyfus model) and 2011-2012 (post-Milestone model) in one large university-based internal medicine residency training program. Main measures included change in PGY-level average score; slope, range, and separation of average scores across all six Accreditation Council for Graduate Medical Education (ACGME) competencies. Transitioning from a Dreyfus-based model to a Milestone-based model resulted in a larger separation in the scores between our three post-graduate year classes, a steeper progression of scores in the PGY-1 class, a wider use of the 5-point scale on our global end of rotation evaluation form, and a downward shift in the PGY-1 scores and an upward shift in the PGY-3 scores. For faculty trained in both models of assessment, the Milestone-based model had greater discriminatory ability as evidenced by the larger separation in the scores for all the classes, in particular the PGY-1 class.

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

Economic Evaluation of Community-Based HIV Prevention Programs in Ontario: Evidence of Effectiveness in Reducing HIV Infections and Health Care Costs.

Science.gov (United States)

Choi, Stephanie K Y; Holtgrave, David R; Bacon, Jean; Kennedy, Rick; Lush, Joanne; McGee, Frank; Tomlinson, George A; Rourke, Sean B

2016-06-01

Investments in community-based HIV prevention programs in Ontario over the past two and a half decades are assumed to have had an impact on the HIV epidemic, but they have never been systematically evaluated. To help close this knowledge gap, we conducted a macro-level evaluation of investment in Ontario HIV prevention programs from the payer perspective. Our results showed that, from 1987 to 2011, province-wide community-based programs helped to avert a total of 16,672 HIV infections, saving Ontario's health care system approximately $6.5 billion Canadian dollars (range 4.8-7.5B). We also showed that these community-based HIV programs were cost-saving: from 2005 to 2011, every dollar invested in these programs saved about $5. This study is an important first step in understanding the impact of investing in community-based HIV prevention programs in Ontario and recognizing the impact that these programs have had in reducing HIV infections and health care costs.

Building an evidence base for community health: a review of the quality of program evaluations.

Science.gov (United States)

Jolley, Gwyn M; Lawless, Angela P; Baum, Fran E; Hurley, Catherine J; Fry, Denise

2007-11-01

An assessment of the quality of program evaluations conducted in South Australian community health services investigated how effective evaluation reporting is in producing an evidence base for community health. Evaluation reports were assessed by a team of reviewers. Practitioner workshops allowed an understanding of the uses of evaluation and what promotes or acts as a barrier to undertaking evaluations. Community health services do undertake a good deal of evaluation. However, reports were not generally explicit in dealing with the principles that underpin community health. Few engaged with program theory or rationale. Typically, reports were of short-term projects with uncertain futures so there may seem little point in considering issues of long-term health outcomes and transferability to other settings. The most important issue from our study is the lack of investment in applied health services research of the sort that will be required to produce the evidence for practice that policy makers desire. The current lack of evidence for community health reflects failure of the system to invest in research and evaluation that is adequately resourced and designed for complex community settings.

A Mentor-Based Portfolio Program to Evaluate Pharmacy Students’ Self-Assessment Skills

Science.gov (United States)

Kalata, Lindsay R.

2013-01-01

Objective. To evaluate pharmacy students' self-assessment skills with an electronic portfolio program using mentor evaluators. Design. First-year (P1) and second-year (P2) pharmacy students used online portfolios that required self-assessments of specific graded class assignments. Using a rubric, faculty and alumni mentors evaluated students' self-assessments and provided feedback. Assessment. Eighty-four P1 students, 74 P2 students, and 59 mentors participated in the portfolio program during 2010-2011. Both student groups performed well overall, with only a small number of resubmissions required. P1 students showed significant improvements across semesters for 2 of the self-assessment questions; P2 students' scores did not differ significantly. The P1 scores were significantly higher than P2 scores for 3 questions during spring 2011. Mentors and students had similar levels of agreement with the extent to which students put forth their best effort on the self-assessments. Conclusion. An electronic portfolio using mentors based inside and outside the school provided students with many opportunities to practice their self-assessment skills. This system represents a useful method of incorporating self-assessments into the curriculum that allows for feedback to be provided to the students. PMID:23716749

Study protocol for the evaluation of an Infant Simulator based program delivered in schools: a pragmatic cluster randomised controlled trial

OpenAIRE

Brinkman, Sally A; Johnson, Sarah E; Lawrence, David; Codde, James P; Hart, Michael B; Straton, Judith AY; Silburn, Sven

2010-01-01

Abstract Background This paper presents the study protocol for a pragmatic randomised controlled trial to evaluate the impact of a school based program developed to prevent teenage pregnancy. The program includes students taking care of an Infant Simulator; despite growing popularity and an increasing global presence of such programs, there is no published evidence of their long-term impact. The aim of this trial is to evaluate the Virtual Infant Parenting (VIP) program by investigating pre-c...

An experimental evaluation of theory-based mother and mother-child programs for children of divorce.

Science.gov (United States)

Wolchik, S A; West, S G; Sandler, I N; Tein, J Y; Coatsworth, D; Lengua, L; Weiss, L; Anderson, E R; Greene, S M; Griffin, W A

2000-10-01

This study evaluated the efficacy of 2 theory-based preventive interventions for divorced families: a program for mothers and a dual component mother-child program. The mother program targeted mother-child relationship quality, discipline, interparental conflict, and the father-child relationship. The child program targeted active coping, avoidant coping, appraisals of divorce stressors, and mother-child relationship quality. Families with a 9- to 12-year-old child (N = 240) were randomly assigned to the mother, dual-component, or self-study program. Postintervention comparisons showed significant positive program effects of the mother program versus self-study condition on relationship quality, discipline, attitude toward father-child contact, and adjustment problems. For several outcomes, more positive effects occurred in families with poorer initial functioning. Program effects on externalizing problems were maintained at 6-month follow-up. A few additive effects of the dual-component program occurred for the putative mediators; none occurred for adjustment problems.

Promoting sustainability in quality improvement: an evaluation of a web-based continuing education program in blood pressure measurement.

Science.gov (United States)

Block, Lauren; Flynn, Sarah J; Cooper, Lisa A; Lentz, Caroline; Hull, Tammie; Dietz, Katherine B; Boonyasai, Romsai T

2018-01-10

The accuracy of blood pressure measurement is variable in office-based settings. Even when staff training programs are effective, knowledge and skills decay over time, supporting the need for ongoing staff training. We evaluated whether a web-based continuing education program in blood pressure measurement reinforced knowledge and skills among clinical staff and promoted sustainability of an existing quality improvement program. Medical assistants and nurses at six primary care clinics within a health system enrolled in a 30-min online educational program designed to refresh their knowledge of blood pressure measurement. A 20-question pre- and post-intervention survey addressed learners' knowledge and attitudes. Direct observation of blood pressure measurement technique before and after the intervention was performed. Differences in responses to pre- and post-module knowledge and attitudes questions and in observation data were analyzed using chi-square tests and simple logistic regression. All 88 clinical staff members participated in the program and completed the evaluation survey. Participants answered 80.6% of questions correctly before the module and 93.4% afterwards (p blood pressure measurement were high at baseline and did not improve significantly. Prior to the intervention, staff adhered to 9 of 18 elements of the recommended technique during at least 90% of observations. Following the program, staff was more likely to explain the protocol, provide a rest period, measure an average blood pressure, and record the average blood pressure, but less likely to measure blood pressure with the arm at heart level and use the right arm. We designed, implemented, and evaluated a web-based educational program to improve knowledge, skills, and attitudes in blood pressure measurement and use of an automated device among nurses and medical assistants in ambulatory care. The program reinforced knowledge related to recommended blood pressure measurement technique

Building a community-based culture of evaluation.

Science.gov (United States)

Janzen, Rich; Ochocka, Joanna; Turner, Leanne; Cook, Tabitha; Franklin, Michelle; Deichert, Debbie

2017-12-01

In this article we argue for a community-based approach as a means of promoting a culture of evaluation. We do this by linking two bodies of knowledge - the 70-year theoretical tradition of community-based research and the trans-discipline of program evaluation - that are seldom intersected within the evaluation capacity building literature. We use the three hallmarks of a community-based research approach (community-determined; equitable participation; action and change) as a conceptual lens to reflect on a case example of an evaluation capacity building program led by the Ontario Brian Institute. This program involved two community-based groups (Epilepsy Southwestern Ontarioand the South West Alzheimer Society Alliance) who were supported by evaluators from the Centre for Community Based Research to conduct their own internal evaluation. The article provides an overview of a community-based research approach and its link to evaluation. It then describes the featured evaluation capacity building initiative, including reflections by the participating organizations themselves. We end by discussing lessons learned and their implications for future evaluation capacity building. Our main argument is that organizations that strive towards a community-based approach to evaluation are well placed to build and sustain a culture of evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

A community-based program evaluation of community competency trainings.

Science.gov (United States)

Hanssmann, Christoph; Morrison, Darius; Russian, Ellery; Shiu-Thornton, Sharyne; Bowen, Deborah

2010-01-01

Transgender and gender-nonconforming individuals encounter a multitude of barriers to accessing clinically and culturally competent health care. One strategy to increase the quality and competence of care delivery is workplace trainings. This study describes a community-based program for the evaluation of this type of training. Using a mixed-methods approach, the research team assessed the effectiveness of three competency trainings administered by a local nonprofit organization in the Northwest United States. Quantitative data indicated a significant shift in self-assessed knowledge associated with completion of the training. Qualitative data confirmed this result and revealed a number of important themes about the effect of the trainings on providers and their ability to implement knowledge and skills in practice. Clinical considerations are proposed for providers who seek similar trainings and who aim to increase clinical and cultural competency in delivering care to transgender and gender-nonconforming patients and clients.

Evaluation of a Family-based Substance Abuse Prevention Program Targeted for the Middle School Years.

Science.gov (United States)

Abbey, Antonia; Pilgrim, Colleen; Hendrickson, Peggy; Buresl, Sue

2000-01-01

Evaluates family-based substance abuse prevention program implemented in a rural community for families with middle school students. In comparison with nonparticipants, students had higher family cohesion, less family fighting, greater school attachment, higher self-esteem, and believed alcohol should be consumed at an older age, at one-year…

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol.

Science.gov (United States)

Ware, Patrick; Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-05-03

Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. The telemonitoring program was launched in

Evaluation of a Workplace-Based Migraine Education Program.

Science.gov (United States)

Burton, Wayne N; Chen, Chin-Yu; Li, Xingquan; McCluskey, Maureen; Erickson, Denise; Schultz, Alyssa B

2016-08-01

Migraine affects approximately 10% of working-age adults and is associated with increased health care costs, absenteeism, and presenteeism in the workplace. A migraine education program was offered to United States employees of a global financial services organization. Two hundred forty three employees (46% response rate) completed both a baseline and 6-month follow-up migraine questionnaire. The program included webinars, E-mailed educational tips, and intranet-based resources. No change was found in the frequency of migraines but improvements were observed in the severity, workdays missed, effectiveness at work during migraine, and work/activity limitations. Participants reported taking action to identify and reduce migraine triggers. A worksite disease education program for migraine headache has the potential to significantly impact lost productivity and absenteeism for migraineurs.

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

Evaluation of a Web-Based Holistic Stress Reduction Pilot Program Among Nurse-Midwives.

Science.gov (United States)

Wright, Erin M

2018-06-01

Work-related stress among midwives results in secondary traumatic stress, posttraumatic stress disorder, and job attrition. The purpose of this pilot project was to evaluate the effectiveness of a holistic, web-based program using holistic modalities for stress reduction and improved coping among certified nurse-midwives. A convenience sample of 10 midwives participated in a web-based holistic stress reduction intervention using yoga, mindfulness-based stress reduction, and meditation for four days each week over 4 weeks. Participants completed pre- and postintervention questionnaires (Perceived Stress Scale [PSS] and the Coping Self-Efficacy Scale [CSES]) for evaluation of effectiveness. The PSS means showed improvement in midwives' stress (16.4-12.3). The CSES means showed improvement in coping (174.8-214.5). Improvement was shown in each subscale of the CSES ("uses problem-focused coping": 19.2%; "stops unpleasant thoughts and emotions": 20.3%; and "gets support from family and friends": 16.6%). Findings suggest the potential for stress reduction and improved coping skills after using holistic techniques in a web-based format within a cohort of nurse-midwives. Further research of web-based, holistic intervention for stress reduction among midwives is warranted.

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Girls Just Wanna Have Fun: a process evaluation of a female youth-driven physical activity-based life skills program.

Science.gov (United States)

Bean, Corliss N; Forneris, Tanya; Halsall, Tanya

2014-01-01

Integrating a positive youth development framework into physical activity programming has become popular as it is believed that this integration can create the development of both physical and psychosocial skills. However, there has been a lack of intervention fidelity research within the field of positive youth development. The Girls Just Wanna Have Fun program was designed in response to increased calls for physical activity programs for female youth and is a theoretically-grounded physical activity-based life skills program that aims to empower female youth. The purpose of this paper was to provide a detailed description of the program and a process evaluation of the first year of program implementation. From interviews with youth and leaders, as well as documentation from the leaders' weekly online log of each implemented session, themes emerged regarding the successes. Findings from this study indicated that program goals were attained and it appears that the program was implemented, for the most part, as designed. The themes related to successes included using activities to facilitate relational time, providing intentional opportunities for leadership, having communicative program leaders who supported one another, and engaging youth in different types of physical activity. The themes related to challenges included difficulties with facility and transportation, some activities being too much like schoolwork, and social distractions and cliques. Included in the paper is a discussion of practical implications and recommendations for community programmers, as well as future directions for the program. Overall, this process evaluation represents an important step in responding to calls for increased evaluation in community-based programs and aids in understanding the process in which positive youth development programs can be effectively implemented.

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

REITP3-Hazard evaluation program for heat release based on thermochemical calculation

Energy Technology Data Exchange (ETDEWEB)

Akutsu, Yoshiaki.; Tamura, Masamitsu. [The University of Tokyo, Tokyo (Japan). School of Engineering; Kawakatsu, Yuichi. [Oji Paper Corp., Tokyo (Japan); Wada, Yuji. [National Institute for Resources and Environment, Tsukuba (Japan); Yoshida, Tadao. [Hosei University, Tokyo (Japan). College of Engineering

1999-06-30

REITP3-A hazard evaluation program for heat release besed on thermochemical calculation has been developed by modifying REITP2 (Revised Estimation of Incompatibility from Thermochemical Properties{sup 2)}. The main modifications are as follows. (1) Reactants are retrieved from the database by chemical formula. (2) As products are listed in an external file, the addition of products and change in order of production can be easily conducted. (3) Part of the program has been changed by considering its use on a personal computer or workstation. These modifications will promote the usefulness of the program for energy hazard evaluation. (author)

Can faith-based correctional programs work? An outcome evaluation of the innerchange freedom initiative in Minnesota.

Science.gov (United States)

Duwe, Grant; King, Michelle

2013-07-01

This study evaluated the effectiveness of the InnerChange Freedom Initiative (InnerChange), a faith-based prisoner reentry program, by examining recidivism outcomes among 732 offenders released from Minnesota prisons between 2003 and 2009. Results from the Cox regression analyses revealed that participating in InnerChange significantly reduced reoffending (rearrest, reconviction, and new offense reincarceration), although it did not have a significant impact on reincarceration for a technical violation revocation. The findings further suggest that the beneficial recidivism outcomes for InnerChange participants may have been due, in part, to the continuum of mentoring support some offenders received in the institution and the community. The results imply that faith-based correctional programs can reduce recidivism, but only if they apply evidence-based practices that focus on providing a behavioral intervention within a therapeutic community, addressing the criminogenic needs of participants and delivering a continuum of care from the institution to the community. Given that InnerChange relies heavily on volunteers and program costs are privately funded, the program exacts no additional costs to the State of Minnesota. Yet, because InnerChange lowers recidivism, which includes reduced reincarceration and victimization costs, the program may be especially advantageous from a cost-benefit perspective.

Understanding Acid-Base Concepts: Evaluating the Efficacy of a Senior High School Student-Centred Instructional Program in Indonesia

Science.gov (United States)

Rahayu, Sri; Chandrasegaran, A. L.; Treagust, David F.; Kita, Masakazu; Ibnu, Suhadi

2011-01-01

This study was a mixed quantitative-qualitative research to evaluate the efficacy of a designed student-centred instructional (DSCI) program for teaching about acids and bases. The teaching innovation was designed based on constructivist, hands-on inquiry and context-based approaches and implemented in seven 45-min lessons with a class of 36 grade…

The Resilience Program: Preliminary evaluation of a mentalization-based education program.

Directory of Open Access Journals (Sweden)

Poul Lundgaard Bak

2015-06-01

Full Text Available In order to manage with the burden of mental health problems in the world we need to develop cost-effective and safe preventive interventions. Education about resilience to support the ability to cope with life challenges in general, may be a useful strategy. We consider the concepts of Theory of Mind and Mentalization to be relevant in this context. In this paper we describe a simple modular intervention program based on these concepts which can be tailored to specific needs and situations in individual therapy as well as group levels. The program has shown promising results in pilot studies and is now tested in controlled trials in settings such as schools and educational institutions, adults diagnosed with ADHD and children in foster care.

A systematic review of school-based suicide prevention programs.

Science.gov (United States)

Katz, Cara; Bolton, Shay-Lee; Katz, Laurence Y; Isaak, Corinne; Tilston-Jones, Toni; Sareen, Jitender

2013-10-01

Suicide is one of the leading causes of death among youth today. Schools are a cost-effective way to reach youth, yet there is no conclusive evidence regarding the most effective prevention strategy. We conducted a systematic review of the empirical literature on school-based suicide prevention programs. Studies were identified through MEDLINE and Scopus searches, using keywords such as "suicide, education, prevention and program evaluation." Additional studies were identified with a manual search of relevant reference lists. Individual studies were rated for level of evidence, and the programs were given a grade of recommendation. Five reviewers rated all studies independently and disagreements were resolved through discussion. Sixteen programs were identified. Few programs have been evaluated for their effectiveness in reducing suicide attempts. Most studies evaluated the programs' abilities to improve students' and school staffs' knowledge and attitudes toward suicide. Signs of Suicide and the Good Behavior Game were the only programs found to reduce suicide attempts. Several other programs were found to reduce suicidal ideation, improve general life skills, and change gatekeeper behaviors. There are few evidence-based, school-based suicide prevention programs, a combination of which may be effective. It would be useful to evaluate the effectiveness of general mental health promotion programs on the outcome of suicide. The grades assigned in this review are reflective of the available literature, demonstrating a lack of randomized controlled trials. Further evaluation of programs examining suicidal behavior outcomes in randomized controlled trials is warranted. © 2013 Wiley Periodicals, Inc.

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

Science.gov (United States)

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

Comparison and Analysis of Evaluation System of Child Care Program in Primary Health Care System in the East Azerbaijan Province Based on Comprehensive Evaluation Model (CIPP

Directory of Open Access Journals (Sweden)

Yalda Mousa Zadeh

2015-08-01

Full Text Available Background and objectives: Planning plays an important role in improving children's health and an evaluation system is necessary to planning. The purpose of this study was comparing and analyzing evaluation system of child care program in primary health care system in the Eastern Azerbaijan province based on Comprehensive Evaluation Model (CIPP. Material and Methods : This is a cross sectional study. The process includes a review of current evaluation system, comparison and analysis of the system based on a comprehensive model and to assess and identify the strengths and weaknesses of the current systems. The quantitative methods (such as brainstorming, observation and interview and consensus of study group about the results of the study were used for analyzing and interpreting results. Results: It showed that not enough attention was paid to the context and performance and the content of evaluation just includes inputs and processes based on the finding. Specific criteria and impact were considered in four areas (context, input, process and outcome and all levels which were according to the proposal and based on the CIPP model. Conclusion: Evaluation is a control process tool by higher levels and self-assessment by service provider is not considered in the current system. Evaluation includes quantitative aspects and not the quality of process. So, it is recommended that forecasting system that utilizes evaluation will result in improving future planning and a scientific model to be used in designing evaluation program. ​

Evaluating the impact of implementation factors on family-based prevention programming: methods for strengthening causal inference.

Science.gov (United States)

Crowley, D Max; Coffman, Donna L; Feinberg, Mark E; Greenberg, Mark T; Spoth, Richard L

2014-04-01

Despite growing recognition of the important role implementation plays in successful prevention efforts, relatively little work has sought to demonstrate a causal relationship between implementation factors and participant outcomes. In turn, failure to explore the implementation-to-outcome link limits our understanding of the mechanisms essential to successful programming. This gap is partially due to the inability of current methodological procedures within prevention science to account for the multitude of confounders responsible for variation in implementation factors (i.e., selection bias). The current paper illustrates how propensity and marginal structural models can be used to improve causal inferences involving implementation factors not easily randomized (e.g., participant attendance). We first present analytic steps for simultaneously evaluating the impact of multiple implementation factors on prevention program outcome. Then, we demonstrate this approach for evaluating the impact of enrollment and attendance in a family program, over and above the impact of a school-based program, within PROSPER, a large-scale real-world prevention trial. Findings illustrate the capacity of this approach to successfully account for confounders that influence enrollment and attendance, thereby more accurately representing true causal relations. For instance, after accounting for selection bias, we observed a 5% reduction in the prevalence of 11th grade underage drinking for those who chose to receive a family program and school program compared to those who received only the school program. Further, we detected a 7% reduction in underage drinking for those with high attendance in the family program.

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

Science.gov (United States)

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

Internet-based peer support for Ménière's disease: a summary of web-based data collection, impact evaluation, and user evaluation.

Science.gov (United States)

Pyykkő, Ilmari; Manchaiah, Vinaya; Levo, Hilla; Kentala, Erna; Juhola, Martti

2017-07-01

This paper presents a summary of web-based data collection, impact evaluation, and user evaluations of an Internet-based peer support program for Ménière's disease (MD). The program is written in html-form. The data are stored in a MySQL database and uses machine learning in the diagnosis of MD. The program works interactively with the user and assesses the participant's disorder profile in various dimensions (i.e., symptoms, impact, personal traits, and positive attitude). The inference engine uses a database to compare the impact with 50 referents, and provides regular feedback to the user. Data were analysed using descriptive statistics and regression analysis. The impact evaluation was based on 740 cases and the user evaluation on a sample of 75 cases of MD respectively. The web-based system was useful in data collection and impact evaluation of people with MD. Among those with a recent onset of MD, 78% rated the program as useful or very useful, whereas those with chronic MD rated the program 55%. We suggest that a web-based data collection and impact evaluation for peer support can be helpful while formulating the rehabilitation goals of building the self-confidence needed for coping and increasing social participation.

Clinical capabilities of graduates of an outcomes-based integrated medical program

Directory of Open Access Journals (Sweden)

Scicluna Helen A

2012-06-01

Full Text Available Abstract Background The University of New South Wales (UNSW Faculty of Medicine replaced its old content-based curriculum with an innovative new 6-year undergraduate entry outcomes-based integrated program in 2004. This paper is an initial evaluation of the perceived and assessed clinical capabilities of recent graduates of the new outcomes-based integrated medical program compared to benchmarks from traditional content-based or process-based programs. Method Self-perceived capability in a range of clinical tasks and assessment of medical education as preparation for hospital practice were evaluated in recent graduates after 3 months working as junior doctors. Responses of the 2009 graduates of the UNSW’s new outcomes-based integrated medical education program were compared to those of the 2007 graduates of UNSW’s previous content-based program, to published data from other Australian medical schools, and to hospital-based supervisor evaluations of their clinical competence. Results Three months into internship, graduates from UNSW’s new outcomes-based integrated program rated themselves to have good clinical and procedural skills, with ratings that indicated significantly greater capability than graduates of the previous UNSW content-based program. New program graduates rated themselves significantly more prepared for hospital practice in the confidence (reflective practice, prevention (social aspects of health, interpersonal skills (communication, and collaboration (teamwork subscales than old program students, and significantly better or equivalent to published benchmarks of graduates from other Australian medical schools. Clinical supervisors rated new program graduates highly capable for teamwork, reflective practice and communication. Conclusions Medical students from an outcomes-based integrated program graduate with excellent self-rated and supervisor-evaluated capabilities in a range of clinically-relevant outcomes. The program

Evaluation of a High School Fair Program for Promoting Successful Inquiry-based Learning

Science.gov (United States)

Betts, Julia Nykeah

The success of inquiry-based learning (IBL) in supporting science literacy can be challenged when students encounter obstacles in the absence of proper support. This research is intended to evaluate the effectiveness of an Oregon public school district's regional science fair coaching program in promoting inquiry skills and positive attitudes toward science in participating high school students. The purpose of this study was to better understand students' perception of program support, obstacles or barriers faced by students, and potential benefits of IBL facilitated by the science fair program. Data included responses to informal and semi-structured interviews, an anonymous survey, a Skills assessment of final project displays, and an in-depth case study on three students' experiences. Results suggest that the science fair program can properly engage participants in authentic IBL. However, when assessing the participant's final project displays, I found that previous fair experience did not significantly increase mean scores as identified by the official Oregon Department of Education (ODE) scoring guides. Based on results from the case study, it is suggested that participants' low science self-concept, poor understanding of inquiry skills, and inability to engage in reflective discourse may reduce students' abilities to truly benefit. Recommendations to address this discrepancy include identifying specific needs of students through a pre--fair survey to develop more targeted support, and providing new opportunities to develop skills associated with science-self concept, understanding of inquiry and reflective discourse. In addition, results suggest that students would benefit from more financial support in the form of grants, and more connections with knowledgeable mentors.

Educational Program Evaluation Model, From the Perspective of the New Theories

Directory of Open Access Journals (Sweden)

Soleiman Ahmady

2014-05-01

Full Text Available Introduction: This study is focused on common theories that influenced the history of program evaluation and introduce the educational program evaluation proposal format based on the updated theory. Methods: Literature searches were carried out in March-December 2010 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface, ERIC (Education Resources Information Center and the main journal of medical education regarding current evaluation models and theories. We included all study designs in our study. We found 810 articles related to our topic, and finally 63 with the full text article included. We compared documents and used expert consensus for selection the best model. Results: We found that the complexity theory using logic model suggests compatible evaluation proposal formats, especially with new medical education programs. Common components of a logic model are: situation, inputs, outputs, and outcomes that our proposal format is based on. Its contents are: title page, cover letter, situation and background, introduction and rationale, project description, evaluation design, evaluation methodology, reporting, program evaluation management, timeline, evaluation budget based on the best evidences, and supporting documents. Conclusion: We found that the logic model is used for evaluation program planning in many places, but more research is needed to see if it is suitable for our context.

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

Science.gov (United States)

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

The Inquiry Based Science and Technology Education Program (IN-STEP): The Evaluation of the First Year

Science.gov (United States)

Corcoran, Thomas B.

2008-01-01

This is the first report on the evaluation of the Inquiry Based Science and Technology Education Program (IN-STEP), an innovative and ambitious science education initiative for lower secondary schools being undertaken by a public-private partnership in Thailand funded by MSD-Thailand, an affiliate of Merck & Co. IN-STEP is a public-private…

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

An Evaluation of a School-Based Professional Development Program on Teachers' Efficacy for Technology Integration: Findings from an Initial Study

Science.gov (United States)

Skoretz, Yvonne; Childress, Ronald

2013-01-01

The purpose of this program evaluation was to determine the impact of a school-based, job-embedded professional development program on elementary and middle school teacher efficacy for technology integration. Participant bi-weekly journal postings were analyzed using Grappling's "Technology and Learning Spectrum" (Porter, 2001) to…

Using Program Theory-Driven Evaluation Science to Crack the Da Vinci Code

Science.gov (United States)

Donaldson, Stewart I.

2005-01-01

Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

Long Live Love+: evaluation of the implementation of an online school-based sexuality education program in the Netherlands.

Science.gov (United States)

van Lieshout, Sanne; Mevissen, Fraukje; de Waal, Esri; Kok, Gerjo

2017-06-01

Schools are a common setting for adolescents to receive health education, but implementation of these programs with high levels of completeness and fidelity is not self-evident. Programs that are only partially implemented (completeness) or not implemented as instructed (fidelity) are unlikely to be effective. Therefore, it is important to identify which determinants affect completeness and fidelity of program implementation. As part of the launch of Long Live Love+ (LLL+), an online school-based sexuality education program for adolescents aged 15-17, we performed a process evaluation among teachers and students to measure the levels of completeness and fidelity, identify factors influencing teachers' implementation, and to evaluate the students' response. Sixteen Biology teachers from nine secondary schools throughout the Netherlands who implemented LLL+ were interviewed and 60 students participated in 13 focus group discussions. Results showed that teachers' completeness ranged between 22-100% (M = 75%). Fidelity was high, but many teachers added elements. Teachers and students enjoyed LLL+, particularly the diversity in the exercises and its interactive character. The most important factors that influenced implementation were time and organizational constraints, lack of awareness on the impact of completeness and fidelity, and student response. These factors should be taken into account when developing school-based prevention programs. © The Author 2017. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com.

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Evaluation of a Telephone-Delivered, Community-Based Collaborative Care Management Program for Caregivers of Older Adults with Dementia.

Science.gov (United States)

Mavandadi, Shahrzad; Wray, Laura O; DiFilippo, Suzanne; Streim, Joel; Oslin, David

2017-09-01

To evaluate whether a community-based, telephone-delivered, brief patient/caregiver-centered collaborative dementia care management intervention is associated with improved caregiver and care recipient (CR) outcomes. Longitudinal program evaluation of a clinical intervention; assessments at baseline and 3- and 6-month follow-up. General community. Caregivers (N = 440) of older, community-dwelling, low-income CRs prescribed a psychotropic medication by a primary care provider who met criteria for dementia and were enrolled in the SUpporting Seniors Receiving Treatment And INtervention (SUSTAIN) program for older adults. Dementia care management versus clinical evaluation only. Perceived caregiving burden and caregiver general health (primary outcomes); CR neuropsychiatric symptoms and caregiver distress in response to CRs' challenging dementia-related behaviors (secondary outcomes). Caregivers were, on average, 64.0 (SD: 11.8) years old and 62.6% provided care for the CR for 20 or more hours per week. The majority of the sample was female (73.2%), non-Hispanic White (90.2%), and spousal caregivers (72.5%). Adjusted longitudinal models of baseline and 3- and 6-month data suggest that compared with caregivers receiving clinical evaluation only, caregivers receiving care management reported greater reductions in burden over time. Subgroup analyses also showed statistically significant reductions in caregiver-reported frequency of CR dementia-related behaviors and caregiver distress in response to those symptoms at 3-month follow-up. A community-based, telephone-delivered care management program for caregivers of individuals with dementia is associated with favorable caregiver and CR-related outcomes. Findings support replication and further research in the impact of tailored, collaborative dementia care management programs that address barriers to access and engagement. Published by Elsevier Inc.

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Evaluation of the Tier 1 Program of Project P.A.T.H.S.: Secondary Data Analyses of Conclusions Drawn by the Program Implementers

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2008-01-01

Full Text Available The Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes is a curricula-based positive youth development program. In the experimental implementation phase, 52 schools participated in the program. Based on subjective outcome evaluation data collected from the program participants (Form A and program implementers (Form B in each school, the program implementers were invited to write down five conclusions based on an integration of the evaluation findings (N = 52. The conclusions stated in the 52 evaluation reports were further analyzed via secondary data analyses in this paper. Results showed that most of the conclusions concerning perceptions of the Tier 1 Program, instructors, and effectiveness of the programs were positive in nature. There were also conclusions reflecting the respondents’ appreciation of the program. Finally, responses on the difficulties encountered and suggestions for improvements were observed. In conjunction with the previous evaluation findings, the present study suggests that the Tier 1 Program was well received by the stakeholders and the program was beneficial to the development of the program participants.

Evaluation of a gender-based violence prevention program for student athletes in Mumbai, India.

Science.gov (United States)

Miller, Elizabeth; Das, Madhumita; Tancredi, Daniel J; McCauley, Heather L; Virata, Maria Catrina D; Nettiksimmons, Jasmine; O'Connor, Brian; Ghosh, Sancheeta; Verma, Ravi

2014-03-01

Gender-based violence, which includes sexual and intimate partner violence against women, is prevalent worldwide, prompting calls for primary prevention programs which engage men and boys in changing social norms that condone violence against women. Bystander intervention efforts which encourage males to say something to stop peers from enacting disrespectful and abusive behaviors toward females are a promising strategy for promoting non-violent, gender-equitable attitudes and behaviors. An evaluation of "Parivartan"--a U.S. program called "Coaching Boys Into Men" adapted for urban India cricket teams--was conducted in Mumbai, India. Baseline and 12 month follow-up surveys were administered to 309 male cricket athletes aged 10 to 16 years in 46 urban middle schools in Mumbai, India (27 intervention, 19 control). Athletes whose coaches were trained in the program demonstrated greater improvements in gender-equitable attitudes compared to athletes whose coaches provided standard coaching only. Marginally significant improvements were seen in reduction of negative bystander behavior. Violence prevention programs which utilize coaches as positive messengers for respect and non-violence may be a useful addition to global prevention efforts to reduce violence against women.

Theory-Based Evaluation Meets Ambiguity

DEFF Research Database (Denmark)

Dahler-Larsen, Peter

2017-01-01

As theory-based evaluation (TBE) engages in situations where multiple stakeholders help develop complex program theory about dynamic phenomena in politically contested settings, it becomes difficult to develop and use program theory without ambiguity. The purpose of this article is to explore...... ambiguity as a fruitful perspective that helps TBE face current challenges. Literatures in organization theory and political theory are consulted in order to cultivate the concept of ambiguity. Janus variables (which work in two ways) and other ambiguous aspects of program theories are classified...... and exemplified. Stances towards ambiguity are considered, as are concrete steps that TBE evaluators can take to identify and deal with ambiguity in TBE....

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

A Formative Evaluation of Healthy Heroes: A Photo Comic Book-Social Cognitive Theory Based Obesity Prevention Program

Science.gov (United States)

Branscum, Paul; Housley, Alexandra; Bhochhibhoya, Amir; Hayes, Logan

2016-01-01

Purpose: Low consumption of fruits and vegetables is often associated with poor diet quality, and childhood obesity. The purpose of this study was to assess the feasibility, and conduct a formative evaluation, of Healthy Heroes, an innovative, social cognitive theory-based program that uses child created photo-comic books to promote fruit and…

Evaluation of "College CHEF," a Campus-based, Culinary Nutrition Education Program

Directory of Open Access Journals (Sweden)

Jennifer McMullen

2017-05-01

Conclusions:  Campus-based culinary nutrition education programming has potential to positively impact college students’ fruit and vegetable consumption and cooking knowledge. Future programs should incorporate strategies such as additional opportunities to engage in hands-on practice and building cross-campus collaborations to promote sustainability.

From design to implementation--the Joint Asia Diabetes Evaluation (JADE) program: a descriptive report of an electronic web-based diabetes management program.

Science.gov (United States)

Ko, Gary T; So, Wing-Yee; Tong, Peter C; Le Coguiec, Francois; Kerr, Debborah; Lyubomirsky, Greg; Tamesis, Beaver; Wolthers, Troels; Nan, Jennifer; Chan, Juliana

2010-05-13

The Joint Asia Diabetes Evaluation (JADE) Program is a web-based program incorporating a comprehensive risk engine, care protocols, and clinical decision support to improve ambulatory diabetes care. The JADE Program uses information technology to facilitate healthcare professionals to create a diabetes registry and to deliver an evidence-based care and education protocol tailored to patients' risk profiles. With written informed consent from participating patients and care providers, all data are anonymized and stored in a databank to establish an Asian Diabetes Database for research and publication purpose. The JADE electronic portal (e-portal: http://www.jade-adf.org) is implemented as a Java application using the Apache web server, the mySQL database and the Cocoon framework. The JADE e-portal comprises a risk engine which predicts 5-year probability of major clinical events based on parameters collected during an annual comprehensive assessment. Based on this risk stratification, the JADE e-portal recommends a care protocol tailored to these risk levels with decision support triggered by various risk factors. Apart from establishing a registry for quality assurance and data tracking, the JADE e-portal also displays trends of risk factor control at each visit to promote doctor-patient dialogues and to empower both parties to make informed decisions. The JADE Program is a prototype using information technology to facilitate implementation of a comprehensive care model, as recommended by the International Diabetes Federation. It also enables health care teams to record, manage, track and analyze the clinical course and outcomes of people with diabetes.

From design to implementation - The Joint Asia Diabetes Evaluation (JADE program: A descriptive report of an electronic web-based diabetes management program

Directory of Open Access Journals (Sweden)

Lyubomirsky Greg

2010-05-01

Full Text Available Abstract Background The Joint Asia Diabetes Evaluation (JADE Program is a web-based program incorporating a comprehensive risk engine, care protocols, and clinical decision support to improve ambulatory diabetes care. Methods The JADE Program uses information technology to facilitate healthcare professionals to create a diabetes registry and to deliver an evidence-based care and education protocol tailored to patients' risk profiles. With written informed consent from participating patients and care providers, all data are anonymized and stored in a databank to establish an Asian Diabetes Database for research and publication purpose. Results The JADE electronic portal (e-portal: http://www.jade-adf.org is implemented as a Java application using the Apache web server, the mySQL database and the Cocoon framework. The JADE e-portal comprises a risk engine which predicts 5-year probability of major clinical events based on parameters collected during an annual comprehensive assessment. Based on this risk stratification, the JADE e-portal recommends a care protocol tailored to these risk levels with decision support triggered by various risk factors. Apart from establishing a registry for quality assurance and data tracking, the JADE e-portal also displays trends of risk factor control at each visit to promote doctor-patient dialogues and to empower both parties to make informed decisions. Conclusions The JADE Program is a prototype using information technology to facilitate implementation of a comprehensive care model, as recommended by the International Diabetes Federation. It also enables health care teams to record, manage, track and analyze the clinical course and outcomes of people with diabetes.

From design to implementation - The Joint Asia Diabetes Evaluation (JADE) program: A descriptive report of an electronic web-based diabetes management program

Science.gov (United States)

2010-01-01

Background The Joint Asia Diabetes Evaluation (JADE) Program is a web-based program incorporating a comprehensive risk engine, care protocols, and clinical decision support to improve ambulatory diabetes care. Methods The JADE Program uses information technology to facilitate healthcare professionals to create a diabetes registry and to deliver an evidence-based care and education protocol tailored to patients' risk profiles. With written informed consent from participating patients and care providers, all data are anonymized and stored in a databank to establish an Asian Diabetes Database for research and publication purpose. Results The JADE electronic portal (e-portal: http://www.jade-adf.org) is implemented as a Java application using the Apache web server, the mySQL database and the Cocoon framework. The JADE e-portal comprises a risk engine which predicts 5-year probability of major clinical events based on parameters collected during an annual comprehensive assessment. Based on this risk stratification, the JADE e-portal recommends a care protocol tailored to these risk levels with decision support triggered by various risk factors. Apart from establishing a registry for quality assurance and data tracking, the JADE e-portal also displays trends of risk factor control at each visit to promote doctor-patient dialogues and to empower both parties to make informed decisions. Conclusions The JADE Program is a prototype using information technology to facilitate implementation of a comprehensive care model, as recommended by the International Diabetes Federation. It also enables health care teams to record, manage, track and analyze the clinical course and outcomes of people with diabetes. PMID:20465815

Construction of Engineering Education Program based on the Alumni's Evaluation of the Educational Outcome

Science.gov (United States)

Tsukamoto, Takehiko; Nishizawa, Hitoshi

The Department of Electrical and Electronic Engineering in Toyota National College of Technology has put great emphasis on fundamental subjects, such as “electrical and electronic circuit" and “electromagnetism" more than 40 years. On the other hand, several issues of our college were clarified by the alumni's evaluation of the educational outcome in 2002. The most serious issue was low achievement of English and Social education. The alumni of all generation are dissatisfied with their low skill in English communication. As a part of the educational reforms, our department has constructed a new engineering education program focusing on fundamental ability. We introduced many problem-based-learning experiments and the compulsory subjects such as “English communication for electrical engineers" and “Engineering Ethics" into this program. Great educative results are obtained by these improvements. As a typical example, the scores of all 2nd grade students of advanced engineering course in TOEIC tests became 450 points or more. Our program has been authorized by JABEE since 2004.

An Evaluation of PET Based on Longitudinal Data.

Science.gov (United States)

Mandeville, Garrett K.

Although teacher inservice programs based on Madeline Hunter's Program for Effective Teaching (PET) have become very popular in U.S. schools, there is little evidence that the Hunter model ultimately results in increased student achievement. This longitudinal study attempts to evaluate the effects of Hunter-based staff development programs on…

Connect: An Effective Community-Based Youth Suicide Prevention Program

Science.gov (United States)

Bean, Gretchen; Baber, Kristine M.

2011-01-01

Youth suicide prevention is an important public health issue. However, few prevention programs are theory driven or systematically evaluated. This study evaluated Connect, a community-based youth suicide prevention program. Analysis of pre and posttraining questionnaires from 648 adults and 204 high school students revealed significant changes in…

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Symptoms and biomarkers associated with celiac disease: evaluation of a population-based screening program in adults.

Science.gov (United States)

Kårhus, Line L; Thuesen, Betina H; Rumessen, Jüri J; Linneberg, Allan

2016-11-01

To identify possible early predictors (symptoms and biomarkers) of celiac disease, compare symptoms before and after screening, and evaluate the diagnostic efficacy of serologic screening for celiac disease in an adult Danish population. This cross-sectional population-based study was based on the 5-year follow-up of the Health2006 cohort, where 2297 individuals were screened for celiac disease; 56 were antibody positive and thus invited to clinical evaluation. Eight were diagnosed with biopsy-verified celiac disease. A follow-up questionnaire was sent to antibody-positive individuals 19 months after the clinical evaluation to obtain information on their symptoms and their experience with participation in the screening. Before screening, participants subsequently diagnosed with celiac disease did not differ from the rest of the population with respect to symptoms, but had significantly lower total cholesterol. Tissue transglutaminase IgA antibodies with a cut-off of 10 U/ml had a positive predictive value of 88%. The majority of participants were satisfied with their participation in the screening program. Individuals with celiac disease were generally satisfied with having been diagnosed and 71% felt better on a gluten-free diet. There were no differences in the prevalence of symptoms between participants with and without screening-detected celiac disease, confirming that risk stratification in a general population by symptoms is difficult. The majority of participants diagnosed with celiac disease felt better on a gluten-free diet despite not reporting abdominal symptoms before diagnosis and participants in the clinical evaluation were generally satisfied with participation in the screening program.

Evaluation of radiological teaching programs in the Internet

International Nuclear Information System (INIS)

Seitz, J.; Schubert, S.; Voelk, M.; Scheibl, K.; Paetzel, C.; Schreyer, A.; Djavidani, B.; Feuerbach, S.; Strotzer, M.

2003-01-01

Evaluation of web based training programs,which can be contacted from the homepages of radiological departments of German universities.Material and method From june 2000 to january 2002 the 75 web based training programs of 57 providers,which can be contacted from the web pages of the radiological departments of german universities were evaluated in a prospective study.A medical student experienced in using the world wide web examined each training program three times in an interval of six months using the following criteria: availability of the web sites,target group,kind of training program,contents and structure and the technical solution. 51 of the 57 the homepages were fully available at each visit. 64 of the 75 web based training programs which could be connected from these sites were available at all three visitis.One program was only partially available at one spot check. 8 of the 75 programs were designed for physicians and medically trained personal, 23 were made for medical students and 44 addressed both target groups (partially more than once mentioned).The number of the presented cases ranged between one single and 3700. In 31 of 75 training programs links to other teaching files were found.A complete presentation of cases was presented by 48 of the 75 web sites.5 of the 75 web sites offered physiological images for comparison. In 20 training programs the pathological changes were optically marked in the x-ray images.A logical and didactical structure was found in 24 teaching files, 14 gave the possibility to check the learning results.No provider made use of the possibility to pass credits to the students or physicians acount with regard to official training programs. Multimedia techniques were used in 15 training programs.43 sites used data reduced preview images (thumbnails).The latest update of the site is mentioned in 55 of the 75 web sites. 19 of 57 providers had either no possibility of contact or did not answer to an e-mail. From the homepages

Outcome evaluation of a community center-based program for mothers at high psychosocial risk.

Science.gov (United States)

Rodrigo, María José; Máiquez, María Luisa; Correa, Ana Delia; Martín, Juan Carlos; Rodríguez, Guacimara

2006-09-01

This study reported the outcome evaluation of the "Apoyo Personal y Familiar" (APF) program for poorly-educated mothers from multi-problem families, showing inadequate behavior with their children. APF is a community-based multi-site program delivered through weekly group meetings in municipal resource centers. A total of 340 mothers referred by the municipal social services of Tenerife, Spain were assessed; 185 mothers participated in the APF program that lasted 8 months, and 155 mothers were in the control group. Pre-post test comparisons for the intervention group and post-test comparisons with the control group on self-rating measures of maternal beliefs, personal agency and child-rearing practices were performed. Multivariate tests, t tests and effect sizes (ES) were calculated to determine the program effectiveness on the outcome measures. Mothers' support of nurturist and nativist beliefs and the reported use of Neglect-permissive and Coercive practices significantly decreased after program completion whereas the reported use of Inductive practices significantly increased. Increases in self-efficacy, internal control and role difficulty were also significant in relation to those of the control group. The program was especially effective for older mothers, with fewer children, living in a two-parent family, in urban areas and with either low or medium educational levels. The program was very effective in changing the mothers' perceived competences and modestly effective in changing their beliefs about child development and education and reported child-rearing practices. Changes in personal agency are very important for at-risk parents who feel helpless and with no control over their lives.

Physiotherapists supporting self-management through health coaching: a mixed methods program evaluation.

Science.gov (United States)

Dufour, Sinéad Patricia; Graham, Shane; Friesen, Josh; Rosenblat, Michael; Rous, Colin; Richardson, Julie

2015-01-01

To evaluate a program in support of chronic disease self-management (CDSM) that is founded on a health coaching (HC) approach, includes supervised exercise and mindfulness-based stress reduction components and is delivered within a private practice physiotherapy setting. An explanatory mixed method design, framed by theory-based program evaluation, was employed to evaluate an eight-week group-based program. Standardized self-rated and performance measures were evaluated pre- and post intervention. Additionally, participant focus groups were conducted following the intervention period. An inductive thematic approach was undertaken to analyze the qualitative data. Seventeen participants (N = 17) completed the study. Improvements were seen in both self-report and performance outcomes. Participants explained how and why they felt the program was beneficial. Six themes were generated: (1) group dynamic; (2) learning versus doing; (3) holism and comprehensive care; (4) self-efficacy and empowerment; (5) previous solutions versus new management strategies; and (6) healthcare provider support. This study established that a group program in support of CDSM founded on a HC approach demonstrated potential value from participants as well as favorable outcomes. A pragmatic randomized control trial is required to determine efficacy of this intervention.

Evaluation of HeartSmarts, a Faith-Based Cardiovascular Health Education Program.

Science.gov (United States)

Tettey, Naa-Solo; Duran, Pedro A; Andersen, Holly S; Boutin-Foster, Carla

2017-02-01

In order to effectively address cardiovascular disease among African Americans, evidence-based health information must be disseminated within a context aligned with the values and beliefs of the population. Faith-based organizations play a critical role in meeting the religious and spiritual needs of many African Americans. Additionally, faith-based organizations can be effective in health promotion. A manual was created by incorporating biblical scriptures relating to health messages drawn from existing health manuals oriented toward African Americans. Lay health educators active in their churches participated in a 12-week training to learn the basics of cardiovascular disease and methods for delivering the program to their congregations' members. After the completion of the training, these lay health educators recruited participants from their respective churches and administered their own 12-week HeartSmarts program. Measurements of participants' systolic and diastolic blood pressure (mmHg), height (in.), weight (lbs.), and waist circumference (in.) were taken, and cardiovascular disease knowledge assessments (based on 20 open-ended questions) were administered at the start and end of the 12-week programs. Fourteen predominantly African American churches in NYC participated. Of the 221 participants, 199 completed the program. There were significant reductions in pretest and posttest total participant averages for systolic BP (4.48 mmHg, p health assessment scores had an average increase of 12.74 correct responses (p health messages and reducing cardiovascular risk among African Americans.

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

Science.gov (United States)

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

Science.gov (United States)

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper

Consumer engagement and the development, evaluation and dissemination of evidence-based parenting programs

Science.gov (United States)

Sanders, Matthew R.; Kirby, James N.

2013-01-01

A consumer perspective can contribute much to enhancing the “ecological fit” of population level parenting interventions so they meet the needs of parents. This approach involves building relationships with consumer groups and soliciting consumer input into the relevance and acceptability of interventions, clarifying the enablers and barriers to engagement and involvement of parents, and clarifying variables that influence a parent’s program completion. The adoption of a more collaborative approach to working with consumers is important if meaningful population level change in the prevalence of serious social, emotional and behavioral problems in children and young people is to be achieved. Parents seeking assistance for their children’s behavior come from a diverse range of socioeconomic backgrounds, educational levels, cultures and languages. This paper examines consumer engagement strategies that can be employed throughout the process of program development, evaluation, training and dissemination and in “scaling up” the intervention. We argue that a multi-level public health approach to parenting intervention requires a strong consumer perspective to enable interventions to be more responsive to the preferences and needs of families and to ensure improved population reach of interventions. Examples from large scale dissemination trials are used to illustrate how consumer input can result in an increasingly differentiated suite of evidence-based parenting programs. PMID:22440062

Pilot Evaluation of a Sexual Abuse Prevention Program for Taiwanese Children

Science.gov (United States)

Chen, Yi-Chuen; Fortson, Beverly L.; Tseng, Kai-Wen

2012-01-01

The purpose of the current study was to develop and evaluate the efficacy of a school-based child sexual abuse prevention program for Taiwanese children. Forty-six Taiwanese children age 6 to 13 were divided into one of two groups based on their school grade and then randomly assigned to a skills-based child sexual abuse prevention program who…

Is Something Better than Nothing? An Evaluation of Early Childhood Programs in Cambodia

Science.gov (United States)

Rao, Nirmala; Sun, Jin; Pearson, Veronica; Pearson, Emma; Liu, Hongyun; Constas, Mark A.; Engle, Patrice L.

2012-01-01

This study evaluated the relative effectiveness of home-based, community-based, and state-run early childhood programs across Cambodia. A total of 880 five-year-olds (55% girls) from 6 rural provinces in Cambodia attending State Preschools, Community Preschools, Home-Based Programs, or no programs were assessed twice using the Cambodian…

Dig into Learning: A Program Evaluation of an Agricultural Literacy Innovation

Science.gov (United States)

Edwards, Erica Brown

2016-01-01

This study is a mixed-methods program evaluation of an agricultural literacy innovation in a local school district in rural eastern North Carolina. This evaluation describes the use of a theory-based framework, the Concerns-Based Adoption Model (CBAM), in accordance with Stufflebeam's Context, Input, Process, Product (CIPP) model by evaluating the…

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Design and Evaluation of the User-Adapted Program Scheduling system based on Bayesian Network and Constraint Satisfaction

Science.gov (United States)

Iwasaki, Hirotoshi; Sega, Shinichiro; Hiraishi, Hironori; Mizoguchi, Fumio

In recent years, lots of music content can be stored in mobile computing devices, such as a portable digital music player and a car navigation system. Moreover, various information content like news or traffic information can be acquired always anywhere by a cellular communication and a wireless LAN. However, usability issues arise from the simple interfaces of mobile computing devices. Moreover, retrieving and selecting such content poses safety issues, especially while driving. Thus, it is important for the mobile system to recommend content automatically adapted to user's preference and situation. In this paper, we present the user-adapted program scheduling that generates sequences of content (Program) suiting user's preference and situation based on the Bayesian network and the Constraint Satisfaction Problem (CSP) technique. We also describe the design and evaluation of its realization system, the Personal Program Producer (P3). First, preference such as a genre ratio of content in a program is learned as a Bayesian network model using simple operations such as a skip behavior. A model including each content tends to become large-scale. In order to make it small, we present the model separation method that carries out losslessly compression of the model. Using the model, probabilistic distributions of preference to generate constraints are inferred. Finally satisfying the constraints, a program is produced. This kind of CSP has an issue of which the number of variables is not fixedness. In order to make it variable, we propose a method using metavariables. To evaluate the above methods, we applied them to P3 on a car navigation system. User evaluations helped us clarify that the P3 can produce the program that a user prefers and adapt it to the user.

IPEP: Laboratory performance evaluation reports for management of DOE EM programs

International Nuclear Information System (INIS)

Hensley, J.E.; Lindahl, P.C.; Streets, W.E.

1995-01-01

Environmental restoration program/project managers at DOE's Office of Environmental Management (EM) are making important decisions based on analytical data generated by contracted laboratories. The Analytical Services Division, EM-263, is developing the Integrated Performance Evaluation Program (IPEP) to assess the performance of those laboratories, based on results from Performance Evaluation (PE) programs. The IPEP reports will be used by the laboratories to foster self-assessment and improvement. In addition, IPEP will produce PE reports for three levels of EM management (Operations/Project Offices, Area Program Offices, and Deputy Assistant Secretary Office). These reports will be used to assess whether contracted analytical laboratories have the capability to produce environmental data of the quality necessary for making environmental restoration and waste management decisions

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Evaluation of a Web-Based Professional Development Program (Project ACE) for Teachers of Children with Autism Spectrum Disorders

Science.gov (United States)

Rakap, Salih; Jones, Hazel A.; Emery, Alice Kaye

2015-01-01

This article describes the development, implementation, and second-year evaluation of Project Autism Competencies for Endorsement (ACE), a web-based professional development (PD) program that is designed to train teachers currently working in the field to meet the unique and diverse needs of children with autism spectrum disorders (ASDs). A…

Effects of a Community-Based, Post-Rehabilitation Exercise Program in COPD: Protocol for a Randomized Controlled Trial With Embedded Process Evaluation.

Science.gov (United States)

Desveaux, Laura; Beauchamp, Marla K; Lee, Annemarie; Ivers, Noah; Goldstein, Roger; Brooks, Dina

2016-05-11

This manuscript (1) outlines the intervention, (2) describes how its effectiveness is being evaluated in a pragmatic randomized controlled trial, and (3) summarizes the embedded process evaluation aiming to understand key barriers and facilitators for implementation in new environments. Participating centers refer eligible individuals with COPD following discharge from their local PR program. Consenting patients are assigned to a year-long community exercise program or usual care using block randomization and stratifying for supplemental oxygen use. Patients in the intervention arm are asked to attend an exercise session at least twice per week at their local community facility where their progress is supervised by a case manager. Each exercise session includes a component of aerobic exercise, and activities designed to optimize balance, flexibility, and strength. All study participants will have access to routine follow-up appointments with their respiratory physician, and additional health care providers as part of their usual care. Assessments will be completed at baseline (post-PR), 6, and 12 months, and include measures of functional exercise capacity, quality of life, self-efficacy, and health care usage. Intervention effectiveness will be assessed by comparing functional exercise capacity between intervention and control groups. A mixed-methods process evaluation will be conducted to better understand intervention implementation, guided by Normalization Process Theory and the Consolidated Framework for Implementation Research. Based on results from our pilot work, we anticipate a maintenance of exercise capacity and improved health-related quality of life in the intervention group, compared with a decline in exercise capacity in the usual care group. Findings from this study will improve our understanding of the effectiveness of community-based exercise programs for maintaining benefits following PR in patients with COPD and provide information on how best

Evaluation of nuclear power plant environmental impact prediction, based on monitoring programs. Summary and recommendations

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1977-02-01

An evaluation of the effectivenss of non-radiological environmental monitoring programs is presented. The monitoring programs for Monticello, Haddam Neck, and Millstone Nuclear Generating Plants are discussed. Recommendations for improvements in monitoring programs are presented

Evaluation of Millstone Nuclear Power Plant, Environmental Impact prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1977-02-01

This report evaluates the nonradiological monitoring program at Millstone Nuclear Power Plant. Both operational as well as preoperational monitoring programs were analyzed to produce long-term (5 yr or longer) data sets, where possible. In order to determine the effectiveness of these monitoring programs, the appropriate data sets have to be analyzed by the appropriate statistical analysis. Thus, both open literature and current statistical analysis being developed at Pacific Northwest Laboratories (PNL) were employed in data analysis

Evaluation of Millstone Nuclear Power Plant, Environmental Impact prediction, based on monitoring programs

Energy Technology Data Exchange (ETDEWEB)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1977-02-01

This report evaluates the nonradiological monitoring program at Millstone Nuclear Power Plant. Both operational as well as preoperational monitoring programs were analyzed to produce long-term (5 yr or longer) data sets, where possible. In order to determine the effectiveness of these monitoring programs, the appropriate data sets have to be analyzed by the appropriate statistical analysis. Thus, both open literature and current statistical analysis being developed at Pacific Northwest Laboratories (PNL) were employed in data analysis.

Statistical Process Control in the Practice of Program Evaluation.

Science.gov (United States)

Posavac, Emil J.

1995-01-01

A technique developed to monitor the quality of manufactured products, statistical process control (SPC), incorporates several features that may prove attractive to evaluators. This paper reviews the history of SPC, suggests how the approach can enrich program evaluation, and illustrates its use in a hospital-based example. (SLD)

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

Directory of Open Access Journals (Sweden)

Burgers Jako S

2007-11-01

Full Text Available Abstract Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes

ANA - a program for evaluation of gamma spectra from environmental samples

International Nuclear Information System (INIS)

Mishev, P.

1993-01-01

The program aims at for evaluation of gamma spectra, collected in different multichannel analyzers. It provides file format conversion from most popular file spectra formats. The program includes: spectra visualization; energy and shape calibration; efficiency calibration; automatic peak search; resolving of multiplets and peak calculations, based on program KATOK; isotope library; isotope identification and activity calculations. Three types of efficiency calibrations are possible: spline approximation; two branches logarithmic approximation; and polynomial approximation based on orthonormal polynomials. The suggestions of the International Atomic Energy Agency were taken into account in development of the algorithms. The program allows batch spectra processing appropriate for routine tasks and user controlled evaluations. Calculations of lower detection limits of some user defined isotopes are also possible. The program calculates precisely the statistical uncertainties of the final results. The error sources taken into account are: standard source activity errors, efficiency approximation errors and current measurement errors. (author)

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond's Checklist: A Narrative Review.

Science.gov (United States)

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-09-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond's checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles' structure was analyzed by Drummond's standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond's criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Situated Research Design and Methodological Choices in Formative Program Evaluation

Science.gov (United States)

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Seca Coal-Based Systems Program

International Nuclear Information System (INIS)

Alinger, Matthew

2008-01-01

This report summarizes the progress made during the August 1, 2006 - May 31, 2008 award period under Cooperative Agreement DE-FC26-05NT42614 for the U. S. Department of Energy/National Energy Technology Laboratory (USDOE/NETL) entitled 'SECA Coal Based Systems'. The initial overall objective of this program was to design, develop, and demonstrate multi-MW integrated gasification fuel cell (IGFC) power plants with >50% overall efficiency from coal (HHV) to AC power. The focus of the program was to develop low-cost, high performance, modular solid oxide fuel cell (SOFC) technology to support coal gas IGFC power systems. After a detailed GE internal review of the SOFC technology, the program was de-scoped at GE's request. The primary objective of this program was then focused on developing a performance degradation mitigation path for high performing, cost-effective solid oxide fuel cells (SOFCs). There were two initial major objectives in this program. These were: (1) Develop and optimize a design of a >100 MWe integrated gasification fuel cell (IGFC) power plant; (2) Resolve identified barrier issues concerning the long-term economic performance of SOFC. The program focused on designing and cost estimating the IGFC system and resolving technical and economic barrier issues relating to SOFC. In doing so, manufacturing options for SOFC cells were evaluated, options for constructing stacks based upon various cell configurations identified, and key performance characteristics were identified. Key factors affecting SOFC performance degradation for cells in contact with metallic interconnects were be studied and a fundamental understanding of associated mechanisms was developed using a fixed materials set. Experiments and modeling were carried out to identify key processes/steps affecting cell performance degradation under SOFC operating conditions. Interfacial microstructural and elemental changes were characterized, and their relationships to observed degradation

Demand side management program evaluation based on industrial and commercial field data

International Nuclear Information System (INIS)

Eissa, M.M.

2011-01-01

Demand Response is increasingly viewed as an important tool for use by the electric utility industry in meeting the growing demand for electricity. There are two basic categories of demand response options: time varying retail tariffs and incentive Demand Response Programs. is applying the time varying retail tariffs program, which is not suitable according to the studied load curves captured from the industrial and commercial sectors. Different statistical studies on daily load curves for consumers connected to 22 kV lines are classified. The load curve criteria used for classification is based on peak ratio and night ratio. The data considered here is a set of 120 annual load curves corresponding to the electric power consumption (the western area in the King Saudi Arabia (KSA)) of many clients in winter and some months in the summer (peak period). The study is based on real data from several Saudi customer sectors in many geographical areas with larger commercial and industrial customers. The study proved that the suitable Demand Response for the ESC is the incentive program. - Highlights: → Study helps in selecting the proper demand side program. → A credit will be given for the customers during summer months. → Reduction in the electric bill. → Monthly bill credit is decreased based on customers' peak load reduction. → Guide for applying the proper demand side program suitable for the utility and customers.

Pilot Evaluation of the Feasibility and Acceptability of StressOFF Strategies: A Single-Session School-Based Stress Management Program for Adolescents

Science.gov (United States)

Shapiro, Amy J.; Heath, Nancy L.; Carsley, Dana

2016-01-01

The present study reports the pilot evaluation of the feasibility and acceptability of StressOFF Strategies, a "single-session" (45 min) adolescent-targeted, school-based psychoeducational program, which introduces cognitive behavioral techniques and mindfulness-based techniques. Five hundred and sixty-five Grade 9 students (57% female;…

Process evaluation of a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus.

Science.gov (United States)

Odgers-Jewell, Kate; Isenring, Elisabeth; Thomas, Rae; Reidlinger, Dianne P

2017-07-01

The present study developed and evaluated a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus. Two frameworks, the Medical Research Council (MRC) framework for developing and evaluating complex interventions and the RE-AIM framework were followed. Data to develop the intervention were sourced from scoping of the literature and formative evaluation. Program evaluation comprised analysis of primary recruitment of participants through general practitioners, baseline and end-point measures of anthropometry, four validated questionnaires, contemporaneous facilitator notes and telephone interviews with participants. A total of 16 participants enrolled in the intervention. Post-intervention results were obtained from 13 participants, with an estimated mean change from baseline in weight of -0.72 kg (95%CI -1.44 to -0.01), body mass index of -0.25 kg/m 2 (95%CI -0.49 to -0.01) and waist circumference of -1.04 cm (95%CI -4.52 to 2.44). The group education program was acceptable to participants. The results suggest that recruitment through general practitioners is ineffective, and alternative recruitment strategies are required. This patient-centred, patient-directed, group-based intervention for the management of type 2 diabetes mellitus was both feasible and acceptable to patients. Health professionals should consider the combined use of the MRC and RE-AIM frameworks in the development of interventions to ensure a rigorous design process and to enable the evaluation of all phases of the intervention, which will facilitate translation to other settings. Further research with a larger sample trialling additional recruitment strategies, evaluating further measures of effectiveness and utilising lengthier follow-up periods is required. © 2016 Dietitians Association of Australia.

Web‐based interactive learning programs for dentistry concept and its evaluation

Directory of Open Access Journals (Sweden)

Jitka Feberová

2013-06-01

Full Text Available The change in pedagogy relates partly to the development of electronic media and communication possibilities that are available in networked environments. This new technology dominates and supports the international educational content and learning. The aim of our study was to evaluate this progress in dental edu­cation. The education was compared parallel in two groups of Czech and international students. Groups and teaching hours were in the fourth year of the MD curriculum. Stomatology course materials were prepared and published on the portals of the individual dental study programs (http://dl.cuni.cz. The lectures had different access levels, ranging from materials that were freely available to all International WEB dental faculties’ sources to materials that were accessible only after receiving permission from the authors. A number of software tools were used for the creation of ­e-learning courses, such as, e.g., WebCT, Blackboard, Adobe Connect or Microsoft Class Server. The 291 students who were included in our study were divided into two groups according to the ­e-learning program. The goal of our study was to check student activities during the educational process, namely online work – lessons, articles, videos, lite­rature, quizzes and direct Internet access. The statisticaly significant differences were found in the results of the questionnaire based on five-point Likert scale. The Mann Whitney non-parametric test was used to evaluate students’ activities during the edu­cation process. The ­e-learning course had a direct influence on learning experiences, dental information, opinions and comments. Our results verified that satisfaction is an important and influential factor in determining whether a student decides to choose a dentistry and maxillofacial surgery course. Students prefer to have more time for practical therapy in the clinic. It was demonstrated that examination results did not correspond to the type of

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Evaluation of students' perceptions on game based learning program using fuzzy set conjoint analysis

Science.gov (United States)

Sofian, Siti Siryani; Rambely, Azmin Sham

2017-04-01

An effectiveness of a game based learning (GBL) can be determined from an application of fuzzy set conjoint analysis. The analysis was used due to the fuzziness in determining individual perceptions. This study involved a survey collected from 36 students aged 16 years old of SMK Mersing, Johor who participated in a Mathematics Discovery Camp organized by UKM research group called PRISMatik. The aim of this research was to determine the effectiveness of the module delivered to cultivate interest in mathematics subject in the form of game based learning through different values. There were 11 games conducted for the participants and students' perceptions based on the evaluation of six criteria were measured. A seven-point Likert scale method was used to collect students' preferences and perceptions. This scale represented seven linguistic terms to indicate their perceptions on each module of GBLs. Score of perceptions were transformed into degree of similarity using fuzzy set conjoint analysis. It was found that Geometric Analysis Recreation (GEAR) module was able to increase participant preference corresponded to the six attributes generated. The computations were also made for the other 10 games conducted during the camp. Results found that interest, passion and team work were the strongest values obtained from GBL activities in this camp as participants stated very strongly agreed that these attributes fulfilled their preferences in every module. This was an indicator of efficiency for the program. The evaluation using fuzzy conjoint analysis implicated the successfulness of a fuzzy approach to evaluate students' perceptions toward GBL.

Development of object oriented program `SONSHO` for strength evaluation. Manual of Version 4.0 program

Energy Technology Data Exchange (ETDEWEB)

Hosogai, Hiromi [Joyo Industries Co. Ltd., Tokai, Ibaraki (Japan); Kasahara, Naoto

1998-07-01

Object Oriented Program `SONSHO` predicts creep fatigue damage factors based on Elevated Temperature Structural Design Guide for `Monju` and other various procedures from stress classification data obtained from structural analysis results. From view point of program implementation, it is required that external programs interface and frequent revise from update of material and creep fatigue evaluation methods. Object oriented approach was continuously introduced to improve these aspects of the program. Version 4.0 has the following new functions. (1) Material strength library was implemented as an independent program module based on Microsoft Active X control and 32bitDLL technologies, which can be accessed by general Windows programs. (2) Self instruction system `Wizard` enables manual less operation. (3) Microsoft common object model (COM) was adopted for program interface, and this program can communicate with Excel sheet data on memory. Sonsho Ver.4.0 can work on Windows 95 or Windows NT4.0. Microsoft Visual Basic 5.0 (Enterprose Edition) and Microsoft FORTRAN Power Station 4.0 were adopted for program. (author)

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Rainfall Product Evaluation for the TRMM Ground Validation Program

Science.gov (United States)

Amitai, E.; Wolff, D. B.; Robinson, M.; Silberstein, D. S.; Marks, D. A.; Kulie, M. S.; Fisher, B.; Einaudi, Franco (Technical Monitor)

2000-01-01

Evaluation of the Tropical Rainfall Measuring Mission (TRMM) satellite observations is conducted through a comprehensive Ground Validation (GV) Program. Standardized instantaneous and monthly rainfall products are routinely generated using quality-controlled ground based radar data from four primary GV sites. As part of the TRMM GV program, effort is being made to evaluate these GV products and to determine the uncertainties of the rainfall estimates. The evaluation effort is based on comparison to rain gauge data. The variance between the gauge measurement and the true averaged rain amount within the radar pixel is a limiting factor in the evaluation process. While monthly estimates are relatively simple to evaluate, the evaluation of the instantaneous products are much more of a challenge. Scattegrams of point comparisons between radar and rain gauges are extremely noisy for several reasons (e.g. sample volume discrepancies, timing and navigation mismatches, variability of Z(sub e)-R relationships), and therefore useless for evaluating the estimates. Several alternative methods, such as the analysis of the distribution of rain volume by rain rate as derived from gauge intensities and from reflectivities above the gauge network will be presented. Alternative procedures to increase the accuracy of the estimates and to reduce their uncertainties also will be discussed.

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

Science.gov (United States)

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating community-based public health leadership training.

Science.gov (United States)

Ceraso, Marion; Gruebling, Kirsten; Layde, Peter; Remington, Patrick; Hill, Barbara; Morzinski, Jeffrey; Ore, Peggy

2011-01-01

Addressing the nation's increasingly complex public health challenges will require more effective multisector collaboration and stronger public health leadership. In 2005, the Healthy Wisconsin Leadership Institute launched an annual, year-long intensive "community teams" program. The goal of this program is to develop collaborative leadership and public health skills among Wisconsin-based multisectoral teams mobilizing their communities to improve public health. To measure the scope of participation and program impacts on individual learning and practice, including application of new knowledge and collective achievements of teams on coalition and short-term community outcomes. End-of-year participant program evaluations and follow-up telephone interviews with participants 20 months after program completion. Community-based public health leadership training program. Sixty-eight participants in the Community Teams Program during the years 2006 to 2007 and 2007 to 2008. Professional diversity of program participants; individual learning and practice, including application of new knowledge; and collective achievements of teams, including coalition and short-term community outcomes. Participants in the Community Teams Program represent a diversity of sectors, including nonprofit, governmental, academic, business, and local public health. Participation increased knowledge across all public health and leadership competency areas covered in the program. Participating teams reported outcomes, including increased engagement of community leadership, expansion of preventive services, increased media coverage, strengthened community coalitions, and increased grant funding. Evaluation of this community-based approach to public health leadership training has shown it to be a promising model for building collaborative and public health leadership skills and initiating sustained community change for health improvement.

Neighborhood-based physical activity differences: Evaluation of the effect of health promotion program.

Directory of Open Access Journals (Sweden)

Amanda Cristina de Souza Andrade

Full Text Available The practice of physical activity is an important factor in the prevention of health problems. However, a small portion of the population is physically active. Recent reviews show that physical activity classes in community settings have the potential to increase population levels of physical activity and reduce health inequalities.To evaluate the effect of the Academias da Cidade Program in Belo Horizonte on the practice of physical activity in leisure time (PALT by non-users living near the program centers.We conducted a home-based health survey in Belo Horizonte (2008-2009 with 1,581 adults who were non-users of the program and who lived within a 1,500-meter radius of one active program center (exposed group and two nonoperational centers with sites reserved for their construction (unexposed group. We collected data on PALT levels (≥150 minutes/week, which was measured with the Physical Activity International Questionnaire and analyzed with binary logistic regression using the Generalized Estimating Equations method. The propensity score was used as an adjustment variable to control the potential confusion in the measures of effect of exposure studied.The overall prevalence of the PALT was 26.5% in the exposed group and 22.7% in the unexposed group. The exposed group was more likely to be active in leisure time (OR = 1.05; CI 95%: 1.01-1.10. When considering the interaction between exposed group and distance, individuals in the exposed group who lived less than 500 meters from the program center were more likely to be active in leisure time (OR = 1.18, CI 95%: 1.03-1.35 compared to their counterparts.Promoting physical activity in the community can favorably affect PALT levels among residents, especially those living closest to intervention centers. We believe the Academias da Cidade Program is a promising strategy to facilitate the access to appropriate spaces for the practice of physical activity and contribute to increase the levels

Quantitative Evaluation of the Community Research Fellows Training Program

Directory of Open Access Journals (Sweden)

Lucy eD'Agostino McGowan

2015-07-01

Full Text Available Context: The Community Research Fellows Training (CRFT program is a community-based participatory research (CBPR initiative for the St. Louis area. This fifteen week program, based on a Master in Public Health curriculum, was implemented by the Division of Public Health Sciences at Washington University School of Medicine in partnership with the Siteman Cancer Center. Objectives: We measure the knowledge gained by participants and evaluate participant and faculty satisfaction of the CRFT program both in terms of meeting learning objectives and actively engaging the community in the research process.Participants: We conducted analyses on 44 community members who participated in the CRFT program and completed the baseline and follow-up knowledge assessments.Main Outcome Measures: Knowledge gain is measured by a baseline and follow-up assessment given at the first and final session. Additionally, pre- and post-tests are given after the first 12 sessions. To measure satisfaction, program evaluations are completed by both the participants and faculty after each topic. Mid-way through the program, a mid-term assessment was administered to assess the program’s community engagement. We analyzed the results from the assessments, pre- and post-tests, and evaluations.Results: The CRFT participants’ knowledge increased at follow-up as compared with baseline on average by a 16.5 point difference (p<0.0001. Post-test scores were higher than pre-test scores for 11 of the 12 sessions. Both participants and faculty enjoyed the training and rated all session well.Conclusions: The CRFT program was successful in increasing community knowledge, in participant satisfaction, and in faculty satisfaction. This success has enhanced the infrastructure for CBPR as well as led to CBPR pilot projects that address health disparities in the St. Louis Greater Metropolitan Area.

Evaluation of criteria for sustainability of community-based rural homestay programs via a modified pairwise comparison method

Science.gov (United States)

Ramli, Rohaini; Kasim, Maznah Mat; Ramli, Razamin; Kayat, Kalsom; Razak, Rafidah Abd

2014-12-01

Ministry of Tourism and Culture Malaysia has long introduced homestay programs across the country to enhance the quality of life of people, especially those living in rural areas. This type of program is classified as a community-based tourism (CBT) as it is expected to economically improve livelihood through cultural and community associated activities. It is the aspiration of the ministry to see that the income imbalance between people in the rural and urban areas is reduced, thus would contribute towards creating more developed states of Malaysia. Since 1970s, there are 154 homestay programs registered with the ministry. However, the performance and sustainability of the programs are still not satisfying. There are only a number of homestay programs that perform well and able to sustain. Thus, the aim of this paper is to identify relevant criteria contributing to the sustainability of a homestay program. The criteria are evaluated for their levels of importance via the use of a modified pairwise method and analyzed for other potentials. The findings will help the homestay operators to focus on the necessary criteria and thus, effectively perform as the CBT business initiative.

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Differential Programming Needs of College Students Preferring Web-Based Versus In-Person Physical Activity Programs.

Science.gov (United States)

Goldstein, Stephanie P; Forman, Evan M; Butryn, Meghan L; Herbert, James D

2017-09-21

College students report several barriers to exercise, highlighting a need for university-based programs that address these challenges. In contrast to in-person interventions, several web-based programs have been developed to enhance program engagement by increasing ease of access and lowering the necessary level of commitment to participate. Unfortunately, web-based programs continue to struggle with engagement and less-than-ideal outcomes. One explanation for this discrepancy is that different intervention modalities may attract students with distinctive activity patterns, motivators, barriers, and program needs. However, no studies have formally evaluated intervention modality preference (e.g., web-based or in-person) among college students. The current study sought to examine the relationship between intervention modality preference and physical activity programming needs. Undergraduate students (n = 157) enrolled in psychology courses at an urban university were asked to complete an online survey regarding current activity patterns and physical activity program preferences. Participants preferring web-based physical activity programs exercised less (p = .05), were less confident in their abilities to exercise (p = .01), were less likely to endorse the maintenance stage of change (p web-based programming may require programs that enhance self-efficacy by fostering goal-setting and problem-solving skills. A user-centered design approach may enhance the engagement (and therefore effectiveness) of physical activity promotion programs for college students.

The development of a parenting program for incarcerated mothers in Australia: a review of prison-based parenting programs.

Science.gov (United States)

Newman, Claire; Fowler, Cathrine; Cashin, Andrew

2011-08-01

The increasing population of children with an incarcerated parent is a significant public health issue. A literature search highlighted that children of incarcerated parents experience psychological stressors that may potentially impact on health and behavioural outcomes. Parenting programs for prisoners may be of benefit as early parenting experiences during childhood have a significant impact on a child's future experiences as an adolescent and adult. A review of identified evaluation-based studies of parenting programs for prisoners (N = 11), although varied in program delivery approaches and evaluation methods, suggest that such programs have the potential to improve the parenting skills, knowledge and confidence of incarcerated parents. Finally, this paper provides an outline of the development of an Australian based parenting program for incarcerated mothers and their young children.

Towards Bridging the Gap Programming Language and Partial Evaluation

DEFF Research Database (Denmark)

Le Meur, Anne-Francoise; Lawall, Julia Laetitia; Consel, Charles

2002-01-01

Partial evaluation is a program-transformation technique that automatically specializes a program with respect to user-supplied invariants. Despite successful applications in areas such as graphics, operating systems, and software engineering, partial evaluators have yet to achieve widespread use....... One reason is the difficulty of adequately describing specialization opportunities. Indeed, under-specialization or over-specialization often occurs, without any direct feedback to the user as to the source of the problem.We have developed a high-level, module-based language allowing the programmer...... to guide the choice of both the code to specialize and the invariants to exploit during the specialization process. To ease the use of partial evaluation, the syntax of this language is similar to the declaration syntax of the target language of the partial evaluator. To provide feedback to the programmer...

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Evaluation of an innovative late-life depression training program.

Science.gov (United States)

Smith, Marianne; Stolder, Mary Ellen; Liu, Megan Fang

2014-01-01

This paper describes evaluation findings associated with an innovative, CD-based, self-directed training program that was designed to improve general practice nurses' abilities to identify and care for older adults with depression. A voluntary sample of nurses completed an evaluation that focused on participants' perceptions of changes in their knowledge and skills and usefulness of the program. Quantitative items received high ratings, and narrative responses to open-ended questions were largely positive. Many opportunities exist for psychiatric nurses to facilitate, support, and extend training principles to promote late-life depression recognition and treatment. © 2013 Wiley Periodicals, Inc.

Economic Evaluation of a Comprehensive Teenage Pregnancy Prevention Program: Pilot Program

Science.gov (United States)

Rosenthal, Marjorie S.; Ross, Joseph S.; Bilodeau, RoseAnne; Richter, Rosemary S.; Palley, Jane E.; Bradley, Elizabeth H.

2011-01-01

Background Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic are effective in reducing births among enrolled teenagers. However, there have been limited data on costs and cost-effectiveness of such programs. Objectives To use a community-based participatory research approach, to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Methods Using data from 1997-2003, we conducted an in-time intervention analysis to determine program cost-benefit while teenagers were enrolled and then used an extrapolation analysis to estimate accyrred economibc benefits and cost-benefit up to age 30. Results The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage females, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1,599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 on average, with social benefits outweighing total social costs by age 20.1. Conclusions We estimate that this comprehensive teenage pregnancy prevention program would provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost-effectiveness of similarly comprehensive programs when implemented more widely in high-risk neighborhoods. PMID:19896030

Economic evaluation of a comprehensive teenage pregnancy prevention program: pilot program.

Science.gov (United States)

Rosenthal, Marjorie S; Ross, Joseph S; Bilodeau, Roseanne; Richter, Rosemary S; Palley, Jane E; Bradley, Elizabeth H

2009-12-01

Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic support are effective in reducing births among enrolled teenagers. However, there have been limited data on the costs and cost effectiveness of such programs. The study used a community-based participatory research approach to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Using data from 1997-2003, an in-time intervention analysis was conducted to determine program cost-benefit while teenagers were enrolled; an extrapolation analysis was then used to estimate accrued economic benefits and cost-benefit up to age 30 years. The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage girls, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 years on average, with social benefits outweighing total social costs by age 20.1 years. This comprehensive teenage pregnancy prevention program is estimated to provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost effectiveness of similarly comprehensive programs when they are implemented more widely in high-risk neighborhoods.

Strategies and policies for improving energy efficiency programs: Closing the loop between evaluation and implementation

International Nuclear Information System (INIS)

Vine, Edward

2008-01-01

Program implementers often use evaluation results to improve the performance of their programs, but, as described in this paper, this is not always the case. Based on a review of the literature, participation in workshops, and interviews with over 50 program implementers, evaluators, and regulators in the United States and Canada, the utilization of evaluation results is investigated by asking the following questions: (1) How are program evaluation results used by program implementers and other stakeholders? (2) How are program evaluation results communicated to program implementers and other stakeholders? (3) Are the needs of program implementers being met by program evaluation? (4) What is the role of the utility regulator in facilitating the use of program evaluation results? (5) What other mechanisms can facilitate the use of program evaluation results? While there is some consensus on the answers to these questions, the type of interest in and use of evaluation varies by functional role (e.g., evaluator versus implementer), maturity of the energy efficiency market, institutional context (e.g., evaluation and implementation conducted inside the same organization, or evaluation and implementation conducted by separate entities), and by regulatory demands and evaluation interests

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

An evaluation of the Browns Ferry Nuclear Plant preventive maintenance program based on reliability centered maintenance analysis

International Nuclear Information System (INIS)

McCullough, C.L.; McCullough, C.A.

1989-01-01

Reliability centered maintenance (RCM) techniques were used to support a preventative maintenance (PM) upgrade program (PMUP) performed at TVA Browns Ferry Nuclear Plant (BFNP). The purpose of the RCM analysis was to identify critical equipment based on risk and economic importance and to evaluate the PM activities applicable to that equipment. The analysis may be conveniently divided into three steps, which will be outlined in the Approach section of this paper. The net benefit of the RCM approach was a prioritization of the focus of the PM upgrade program so that plant components receive attention proportional to their importance, and assurance that PM activities properly address the most likely component failure causes

Evaluating public involvement in the National Low-Level Radioactive Waste Management Program

International Nuclear Information System (INIS)

1982-09-01

The Department of Energy contracted with the Keystone Center to evaluate the effectiveness of the National Low-Level Radioactive Waste Management Program's public-involvement efforts. The Center chose six evaluators with diverse training and experience related to low-level waste management and public-participation programs. Keystone's evaluation was based on (a) observations by the evaluators who attended the National Program-sponsored strategy review meetings and fairs; (b) interviews with low-level waste generators, local government officials, state legislators, public-interest groups, and members of the general public; and (c) observations of the final National Program strategy task force meeting. The evaluators concluded that, overall, the public-participation processes yielded some very positive results - for policy development and for DOE and the EG and G staff. They judged the strategy document to be complete, concise, and helpful to public dialogue on low-level waste issues. They also made specific recommendations for improvements to the public-participation program

Evaluating the effectiveness of a laboratory-based professional development program for science educators

Science.gov (United States)

Amolins, Michael Wayne

The development of effective science educators has been a long-standing goal of the American education system. Numerous studies have suggested a breadth of professional development programs that have sought to utilize constructivist principles in order to orchestrate movement toward student-led, inquiry-based instruction. Very few, however, have addressed a missing link between the modern scientific laboratory and the traditional science classroom. While several laboratory-based training programs have begun to emerge in recent years, the skills necessary to translate this information into the classroom are rarely addressed. The result is that participants are often left without an outlet or the confidence to integrate these into their lessons. The purpose of this study was to examine the effectiveness of a laboratory-based professional development program focused on classroom integration and reformed science teaching principles. This was measured by the ability to invigorate its seven participants in order to achieve higher levels of success and fulfillment in the classroom. These participants all taught at public high schools in South Dakota, including both rural and urban locations, and taught a variety of courses. Participants were selected for this study through their participation in the Sanford Research/USD Science Educator Research Fellowship Program. Through the use of previously collected data acquired by Sanford Research, this study attempted to detail the convergence of three assessments in order to demonstrate the growth and development of its participants. First, pre- and post-program surveys were completed in order to display the personal and professional growth of its participants. Second, pre- and post-program classroom observations employing the Reformed Teaching Observation Protocol allowed for the assessment of pedagogical modifications being integrated by each participant, as well as the success of such modifications in constructively

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

[A critical evaluation of food programs in Argentina].

Science.gov (United States)

Abeyá Gilardon, Enrique O

2016-01-01

Argentina has an over 60-year history of food programs which have received few to no evaluations, even considering the highly important epidemiological and social changes that have occurred in the target population. In this article, nationwide State-run food programs with the objective of contributing to the food security of the families in greatest need are reviewed, the nutritional situation of the target population is reassessed, and arguments for analyzing current programs using a typology based in the components of food security are proposed. A general review of the conceptions, content and reach of food programs should be carried out, in order for these programs to cease to act as mere social assistance and instead be transformed in bearers of the right to better food and nutrition.

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

KiVa Antibullying Program: Overview of Evaluation Studies Based on a Randomized Controlled Trial and National Rollout in Finland

Directory of Open Access Journals (Sweden)

Christina Salmivalli

2012-12-01

Full Text Available The effects of a Finnish national school-based antibullying program (KiVa were evaluated in a randomized controlled trial (2007–2009 and during nationwide implementation (since 2009. The KiVa program is been found to reduce bullying and victimization and increase empathy towards victimized peers and self-efficacy to support and defend them. KiVa increases school liking and motivation and contributes to significant reductions in anxiety, depression, and negative peer perceptions. Somewhat larger reductions in bullying and victimization were found in the randomized controlled trial than in the broad rollout, and the largest effects were obtained in primary school (grades 1–6. The uptake of the KiVa program is remarkable, with 90 percent of Finnish comprehensive schools currently registered as program users.

Evaluating Teen Pregnancy Prevention Programs: Decades of Evolving Strategies and Practices

Directory of Open Access Journals (Sweden)

Susan Philliber

2015-09-01

Full Text Available This paper reviews the changing strategies for both process and outcome evaluations of teen pregnancy prevention programs over the past few decades. Implementation evaluations have emphasized discovery of what program attributes are most effective in reducing teen pregnancy and its antecedents. Outcome evaluations have moved from collecting data to measure knowledge, attitudes, and program satisfaction to measuring behavior change including postponement of sexual involvement, increased used of contraception, or reduction in teen pregnancy. High quality randomized control trials or quasi-experimental designs are being increasingly emphasized, as are sophisticated analysis techniques using multi-variate analyses, controls for cluster sampling, and other strategies designed to build a more solid knowledge base about how to prevent early pregnancy.

Using GIS to evaluate a fire safety program in North Carolina.

Science.gov (United States)

Dudley, Thomas; Creppage, Kathleen; Shanahan, Meghan; Proescholdbell, Scott

2013-10-01

Evaluating program impact is a critical aspect of public health. Utilizing Geographic Information Systems (GIS) is a novel way to evaluate programs which try to reduce residential fire injuries and deaths. The purpose of this study is to demonstrate the application of GIS within the evaluation of a smoke alarm installation program in North Carolina. This approach incorporates national fire incident data which, when linked with program data, provides a clear depiction of the 10 years impact of the Get Alarmed, NC! program and estimates the number of potential lives saved. We overlapped Get Alarmed, NC! program installation data with national information on fires using GIS to identify homes that experienced a fire after an alarm was installed and calculated potential lives saved based on program documentation and average housing occupancy. We found that using GIS was an efficient and quick way to match addresses from two distinct sources. From this approach we estimated that between 221 and 384 residents were potentially saved due to alarms installed in their homes by Get Alarmed, NC!. Compared with other program evaluations that require intensive and costly participant telephone surveys and/or in-person interviews, the GIS approach is inexpensive, quick, and can easily analyze large disparate datasets. In addition, it can be used to help target the areas most at risk from the onset. These benefits suggest that by incorporating previously unutilized data, the GIS approach has the potential for broader applications within public health program evaluation.

Tryon Trekkers: An Evaluation of a STEM Based Afterschool Program for At-Risk Youth

Science.gov (United States)

Eckels Anderson, Chessa

This study contributed to the body of research that supports a holistic model of afterschool learning through the design of an afterschool intervention that benefits elementary school students of low socioeconomic status. This qualitative study evaluated a science focused afterschool curriculum that was designed using principles from Risk and Resiliency Theory, academic motivation theories, science core ideas from the Next Generation Science Standards, and used environmental education philosophy. The research question of this study is: how does an outdoor and STEM based afterschool program impact at-risk students' self-efficacy, belonging and engagement and ability to apply conceptual knowledge of environmental science topics? The study collected information about the participants' affective experiences during the intervention using structured and ethnographic observations and semi-structured interviews. Observations and interviews were coded and analyzed to find patterns in participants' responses. Three participant profiles were developed using the structured observations and ethnographic observations to provide an in depth understanding of the participant experience. The study also assessed the participants' abilities to apply conceptual understanding of the program's science topics by integrating an application of conceptual knowledge task into the curriculum. This task in the form of a participant project was assessed using an adapted version of the Portland Metro STEM Partnership's Application of Conceptual Knowledge Rubric. Results in the study showed that participants demonstrated self-efficacy, a sense of belonging and engagement during the program. Over half of the participants in the study demonstrated a proficient understanding of program concepts. Overall, this holistic afterschool program demonstrated that specific instructional practices and a multi-modal science curriculum helped to support the social and emotional needs of at-risk children.

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Repository-Based Software Engineering Program: Working Program Management Plan

Science.gov (United States)

1993-01-01

Repository-Based Software Engineering Program (RBSE) is a National Aeronautics and Space Administration (NASA) sponsored program dedicated to introducing and supporting common, effective approaches to software engineering practices. The process of conceiving, designing, building, and maintaining software systems by using existing software assets that are stored in a specialized operational reuse library or repository, accessible to system designers, is the foundation of the program. In addition to operating a software repository, RBSE promotes (1) software engineering technology transfer, (2) academic and instructional support of reuse programs, (3) the use of common software engineering standards and practices, (4) software reuse technology research, and (5) interoperability between reuse libraries. This Program Management Plan (PMP) is intended to communicate program goals and objectives, describe major work areas, and define a management report and control process. This process will assist the Program Manager, University of Houston at Clear Lake (UHCL) in tracking work progress and describing major program activities to NASA management. The goal of this PMP is to make managing the RBSE program a relatively easy process that improves the work of all team members. The PMP describes work areas addressed and work efforts being accomplished by the program; however, it is not intended as a complete description of the program. Its focus is on providing management tools and management processes for monitoring, evaluating, and administering the program; and it includes schedules for charting milestones and deliveries of program products. The PMP was developed by soliciting and obtaining guidance from appropriate program participants, analyzing program management guidance, and reviewing related program management documents.

Basalt Waste Isolation Project Technical Program Evaluation Process: a criteria-based method

International Nuclear Information System (INIS)

Babad, H.; Evans, G.C.; Wolfe, B.A.

1982-01-01

The need to objectively evaluate the progress being made by the Basalt Waste Isolation Project (BWIP) toward establishing the feasibility of siting a nuclear waste repository in basalt (NWRB) mandates a process for evaluating the technical work of the project. To assist BWIP management in the evaluation process, the Systems Department staff has developed a BWIP Technical Program Evaluation Process (TPEP). The basic process relates progress on project technical work to the SWIP Functional and System Performance Criteria as defined in National Waste Terminal Storage (MWTS) Criteria Documents. The benefits of the TPEP to BWIP and future plans for TPEP are discussed. During fiscal year (FY) 1982, TPEP wll be further formalized and further applied to the review of BWIP technical activities

Seca Coal-Based Systems Program

Energy Technology Data Exchange (ETDEWEB)

Matthew Alinger

2008-05-31

This report summarizes the progress made during the August 1, 2006 - May 31, 2008 award period under Cooperative Agreement DE-FC26-05NT42614 for the U. S. Department of Energy/National Energy Technology Laboratory (USDOE/NETL) entitled 'SECA Coal Based Systems'. The initial overall objective of this program was to design, develop, and demonstrate multi-MW integrated gasification fuel cell (IGFC) power plants with >50% overall efficiency from coal (HHV) to AC power. The focus of the program was to develop low-cost, high performance, modular solid oxide fuel cell (SOFC) technology to support coal gas IGFC power systems. After a detailed GE internal review of the SOFC technology, the program was de-scoped at GE's request. The primary objective of this program was then focused on developing a performance degradation mitigation path for high performing, cost-effective solid oxide fuel cells (SOFCs). There were two initial major objectives in this program. These were: (1) Develop and optimize a design of a >100 MWe integrated gasification fuel cell (IGFC) power plant; (2) Resolve identified barrier issues concerning the long-term economic performance of SOFC. The program focused on designing and cost estimating the IGFC system and resolving technical and economic barrier issues relating to SOFC. In doing so, manufacturing options for SOFC cells were evaluated, options for constructing stacks based upon various cell configurations identified, and key performance characteristics were identified. Key factors affecting SOFC performance degradation for cells in contact with metallic interconnects were be studied and a fundamental understanding of associated mechanisms was developed using a fixed materials set. Experiments and modeling were carried out to identify key processes/steps affecting cell performance degradation under SOFC operating conditions. Interfacial microstructural and elemental changes were characterized, and their relationships to observed

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 2

Science.gov (United States)

Greenburg, J. S.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

The computational procedures used in the evaluation of spacecraft technology programs that impact upon commercial communication satellite operations are discussed. Computer programs and data bases are described.

A constructive Indian country response to the evidence-based program mandate.

Science.gov (United States)

Walker, R Dale; Bigelow, Douglas A

2011-01-01

Over the last 20 years governmental mandates for preferentially funding evidence-based "model" practices and programs has become doctrine in some legislative bodies, federal agencies, and state agencies. It was assumed that what works in small sample, controlled settings would work in all community settings, substantially improving safety, effectiveness, and value-for-money. The evidence-based "model" programs mandate has imposed immutable "core components," fidelity testing, alien programming and program developers, loss of familiar programs, and resource capacity requirements upon tribes, while infringing upon their tribal sovereignty and consultation rights. Tribal response in one state (Oregon) went through three phases: shock and rejection; proposing an alternative approach using criteria of cultural appropriateness, aspiring to evaluability; and adopting logic modeling. The state heard and accepted the argument that the tribal way of knowing is different and valid. Currently, a state-authorized tribal logic model and a review panel process are used to approve tribal best practices for state funding. This constructive response to the evidence-based program mandate elevates tribal practices in the funding and regulatory world, facilitates continuing quality improvement and evaluation, while ensuring that practices and programs remain based on local community context and culture. This article provides details of a model that could well serve tribes facing evidence-based model program mandates throughout the country.

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

Evidence from the field: Findings on issues related to planning, implementing and evaluating gender-based programs.

Science.gov (United States)

Kowalczyk, Shelly; Randolph, Suzanne; Stokes, Shereitte; Winston, Stefanie

2015-08-01

An Initiative of the United States Department of Health and Human Services' Office on Women's Health (OWH), Coalition for a Healthier Community (CHC), supports ten grantees across the U.S. in the implementation of gender-based health interventions targeting women and girls. A national evaluation is assessing whether gender-focused public health systems approaches are sustainable and cost effective in addressing health disparities in women and girls. To inform the evaluation, a systematic examination was conducted of literature in both the public and private sector designed to track, assess, understand, and improve women's health, public health systems approaches, and the cost-effectiveness and sustainability of gender-based programs. A two-person team assured the quality of the results following the review of abstracts and full-text articles. Of 123 articles meeting eligibility criteria (See inclusion criteria described in Section 2.2 below), only 18 met inclusion criteria specific to a focus on a systems approach, cost-effectiveness and/or sustainability. Studies assessing systems approaches suggested their effectiveness in changing perceptions and increasing knowledge within a community; increasing involvement of local decision-makers and other community leaders in women's health issues; and increasing community capacity to address women and girls' health. Further evaluation of the cost-effectiveness and sustainability of gender-based approaches is needed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Assessment of military population-based psychological resilience programs.

Science.gov (United States)

Morgan, Brenda J; Bibb, Sandra C Garmon

2011-09-01

Active duty service members' (ADSMs) seemingly poor adaptability to traumatic stressors is a risk to force health. Enhancing the psychological resilience of ADSMs has become a key focus of Department of Defense (DoD) leaders and the numbers of military programs for enhancing psychological resilience have increased. The purpose of this article is to describe the results of an assessment conducted to determine comprehensiveness of current psychological resilience building programs that target ADSMs. A modified six-step, population-based needs assessment was used to evaluate resilience programs designed to meet the psychological needs of the ADSM population. The assessment results revealed a gap in published literature regarding program outcomes. DoD leaders may benefit from targeted predictive research that assesses program effectiveness outcomes. The necessity of including preventive, evidence-based interventions in new programs, such as positive emotion interventions shown to enhance psychological resilience in civilian samples, is also recommended.

Evaluating the Effectiveness of the 2002-2003 NASA SCIence Files(TM) Program

Science.gov (United States)

Pinelli, Thomas E.; Lambert, Matthew A.; Williams, Amy C.

2004-01-01

NASA SCIence Files (tm) is a research-, inquiry-, and standards-based, integrated mathematics, science, and technology series of 60-minute instructional distance learning (television and web-based) programs for students in grades 3-5. Respondents who evaluated the programs in the 2002-2003 NASA SCIence Files (tm) series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Evaluation of a fissure sealant program as part of community-based teaching and training.

Science.gov (United States)

van Wyk, Philippus J; Kroon, Jeroen; White, John G

2004-01-01

Since 1995 the Department of Community Dentistry of the University of Pretoria has been involved in the rendering of mobile primary oral health care services to children in the Hammanskraal area of Gauteng, South Africa, as part of their students' community-based training. Mokonyama Primary School was identified as the first school where a primary oral health care service could be rendered. The objective of this study was to evaluate the impact (outcomes) of a fissure sealant program on the dentition status of the school children. Seven years after the implementation of the program, the dentition status of children at Mokonyama was compared with that of a comparable group of children from the same area who were not exposed to the program. The results showed that the decayed, missing, and filled teeth in the primary dentition (dmft) in the six-year-old group in Mokonyama (1.74) did not differ significantly from the dmft (1.43) of the control group (p = 0.49). The decayed, missing, and filled teeth in the permanent dentition (DMFT) of 0.59 for the fifteen-year-old group in Mokonyama, however, differed significantly (p = 0.0001) from the DMFT of the control group (2.38). Fifteen-year-old children in Mokonyama had 75.2 percent fewer caries than their counterparts in the control group.

Evaluation of a Place-Based Environmental Education Program: From There to Here

Science.gov (United States)

Cincera, Jan; Johnson, Bruce; Kovacikova, Silvia

2015-01-01

The article introduces a Czech environmental education middle school program focused on helping students develop place attachment to their community and on increasing their interest in natural area in their region. The evaluation applied a mixed approach combining pretesting/posttesting of the students (N = 158), two group interviews with selected…

Evaluation of effects of program for improving skills and motivation for employment

Directory of Open Access Journals (Sweden)

Marić Zorica

2011-01-01

Full Text Available Contemporary programs that have been implemented in order to help unemployed reduce time for finding a job are based on clear theoretical background and empirical evidence. In addition to providing opportunities to learn necessary skills, these programs also incorporate important psychological components which will be addressed in this paper. The goal of these interventions is to reduce time for finding a job, prevent long-term unemployment and negative effects of unemployment on individuals“ mental health. The paper presents evaluation of the effects of these psychological interventions. The program was based on Ajzen’s theory of planned behavior (2005, Bandura’s social-cognitive theory (1997 and cognitive-behavior theory of behavioral change (Meichenbaum, 1993. The goal of this program was to help unemployed individuals take an active role in finding a job, reduce time for finding a job and prevent negative effects of unemployment on their mental health. The target group of the program were young unemployed individuals ages 19 - 30, with at least high school level of education. Evaluation study was conducted on a sample of 92 male and female individuals who attended 3-day psychological program. Participants filled out five short scales specifically designed to assess variables that were targeted for change, such as, active approach to finding a job, attitudes toward process of employment, self-efficacy and resilience to frustrations and obstacles. Scales were administered before and after the training. Evaluation results, based on these pre and post measures, showed significant positive effects of this program on all five variables.

Evaluation of a Drowning Prevention Program Based on Testimonial Videos: A Randomized Controlled Trial.

Science.gov (United States)

Shen, Jiabin; Pang, Shulan; Schwebel, David C

2016-06-01

Unintentional drowning is the most common cause of childhood death in rural China. Global intervention efforts offer mixed results regarding the efficacy of educational programs. Using a randomized controlled design, we evaluated a testimonial-based intervention to reduce drowning risk among 280 3rd- and 4th-grade rural Chinese children. Children were randomly assigned to view either testimonials on drowning risk (intervention) or dog-bite risk (control). Safety knowledge and perceived vulnerability were measured by self-report questionnaires, and simulated behaviors in and near water were assessed with a culturally appropriate dollhouse task. Children in the intervention group had improved children's safety knowledge and simulated behaviors but not perceived vulnerability compared with controls. The testimonial-based intervention's efficacy appears promising, as it improved safety knowledge and simulated risk behaviors with water among rural Chinese children. © The Author 2015. Published by Oxford University Press on behalf of the Society of Pediatric Psychology. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Using Elite Athletes to Promote Drug Abstinence: Evaluation of a Single-Session School-Based Drug Use Prevention Program Delivered by Junior Hockey Players

Science.gov (United States)

Wong, Jennifer

2016-01-01

School-based substance use prevention programs are a common method to approaching drug use in youths. Project SOS is a single-session drug prevention program developed by police officers and delivered by elite junior hockey players to students in grades 6 and 7. The current study evaluates the effects of Project SOS at achieving its objectives of…

A High Precision Comprehensive Evaluation Method for Flood Disaster Loss Based on Improved Genetic Programming

Institute of Scientific and Technical Information of China (English)

ZHOU Yuliang; LU Guihua; JIN Juliang; TONG Fang; ZHOU Ping

2006-01-01

Precise comprehensive evaluation of flood disaster loss is significant for the prevention and mitigation of flood disasters. Here, one of the difficulties involved is how to establish a model capable of describing the complex relation between the input and output data of the system of flood disaster loss. Genetic programming (GP) solves problems by using ideas from genetic algorithm and generates computer programs automatically. In this study a new method named the evaluation of the grade of flood disaster loss (EGFD) on the basis of improved genetic programming (IGP) is presented (IGPEGFD). The flood disaster area and the direct economic loss are taken as the evaluation indexes of flood disaster loss. Obviously that the larger the evaluation index value, the larger the corresponding value of the grade of flood disaster loss is. Consequently the IGP code is designed to make the value of the grade of flood disaster be an increasing function of the index value. The result of the application of the IGP-EGFD model to Henan Province shows that a good function expression can be obtained within a bigger searched function space; and the model is of high precision and considerable practical significance.Thus, IGP-EGFD can be widely used in automatic modeling and other evaluation systems.

Milestone-specific, Observed data points for evaluating levels of performance (MODEL) assessment strategy for anesthesiology residency programs.

Science.gov (United States)

Nagy, Christopher J; Fitzgerald, Brian M; Kraus, Gregory P

2014-01-01

Anesthesiology residency programs will be expected to have Milestones-based evaluation systems in place by July 2014 as part of the Next Accreditation System. The San Antonio Uniformed Services Health Education Consortium (SAUSHEC) anesthesiology residency program developed and implemented a Milestones-based feedback and evaluation system a year ahead of schedule. It has been named the Milestone-specific, Observed Data points for Evaluating Levels of performance (MODEL) assessment strategy. The "MODEL Menu" and the "MODEL Blueprint" are tools that other anesthesiology residency programs can use in developing their own Milestones-based feedback and evaluation systems prior to ACGME-required implementation. Data from our early experience with the streamlined MODEL blueprint assessment strategy showed substantially improved faculty compliance with reporting requirements. The MODEL assessment strategy provides programs with a workable assessment method for residents, and important Milestones data points to programs for ACGME reporting.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond’s Checklist: A Narrative Review

Directory of Open Access Journals (Sweden)

Aziz Rezapour

2017-09-01

Full Text Available Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond’s checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles’ structure was analyzed by Drummond’s standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond’s criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Design and implementation of an integrated, continuous evaluation, and quality improvement system for a state-based home-visiting program.

Science.gov (United States)

McCabe, Bridget K; Potash, Dru; Omohundro, Ellen; Taylor, Cathy R

2012-10-01

To describe the design and implementation of an evaluation system to facilitate continuous quality improvement (CQI) and scientific evaluation in a statewide home visiting program, and to provide a summary of the system's progress in meeting intended outputs and short-term outcomes. Help Us Grow Successfully (HUGS) is a statewide home visiting program that provides services to at-risk pregnant/post-partum women, children (0-5 years), and their families. The program goals are to improve parenting skills and connect families to needed services and thus improve the health of the service population. The evaluation system is designed to: (1) integrate evaluation into daily workflow; (2) utilize standardized screening and evaluation tools; (3) facilitate a culture of CQI in program management; and, (4) facilitate scientifically rigorous evaluations. The review of the system's design and implementation occurred through a formative evaluation process (reach, dose, and fidelity). Data was collected through electronic and paper surveys, administrative data, and notes from management meetings, and medical chart review. In the design phase, four process and forty outcome measures were selected and are tracked using standardized screening and monitoring tools. During implementation, the reach and dose of training were adequate to successfully launch the evaluation/CQI system. All staff (n = 165) use the system for management of families; the supervisors (n = 18) use the system to track routine program activities. Data quality and availability is sufficient to support periodic program reviews at the region and state level. In the first 7 months, the HUGS evaluation system tracked 3,794 families (7,937 individuals). System use and acceptance is high. A successful implementation of a structured evaluation system with a strong CQI component is feasible in an existing, large statewide program. The evaluation/CQI system is an effective mechanism to drive modest change in management

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Evaluation of Medical Education virtual Program: P3 model.

Science.gov (United States)

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Evaluation of training programs and entry-level qualifications for nuclear-power-plant control-room personnel based on the systems approach to training

International Nuclear Information System (INIS)

Haas, P.M.; Selby, D.L.; Hanley, M.J.; Mercer, R.T.

1983-09-01

This report summarizes results of research sponsored by the US Nuclear Regulatory Commission (NRC) Office of Nuclear Regulatory Research to initiate the use of the Systems Approach to Training in the evaluation of training programs and entry level qualifications for nuclear power plant (NPP) personnel. Variables (performance shaping factors) of potential importance to personnel selection and training are identified, and research to more rigorously define an operationally useful taxonomy of those variables is recommended. A high-level model of the Systems Approach to Training for use in the nuclear industry, which could serve as a model for NRC evaluation of industry programs, is presented. The model is consistent with current publically stated NRC policy, with the approach being followed by the Institute for Nuclear Power Operations, and with current training technology. Checklists to be used by NRC evaluators to assess training programs for NPP control-room personnel are proposed which are based on this model

Evaluation of training programs and entry-level qualifications for nuclear-power-plant control-room personnel based on the systems approach to training

Energy Technology Data Exchange (ETDEWEB)

Haas, P M; Selby, D L; Hanley, M J; Mercer, R T

1983-09-01

This report summarizes results of research sponsored by the US Nuclear Regulatory Commission (NRC) Office of Nuclear Regulatory Research to initiate the use of the Systems Approach to Training in the evaluation of training programs and entry level qualifications for nuclear power plant (NPP) personnel. Variables (performance shaping factors) of potential importance to personnel selection and training are identified, and research to more rigorously define an operationally useful taxonomy of those variables is recommended. A high-level model of the Systems Approach to Training for use in the nuclear industry, which could serve as a model for NRC evaluation of industry programs, is presented. The model is consistent with current publically stated NRC policy, with the approach being followed by the Institute for Nuclear Power Operations, and with current training technology. Checklists to be used by NRC evaluators to assess training programs for NPP control-room personnel are proposed which are based on this model.

The PAMINO-project: evaluating a primary care-based educational program to improve the quality of life of palliative patients

Directory of Open Access Journals (Sweden)

Engeser Peter

2007-05-01

Full Text Available Abstract Background The care of palliative patients challenges the health care system in both quantity and quality. Especially the role of primary care givers needs to be strengthened to provide them with the knowledge and the confidence of applying an appropriate end-of-life care to palliative patients. To improve health care services for palliative patients in primary care, interested physicians in and around Heidelberg, Germany, are enabled to participate in the community-based program 'Palliative Medical Initiative North Baden (PAMINO' to improve their knowledge in dealing with palliative patients. The impact of this program on patients' health and quality of life remains to be evaluated. Methods/Design The evaluation of PAMINO is a non-randomized, controlled study. Out of the group of primary care physicians who took part in the PAMINO program, a sample of 45 physicians and their palliative patients will be compared to a sample of palliative patients of 45 physicians who did not take part in the program. Every four weeks for 6 months or until death, patients, physicians, and the patients' family caregivers in both groups answer questions to therapy strategies, quality of life (QLQ-C15-PAL, POS, pain (VAS, and burden for family caregivers (BSFC. The inclusion of physicians and patients in the study starts in March 2007. Discussion Although participating physicians value the increase in knowledge they receive from PAMINO, the effects on patients remain unclear. If the evaluation reveals a clear benefit for patients' quality of life, a larger-scale implementation of the program is considered. Trial registration: The study was registered at ‘current controlled trials (CCT’, registration number: ISRCTN78021852.

Evaluation model applied to TRANSPETRO's Marine Terminals Standardization Program

Energy Technology Data Exchange (ETDEWEB)

Almeida, Maria Fatima Ludovico de; Mueller, Gabriela [Pontificia Universidade Catolica do Rio de Janeiro (PUC-Rio), Rio de Janeiro, RJ (Brazil). Instituto Tecnologico; Garcia, Luciano Maldonado [TRANSPETRO - PETROBRAS Transporte S.A., Rio de Janeiro, RJ (Brazil)

2009-07-01

This paper describes an innovative evaluation model applied to TRANSPETRO's 'Marine Terminals Standardization Program' based on updating approaches of programs evaluation and organizational learning. Since the program was launched in 2004, the need for having an evaluation model able to evaluate its implementation progress, to measure the degree of standards compliance and its potential economic, social and environmental impacts has become evident. Within a vision of safe and environmentally responsible operations of marine terminals, this evaluation model was jointly designed by TRANSPETRO and PUC-Rio to promote continuous improvement and learning in operational practices and in the standardization process itself. TRANSPETRO believes that standardization supports its services and management innovation capability by creating objective and internationally recognized parameters, targets and metrology for its business activities. The conceptual model and application guidelines for this important tool are presented in this paper, as well as the next steps towards its implementation. (author)

Adapting Animal-Assisted Therapy Trials to Prison-Based Animal Programs.

Science.gov (United States)

Allison, Molly; Ramaswamy, Megha

2016-09-01

Prison-based animal programs have shown promise when it comes to increased sociability, responsibility, and levels of patience for inmates who participate in these programs. Yet there remains a dearth of scientific research that demonstrates the impact of prison-based animal programs on inmates' physical and mental health. Trials of animal-assisted therapy interventions, a form of human-animal interaction therapy most often used with populations affected by depression/anxiety, mental illness, and trauma, may provide models of how prison-based animal program research can have widespread implementation in jail and prison settings, whose populations have high rates of mental health problems. This paper reviews the components of prison-based animal programs most commonly practiced in prisons today, presents five animal-assisted therapy case studies, evaluates them based on their adaptability to prison-based animal programs, and discusses the institutional constraints that act as barriers for rigorous prison-based animal program research implementation. This paper can serve to inform the development of a research approach to animal-assisted therapy that nurses and other public health researchers can use in working with correctional populations. © 2016 Wiley Periodicals, Inc.

Study protocol for the evaluation of an Infant Simulator based program delivered in schools: a pragmatic cluster randomised controlled trial.

Science.gov (United States)

Brinkman, Sally A; Johnson, Sarah E; Lawrence, David; Codde, James P; Hart, Michael B; Straton, Judith A Y; Silburn, Sven

2010-10-21

This paper presents the study protocol for a pragmatic randomised controlled trial to evaluate the impact of a school based program developed to prevent teenage pregnancy. The program includes students taking care of an Infant Simulator; despite growing popularity and an increasing global presence of such programs, there is no published evidence of their long-term impact. The aim of this trial is to evaluate the Virtual Infant Parenting (VIP) program by investigating pre-conceptual health and risk behaviours, teen pregnancy and the resultant birth outcomes, early child health and maternal health. Fifty-seven schools (86% of 66 eligible secondary schools) in Perth, Australia were recruited to the clustered (by school) randomised trial, with even randomisation to the intervention and control arms. Between 2003 and 2006, the VIP program was administered to 1,267 participants in the intervention schools, while 1,567 participants in the non-intervention schools received standard curriculum. Participants were all female and aged between 13-15 years upon recruitment. Pre and post-intervention questionnaires measured short-term impact and participants are now being followed through their teenage years via data linkage to hospital medical records, abortion clinics and education records. Participants who have a live birth are interviewed by face-to-face interview. Kaplan-Meier survival analysis and proportional hazards regression will test for differences in pregnancy, birth and abortion rates during the teenage years between the study arms. This protocol paper provides a detailed overview of the trial design as well as initial results in the form of participant flow. The authors describe the intervention and its delivery within the natural school setting and discuss the practical issues in the conduct of the trial, including recruitment. The trial is pragmatic and will directly inform those who provide Infant Simulator based programs in school settings. ISRCTN24952438.

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Secondary Data Analyses of Subjective Outcome Evaluation Data Based on Nine Databases

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2012-01-01

Full Text Available The purpose of this study was to evaluate the effectiveness of the Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes in Hong Kong by analyzing 1,327 school-based program reports submitted by program implementers. In each report, program implementers were invited to write down five conclusions based on an integration of the subjective outcome evaluation data collected from the program participants and program implementers. Secondary data analyses were carried out by aggregating nine databases, with 14,390 meaningful units extracted from 6,618 conclusions. Results showed that most of the conclusions were positive in nature. The findings generally showed that the workers perceived the program and program implementers to be positive, and they also pointed out that the program could promote holistic development of the program participants in societal, familial, interpersonal, and personal aspects. However, difficulties encountered during program implementation (2.15% and recommendations for improvement were also reported (16.26%. In conjunction with the evaluation findings based on other strategies, the present study suggests that the Tier 1 Program of the Project P.A.T.H.S. is beneficial to the holistic development of the program participants.

Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model: A Web-based program designed to evaluate the cost-effectiveness of disease management programs in heart failure.

Science.gov (United States)

Reed, Shelby D; Neilson, Matthew P; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H; Polsky, Daniel E; Graham, Felicia L; Bowers, Margaret T; Paul, Sara C; Granger, Bradi B; Schulman, Kevin A; Whellan, David J; Riegel, Barbara; Levy, Wayne C

2015-11-01

Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics; use of evidence-based medications; and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model. Projections of resource use and quality of life are modeled using relationships with time-varying Seattle Heart Failure Model scores. The model can be used to evaluate parallel-group and single-cohort study designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. The Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. Copyright © 2015 Elsevier Inc. All rights reserved.

Methods for evaluating educational programs: does Writing Center participation affect student achievement?

Science.gov (United States)

Bredtmann, Julia; Crede, Carsten J; Otten, Sebastian

2013-02-01

This paper evaluates the effectiveness of the introduction of a Writing Center at a university, which aims at improving students' scientific writing abilities. In order to deal with the presumed limited utility of student feedback surveys for evaluating the effectiveness of educational programs, we use students' actual learning outcomes as our quality measure. Based on this objective measure, different statistical evaluation methods established in the labor market treatment literature are applied. We present and discuss the validity of these methods to evaluate educational programs and compare the results of these approaches to implications obtained using corresponding student surveys. Although almost all students reported the writing courses to be helpful, we find no significant effect of course participation on students' grades. This result highlights the need for institutions not to rely solely on student course evaluations for evidence-based policy decisions. Copyright © 2012 Elsevier Ltd. All rights reserved.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Super-Efficient Refrigerator Program (SERP) evaluation volume 2: Preliminary impact and market transformation assessment

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-08-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. It is one of the first examples of a large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the preliminary impact and market transformation evaluation of SERP ({open_quotes}the Program{close_quotes}). Pacific Northwest National Laboratory (PNNL) conducted this evaluation for the U.S. Department of Energy. This study focuses on the preliminary impact evaluation and market transformation assessment, but also presents limited process evaluation information. It is based on interviews with refrigerator dealers and manufacturers, interviews with utility participants, industry data, and information from the Program administrators. Results from this study complement those from prior process evaluation also conducted by PNNL. 42 refs., 5 figs., 4 tabs.

Employing continuous quality improvement in community-based substance abuse programs.

Science.gov (United States)

Chinman, Matthew; Hunter, Sarah B; Ebener, Patricia

2012-01-01

This article aims to describe continuous quality improvement (CQI) for substance abuse prevention and treatment programs in a community-based organization setting. CQI (e.g., plan-do-study-act cycles (PDSA)) applied in healthcare and industry was adapted for substance abuse prevention and treatment programs in a community setting. The authors assessed the resources needed, acceptability and CQI feasibility for ten programs by evaluating CQI training workshops with program staff and a series of three qualitative interviews over a nine-month implementation period with program participants. The CQI activities, PDSA cycle progress, effort, enthusiasm, benefits and challenges were examined. Results indicated that CQI was feasible and acceptable for community-based substance abuse prevention and treatment programs; however, some notable resource challenges remain. Future studies should examine CQI impact on service quality and intended program outcomes. The study was conducted on a small number of programs. It did not assess CQI impact on service quality and intended program outcomes. Practical implications- This project shows that it is feasible to adapt CQI techniques and processes for community-based programs substance abuse prevention and treatment programs. These techniques may help community-based program managers to improve service quality and achieve program outcomes. This is one of the first studies to adapt traditional CQI techniques for community-based settings delivering substance abuse prevention and treatment programs.

[Effect of school-based peer leader centered smoking prevention program].

Science.gov (United States)

Shin, Sung Rae; Oh, Pok Ja; Youn, Hye Kyung; Shin, Sun Hwa

2014-12-01

The purpose of this study was to develop and evaluate a school-based peer leader centered smoking prevention program. Non-equivalent control group with a pre/post-test design was used. Students (n=174) in two boys' junior high schools located in D city, Korea participated with 85 being selected for the experimental group and 89 for the control group. Five sessions were given to the experimental group and a 50 minute lecture to the control group. Knowledge, attitude, non-smoking intention, and non-smoking efficacy were measured for the both experimental and control group at two weeks before the program and one month after the program was completed. Data were analyzed using χ²-test, Fisher's exact test, independent t-test and paired t-test with the SPSS 21.0 program. The experimental group showed higher overall knowledge, negative attitude toward smoking, and higher non-smoking intention and efficacy. After receiving the school based peer leader centered smoking prevention program scores for attitude toward smoking and non-smoking efficacy increased in the experimental group were higher than in the control group. The school-based peer leader centered smoking prevention program needs longitudinal evaluation, but from this study, there is an indication that this program can be used with junior high school students and effectively change students' attitude toward smoking and promote non-smoking efficacy.

A formative evaluation of a coach-based technical assistance model for youth- and family-focused programming.

Science.gov (United States)

Olson, Jonathan R; McCarthy, Kimberly J; Perkins, Daniel F; Borden, Lynne M

2018-04-01

The Children, Youth, and Families At-Risk (CYFAR) initiative provides funding and technical support for local community-based programs designed to promote positive outcomes among vulnerable populations. In 2013, CYFAR implemented significant changes in the way it provides technical assistance (TA) to grantees. These changes included introducing a new TA model in which trained coaches provide proactive support that is tailored to individual CYFAR projects. The purpose of this paper is to describe the evolution of this TA model and present preliminary findings from a formative evaluation. CYFAR Principal Investigators (PIs) were invited to respond to online surveys in 2015 and 2016. The surveys were designed to assess PI attitudes towards the nature and quality of support that they receive from their coaches. CYFAR PIs reported that their coaches have incorporated a range of coaching skills and techniques into their work. PIs have generally positive attitudes towards their coaches, and these attitudes have become more positive over time. Results suggest that CYFAR PIs have been generally supportive of the new TA system. Factors that may have facilitated support include a strong emphasis on team-building and the provision of specific resources that support program design, implementation, and evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Intervention mapping: a process for developing theory- and evidence-based health education programs.

Science.gov (United States)

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. (eds.); Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

The Examination of Views of Parents about the Web-Based Performance Evaluation Program in the Science Teaching Process

OpenAIRE

Bakırcı, Hasan; KARA, YILMAZ; ÇEPNİ, Salih

2018-01-01

The research was aimed to reveal the views of parents on web-based performance evaluation program. The case study method adopted for this study. The research was conducted in the central district of Trabzon province during the fall semester of 2012-2013 academic years. A questionnaire was administered to three hundred parents and face-to-face interviews were conducted with 10 of those parents. The obtained data was analyzed through descriptive and content analysis. Majority of the parents wer...

Evaluation of medical education virtual program: P3 model

Directory of Open Access Journals (Sweden)

RITA REZAEE

2016-10-01

Full Text Available Introduction: In e-learning, people get involved in a process and create the content (product and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76, but they declared technical support as the less desirable part (1.17±1.23. Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Implementation of an interprofessional team-based learning program involving seven undergraduate health and social care programs from two universities, and students' evaluation of their readiness for interprofessional learning.

Science.gov (United States)

Chan, Lap Ki; Ganotice, Fraide; Wong, Frances Kam Yuet; Lau, Chak Sing; Bridges, Susan M; Chan, Celia Hoi Yan; Chan, Namkiu; Chan, Phoebe Wing Lam; Chen, Hai Yong; Chen, Julie Yun; Chu, Jody Kwok Pui; Ho, Charlene C; Ho, Jacqueline Mei Chi; Lam, Tai Pong; Lam, Veronica Suk Fun; Li, Qingyun; Shen, Jian Gang; Tanner, Julian Alexander; Tso, Winnie Wan Yee; Wong, Arkers Kwan Ching; Wong, Gordon Tin Chun; Wong, Janet Yuen Ha; Wong, Nai Sum; Worsley, Alan; Yu, Lei King; Yum, Tin Pui

2017-11-21

Interprofessional learning is gaining momentum in revolutionizing healthcare education. During the academic year 2015/16, seven undergraduate-entry health and social care programs from two universities in Hong Kong took part in an interprofessional education program. Based on considerations such as the large number of students involved and the need to incorporate adult learning principles, team-based learning was adopted as the pedagogy for the program, which was therefore called the interprofessional team-based learning program (IPTBL). The authors describe the development and implementation of the IPTBL program and evaluate the effectiveness of the program implementation. Eight hundred and one students, who are predominantly Chinese, participated in the IPTBL. The quantitative design (a pretest-posttest experimental design) was utilized to examine the students' gains on their readiness to engage in interprofessional education (IPE). Three instructional units (IUs) were implemented, each around a clinical area which could engage students from complementary health and social care disciplines. Each IU followed a team-based learning (TBL) process: pre-class study, individual readiness assurance test, team readiness assurance test, appeal, feedback, and application exercise. An electronic platform was developed and was progressively introduced in the three IUs. The students' self-perceived attainment of the IPE learning outcomes was high. Across all four subscales of RIPLS, there was significant improvement in student's readiness to engage in interprofessional learning after the IPTBL. A number of challenges were identified: significant time involvement of the teachers, difficulty in matching students from different programs, difficulty in making IPTBL count towards a summative assessment score, difficulty in developing the LAMS platform, logistics difficulty in managing paper TBL, and inappropriateness of the venue. Despite some challenges in developing and

An Evaluation of a Community-Based Psycho-Educational Program for Users of Child Sexual Exploitation Material.

Science.gov (United States)

Gillespie, Steven M; Bailey, Alexandra; Squire, Tom; Carey, Melissa L; Eldridge, Hilary J; Beech, Anthony R

2018-03-01

Online sexual offenders represent an increasingly large proportion of all sexual offenders. Many of these offenders receive noncustodial sentences, and there is a growing need for community-based interventions. The aim of this study was to evaluate a psycho-educational program for community dwelling users of child sexual exploitation material (CSEM). A total of 92 adult male participants completed self-report measures at pre and post. A subset of participants also completed measures after a follow-up period. Results suggested benefits across depression, anxiety, and stress; social competency, including locus of control and self-esteem; and distorted attitudes. Furthermore, these effects remained 8 to 12 weeks following program completion. Our results suggest that CSEM users are amenable to treatment in the community and that there are beneficial outcomes in affective and interpersonal functioning following psycho-education. These factors represent treatment targets for sexual offenders and are recognized risk factors for contact sexual offense recidivism.

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Conception of programs for evaluating balance indices of operation of WWER-440 nuclear power plants

International Nuclear Information System (INIS)

Zadrazil, J.

1986-01-01

The procedures are discussed of writing computation programs for the evaluation of basic technical and economic parameters of the operation of WWER-440 nuclear power plants. The criterion of the evaluation is the maximum power supply to the grid together with the required supply of heat, with the observance of safe operating conditions. Previous procedures of evaluation are compared with present procedures based on the use of a monitoring and evaluation system of the KOMPLEX-URAN 2 M type. The mathematical model of the program is based on balance equations and relations derived for actual measuring systems and is completed with an assessment of the reliability of input and output data. The flow chart is shown of the algorithm for the evaluation of technical and economic parameters, and methods are suggested for improving and extending the program. (J.C.)

Designing and evaluating an effective theory-based continuing interprofessional education program to improve sepsis care by enhancing healthcare team collaboration.

Science.gov (United States)

Owen, John A; Brashers, Valentina L; Littlewood, Keith E; Wright, Elisabeth; Childress, Reba Moyer; Thomas, Shannon

2014-05-01

Continuing interprofessional education (CIPE) differs from traditional continuing education (CE) in both the learning process and content, especially when it occurs in the workplace. Applying theories to underpin the development, implementation, and evaluation of CIPE activities informs educational design, encourages reflection, and enhances our understanding of CIPE and collaborative practice. The purpose of this article is to describe a process of design, implementation, and evaluation of CIPE through the application of explicit theories related to CIPE and workplace learning. A description of an effective theory-based program delivered to faculty and clinicians to enhance healthcare team collaboration is provided. Results demonstrated that positive changes in provider perceptions of and commitment to team-based care were achieved using this theory-based approach. Following this program, participants demonstrated a greater appreciation for the roles of other team members by indicating that more responsibility for implementing the Surviving Sepsis guideline should be given to nurses and respiratory therapists and less to physicians. Furthermore, a majority (86%) of the participants made commitments to demonstrate specific collaborative behaviors in their own practice. The article concludes with a discussion of our enhanced understanding of CIPE and a reinterpretation of the learning process which has implications for future CIPE workplace learning activities.

Impact Evaluation of an Addiction Intervention Program in a Quebec Prison

Directory of Open Access Journals (Sweden)

Catherine Arseneault

2015-01-01

Full Text Available Objectives This study evaluates the effects of a prison-based addiction intervention program. The evaluation is based on a multidimensional data collection that draws a portrait of the respondents’ substance use, and of their psychological/emotional, social, and judicial spheres. It measures the changes, or lack thereof, in substance use; the psychological/emotional, social, and judicial spheres; as well as the post-treatment services used. Method A quasi-experimental repeated measures design (0, 6 weeks, and 6 months was used. Effects of the program were identified by comparing the results obtained by a group of inmates who had participated in the program ( n = 80; experimental group with those of another group who had received no intervention ( n = 70; control group. Results The preliminary results suggested a certain treatment effect related to impulsivity and psychological distress. Conclusion Although the preliminary results were promising, the experimental and control groups did not differ significantly when more robust analyses were used.

The Basalt Waste Isolation Project technical program evaluation process: A criteria-based method

International Nuclear Information System (INIS)

Babad, H.; Evans, C.; Wolfe, B.A.

1982-01-01

The need to objectively evaluate the progress being made by the Basalt Waste Isolation Project (BWIP) toward establishing the feasibility of siting a nuclear waste repository in basalt (NWRB) mandates a process for evaluating the technical work of the project. To assist BWIP management in the evaluation process, the Systems Department staff has developed a BWIP Technical Program Evaluation Process (TPEP). The basic process relates progress on project technical work to the BWIP Functional and System Performance Criteria as defined in National Waste Terminal Storage (NWTS) Criteria Documents. The benefits of the TPEP to BWIP and future plans for TPEP are discussed. During fiscal year (FY) 1982, TPEP will be further formalized and further applied to the review of BWIP technical activities

Evaluating a community-based early childhood education and development program in Indonesia: study protocol for a pragmatic cluster randomized controlled trial with supplementary matched control group

NARCIS (Netherlands)

Pradhan, M.; Brinkman, S.A.; Beatty, A.; Maika, A.; Satriawan, E.; de Ree, J.; Hasan, A.

2013-01-01

Background This paper presents the study protocol for a pragmatic cluster randomized controlled trial (RCT) with a supplementary matched control group. The aim of the trial is to evaluate a community-based early education and development program launched by the Government of Indonesia. The program

Evaluating a community-based early childhood education and development program in Indonesia: study protocol for a pragmatic cluster randomized controlled trial with supplementary matched control group

NARCIS (Netherlands)

Pradhan, M.P.; Brinkman, S.A.; Beatty, A.; Maika, A.; Satriawan, E.; de Ree, J.; Hasan, A.

2013-01-01

Background: This paper presents the study protocol for a pragmatic cluster randomized controlled trial (RCT) with a supplementary matched control group. The aim of the trial is to evaluate a community-based early education and development program launched by the Government of Indonesia. The program

Development, implementation and evaluation of an evidence-based program for introduction of new health technologies and clinical practices in a local healthcare setting.

Science.gov (United States)

Harris, Claire; Garrubba, Marie; Allen, Kelly; King, Richard; Kelly, Cate; Thiagarajan, Malar; Castleman, Beverley; Ramsey, Wayne; Farjou, Dina

2015-12-28

This paper reports the process of establishing a transparent, accountable, evidence-based program for introduction of new technologies and clinical practices (TCPs) in a large Australian healthcare network. Many countries have robust evidence-based processes for assessment of new TCPs at national level. However many decisions are made by local health services where the resources and expertise to undertake health technology assessment (HTA) are limited and a lack of structure, process and transparency has been reported. An evidence-based model for process change was used to establish the program. Evidence from research and local data, experience of health service staff and consumer perspectives were incorporated at each of four steps: identifying the need for change, developing a proposal, implementation and evaluation. Checklists assessing characteristics of success, factors for sustainability and barriers and enablers were applied and implementation strategies were based on these findings. Quantitative and qualitative methods were used for process and outcome evaluation. An action research approach underpinned ongoing refinement to systems, processes and resources. A Best Practice Guide developed from the literature and stakeholder consultation identified seven program components: Governance, Decision-Making, Application Process, Monitoring and Reporting, Resources, Administration, and Evaluation and Quality Improvement. The aims of transparency and accountability were achieved. The processes are explicit, decisions published, outcomes recorded and activities reported. The aim of ascertaining rigorous evidence-based information for decision-making was not achieved in all cases. Applicants proposing new TCPs provided the evidence from research literature and local data however the information was often incorrect or inadequate, overestimating benefits and underestimating costs. Due to these limitations the initial application process was replaced by an Expression of

Enhancing pediatric residents’ scholar role: the development of a Scholarly Activity Guidance and Evaluation program

Directory of Open Access Journals (Sweden)

Catherine M. Pound

2015-06-01

Full Text Available Background: Research training is essential to the development of well-rounded physicians. Although many pediatric residency programs require residents to complete a research project, it is often challenging to integrate research training into educational programs. Objective: We aimed to develop an innovative research program for pediatric residents, called the Scholarly Activity Guidance and Evaluation (SAGE program. Methods: We developed a competency-based program which establishes benchmarks for pediatric residents, while providing ongoing academic mentorship. Results: Feedback from residents and their research supervisors about the SAGE program has been positive. Preliminary evaluation data have shown that all final-year residents have met or exceeded program expectations. Conclusions: By providing residents with this supportive environment, we hope to influence their academic career paths, increase their research productivity, promote evidence-based practice, and ultimately, positively impact health outcomes.

Evaluability Assessment Thesis and Dissertation Studies in Graduate Professional Degree Programs

Science.gov (United States)

Walser, Tamara M.; Trevisan, Michael S.

2016-01-01

Evaluability assessment (EA) has potential as a design option for thesis and dissertation studies, serving as a practical training experience for both technical and nontechnical evaluation skills. Based on a content review of a sample of EA theses and dissertations from graduate professional degree programs, the authors of this article found that…

Analysis of School Food Safety Programs Based on HACCP Principles

Science.gov (United States)

Roberts, Kevin R.; Sauer, Kevin; Sneed, Jeannie; Kwon, Junehee; Olds, David; Cole, Kerri; Shanklin, Carol

2014-01-01

Purpose/Objectives: The purpose of this study was to determine how school districts have implemented food safety programs based on HACCP principles. Specific objectives included: (1) Evaluate how schools are implementing components of food safety programs; and (2) Determine foodservice employees food-handling practices related to food safety.…

Evaluation of Haddam Neck (Connecticut Yankee) Nuclear Power Plant, environmental impact prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Mahaffey, J.A.; Waton, D.G.

1976-12-01

A study was undertaken by the U.S. Nuclear Regulatory Commission (NRC) to evaluate the nonradiological environmental data obtained from three nuclear power plants operating for a period of one year or longer. The document presented reports the second of three nuclear power plants to be evaluated in detail by Battelle, Pacific Northwest Laboratories. Haddam Neck (Connecticut Yankee) Nuclear Power Plant nonradiological monitoring data were assessed to determine their effectiveness in the measurement of environmental impacts. Efforts were made to determine if: (1) monitoring programs, as designed, can detect environmental impacts, (2) appropriate statistical analyses were performed and if they were sensitive enough to detect impacts, (3) predicted impacts could be verified by monitoring programs, and (4) monitoring programs satisfied the requirements of the Environmental Technical Specifications. Both preoperational and operational monitoring data were examined to test the usefulness of baseline information in evaluating impacts. This included an examination of the methods used to measure ecological, chemical, and physical parameters, and an assessment of sampling periodicity and sensitivity where appropriate data sets were available. From this type of analysis, deficiencies in both preoperational and operational monitoring programs may be identified and provide a basis for suggested improvement

Implementing a Project-Based Learning Model in a Pre-Service Leadership Program

Science.gov (United States)

Albritton, Shelly; Stacks, Jamie

2016-01-01

This paper describes two instructors' efforts to more authentically engage students in a preservice leadership program's course called Program Planning and Evaluation by using a project-based learning approach. Markham, Larmer, and Ravitz (2003) describe project-based learning (PjBL) as "a systematic teaching method that engages students in…

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

A trial-based economic evaluation of 2 nurse-led disease management programs in heart failure.

Science.gov (United States)

Postmus, Douwe; Pari, Anees A Abdul; Jaarsma, Tiny; Luttik, Marie Louise; van Veldhuisen, Dirk J; Hillege, Hans L; Buskens, Erik

2011-12-01

Although previously conducted meta-analyses suggest that nurse-led disease management programs in heart failure (HF) can improve patient outcomes, uncertainty regarding the cost-effectiveness of such programs remains. To compare the relative merits of 2 variants of a nurse-led disease management program (basic or intensive support by a nurse specialized in the management of patients with HF) against care as usual (routine follow-up by a cardiologist), a trial-based economic evaluation was conducted alongside the COACH study. In terms of costs per life-year, basic support was found to dominate care as usual, whereas the incremental cost-effectiveness ratio between intensive support and basic support was found to be equal to €532,762 per life-year; in terms of costs per quality-adjusted life-year (QALY), basic support was found to dominate both care as usual and intensive support. An assessment of the uncertainty surrounding these findings showed that, at a threshold value of €20,000 per life-year/€20,000 per QALY, basic support was found to have a probability of 69/62% of being optimal against 17/30% and 14/8% for care as usual and intensive support, respectively. The results of our subgroup analysis suggest that a stratified approach based on offering basic support to patients with mild to moderate HF and intensive support to patients with severe HF would be optimal if the willingness-to-pay threshold exceeds €45,345 per life-year/€59,289 per QALY. Although the differences in costs and effects among the 3 study groups were not statistically significant, from a decision-making perspective, basic support still had a relatively large probability of generating the highest health outcomes at the lowest costs. Our results also substantiated that a stratified approach based on offering basic support to patients with mild to moderate HF and intensive support to patients with severe HF could further improve health outcomes at slightly higher costs. Copyright �

Evaluation of the Super Efficient Refrigerator Program (SERP) in the Bonneville Power Administration service territory

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-06-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. it is one of the first examples of large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the evaluation of SERP ({open_quotes}the Program{close_quotes}) in the Bonneville Power Administration`s (Bonneville`s) service territory. Pacific Northwest National Laboratory (PNNL) conducted this evaluation for Bonneville. This study includes the process evaluation, preliminary impact evaluation, and market transformation assessment. It is based on site visits and interviews with refrigerator dealers and manufacturers, industry data, and Bonneville information. Results from this study are compared with those from a parallel study that examines the Program across the 24 participating utilities.

Implementation Measurement for Evidence-Based Violence Prevention Programs in Communities.

Science.gov (United States)

Massetti, Greta M; Holland, Kristin M; Gorman-Smith, Deborah

2016-08-01

Increasing attention to the evaluation, dissemination, and implementation of evidence-based programs (EBPs) has led to significant advancements in the science of community-based violence prevention. One of the prevailing challenges in moving from science to community involves implementing EBPs and strategies with quality. The CDC-funded National Centers of Excellence in Youth Violence Prevention (YVPCs) partner with communities to implement a comprehensive community-based strategy to prevent violence and to evaluate that strategy for impact on community-wide rates of violence. As part of their implementation approach, YVPCs document implementation of and fidelity to the components of the comprehensive youth violence prevention strategy. We describe the strategies and methods used by the six YVPCs to assess implementation and to use implementation data to inform program improvement efforts. The information presented describes the approach and measurement strategies employed by each center and for each program implemented in the partner communities. YVPCs employ both established and innovative strategies for measurement and tracking of implementation across a broad range of programs, practices, and strategies. The work of the YVPCs highlights the need to use data to understand the relationship between implementation of EBPs and youth violence outcomes.

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

Development and evaluation of a pharmacogenomics educational program for pharmacists.

Science.gov (United States)

Formea, Christine M; Nicholson, Wayne T; McCullough, Kristen B; Berg, Kevin D; Berg, Melody L; Cunningham, Julie L; Merten, Julianna A; Ou, Narith N; Stollings, Joanna L

2013-02-12

Objectives. To evaluate hospital and outpatient pharmacists' pharmacogenomics knowledge before and 2 months after participating in a targeted, case-based pharmacogenomics continuing education program.Design. As part of a continuing education program accredited by the Accreditation Council for Pharmacy Education (ACPE), pharmacists were provided with a fundamental pharmacogenomics education program.Evaluation. An 11-question, multiple-choice, electronic survey instrument was distributed to 272 eligible pharmacists at a single campus of a large, academic healthcare system. Pharmacists improved their pharmacogenomics test scores by 0.7 questions (pretest average 46%; posttest average 53%, p=0.0003).Conclusions. Although pharmacists demonstrated improvement, overall retention of educational goals and objectives was marginal. These results suggest that the complex topic of pharmacogenomics requires a large educational effort in order to increase pharmacists' knowledge and comfort level with this emerging therapeutic opportunity.

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Dissemination of Technology to Evaluate Healthy Food Incentive Programs.

Science.gov (United States)

Freedman, Darcy A; Hunt, Alan R; Merritt, Katie; Shon, En-Jung; Pike, Stephanie N

2017-03-01

Federal policy supports increased implementation of monetary incentive interventions for chronic disease prevention among low-income populations. This study describes how a Prevention Research Center, working with a dissemination partner, developed and distributed technology to support nationwide implementation and evaluation of healthy food incentive programming focused on Supplemental Nutrition Assistance Program recipients. FM Tracks, an iOS-based application and website, was developed to standardize evaluation methods for healthy food incentive program implementation at direct-to-consumer markets. This evaluation examined diffusion and adoption of the technology over 9 months (July 2015-March 2016). Data were analyzed in 2016. FM Tracks was disseminated to 273 markets affiliated with 37 regional networks in 18 states and Washington, DC. All markets adopted the sales transaction data collection feature, with nearly all recording at least one Supplemental Nutrition Assistance Program (99.3%) and healthy food incentive (97.1%) transaction. A total of 43,493 sales transactions were recorded. By the ninth month of technology dissemination, markets were entering individual sales transactions using the application (34.5%) and website (29.9%) and aggregated transactions via website (35.6%) at similar rates. Use of optional evaluation features like recording a customer ID with individual transactions increased successively with a low of 22.2% during the first month to a high of 69.2% in the ninth month. Systematic and widely used evaluation technology creates possibilities for pragmatic research embedded within ongoing, real-world implementation of food access interventions. Technology dissemination requires supportive technical assistance and continuous refinement that can be advanced through academic-practitioner partnerships. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Study protocol for the evaluation of an Infant Simulator based program delivered in schools: a pragmatic cluster randomised controlled trial

Directory of Open Access Journals (Sweden)

Hart Michael B

2010-10-01

Full Text Available Abstract Background This paper presents the study protocol for a pragmatic randomised controlled trial to evaluate the impact of a school based program developed to prevent teenage pregnancy. The program includes students taking care of an Infant Simulator; despite growing popularity and an increasing global presence of such programs, there is no published evidence of their long-term impact. The aim of this trial is to evaluate the Virtual Infant Parenting (VIP program by investigating pre-conceptual health and risk behaviours, teen pregnancy and the resultant birth outcomes, early child health and maternal health. Methods and Design Fifty-seven schools (86% of 66 eligible secondary schools in Perth, Australia were recruited to the clustered (by school randomised trial, with even randomisation to the intervention and control arms. Between 2003 and 2006, the VIP program was administered to 1,267 participants in the intervention schools, while 1,567 participants in the non-intervention schools received standard curriculum. Participants were all female and aged between 13-15 years upon recruitment. Pre and post-intervention questionnaires measured short-term impact and participants are now being followed through their teenage years via data linkage to hospital medical records, abortion clinics and education records. Participants who have a live birth are interviewed by face-to-face interview. Kaplan-Meier survival analysis and proportional hazards regression will test for differences in pregnancy, birth and abortion rates during the teenage years between the study arms. Discussion This protocol paper provides a detailed overview of the trial design as well as initial results in the form of participant flow. The authors describe the intervention and its delivery within the natural school setting and discuss the practical issues in the conduct of the trial, including recruitment. The trial is pragmatic and will directly inform those who provide

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Effectiveness of a Core-Competency-based Program on Residents' Learning and Experience.

Science.gov (United States)

Charles, Lesley; Triscott, Jean; Dobbs, Bonnie; Tian, Peter George; Babenko, Oksana

2016-06-01

The Care of the Elderly (COE) Diploma Program is a six-to-twelve-month enhanced skills program taken after two years of core residency training in Family Medicine. In 2010, we developed and implemented a core-competency-based COE Diploma program (CC), in lieu of one based on learning objectives (LO). This study assessed the effectiveness of the core-competency-based program on residents' learning and their training experience as compared to residents trained using learning objectives. The data from the 2007-2013 COE residents were used in the study, with nine and eight residents trained in the LO and CC programs, respectively. Residents' learning was measured using preceptors' evaluations of residents' skills/abilities throughout the program (118 evaluations in total). Residents' rating of training experience was measured using the Graduate's Questionnaire which residents completed after graduation. For residents' learning, overall, there was no significant difference between the two programs. However, when examined as a function of the four CanMEDS roles, there were significant increases in the CC residents' scores for two of the CanMEDS roles: Communicator/Collaborator/Manager and Scholar compared to residents in the LO program. With respect to residents' training experience, seven out of ten program components were rated by the CC residents higher than by the LO residents. The implementation of a COE CC program appears to facilitate resident learning and training experience.

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs

Directory of Open Access Journals (Sweden)

Chloe S. Gordon

2017-02-01

Full Text Available Abstract Background Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children’s drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Methods Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews, program evaluation questionnaires completed by children (n = 166, lesson observations completed by teachers (n = 35 observations, and reflective journal entries completed by the researcher (n = 44 entries. A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Results Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students’ life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs.

Science.gov (United States)

Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J

2017-02-02

Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic

Teaming up for Literacy: Examining Participants' Contributions to a Collaborative Family-Based Program

Science.gov (United States)

Kumar, Tracey

2016-01-01

This study of participants' contributions to a university-based family literacy program was informed by both "funds of knowledge" (Moll, 1992) and "multiple literacies" (Auerbach, 1995). The study examined participants' contributions to the design, implementation, and evaluation of a university-based family literacy program. In…

Process and Outcome Evaluation of an Art Therapy Program for People Living with HIV/AIDS

Science.gov (United States)

Feldman, Matthew B.; Betts, Donna J.; Blausey, Daniel

2014-01-01

Program evaluation offers an opportunity for improving the implementation and impact of art therapy. This article describes a process and outcomes evaluation of an art therapy program within the mental health services unit of a community-based organization for people living with HIV/AIDS. The aims were to assess utilization patterns and program…

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

The evaluation of a culturally appropriate, community-based lifestyle intervention program for elderly Chinese immigrants with chronic diseases: a pilot study.

Science.gov (United States)

Lu, Yifan; Dipierro, Moneika; Chen, Lingjun; Chin, Richard; Fava, Maurizio; Yeung, Albert

2014-03-01

The 'Healthy Habits Program' is a 6-month community-based program, which offers exercise facilities, training and weekly health education group to underserved elderly Chinese Americans with chronic medical diseases in their native languages. This pilot study evaluates the acceptability and the health effects of the 'Healthy Habits Program'. Ninety-nine subjects participated in the 'Healthy Habits Program' in 2011. Before and after the program, the participants were assessed in their physical and mental health using various fitness tests as well as measures of disability and psychological functioning. Participants provided overwhelmingly positive feedback on the program, which was associated with significant improvements in physical and mental health including a significant decrease in body mass index (BMI), blood pressure and increase in stamina. The participants reported lower mean scores on the Patient Health Questionnaire-9 item Scale (PHQ-9), indicating improved psychological well-being. These promising pilot study results from this lifestyle intervention program for elderly Chinese American immigrants with chronic diseases inform the design of a more definitive trial using a randomized design and larger sample size.

Implementation of an interprofessional team-based learning program involving seven undergraduate health and social care programs from two universities, and students’ evaluation of their readiness for interprofessional learning

Directory of Open Access Journals (Sweden)

Lap Ki Chan

2017-11-01

Full Text Available Abstract Background Interprofessional learning is gaining momentum in revolutionizing healthcare education. During the academic year 2015/16, seven undergraduate-entry health and social care programs from two universities in Hong Kong took part in an interprofessional education program. Based on considerations such as the large number of students involved and the need to incorporate adult learning principles, team-based learning was adopted as the pedagogy for the program, which was therefore called the interprofessional team-based learning program (IPTBL. The authors describe the development and implementation of the IPTBL program and evaluate the effectiveness of the program implementation. Methods Eight hundred and one students, who are predominantly Chinese, participated in the IPTBL. The quantitative design (a pretest-posttest experimental design was utilized to examine the students’ gains on their readiness to engage in interprofessional education (IPE. Results Three instructional units (IUs were implemented, each around a clinical area which could engage students from complementary health and social care disciplines. Each IU followed a team-based learning (TBL process: pre-class study, individual readiness assurance test, team readiness assurance test, appeal, feedback, and application exercise. An electronic platform was developed and was progressively introduced in the three IUs. The students’ self-perceived attainment of the IPE learning outcomes was high. Across all four subscales of RIPLS, there was significant improvement in student’s readiness to engage in interprofessional learning after the IPTBL. A number of challenges were identified: significant time involvement of the teachers, difficulty in matching students from different programs, difficulty in making IPTBL count towards a summative assessment score, difficulty in developing the LAMS platform, logistics difficulty in managing paper TBL, and inappropriateness of the

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

Development and evaluation of addiction treatment programs in Latin America.

Science.gov (United States)

Marín-Navarrete, Rodrigo; Medina-Mora, María Elena; Pérez-López, Alejandro; Horigian, Viviana E

2018-07-01

The aim of this article is to present a state-of-the-art review of the scientific studies that have evaluated healthcare systems, services and programs for addiction treatment in Latin America. As a secondary aim, this article presents a brief description and analysis of the addiction prevention and treatment resources and programs available in Latin America, based on information from the ATLAS on Substance Use (ATLAS-SU) project led by the WHO. Substance use disorders (SUDs) are among the main causes associated with global burden of disease. Around the world, many initiatives have been proposed to promote policies to reduce substance use and reduce the impact of SUD, including integrating treatments into healthcare systems, increasing access to treatment programs and impacting outcome measures. In Latin America, multiple efforts have been implemented to improve addiction services and programs, although little is known about the impact they have generated. International studies report the availability of strategies and public inicitatives on prevention and treatment of addiction in Latin America. These studies also report established networks of public and private services that include prevention and detoxification programs, outpatient and residential treatment, and also social reintegration initiatives. However, despite these advances, information on the evaluation of the progress, results and impact of these programs is limited.

An Evaluation Instrument for Object-Oriented Example Programs for Novices

DEFF Research Database (Denmark)

Christensen, Henrik Bærbak; Börstler, Jürgen; Nordström,, Marie

objectively and consistently requires some kind of measurement instrument. In this paper, we describe the development and initial validation of an evaluation instrument for example programs, based on three aspects of quality; technical quality, object-oriented quality, and didactical quality. Validation......Examples are important tools for programming education. In this paper, we investigate desirable properties of programming examples from a cognitive and a measurement point of view. We argue that some cognitive aspects of example programs are "caught" by common software measures......, but they are not sufficient to capture all important aspects of understandability. We propose a framework for measuring the understandability of example programs that also considers factors related to the usage context of examples. Research shows that examples play an important role for cognitive skill acquisition. Students...

Developments of integrity evaluation technology for pressurized components in nuclear power plant and IT based integrity evaluation system

Energy Technology Data Exchange (ETDEWEB)

Kim, Young Jin; Choi, Jae Boong; Shim, Do Jun [Sungkyunkwan Univ., Seoul (Korea, Republic of)] (and others)

2003-03-15

The objective of this research is to develop an efficient evaluation technology and to investigate applicability of newly-developed technology, such as internet-based cyber platform, to operating power plants. Development of efficient evaluation systems for Nuclear Power Plant components, based on structural integrity assessment techniques, are increasingly demanded for safe operation with the increasing operating period of Nuclear Power Plants. The following five topics are covered in this project: development of assessment method for wall-thinned nuclear piping based on pipe test; development of structural integrity program for steam generator tubes with cracks of various shape; development of fatigue life evaluation system for mam components of NPP; development of internet-based cyber platform and integrity program for primary components of NPP; effect of aging on strength of dissimilar welds.

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

Efficiency evaluation of grant policy in sport by principles of program financing

Directory of Open Access Journals (Sweden)

Vladimír Hobza

2010-03-01

Full Text Available The paper concerns with mutual interconnection of goals of municipal development concepts and methods of their assessment. Based on grant policy of selected municipalities (regions, communities and on the principles of program financing, a specific method of evaluation performance is suggested, which enables to evaluate closer control of sport development, visions, proclaimed goals and sport support programs. The principle of the proposed procedure is based on the use of indicators and methods: CEA, CBA, CUA and CMA in program financing of sport - a field where it is not possible to calculate only direct economic results but it is necessary to consider the impact of externalities (benefits. The authors suggest procedures, which lead to a higher level of control, transparency and efficiency of public spending in the municipal sphere. The goal of this contribution is to point out possible means of assessing grant proposals, as a support tool for decision-making and subsequent control.

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Effectiveness of a Core-Competency–based Program on Residents’ Learning and Experience

Science.gov (United States)

Charles, Lesley; Triscott, Jean; Dobbs, Bonnie; Tian, Peter George; Babenko, Oksana

2016-01-01

Background The Care of the Elderly (COE) Diploma Program is a six-to-twelve-month enhanced skills program taken after two years of core residency training in Family Medicine. In 2010, we developed and implemented a core-competency–based COE Diploma program (CC), in lieu of one based on learning objectives (LO). This study assessed the effectiveness of the core-competency–based program on residents’ learning and their training experience as compared to residents trained using learning objectives. Methods The data from the 2007–2013 COE residents were used in the study, with nine and eight residents trained in the LO and CC programs, respectively. Residents’ learning was measured using preceptors’ evaluations of residents’ skills/abilities throughout the program (118 evaluations in total). Residents’ rating of training experience was measured using the Graduate’s Questionnaire which residents completed after graduation. Results For residents’ learning, overall, there was no significant difference between the two programs. However, when examined as a function of the four CanMEDS roles, there were significant increases in the CC residents’ scores for two of the CanMEDS roles: Communicator/Collaborator/Manager and Scholar compared to residents in the LO program. With respect to residents’ training experience, seven out of ten program components were rated by the CC residents higher than by the LO residents. Conclusion The implementation of a COE CC program appears to facilitate resident learning and training experience. PMID:27403213

The Design and Pilot Evaluation of an Interactive Learning Environment for Introductory Programming Influenced by Cognitive Load Theory and Constructivism

Science.gov (United States)

Moons, Jan; De Backer, Carlos

2013-01-01

This article presents the architecture and evaluation of a novel environment for programming education. The design of this programming environment, and the way it is used in class, is based on the findings of constructivist and cognitivist learning paradigms. The environment is evaluated based on qualitative student and teacher evaluations and…

Competency-Based Assessment for Clinical Supervisors: Design-Based Research on a Web-Delivered Program

Science.gov (United States)

Williams, Lauren Therese; Grealish, Laurie; Jamieson, Maggie

2015-01-01

Background Clinicians need to be supported by universities to use credible and defensible assessment practices during student placements. Web-based delivery of clinical education in student assessment offers professional development regardless of the geographical location of placement sites. Objective This paper explores the potential for a video-based constructivist Web-based program to support site supervisors in their assessments of student dietitians during clinical placements. Methods This project was undertaken as design-based research in two stages. Stage 1 describes the research consultation, development of the prototype, and formative feedback. In Stage 2, the program was pilot-tested and evaluated by a purposeful sample of nine clinical supervisors. Data generated as a result of user participation during the pilot test is reported. Users’ experiences with the program were also explored via interviews (six in a focus group and three individually). The interviews were transcribed verbatim and thematic analysis conducted from a pedagogical perspective using van Manen’s highlighting approach. Results This research succeeded in developing a Web-based program, “Feed our Future”, that increased supervisors’ confidence with their competency-based assessments of students on clinical placements. Three pedagogical themes emerged: constructivist design supports transformative Web-based learning; videos make abstract concepts tangible; and accessibility, usability, and pedagogy are interdependent. Conclusions Web-based programs, such as Feed our Future, offer a viable means for universities to support clinical supervisors in their assessment practices during clinical placements. A design-based research approach offers a practical process for such Web-based tool development, highlighting pedagogical barriers for planning purposes. PMID:25803172

Evaluating the effectiveness of a laboratory-based professional development program for science educators

Science.gov (United States)

Amolins, Michael W.; Ezrailson, Cathy M.; Pearce, David A.; Elliott, Amy J.

2015-01-01

The process of developing effective science educators has been a long-standing objective of the broader education community. Numerous studies have recommended not only depth in a teacher's subject area but also a breadth of professional development grounded in constructivist principles, allowing for successful student-centered and inquiry-based instruction. Few programs, however, have addressed the integration of the scientific research laboratory into the science classroom as a viable approach to professional development. Additionally, while occasional laboratory training programs have emerged in recent years, many lack a component for translating acquired skills into reformed classroom instruction. Given the rapid development and demand for knowledgeable employees and an informed population from the biotech and medical industries in recent years, it would appear to be particularly advantageous for the physiology and broader science education communities to consider this issue. The goal of this study was to examine the effectiveness of a laboratory-based professional development program focused on the integration of reformed teaching principles into the classrooms of secondary teachers. This was measured through the program's ability to instill in its participants elevated academic success while gaining fulfillment in the classroom. The findings demonstrated a significant improvement in the use of student-centered instruction and other reformed methods by program participants as well as improved self-efficacy, confidence, and job satisfaction. Also revealed was a reluctance to refashion established classroom protocols. The combination of these outcomes allowed for construction of an experiential framework for professional development in applied science education that supports an atmosphere of reformed teaching in the classroom. PMID:26628658

Evaluation of liquefaction potential of soil based on standard penetration test using multi-gene genetic programming model

Science.gov (United States)

Muduli, Pradyut; Das, Sarat

2014-06-01

This paper discusses the evaluation of liquefaction potential of soil based on standard penetration test (SPT) dataset using evolutionary artificial intelligence technique, multi-gene genetic programming (MGGP). The liquefaction classification accuracy (94.19%) of the developed liquefaction index (LI) model is found to be better than that of available artificial neural network (ANN) model (88.37%) and at par with the available support vector machine (SVM) model (94.19%) on the basis of the testing data. Further, an empirical equation is presented using MGGP to approximate the unknown limit state function representing the cyclic resistance ratio (CRR) of soil based on developed LI model. Using an independent database of 227 cases, the overall rates of successful prediction of occurrence of liquefaction and non-liquefaction are found to be 87, 86, and 84% by the developed MGGP based model, available ANN and the statistical models, respectively, on the basis of calculated factor of safety (F s) against the liquefaction occurrence.

Subjective evaluation of a peer support program by women with breast cancer: A qualitative study.

Science.gov (United States)

Ono, Miho; Tsuyumu, Yuko; Ota, Hiroko; Okamoto, Reiko

2017-01-01

The aim of this study was to determine the subjective evaluation of a breast cancer peer support program based on a survey of the participants who completed the program. Semistructured interviews were held with 10 women with breast cancer. The responses were subject to a qualitative inductive analysis. Women with breast cancer who participated in the breast cancer peer support program evaluated the features of the program and cited benefits, such as "Receiving individual peer support tailored to your needs," "Easily consulted trained peer supporters," and "Excellent coordination." Also indicated were benefits of the peer support that was received, such as "Receiving peer-specific emotional support," "Obtaining specific experimental information," "Re-examining yourself," and "Making preparations to move forward." The women also spoke of disadvantages, such as "Strict management of personal information" and "Matching limitations." In this study, the subjective evaluation of a peer support program by women with breast cancer was clarified . The women with breast cancer felt that the program had many benefits and some disadvantages. These results suggest that there is potential for peer support-based patient-support programs in medical services that are complementary to the current support that is provided by professionals. © 2016 Japan Academy of Nursing Science.

A simulation-based training program improves emergency department staff communication.

Science.gov (United States)

Sweeney, Lynn A; Warren, Otis; Gardner, Liz; Rojek, Adam; Lindquist, David G

2014-01-01

The objectives of this study were to evaluate the effectiveness of Project CLEAR!, a novel simulation-based training program designed to instill Crew Resource Management (CRM) as the communication standard and to create a service-focused environment in the emergency department (ED) by standardizing the patient encounter. A survey-based study compared physicians' and nurses' perceptions of the quality of communication before and after the training program. Surveys were developed to measure ED staff perceptions of the quality of communication between staff members and with patients. Pretraining and posttraining survey results were compared. After the training program, survey scores improved significantly on questions that asked participants to rate the overall communication between staff members and between staff and patients. A simulation-based training program focusing on CRM and standardizing the patient encounter improves communication in the ED, both between staff members and between staff members and patients.

Evidence-based intervention against bullying and cyberbullying: Evaluation of the NoTrap! program in two independent trials.

Science.gov (United States)

Palladino, Benedetta E; Nocentini, Annalaura; Menesini, Ersilia

2016-01-01

The NoTrap! (Noncadiamointrappola!) program is a school-based intervention, which utilizes a peer-led approach to prevent and combat both traditional bullying and cyberbullying. The aim of the present study was to evaluate the efficacy of the third Edition of the program in accordance with the recent criteria for evidence-based interventions. Towards this aim, two quasi-experimental trials involving adolescents (age M = 14.91, SD = .98) attending their first year at different high schools were conducted. In Trial 1 (control group, n = 171; experimental group, n = 451), latent growth curve models for data from pre-, middle- and post-tests showed that intervention significantly predicted change over time in all the target variables (victimization, bullying, cybervictimization, and cyberbullying). Specifically, target variables were stable for the control group but decreased significantly over time for the experimental group. Long-term effects at the follow up 6 months later were also found. In Trial 2 (control group, n = 227; experimental group, n = 234), the moderating effect of gender was examined and there was a reported decrease in bullying and cyberbullying over time (pre- and post-test) in the experimental group but not the control group, and this decrease was similar for boys and girls. © 2016 Wiley Periodicals, Inc.

An evaluation of an aggression management training program to cope with workplace violence in the healthcare sector

NARCIS (Netherlands)

J.K. Oostrom (Janneke); H. van Mierlo (Heleen)

2008-01-01

textabstractWorkplace violence is a major occupational hazard for healthcare workers, generating a need for effective intervention programs. The purpose of this study was to evaluate the effectiveness of an aggression management training program. The evaluation design was based on the internal

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Back to the basics: identifying positive youth development as the theoretical framework for a youth drug prevention program in rural Saskatchewan, Canada amidst a program evaluation.

Science.gov (United States)

Dell, Colleen Anne; Duncan, Charles Randy; DesRoches, Andrea; Bendig, Melissa; Steeves, Megan; Turner, Holly; Quaife, Terra; McCann, Chuck; Enns, Brett

2013-10-22

Despite endorsement by the Saskatchewan government to apply empirically-based approaches to youth drug prevention services in the province, programs are sometimes delivered prior to the establishment of evidence-informed goals and objectives. This paper shares the 'preptory' outcomes of our team's program evaluation of the Prince Albert Parkland Health Region Mental Health and Addiction Services' Outreach Worker Service (OWS) in eight rural, community schools three years following its implementation. Before our independent evaluation team could assess whether expectations of the OWS were being met, we had to assist with establishing its overarching program goals and objectives and 'at-risk' student population, alongside its alliance with an empirically-informed theoretical framework. A mixed-methods approach was applied, beginning with in-depth focus groups with the OWS staff to identify the program's goals and objectives and targeted student population. These were supplemented with OWS and school administrator interviews and focus groups with school staff. Alignment with a theoretical focus was determined though a review of the OWS's work to date and explored in focus groups between our evaluation team and the OWS staff and validated with the school staff and OWS and school administration. With improved understanding of the OWS's goals and objectives, our evaluation team and the OWS staff aligned the program with the Positive Youth Development theoretical evidence-base, emphasizing the program's universality, systems focus, strength base, and promotion of assets. Together we also gained clarity about the OWS's definition of and engagement with its 'at-risk' student population. It is important to draw on expert knowledge to develop youth drug prevention programming, but attention must also be paid to aligning professional health care services with a theoretically informed evidence-base for evaluation purposes. If time does not permit for the establishment of

Evaluating bacterial gene-finding HMM structures as probabilistic logic programs.

Science.gov (United States)

Mørk, Søren; Holmes, Ian

2012-03-01

Probabilistic logic programming offers a powerful way to describe and evaluate structured statistical models. To investigate the practicality of probabilistic logic programming for structure learning in bioinformatics, we undertook a simplified bacterial gene-finding benchmark in PRISM, a probabilistic dialect of Prolog. We evaluate Hidden Markov Model structures for bacterial protein-coding gene potential, including a simple null model structure, three structures based on existing bacterial gene finders and two novel model structures. We test standard versions as well as ADPH length modeling and three-state versions of the five model structures. The models are all represented as probabilistic logic programs and evaluated using the PRISM machine learning system in terms of statistical information criteria and gene-finding prediction accuracy, in two bacterial genomes. Neither of our implementations of the two currently most used model structures are best performing in terms of statistical information criteria or prediction performances, suggesting that better-fitting models might be achievable. The source code of all PRISM models, data and additional scripts are freely available for download at: http://github.com/somork/codonhmm. Supplementary data are available at Bioinformatics online.

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Object-oriented fault tree evaluation program for quantitative analyses

Science.gov (United States)

Patterson-Hine, F. A.; Koen, B. V.

1988-01-01

Object-oriented programming can be combined with fault free techniques to give a significantly improved environment for evaluating the safety and reliability of large complex systems for space missions. Deep knowledge about system components and interactions, available from reliability studies and other sources, can be described using objects that make up a knowledge base. This knowledge base can be interrogated throughout the design process, during system testing, and during operation, and can be easily modified to reflect design changes in order to maintain a consistent information source. An object-oriented environment for reliability assessment has been developed on a Texas Instrument (TI) Explorer LISP workstation. The program, which directly evaluates system fault trees, utilizes the object-oriented extension to LISP called Flavors that is available on the Explorer. The object representation of a fault tree facilitates the storage and retrieval of information associated with each event in the tree, including tree structural information and intermediate results obtained during the tree reduction process. Reliability data associated with each basic event are stored in the fault tree objects. The object-oriented environment on the Explorer also includes a graphical tree editor which was modified to display and edit the fault trees.

Development of integrity evaluation technology for pressurized components in nuclear power plant and IT based integrity evaluation system

International Nuclear Information System (INIS)

Kim, Young Jin; Choi, Jae Boong; Shim, Do Jun

2004-02-01

The objective of this research is to develop on efficient integrity evaluation technology and to investigate the applicability of the newly-developed technology such as internet-based cyber platform etc. to Nuclear Power Plant(NPP) components. The development of an efficient structural integrity evaluation system is necessary for safe operation of NPP as the increase of operating periods. Moreover, material test data as well as emerging structural integrity assessment technology are also needed for the evaluation of aged components. The following five topics are covered in this project: development of the wall-thinning evaluation program for nuclear piping; development of structural integrity evaluation criteria for steam generator tubes with cracks of various shape; development of fatigue life evaluation system for major components of NPP; ingegration of internet-based cyber platform and integrity evaluation program for primary components of NPP; effects of aging on strength of dissimilar welds

Development of integrity evaluation technology for pressurized components in nuclear power plant and IT based integrity evaluation system

Energy Technology Data Exchange (ETDEWEB)

Kim, Young Jin; Choi, Jae Boong; Shim, Do Jun [Sungkyunkwan Univ., Seoul (Korea, Republic of)] (and others)

2004-02-15

The objective of this research is to develop on efficient integrity evaluation technology and to investigate the applicability of the newly-developed technology such as internet-based cyber platform etc. to Nuclear Power Plant(NPP) components. The development of an efficient structural integrity evaluation system is necessary for safe operation of NPP as the increase of operating periods. Moreover, material test data as well as emerging structural integrity assessment technology are also needed for the evaluation of aged components. The following five topics are covered in this project: development of the wall-thinning evaluation program for nuclear piping; development of structural integrity evaluation criteria for steam generator tubes with cracks of various shape; development of fatigue life evaluation system for major components of NPP; ingegration of internet-based cyber platform and integrity evaluation program for primary components of NPP; effects of aging on strength of dissimilar welds.

An Introduction to "My Environmental Education Evaluation Resource Assistant" (MEERA), a Web-Based Resource for Self-Directed Learning about Environmental Education Program Evaluation

Science.gov (United States)

Zint, Michaela

2010-01-01

My Environmental Education Evaluation Resource Assistant or "MEERA" is a web-site designed to support environmental educators' program evaluation activities. MEERA has several characteristics that set it apart from other self-directed learning evaluation resources. Readers are encouraged to explore the site and to reflect on the role that…

Intervention mapping protocol for developing a theory-based diabetes self-management education program.

Science.gov (United States)

Song, Misoon; Choi, Suyoung; Kim, Se-An; Seo, Kyoungsan; Lee, Soo Jin

2015-01-01

Development of behavior theory-based health promotion programs is encouraged with the paradigm shift from contents to behavior outcomes. This article describes the development process of the diabetes self-management program for older Koreans (DSME-OK) using intervention mapping (IM) protocol. The IM protocol includes needs assessment, defining goals and objectives, identifying theory and determinants, developing a matrix to form change objectives, selecting strategies and methods, structuring the program, and planning for evaluation and pilot testing. The DSME-OK adopted seven behavior objectives developed by the American Association of Diabetes Educators as behavioral outcomes. The program applied an information-motivation-behavioral skills model, and interventions were targeted to 3 determinants to change health behaviors. Specific methods were selected to achieve each objective guided by IM protocol. As the final step, program evaluation was planned including a pilot test. The DSME-OK was structured as the 3 determinants of the IMB model were intervened to achieve behavior objectives in each session. The program has 12 weekly 90-min sessions tailored for older adults. Using the IM protocol in developing a theory-based self-management program was beneficial in terms of providing a systematic guide to developing theory-based and behavior outcome-focused health education programs.

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

Evaluating a School-Based Day Treatment Program for Students with Challenging Behaviors

Science.gov (United States)

Hickman, Antoine Lewis

2014-01-01

Jade County Public Schools has provided school-based therapeutic day treatment in its public schools for more than 10 years. This program was adopted by the school system to provide an intervention in the school and classroom to address the challenging behaviors of students with emotional and behavioral disorders. Currently, three human services…

Evaluation of a Pharmacist and Nurse Practitioner Smoking Cessation Program.

Science.gov (United States)

Afzal, Zubair; Pogge, Elizabeth; Boomershine, Virginia

2017-08-01

To evaluate the efficacy of a smoking cessation program led by a pharmacist and a nurse practitioner. During a 6-month period, patients attended 7 one-on-one face-to-face smoking cessation counseling sessions with a pharmacist and 1 to 2 one-on-one face-to-face smoking cessation counseling sessions with a nurse practitioner. The primary outcome was smoking cessation point prevalence rates at months 1, 3, and 5 post-quit date. Secondary outcomes included medication adherence rates at months 1, 3, and 5 post-quit date, nicotine dependence at baseline versus program end, and patient satisfaction. Nine (47%) of 19 total participants completed the program. Seven of the 9 patients who completed the program were smoke-free upon study completion. Point prevalence rates at months 1, 3, and 5 post-quit date were 66%, 77%, and 77%, respectively, based on patients who completed the program. Medication adherence rates were 88.6%, 54.6%, and 75% at months 1, 3, and 5 post-quit date, respectively. Based on the Fagerstrom test, nicotine dependence decreased from baseline to the end of the study, 4.89 to 0.33 ( P smoking cessation program can assist patients in becoming smoke-free.

Evaluation of a liaison librarian program: client and liaison perspectives.

Science.gov (United States)

Tennant, Michele R; Cataldo, Tara Tobin; Sherwill-Navarro, Pamela; Jesano, Rae

2006-10-01

This paper describes a survey-based evaluation of the five-year old Liaison Librarian Program at the University of Florida. Liaison librarians, faculty, students, staff, residents, and post-doctoral associates were queried via Web-based surveys. Questions addressed client and liaison perspectives on a variety of issues, including program and service awareness and usage, client-library relations and communication, client support for the program, and liaison workload. Approximately 43% of the 323 client respondents were aware of liaison services; 72% (n = 163) of these clients had had contact with their liaison. Ninety-five percent (n = 101) of faculty and students who reported contact with their liaison supported the continuation of the program. Liaison services were used by a greater percentage of faculty than students, although they had similar patterns of usage and reported the same "traditional" services to be most important. Liaisons indicated that communications with clients had increased, the reputation of the library was enhanced, and their workloads had increased as a result of the Liaison Librarian Program. Survey results suggest that the Liaison Librarian Program has a core set of clients who use and highly value the services provided by liaisons. Recommendations addressing workload, training, marketing, and administrative support are provided.

School-based sleep education program improves sleep and academic performance of school-age children.

Science.gov (United States)

Gruber, Reut; Somerville, Gail; Bergmame, Lana; Fontil, Laura; Paquin, Soukaina

2016-05-01

The objective of this study was to develop and evaluate the effectiveness of a school-based sleep education program aimed at improving the sleep and academic performance of school-age children. Using a community-based participatory research approach, we created a school-based sleep education program, "Sleep for Success"™ (SFS), composed of four distinct modules that addressed the children, their family and community, the school staff, and decision makers within the school setting. Implementation was carried out in three elementary schools. Seventy-one students participated in the evaluation of the program. The effectiveness of the SFS program was evaluated using non-randomized controlled before-and-after study groups (intervention and control) assessed over two time points (pre- and post-program implementation). Before (baseline) and after implementation, sleep and academic performance were measured using actigraphy and report card marks, respectively. In the intervention group, true sleep was extended by 18.2 min per night, sleep efficiency improved by 2.3%, and sleep latency was shortened by 2.3 min, and report card grades in mathematics and English improved significantly. No changes were noted in the control group. Participation in the sleep education program was associated with significant improvements in children's sleep and academic performance. Copyright © 2016 Elsevier B.V. All rights reserved.

The Design of Model-Based Training Programs

Science.gov (United States)

Polson, Peter; Sherry, Lance; Feary, Michael; Palmer, Everett; Alkin, Marty; McCrobie, Dan; Kelley, Jerry; Rosekind, Mark (Technical Monitor)

1997-01-01

This paper proposes a model-based training program for the skills necessary to operate advance avionics systems that incorporate advanced autopilots and fight management systems. The training model is based on a formalism, the operational procedure model, that represents the mission model, the rules, and the functions of a modem avionics system. This formalism has been defined such that it can be understood and shared by pilots, the avionics software, and design engineers. Each element of the software is defined in terms of its intent (What?), the rationale (Why?), and the resulting behavior (How?). The Advanced Computer Tutoring project at Carnegie Mellon University has developed a type of model-based, computer aided instructional technology called cognitive tutors. They summarize numerous studies showing that training times to a specified level of competence can be achieved in one third the time of conventional class room instruction. We are developing a similar model-based training program for the skills necessary to operation the avionics. The model underlying the instructional program and that simulates the effects of pilots entries and the behavior of the avionics is based on the operational procedure model. Pilots are given a series of vertical flightpath management problems. Entries that result in violations, such as failure to make a crossing restriction or violating the speed limits, result in error messages with instruction. At any time, the flightcrew can request suggestions on the appropriate set of actions. A similar and successful training program for basic skills for the FMS on the Boeing 737-300 was developed and evaluated. The results strongly support the claim that the training methodology can be adapted to the cockpit.

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating the effectiveness of a laboratory-based professional development program for science educators.

Science.gov (United States)

Amolins, Michael W; Ezrailson, Cathy M; Pearce, David A; Elliott, Amy J; Vitiello, Peter F

2015-12-01

The process of developing effective science educators has been a long-standing objective of the broader education community. Numerous studies have recommended not only depth in a teacher's subject area but also a breadth of professional development grounded in constructivist principles, allowing for successful student-centered and inquiry-based instruction. Few programs, however, have addressed the integration of the scientific research laboratory into the science classroom as a viable approach to professional development. Additionally, while occasional laboratory training programs have emerged in recent years, many lack a component for translating acquired skills into reformed classroom instruction. Given the rapid development and demand for knowledgeable employees and an informed population from the biotech and medical industries in recent years, it would appear to be particularly advantageous for the physiology and broader science education communities to consider this issue. The goal of this study was to examine the effectiveness of a laboratory-based professional development program focused on the integration of reformed teaching principles into the classrooms of secondary teachers. This was measured through the program's ability to instill in its participants elevated academic success while gaining fulfillment in the classroom. The findings demonstrated a significant improvement in the use of student-centered instruction and other reformed methods by program participants as well as improved self-efficacy, confidence, and job satisfaction. Also revealed was a reluctance to refashion established classroom protocols. The combination of these outcomes allowed for construction of an experiential framework for professional development in applied science education that supports an atmosphere of reformed teaching in the classroom. Copyright © 2015 The American Physiological Society.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

Energy Technology Data Exchange (ETDEWEB)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il [Korea Atomic Energy Research Institute, Daejeon (Korea, Republic of)

2015-10-15

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

International Nuclear Information System (INIS)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il

2015-01-01

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit

Process Evaluation of a School-Based Education Program about Organ Donation and Registration, and the Intention for Continuance

Science.gov (United States)

Reubsaet, A.; Reinaerts, E. B. M.; Brug, J.; van Hooff, J. P.; van den Borne, H. W.

2004-01-01

This paper describes the process evaluation of an organ donation education program for high school students aged 15-18 years of which the effectiveness was established. The program consisted of three components: a video with group discussion, an interactive computer-tailored program and a registration training session. A cross-sectional survey was…

A comparative evaluation of sequence classification programs

Directory of Open Access Journals (Sweden)

Bazinet Adam L

2012-05-01

Full Text Available Abstract Background A fundamental problem in modern genomics is to taxonomically or functionally classify DNA sequence fragments derived from environmental sampling (i.e., metagenomics. Several different methods have been proposed for doing this effectively and efficiently, and many have been implemented in software. In addition to varying their basic algorithmic approach to classification, some methods screen sequence reads for ’barcoding genes’ like 16S rRNA, or various types of protein-coding genes. Due to the sheer number and complexity of methods, it can be difficult for a researcher to choose one that is well-suited for a particular analysis. Results We divided the very large number of programs that have been released in recent years for solving the sequence classification problem into three main categories based on the general algorithm they use to compare a query sequence against a database of sequences. We also evaluated the performance of the leading programs in each category on data sets whose taxonomic and functional composition is known. Conclusions We found significant variability in classification accuracy, precision, and resource consumption of sequence classification programs when used to analyze various metagenomics data sets. However, we observe some general trends and patterns that will be useful to researchers who use sequence classification programs.

Guide for Conducting Benefit-Cost Evaluation of Realized Impacts of Public R&D Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emerald Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2011-08-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others. Retrospective evaluations may be contrasted to prospective evaluations that reflect expected or potential outcomes only if assumptions hold. The retrospective approach described in this Guide is based on realized results only and the extent they can be attributed to the efforts of an R&D program. While it has been prepared specifically to guide retrospective benefit-cost analysis of EERE R&D Programs, this report may be used for similar analysis of other public R&D organizations.

A leadership development program for surgeons: First-year participant evaluation.

Science.gov (United States)

Pradarelli, Jason C; Jaffe, Gregory A; Lemak, Christy Harris; Mulholland, Michael W; Dimick, Justin B

2016-08-01

In a dynamic health care system, strong leadership has never been more important for surgeons. Little is known about how to design and conduct effectively a leadership program specifically for surgeons. We sought to evaluate critically a Leadership Development Program for practicing surgeons by exploring how the program's strengths and weaknesses affected the surgeons' development as physician-leaders. At a large academic institution, we conducted semistructured interviews with 21 surgical faculty members who applied voluntarily, were selected, and completed a newly created Leadership Development Program in December 2012. Interview transcripts underwent qualitative descriptive analysis with thematic coding based on grounded theory. Themes were extracted regarding surgeons' evaluations of the program on their development as physician-leaders. After completing the program, surgeons reported personal improvements in the following 4 areas: self-empowerment to lead, self-awareness, team-building skills, and knowledge in business and leadership. Surgeons felt "more confident about stepping up as a leader" and more aware of "how others view me and my interactions." They described a stronger grasp on "giving feedback" as well as a better understanding of "business/organizational issues." Overall, surgeon-participants reported positive impacts of the program on their day-to-day work activities and general career perspective as well as on their long-term career development plans. Surgeons also recommended areas where the program could potentially be improved. These interviews detailed self-reported improvements in leadership knowledge and capabilities for practicing surgeons who completed a Leadership Development Program. A curriculum designed specifically for surgeons may enable future programs to equip surgeons better for important leadership roles in a complex health care environment. Copyright © 2016 Elsevier Inc. All rights reserved.

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

Science.gov (United States)

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

Formative Evaluation of the Behavior Change Components within a Colorado Weatherization Assistance Program

Science.gov (United States)

Sandoval, Perla K.

A formative evaluation of behavior change elements of an ongoing Weatherization Assistance Program (WAP) offered by the Energy Resource Center (E.R.C.) in Denver, CO was conducted. The WAP as administered by the E.R.C. in Colorado saves residents an average 15% of energy consumption (E.R.C., 2015). However, research suggests that adding behavioral components to WAPs could increase energy savings to 21-26% (Gregory, 1992; APPRAISE, 2002). The goal of this evaluation is to provide recommendations to E.R.C. for program changes using Community Based Social Marketing (CBSM) and Theory of Planned Behavior. The CBSM Step 1- Step 3 is the focus of this formative evaluation. This program evaluation has four components: 1) review of written materials, 2) interviews with staff, 3) surveys mailed to E.R.C. clients and 4) in-home observations conducted with E.R.C. clients. Results of this formative evaluation has 3 sections of behaviors recommended for future intervention high priority, mid priority, and low priority recommendations based on CBSM penetration, probability, and impact factors. Behaviors that are listed as high priority for E.R.C. Behavioral intervention are cold water washing, hang drying, setting back thermostats, and window coverings. Overall increase in staff engagement is also recommended to be pursued. Each staff level is also given recommendations on how to engage in behavior change interventions.

An Evidence-Based Assessment of Faith-Based Programs: Do Faith-Based Programs "Work" to Reduce Recidivism?

Science.gov (United States)

Dodson, Kimberly D.; Cabage, Leann N.; Klenowski, Paul M.

2011-01-01

Faith-based organizations administer many of the prison-based programs aimed at reducing recidivism. Many of these organizations also manage treatment programs for substance abusers, at-risk juveniles, and ex-offenders. Much of the research on religiosity and delinquency indicates that the two are inversely related. Therefore, it seems plausible…

Customizing Process to Align with Purpose and Program: The 2003 MS PHD'S in Ocean Sciences Program Evaluative Case Study

Science.gov (United States)

Williamson, V. A.; Pyrtle, A. J.

2004-12-01

How did the 2003 Minorities Striving and Pursuing Higher Degrees of Success (MS PHD'S) in Ocean Sciences Program customize evaluative methodology and instruments to align with program goals and processes? How is data captured to document cognitive and affective impact? How are words and numbers utilized to accurately illustrate programmatic outcomes? How is compliance with implicit and explicit funding regulations demonstrated? The 2003 MS PHD'S in Ocean Sciences Program case study provides insightful responses to each of these questions. MS PHD'S was developed by and for underrepresented minorities to facilitate increased and sustained participation in Earth system science. Key components of this initiative include development of a community of scholars sustained by face-to-face and virtual mentoring partnerships; establishment of networking activities between and among undergraduate, graduate, postgraduate students, scientists, faculty, professional organization representatives, and federal program officers; and provision of forums to address real world issues as identified by each constituent group. The evaluative case study of the 2003 MS PHD'S in Ocean Sciences Program consists of an analysis of four data sets. Each data set was aligned to document progress in the achievement of the following program goals: Goal 1: The MS PHD'S Ocean Sciences Program will successfully market, recruit, select, and engage underrepresented student and non-student participants with interest/ involvement in Ocean Sciences; Goal 2: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by quantitative analysis of user-feedback; Goal 3: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by qualitative analysis of user-feedback, and; Goal 4: The MS PHD'S Ocean Sciences Program will develop a constituent base adequate to demonstrate evidence of interest, value, need and sustainability in

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

Protocole of a controlled before-after evaluation of a national health information technology-based program to improve healthcare coordination and access to information.

Science.gov (United States)

Saillour-Glénisson, Florence; Duhamel, Sylvie; Fourneyron, Emmanuelle; Huiart, Laetitia; Joseph, Jean Philippe; Langlois, Emmanuel; Pincemail, Stephane; Ramel, Viviane; Renaud, Thomas; Roberts, Tamara; Sibé, Matthieu; Thiessard, Frantz; Wittwer, Jerome; Salmi, Louis Rachid

2017-04-21

Improvement of coordination of all health and social care actors in the patient pathways is an important issue in many countries. Health Information (HI) technology has been considered as a potentially effective answer to this issue. The French Health Ministry first funded the development of five TSN ("Territoire de Soins Numérique"/Digital health territories) projects, aiming at improving healthcare coordination and access to information for healthcare providers, patients and the population, and at improving healthcare professionals work organization. The French Health Ministry then launched a call for grant to fund one research project consisting in evaluating the TSN projects implementation and impact and in developing a model for HI technology evaluation. EvaTSN is mainly based on a controlled before-after study design. Data collection covers three periods: before TSN program implementation, during early TSN program implementation and at late TSN program implementation, in the five TSN projects' territories and in five comparison territories. Three populations will be considered: "TSN-targeted people" (healthcare system users and people having characteristics targeted by the TSN projects), "TSN patient users" (people included in TSN experimentations or using particular services) and "TSN professional users" (healthcare professionals involved in TSN projects). Several samples will be made in each population depending on the objective, axis and stage of the study. Four types of data sources are considered: 1) extractions from the French National Heath Insurance Database (SNIIRAM) and the French Autonomy Personalized Allowance database, 2) Ad hoc surveys collecting information on knowledge of TSN projects, TSN program use, ease of use, satisfaction and understanding, TSN pathway experience and appropriateness of hospital admissions, 3) qualitative analyses using semi-directive interviews and focus groups and document analyses and 4) extractions of TSN

INPO JTA application: developing a competency-based training program

International Nuclear Information System (INIS)

Patrick, P.W.

1985-01-01

Developing a competency-based training program requires the support of a strong curriculum development program. The major thrust of Arkansas Power and Light Company's competency-based curriculum development program is the identification of competencies using position task analysis data, panels, and INPO JTA data. Eight steps in the curriculum development approach provide the logic and rationale of the process: (1) establish competencies, (2) conduct competency verification, (3) develop competency tests, (4) develop curriculum, (5) develop instructional media, (6) validate curriculum and conduct field testing, (7) perform training effectiveness evaluation, and (8) revise the curriculum as needed. The processes describe how INPO JTA's and NRC procedures are cross-referenced to show that standards and requirements imposed or sanctioned by NRC and INPO are met. The competency-based approach to curriculum and training development eliminates the traditional scatterload approach to training and focuses on training to the competency. The primary benefits of competency-based training include accountability, minimal job training to meet job or position requirements, and a process to document an individual's job proficiency

How Do US Pediatric Residency Programs Teach and Evaluate Community Pediatrics and Advocacy Training?

Science.gov (United States)

Lichtenstein, Cara; Hoffman, Benjamin D; Moon, Rachel Y

2017-07-01

In 2013, the Accreditation Council for Graduate Medical Education updated requirements for training in community pediatrics and advocacy in pediatric residency programs. In light of this update, the aim of this study was to better understand how community pediatrics is being taught and evaluated in pediatric residency programs in the United States. Cross-sectional exploratory study using a Web-based survey of pediatric residency program directors in September 2014. Questions focused on teaching and evaluation of 10 community pediatrics competencies. Of 85 programs (43% response rate), 30% offered a separate training track and/or 6-block individualized curriculum in community pediatrics or advocacy. More than 75% required all residents to learn 7 of 10 competencies queried. Respondents in urban settings were more likely to teach care of special populations (P = .02) and public speaking (P pediatrics and advocacy teaching among responding US pediatric residency programs. Although respondents reported a variety of teaching and evaluation methods, there were few statistically significant differences between programs. Copyright © 2017 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

Theory-Based Evaluation Meets Ambiguity: The Role of Janus Variables

Science.gov (United States)

Dahler-Larsen, Peter

2018-01-01

As theory-based evaluation (TBE) engages in situations where multiple stakeholders help develop complex program theory about dynamic phenomena in politically contested settings, it becomes difficult to develop and use program theory without ambiguity. The purpose of this article is to explore ambiguity as a fruitful perspective that helps TBE face…

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Feasibility of the evidence-based cognitive telerehabilitation program Remind for patients with primary brain tumors.

Science.gov (United States)

van der Linden, Sophie D; Sitskoorn, Margriet M; Rutten, Geert-Jan M; Gehring, Karin

2018-05-01

Many patients with primary brain tumors experience cognitive deficits. Cognitive rehabilitation programs focus on alleviating these deficits, but availability of such programs is limited. Our large randomized controlled trial (RCT) demonstrated positive effects of the cognitive rehabilitation program developed by our group. We converted the program into the iPad-based cognitive rehabilitation program ReMind, to increase its accessibility. The app incorporates psychoeducation, strategy training and retraining. This pilot study in patients with primary brain tumors evaluates the feasibility of the use of the ReMind-app in a clinical (research) setting in terms of accrual, attrition, adherence and patient satisfaction. The intervention commenced 3 months after resective surgery and patients were advised to spend 3 h per week on the program for 10 weeks. Of 28 eligible patients, 15 patients with presumed low-grade glioma or meningioma provided informed consent. Most important reason for decline was that patients (7) experienced no cognitive complaints. Participants completed on average 71% of the strategy training and 76% of the retraining. Some patients evaluated the retraining as too easy. Overall, 85% of the patients evaluated the intervention as "good" or "excellent". All patients indicated that they would recommend the program to other patients with brain tumors. The ReMind-app is the first evidence-based cognitive telerehabilitation program for adult patients with brain tumors and this pilot study suggests that postoperative cognitive rehabilitation via this app is feasible. Based on patients' feedback, we have expanded the retraining with more difficult exercises. We will evaluate the efficacy of ReMind in an RCT.

A Final Report for the Evaluation of the Achieve3000 Programs

Science.gov (United States)

Shannon, Lisa; Grant, Billie-Jo

2015-01-01

Achieve3000 publishes a number of online literacy programs that differentiate lessons and activities based on student performance. Magnolia Consulting--an independent, third party evaluation firm--assessed Achieve3000 Solutions' impact on student learning during the 2014-15 school year. The researchers used a randomized control trial, where…

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Subjective Outcome Evaluation of the Project P.A.T.H.S. (Secondary 2 Program: Views of the Program Participants

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2009-01-01

Full Text Available A total of 196 secondary schools participated in the Secondary 2 Program of the Full Implementation Phase of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes. After completion of the Tier 1 Program, 30,731 students responded to the Subjective Outcome Evaluation Form (Form A to assess their perceptions of the program, instructors, and perceived effectiveness of the program. Based on the consolidated reports submitted by the schools to the funding body, the research team aggregated the consolidated data to form a “reconstructed” overall profile on the perceptions of the program participants. Findings demonstrated that high proportions of the respondents had positive perceptions of the program and the instructors, and roughly four-fifths of the respondents regarded the program as beneficial to them. Correlation analyses showed that perceived program and instructor characteristics were positively associated with perceived benefits of the program.

Improving energy efficiency and smart grid program analysis with agent-based end-use forecasting models

International Nuclear Information System (INIS)

Jackson, Jerry

2010-01-01

Electric utilities and regulators face difficult challenges evaluating new energy efficiency and smart grid programs prompted, in large part, by recent state and federal mandates and financial incentives. It is increasingly difficult to separate electricity use impacts of individual utility programs from the impacts of increasingly stringent appliance and building efficiency standards, increasing electricity prices, appliance manufacturer efficiency improvements, energy program interactions and other factors. This study reviews traditional approaches used to evaluate electric utility energy efficiency and smart-grid programs and presents an agent-based end-use modeling approach that resolves many of the shortcomings of traditional approaches. Data for a representative sample of utility customers in a Midwestern US utility are used to evaluate energy efficiency and smart grid program targets over a fifteen-year horizon. Model analysis indicates that a combination of the two least stringent efficiency and smart grid program scenarios provides peak hour reductions one-third greater than the most stringent smart grid program suggesting that reductions in peak demand requirements are more feasible when both efficiency and smart grid programs are considered together. Suggestions on transitioning from traditional end-use models to agent-based end-use models are provided.

School-based violence prevention strategy: a pilot evaluation.

Science.gov (United States)

Thakore, Rachel V; Apfeld, Jordan C; Johnson, Ronald K; Sathiyakumar, Vasanth; Jahangir, A Alex; Sethi, Manish K

2015-07-01

Violence has recently been reported among a primarily young, minority population in Nashville, Tennessee. School-based programs have been proven as effective methods of reducing violent behavior, beliefs, and actions that lead to violence among adolescents. Investigators implemented a rigorous search for an appropriate school-based violence prevention program for Metropolitan Nashville middle school students utilizing a systematic review and discussion group with victims of violence. 27 programs nation-wide were reviewed and 2 discussion groups with African American males under the age of 25 admitted to a level 1 trauma center for assault-related injuries were conducted. Our findings led to a single, evidence-based conflict resolution program. In conjunction with educators, we evaluated the program's effectiveness in a pilot study in a Nashville middle school with high rates of violence. 122 students completed the conflict resolution program and described their behavior and experiences with violence in a pre-test/post-test self-rate questionnaire. Results showed a significant decrease in violent behavior and an increase in students' competencies to deal with violence (p less than 0.05). This study shows that a reduction in violent behavior and beliefs among middle school students can be achieved through the implementation of a targeted violence intervention program. A larger-scale intervention is needed to develop more conclusive evidence of effectiveness. © 2015 KUMS, All rights reserved.

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

INSPECT: a package of computer programs for planning and evaluating safeguards inspections

International Nuclear Information System (INIS)

Mullen, M.F.

1980-01-01

As part of the US Program of Technical Assistance to IAEA Safeguards, PNL has developed a package of computer programs, called INSPECT, that can be used in planning and evaluating safeguards inspections of various types of nuclear facilities. The programs are based on the statistical methods described in Part F of the IAEA Safeguards Technical Manual and can be used to calculate the variance components of the MUF (Material Unaccounted For) statistic, the variance components of the D (difference) statistic, attribute and variables sampling plans, and a measure of the effectiveness of the inspection plan. The paper describes the programs, reviews a number of applications, and indicates areas for future work

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Evaluation of the MIND Research Institute's Spatial-Temporal Math (ST Math) Program in California

Science.gov (United States)

Wendt, Staci; Rice, John; Nakamoto, Jonathan

2014-01-01

The MIND Research Institute contracted with the Evaluation Research Program at WestEd to conduct an independent assessment of mathematics outcomes in elementary school grades across California that were provided with the ST Math program. Spatial-Temporal (ST) Math is a game-based instructional software designed to boost K-5 and secondary-level…

Short-term evaluation of a skill-development sexual education program for Spanish adolescents compared with a well-established program.

Science.gov (United States)

Espada, José P; Morales, Alexandra; Orgilés, Mireia; Jemmott, John B; Jemmott, Loretta S

2015-01-01

The Centers for Disease Control and Prevention highlights the importance of evaluating interventions rigorously and recommends evaluating new interventions against interventions with established efficacy. Competencias para adolescentes con una sexualidad saludable (COMPAS) is a school-based HIV prevention program that has been shown to be effective in reducing sexual risk behaviors among adolescents in Spain. This study evaluates the efficacy of COMPAS program compared with a Spanish-culture adapted version of ¡Cuídate! (Take Care of Yourself), an evidence-based HIV prevention curriculum designed for Latino adolescents in the US. This cluster randomized controlled trial involved 1,563 adolescents attending 18 public high schools located in 5 provinces of Spain. The schools invited to participate were enrolled and randomly assigned to the three experimental conditions: COMPAS, ¡Cuídate!, and control group (CG; no intervention). Generalized estimating equation analyses revealed that both interventions improved attitudes toward people living with human immunodeficiency syndrome (HIV)/AIDS and the HIV test and increased HIV/sexually transmitted infection knowledge and intention to engage in safer sex behaviors compared with the CG. Although only COMPAS increased participants' sexual risk perception and attitude toward condom use compared with the CG, the two interventions did not significantly differ on any outcome. When compared with an established program, COMPAS was at least as effective at increasing the intention to engage in safer sex behaviors as the evidence-based intervention. Copyright © 2015 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.