Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

Evaluating a national science and technology program using the human capital and relational asset perspectives.

Science.gov (United States)

Hung, Chia-Liang; Chou, Jerome Chih-Lung; Roan, Hung-Wei

2010-11-01

The purpose of this research is to evaluate the performance of the National Science and Technology Program (NSTP) by targeting the Taiwan National Telecommunication Program (NTP) initiated in 1998. The Taiwan telecommunications industry has prospered, currently occupying key positions in global markets even though NTP seldom contributes positively to patent citation performance. Hence, the authors of this study investigate the qualitative perspective of intellectual capital rather than quantitative technological indices. The current study focuses on both human capital and relational assets through surveys of 53 principal investigators of NTP projects and 63 industrial R&D managers of telecommunications corporations in the Taiwan market. Results show that NSTP member quality and the flow of employment are good indicators of human capital and that both perform better than the middle value in the case of Taiwan NTP. In addition, we find that industrial participants are more likely to share R&D resources than other academic researchers with higher intention of co-publishing, co-funding, and sharing equipment and facilities. The industrial NTP participants also have higher expectations regarding achieving advanced technology breakthroughs in contrast to non-NTP industrial interviewees. Moreover, industrial participants with greater industry-university cooperation intensity indeed obtain a particular advantage, that is, greater knowledge acquisition from other fields related to the effect of knowledge spillovers through the particular NSTP linkage. Accordingly, from the perspectives of human capital and relational assets, the authors conclude by articulating the importance of absorptive capacity resulting from good human capital and knowledge spillover contributed by relational assets within governmental technology policy and NSTP programming. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

Organizational Structures that Support Internal Program Evaluation

Science.gov (United States)

Lambur, Michael T.

2008-01-01

This chapter explores how the structure of large complex organizations such as Cooperative Extension affects their ability to support internal evaluation of their programs and activities. Following a literature review of organizational structure and its relation to internal evaluation capacity, the chapter presents the results of interviews with…

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

Development and evaluation of a cancer-related fatigue patient education program: protocol of a randomized controlled trial

Directory of Open Access Journals (Sweden)

Görres Stefan

2008-07-01

Full Text Available Abstract Background Cancer-related fatigue (CRF and its impact on patients' quality of life has been an increasing subject of research. However, in Germany there is a lack of evidence-based interventions consistent with the multidimensional character of fatigue. The objective of this study is to develop and evaluate a self-management program for disease-free cancer patients to cope with CRF. Methods Based on evidence extracted from a literature review, a curriculum for the self-management program was elaborated. The curriculum was reviewed and validated by an interdisciplinary expert group and the training-modules will be pretested with a small number of participants and discussed in terms of feasibility and acceptance. To determine the efficacy of the program a randomised controlled trial will be carried out: 300 patients will be recruited from oncological practices in Bremen, Germany, and will be allocated to intervention or control group. The intervention group participates in the program, whereas the control group receives standard care and the opportunity to take part in the program after the end of the follow-up (waiting control group. Primary outcome measure is the level of fatigue, secondary outcome measures are quality of life, depression, anxiety, self-efficacy and physical activity. Data will be collected before randomisation, after intervention, and after a follow-up of 6 months. Discussion Because there are no comparable self-management programs for cancer survivors with fatigue, the development of the curriculum has been complex; therefore, the critical appraisal by the experts was an important step to validate the program and their contributions have been integrated into the curriculum. The experts appreciated the program as filling a gap in outpatient cancer care. If the results of the evaluation prove to be satisfactory, the outpatient care of cancer patients can be broadened and supplemented. Trial Registration Clinical

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond's Checklist: A Narrative Review.

Science.gov (United States)

Rezapour, Aziz; Jafari, Abdosaleh; Mirmasoudi, Kosha; Talebianpour, Hamid

2017-09-01

Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond's checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English) in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles' structure was analyzed by Drummond's standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond's criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

Science.gov (United States)

2010-07-01

... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

Evaluation of the Navy Master Planning Program

Science.gov (United States)

1976-05-01

Navy planning directives, interviews with Navy planning personnel, researc " of applicable literature on planning and program evaluation, and the...master planning has absorbed the additional roles of program management and public relations marketing . The Navy planner is now deeply involved in...master planning 62conducted by NAVFAC headquarters in 1972, various Navy planning directives, a " Market Survey" of NAVFAC services and customer 63

Evaluation of a multi-site program designed to strengthen relational bonds for siblings separated by foster care.

Science.gov (United States)

Waid, Jeffrey; Wojciak, Armeda Stevenson

2017-10-01

Sibling relationships in foster care settings have received increased attention in recent years. Despite growing evidence regarding the protective potential of sibling relationships for youth in care, some sibling groups continue to experience foster care related separation, and few programs exist to address the needs of these youth. This study describes and evaluates Camp To Belong, a multi-site program designed to provide short-term reunification to separated sibling groups through a week-long summer camp experience. Using a pre-test post-test survey design, this paper examines changes in youth ratings of sibling conflict and sibling support across camps located in six geographically distinct regions of the United States. The effects of youth age, number of prior camp exposures, and camp location were tested using multilevel modeling procedures. Findings suggest that participation in Camp To Belong may reduce sibling conflict, and improvements in sibling support are noted for youth who have had prior exposure to the camp's programming. Camp-level variance in the sibling support outcome highlight the complex nature of relationships for siblings separated by foster care, and suggest the need for additional research. Lessons learned from this multi-site evaluation and future directions are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Evaluation of Clark County School District's Alternative Route to Licensure Program from the Program Participants' Perspectives

Science.gov (United States)

Kenyon, James J., Jr.

2013-01-01

This evaluation assesses the Alternative Route to Licensure (ARL) program of the Clark County School District (CCSD), in Clark County, Nevada from the program participants' perspectives. The program was implemented to reduce teacher shortages in the school district and allow persons with non-education-related Bachelor's Degrees to obtain teaching…

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Quality Assessment of Published Articles in Iranian Journals Related to Economic Evaluation in Health Care Programs Based on Drummond’s Checklist: A Narrative Review

Directory of Open Access Journals (Sweden)

Aziz Rezapour

2017-09-01

Full Text Available Health economic evaluation research plays an important role in selecting cost-effective interventions. The purpose of this study was to assess the quality of published articles in Iranian journals related to economic evaluation in health care programs based on Drummond’s checklist in terms of numbers, features, and quality. In the present review study, published articles (Persian and English in Iranian journals related to economic evaluation in health care programs were searched using electronic databases. In addition, the methodological quality of articles’ structure was analyzed by Drummond’s standard checklist. Based on the inclusion criteria, the search of databases resulted in 27 articles that fully covered economic evaluation in health care programs. A review of articles in accordance with Drummond’s criteria showed that the majority of studies had flaws. The most common methodological weakness in the articles was in terms of cost calculation and valuation. Considering such methodological faults in these studies, it is anticipated that these studies would not provide an appropriate feedback to policy makers to allocate health care resources correctly and select suitable cost-effective interventions. Therefore, researchers are required to comply with the standard guidelines in order to better execute and report on economic evaluation studies.

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

The program success story: a valuable tool for program evaluation.

Science.gov (United States)

Lavinghouze, Rene; Price, Ann Webb; Smith, Kisha-Ann

2007-10-01

Success stories are evaluation tools that have been used by professionals across disciplines for quite some time. They are also proving to be useful in promoting health programs and their accomplishments. The increasing popularity of success stories is due to the innovative and effective way that they increase a program's visibility, while engaging potential participants, partners, and funders in public health efforts. From the community level to the federal level, program administrators are using success stories as vehicles for celebrating achievements, sharing challenges, and communicating lessons learned. Success stories are an effective means to move beyond the numbers and connect to readers-with a cause they can relate to and want to join. This article defines success stories and provides an overview of several types of story formats, how success stories can be systematically collected, and how they are used to communicate program success.

Methods for evaluating a mature substance abuse prevention/early intervention program.

Science.gov (United States)

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Evaluating a National Science and Technology Program Using the Human Capital and Relational Asset Perspectives

Science.gov (United States)

Hung, Chia-Liang; Chou, Jerome Chih-Lung; Roan, Hung-Wei

2010-01-01

The purpose of this research is to evaluate the performance of the National Science and Technology Program (NSTP) by targeting the Taiwan National Telecommunication Program (NTP) initiated in 1998. The Taiwan telecommunications industry has prospered, currently occupying key positions in global markets even though NTP seldom contributes positively…

Program Evaluation: Roles and Responsibilities of Boards of Education Relative to Thorough and Efficient Legislation.

Science.gov (United States)

Research for Better Schools, Inc., Philadelphia, PA.

The process for providing a "thorough and efficient" (T & E) education according to New Jersey statutes and regulations involves six basic steps. This document suggests procedures for handling the fifth step, educational program evaluation. Processes discussed include committee formation, evaluation planning, action plan…

The economic, energy, and environmental impacts of the Energy-Related Inventions Program

International Nuclear Information System (INIS)

Brown, M.A.; Wilson, C.R.; Franchuk, C.A.; Cohn, S.M.; Jones, D.

1994-07-01

This report provides information on the economic, energy, and environmental impacts of inventions supported by the Energy-Related Inventions Program (ERIP) -- a program jointly operated by the US Department of Energy and the National Institute of Standards and Technology (NIST). It describes the results of the latest in a series of ERIP evaluation projects that have been completed since 1980. The period of interest is 1980 through 1992. The evaluation is based on data collected in 1993 through mail and telephone surveys of 253 program participants, and historical data collected during previous evaluations for an additional 189 participants

The economic, energy, and environmental impacts of the Energy-Related Inventions Program

Energy Technology Data Exchange (ETDEWEB)

Brown, M.A.; Wilson, C.R.; Franchuk, C.A.; Cohn, S.M.; Jones, D.

1994-07-01

This report provides information on the economic, energy, and environmental impacts of inventions supported by the Energy-Related Inventions Program (ERIP) -- a program jointly operated by the US Department of Energy and the National Institute of Standards and Technology (NIST). It describes the results of the latest in a series of ERIP evaluation projects that have been completed since 1980. The period of interest is 1980 through 1992. The evaluation is based on data collected in 1993 through mail and telephone surveys of 253 program participants, and historical data collected during previous evaluations for an additional 189 participants.

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Evaluation of a Community College's Nursing Faculty Advising Program Relative to Students' Satisfaction and Retention

Science.gov (United States)

Harrell, Johnna C.; Reglin, Gary

2018-01-01

Problem was the community college recognized a decline in student retention rates from 2009 to 2012 in the School of Nursing. Purpose of this program evaluation was to evaluate a faculty advising program (FAP) in the School of Nursing at a community college in regard to students' satisfaction and retention. Evaluation period was from Fall 2012 to…

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Materials balance area Custodian Performance Evaluation Program at PNL

International Nuclear Information System (INIS)

Dickman, D.A.

1991-07-01

The material balance area (MBA) custodian has primary responsibility for control and accountability of nuclear material within an MBA. In this role, the custodian operates as an extension of the facility material control and accountability (MC ampersand A) organization. To effectively meet administrative requirements and protection needs, the custodian must be fully trained in all aspects of MC ampersand A related to the MBA, and custodian performance must be periodically evaluated. DOE Policy requires that each facility provide for a program which assures that each facility provide for a program which assures that personnel performing MC ampersand A functions are (1) trained and/or qualified to perform their duties and responsibilities and (2) knowledgeable of requirements and procedures related to their functions. The MBA Custodian Performance Evaluation Program at PNL uses a variety of assessment techniques to meet this goal, including internal and independent MBA audits, periodic custodian testing, conduct of limited scope performance tests, daily monitoring of MC ampersand A documentation, and reviewing custodian performance during physical inventories. The data collected from these sources is analyzed and incorporated into an annual custodian performance evaluation document, given to each custodian and line management. Development of this program has resulted in significantly improved custodian performance and a marked decrease in finding and observations identified during MBA audits

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

NRC systematic evaluation program: seismic review

International Nuclear Information System (INIS)

Levin, H.A.

1980-01-01

The NRC Systematic Evaluation Program is currently making an assessment of the seismic design safety of 11 older nuclear power plant facilities. The general review philosophy and review criteria relative to seismic input, structural response, and equipment functionability are presented, including the rationale for the development of these guidelines considering the significant evolution of seismic design criteria since these plants were originally licensed. Technical approaches thought more realistic in light of current knowledge are utilized. Initial findings for plants designed to early seismic design procedures suggest that with minor exceptions, these plants possess adequate seismic design margins when evaluated against the intent of current criteria. However, seismic qualification of electrical equipment has been identified as a subject which requires more in-depth evaluation

Public Relations for Brazilian Libraries: Process, Principles, Program Planning, Planning Techniques and Suggestions.

Science.gov (United States)

Kies, Cosette N.

A brief overview of the functions of public relations in libraries introduces this manual, which provides an explanation of the public relations (PR) process, including fact-finding, planning, communicating, evaluating, and marketing; some PR principles; a 10-step program that could serve as a model for planning a PR program; a discussion of PR…

Evaluating public involvement in the National Low-Level Radioactive Waste Management Program

International Nuclear Information System (INIS)

1982-09-01

The Department of Energy contracted with the Keystone Center to evaluate the effectiveness of the National Low-Level Radioactive Waste Management Program's public-involvement efforts. The Center chose six evaluators with diverse training and experience related to low-level waste management and public-participation programs. Keystone's evaluation was based on (a) observations by the evaluators who attended the National Program-sponsored strategy review meetings and fairs; (b) interviews with low-level waste generators, local government officials, state legislators, public-interest groups, and members of the general public; and (c) observations of the final National Program strategy task force meeting. The evaluators concluded that, overall, the public-participation processes yielded some very positive results - for policy development and for DOE and the EG and G staff. They judged the strategy document to be complete, concise, and helpful to public dialogue on low-level waste issues. They also made specific recommendations for improvements to the public-participation program

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

Heuristic Evaluation for Novice Programming Systems

OpenAIRE

Kölling, Michael; McKay, Fraser

2016-01-01

The past few years has seen a proliferation of novice programming tools. The availability of a large number of systems has made it difficult for many users to choose among them. Even for education researchers, comparing the relative quality of these tools, or judging their respective suitability for a given context, is hard in many instances. For designers of such systems, assessing the respective quality of competing design decisions can be equally difficult.\\ud Heuristic evaluation provides...

Gendered Citizenship and the Individualization of Environmental Responsibility: Evaluating a Campus Common Reading Program

Science.gov (United States)

Kennedy, Emily Huddart; Boyd, Amanda

2018-01-01

Campus common reading programs are intended to stimulate critical thinking and dialogue across disciplines yet scarce evidence exists to evaluate the success of such programs. We assess the extent to which engagement in an environmentally-themed common reading program is related to (1) concern for waste-related issues, (2) beliefs that addressing…

The From Survivor to Thriver program: RCT of an online therapist-facilitated program for rape-related PTSD.

Science.gov (United States)

Littleton, Heather; Grills, Amie E; Kline, Katherine D; Schoemann, Alexander M; Dodd, Julia C

2016-10-01

This study evaluated the efficacy of the From Survivor to Thriver program, an interactive, online therapist-facilitated cognitive-behavioral program for rape-related PTSD. Eighty-seven college women with rape-related PTSD were randomized to complete the interactive program (n=46) or a psycho-educational self-help website (n=41). Both programs led to large reductions in interview-assessed PTSD at post-treatment (interactive d=2.22, psycho-educational d=1.10), which were maintained at three month follow-up. Both also led to medium- to large-sized reductions in self-reported depressive and general anxiety symptoms. Follow-up analyses supported that the therapist-facilitated interactive program led to superior outcomes among those with higher pre-treatment PTSD whereas the psycho-educational self-help website led to superior outcomes for individuals with lower pre-treatment PTSD. Future research should examine the efficacy and effectiveness of online interventions for rape-related PTSD including whether treatment intensity matching could be utilized to maximize outcomes and therapist resource efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Evaluation of otolaryngology residency program websites.

Science.gov (United States)

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42

Educational Program Evaluation Model, From the Perspective of the New Theories

Directory of Open Access Journals (Sweden)

Soleiman Ahmady

2014-05-01

Full Text Available Introduction: This study is focused on common theories that influenced the history of program evaluation and introduce the educational program evaluation proposal format based on the updated theory. Methods: Literature searches were carried out in March-December 2010 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface, ERIC (Education Resources Information Center and the main journal of medical education regarding current evaluation models and theories. We included all study designs in our study. We found 810 articles related to our topic, and finally 63 with the full text article included. We compared documents and used expert consensus for selection the best model. Results: We found that the complexity theory using logic model suggests compatible evaluation proposal formats, especially with new medical education programs. Common components of a logic model are: situation, inputs, outputs, and outcomes that our proposal format is based on. Its contents are: title page, cover letter, situation and background, introduction and rationale, project description, evaluation design, evaluation methodology, reporting, program evaluation management, timeline, evaluation budget based on the best evidences, and supporting documents. Conclusion: We found that the logic model is used for evaluation program planning in many places, but more research is needed to see if it is suitable for our context.

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Are Job Search Programs a Promising Tool? : A Microeconometric Evaluation for Austria

OpenAIRE

Weber, Andrea Maria; Hofer, Helmut

2004-01-01

In Austria job search programs were introduced on a large scale in 1999. These programs aim at activating unemployed at an early stage and bringing them back to work by training job search related skills. We evaluate the impact of active labour market programs in Austria on individual unemployment durations, and allow program effects to vary between job search programs and formal training programs. We use the timing-of-events method which estimates the program effect as a shift in the transit...

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Computer-Assisted Program Reasoning Based on a Relational Semantics of Programs

Directory of Open Access Journals (Sweden)

Wolfgang Schreiner

2012-02-01

Full Text Available We present an approach to program reasoning which inserts between a program and its verification conditions an additional layer, the denotation of the program expressed in a declarative form. The program is first translated into its denotation from which subsequently the verification conditions are generated. However, even before (and independently of any verification attempt, one may investigate the denotation itself to get insight into the "semantic essence" of the program, in particular to see whether the denotation indeed gives reason to believe that the program has the expected behavior. Errors in the program and in the meta-information may thus be detected and fixed prior to actually performing the formal verification. More concretely, following the relational approach to program semantics, we model the effect of a program as a binary relation on program states. A formal calculus is devised to derive from a program a logic formula that describes this relation and is subject for inspection and manipulation. We have implemented this idea in a comprehensive form in the RISC ProgramExplorer, a new program reasoning environment for educational purposes which encompasses the previously developed RISC ProofNavigator as an interactive proving assistant.

Systematic evaluation program status summary report: November 1-30, 1981

International Nuclear Information System (INIS)

1981-12-01

The Systematic Evaluation Program is intended to examine many safety related aspects of eleven of the older light water reactors. This document provides the existing status of the review process including individual topic and overall completion status

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Is Something Better than Nothing? An Evaluation of Early Childhood Programs in Cambodia

Science.gov (United States)

Rao, Nirmala; Sun, Jin; Pearson, Veronica; Pearson, Emma; Liu, Hongyun; Constas, Mark A.; Engle, Patrice L.

2012-01-01

This study evaluated the relative effectiveness of home-based, community-based, and state-run early childhood programs across Cambodia. A total of 880 five-year-olds (55% girls) from 6 rural provinces in Cambodia attending State Preschools, Community Preschools, Home-Based Programs, or no programs were assessed twice using the Cambodian…

Implementing Relative Ranking Evaluation Framework at Department of Energy (DOE) installations

International Nuclear Information System (INIS)

Sharma, S.K.; Williamson, D.; Treichel, L.C.; James, L.M.

1996-01-01

The US Department of Energy (DOE) Office of Environmental Restoration (EM-40) has developed the Relative Ranking Evaluation Framework (RREF) to help categorize release sites, facilities and buildings requiring restoration or decommissioning. Based on this framework, a computer tool, the Relative Rank Evaluation Program (RREP) has been developed to evaluate release sites, facilities and buildings, and to manage information pertaining to relative ranking evaluations. The relative ranking information is being used by both Headquarters and field project managers, and other environmental personnel responsible for planning, executing and evaluation environmental restoration activities at DOE installations. External stakeholders, such as representatives of federal and state regulatory agencies, local governments and communities in the vicinity of current and formerly used DOE installations may use this data to review proposed and planned activities

Functional Programming With Relations

OpenAIRE

Hutton, Graham

1991-01-01

While programming in a relational framework has much to offer over the functional style in terms of expressiveness, computing with relations is less efficient, and more semantically troublesome. In this paper we propose a novel blend of the functional and relational styles. We identify a class of "causal relations", which inherit some of the bi-directionality properties of relations, but retain the efficiency and semantic foundations of the functional style.

National Uranium Resource Evaluation Program. Hydrogeochemical and Stream Sediment Reconnaissance Basic Data Reports Computer Program Requests Manual

International Nuclear Information System (INIS)

1980-01-01

This manual is intended to aid those who are unfamiliar with ordering computer output for verification and preparation of Uranium Resource Evaluation (URE) Project reconnaissance basic data reports. The manual is also intended to help standardize the procedures for preparing the reports. Each section describes a program or group of related programs. The sections are divided into three parts: Purpose, Request Forms, and Requested Information

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. (eds.); Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

GESAT: System for management and evaluation of training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper describe the criteria considered to design the GESAT system, the elements considered to select the relational model, selection of the database language and the main features and possibilities of this system. GESAT allow the management of training programs based on the Systematic Approach to Training. Include the information related with all SAT phases, the results of the job analysis, training plans design, development of materials, training implementation, and the subsequent evaluation

Safety evaluation report related to Babcock and Wilcox Owners Group Plant Reassessment Program: [Final report

International Nuclear Information System (INIS)

1987-11-01

After the accident of Three Mile Island, Unit 2, nuclear power plant owners made a number of improvements to their nuclear facilities. Despite these improvements, the US Nuclear Regulatory Commission (NRC) staff is concerned that the number and complexity of events at Babcock and Wilcox (B and W) nuclear plants have not decreased as expected. This concern was reinforced by the June 9, 1985 total-loss-of-feedwater event at Davis-Besse Nuclear Power Station and the December 26, 1985 overcooling transient at Rancho Seco Nuclear Generating Station. By letter dated January 24, 1986, the Executive Director for Operations (EDO) informed the Chairman of the B and W Owners Group (BWOG) that a number of recent events at B and W-designed reactors have led the NRC staff to conclude that the basic requirements for B and W reactors need to be reexamined. In its February 13, 1986 response to the EDO's letter, the BWOG committed to lead an effort to define concerns relative to reducing the frequency of reactor trips and the complexity of post-trip response in B and W plants. The BWOG submitted a description of the B and W program entitled ''Safety and Performance Improvement Program'' (BAW-1919) on May 15, 1986. Five revisions to BAW-1919 have also been submitted. The NRC staff has reviewed BAW-1919 and its revisions and presents its evaluation in this report. 2 figs., 34 tabs

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Evaluation of the childhood obesity prevention program Kids - 'Go for your life'

Directory of Open Access Journals (Sweden)

Gibbs Lisa

2010-05-01

Full Text Available Abstract Background Kids - 'Go for your life' (K-GFYL is an award-based health promotion program being implemented across Victoria, Australia. The program aims to reduce the risk of childhood obesity by improving the socio-cultural, policy and physical environments in children's care and educational settings. Membership of the K-GFYL program is open to all primary and pre-schools and early childhood services across the State. Once in the program, member schools and services are centrally supported to undertake the health promotion (intervention activities. Once the K-GFYL program 'criteria' are reached the school/service is assessed and 'awarded'. This paper describes the design of the evaluation of the statewide K-GFYL intervention program. Methods/Design The evaluation is mixed method and cross sectional and aims to: 1 Determine if K-GFYL award status is associated with more health promoting environments in schools/services compared to those who are members only; 2 Determine if children attending K-GFYL award schools/services have higher levels of healthy eating and physical activity-related behaviors compared to those who are members only; 3 Examine the barriers to implementing and achieving the K-GFYL award; and 4 Determine the economic cost of implementing K-GFYL in primary schools Parent surveys will capture information about the home environment and child dietary and physical activity-related behaviors. Environmental questionnaires in early childhood settings and schools will capture information on the physical activity and nutrition environment and current health promotion activities. Lunchbox surveys and a set of open-ended questions for kindergarten parents will provide additional data. Resource use associated with the intervention activities will be collected from primary schools for cost analysis. Discussion The K-GFYL award program is a community-wide intervention that requires a comprehensive, multi-level evaluation. The evaluation

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Systematic evaluation program. Status report and initial evaluation

International Nuclear Information System (INIS)

1983-06-01

The MHB Ongoing Systematic Evaluation Program (SEP) Assessment Study was initiated by the Swedish Nuclear Power Inspectorate (SKI) in 1980. This MHB report is a status report and initial evaluation of SEP. The methodology and results of SEP are disscused with particular emphasis on the first two SEP plant reviews - the Palisades and R.E. Ginna nuclear power plants. The comments of cognizant persons in the NRC and the ACRS, as well as private consultants, are included herein. MHBs major findings are as follows: The SEP plant review methodology was acceptable to the NRC Commissioners, the ACRS, and the NRC Staffs consultants who evaluated the first two SEP plant reviews. A concern raised by all who commented on SEP was the absence of Three Mile Island Action Plan Items and Unresolved Safety Issues from current SEP reviews. The SEP reviews of the Palisades and R.E. Ginna plants concluded that the two plant designs were adequate with respect to a majority of safety topics. Several topics remain unresolved in both the Palisades and R.E. Ginna SEP reviews. In the case of the Ginna plant, several related topics have been grouped together in a major structural reevaluation study. In general, due to the number of unresolved and excluded topics, SEP has not at this time produced a plant safety evaluation which can be considered complete and integrated. (author)

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

Material balance area custodian performance evaluation program at PNL

International Nuclear Information System (INIS)

Dickman, D.A.

1991-01-01

This paper reports that the material balance area (MBA) custodian has primary responsibility for control and accountability of nuclear material within an MBA. In this role, the custodian operates as an extension of the facility material control and accountability (MC and A) organization. To effectively meet administrative requirements and protection needs, the custodian must be fully trained in all aspects of MC and A related to the MBA, and custodian performance must be periodically evaluated. U.S. Department of Energy (DOE) Policy requires that each facility provide for a program which ensures that personnel performing MC and A functions are trained and/or qualified to perform their duties and responsibilities and knowledgeable of requirements and procedures related to their functions. the MBA Custodian Performance Evaluation Program at Pacific Northwest Laboratory (PNL) uses a variety of assessment techniques to meet this goal, including internal and independent MBA audits, periodic custodian testing, limited scope performance tests, daily monitoring of MC and A documentation, and reviewing custodian performance during physical inventories

Rainfall Product Evaluation for the TRMM Ground Validation Program

Science.gov (United States)

Amitai, E.; Wolff, D. B.; Robinson, M.; Silberstein, D. S.; Marks, D. A.; Kulie, M. S.; Fisher, B.; Einaudi, Franco (Technical Monitor)

2000-01-01

Evaluation of the Tropical Rainfall Measuring Mission (TRMM) satellite observations is conducted through a comprehensive Ground Validation (GV) Program. Standardized instantaneous and monthly rainfall products are routinely generated using quality-controlled ground based radar data from four primary GV sites. As part of the TRMM GV program, effort is being made to evaluate these GV products and to determine the uncertainties of the rainfall estimates. The evaluation effort is based on comparison to rain gauge data. The variance between the gauge measurement and the true averaged rain amount within the radar pixel is a limiting factor in the evaluation process. While monthly estimates are relatively simple to evaluate, the evaluation of the instantaneous products are much more of a challenge. Scattegrams of point comparisons between radar and rain gauges are extremely noisy for several reasons (e.g. sample volume discrepancies, timing and navigation mismatches, variability of Z(sub e)-R relationships), and therefore useless for evaluating the estimates. Several alternative methods, such as the analysis of the distribution of rain volume by rain rate as derived from gauge intensities and from reflectivities above the gauge network will be presented. Alternative procedures to increase the accuracy of the estimates and to reduce their uncertainties also will be discussed.

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies.

Science.gov (United States)

Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F

2016-06-01

Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Integrating design science theory and methods to improve the development and evaluation of health communication programs.

Science.gov (United States)

Neuhauser, Linda; Kreps, Gary L

2014-12-01

Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Developing the Metropolia Alumni Relations Program

OpenAIRE

Hardy, Tea

2015-01-01

The target of this Master's Thesis was to create a practical plan to further develop the alumni relations program at Helsinki Metropolia University of Applied Sciences. The plan will act as a guide for the program on how to reach and engage Metropolia's students and alumni in order to create a sustainable and active alumni relations program. Special attention was given to the international students and alumni, which is an understandable approach from the global perspective as many of the Metr...

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Recommended Resources for Planning to Evaluate Program Improvement Efforts (Including the SSIP)

Science.gov (United States)

National Center for Systemic Improvement at WestEd, 2015

2015-01-01

This document provides a list of recommended existing resources for state Part C and Part B 619 staff and technical assistance (TA) providers to utilize to support evaluation planning for program improvement efforts (including the State Systemic Improvement Plan, SSIP). There are many resources available related to evaluation and evaluation…

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Implementing and evaluating a program to facilitate chronic disease prevention and screening in primary care: a mixed methods program evaluation.

Science.gov (United States)

Manca, Donna Patricia; Aubrey-Bassler, Kris; Kandola, Kami; Aguilar, Carolina; Campbell-Scherer, Denise; Sopcak, Nicolette; O'Brien, Mary Ann; Meaney, Christopher; Faria, Vee; Baxter, Julia; Moineddin, Rahim; Salvalaggio, Ginetta; Green, Lee; Cave, Andrew; Grunfeld, Eva

2014-10-08

comprising the composite index include the following: process measures, referral/treatment measures, and target/change outcome measures related to cardiovascular disease, diabetes, cancer and associated lifestyle factors. The BETTER 2 program is a collaborative approach grounded in practice and built from existing work (i.e., integration not creation). The program evaluation is designed to provide an understanding of issues impacting the implementation of an effective approach for CDPS within primary care that may be adapted to become sustainable in the non-research setting.

An Evaluation Instrument for Object-Oriented Example Programs for Novices

DEFF Research Database (Denmark)

Christensen, Henrik Bærbak; Börstler, Jürgen; Nordström,, Marie

objectively and consistently requires some kind of measurement instrument. In this paper, we describe the development and initial validation of an evaluation instrument for example programs, based on three aspects of quality; technical quality, object-oriented quality, and didactical quality. Validation......Examples are important tools for programming education. In this paper, we investigate desirable properties of programming examples from a cognitive and a measurement point of view. We argue that some cognitive aspects of example programs are "caught" by common software measures......, but they are not sufficient to capture all important aspects of understandability. We propose a framework for measuring the understandability of example programs that also considers factors related to the usage context of examples. Research shows that examples play an important role for cognitive skill acquisition. Students...

Structural Aging Program to evaluate continued performance of safety-related concrete structures in nuclear power plants

International Nuclear Information System (INIS)

Naus, D.J.; Oland, C.B.; Ellingwood, B.R.

1994-01-01

This report discusses the Structural Aging (SAG) Program which is being conducted at the Oak Ridge National Laboratory (ORNL) for the United States Nuclear Regulatory commission (USNRC). The SAG Program is addressing the aging management of safety-related concrete structures in nuclear power plants for the purpose of providing improved technical bases for their continued service. The program is organized into three technical tasks: Materials Property Data Base, Structural Component Assessment/Repair Technologies, and Quantitative Methodology for continued Service Determinations. Objectives and a summary of recent accomplishments under each of these tasks are presented

Challenges and solutions in the evaluation of a low back pain disease management program.

Science.gov (United States)

Kotsos, Thomas; Muldowney, Kevin; Chapa, Griselda; Martin, J Eric; Linares, Antonio

2009-02-01

This paper examines a novel approach to evaluating a nurse-run telephonic low back pain (LBP) disease management (DM) program offered by a fully-insured commercial health plan population with approximately 150,000 members located in the northeastern United States. Members with at least 6 member months of eligibility were identified to have LBP using administrative claims and eligibility data. The LBP program relies on telephonic nurse management augmented by printed materials, adapting and advocating HEDIS imaging guidelines, and drug utilization review. Outcomes of this LBP DM program were assessed using a pre-post population-based approach as recommended in the DMAA Outcomes Guidelines Report. Baseline year and program year populations were segmented into 5 LBP clinical categories and each was weight adjusted using population size. LBP-related medical service utilization and pharmacy utilization also were evaluated. Individuals under active LBP management exhibited a decrease in LBP-related imaging and surgeries. Overall analgesic use also decreased. These data suggest the LBP DM program is associated with a decrease in imaging, surgeries, and analgesic use. The magnitude of the clinically segmented weight-adjusted return on investment (ROI) was lower than the unadjusted ROI, but was directionally positive indicating program impact. This adjustment is necessary in order to gain insight into and consistency of the results of a comprehensive LBP DM program evaluation.

Evaluation of a peer education program on student leaders' energy balance-related behaviors.

Science.gov (United States)

Foley, B C; Shrewsbury, V A; Hardy, L L; Flood, V M; Byth, K; Shah, S

2017-09-07

Few studies have reported energy balance-related behavior (EBRB) change for peer leaders delivering health promotion programs to younger students in secondary schools. Our study assessed the impact of the Students As LifeStyle Activists (SALSA) program on SALSA peer leaders' EBRBs, and their intentions regarding these behaviors. We used a pre-post study design to assess changes in EBRBs and intentions of Year 10 secondary school students (15-16 year olds) who volunteered to be peer leaders to deliver the SALSA program to Year 8 students (13-14 year olds). This research is part of a larger study conducted during 2014 and 2015 in 23 secondary schools in Sydney, Australia. We used an online questionnaire before and after program participation to assess Year 10 peer leaders' fruit and vegetable intake, daily breakfast eating, sugar sweetened beverage (SSB) intake, moderate-to-vigorous physical activity (MVPA) participation and school-day recreational screen time behaviors and intentions regarding these EBRBs. Generalized estimating equations with a robust variance structure and exchangeable correlation structure were used to estimate the individual-level summary statistics and their 95% CIs, adjusted for clustering. We further assessed the effect of covariates on EBRB changes. There were significant increases in the proportion of Year 10 peer leaders (n = 415) who reported eating ≥2 serves fruit/day fruit from 54 to 63% (P peer leaders recreational screen time differed by socio-economic status (P peer leaders' intentions, except MVPA which remained stable. The SALSA program had a positive impact on peer leaders' EBRBs, with gender and socio-economic status moderating some outcomes. ACTRN12617000712303 retrospectively registered.

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

Science.gov (United States)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

A Relational Algebra Query Language for Programming Relational Databases

Science.gov (United States)

McMaster, Kirby; Sambasivam, Samuel; Anderson, Nicole

2011-01-01

In this paper, we describe a Relational Algebra Query Language (RAQL) and Relational Algebra Query (RAQ) software product we have developed that allows database instructors to teach relational algebra through programming. Instead of defining query operations using mathematical notation (the approach commonly taken in database textbooks), students…

Good Cop, Better Cop: Evaluation of a Geriatrics Training Program for Police.

Science.gov (United States)

Brown, Rebecca T; Ahalt, Cyrus; Rivera, Josette; Stijacic Cenzer, Irena; Wilhelm, Angela; Williams, Brie A

2017-08-01

To develop, implement, and evaluate a training program in aging-related health for police officers. Cross-sectional. Crisis intervention training program for police officers in San Francisco. Police officers attending one of five 2-hour trainings (N = 143). A lecture on aging-related health conditions pertinent to police work followed by three experiential trainings on how it feels to be "old." Participants evaluated the quality of the training and the likelihood that they would apply new knowledge to their work and rated their knowledge using a retrospective pre-post evaluation. In open-ended responses, participants reported work-related changes they anticipated making in response to the training. All 143 participants completed the evaluation. Eighty-four percent reported interacting with older adults at least monthly; 45% reported daily interactions. Participants rated the training quality at 4.6/5 and the likelihood they would apply new knowledge to their work at 4.4/5. Retrospective pre-post knowledge scores increased for all domains, including how to identify aging-related health conditions that can affect safety during police interactions (2.9/5 to 4.2/5; P police officers' self-reported knowledge and skills. Clinicians have an important opportunity to help enhance safe and effective community policing for older adults. © 2017, Copyright the Authors Journal compilation © 2017, The American Geriatrics Society.

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

Riset sebagai Ujung Tombak Keberhasilan Program Public Relations

OpenAIRE

Ike Devi Sulistyaningtyas

2013-01-01

Abstract : Public Relations encompasses basically the management and communications function between organizations and public. The important thing of the public relations management is research, because Public Relations program is started from research and after all the programs done. It is also using research to find the output and outcome. The point is how to gain successful of Public Relations program depend on how to use research.

Riset Sebagai Ujung Tombak Keberhasilan Program Public Relations

OpenAIRE

Sulistyaningtyas, Ike Devi

2010-01-01

Public Relations encompasses basically the management and communications function between organizations and public. The important thing of the public relations management is research, because Public Relations program is started from research and after all the programs done. It is also using research to find the output and outcome. The point is how to gain successful of Public Relations program depend on how to use research.

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

Analyzing the Curricula of Doctor of Philosophy in Educational Technology-Related Programs in the United States

Science.gov (United States)

Almaden, Abdullah; Ku, Heng-Yu

2017-01-01

The purpose of this study was to analyze on-campus and online PhD programs in educational technology-related fields in the United States. In particular, it sought to evaluate the most common program titles; core, elective, and research courses based on program curricula. The research design was quantitative content analysis and data were collected…

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Implementation and evaluation of an incentivized Internet-mediated walking program for obese adults.

Science.gov (United States)

Zulman, Donna M; Damschroder, Laura J; Smith, Ryan G; Resnick, Paul J; Sen, Ananda; Krupka, Erin L; Richardson, Caroline R

2013-12-01

In response to rising health care costs associated with obesity rates, some health care insurers are adopting incentivized technology-enhanced wellness programs. The purpose of this study is to evaluate the large-scale implementation of an incentivized Internet-mediated walking program for obese adults and to examine program acceptance, adherence, and impact. A mixed-methods evaluation was conducted to investigate program implementation, acceptance, and adherence rates, and physical activity rates among program participants. Program implementation was shaped by national and state policies, data security concerns, and challenges related to incentivizing participation. Among 15,397 eligible individuals, 6,548 (43 %) elected to participate in the walking program, achieving an average of 6,523 steps/day (SD 2,610 steps). Participants who uploaded step counts for 75 % of days for a full year (n = 2,885) achieved an average of 7,500 steps (SD 3,093). Acceptance and participation rates in this incentivized Internet-mediated walking program suggest that such interventions hold promise for engaging obese adults in physical activity.

Readiness for Residency: A Survey to Evaluate Undergraduate Medical Education Programs.

Science.gov (United States)

Peterson, Linda N; Rusticus, Shayna A; Wilson, Derek A; Eva, Kevin W; Lovato, Chris Y

2015-11-01

Health professions programs continue to search for meaningful and efficient ways to evaluate the quality of education they provide and support ongoing program improvement. Despite flaws inherent in self-assessment, recent research suggests that aggregated self-assessments reliably rank aspects of competence attained during preclerkship MD training. Given the novelty of those observations, the purpose of this study was to test their generalizability by evaluating an MD program as a whole. The Readiness for Residency Survey (RfR) was developed and aligned with the published Readiness for Clerkship Survey (RfC), but focused on the competencies expected to be achieved at graduation. The RfC and RfR were administered electronically four months after the start of clerkship and six months after the start of residency, respectively. Generalizability and decision studies examined the extent to which specific competencies were achieved relative to one another. The reliability of scores assigned by a single resident was G = 0.32. However, a reliability of G = 0.80 could be obtained by averaging over as few as nine residents. Whereas highly rated competencies in the RfC resided within the CanMEDS domains of professional, communicator, and collaborator, five additional medical expert competencies emerged as strengths when the program was evaluated after completion by residents. Aggregated resident self-assessments obtained using the RfR reliably differentiate aspects of competence attained over four years of undergraduate training. The RfR and RfC together can be used as evaluation tools to identify areas of strength and weakness in an undergraduate medical education program.

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Positive Side Effects of a Job-Related Training Program for Older Adults in South Korea

Science.gov (United States)

Lee, Minhong; Choi, Jae-Sung

2012-01-01

The objective of the current study was to evaluate empirically positive side effects of a job-related training program on older adults' self-esteem, depression, and social networks. A total of 70 older adults participated in the study after completing the Older Paraprofessional Training Program developed and provided by the Continuing Education…

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

The energy-related inventions program: Continuing benefits to the inventor community

Energy Technology Data Exchange (ETDEWEB)

Braid, R.B. Jr.; Brown, M.A.; Wilson, C.R.; Franchuk, C.A.; Rizy, C.G.

1996-10-01

This report provides information on the economic, energy, and environmental impacts of inventions supported by the Energy-Related Inventions Program (ERIP) - a technology commercialization program jointly operated by the U.S. Department of Energy (DOE) and the National Institute of Standards and Technology (NIST). It describes the results of the latest in a series of ERIP evaluation projects that have been completed since 1980. The period of interest is 1980 through 1994. The evaluation is based on data collected in 1995 through mail and telephone surveys of 211 program participants, and historical data collected during previous evaluations for an additional 253 participants. As of September 1993, a total of 609 inventions had been recommended to DOE by NIST, which screens all submitted inventions for technical merit, potential for commercial success, and potential energy impact. By the end of 1994, at least 144 (or 24%) of these inventions had entered the market, generating total cumulative sales of $961 million (in 19944). It is estimated that in 1994 ERIP inventors earned royalties of $2.3 million, and over the lifetime of the program, royalties total $28.2 million. With $47.5 million in grants awarded from 1975 through 1994 and $124 million in program appropriations over the same period, ERIP has generated a 20:1 return in terms of sales values to grants, and an 8:1 return in sales versus program appropriations. Further, it is estimated that at least 757 job-years of employment were supported by ERIP technologies in 1994, and that this resulted in a return of approximately $3.4 million in individual income taxes to the U.S. Treasury. Finally, approximately $334 million of energy expenditures were saved in 1994 as a result of the commercial success of five ERIP projects. These energy savings resulted in reduced emissions of 2.1 million metric tons of carbon in 1994 alone.

Conception of programs for evaluating balance indices of operation of WWER-440 nuclear power plants

International Nuclear Information System (INIS)

Zadrazil, J.

1986-01-01

The procedures are discussed of writing computation programs for the evaluation of basic technical and economic parameters of the operation of WWER-440 nuclear power plants. The criterion of the evaluation is the maximum power supply to the grid together with the required supply of heat, with the observance of safe operating conditions. Previous procedures of evaluation are compared with present procedures based on the use of a monitoring and evaluation system of the KOMPLEX-URAN 2 M type. The mathematical model of the program is based on balance equations and relations derived for actual measuring systems and is completed with an assessment of the reliability of input and output data. The flow chart is shown of the algorithm for the evaluation of technical and economic parameters, and methods are suggested for improving and extending the program. (J.C.)

Tuberculosis control program in the municipal context: performance evaluation

Directory of Open Access Journals (Sweden)

Tiemi Arakawa

Full Text Available ABSTRACT OBJECTIVE The objective of this study is to evaluate the performance of the Tuberculosis Control Program in municipalities of the State of São Paulo. METHODS This is a program evaluation research, with ecological design, which uses three non-hierarchical groups of the municipalities of the State of São Paulo according to their performance in relation to operational indicators. We have selected 195 municipalities with at least five new cases of tuberculosis notified in the Notification System of the State of São Paulo and with 20,000 inhabitants or more in 2010. The multiple correspondence analysis was used to identify the association between the groups of different performances, the epidemiological and demographic characteristics, and the characteristics of the health systems of the municipalities. RESULTS The group with the worst performance showed the highest rates of abandonment (average [avg] = 10.4, standard deviation [sd] = 9.4 and the lowest rates of supervision of Directly Observed Treatment (avg = 6.1, sd = 12.9, and it was associated with low incidence of tuberculosis, high tuberculosis and HIV, small population, high coverage of the Family Health Strategy/Program of Community Health Agents, and being located on the countryside. The group with the best performance presented the highest cure rate (avg = 83.7, sd = 10.5 and the highest rate of cases in Directly Observed Treatment (avg = 83.0, sd = 12.7; the group of regular performance showed regular results for outcome (avg cure = 79.8, sd = 13.2; abandonment avg = 9.5, sd = 8.3 and supervision of the Directly Observed Treatment (avg = 42.8, sd = 18.8. Large population, low coverage of the Family Health Strategy/Program of Community Health Agents, high incidence of tuberculosis and AIDS, and being located on the coast and in metropolitan areas were associated with these groups. CONCLUSIONS The findings highlight the importance of the Directly Observed Treatment in relation

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

Physical protection evaluation methodology program development and application

International Nuclear Information System (INIS)

Seo, Janghoon; Yoo, Hosik

2015-01-01

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Physical protection evaluation methodology program development and application

Energy Technology Data Exchange (ETDEWEB)

Seo, Janghoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2015-10-15

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Limited economic evaluation to assess the effectiveness of a university-wide office ergonomics program.

Science.gov (United States)

Bidassie, Balmatee; McGlothlin, James D; Goh, Alina; Feyen, Robert G; Barany, James W

2010-05-01

The objective of this research was to evaluate the effectiveness and provide a limited economic evaluation of an office ergonomics program at a major university from 1995 to 2007. The relationship between office-related recordable injuries, reported lost time, severity of these injuries, and the Workers' Compensation (WC) paid was analyzed and the corresponding incident cost was calculated. Two major datasets analyzed were OSHA 200/300 logs (1991-2007) and WC claims paid (1999-2007). Since the beginning of the office ergonomics program in 1995 and through 2007 (13-year period), the number of office cumulative trauma disorder (CTD) cases decreased by 53%. Since the official start (in 1999) of a 50-50 cost share agreement for office equipment purchases between the university's Safety and Health Department (SHD) and the university departments evaluated, it was observed that the incident rate decreased by 63%, Total Days Away/restrict or Transfer (DART) rate decreased by 41%, Lost Time Case (LTC) rate decreased by 71% and office-related carpal tunnel syndrome decreased by almost 50%. The long-term goal of this research is to demonstrate the self-sustainability of an office ergonomics program by showing that equipment costs are eventually offset by a decrease in WC claims paid and lost time from office-related injuries and illnesses. While limited, this research helps in cost-justifying the implementation of future office ergonomics programs for large organizations. Copyright (c) 2009 Elsevier Ltd. All rights reserved.

Impact Evaluation of an Addiction Intervention Program in a Quebec Prison

Directory of Open Access Journals (Sweden)

Catherine Arseneault

2015-01-01

Full Text Available Objectives This study evaluates the effects of a prison-based addiction intervention program. The evaluation is based on a multidimensional data collection that draws a portrait of the respondents’ substance use, and of their psychological/emotional, social, and judicial spheres. It measures the changes, or lack thereof, in substance use; the psychological/emotional, social, and judicial spheres; as well as the post-treatment services used. Method A quasi-experimental repeated measures design (0, 6 weeks, and 6 months was used. Effects of the program were identified by comparing the results obtained by a group of inmates who had participated in the program ( n = 80; experimental group with those of another group who had received no intervention ( n = 70; control group. Results The preliminary results suggested a certain treatment effect related to impulsivity and psychological distress. Conclusion Although the preliminary results were promising, the experimental and control groups did not differ significantly when more robust analyses were used.

The Energy-Related Inventions Program: A decade of commercial progress

Energy Technology Data Exchange (ETDEWEB)

Brown, M.A.; Franchuk, C.A. (Oak Ridge National Lab., TN (United States)); Wilson, C.R. (Tennessee Univ., Knoxville, TN (United States))

1991-12-01

This report provides information on the recent commercial progress of inventions supported by the US Department of Energy's Energy-Related Inventions Programs (ERIP). It describes the results of the latest in a series of ERIP evaluation projects that have been completed since 1980. It focuses on the economic impacts of the program, notably sales and employment benefits. The period of interest is 1980 through 1990. The evaluation is based on data collected through mail and telephone surveying of 143 participants in the Program. As of October 1989, a total of 486 inventions were recommended to DOE by the National Institute for Standards and Technology, which screens all submitted inventions in terms of technical merit, potential for commercial success, and potential energy impact. By the end of 1990, at least 109 of these inventions had entered the market, generating total cumulative sales of more than $500 million. With $25.7 million in grants awarded from 1975 through 1990, and $63.1 million in program appropriations over the same period, ERIP has generated a 20:1 return in terms of sales values to grants, and an 8:1 return in sales versus program appropriations. It is estimated that 25% of all ERIP inventions had achieved sales by the end of 1990. While it is difficult to make exact comparisons between these percentages and other indicators of the success rates of technological innovations as a whole, the ERIP figures remain impressive. The commercial progress of spin-off technologies is also documented.

The Energy-Related Inventions Program: A decade of commercial progress

Energy Technology Data Exchange (ETDEWEB)

Brown, M.A.; Franchuk, C.A. [Oak Ridge National Lab., TN (United States); Wilson, C.R. [Tennessee Univ., Knoxville, TN (United States)

1991-12-01

This report provides information on the recent commercial progress of inventions supported by the US Department of Energy`s Energy-Related Inventions Programs (ERIP). It describes the results of the latest in a series of ERIP evaluation projects that have been completed since 1980. It focuses on the economic impacts of the program, notably sales and employment benefits. The period of interest is 1980 through 1990. The evaluation is based on data collected through mail and telephone surveying of 143 participants in the Program. As of October 1989, a total of 486 inventions were recommended to DOE by the National Institute for Standards and Technology, which screens all submitted inventions in terms of technical merit, potential for commercial success, and potential energy impact. By the end of 1990, at least 109 of these inventions had entered the market, generating total cumulative sales of more than $500 million. With $25.7 million in grants awarded from 1975 through 1990, and $63.1 million in program appropriations over the same period, ERIP has generated a 20:1 return in terms of sales values to grants, and an 8:1 return in sales versus program appropriations. It is estimated that 25% of all ERIP inventions had achieved sales by the end of 1990. While it is difficult to make exact comparisons between these percentages and other indicators of the success rates of technological innovations as a whole, the ERIP figures remain impressive. The commercial progress of spin-off technologies is also documented.

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review.

Science.gov (United States)

Nicoll, Pam; MacRury, Sandra; van Woerden, Hugo C; Smyth, Keith

2018-04-11

Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

25 CFR 170.804 - How is BIA's Road Maintenance Program related to the IRR Program?

Science.gov (United States)

2010-04-01

... 25 Indians 1 2010-04-01 2010-04-01 false How is BIA's Road Maintenance Program related to the IRR... WATER INDIAN RESERVATION ROADS PROGRAM BIA Road Maintenance § 170.804 How is BIA's Road Maintenance Program related to the IRR Program? The following chart illustrates how BIA's Road Maintenance Program is...

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Implementation and evaluation of a training program as part of the Cooperative Biological Engagement Program in Azerbaijan

Directory of Open Access Journals (Sweden)

April eJohnson

2015-10-01

Full Text Available A training program for animal and human health professionals has been implemented in Azerbaijan through a joint agreement between the United States Defense Threat Reduction Agency and the Government of Azerbaijan. The training program is administered as part of the Cooperative Biological Engagement Program, and targets key employees in Azerbaijan’s disease surveillance system including physicians, veterinarians, epidemiologists, and laboratory personnel. Training is aimed at improving detection, diagnosis, and response to especially dangerous pathogens, although the techniques and methodologies can be applied to other pathogens and diseases of concern. Biosafety and biosecurity training is provided to all trainees within the program. Prior to 2014, a variety of international agencies and organizations provided training, which resulted in gaps related to lack of coordination of training materials and content. In 2014 a new training program was implemented in order to address those gaps. This paper provides an overview of the Cooperative Biological Engagement Program training program in Azerbaijan, a description of how the program fits into existing national training infrastructure, and an evaluation of the new program’s effectiveness to date. Long-term sustainability of the program is also discussed.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Outline for an Online Public Relations Program

Science.gov (United States)

Schmidt, Janet

1978-01-01

Proven public relations strategies for winning management support for information programs and services are discussed, including seeking a higher level of visibility for the library/information center, implementing a current awareness program, and starting an orientation program for new employees. A questionnaire for obtaining user feedback and…

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Evaluation of a program to enhance young drivers' safety in Israel.

Science.gov (United States)

Toledo, Tomer; Lotan, Tsippy; Taubman-Ben-Ari, Orit; Grimberg, Einat

2012-03-01

Young drivers in Israel, as in other parts of the world, are involved in car crashes more than any other age group. The graduated driver licensing system in Israel requires that all new drivers be accompanied by an experienced driver whenever they drive for the first 3 months after obtaining a driving license. In an effort to make the accompanied driving phase more effective, a novel program which targets both young drivers and their parents was initiated in 2005. The program administers a personal meeting with the young driver and the accompanying parent scheduled for the beginning of the accompanied driving phase. In this meeting guidance is given regarding best practices for undertaking the accompanied driving, as well as tips for dealing with in-vehicle parent-teen dynamics. Through 2008, almost 130,000 families of young drivers have participated in the program. In order to evaluate the effectiveness of the program, injury crash records of the young drivers who participated in the program were compared with those of all other young drivers that were licensed at the same time period. The results obtained indicate statistically significant lower crash records for young drivers that participated in the program. Limitations of the evaluation related to self-selection biases are discussed, and practical implications are suggested. Copyright © 2011 Elsevier Ltd. All rights reserved.

Evaluation of the content and accessibility of microsurgery fellowship program websites.

Science.gov (United States)

Silvestre, Jason; Vargas, Christina R; Ho, Olivia; Lee, Bernard T

2015-10-01

Microsurgery fellowship applicants utilize Internet-based resources such as the San Francisco Match (SF Match) to manage their applications. In deciding where to apply, applicants rely on advice from mentors and online resources including microsurgery fellowship websites (MFWs). The purpose of this study was to evaluate the content and accessibility of MFWs. While microsurgery is practiced by many surgical specialties, this study focused on MFWs for programs available in the 2014 Microsurgery Fellowship Match. Program lists from the American Society for Reconstructive Microsurgery (ASRM) and the San Francisco Match (SF Match) were analyzed for the accessibility of MFW links. MFWs were evaluated for education and recruitment content, and MFW comprehensiveness was compared on the basis of program characteristics using chi square tests. Of the 25 fellowships available, only 18 had websites (72%). SF Match and ASRM listed similar programs (96% overlap) and provided website links (89%, 76%), but only a minority connected directly to the MFW (38%, 23%). A minority of programs were responsive via email inquiry (36%). MFWs maintained minimal education and recruitment content. MFW comprehensiveness was not associated with program characteristics. MFWs are often not readily accessible and contain limited information for fellowship applicants. Given the relative low-cost of website development, MFWs may be improved to facilitate fellow recruitment. © 2015 Wiley Periodicals, Inc.

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.

2000-01-01

The action program Energy 2000 has been continually reviewed by independent experts in view of its effects. This resulted in around 50 scientific studies between 1991 and 1999, dealing with different aspects of the program. In the book 'Energy 2000: effects of the program and conclusions from its evaluation', the results of these evaluations are summarised, and conclusions for the design of the follow-up program are drawn. The organisational frame of the program is presented and the question answered whether the determining principles of the program proved practical. Besides, the effects of state intervention, of the conflict solving groups and the voluntary actions of Energy 2000 are appraised. A separate chapter is dedicated to the evaluation strategy of the program, its implementation and the benefits of the evaluations. Propositions for the evaluation of the follow-up program are formulated as well. Dr. Andreas Balthasar is President of the Swiss Evaluation Society. (author)

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

The Relation of Source Credibility and Message Frequency to Program Evaluation and Self-Confidence of Students in a Job Shadowing Program

Science.gov (United States)

Linnehan, Frank

2004-01-01

Using a pre- and post-test design, this study examined the relation of an adult's credibility and message frequency to the beliefs of female high school students participating in a job-shadowing program. Hypotheses were based on the Elaboration Likelihood Model of attitude formation and change. Findings indicate that credibility of the adult…

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

Evaluation of Outcomes Associated with a Leisure-time Activity Program for Disadvantaged Youth

Directory of Open Access Journals (Sweden)

Juanita Bester

2016-01-01

Full Text Available The SLEAK (Skills, Learning and Educational Activities for Kids program was established in 2008 as a joint partnership between a community leader and the Division of Occupational Therapy Stellenbosch University. The vision of the SLEAK program is to create a sustainable, non-profit, leisure-time activity program for the youth (10-13 years of age of the community in order to curb drug and gangster-related activities and to foster healthy work-related skills in the youth to make them responsible and productive members of their community. The SLEAK program was evaluated in its entirety and this article will focus on the results for the outcomes set for the children in the SLEAK program. The results indicated that although it is still a rather small project, it seems as if the project is effective in what it set out to achieve and that it could serve as a pilot for starting projects in similar communities.

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

Science.gov (United States)

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Evaluation of utility residential energy conservation programs: A Pacific Northwest example

Energy Technology Data Exchange (ETDEWEB)

Hirst, E; Bronfman, B; Goeltz, R; Keating, K; Lerman, D; Timble, J

1984-03-01

This paper describes a detailed quantitative evaluation of the Residential Weatherization Pilot Program, operated by the Bonneville Power Administration from 1980 through 1982. The program provided free energy audits to more than 6000 electrically-heated homes and gave zero-interest loans to weatherize almost 4000 of these audited homes. The total cost of the program was almost $8 million. Using actual electricity consumption records for program participants and nonparticipants, we calculated the energy-saving effect of the pilot program in several ways and always reached the same conclusion. Households that received an audit and weatherization loan reduced their annual electricity consumption by about 3500 kWh relative to what they would have done without the program; this 3500 kWh is the saving that can be directly attributed to the program. Using a simple net present worth approach, the authors computed program benefits and costs for participating households, the BPA power system, and the Pacific Northwest region as a whole. Under a wide range of assumptions concerning discount rate, years until the weatherization loan is repaid, program energy saving, and BPA's marginal cost of power, the program is economically attractive from all three perspectives.

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

Process evaluation of a Toolbox-training program for construction foremen in Denmark

DEFF Research Database (Denmark)

Jeschke, Katharina Christiane; Kines, Pete; Rasmussen, Liselotte

2017-01-01

foremen’s knowledge and communication skills in daily planning of work tasks and their related OSH risks on construction sites. The program builds on the popular 'toolbox meeting' concept, however there is very little research evaluating these types of meetings. This article describes the development...... and revised until the final version after the fifth group. The evaluation utilized an action research strategy with a mixed–methods approach of triangulating questionnaire, interview, and observation data. Process evaluation results showed that the eight Toolbox-training topics were relevant and useful...

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Aspect-oriented programming evaluated

CERN Document Server

Kleinschmager, Sebastian

2012-01-01

Hauptbeschreibung Aspect-oriented-programming is a relatively new technique that has evolved on top of the already well-established approach of object-oriented programming. When it is used correctly, it promises to remove many redundant parts of a code that appear repeatedly in an application, essentially untangling the original code. Thus, it can lead to a cleaner, more separated software design, to greater modularity and maintainability. Time-savings in software engineering can also be huge cost-savings, and anything that increases software quality is a welcome sight in an industr

Evaluation of a peer education program on student leaders’ energy balance-related behaviors

Directory of Open Access Journals (Sweden)

B. C. Foley

2017-09-01

Full Text Available Abstract Background Few studies have reported energy balance-related behavior (EBRB change for peer leaders delivering health promotion programs to younger students in secondary schools. Our study assessed the impact of the Students As LifeStyle Activists (SALSA program on SALSA peer leaders’ EBRBs, and their intentions regarding these behaviors. Methods We used a pre–post study design to assess changes in EBRBs and intentions of Year 10 secondary school students (15–16 year olds who volunteered to be peer leaders to deliver the SALSA program to Year 8 students (13–14 year olds. This research is part of a larger study conducted during 2014 and 2015 in 23 secondary schools in Sydney, Australia. We used an online questionnaire before and after program participation to assess Year 10 peer leaders’ fruit and vegetable intake, daily breakfast eating, sugar sweetened beverage (SSB intake, moderate-to-vigorous physical activity (MVPA participation and school-day recreational screen time behaviors and intentions regarding these EBRBs. Generalized estimating equations with a robust variance structure and exchangeable correlation structure were used to estimate the individual-level summary statistics and their 95% CIs, adjusted for clustering. We further assessed the effect of covariates on EBRB changes. Results There were significant increases in the proportion of Year 10 peer leaders (n = 415 who reported eating ≥2 serves fruit/day fruit from 54 to 63% (P < 0.01; eating ≥5 serves vegetables/day from 8 to 12% (P < 0.01; and drinking <1 cup/day of SSBs from 56 to 62% (P < 0.01. Change in ≥60 min MVPA participation/day depended on gender (P < 0.01: Boys increased 14% while girls decreased −2%. Changes in eating breakfast daily also depended on gender (P < 0.004: Boys increased 13% while girls decreased −0.4%. The change in peer leaders recreational screen time differed by socio-economic status (P < 0.05: above average

Energy Extension Service Pilot Program: evaluation report after two years. Volume I. Evaluation summary

Energy Technology Data Exchange (ETDEWEB)

None

1980-04-01

The EES pilot program was initiated in August 1977, when 10 states were selected on a competitive basis for participation. The pilot states (Alabama, Connecticut, Michigan, New Mexico, Pennsylvania, Tennessee, Texas, Washington, Wisconsin, and Wyoming) devoted the first 6 months to start-up activities. This document is a follow-up report to the three volume Evaluation Summary of the first year of the pilot EES program published in September 1979. The purpose of this report is to provide an overview of the impacts and costs of the two years of the pilot program, and to check the consistency of findings over the two year period. The analysis addresses the following: (1) were the impact findings of Year I and Year II consistent, or did Year I and Year II attitudes and behavior vary. If variation existed, could it be attributed to program changes as the EES progressed from a start-up phase (Year I) to more normal service delivery (Year II); and (2) did costs of service delivery change (again reflecting start-up and normal service delivery costs). Did cost changes affect conclusions about the relative cost effectiveness of delivering services to different target audiences.

Evaluating the Navy’s Enlisted Accessions Testing Program Based on Future Talent Needs

Science.gov (United States)

2017-03-01

NAVY’S ENLISTED ACCESSIONS TESTING PROGRAM BASED ON FUTURE TALENT NEEDS by Shereka F. Riley March 2017 Thesis Advisor: Joseph Sullivan Co...REPORT TYPE AND DATES COVERED Master’s thesis 4. TITLE AND SUBTITLE EVALUATING THE NAVY’S ENLISTED ACCESSIONS TESTING PROGRAM BASED ON FUTURE TALENT ...public release. Distribution is unlimited. 12b. DISTRIBUTION CODE 13. ABSTRACT (maximum 200 words) In recent years, non-defense related industries

Recurrence after surgery due to cervical cancer - An evaluation of the follow-up program

DEFF Research Database (Denmark)

Fuglsang, Katrine; Petersen, Lone Kjeld; Blaakær, Jan

Objective During the last 20 years the follow-up program after surgical treatment for cervical cancer has remained unchanged. Surprisingly, little is communicated in relation to the follow-up program even though it has a huge impact on the life of the women and their relatives for five years....... The focus for this study is to evaluate the follow-up program in fulfilling the purpose for early diagnosis of recurrence while reminding and concerning women, who we consider healthy after surgery, 10 times during five years. Already politicians are focusing on the subject due to the socioeconomic...... consequences, but there is a need for a foundation prior to an adjustment of the follow-up program. Methods Design: retrospective study of a cohort of women attending follow-up program after surgery due to cervical cancer. Material: From the patient register at the Department of Gynaecology and Obstetrics...

Process Evaluation for a Prison-based Substance Abuse Program.

Science.gov (United States)

Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

2000-01-01

Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

The integrated performance evaluation program quality assurance guidance in support of EM environmental sampling and analysis activities

International Nuclear Information System (INIS)

1994-05-01

EM's (DOE's Environmental Restoration and Waste Management) Integrated Performance Evaluation Program (IPEP) has the purpose of integrating information from existing PE programs with expanded QA activities to develop information about the quality of radiological, mixed waste, and hazardous environmental sample analyses provided by all laboratories supporting EM programs. The guidance addresses the goals of identifying specific PE sample programs and contacts, identifying specific requirements for participation in DOE's internal and external (regulatory) programs, identifying key issues relating to application and interpretation of PE materials for EM headquarters and field office managers, and providing technical guidance covering PE materials for site-specific activities. (PE) Performance Evaluation materials or samples are necessary for the quality assurance/control programs covering environmental data collection

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

Girls Just Wanna Have Fun: a process evaluation of a female youth-driven physical activity-based life skills program.

Science.gov (United States)

Bean, Corliss N; Forneris, Tanya; Halsall, Tanya

2014-01-01

Integrating a positive youth development framework into physical activity programming has become popular as it is believed that this integration can create the development of both physical and psychosocial skills. However, there has been a lack of intervention fidelity research within the field of positive youth development. The Girls Just Wanna Have Fun program was designed in response to increased calls for physical activity programs for female youth and is a theoretically-grounded physical activity-based life skills program that aims to empower female youth. The purpose of this paper was to provide a detailed description of the program and a process evaluation of the first year of program implementation. From interviews with youth and leaders, as well as documentation from the leaders' weekly online log of each implemented session, themes emerged regarding the successes. Findings from this study indicated that program goals were attained and it appears that the program was implemented, for the most part, as designed. The themes related to successes included using activities to facilitate relational time, providing intentional opportunities for leadership, having communicative program leaders who supported one another, and engaging youth in different types of physical activity. The themes related to challenges included difficulties with facility and transportation, some activities being too much like schoolwork, and social distractions and cliques. Included in the paper is a discussion of practical implications and recommendations for community programmers, as well as future directions for the program. Overall, this process evaluation represents an important step in responding to calls for increased evaluation in community-based programs and aids in understanding the process in which positive youth development programs can be effectively implemented.

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

Effectiveness of a Multilevel Workplace Health Promotion Program on Vitality, Health, and Work-Related Outcomes

NARCIS (Netherlands)

Hendriksen, I.J.M.; Snoijer, M.; Kok, B.P. de; Vlisteren, J. van; Hofstetter, H.

2016-01-01

Objective: Evaluation of the effectiveness of a workplace health promotion program on employees’ vitality, health, and work-related outcomes, and exploring the influence of organizational support and the supervisors’ role on these outcomes. Methods: The 5-month intervention included activities at

Using student satisfaction data to evaluate a new online accelerated nursing education program.

Science.gov (United States)

Gazza, Elizabeth A; Matthias, April

2016-10-01

As increasing numbers of students enroll in online education, institutions of higher education are responsible for delivering quality online courses and programs. Agencies that accredit institutions and programs require evidence of program quality, including student satisfaction. A large state university in the Southeastern United States transitioned an online nursing education degree completion, or Registered Nurse-to-Bachelor of Science in Nursing, program to an online accelerated format in order to meet the needs of working nurses and ultimately, increase the number of nurses prepared at the baccalaureate level. This article describes a descriptive, cross-sectional study that evaluated the effectiveness of the new online accelerated program using the quality indicator of student satisfaction. Ninety-one (32%) of the 284 students who were enrolled or had been enrolled in a course within the online accelerated degree completion program between fall 2013 session 1 and summer 2014 session participated in the study. The electronic Noel-Levitz Priorities Survey for Online Learners™ was used to measure student satisfaction with the program and associated services. Results provided insight into the students' satisfaction with the new program format and served as the basis for an interdepartmental program enhancement plan aimed at maintaining and enhancing student satisfaction and overall program quality. Findings indicated that measuring and evaluating student satisfaction can provide valuable information about the effectiveness of an online program. Recommendations for using the measurement tool in online program planning and studying student satisfaction in relation to retention and program completion were identified. Copyright © 2016 Elsevier Ltd. All rights reserved.

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

Science.gov (United States)

Maher, Charles A.

1981-01-01

Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

Manipulator system man-machine interface evaluation program. [technology assessment

Science.gov (United States)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Clemson University Science Master's Program in Sustainable and Resilient Infrastructure: A program evaluation

Science.gov (United States)

O'Sell, Elizabeth Eberhart

The Clemson University Science Master's Program (SMP) in Sustainable and Resilient Infrastructure is a program which aims to link engineering, materials, construction, environment, architecture, business, and public policy to produce graduates with unique holistic perspective and expertise to immediately contribute to the workforce in the area of sustainable and resilient infrastructure. A program evaluation of the SMP has been performed to study the effectiveness of the SMP and identify areas where the goals and vision of the SMP are achieved and areas where improvements can be made. This was completed by analysis of trends within survey responses, review of Master's thesis reports, and review of courses taken. It was found that the SMP has facilitated new interdisciplinary research collaborations of faculty in different concentration areas within the Glenn Department of Civil Engineering, as well as collaboration with faculty in other departments. It is recommended that a course which provides instruction in all eight competency areas be required for all SMP students to provide a comprehensive overview and ensure all students are exposed to concepts of all competency areas. While all stakeholders are satisfied with the program and believe it has been successful thus far, efforts do need to be made as the program moves forward to address and improve some items that have been mentioned as needing improvement. The concerns about concentration courses, internship planning, and advising should be addressed. This evaluation provides benefits to prospective students, current SMP participants, and outside program supporters. The goal of this evaluation is to provide support that the SMP is an effective and worthwhile program for participating students, while attempting to identify any necessary program improvements and provide recommendations for achieving these improvements. This goal has been accomplished.

Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emeral Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2007-03-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others.

Relevance Evaluation of Engineering Master's Program in Peru

OpenAIRE

Miñán, Erick; Lavalle, Carlos; Díaz-Puente, José M.

2012-01-01

In a context of mass higher education, it is necessary to ensure not only quality but also the relevance of engineering master's programs, namely the appropriateness of the objectives and outcomes to the needs and interests of the program beneficiaries. After a literature review we analyzed the evaluation models of three organizations in Peru: the Board of Evaluation, Accreditation and Certification of the University Education Quality CONEAU, the Institute of Quality and Accreditation of Comp...

Challenges to Evaluating Physical Activity Programs in American Indian/Alaska Native Communities

Science.gov (United States)

Roberts, Erica Blue; Butler, James; Green, Kerry M.

2018-01-01

Despite the importance of evaluation to successful programming, a lack of physical activity program (PAP) evaluation for American Indian/Alaska Native (AI/AN) programs exists, which is significant given the high rates of obesity and diabetes in this population. While evaluation barriers have been identified broadly among AI/AN programs, challenges…

Evaluation of a liaison librarian program: client and liaison perspectives.

Science.gov (United States)

Tennant, Michele R; Cataldo, Tara Tobin; Sherwill-Navarro, Pamela; Jesano, Rae

2006-10-01

This paper describes a survey-based evaluation of the five-year old Liaison Librarian Program at the University of Florida. Liaison librarians, faculty, students, staff, residents, and post-doctoral associates were queried via Web-based surveys. Questions addressed client and liaison perspectives on a variety of issues, including program and service awareness and usage, client-library relations and communication, client support for the program, and liaison workload. Approximately 43% of the 323 client respondents were aware of liaison services; 72% (n = 163) of these clients had had contact with their liaison. Ninety-five percent (n = 101) of faculty and students who reported contact with their liaison supported the continuation of the program. Liaison services were used by a greater percentage of faculty than students, although they had similar patterns of usage and reported the same "traditional" services to be most important. Liaisons indicated that communications with clients had increased, the reputation of the library was enhanced, and their workloads had increased as a result of the Liaison Librarian Program. Survey results suggest that the Liaison Librarian Program has a core set of clients who use and highly value the services provided by liaisons. Recommendations addressing workload, training, marketing, and administrative support are provided.

Oak Ridge National Laboratory Embrittlement Data Base (EDB) and Dosimetry Evaluation (DE) program

International Nuclear Information System (INIS)

Pace, J.V. III; Remec, I.; Wang, J.A.; White, J.E.

1996-01-01

The objective of this program is to develop, maintain, and upgrade computerized data bases, calculational procedures, and standards relating to reactor pressure vessel fluence spectra determinations and embrittlement assessments. As part of this program, the information from radiation embrittlement research on nuclear reactor pressure vessel steels and from power reactor surveillance reports is maintained in a data base published on a periodic basis. The Embrittlement Data Base (EDB) effort consists of verifying the quality of the EDB, providing user-friendly software to access and process the data, and exploring and assessing embrittlement prediction models. The Dosimetry Evaluation effort consists of maintaining and upgrading validated neutron and gamma radiation transport procedures, maintaining cross-section libraries with the latest evaluated nuclear data, and maintaining and updating validated dosimetry procedures and data bases. The information available from this program provides data for assisting the Office of Nuclear Reactor Regulation, with support from the Office of Nuclear Regulatory Research, to effectively monitor current procedures and data bases used by vendors, utilities, and service laboratories in the pressure vessel irradiation surveillance program

Evaluating the impacts of the clean cities program.

Science.gov (United States)

Qiu, Shiyong; Kaza, Nikhil

2017-02-01

The Department of Energy's Clean Cities program was created in 1993 to reduce petroleum usage in the transportation sector. The program promotes alternative fuels such as biofuels and fuel-saving strategies such as idle reduction and fleet management through coalitions of local government, non-profit, and private actors. Few studies have evaluated the impact of the program because of its complexity that include interrelated strategies of grants, education and training and diversity of participants. This paper uses a Difference-in-Differences (DiD) approach to evaluate the effectiveness of the program between 1990 and 2010. We quantify the effectiveness of the Clean Cities program by focusing on performance measures such as air quality, number of alternative fueling stations, private vehicle occupancy and transit ridership. We find that counties that participate in the program perform better on all these measures compared to counties that did not participate. Compared to the control group, counties in the Clean Cities program experienced a reduction in days with bad air quality (3.7%), a decrease in automobile commuters (2.9%), an overall increase in transit commuters (2.1%) and had greater numbers of new alternative fueling stations (12.9). The results suggest that the program is a qualified success. Copyright © 2016 Elsevier B.V. All rights reserved.

An Evaluation of State Energy Program Accomplishments: 2002 Program Year

Energy Technology Data Exchange (ETDEWEB)

Schweitzer, M.

2005-07-13

The U.S. Department of Energy's (DOE's) State Energy Program (SEP) was established in 1996 by merging the State Energy Conservation Program (SECP) and the Institutional Conservation Program (ICP), both of which had been in existence since 1976 (U.S. DOE 2001a). The SEP provides financial and technical assistance for a wide variety of energy efficiency and renewable energy activities undertaken by the states and territories. SEP provides money to each state and territory according to a formula that accounts for population and energy use. In addition to these ''Formula Grants'', SEP ''Special Project'' funds are made available on a competitive basis to carry out specific types of energy efficiency and renewable energy activities (U.S. DOE 2003c). The resources provided by DOE typically are augmented by money and in-kind assistance from a number of sources, including other federal agencies, state and local governments, and the private sector. The states SEP efforts include several mandatory activities, such as establishing lighting efficiency standards for public buildings, promoting car and vanpools and public transportation, and establishing policies for energy-efficient government procurement practices. The states and territories also engage in a broad range of optional activities, including holding workshops and training sessions on a variety of topics related to energy efficiency and renewable energy, providing energy audits and building retrofit services, offering technical assistance, supporting loan and grant programs, and encouraging the adoption of alternative energy technologies. The scope and variety of activities undertaken by the various states and territories is extremely broad, and this reflects the diversity of conditions and needs found across the country and the efforts of participating states and territories to respond to them. The purpose of this report is to present estimates of the energy and

Munch and Move: evaluation of a preschool healthy eating and movement skill program

Directory of Open Access Journals (Sweden)

Farrell Louise

2010-11-01

Full Text Available Abstract Background Early childhood services have been identified as a key setting for promoting healthy eating and physical activity as a means of preventing overweight and obesity. However, there is limited evidence on effective nutrition and physical activity programs in this setting. The purpose of this study was to evaluate Munch and Move, a low-intensity, state-wide, professional development program designed to support early childhood professionals to promote healthy eating and physical activity among children in their care. Methods The evaluation involved 15 intervention and 14 control preschools (n = 430; mean age 4.4 years in Sydney, New South Wales, Australia and was based on a randomised-control design with pre and post evaluation of children's lunchbox contents, fundamental movement skills (FMS, preschool policies and practices and staff attitudes, knowledge and confidence related to physical activity, healthy eating and recreational screen time. Results At follow up, FMS scores for locomotor, object control and total FMS score significantly improved by 3.4, 2.1 and 5.5 points more (respectively in the intervention group compared with the control group (P Conclusion The findings suggest that a low intensity preschool healthy weight intervention program can improve certain weight related behaviours. The findings also suggest that change to food policies are difficult to initiate mid-year and potentially a longer implementation period may be required to determine the efficacy of food policies to influence the contents of preschoolers lunchboxes.

Quasi-Experimental Evaluation of a Student Mentoring Program

OpenAIRE

Sandner, Malte

2013-01-01

This paper presents evidence from a natural-experiment which evaluates the effectiveness of a student mentoring program. The mentoring includes several compulsory, scheduled, faceto- face appointments between a mentor and a student in the first study year. All mentors are graduated and employed by the institution. For the evaluation, I use the fact that the mentoring is only offered to students in an economics and management program, whereas it is not offered to students in an industrial engi...

Independent auto evaluation of an operative radiological protection program

International Nuclear Information System (INIS)

Medrano L, M.A.; Rodriguez C, C.C.; Linares R, D.; Zarate M, N.; Zempoalteca B, R.

2006-01-01

The program of operative radiological protection of a nuclear power plant consists of multiple procedures and associate tasks that have as purpose the radiological protection of the workers of the power station. It is for this reason that the constant evaluation of the one it programs it is an important tool in the identification of their weaknesses (and strengths), so they can be assisted appropriately. In this work the main elements of the program of independent auto evaluation of the program of operative radiological protection of the Laguna Verde Central that has been developed and implemented by the National Institute of Nuclear Research are described. (Author)

An Evaluation of Sisters of Nia: A Cultural Program for African American Girls

Science.gov (United States)

Belgrave, Faye Z.; Reed, Melba C.; Plybon, Laura E.; Butler, Deborah S.; Allison, Kevin W.; Davis, Trina

2004-01-01

In this study, the authors evaluated the effectiveness of a cultural intervention for increasing cultural values and beliefs. Fifty-nine African American girls in early adolescence participated in a 15-session cultural program or in an activity comparison group. Measures of ethnic identity, gender roles, and relational aggression were administered…

Taiwan Teacher Preparation Program Evaluation: Some Critical Perspectives

Science.gov (United States)

Liu, Tze-Chang

2015-01-01

This paper focuses on the influences and changes of recent Taiwan teacher preparation program evaluation (TTPPE) as one of the national evaluation projects conducted by the Higher Education Evaluation and Accreditation Council of Taiwan. The main concerns are what kind of ideology is transformed through the policy by means of evaluation, and what…

Evolution of a multilevel framework for health program evaluation.

Science.gov (United States)

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Compulsory Project-Level Involvement and the Use of Program-Level Evaluations: Evaluating the Local Systemic Change for Teacher Enhancement Program

Science.gov (United States)

Johnson, Kelli; Weiss, Iris R.

2011-01-01

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Multi-criteria group decision making for evaluating the performance of e-waste recycling programs under uncertainty.

Science.gov (United States)

Wibowo, Santoso; Deng, Hepu

2015-06-01

This paper presents a multi-criteria group decision making approach for effectively evaluating the performance of e-waste recycling programs under uncertainty in an organization. Intuitionistic fuzzy numbers are used for adequately representing the subjective and imprecise assessments of the decision makers in evaluating the relative importance of evaluation criteria and the performance of individual e-waste recycling programs with respect to individual criteria in a given situation. An interactive fuzzy multi-criteria decision making algorithm is developed for facilitating consensus building in a group decision making environment to ensure that all the interest of individual decision makers have been appropriately considered in evaluating alternative e-waste recycling programs with respect to their corporate sustainability performance. The developed algorithm is then incorporated into a multi-criteria decision support system for making the overall performance evaluation process effectively and simple to use. Such a multi-criteria decision making system adequately provides organizations with a proactive mechanism for incorporating the concept of corporate sustainability into their regular planning decisions and business practices. An example is presented for demonstrating the applicability of the proposed approach in evaluating the performance of e-waste recycling programs in organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

The US Department of Energy Personnel Dosimetry Evaluation and Upgrade Program

International Nuclear Information System (INIS)

Faust, L.G.; Stroud, C.M.; Swinth, K.L.; Vallario, E.J.

1987-11-01

The US Department of Energy (DOE) Personnel Dosimetry Evaluation and Upgrade Program is designed to identify and evaluate dosimetry deficiencies and to conduct innovative research and development programs that will improve overall capabilities, thus ensuring that DOE can comply with applicable standards and regulations for dose measurement. To achieve these goals, two programs were initiated to evaluate and upgrade beta measurement and neutron dosimetry. 3 refs

Child Development Program Evaluation Scale.

Science.gov (United States)

Fiene, Richard J.

The Child Development Program Evaluation Scale (CDPES) is actually two scales in one, a licensing scale and a quality scale. Licensing predictor items have been found to predict overall compliance of child day care centers with state regulations in four states. Quality scale items have been found to predict the overall quality of child day care…

Objective Evaluation in an Online Geographic Information System Certificate Program

OpenAIRE

Scott L. WALKER

2005-01-01

Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program....

Nondestructive Evaluation Program: Progress in 1986

International Nuclear Information System (INIS)

1987-07-01

The increasing cost of equipment for power generating plants and the potential increases in productivity and safety available through rapidly developing Nondestructive Evaluation (NDE) technology led EPRI to initiate a Nondestructive Evaluation Program in 1974. To date, the major focus has been on light water reactor inspection problems; however, increased application to other systems is now under way. This report presents a comprehensive review of the EPRI effort in the NDE area. Most of the report consists of contractor-supplied progress reports on each current project. An organizational plan of the program is presented in overview. In addition, organization from several viewpoints is presented, e.g., in-service inspection operators, R and D personnel, and utility representatives. The report summarizes significant progress made since the previous EPRI Special Report NP-4315-SR was issued in May 1986. Section 1 contains information about the program organization, and the sections that follow contain contractor-supplied progress reports of each current project. The progress reports are grouped by plant components - pipe, pressure vessel, steam generator and boiler tubes, and turbine. In addition, Part 6 is devoted to discussions of technology transfer

Evaluating the impact of implementation factors on family-based prevention programming: methods for strengthening causal inference.

Science.gov (United States)

Crowley, D Max; Coffman, Donna L; Feinberg, Mark E; Greenberg, Mark T; Spoth, Richard L

2014-04-01

Despite growing recognition of the important role implementation plays in successful prevention efforts, relatively little work has sought to demonstrate a causal relationship between implementation factors and participant outcomes. In turn, failure to explore the implementation-to-outcome link limits our understanding of the mechanisms essential to successful programming. This gap is partially due to the inability of current methodological procedures within prevention science to account for the multitude of confounders responsible for variation in implementation factors (i.e., selection bias). The current paper illustrates how propensity and marginal structural models can be used to improve causal inferences involving implementation factors not easily randomized (e.g., participant attendance). We first present analytic steps for simultaneously evaluating the impact of multiple implementation factors on prevention program outcome. Then, we demonstrate this approach for evaluating the impact of enrollment and attendance in a family program, over and above the impact of a school-based program, within PROSPER, a large-scale real-world prevention trial. Findings illustrate the capacity of this approach to successfully account for confounders that influence enrollment and attendance, thereby more accurately representing true causal relations. For instance, after accounting for selection bias, we observed a 5% reduction in the prevalence of 11th grade underage drinking for those who chose to receive a family program and school program compared to those who received only the school program. Further, we detected a 7% reduction in underage drinking for those with high attendance in the family program.

Evaluation of the RATU2 and RETU research programs

International Nuclear Information System (INIS)

Faidy, C.; Hayns, M.R.

1998-05-01

The report is an evaluation of the Finnish RATU2 (Structural Integrity of Nuclear Power Plants) and RETU (Reactor Safety) programs. The first generation of nuclear safety research programs were started in 1988-1990. Mid-term reviews were carried out and published in 1992. Many of the recommendations from those reviews have been implemented and they are referred to in this evaluation report

24 CFR 266.115 - Program monitoring and evaluation.

Science.gov (United States)

2010-04-01

... AUTHORITIES HOUSING FINANCE AGENCY RISK-SHARING PROGRAM FOR INSURED AFFORDABLE MULTIFAMILY PROJECT LOANS Housing Finance Agency Requirements § 266.115 Program monitoring and evaluation. (a) HFA certifications... under this part, basic underwriting and closing information must be submitted in a format specified by...

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

Science.gov (United States)

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper

Kentucky Preschool Evaluation Project: Differential Effects, Program Characteristics and Child Outcomes, and Longitudinal and Cumulative Findings. Reports 1-4, 1998-1999.

Science.gov (United States)

Hemmeter, Mary Louise; Townley, Kim; Wilson, Stephen; Epstein, Ann; Hines, Huyi

This document is comprised of four reports related to the evaluation of the Kentucky Preschool Program (KPP), serving 4-year-olds who qualify for the free lunch program and 3- and 4-year-olds with disabilities. Report 1 focuses on the differential effects of the preschool program related to race and to gender. Three key findings are reported: (1)…

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

A randomized, controlled intervention of machine guarding and related safety programs in small metal-fabrication businesses.

Science.gov (United States)

Parker, David L; Brosseau, Lisa M; Samant, Yogindra; Xi, Min; Pan, Wei; Haugan, David

2009-01-01

Metal fabrication employs an estimated 3.1 million workers in the United States. The absence of machine guarding and related programs such as lockout/tagout may result in serious injury or death. The purpose of this study was to improve machine-related safety in small metal-fabrication businesses. We used a randomized trial with two groups: management only and management-employee. We evaluated businesses for the adequacy of machine guarding (machine scorecard) and related safety programs (safety audit). We provided all businesses with a report outlining deficiencies and prioritizing their remediation. In addition, the management-employee group received four one-hour interactive training sessions from a peer educator. We evaluated 40 metal-fabrication businesses at baseline and 37 (93%) one year later. Of the three nonparticipants, two had gone out of business. More than 40% of devices required for adequate guarding were missing or inadequate, and 35% of required safety programs and practices were absent at baseline. Both measures improved significantly during the course of the intervention. No significant differences in changes occurred between the two intervention groups. Machine-guarding practices and programs improved by up to 13% and safety audit scores by up to 23%. Businesses that added safety committees or those that started with the lowest baseline measures showed the greatest improvements. Simple and easy-to-use assessment tools allowed businesses to significantly improve their safety practices, and safety committees facilitated this process.

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity.

Science.gov (United States)

Mihalic, Sharon F; Fagan, Abigail A; Argamaso, Susanne

2008-01-18

Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured. This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST) drug prevention program with fidelity. Regression analysis was used to examine factors influencing four dimensions of fidelity: adherence, dosage, quality of delivery, and student responsiveness. Although most sites faced common barriers, such as finding room in the school schedule for the program, gaining full support from key participants (i.e., site coordinators, principals, and LST teachers), ensuring teacher participation in training workshops, and classroom management difficulties, most schools involved in the project implemented LST with very high levels of fidelity. Across sites, 86% of program objectives and activities required in the three-year curriculum were delivered to students. Moreover, teachers were observed using all four recommended teaching practices, and 71% of instructors taught all the required LST lessons. Multivariate analyses found that highly rated LST program characteristics and better student behavior were significantly related to a greater proportion of material taught by teachers (adherence). Instructors who rated the LST program characteristics as ideal were more likely to teach all lessons (dosage). Student behavior and use of interactive teaching techniques (quality of delivery) were positively related. No variables were related to student participation (student responsiveness). Although difficult, high implementation fidelity by community-based organizations can be achieved. This study suggests some important factors that organizations should consider to ensure fidelity, such as

Implementing the LifeSkills Training drug prevention program: factors related to implementation fidelity

Directory of Open Access Journals (Sweden)

Fagan Abigail A

2008-01-01

Full Text Available Abstract Background Widespread replication of effective prevention programs is unlikely to affect the incidence of adolescent delinquency, violent crime, and substance use until the quality of implementation of these programs by community-based organizations can be assured. Methods This paper presents the results of a process evaluation employing qualitative and quantitative methods to assess the extent to which 432 schools in 105 sites implemented the LifeSkills Training (LST drug prevention program with fidelity. Regression analysis was used to examine factors influencing four dimensions of fidelity: adherence, dosage, quality of delivery, and student responsiveness. Results Although most sites faced common barriers, such as finding room in the school schedule for the program, gaining full support from key participants (i.e., site coordinators, principals, and LST teachers, ensuring teacher participation in training workshops, and classroom management difficulties, most schools involved in the project implemented LST with very high levels of fidelity. Across sites, 86% of program objectives and activities required in the three-year curriculum were delivered to students. Moreover, teachers were observed using all four recommended teaching practices, and 71% of instructors taught all the required LST lessons. Multivariate analyses found that highly rated LST program characteristics and better student behavior were significantly related to a greater proportion of material taught by teachers (adherence. Instructors who rated the LST program characteristics as ideal were more likely to teach all lessons (dosage. Student behavior and use of interactive teaching techniques (quality of delivery were positively related. No variables were related to student participation (student responsiveness. Conclusion Although difficult, high implementation fidelity by community-based organizations can be achieved. This study suggests some important factors that

Using GIS to evaluate a fire safety program in North Carolina.

Science.gov (United States)

Dudley, Thomas; Creppage, Kathleen; Shanahan, Meghan; Proescholdbell, Scott

2013-10-01

Evaluating program impact is a critical aspect of public health. Utilizing Geographic Information Systems (GIS) is a novel way to evaluate programs which try to reduce residential fire injuries and deaths. The purpose of this study is to demonstrate the application of GIS within the evaluation of a smoke alarm installation program in North Carolina. This approach incorporates national fire incident data which, when linked with program data, provides a clear depiction of the 10 years impact of the Get Alarmed, NC! program and estimates the number of potential lives saved. We overlapped Get Alarmed, NC! program installation data with national information on fires using GIS to identify homes that experienced a fire after an alarm was installed and calculated potential lives saved based on program documentation and average housing occupancy. We found that using GIS was an efficient and quick way to match addresses from two distinct sources. From this approach we estimated that between 221 and 384 residents were potentially saved due to alarms installed in their homes by Get Alarmed, NC!. Compared with other program evaluations that require intensive and costly participant telephone surveys and/or in-person interviews, the GIS approach is inexpensive, quick, and can easily analyze large disparate datasets. In addition, it can be used to help target the areas most at risk from the onset. These benefits suggest that by incorporating previously unutilized data, the GIS approach has the potential for broader applications within public health program evaluation.

Basalt Waste Isolation Project Technical Program Evaluation Process: a criteria-based method

International Nuclear Information System (INIS)

Babad, H.; Evans, G.C.; Wolfe, B.A.

1982-01-01

The need to objectively evaluate the progress being made by the Basalt Waste Isolation Project (BWIP) toward establishing the feasibility of siting a nuclear waste repository in basalt (NWRB) mandates a process for evaluating the technical work of the project. To assist BWIP management in the evaluation process, the Systems Department staff has developed a BWIP Technical Program Evaluation Process (TPEP). The basic process relates progress on project technical work to the SWIP Functional and System Performance Criteria as defined in National Waste Terminal Storage (MWTS) Criteria Documents. The benefits of the TPEP to BWIP and future plans for TPEP are discussed. During fiscal year (FY) 1982, TPEP wll be further formalized and further applied to the review of BWIP technical activities

Evaluation of Pre-Departure English Training Program

Directory of Open Access Journals (Sweden)

Ali Saukah

2016-02-01

Full Text Available The program evaluation reported in this article covers three batches of participants, from 1996 through 1997, sponsored by the Directorate General of Higher Education projects to prepare faculty members of teacher training institutions for overseas studies. The result outcomes could be achieved when the initial English competence requirred for participating in the program was at least at the Pre-Advanced level. The criterion validity of the TOEFL-Equivalent test developed by the program was assured, and the test could, therefore, be used as a good predictor of the International TOEFL. Other recommendations are also given for the improvement of the planning and implementation of the program in the future

Curriculum Evaluation and Employers Opinions: the case study of Educational Technology Program in Bachelor Degree (Continuing Program

Directory of Open Access Journals (Sweden)

Nakhon Lalognam

2016-09-01

Full Text Available The purposes of this research were: 1 to evaluate the Educational Technology Program (Continuing Program in Bachelor Degree curriculum which is revised in 2007 by applying CIPP model for evaluation. 2 to study the opinions of the employers about the ideal characteristics and actual characteristics of graduates. 3 to study the opinions for the requirements of the Educational Technology Program in Bachelor Degree (Continuing Program and knowledge implementation in work of graduates. 4 to make the suggestions and guidelines to improve the Educational Technology Program in Bachelor Degree (Continuing Program to achieve potentiality and responsive for the requirements of learners and employers. The sample of this research were 310 persons ; consisted of graduates in the Educational Technology Program in Bachelor Degree (Continuing Program in academic year 2006 - 2010, the committee of the Educational Technology Program in Bachelor Degree (Continuing Program , instructors and employers by using Multi-stage Random Sampling and Simple Random Sampling. The instruments of this research were the 5 levels rating scale questionnaire and the structured interview type. They consisted of 3 sets: 1 for graduates, 2 for the committee of the Educational Technology Program in Bachelor Degree (Continuing Program and 3 for instructors and employers. The research found that: 1. The results of evaluation on the Educational Technology Program in Bachelor Degree (Continuing Program which is revised in 2007 were: 1.1 The opinions of graduates to curriculum in all of aspects were average at the uncertain level which the context aspect was at the high level, input aspect was at the uncertain level, process aspect was at the uncertain level and product aspect was at the high level. 1.2 The opinions of the curriculum committee and instructors to curriculum in all of aspects were average at the high level which the context aspect was at the high level, input aspect was at the

38 CFR 1.15 - Standards for program evaluation.

Science.gov (United States)

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... intent, contain a method to measure fulfillment of the objectives, ascertain the degree to which goals... the data. (f) Each program evaluation requires a systematic research design to collect the data...

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

Science.gov (United States)

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

Science.gov (United States)

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Computer programs for TRIGA calibration, burnup evaluation, and bookkeeping

International Nuclear Information System (INIS)

Nelson, George W.

1978-01-01

Several computer programs have been developed at the University of Arizona to assist the direction and operation of the TRIGA Reactor Laboratory. The programs fall into the following three categories: 1. Programs for calculation of burnup of each fuel element in the reactor core, for maintaining an inventory of fuel element location and fissile content at any time, and for evaluation of the reactivity effects of burnup or proposed fuel element rearrangement in the core. 2. Programs for evaluation, function fitting, and tabulation of control rod measurements. 3. Bookkeeping programs to summarize and tabulate reactor runs and irradiations according to time, energy release, purpose, responsible party, etc. These summarized data are reported in an annual operating report for the facility. The use of these programs has saved innumerable hours of repetitious work, assuring more accurate, objective results, and requiring a minimum of effort to repeat calculations when input data are modified. The programs are written in FORTRAN-IV, and have been used on a CDC-6400 computer. (author)

Experiential Education and Empowerment Evaluation: Mars Rover Educational Program Case Example.

Science.gov (United States)

Fetterman, David; Bowman, Cassie

2002-01-01

Empowerment evaluation helps people improve their programs using self-evaluation. Empowerment evaluation has three steps: establishing a mission; taking stock of the most significant activities; and planning for the future by establishing goals, strategies, and criteria for evidence. A NASA experiential program for small, distributed groups of…

Qualification program of the ASTRID SFR project: definition, methodology and associated risk evaluation and management - 15093

International Nuclear Information System (INIS)

Rodriguez, G.; Dirat, J.F.; Traina, A.; Christofari, M.

2015-01-01

The Preconceptual Design phase of the ASTRID French Sodium Fast Reactor project had the objective to integrate innovative options to meet the requirements of the 4. generation reactors and to comply with the related specifications. It was followed by the conceptual phase studies (AVP2 phase 2013-2015) where some technical options are left opened with an advanced option and a backup alternative. In the same time of the AVP2 phase studies, the qualification program related to ASTRID project was initiated. It consists in collecting the exhaustive list of research/development (R/D) needs and technological demonstration tests to be fulfilled on representative mockup prior to component implementation in the prototype. The ASTRID Qualification Program (AQP) objectives are to collect needs expressed by all engineering companies involved in ASTRID, and then to organize the answer to this expression of needs. This significant work of needs compilation has been divided in several tasks, according to the ASTRID project decomposition in the Product Breakdown Structure (PBS). Compilation of needs was jointly performed by engineering company, R/D responsible and coordinated by the ASTRID Qualification project responsible. It was associated with an evaluation of the maturity level of the technical options thanks to a Technological Readiness Level grid (TRL ranking table), an identification of major risks, and an evaluation of the R/D potentiality and associated facility platform. The methodology applied for the ASTRID Qualification Program (AQP) is presented. It is explained what methodology was used associated to the TRL process, and how is managed the associated risk analysis evaluation: evaluation of major risks, definition of a risk portfolio and a corresponding Action Plan for risk reduction (synthesized under the REM acronym: Risk Evaluation and Management). This methodology is a mean used to facilitate ASTRID risk-informed decision making, technology qualification and

Evaluating a Psychology Graduate Student Peer Mentoring Program

Science.gov (United States)

Fleck, Christina; Mullins, Morell E.

2012-01-01

Research on mentoring outcomes and characteristics of various types of mentoring programs in different settings is limited. The present study sampled 39 graduate students at a small Midwestern university to evaluate peer mentoring in a graduate school setting. Mentoring function and outcome relationships as well as program characteristics were…

Evaluating the effectiveness of a logger safety training program.

Science.gov (United States)

Bell, Jennifer L; Grushecky, Shawn T

2006-01-01

Logger safety training programs are rarely, if ever, evaluated as to their effectiveness in reducing injuries. Workers' compensation claim rates were used to evaluate the effectiveness of a logger safety training program, the West Virginia Loggers' Safety Initiative (LSI). There was no claim rate decline detected in the majority (67%) of companies that participated in all 4 years of the LSI. Furthermore, their rate did not differ from the rest of the WV logging industry that did not participate in the LSI. Worker turnover was significantly related to claim rates; companies with higher turnover of employees had higher claim rates. Companies using feller bunchers to harvest trees at least part of the time had a significantly lower claim rate than companies not using them. Companies that had more inspections per year had lower claim rates. High injury rates persist even in companies that receive safety training; high employee turnover may affect the efficacy of training programs. The logging industry should be encouraged to facilitate the mechanization of logging tasks, to address barriers to employee retention, and to increase the number of in-the-field performance monitoring inspections. Impact on industry There are many states whose logger safety programs include only about 4-8 hours of safe work practices training. These states may look to West Virginia's expanded training program (the LSI) as a model for their own programs. However, the LSI training may not be reaching loggers due to the delay in administering training to new employees and high levels of employee turnover. Regardless of training status, loggers' claim rates decline significantly the longer they work for a company. It may be that high injury rates in the state of West Virginia would be best addressed by finding ways to encourage and facilitate companies to become more mechanized in their harvesting practices, and to increase employee tenure. Increasing the number of yearly performance inspections

New trends in the evaluation and implementation of the safety-related operating experience associated with NRC-licensed reactors

International Nuclear Information System (INIS)

Michelson, C.; Heltemes, C.J.

1981-01-01

This article is an overview of the Nuclear Regulatory Commission program for the evaluation and dissemination of the safety-related operating experience associated with all NRC-licensed reactors. It discusses the historical background and past problems that led to the recent formation of NRC's Office for Analysis and Evaluation of Operational Data (AEOD) and details its activities, organization, staffing, and proposed analysis and evaluation methodology. The programs of industry organizations and nuclear plant licensees and the integration of foreign operating experience are included in the overview. The problems and limitations of the Licensee Event Report (LER) program and the Nuclear Plant Reliability Data system program are discussed. The AEOD analysis and evaluation methodology program includes some new improvements in the assessment of safety-related operating experience. Of particular note is the sequence coding and search procedure being developed by AEOD under a contract with the Nuclear Safety Information Center at the Oak Ridge National Laboratory. This computer-based retrieval system will have markedly improved search strategy capability for such items as commoncause failures or complex system interactions involving various failure sequences and other relationships associated with an event. The system retrieves failure data and information on the principal LER occurrence and on related component and system responses. The computer-generated Power Reactor Watch List enables AEOD to monitor all critical or unusual situations warranting close attention because of potential public health and safety. This listing is supported by a preestablished computer search strategy of the historical data base permitting identification of all past events and statistical information that are applicable to the situation being watched

Strategies and policies for improving energy efficiency programs: Closing the loop between evaluation and implementation

International Nuclear Information System (INIS)

Vine, Edward

2008-01-01

Program implementers often use evaluation results to improve the performance of their programs, but, as described in this paper, this is not always the case. Based on a review of the literature, participation in workshops, and interviews with over 50 program implementers, evaluators, and regulators in the United States and Canada, the utilization of evaluation results is investigated by asking the following questions: (1) How are program evaluation results used by program implementers and other stakeholders? (2) How are program evaluation results communicated to program implementers and other stakeholders? (3) Are the needs of program implementers being met by program evaluation? (4) What is the role of the utility regulator in facilitating the use of program evaluation results? (5) What other mechanisms can facilitate the use of program evaluation results? While there is some consensus on the answers to these questions, the type of interest in and use of evaluation varies by functional role (e.g., evaluator versus implementer), maturity of the energy efficiency market, institutional context (e.g., evaluation and implementation conducted inside the same organization, or evaluation and implementation conducted by separate entities), and by regulatory demands and evaluation interests

The management of evaluating the European programs and policies implemented in Romania

Directory of Open Access Journals (Sweden)

Doctoral student ROMAN MIHAELA

2011-12-01

Full Text Available Starting with the reform and modernization of the public administration in Romania in the mid 1990s, an important element of this process being the development of the management process, respectively of planning and managing public policies, the Romanian government started also a process of developing the capacity for evaluating public programs and policies, both the ones with European or foreign financing and the ones with domestic financing. Up-to-date analyses and studies have showed, however, that at the level of the national public sector there is a major discrepancy between the progress made in the evaluation of European programs or the ones with foreign financing and the programs financed from public funds, namely that there is a consolidated evaluation practice as regards the first types of programs, which is virtually inexistent as regards programs financed from the public budget.This paper intends to identify the progress made at the level of the Romanian public administration as regards the management of evaluating programs with European financing, to see the characteristics of building the evaluation capacity within the national system of these programs and the motivation stimulating such approaches. The first part of this paper shall contain a presentation of the background of the current evaluation system, including both the legislative framework and the institutional framework with duties of management and evaluation of European programs; further, I shall analyze the evolution of this system in order to be able to draw conclusions regarding the evaluation capacity of Romania.

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

Science.gov (United States)

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Evaluation of a Hospital-Based Pneumonia Nurse Navigator Program.

Science.gov (United States)

Seldon, Lisa E; McDonough, Kelly; Turner, Barbara; Simmons, Leigh Ann

2016-12-01

The aim of this study is to evaluate the effectiveness of a hospital-based pneumonia nurse navigator program. This study used a retrospective, formative evaluation. Data of patients admitted from January 2012 through December 2014 to a large community hospital with a primary or secondary diagnosis of pneumonia, excluding aspiration pneumonia, were used. Data included patient demographics, diagnoses, insurance coverage, core measures, average length of stay (ALOS), disposition, readmission rate, financial outcomes, and patient barriers to care were collected. Descriptive statistics and parametric testing were used to analyze data. Core measure performance was sustained at the 90th percentile 2 years after the implementation of the navigator program. The ALOS did not decrease to established benchmarks; however, the SD for ALOS decreased by nearly half after implementation of the navigator program, suggesting the program decreased the number and length of extended stays. Charges per case decreased by 21% from 2012 to 2014. Variable costs decreased by 4% over a 2-year period, which increased net profit per case by 5%. Average readmission payments increased by 8% from 2012 to 2014, and the net revenue per case increased by 8.3%. The pneumonia nurse navigator program may improve core measures, reduce ALOS, and increase net revenue. Future evaluations are necessary to substantiate these findings and optimize the cost and quality performance of navigator programs.

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

Science.gov (United States)

Ewell, Bob

1998-01-01

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs

Evaluation of a class wide teaching program for developing preschool life skills.

Science.gov (United States)

Hanley, Gregory P; Heal, Nicole A; Tiger, Jeffrey H; Ingvarsson, Einar T

2007-01-01

Recently, nonmaternal center-based child care has been linked to problem behavior in young children (National Institute of Child Health and Human Development, 2003). In response, a comprehensive program to promote prosocial skills was evaluated in a classroom of 16 children between the ages of 3 and 5 years. Classroom observations were conducted during evocative situations to determine the likelihood of problem behavior (noncompliance, vocal or motor disruptions, aggression) and preschool life skills. A classwide teaching program was then implemented in a staggered manner across instruction following, functional communication, delay tolerance, and friendship skills. These four categories of preschool life skills, which included two to four related skills, were selected for classwide teaching because they were either identified by educators as important for early school success, have often been taught following functional assessments of more severe problem behavior, or both. Skills were taught on a classwide basis during typically scheduled activities (circle, free play, transitions, meals) via instructions, modeling, role play, and feedback. A multiple probe design showed that the program resulted in an 74% reduction in problem behavior and a more than four-fold increase in preschool life skills. Similar beneficial effects of the program were evident in questionnaire data gathered prior to and at the close of the evaluation. Finally, the teachers who implemented the program reported overall high levels of satisfaction with the classwide teaching program, the target skills, and the results. Implications for the design of early childhood experiences for preempting the development of serious problem behavior are discussed.

Evaluating a food bank recipe-tasting program.

Science.gov (United States)

Keller-Olaman, Susan J; Edwards, Vicki; Elliott, Susan J

2005-01-01

Food banks mitigate immediate food insecurity, but their ability to promote healthy nutrition is constrained by how often recipients may visit and the range of foods available. In a descriptive study, a formative evaluation was completed of a combined heart-healthy recipe-tasting and education program that aims to promote healthy eating knowledge and skills in a group of food bank recipients in Hamilton, Ontario. Fifty-five adults were surveyed about food bank attendance, program awareness, perceived enhancement of knowledge and skills, and suggestions for program improvement. Most participants (73%) were positive about the program, and 91% wanted the program to continue. In addition, 78% would prepare the recipes sampled. In contrast, program awareness and planning food bank visits to coincide with the program were generally low. Food banks are potential sites for effective nutrition promotion programs. To reach more recipients, more frequent implementation and seeking the use of a designated room are suggested for the current program. The findings also suggest that the sampling approach to promoting healthy eating to food bank recipients deserves further study. For example, monitoring the selection of featured recipe ingredients would be a useful indicator of behaviour.

Evaluation Methodologies for Estimating the Likelihood of Program Implementation Failure

Science.gov (United States)

Durand, Roger; Decker, Phillip J.; Kirkman, Dorothy M.

2014-01-01

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

Secondary Education Programs in Kuwait: An Evaluation Study

Science.gov (United States)

Eid, Ghada K.; Koushki, Parviz A.

2005-01-01

This paper evaluates the effectiveness of the semester and the credit programs of high school education in Kuwait in terms of their graduating students' preparedness for continued and successful academic performance in programs of higher education. Students' percentile graduation rank from high school and their performances in the English, math…

Using Program Theory-Driven Evaluation Science to Crack the Da Vinci Code

Science.gov (United States)

Donaldson, Stewart I.

2005-01-01

Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

Systematic evaluation program, status summary report

International Nuclear Information System (INIS)

1983-01-01

Status reports are presented on the systematic evaluation program for the Big Rock Point reactor, Dresden-1 reactor, Dresden-2 reactor, Ginna-1 reactor, Connecticut Yankee reactor, LACBWR reactor, Millstone-1 reactor, Oyster Creek-1 reactor, Palisades-1 reactor, San Onofre-1 reactor, and Rowe Yankee reactor

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

Field manual for ground water reconnaissance. Savannah River Laboratory National Uranium Resource Evaluation Program

International Nuclear Information System (INIS)

Ferguson, R.B.; Price, V.; Baucom, E.I.

1977-01-01

A manual is presented that is intended to direct and coordinate field operations, site selection, groundwater sample collection, and information codes for the Savannah River Laboratory (SRL) contribution to the National Uranium Resource Evaluation (NURE) program. The manual provides public relations information for field sampling teams as well as technical direction

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

Evaluating Program about Performance of Circular Sodium Heat Pipe

International Nuclear Information System (INIS)

Kwak, Jae Sik; Kim, Hee Reyoung

2014-01-01

The superior heat transfer capability, structural simplicity, relatively inexpensive, insensitivity to the gravitational field, silence and reliability are some of its outstanding features. We study about heat transfer equation of heat pipe and program predicting performance which is considering geometrical shape of heat pipe by the related heat transfer equation of heat pipe. The operating temperature is 450 .deg. C - 950 .deg. C, working fluid is sodium, material for container is stainless steel, and type of wick is sintered metal. As a result of evaluating program about performance of circular sodium heat pipe based on MATLAB code, express correlation between radius and LHR, correlation between heat transfer length and LHR, correlation between wick and LHR, correlation between operating temperature and LHR. Generally radius values of heat pipe are proportional to LHR because of increase of mass flow which is main factor of heat flow. Heat transfer length values of heat pipe are inversely proportional to LHR and slightly inversely proportional to heat rate. Pore size is proportional to LHR. Although increase of pore size decrease capillary pressure, decrease more pressure drop in liquid phase. As a result, mass flow and heat rate are increase. But we have to do additional consideration about pore size and voidage in the aspect of safety and production technique

Evaluating Program about Performance of Circular Sodium Heat Pipe

Energy Technology Data Exchange (ETDEWEB)

Kwak, Jae Sik; Kim, Hee Reyoung [Ulsan National Institute of Science and Technology, Ulsan (Korea, Republic of)

2014-10-15

The superior heat transfer capability, structural simplicity, relatively inexpensive, insensitivity to the gravitational field, silence and reliability are some of its outstanding features. We study about heat transfer equation of heat pipe and program predicting performance which is considering geometrical shape of heat pipe by the related heat transfer equation of heat pipe. The operating temperature is 450 .deg. C - 950 .deg. C, working fluid is sodium, material for container is stainless steel, and type of wick is sintered metal. As a result of evaluating program about performance of circular sodium heat pipe based on MATLAB code, express correlation between radius and LHR, correlation between heat transfer length and LHR, correlation between wick and LHR, correlation between operating temperature and LHR. Generally radius values of heat pipe are proportional to LHR because of increase of mass flow which is main factor of heat flow. Heat transfer length values of heat pipe are inversely proportional to LHR and slightly inversely proportional to heat rate. Pore size is proportional to LHR. Although increase of pore size decrease capillary pressure, decrease more pressure drop in liquid phase. As a result, mass flow and heat rate are increase. But we have to do additional consideration about pore size and voidage in the aspect of safety and production technique.

Defence Health Service Mentoring Program Evaluation 2001

National Research Council Canada - National Science Library

Highfield, Jane

2002-01-01

...). DHS commissioned the Directorate of Strategic Personnel Planning and Research (DSPPR) to evaluate a recent Mentoring Program trial in order to assess the effectiveness and organizational value of Mentoring within DHS...

National Uranium Resource Evaluation Program: the Hydrogeochemical Stream Sediment Reconnaissance Program at LLNL

International Nuclear Information System (INIS)

Higgins, G.H.

1980-08-01

From early 1975 to mid 1979, Lawrence Livermore National Laboratory (LLNL) participated in the Hydrogeochemical Stream Sediment Reconnaissance (HSSR), part of the National Uranium Resource Evaluation (NURE) program sponsored by the Department of Energy (DOE). The Laboratory was initially responsible for collecting, analyzing, and evaluating sediment and water samples from approximately 200,000 sites in seven western states. Eventually, however, the NURE program redefined its sampling priorities, objectives, schedules, and budgets, with the increasingly obvious result that LLNL objectives and methodologies were not compatible with those of the NURE program office, and the LLNL geochemical studies were not relevant to the program goal. The LLNL portion of the HSSR program was consequently terminated, and all work was suspended by June 1979. Of the 38,000 sites sampled, 30,000 were analyzed by instrumental neutron activation analyses (INAA), delayed neutron counting (DNC), optical emission spectroscopy (OES), and automated chloride-sulfate analyses (SC). Data from about 13,000 sites have been formally reported. From each site, analyses were published of about 30 of the 60 elements observed. Uranium mineralization has been identified at several places which were previously not recognized as potential uranium source areas, and a number of other geochemical anomalies were discovered

Effectiveness of computer ergonomics interventions for an engineering company: a program evaluation.

Science.gov (United States)

Goodman, Glenn; Landis, James; George, Christina; McGuire, Sheila; Shorter, Crystal; Sieminski, Michelle; Wilson, Tamika

2005-01-01

Ergonomic principles at the computer workstation may reduce the occurrence of work related injuries commonly associated with intensive computer use. A program implemented in 2001 by an occupational therapist and a physical therapist utilized these preventative measures with education about ergonomics, individualized evaluations of computer workstations, and recommendations for ergonomic and environmental changes. This study examined program outcomes and perceived effectiveness based on review of documents, interviews, and surveys of the employees and the plant manager. The program was deemed successful as shown by 59% of all therapist recommendations and 74% of ergonomic recommendations being implemented by the company, with an 85% satisfaction rate for the ergonomic interventions and an overall employee satisfaction rate of 70%. Eighty-one percent of the physical problems reported by employees were resolved to their satisfaction one year later. Successful implementation of ergonomics programs depend upon effective communication and education of the consumers, and the support, cooperation and collaboration of management and employees.

Strengthening community leadership: evaluation findings from the california healthy cities and communities program.

Science.gov (United States)

Kegler, Michelle C; Norton, Barbara L; Aronson, Robert E

2008-04-01

Collaborative approaches to community health improvement such as healthy cities and communities have the potential to strengthen community capacity through leadership development. The healthy cities and communities process orients existing local leadership to new community problem-solving strategies and draws out leadership abilities among residents not previously engaged in civic life. In an evaluation of the California Healthy Cities and Communities (CHCC) Program, leadership development was one of several outcomes assessed at the civic-participation level of the social ecology. Data collection methods included focus groups and surveys, semistructured interviews with coordinators and community leaders, and review of program documents. Findings suggest that the CHCC program enhanced capacity by expanding new leadership opportunities through coalition participation, program implementation, and civic leadership roles related to spin-off organizations and broader collaborative structures. Communities in rural regions were particularly successful in achieving significant leadership outcomes.

Development of a program for evaluating the temperature of SMART-P fuel rod

Energy Technology Data Exchange (ETDEWEB)

Cheon, Jin Sik; Lee, Byung Ho; Koo, Yang Hyun; Oh, Je Yong; Yim, Jeong Sik; Sohn, Dong Seong

2003-11-01

A code for evaluating the temperature of SMART-P fuel rod has been developed. Finite Element (FE) method is adopted for the developed code sharing the user subroutines which has been prepared for the ABAQUS commercial FE code. The developed program for SMART-P fuel rod corresponds to a nonlinear transient heat transfer problem, and uses a sparse matrix solver for FE equations during iterations at every time step. The verifications of the developed program were conducted using the ABAQUS code. Steady state and transient problems were analyzed for 1/8 rod model due to the symmetry of the fuel rod and full model. From the evaluation of temperature for the 1/8 rod model at steady state, maximal error of 0.18 % was present relative to the ABAQUS result. Analysis for the transient problem using the fuel rod model resulted in the same as the variation of centerline temperature from the ABAQUS code during a hypothetical power transient. Also, given a power depression in fuel meat as a function of burnup, its effect on the centerline temperature was more precisely evaluated by the developed program compared to the ABAQUS code. The distribution of heat flux for the entire cross section and surface was almost identical for the two codes.

Evaluating disease management program effectiveness: an introduction to time-series analysis.

Science.gov (United States)

Linden, Ariel; Adams, John L; Roberts, Nancy

2003-01-01

Currently, the most widely used method in the disease management (DM) industry for evaluating program effectiveness is referred to as the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer a plausible rationale explaining the change from baseline. Furthermore, with the current inclination of DM programs to use financial indicators rather than program-specific utilization indicators as the principal measure of program success, additional biases are introduced that may cloud evaluation results. This paper presents a non-technical introduction to time-series analysis (using disease-specific utilization measures) as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

Accomplishments: AE characterization program for remote flaw evaluation

International Nuclear Information System (INIS)

Hutton, P.H.; Schwenk, E.B.; Kurtz, R.J.

1978-01-01

The purpose of the program is to develop an experimental/analytical evaluation of the feasibility of detecting and analyzing flaw growth in reactor pressure boundaries by means of continuously monitoring acoustic emission (AE). The investigation is devoted exclusively to ASTM Type A533, Grade B, Class 1 material. The basic approach to interpretive model development is through laboratory testing of 1 to 1 1 / 2 inch (25.4 to 38 mm) thick fracture mechanics specimens in both fatigue and fracture at both room temperature and 550 0 F (288 0 C). Seven parameters are measured for each AE signal and related to fracture mechanics functions. AE data from fracture testing of 6 inch (152 mm) wall pressure vessels are also incorporated in analysis

Process evaluation of the Regional Biomass Energy Program

Energy Technology Data Exchange (ETDEWEB)

Wilson, C.R.; Brown, M.A.; Perlack, R.D.

1994-03-01

The U.S. Department of Energy (DOE) established the Regional Biomass Energy Program (RBEP) in 1983 to increase the production and use of biomass energy resources. Through the creation of five regional program (the Great Lakes, Northeast, Pacific Northwest, Southeast, and West), the RBEP focuses on regionally specific needs and opportunities. In 1992, Oak Ridge National (ORNL) conducted a process evaluation of the RBEP Program designed to document and explain the development of the goals and strategies of the five regional programs; describe the economic and market context surrounding commercialization of bioenergy systems; assess the criteria used to select projects; describe experiences with cost sharing; identify program accomplishments in the transfer of information and technology; and offer recommendations for program improvement.

The program ORTOCARTAN for applications in the relativity theory

International Nuclear Information System (INIS)

Krasinski, A.

1985-01-01

A general outline of the program ORTOCARTAN for algebraic computing in the relativity theory is presented. A short history of the program is given. The base-programming language is LISP. The details of the calculation are presented. An example of application of the ORTOCARTAN is given

A High Precision Comprehensive Evaluation Method for Flood Disaster Loss Based on Improved Genetic Programming

Institute of Scientific and Technical Information of China (English)

ZHOU Yuliang; LU Guihua; JIN Juliang; TONG Fang; ZHOU Ping

2006-01-01

Precise comprehensive evaluation of flood disaster loss is significant for the prevention and mitigation of flood disasters. Here, one of the difficulties involved is how to establish a model capable of describing the complex relation between the input and output data of the system of flood disaster loss. Genetic programming (GP) solves problems by using ideas from genetic algorithm and generates computer programs automatically. In this study a new method named the evaluation of the grade of flood disaster loss (EGFD) on the basis of improved genetic programming (IGP) is presented (IGPEGFD). The flood disaster area and the direct economic loss are taken as the evaluation indexes of flood disaster loss. Obviously that the larger the evaluation index value, the larger the corresponding value of the grade of flood disaster loss is. Consequently the IGP code is designed to make the value of the grade of flood disaster be an increasing function of the index value. The result of the application of the IGP-EGFD model to Henan Province shows that a good function expression can be obtained within a bigger searched function space; and the model is of high precision and considerable practical significance.Thus, IGP-EGFD can be widely used in automatic modeling and other evaluation systems.

Agent-based modeling as a tool for program design and evaluation.

Science.gov (United States)

Lawlor, Jennifer A; McGirr, Sara

2017-12-01

Recently, systems thinking and systems science approaches have gained popularity in the field of evaluation; however, there has been relatively little exploration of how evaluators could use quantitative tools to assist in the implementation of systems approaches therein. The purpose of this paper is to explore potential uses of one such quantitative tool, agent-based modeling, in evaluation practice. To this end, we define agent-based modeling and offer potential uses for it in typical evaluation activities, including: engaging stakeholders, selecting an intervention, modeling program theory, setting performance targets, and interpreting evaluation results. We provide demonstrative examples from published agent-based modeling efforts both inside and outside the field of evaluation for each of the evaluative activities discussed. We further describe potential pitfalls of this tool and offer cautions for evaluators who may chose to implement it in their practice. Finally, the article concludes with a discussion of the future of agent-based modeling in evaluation practice and a call for more formal exploration of this tool as well as other approaches to simulation modeling in the field. Copyright © 2017 Elsevier Ltd. All rights reserved.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-01-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Objective Evaluation in an Online Geographic Information System Certificate Program

Directory of Open Access Journals (Sweden)

Scott L. WALKER

2005-01-01

Full Text Available Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program. The evaluation utilized several methods that strived to inject objectivity in evaluation and subsequent decision-making. A rapid multi-modal approach included evaluation methods of (1 considering the online psychosocial learning environment, (2 content analyses comparing the online version of classes to face-to-face versions, (3 cost comparisons in online vs. face-to-face classes, (4 student outcomes, (5 student retention, and (6 benchmarking. These approaches offer opportunities for departmental administrators and decision-making committees to make judgments informed by facts rather than being influenced by the emotions, beliefs, or opinions of organizational dynamics.

Application of quality assurance program to safety related aging equipment or components

International Nuclear Information System (INIS)

Papaiya, N.C.

1990-01-01

This paper addresses how quality assurance programs and their criteria are applied to safety related and aging equipment or components used in commercial nuclear plant applications. The QA Programs referred to are 10CFR50 Appendix B and EPRI NP-5652. The QA programs as applicable are applied to equipment/component aging qualification, preventive maintenance, surveillance testing and procurement engineering. The intent of this paper is not the technical issues, methods and research of aging. The paper addresses QA program's application to age-related equipment or components in safety related applications. Quality Assurance Program 10CFR50 Appendix B applies to all safety related aging components or equipment related to the qualification program and associated preventive maintenance and surveillance testing programs. Quality Assurance involvement with procurement engineering for age-related commercial grade items supports EPRI NP-5652 and assures that the dedicated OGI is equal to the item purchased as a basic component to 10CFR50 Appendix B requirements

Development and Evaluation of vetPAL, a Student-Led, Peer-Assisted Learning Program.

Science.gov (United States)

Bates, Lucy S W; Warman, Sheena; Pither, Zoe; Baillie, Sarah

Based on an idea from a final-year student, Bristol Veterinary School introduced vetPAL, a student-led, peer-assisted learning program. The program involved fifth-year (final-year) students acting as tutors and leading sessions for fourth-year students (tutees) in clinical skills and revision (review) topics. The initiative aimed to supplement student learning while also providing tutors with opportunities to further develop a range of skills. All tutors received training and the program was evaluated using questionnaires collected from tutees and tutors after each session. Tutees' self-rated confidence increased significantly in clinical skills and for revision topics. Advantages of being taught by students rather than staff included the informal atmosphere, the tutees' willingness to ask questions, and the relatability of the tutors. The small group size and the style of learning in the revision sessions (i.e., group work, discussions, and interactivity) were additional positive aspects identified by both tutees and tutors. Benefits for tutors included developing their communication and teaching skills. The training sessions were considered key in helping tutors feel prepared to lead sessions, although the most difficult aspects were the lack of teaching experience and time management. Following the successful pilot of vetPAL, plans are in place to make the program permanent and sustainable, while incorporating necessary changes based on the evaluation and the student leader's experiences running the program. A vetPAL handbook has been created to facilitate organization of the program for future years.

EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

Science.gov (United States)

This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

Program Evaluation in Cost Benefit Terms.

Science.gov (United States)

Tanner, C. Kenneth

This paper advances a model, called the expected opportunity loss model, for curriculum evaluation. This decision-making technique utilizes subjective data by ranking courses according to their expected contributions to the primary objective of the total program. The model also utilizes objective data in the form of component costs, and differs…

The CEMHaVi program: control, evaluation, and modification of lifestyles in obese youth.

Science.gov (United States)

Vanhelst, Jérémy; Marchand, Frédéric; Fardy, Paul; Zunquin, Gautier; Loeuille, Guy-André; Renaut, Hervé; Mikulovic, Jacques; Hurdiel, Rémy; Béghin, Laurent; Theunynck, Denis

2010-01-01

Obesity in children has increased in recent years. Many studies with differing methodologies have been undertaken to treat obesity. The Control, Evaluation, and Modification of Lifestyles in Obese Youth (CEMHaVi) program is a unique 2-year health-wellness program of physical activity and health education for obese youth. Findings of this study represent results at 1-year follow-up. The purpose of this study was to evaluate the effects of the CEMHaVi program. Physician-referred subjects (N = 26) participated in the study, 14 girls (13.4 +/- 2.9 years) and 12 boys (12.3 +/- 2.8 years). Measurements included height, weight, body mass index (BMI), academic performance, sleep habits, and health knowledge. The intervention consisted of a unique program of physical activity, including a variety of games specifically selected to be enjoyable, maintain interest, and motivate subjects to adhere. Activity sessions were offered once per week, 2 hours each session, for 12 months. A health education program was offered once every 3 months for 2 hours per session. Health knowledge, academic performance, self-esteem, and sleep were assessed before and after the intervention. Means were calculated at baseline and following intervention and were compared by paired t tests. Findings suggest significant improvements in academic performance (P < .001), quality and quantity of sleep (P < .05), and obesity (P < .05). The program reduced BMI and improved health knowledge, sleep, and academic performance in obese children. The feasibility of a beneficial lifestyle intervention program is encouraging in addressing obesity and related issues in young boys and girls.

An Implementation Research Approach to Evaluating Health Insurance Programs: Insights from India

Directory of Open Access Journals (Sweden)

Krishna D. Rao

2016-05-01

Full Text Available One of the distinguishing features of implementation research is the importance given to involve implementers in all aspects of research, and as users of research. We report on a recent implementation research effort in India, in which researchers worked together with program implementers from one of the longest serving government funded insurance schemes in India, the Rajiv Aarogyasri Scheme (RAS in the state of undivided Andhra Pradesh, that covers around 70 million people. This paper aims to both inform on the process of the collaborative research, as well as, how the nature of questions that emerged out of the collaborative exercise differed in scope from those typically asked of insurance program evaluations. Starting in 2012, and over the course of a year, staff from the Aarogyasri Health Care Trust (AHCT, and researchers held a series of meetings to identify research questions that could serve as a guide for an evaluation of the RAS. The research questions were derived from the application of a Logical Framework Approach (“log frame” to the RAS. The types of questions that emerged from this collaborative effort were compared with those seen in the published literature on evaluations of insurance programs in low- and middle-income countries (LMICs. In the published literature, 60% of the questions pertained to output/outcome of the program and the remaining 40%, relate to processes and inputs. In contrast, questions generated from the RAS participatory research process between implementers and researchers had a remarkably different distribution – 81% of questions looked at program input/processes, and 19% on outputs and outcomes. An implementation research approach can lead to a substantively different emphasis of research questions. While there are several challenges in collaborative research between implementers and researchers, an implementation research approach can lead to incorporating tacit knowledge of program implementers

Alcohol-Related Consequences among First-Year University Students: Effectiveness of a Web-Based Personalized Feedback Program

Science.gov (United States)

Doumas, Diana M.; Nelson, Kinsey; DeYoung, Amanda; Renteria, Camryn Conrad

2014-01-01

This study evaluated the effectiveness of a web-based personalized feedback program using an objective measure of alcohol-related consequences. Participants were assigned to either the intervention group or an assessment-only control group during university orientation. Sanctions received for campus alcohol policy violations were tracked over the…

Status of beta measurement evaluation and upgrade program

International Nuclear Information System (INIS)

Swinth, K.L.

1986-01-01

In 1983, the US Department of Energy (DOE) initiated a program to evaluate and upgrade beta dosimetry capabilities at DOE and DOE-contractor facilities. The program has several elements which structure the development of improvements in beta measurement practices. In addition to Pacific Northwest Laboratory (PNL), universities, private corporations, and other DOE facilities are involved in the research efforts

Evaluation of a quality control program in radiodiagnosis

International Nuclear Information System (INIS)

Yacovenco, Alejandro; Infantosi, A.F.C.; Tauhata, L.

1996-01-01

A quality assurance program, implemented at the Radiologic Service of the Hospital of the Military Police in Rio de Janeiro, Brazil, is evaluated. The results show a reduction around of 70% in the number of rejected films and 75% in the costs. A return to the former conditions is reported as after the discontinuation of the program

Using program logic model analysis to evaluate and better deliver what works

International Nuclear Information System (INIS)

Megdal, Lori; Engle, Victoria; Pakenas, Larry; Albert, Scott; Peters, Jane; Jordan, Gretchen

2005-01-01

There is a rich history in using program theories and logic models (PT/LM) for evaluation, monitoring, and program refinement in a variety of fields, such as health care, social and education programs. The use of these tools to evaluate and improve energy efficiency programs has been growing over the last 5-7 years. This paper provides an overview of the state-of-the-art methods of logic model development, with analysis that significantly contributed to: Assessing the logic behind how the program expects to be able to meets its ultimate goals, including the 'who', the 'how', and through what mechanism. In doing so, gaps and questions that still need to be addressed can be identified. Identifying and prioritize the indicators that should be measured to evaluate the program and program theory. Determining key researchable questions that need to be answered by evaluation/research, to assess whether the mechanism assumed to cause the changes in actions, attitudes, behaviours, and business practices is workable and efficient. Also will assess the validity in the program logic and the likelihood that the program can accomplish its ultimate goals. Incorporating analysis of prior like programs and social science theories in a framework to identify opportunities for potential program refinements. The paper provides an overview of the tools, techniques and references, and uses as example the energy efficiency program analysis conducted for the New York State Energy Research and Development Authority's (NYSERDA) New York ENERGY $MART SM programs

Criteria for Evaluating Alternative Network and Link Layer Protocols for the NASA Constellation Program Communication Architecture

Science.gov (United States)

Benbenek, Daniel; Soloff, Jason; Lieb, Erica

2010-01-01

Selecting a communications and network architecture for future manned space flight requires an evaluation of the varying goals and objectives of the program, development of communications and network architecture evaluation criteria, and assessment of critical architecture trades. This paper uses Cx Program proposed exploration activities as a guideline; lunar sortie, outpost, Mars, and flexible path options are described. A set of proposed communications network architecture criteria are proposed and described. They include: interoperability, security, reliability, and ease of automating topology changes. Finally a key set of architecture options are traded including (1) multiplexing data at a common network layer vs. at the data link layer, (2) implementing multiple network layers vs. a single network layer, and (3) the use of a particular network layer protocol, primarily IPv6 vs. Delay Tolerant Networking (DTN). In summary, the protocol options are evaluated against the proposed exploration activities and their relative performance with respect to the criteria are assessed. An architectural approach which includes (a) the capability of multiplexing at both the network layer and the data link layer and (b) a single network layer for operations at each program phase, as these solutions are best suited to respond to the widest array of program needs and meet each of the evaluation criteria.

Field manual for stream sediment reconnaissance. Savannah River Laboratory National Uranium Resource Evaluation Program

International Nuclear Information System (INIS)

Ferguson, R.B.; Price, V.; Baucom, E.I.

1976-07-01

A manual is presented that is intended to direct and coordinate field operations, site selection, stream sediment sample collection, water sample collection, and information codes for the Savannah River Laboratory (SRL) contribution to the National Uranium Resource Evaluation (NURE) program. The manual provides public relations information for field sampling teams as well as technical direction

Evaluation of a Telephone-Delivered, Community-Based Collaborative Care Management Program for Caregivers of Older Adults with Dementia.

Science.gov (United States)

Mavandadi, Shahrzad; Wray, Laura O; DiFilippo, Suzanne; Streim, Joel; Oslin, David

2017-09-01

To evaluate whether a community-based, telephone-delivered, brief patient/caregiver-centered collaborative dementia care management intervention is associated with improved caregiver and care recipient (CR) outcomes. Longitudinal program evaluation of a clinical intervention; assessments at baseline and 3- and 6-month follow-up. General community. Caregivers (N = 440) of older, community-dwelling, low-income CRs prescribed a psychotropic medication by a primary care provider who met criteria for dementia and were enrolled in the SUpporting Seniors Receiving Treatment And INtervention (SUSTAIN) program for older adults. Dementia care management versus clinical evaluation only. Perceived caregiving burden and caregiver general health (primary outcomes); CR neuropsychiatric symptoms and caregiver distress in response to CRs' challenging dementia-related behaviors (secondary outcomes). Caregivers were, on average, 64.0 (SD: 11.8) years old and 62.6% provided care for the CR for 20 or more hours per week. The majority of the sample was female (73.2%), non-Hispanic White (90.2%), and spousal caregivers (72.5%). Adjusted longitudinal models of baseline and 3- and 6-month data suggest that compared with caregivers receiving clinical evaluation only, caregivers receiving care management reported greater reductions in burden over time. Subgroup analyses also showed statistically significant reductions in caregiver-reported frequency of CR dementia-related behaviors and caregiver distress in response to those symptoms at 3-month follow-up. A community-based, telephone-delivered care management program for caregivers of individuals with dementia is associated with favorable caregiver and CR-related outcomes. Findings support replication and further research in the impact of tailored, collaborative dementia care management programs that address barriers to access and engagement. Published by Elsevier Inc.

Narrow Viewing: The Vocabulary in Related Television Programs

Science.gov (United States)

Rodgers, Michael P. H.; Webb, Stuart

2011-01-01

In this study, the scripts of 288 television episodes were analyzed to determine the extent to which vocabulary reoccurs in related and unrelated television programs, and the potential for incidental vocabulary learning through watching one season (approximately 24 episodes) of television programs. The scripts consisted of 1,330,268 running words…

The Basalt Waste Isolation Project technical program evaluation process: A criteria-based method

International Nuclear Information System (INIS)

Babad, H.; Evans, C.; Wolfe, B.A.

1982-01-01

The need to objectively evaluate the progress being made by the Basalt Waste Isolation Project (BWIP) toward establishing the feasibility of siting a nuclear waste repository in basalt (NWRB) mandates a process for evaluating the technical work of the project. To assist BWIP management in the evaluation process, the Systems Department staff has developed a BWIP Technical Program Evaluation Process (TPEP). The basic process relates progress on project technical work to the BWIP Functional and System Performance Criteria as defined in National Waste Terminal Storage (NWTS) Criteria Documents. The benefits of the TPEP to BWIP and future plans for TPEP are discussed. During fiscal year (FY) 1982, TPEP will be further formalized and further applied to the review of BWIP technical activities

The Evaluation Market in Germany: Estimating Market Size for Evaluation of Political Programs

Science.gov (United States)

Lowenbein, Oded

2008-01-01

The United States has a long tradition in evaluation of political programs. In the 1930s and 1940s, programs were initiated to reduce unemployment and improve social security as part of the "New Deal." In the late 1960s, somewhat comparable to the U. S. at that time, Germany's new government started its own "New Deal."…

AAAS Communicating Science Program: Reflections on Evaluation

Science.gov (United States)

Braha, J.

2015-12-01

The AAAS Center for Public Engagement (Center) with science builds capacity for scientists to engage public audiences by fostering collaboration among natural or physical scientists, communication researchers, and public engagement practitioners. The recently launched Leshner Leadership Institute empowers cohorts of mid-career scientists to lead public engagement by supporting their networks of scientists, researchers, and practitioners. The Center works closely with social scientists whose research addresses science communication and public engagement with science to ensure that the Communicating Science training program builds on empirical evidence to inform best practices. Researchers ( Besley, Dudo, & Storkdieck 2015) have helped Center staff and an external evaluator develop pan instrument that measures progress towards goals that are suggested by the researcher, including internal efficacy (increasing scientists' communication skills and confidence in their ability to engage with the public) and external efficacy (scientists' confidence in engagement methods). Evaluation results from one year of the Communicating Science program suggest that the model of training yields positive results that support scientists in the area that should lead to greater engagement. This talk will explore the model for training, which provides a context for strategic communication, as well as the practical factors, such as time, access to public engagement practitioners, and technical skill, that seems to contribute to increased willingness to engage with public audiences. The evaluation program results suggest willingness by training participants to engage directly or to take preliminary steps towards engagement. In the evaluation results, 38% of trained scientists reported time as a barrier to engagement; 35% reported concern that engagement would distract from their work as a barrier. AAAS works to improve practitioner-researcher-scientist networks to overcome such barriers.

The SBIRT program matrix: a conceptual framework for program implementation and evaluation.

Science.gov (United States)

Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna

2017-02-01

Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.

Alternative Aviation Jet Fuel Sustainability Evaluation Report Task 1 : Report Evaluating Existing Sustainability Evaluation Programs

Science.gov (United States)

2011-10-25

This report describes how existing biofuel sustainability evaluation programs meet requirements that are under consideration or are in early phases of adoption and implementation in various US and international contexts. Biofuel sustainability evalua...

Hanford performance evaluation program for Hanford site analytical services

International Nuclear Information System (INIS)

Markel, L.P.

1995-09-01

The U.S. Department of Energy (DOE) Order 5700.6C, Quality Assurance, and Title 10 of the Code of Federal Regulations, Part 830.120, Quality Assurance Requirements, states that it is the responsibility of DOE contractors to ensure that ''quality is achieved and maintained by those who have been assigned the responsibility for performing the work.'' Hanford Analytical Services Quality Assurance Plan (HASQAP) is designed to meet the needs of the Richland Operations Office (RL) for maintaining a consistent level of quality for the analytical chemistry services provided by contractor and commmercial analytical laboratory operations. Therefore, services supporting Hanford environmental monitoring, environmental restoration, and waste management analytical services shall meet appropriate quality standards. This performance evaluation program will monitor the quality standards of all analytical laboratories supporting the Hanforad Site including on-site and off-site laboratories. The monitoring and evaluation of laboratory performance can be completed by the use of several tools. This program will discuss the tools that will be utilized for laboratory performance evaluations. Revision 0 will primarily focus on presently available programs using readily available performance evaluation materials provided by DOE, EPA or commercial sources. Discussion of project specific PE materials and evaluations will be described in section 9.0 and Appendix A

Evaluation of Medical Education virtual Program: P3 model.

Science.gov (United States)

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

The Use of Workforce Assessment as a Component of Career and Technical Education Program Evaluation

Science.gov (United States)

Bartlett, Kenneth R.; Schleif, Nicole L.; Bowen, Mauvalyn M.

2011-01-01

This research project examined the extent to which Career and Technical Education (CTE)-related programs use workforce needs assessment as a component of their evaluation activities. An employer perspective was used to develop a conceptual framework drawing on strategic human resource management theory. The extent and methods utilized for…

Traffic Control Device Evaluation Program : FY 2017

Science.gov (United States)

2018-03-01

This report presents findings on the activities conducted in the Traffic Control Device Evaluation Program during the 2017 fiscal year. The research on sponsored changeable message signs (continued from the previous year) was terminated by the Federa...

Evaluating Extension Based Leadership Development Programs in the Southern United States

Science.gov (United States)

Lamm, Kevan W.; Carter, Hannah S.; Lamm, Alexa J.

2016-01-01

The ability to evaluate and accurately articulate the outcomes associated with leadership development programs is critical to their continued financial and administrative support. With calls for outcome-based accountability, the need for rigorous evaluation is particularly relevant for those programs administered through the Cooperative Extension…

Teaching Program Evaluation on Interactive Television.

Science.gov (United States)

McNeil, Keith; Steinhauser, Jim; Newman, Isadore

This paper describes a five-session course entitled "Program Evaluation," which was taught via interactive television in the summer of 2002 to 68 doctoral and master's students in 5 of 6 locations throughout New Mexico. Students received a 4-hour lecture and then participated in off-line activities directed by the instructor. Problems in distance…

Towards Bridging the Gap Programming Language and Partial Evaluation

DEFF Research Database (Denmark)

Le Meur, Anne-Francoise; Lawall, Julia Laetitia; Consel, Charles

2002-01-01

Partial evaluation is a program-transformation technique that automatically specializes a program with respect to user-supplied invariants. Despite successful applications in areas such as graphics, operating systems, and software engineering, partial evaluators have yet to achieve widespread use....... One reason is the difficulty of adequately describing specialization opportunities. Indeed, under-specialization or over-specialization often occurs, without any direct feedback to the user as to the source of the problem.We have developed a high-level, module-based language allowing the programmer...... to guide the choice of both the code to specialize and the invariants to exploit during the specialization process. To ease the use of partial evaluation, the syntax of this language is similar to the declaration syntax of the target language of the partial evaluator. To provide feedback to the programmer...

LUDEP: A Lung Dose Evaluation Program

International Nuclear Information System (INIS)

Birchall, A.; Bailey, M.R.; James, A.C.

1990-06-01

A Task Group of the ICRP is currently reviewing its dosimetric model for the respiratory tract with the aim of producing a more comprehensive and realistic model which can be used both for dosimetry and bioassay purposes. This in turn requires deposition, clearance, and dosimetry to be treated in a more detailed manner in than in the current model. In order to examine the practical application and radiological implications of the proposed model, a microcomputer program has been developed in a modular form so that changes can be easily included as the model develops. LUDEP (Lung Dose Evaluation Program) is a user-friendly menu-driven program which can be operated on any IBM-compatible PC. It enables the user to calculate (a) doses to each region of the respiratory tract and all other body organs, and (b) excretion rates and retention curves for bioassay purposes. 11 refs., 4 figs., 6 tabs

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

Science.gov (United States)

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common

Evaluating the use of programming games for building early analytical thinking skills

Directory of Open Access Journals (Sweden)

H. Tsalapatas

2015-11-01

Full Text Available Analytical thinking is a transversal skill that helps learners excel academically independently of theme area. It is on high demand in the world of work especially in innovation related sectors. It involves finding a viable solution to a problem by identifying goals, parameters, and resources available for deployment. These are strategy elements in game play. They further constitute good practices in programming. This work evaluates how serious games based on visual programming as a solution synthesis tool within exploration, inquiry, and collaboration can help learners build structured mindsets. It analyses how a visual programming environment that supports experimentation for building intuition on potential solutions to logical puzzles, and then encourages learners to synthesize a solution interactively, helps learners through gaming principles to build self-esteem on their problem solving ability, to develop algorithmic thinking capacity, and to stay engaged in learning.

Employee assistance program evaluation. Employee perceptions, awareness, and utilization.

Science.gov (United States)

Moore, T

1989-12-01

Periodic evaluation is necessary to maintain a quality employee assistance program. This survey was undertaken to determine employee awareness of the existing EAP and their satisfaction with the program. Likewise, the survey allowed for employee input on areas of the program they had concerns with that may have caused hesitancy in further use of the program. The survey not only documents to management that the program is of value to employees and identifies areas where changes may be focused in the future to meet employee needs, but actually serves as a communication tool in itself as a reminder of the availability of the Employee Assistance Program.

Evaluation of the US Department of Energy Weatherization Innovation Pilot Program (2010-2014)

Energy Technology Data Exchange (ETDEWEB)

Tonn, Bruce Edward [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Rose, Erin M. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Hawkins, Beth A. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-05-01

This report contains results from analysis conducted on each of the Weatherization Innovation Pilot Program (WIPP) grants awarded to 16 organizations by the US Department of Energy (DOE) in 2010. The purpose of WIPP was to explore the potential adoptability or replicability of innovative processes or technologies for the enhancement of DOE’s Weatherization Assistance Program (WAP). DOE initiated the WIPP grant to accelerate effective innovations in home energy efficiency and other WAP mission-related goals for income-qualifying households of low socioeconomic status. This study was performed alongside a broader, national evaluation of WAP conducted by Oak Ridge National Laboratory (ORNL) for DOE.

Jointly Sponsored Research Program Energy Related Research

Energy Technology Data Exchange (ETDEWEB)

Western Research Institute

2009-03-31

Cooperative Agreement, DE-FC26-98FT40323, Jointly Sponsored Research (JSR) Program at Western Research Institute (WRI) began in 1998. Over the course of the Program, a total of seventy-seven tasks were proposed utilizing a total of $23,202,579 in USDOE funds. Against this funding, cosponsors committed $26,557,649 in private funds to produce a program valued at $49,760,228. The goal of the Jointly Sponsored Research Program was to develop or assist in the development of innovative technology solutions that will: (1) Increase the production of United States energy resources - coal, natural gas, oil, and renewable energy resources; (2) Enhance the competitiveness of United States energy technologies in international markets and assist in technology transfer; (3) Reduce the nation's dependence on foreign energy supplies and strengthen both the United States and regional economies; and (4) Minimize environmental impacts of energy production and utilization. Under the JSR Program, energy-related tasks emphasized enhanced oil recovery, heavy oil upgrading and characterization, coal beneficiation and upgrading, coal combustion systems development including oxy-combustion, emissions monitoring and abatement, coal gasification technologies including gas clean-up and conditioning, hydrogen and liquid fuels production, coal-bed methane recovery, and the development of technologies for the utilization of renewable energy resources. Environmental-related activities emphasized cleaning contaminated soils and waters, processing of oily wastes, mitigating acid mine drainage, and demonstrating uses for solid waste from clean coal technologies, and other advanced coal-based systems. Technology enhancement activities included resource characterization studies, development of improved methods, monitors and sensors. In general the goals of the tasks proposed were to enhance competitiveness of U.S. technology, increase production of domestic resources, and reduce environmental

Development of a systemwide predator control program: Stepwise implementation of a predation index, predator control fisheries, and evaluation plan in the Columbia River Basin. Section 2: Evaluation, Annual Report 1994

International Nuclear Information System (INIS)

Willis, C.F.; Young, F.R.

1995-08-01

The authors are reporting progress on evaluation of the Northern Squawfish Management Program in 1994. The objectives in 1994 were to (1) evaluate exploitation rate, size composition, and incidental catch of northern squawfish (Ptychocheilus oregonensis) captured in the various fisheries and estimate reductions in predation on juvenile salmonids since implementation of the management program, and (2) evaluate changes through 1994 in relative abundance, smolt consumption rate, size and age structure, growth, and fecundity of northern squawfish in lower Columbia and Snake River reservoirs and in the Columbia River downstream from Bonneville Dam

Evaluating program effects on institutional delivery in Peru.

Science.gov (United States)

McQuestion, Michael J; Velasquez, Anibal

2006-07-01

We evaluate the joint effects of two targeted Peruvian health programs on a mother's choice of whether to deliver in a public emergency obstetric care (EmOC) facility. The national maternal and child health insurance, or SMI Program, provided delivery care coverage to Peru's poorest households beginning in 1998. During 1996-2002, Proyecto 2000 sought to improve the quality of EmOC and increase utilization of public EmOC facilities in the districts reporting the highest maternal and neonatal mortality levels. Our data come from the Proyecto 2000 endline evaluation, which sampled 5335 mothers living in the catchment areas of 29 treatment and 29 matched control EmOC facilities. Using propensity scoring and two quality of care indices, we find significantly higher quality of care in Proyecto 2000 treatment facilities. Using variance components logistic models, we find a mother enrolled in the SMI Program was more likely to have delivered her last child in a public EmOC, controlling for household constraints. Residence in a Proyecto 2000 treatment area did not significantly affect the choice. A cross-level interaction term was insignificant, indicating the two program effects were independent.

Evidence from the field: Findings on issues related to planning, implementing and evaluating gender-based programs.

Science.gov (United States)

Kowalczyk, Shelly; Randolph, Suzanne; Stokes, Shereitte; Winston, Stefanie

2015-08-01

An Initiative of the United States Department of Health and Human Services' Office on Women's Health (OWH), Coalition for a Healthier Community (CHC), supports ten grantees across the U.S. in the implementation of gender-based health interventions targeting women and girls. A national evaluation is assessing whether gender-focused public health systems approaches are sustainable and cost effective in addressing health disparities in women and girls. To inform the evaluation, a systematic examination was conducted of literature in both the public and private sector designed to track, assess, understand, and improve women's health, public health systems approaches, and the cost-effectiveness and sustainability of gender-based programs. A two-person team assured the quality of the results following the review of abstracts and full-text articles. Of 123 articles meeting eligibility criteria (See inclusion criteria described in Section 2.2 below), only 18 met inclusion criteria specific to a focus on a systems approach, cost-effectiveness and/or sustainability. Studies assessing systems approaches suggested their effectiveness in changing perceptions and increasing knowledge within a community; increasing involvement of local decision-makers and other community leaders in women's health issues; and increasing community capacity to address women and girls' health. Further evaluation of the cost-effectiveness and sustainability of gender-based approaches is needed. Copyright © 2014 Elsevier Ltd. All rights reserved.

Remote Infrared Audible Signage (RIAS) Pilot Program : evaluation report

Science.gov (United States)

2009-09-01

This report presents evaluation findings on the Remote Infrared Audible Signage (RIAS) Pilot Program in the Puget Sound Region of Washington. The installation, demonstration and evaluation of RIAS were required by a provision in the Safe, Accountable...

Quantitative Evaluation of the Community Research Fellows Training Program

Directory of Open Access Journals (Sweden)

Lucy eD'Agostino McGowan

2015-07-01

Full Text Available Context: The Community Research Fellows Training (CRFT program is a community-based participatory research (CBPR initiative for the St. Louis area. This fifteen week program, based on a Master in Public Health curriculum, was implemented by the Division of Public Health Sciences at Washington University School of Medicine in partnership with the Siteman Cancer Center. Objectives: We measure the knowledge gained by participants and evaluate participant and faculty satisfaction of the CRFT program both in terms of meeting learning objectives and actively engaging the community in the research process.Participants: We conducted analyses on 44 community members who participated in the CRFT program and completed the baseline and follow-up knowledge assessments.Main Outcome Measures: Knowledge gain is measured by a baseline and follow-up assessment given at the first and final session. Additionally, pre- and post-tests are given after the first 12 sessions. To measure satisfaction, program evaluations are completed by both the participants and faculty after each topic. Mid-way through the program, a mid-term assessment was administered to assess the program’s community engagement. We analyzed the results from the assessments, pre- and post-tests, and evaluations.Results: The CRFT participants’ knowledge increased at follow-up as compared with baseline on average by a 16.5 point difference (p<0.0001. Post-test scores were higher than pre-test scores for 11 of the 12 sessions. Both participants and faculty enjoyed the training and rated all session well.Conclusions: The CRFT program was successful in increasing community knowledge, in participant satisfaction, and in faculty satisfaction. This success has enhanced the infrastructure for CBPR as well as led to CBPR pilot projects that address health disparities in the St. Louis Greater Metropolitan Area.

Evaluating Nutrition Education Programming by Using a Dietary Screener

Science.gov (United States)

Schultz, Jennifer; Litchfield, Ruth

2016-01-01

Short dietary assessment instruments known as screeners have potential for use in evaluating nutrition education programming because detecting change in dietary intake can demonstrate movement toward program goals. Using screeners results in objective dietary intake data but involves less administrative time, training, and cost than other…

Wood Programs. Courseware Evaluation for Vocational and Technical Education.

Science.gov (United States)

Kaylor, Robert; And Others

This courseware evaluation rates the Wood Programs software developed by the Iowa Department of Public Instruction. (These programs--not contained in this document--include understanding board feet, wood characteristics, wood safety drill, wood dimensions, wood moisture, operating the table saw, radial arm, measurement drill, fraction drill, and…

Dissemination of Technology to Evaluate Healthy Food Incentive Programs.

Science.gov (United States)

Freedman, Darcy A; Hunt, Alan R; Merritt, Katie; Shon, En-Jung; Pike, Stephanie N

2017-03-01

Federal policy supports increased implementation of monetary incentive interventions for chronic disease prevention among low-income populations. This study describes how a Prevention Research Center, working with a dissemination partner, developed and distributed technology to support nationwide implementation and evaluation of healthy food incentive programming focused on Supplemental Nutrition Assistance Program recipients. FM Tracks, an iOS-based application and website, was developed to standardize evaluation methods for healthy food incentive program implementation at direct-to-consumer markets. This evaluation examined diffusion and adoption of the technology over 9 months (July 2015-March 2016). Data were analyzed in 2016. FM Tracks was disseminated to 273 markets affiliated with 37 regional networks in 18 states and Washington, DC. All markets adopted the sales transaction data collection feature, with nearly all recording at least one Supplemental Nutrition Assistance Program (99.3%) and healthy food incentive (97.1%) transaction. A total of 43,493 sales transactions were recorded. By the ninth month of technology dissemination, markets were entering individual sales transactions using the application (34.5%) and website (29.9%) and aggregated transactions via website (35.6%) at similar rates. Use of optional evaluation features like recording a customer ID with individual transactions increased successively with a low of 22.2% during the first month to a high of 69.2% in the ninth month. Systematic and widely used evaluation technology creates possibilities for pragmatic research embedded within ongoing, real-world implementation of food access interventions. Technology dissemination requires supportive technical assistance and continuous refinement that can be advanced through academic-practitioner partnerships. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

Evaluation of radiological teaching programs in the Internet

International Nuclear Information System (INIS)

Seitz, J.; Schubert, S.; Voelk, M.; Scheibl, K.; Paetzel, C.; Schreyer, A.; Djavidani, B.; Feuerbach, S.; Strotzer, M.

2003-01-01

Evaluation of web based training programs,which can be contacted from the homepages of radiological departments of German universities.Material and method From june 2000 to january 2002 the 75 web based training programs of 57 providers,which can be contacted from the web pages of the radiological departments of german universities were evaluated in a prospective study.A medical student experienced in using the world wide web examined each training program three times in an interval of six months using the following criteria: availability of the web sites,target group,kind of training program,contents and structure and the technical solution. 51 of the 57 the homepages were fully available at each visit. 64 of the 75 web based training programs which could be connected from these sites were available at all three visitis.One program was only partially available at one spot check. 8 of the 75 programs were designed for physicians and medically trained personal, 23 were made for medical students and 44 addressed both target groups (partially more than once mentioned).The number of the presented cases ranged between one single and 3700. In 31 of 75 training programs links to other teaching files were found.A complete presentation of cases was presented by 48 of the 75 web sites.5 of the 75 web sites offered physiological images for comparison. In 20 training programs the pathological changes were optically marked in the x-ray images.A logical and didactical structure was found in 24 teaching files, 14 gave the possibility to check the learning results.No provider made use of the possibility to pass credits to the students or physicians acount with regard to official training programs. Multimedia techniques were used in 15 training programs.43 sites used data reduced preview images (thumbnails).The latest update of the site is mentioned in 55 of the 75 web sites. 19 of 57 providers had either no possibility of contact or did not answer to an e-mail. From the homepages

EPA Supersites Program-related emissions-based particulate matter modeling: initial applications and advances.

Science.gov (United States)

Russell, Armistead G

2008-02-01

One objective of the U.S. Environmental Protection Agency's (EPA's) Supersite Program was to provide data that could be used to more thoroughly evaluate and improve air quality models, and then have those models used to address both scientific and policy-related issues dealing with air quality management. In this direction, modeling studies have used Supersites-related data and are reviewed here. Fine temporal resolution data have been used both to test model components (e.g., the inorganic thermodynamic routines) and air quality modeling systems (in particular, Community Multiscale Air Quality [CMAQ] and Comprehensive Air Quality Model with extensions [CAMx] applications). Such evaluations suggest that the inorganic thermodynamic approaches being used are accurate, as well as the description of sulfate production, although there are significant uncertainties in production of nitric acid, biogenic and ammonia emissions, secondary organic aerosol formation, and the ability to follow the formation and evolution of ultrafine particles. Model applications have investigated how PM levels will respond to various emissions controls, suggesting that nitrate will replace some of the reductions in sulfate particulate matter (PM), although the replacement is small in the summer. Although not part of the Supersite program, modeling being conducted by EPA, regional planning organizations, and states for policy purposes has benefited from the detailed data collected, and the PM models have advanced by their more widespread use.

Boron neutron capture therapy: Brain Tumor Treatment Evaluation Program

International Nuclear Information System (INIS)

Griebenow, M.L.; Dorn, R.V. III; Gavin, P.R.; Spickard, J.H.

1988-01-01

The United States (US) Department of Energy (DOE) recently initiated a focused, multidisciplined program to evaluate Boron Neutron Capture Therapy (BNCT) for the treatment of brain tumors. The program, centered at the DOE/endash/Idaho National Engineering Laboratory (INEL), will develop the analytical, diagnostic and treatment tools, and the database required for BNCT technical assessment. The integrated technology will be evaluated in a spontaneously-occurring canine brain-tumor model. Successful animal studies are expected to lead to human clinical trials within four to five years. 2 refs., 3 figs

Evaluating public participation in environmental decision-making: EPA's superfund community involvement program.

Science.gov (United States)

Susan Charnley; Bruce. Engelbert

2005-01-01

This article discusses an 8-year, ongoing project that evaluates the Environmental Protection Agency's Superfund community involvement program. The project originated as a response to the Government Performance and Results Act, which requires federal agencies to articulate program goals, and evaluate and report their progress in meeting those goals. The evaluation...

Health promotion in schools: a multi-method evaluation of an Australian School Youth Health Nurse Program.

Science.gov (United States)

Banfield, Michelle; McGorm, Kelly; Sargent, Ginny

2015-01-01

Health promotion provides a key opportunity to empower young people to make informed choices regarding key health-related behaviours such as tobacco and alcohol use, sexual practices, dietary choices and physical activity. This paper describes the evaluation of a pilot School Youth Health Nurse (SYHN) Program, which aims to integrate a Registered Nurse into school communities to deliver health promotion through group education and individual sessions. The evaluation was guided by the RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework. The objectives were to explore: 1) whether the Program was accessible to the high school students; 2) the impacts of the Program on key stakeholders; 3) which factors affected adoption of the Program; 4) whether implementation was consistent with the Program intent; and 5) the long-term sustainability of the Program. Research included retrospective analysis of Program records, administration of a survey of student experiences and interviews with 38 stakeholders. This evaluation provided evidence that the SYHN Program is reaching students in need, is effective, has been adopted successfully in schools, is being implemented as intended and could be maintained with sustained funding. The nurses deliver an accessible and acceptable primary health care service, focused on health promotion, prevention and early intervention. After some initial uncertainty about the scope and nature of the role, the nurses are a respected source of health information in the schools, consulted on curriculum development and contributing to whole-of-school health activities. Findings demonstrate that the SYHN model is feasible and acceptable to the students and schools involved in the pilot. The Program provides health promotion and accessible primary health care in the school setting, consistent with the Health Promoting Schools framework.

[A critical evaluation of food programs in Argentina].

Science.gov (United States)

Abeyá Gilardon, Enrique O

2016-01-01

Argentina has an over 60-year history of food programs which have received few to no evaluations, even considering the highly important epidemiological and social changes that have occurred in the target population. In this article, nationwide State-run food programs with the objective of contributing to the food security of the families in greatest need are reviewed, the nutritional situation of the target population is reassessed, and arguments for analyzing current programs using a typology based in the components of food security are proposed. A general review of the conceptions, content and reach of food programs should be carried out, in order for these programs to cease to act as mere social assistance and instead be transformed in bearers of the right to better food and nutrition.

Contextualising the self and social change making: an evaluation of the Young Social Pioneers program

Directory of Open Access Journals (Sweden)

Naomi Berman

2012-03-01

Full Text Available This article presents the findings of an evaluation of an innovative Australian social entrepreneurship and leadership program to highlight some of the challenges young social change makers face as they attempt to influence change in their local, national and international environments. Through an investigation of an innovative Australian social entrepreneurship program, this article demonstrates how reflexive, communicative and participatory practices position young people at the forefront of new forms of civic engagement and that there are certain needs relating to the development of self and community which must to be addressed in order that these young social actors can fulfil their civic aspirations. The findings of the evaluation reported here demonstrate that if social entrepreneur programs are to be successful in providing a service to young people, they need to foster the creation of environments characterised by collectivism, collaboration and opportunities for self development while providing practical solutions to common barriers faced by social entrepreneurs

CRECTJ: a computer program for compilation of evaluated nuclear data

Energy Technology Data Exchange (ETDEWEB)

Nakagawa, Tsuneo [Japan Atomic Energy Research Inst., Tokai, Ibaraki (Japan). Tokai Research Establishment

1999-09-01

In order to compile evaluated nuclear data in the ENDF format, the computer program CRECTJ has been developed. CRECTJ has two versions; CRECTJ5 treats the data in the ENDF/B-IV and ENDF/B-V format, and CRECTJ6 the data in the ENDF-6 format. These programs have been frequently used to make Japanese Evaluated Nuclear Data Library (JENDL). This report describes input data and examples of CRECTJ. (author)

Evaluating Additionality of an Innovation Subsidy Program Targeted at SMEs: An Exploratory Study

Directory of Open Access Journals (Sweden)

Sonja Radas

2013-04-01

Full Text Available This paper explores the effectiveness of a recently introduced innovation subsidy program targeted at SMEs in Croatia. Three aspects of program additionality were evaluated: input, output and behavioral aspects. Both qualitative and survey research was employed, and four case studies with selected recipient companies were conducted. This study is a response to the policy-makers’ need for early program assessment. It attempts to show that even with early evaluation and small population of recipients it is possible to gain insight into program effectiveness. The analysis suggests that the effects of programs targeted at innovative SMEs might need to be evaluated differently than general subsidies. This is especially evident in the evaluation of input additionality. The analysis indicates that SMEs which started with a higher R&D capability tend to increase R&D intensity while participating in the program. The program raised R&D and innovation capability of the participating SMEs, but commercialization of project results remains a concern.

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

Science.gov (United States)

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Evaluation of medical education virtual program: P3 model

Directory of Open Access Journals (Sweden)

RITA REZAEE

2016-10-01

Full Text Available Introduction: In e-learning, people get involved in a process and create the content (product and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76, but they declared technical support as the less desirable part (1.17±1.23. Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

[Resident evaluation of general surgery training programs].

Science.gov (United States)

Espinoza G, Ricardo; Danilla E, Stefan; Valdés G, Fabio; San Francisco R, Ignacio; Llanos L, Osvaldo

2009-07-01

The profile of the general surgeon has changed, aiming to incorporate new skills and to develop new specialties. To assess the quality of postgraduate General Surgery training programs given by Chilean universities, the satisfaction of students and their preferences after finishing the training period. A survey with multiple choice and Likert type questions was designed and applied to 77 surgery residents, corresponding to 59% of all residents of general surgery specialization programs of Chilean universities. Fifty five per cent of residents financed with their own resources the specialization program. Thirty nine percent disagreed partially or totally with the objectives and rotations of programs. The opportunity to perform surgical interventions and the support by teachers was well evaluated. However, 23% revealed teacher maltreatment. Fifty six percent performed research activities, 73% expected to continue training in a derived specialty and 69% was satisfied with the training program. Residents considered that the quality and dedication of professors and financing of programs are issues that must be improved. The opportunity to perform surgical interventions, obtaining a salary for their work and teacher support is considered of utmost importance.

Tribal motor vehicle injury prevention programs for reducing disparities in motor vehicle-related injuries.

Science.gov (United States)

West, Bethany A; Naumann, Rebecca B

2014-04-18

A previous analysis of National Vital Statistics System data for 2003-2007 that examined disparities in rates of motor vehicle-related death by race/ethnicity and sex found that death rates for American Indians/Alaska Natives were two to four times the rates of other races/ethnicities. To address the disparity in motor vehicle-related injuries and deaths among American Indians/Alaska Natives, CDC funded four American Indian tribes during 2004-2009 to tailor, implement, and evaluate evidence-based road safety interventions. During the implementation of these four motor vehicle-related injury prevention pilot programs, seat belt and child safety seat use increased and alcohol-impaired driving decreased. Four American Indian/Alaska Native tribal communities-the Tohono O'odham Nation, the Ho-Chunk Nation, the White Mountain Apache Tribe, and the San Carlos Apache Tribe-implemented evidence-based road safety interventions to reduce motor vehicle-related injuries and deaths. Each community selected interventions from the Guide to Community Preventive Services and implemented them during 2004-2009. Furthermore, each community took a multifaceted approach by incorporating several strategies, such as school and community education programs, media campaigns, and collaborations with law enforcement officers into their programs. Police data and direct observational surveys were the main data sources used to assess results of the programs. Results included increased use of seat belts and child safety seats, increased enforcement of alcohol-impaired driving laws, and decreased motor vehicle crashes involving injuries or deaths. CDC's Office of Minority Health and Health Equity selected the intervention analysis and discussion as an example of a program that might be effective for reducing motor vehicle-related injury disparities in the United States. The Guide to Community Preventive Services recognizes these selected interventions as effective; this report examines the

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Developing a hazmat incident evaluation program

International Nuclear Information System (INIS)

Williams, D.L.; Kaikumba, F.

1991-01-01

This paper reports that all communities are at risk of experiencing a hazardous materials incident, whether in transportation or at a fixed facility (such as petroleum refineries, oil fields, processing plants, etc.). However, many communities are unprepared to cope with this emergency. Administrators of state agencies and local response organizations often face fierce competition for tax dollars in support of their hazardous materials emergency response programs. Historically, little statistical information has been available to support their call for additional budget dollars in the areas of personnel, training, and equipment. It is difficult to plan for an emergency when you have little understanding of the risks, the frequency of incidents, the type of chemicals generally involved, and other vital information. The Illinois Hazardous Materials Incident Evaluation Program was designed to address the state and local needs, and position government and industry in a more responsive and proactive mode. The result is a program that works

Problem Space Matters: Evaluation of a German Enrichment Program for Gifted Children.

Science.gov (United States)

Welter, Marisete M; Jaarsveld, Saskia; Lachmann, Thomas

2018-01-01

We studied the development of cognitive abilities related to intelligence and creativity ( N = 48, 6-10 years old), using a longitudinal design (over one school year), in order to evaluate an Enrichment Program for gifted primary school children initiated by the government of the German federal state of Rhineland-Palatinate ( Entdeckertag Rheinland Pfalz , Germany; ET; Day of Discoverers). A group of German primary school children ( N = 24), identified earlier as intellectually gifted and selected to join the ET program was compared to a gender-, class- and IQ- matched group of control children that did not participate in this program. All participants performed the Standard Progressive Matrices (SPM) test, which measures intelligence in well-defined problem space; the Creative Reasoning Task (CRT), which measures intelligence in ill-defined problem space; and the test of creative thinking-drawing production (TCT-DP), which measures creativity, also in ill-defined problem space. Results revealed that problem space matters: the ET program is effective only for the improvement of intelligence operating in well-defined problem space. An effect was found for intelligence as measured by SPM only, but neither for intelligence operating in ill-defined problem space (CRT) nor for creativity (TCT-DP). This suggests that, depending on the type of problem spaces presented, different cognitive abilities are elicited in the same child. Therefore, enrichment programs for gifted, but also for children attending traditional schools, should provide opportunities to develop cognitive abilities related to intelligence, operating in both well- and ill-defined problem spaces, and to creativity in a parallel, using an interactive approach.

A prequalifying program for evaluating the analytical performance of commercial laboratories

International Nuclear Information System (INIS)

Reith, C.C.; Bishop, C.T.

1987-01-01

Soil and water samples were spiked with known activities of radionuclides and sent to seven commercial laboratories that had expressed an interest in analyzing environmental samples for the Waste Isolation Pilot Plant (WIPP). This Prequalifying Program was part of the selection process for an analytical subcontractor for a three-year program of baseline radiological surveillance around the WIPP site. Both media were spiked at three different activity levels with several transuranic radionuclides, as well as tritium, fission products, and activation products. Laboratory performance was evaluated by calculating relative error for each radionuclide in each sample, assigning grade values, and compiling grades into report cards for each candidate. Results for the five laboratories completing the Prequalifying Program were pooled to reveal differing degrees of difficulty among the treatments and radionuclides. Interlaboratory comparisons revealed systematic errors in the performance of one candidate. The final report cards contained clear differences among overall grades for the five laboratories, enabling analytical performance to be used as a quantitative criterion in the selection of an analytical subcontractor. (author)

Heuristic program to design Relational Databases

Directory of Open Access Journals (Sweden)

Manuel Pereira Rosa

2009-09-01

Full Text Available The great development of today’s world determines that the world level of information increases day after day, however, the time allowed to transmit this information in the classrooms has not changed. Thus, the rational work in this respect is more than necessary. Besides, if for the solution of a given type of problem we do not have a working algorism, we have, first to look for a correct solution, then the heuristic programs are of paramount importance to succeed in these aspects. Having into consideration that the design of the database is, essentially, a process of problem resolution, this article aims at proposing a heuristic program for the design of the relating database.

Evaluating the effectiveness of a post-license education program for young novice drivers in Belgium.

Science.gov (United States)

Brijs, Kris; Cuenen, Ariane; Brijs, Tom; Ruiter, Robert A C; Wets, Geert

2014-05-01

The disproportionately large number of traffic accidents of young novice drivers highlights the need for an effective driver education program. The Goals for Driving Education (GDE) matrix shows that driver education must target both lower and higher levels of driver competences. Research has indicated that current education programs do not emphasize enough the higher levels, for example awareness and insight. This has raised the importance of insight programs. On the Road (OtR), a Flemish post-license driver education program, is such an insight program that aims to target these higher levels. The program focus is on risky driving behavior like speeding and drink driving. In addition, the program addresses risk detection and risk-related knowledge. The goal of the study was to do an effect evaluation of this insight program at immediate post-test and 2 months follow-up. In addition, the study aimed to generalize the results of this program to comparable programs in order to make usable policy recommendations. A questionnaire based on the Theory of Planned Behavior (TPB) was used in order to measure participants' safety consciousness of speeding and drink driving. Moreover, we focused on risk detection and risk-related knowledge. Participants (N=366) were randomly assigned to a baseline-follow-up group or a post-test-follow-up group. Regarding speeding and driving, we found OtR to have little effect on the TPB variables. Regarding risk detection, we found no significant effect, even though participants clearly needed substantial improvement when stepping into the program. Regarding risk-related knowledge, the program did result in a significant improvement at post-test and follow-up. It is concluded that the current program format is a good starting point, but that it requires further attention to enhance high level driving skills. Program developers are encouraged to work in a more evidence-based manner when they select target variables and methods to influence

Evaluation of thermal network correction program using test temperature data

Science.gov (United States)

Ishimoto, T.; Fink, L. C.

1972-01-01

An evaluation process to determine the accuracy of a computer program for thermal network correction is discussed. The evaluation is required since factors such as inaccuracies of temperatures, insufficient number of temperature points over a specified time period, lack of one-to-one correlation between temperature sensor and nodal locations, and incomplete temperature measurements are not present in the computer-generated information. The mathematical models used in the evaluation are those that describe a physical system composed of both a conventional and a heat pipe platform. A description of the models used, the results of the evaluation of the thermal network correction, and input instructions for the thermal network correction program are presented.

A systematic review of economic evaluations of health and health-related interventions in Bangladesh

Science.gov (United States)

2011-01-01

Background Economic evaluation is used for effective resource allocation in health sector. Accumulated knowledge about economic evaluation of health programs in Bangladesh is not currently available. While a number of economic evaluation studies have been performed in Bangladesh, no systematic investigation of the studies has been done to our knowledge. The aim of this current study is to systematically review the published articles in peer-reviewed journals on economic evaluation of health and health-related interventions in Bangladesh. Methods Literature searches was carried out during November-December 2008 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface. The first specific interest was mapping the articles considering the areas of exploration by economic evaluation and the second interest was to scrutiny the methodological quality of studies. The methodological quality of economic evaluation of all articles has been scrutinized against the checklist developed by Evers Silvia and associates. Result Of 1784 potential articles 12 were accepted for inclusion. Ten studies described the competing alternatives clearly and only two articles stated the perspective of their articles clearly. All studies included direct cost, incurred by the providers. Only one study included the cost of community donated resources and volunteer costs. Two studies calculated the incremental cost effectiveness ratio (ICER). Six of the studies applied some sort of sensitivity analysis. Two of the studies discussed financial affordability of expected implementers and four studies discussed the issue of generalizability for application in different context. Conclusion Very few economic evaluation studies in Bangladesh are found in different areas of health and health-related interventions, which does not provide a strong basis of knowledge in the area. The

A systematic review of economic evaluations of health and health-related interventions in Bangladesh

Directory of Open Access Journals (Sweden)

Koehlmoos Tracey P

2011-07-01

Full Text Available Abstract Background Economic evaluation is used for effective resource allocation in health sector. Accumulated knowledge about economic evaluation of health programs in Bangladesh is not currently available. While a number of economic evaluation studies have been performed in Bangladesh, no systematic investigation of the studies has been done to our knowledge. The aim of this current study is to systematically review the published articles in peer-reviewed journals on economic evaluation of health and health-related interventions in Bangladesh. Methods Literature searches was carried out during November-December 2008 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface. The first specific interest was mapping the articles considering the areas of exploration by economic evaluation and the second interest was to scrutiny the methodological quality of studies. The methodological quality of economic evaluation of all articles has been scrutinized against the checklist developed by Evers Silvia and associates. Result Of 1784 potential articles 12 were accepted for inclusion. Ten studies described the competing alternatives clearly and only two articles stated the perspective of their articles clearly. All studies included direct cost, incurred by the providers. Only one study included the cost of community donated resources and volunteer costs. Two studies calculated the incremental cost effectiveness ratio (ICER. Six of the studies applied some sort of sensitivity analysis. Two of the studies discussed financial affordability of expected implementers and four studies discussed the issue of generalizability for application in different context. Conclusion Very few economic evaluation studies in Bangladesh are found in different areas of health and health-related interventions, which does not provide a strong basis

Evaluating Fast Maximum Likelihood-Based Phylogenetic Programs Using Empirical Phylogenomic Data Sets

Science.gov (United States)

Zhou, Xiaofan; Shen, Xing-Xing; Hittinger, Chris Todd

2018-01-01

Abstract The sizes of the data matrices assembled to resolve branches of the tree of life have increased dramatically, motivating the development of programs for fast, yet accurate, inference. For example, several different fast programs have been developed in the very popular maximum likelihood framework, including RAxML/ExaML, PhyML, IQ-TREE, and FastTree. Although these programs are widely used, a systematic evaluation and comparison of their performance using empirical genome-scale data matrices has so far been lacking. To address this question, we evaluated these four programs on 19 empirical phylogenomic data sets with hundreds to thousands of genes and up to 200 taxa with respect to likelihood maximization, tree topology, and computational speed. For single-gene tree inference, we found that the more exhaustive and slower strategies (ten searches per alignment) outperformed faster strategies (one tree search per alignment) using RAxML, PhyML, or IQ-TREE. Interestingly, single-gene trees inferred by the three programs yielded comparable coalescent-based species tree estimations. For concatenation-based species tree inference, IQ-TREE consistently achieved the best-observed likelihoods for all data sets, and RAxML/ExaML was a close second. In contrast, PhyML often failed to complete concatenation-based analyses, whereas FastTree was the fastest but generated lower likelihood values and more dissimilar tree topologies in both types of analyses. Finally, data matrix properties, such as the number of taxa and the strength of phylogenetic signal, sometimes substantially influenced the programs’ relative performance. Our results provide real-world gene and species tree phylogenetic inference benchmarks to inform the design and execution of large-scale phylogenomic data analyses. PMID:29177474

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

Directory of Open Access Journals (Sweden)

Burgers Jako S

2007-11-01

Full Text Available Abstract Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes

Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

Science.gov (United States)

Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

2014-06-01

Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of the 1987-1988 EIA Remedial and Compensatory Program.

Science.gov (United States)

South Carolina State Dept. of Education, Columbia. Office of Research.

Evaluation of South Carolina's 1987-88 Remedial and Compensatory Program, funded by the state's Education Improvement Act of 1984 (EIA), shows that the program was successful in raising the participants' achievement. The programs include basic skills learning in reading and mathematics in all grades, and writing in grades 6-12, but not all grades…

Economic Evaluation of a Comprehensive Teenage Pregnancy Prevention Program: Pilot Program

Science.gov (United States)

Rosenthal, Marjorie S.; Ross, Joseph S.; Bilodeau, RoseAnne; Richter, Rosemary S.; Palley, Jane E.; Bradley, Elizabeth H.

2011-01-01

Background Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic are effective in reducing births among enrolled teenagers. However, there have been limited data on costs and cost-effectiveness of such programs. Objectives To use a community-based participatory research approach, to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Methods Using data from 1997-2003, we conducted an in-time intervention analysis to determine program cost-benefit while teenagers were enrolled and then used an extrapolation analysis to estimate accyrred economibc benefits and cost-benefit up to age 30. Results The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage females, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1,599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 on average, with social benefits outweighing total social costs by age 20.1. Conclusions We estimate that this comprehensive teenage pregnancy prevention program would provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost-effectiveness of similarly comprehensive programs when implemented more widely in high-risk neighborhoods. PMID:19896030

Economic evaluation of a comprehensive teenage pregnancy prevention program: pilot program.

Science.gov (United States)

Rosenthal, Marjorie S; Ross, Joseph S; Bilodeau, Roseanne; Richter, Rosemary S; Palley, Jane E; Bradley, Elizabeth H

2009-12-01

Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic support are effective in reducing births among enrolled teenagers. However, there have been limited data on the costs and cost effectiveness of such programs. The study used a community-based participatory research approach to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Using data from 1997-2003, an in-time intervention analysis was conducted to determine program cost-benefit while teenagers were enrolled; an extrapolation analysis was then used to estimate accrued economic benefits and cost-benefit up to age 30 years. The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage girls, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 years on average, with social benefits outweighing total social costs by age 20.1 years. This comprehensive teenage pregnancy prevention program is estimated to provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost effectiveness of similarly comprehensive programs when they are implemented more widely in high-risk neighborhoods.

Accident Sequence Evaluation Program: Human reliability analysis procedure

International Nuclear Information System (INIS)

Swain, A.D.

1987-02-01

This document presents a shortened version of the procedure, models, and data for human reliability analysis (HRA) which are presented in the Handbook of Human Reliability Analysis With emphasis on Nuclear Power Plant Applications (NUREG/CR-1278, August 1983). This shortened version was prepared and tried out as part of the Accident Sequence Evaluation Program (ASEP) funded by the US Nuclear Regulatory Commission and managed by Sandia National Laboratories. The intent of this new HRA procedure, called the ''ASEP HRA Procedure,'' is to enable systems analysts, with minimal support from experts in human reliability analysis, to make estimates of human error probabilities and other human performance characteristics which are sufficiently accurate for many probabilistic risk assessments. The ASEP HRA Procedure consists of a Pre-Accident Screening HRA, a Pre-Accident Nominal HRA, a Post-Accident Screening HRA, and a Post-Accident Nominal HRA. The procedure in this document includes changes made after tryout and evaluation of the procedure in four nuclear power plants by four different systems analysts and related personnel, including human reliability specialists. The changes consist of some additional explanatory material (including examples), and more detailed definitions of some of the terms. 42 refs

Evaluating Teen Pregnancy Prevention Programs: Decades of Evolving Strategies and Practices

Directory of Open Access Journals (Sweden)

Susan Philliber

2015-09-01

Full Text Available This paper reviews the changing strategies for both process and outcome evaluations of teen pregnancy prevention programs over the past few decades. Implementation evaluations have emphasized discovery of what program attributes are most effective in reducing teen pregnancy and its antecedents. Outcome evaluations have moved from collecting data to measure knowledge, attitudes, and program satisfaction to measuring behavior change including postponement of sexual involvement, increased used of contraception, or reduction in teen pregnancy. High quality randomized control trials or quasi-experimental designs are being increasingly emphasized, as are sophisticated analysis techniques using multi-variate analyses, controls for cluster sampling, and other strategies designed to build a more solid knowledge base about how to prevent early pregnancy.

An Evaluation of Two Dating Violence Prevention Programs on a College Campus.

Science.gov (United States)

Peterson, Kerry; Sharps, Phyllis; Banyard, Victoria; Powers, Ráchael A; Kaukinen, Catherine; Gross, Deborah; Decker, Michele R; Baatz, Carrie; Campbell, Jacquelyn

2016-03-13

Dating violence is a serious and prevalent public health problem that is associated with numerous negative physical and psychological health outcomes, and yet there has been limited evaluation of prevention programs on college campuses. A recent innovation in campus prevention focuses on mobilizing bystanders to take action. To date, bystander programs have mainly been compared with no treatment control groups raising questions about what value is added to dating violence prevention by focusing on bystanders. This study compared a single 90-min bystander education program for dating violence prevention with a traditional awareness education program, as well as with a no education control group. Using a quasi-experimental pre-test/post-test design with follow-up at 2 months, a sample of predominately freshmen college students was randomized to either the bystander (n = 369) or traditional awareness (n = 376) dating violence education program. A non-randomized control group of freshmen students who did not receive any education were also surveyed (n = 224). Students completed measures of attitudes, including rape myth acceptance, bystander efficacy, and intent to help as well as behavioral measures related to bystander action and victimization. Results showed that the bystander education program was more effective at changing attitudes, beliefs, efficacy, intentions, and self-reported behaviors compared with the traditional awareness education program. Both programs were significantly more effective than no education. The findings of this study have important implications for future dating violence prevention educational programming, emphasizing the value of bystander education programs for primary dating violence prevention among college students. © The Author(s) 2016.

76 FR 13404 - Cancer Therapy Evaluation Program Intellectual Property Option to Collaborator

Science.gov (United States)

2011-03-11

... Option to Collaborator AGENCY: National Institutes of Health, HHS. ACTION: Notice. SUMMARY: The National... Cancer Therapy Evaluation Program's Intellectual Property Option to Collaborator. [[Page 13405... Evaluation Program (CTEP)'s Intellectual Property Option to Collaborator. The proposed revision represents a...

Evaluation model applied to TRANSPETRO's Marine Terminals Standardization Program

Energy Technology Data Exchange (ETDEWEB)

Almeida, Maria Fatima Ludovico de; Mueller, Gabriela [Pontificia Universidade Catolica do Rio de Janeiro (PUC-Rio), Rio de Janeiro, RJ (Brazil). Instituto Tecnologico; Garcia, Luciano Maldonado [TRANSPETRO - PETROBRAS Transporte S.A., Rio de Janeiro, RJ (Brazil)

2009-07-01

This paper describes an innovative evaluation model applied to TRANSPETRO's 'Marine Terminals Standardization Program' based on updating approaches of programs evaluation and organizational learning. Since the program was launched in 2004, the need for having an evaluation model able to evaluate its implementation progress, to measure the degree of standards compliance and its potential economic, social and environmental impacts has become evident. Within a vision of safe and environmentally responsible operations of marine terminals, this evaluation model was jointly designed by TRANSPETRO and PUC-Rio to promote continuous improvement and learning in operational practices and in the standardization process itself. TRANSPETRO believes that standardization supports its services and management innovation capability by creating objective and internationally recognized parameters, targets and metrology for its business activities. The conceptual model and application guidelines for this important tool are presented in this paper, as well as the next steps towards its implementation. (author)

77 FR 27253 - Proposed Collection, Laura Bush 21st Century Librarian Grant Program Evaluation

Science.gov (United States)

2012-05-09

... Century Librarian Grant Program Evaluation AGENCY: Institute of Museum and Library Services, National... evaluate and make improvements to the Laura Bush 21st Century Librarian (LB21) Grant Program. The... proposes clearance of the Laura Bush 21st Century Librarian Grant Program Evaluation. The 60-day Notice for...

Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

Science.gov (United States)

Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

2016-03-01

Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing

[Evaluation of the impact of a control program against taeniasis-cysticercosis (Taenia solium)].

Science.gov (United States)

de Aluja, Aline S; Suárez-Marín, Raúl; Sciutto-Conde, Edda; Morales-Soto, Julio; Martínez-Maya, José Juan; Villalobos, Nelly

2014-01-01

The impact of a control program is evaluated to eventually eradicate taeniasis-cysticercosis (Taenia solium) based on education and vaccination of pigs. The prevalence of porcine cysticercosis was estimated using tongue inspection, ultrasound and determination of antibodies, before and three years after the application in three regions of the state of Guerrero. A significant reduction in the prevalence of porcine cysticercosis of 7 to 0.5% and 3.6 to 0.3% estimated by tongue examination or ultrasound respectively (ptaeniasis-cysticercosis establishes the program's effectiveness in preventing infection. The sustained presence of antibodies, compatible with contact of Taenia solium or other related helminths, underlines the importance of maintaining interventions to achieve eradication.

Evaluation of an innovative late-life depression training program.

Science.gov (United States)

Smith, Marianne; Stolder, Mary Ellen; Liu, Megan Fang

2014-01-01

This paper describes evaluation findings associated with an innovative, CD-based, self-directed training program that was designed to improve general practice nurses' abilities to identify and care for older adults with depression. A voluntary sample of nurses completed an evaluation that focused on participants' perceptions of changes in their knowledge and skills and usefulness of the program. Quantitative items received high ratings, and narrative responses to open-ended questions were largely positive. Many opportunities exist for psychiatric nurses to facilitate, support, and extend training principles to promote late-life depression recognition and treatment. © 2013 Wiley Periodicals, Inc.

Test and evaluation about damping characteristics of hanger supports for nuclear power plant piping systems (Seismic Damping Ratio Evaluation Program)

International Nuclear Information System (INIS)

Shibata, H.; Ito, A.; Tanaka, K.; Niino, T.; Gotoh, N.

1981-01-01

Generally, damping phenomena of structures and equipments is caused by very complex energy dissipation. Especially, as piping systems are composed of many components, it is very difficult to evaluate damping characteristics of its system theoretically. On the other hand, the damping value for aseismic design of nuclear power plants is very important design factor to decide seismic response loads of structures, equipments and piping systems. The very extensive studies titled SDREP (Seismic Damping Ratio Evaluation Program) were performed to establish proper damping values for seismic design of piping as a joint work among a university, electric companies and plant makers. In SDREP, various systematic vibration tests were conducted to investigate factors which may contribute to damping characteristics of piping systems and to supplement the data of the pre-operating tests. This study is related to the component damping characteristics tests of that program. The object of this study is to clarify damping characteristics and mechanism of hanger supports used in piping systems, and to establish the evaluation technique of dispersing energy at hanger support points and its effect to the total damping ability of piping system. (orig./WL)

Mapping Out Your Success: Using Mind Maps to Evaluate Youth Development Programs

Directory of Open Access Journals (Sweden)

Mary Sara Wells

2009-06-01

Full Text Available A primary component of any youth program is documenting and promoting the results through evaluation. Frequently, however, administrators in youth development programs struggle to find meaningful ways of evaluating the impacts they have on the lives of youth. It is often difficult to capture the unique benefits these programs offer to participants, especially when traditional methods such as focus groups and interviews may be too time consuming and questionnaires may yield poor response rates. This article presents a creative form of evaluation targeted at demonstrating the success of programs in outcomes that are historically more difficult to measure. A “mind map” is designed to be a pictorial representation of the impact of programs in areas such as connections to community organization and adult role models. Employing this technique can enable administrators in youth development programs to demonstrate to stakeholders the benefits they provide in a non-traditional, but highly effective, way.

FHWA research and technology evaluation program summary report spring 2016

Science.gov (United States)

2016-08-01

This report summarizes the 16 evaluations being conducted by the Volpe National Transportation Systems Center on behalf of FHWAs Research and Technology Program. The FHWA R&T Program furthers the Turner-Fairbank Highway Research Centers goal of...

Evaluation of a case-based urology learning program.

Science.gov (United States)

Mishra, Kirtishri; Snow-Lisy, Devon C; Ross, Jonathan; Goldfarb, David A; Goldman, Howard; Campbell, Steven C

2013-12-01

To address the challenges that today's trainees encounter, such as information overload and reduced immersion in the field, and recognizing their preference for novel educational resources, an electronic case-based urology learning program was developed. Each case was designed to illustrate the basic principles of the disease process and the fundamentals of evaluation and management using the Socratic method, recapitulating a prototypical patient encounter. A 21-question survey was developed after review of published reports of classroom and clinical learning environment surveys. The target group was 2 pilot urology training programs (the Cleveland Clinic and University Hospitals-Case Medical Center). The responses were entirely anonymous. A total of 32 trainees participated (8 fellows and 24 residents), representing a 53% response rate. Most trainees (79%) were able to process cases within an average of ≤ 10 minutes. Of the trainees, 91% reported referring back to particular cases for patient care, to review for examinations, or for studying. Most trainees believed a case-based urology learning program would be a potentially important resource for clinical practice (69%) and for preparing for the in-service (63%) or board (69%) examinations. Most trainees believed the program met its goals of illustrating the basics principles of the disease process (88%), outlining the fundamentals of evaluation and management (94%), and improving the trainees' knowledge base (91%). An electronic case-based urology learning program is feasible and useful and stimulates learning at all trainee levels. Copyright © 2013 Elsevier Inc. All rights reserved.

Integrative Reiki for cancer patients: a program evaluation.

Science.gov (United States)

Fleisher, Kimberly A; Mackenzie, Elizabeth R; Frankel, Eitan S; Seluzicki, Christina; Casarett, David; Mao, Jun J

2014-01-01

This mixed methods study sought to evaluate the outcomes of an integrative Reiki volunteer program in an academic medical oncology center setting. We used de-identified program evaluation data to perform both quantitative and qualitative analyses of participants' experiences of Reiki sessions. The quantitative data were collected pre- and postsession using a modified version of the distress thermometer. The pre- and postsession data from the distress assessment were analyzed using a paired Student's : test. The qualitative data were derived from written responses to open-ended questions asked after each Reiki session and were analyzed for key words and recurring themes. Of the 213 pre-post surveys of first-time sessions in the evaluation period, we observed a more than 50% decrease in self-reported distress (from 3.80 to 1.55), anxiety (from 4.05 to 1.44), depression (from 2.54 to 1.10), pain (from 2.58 to 1.21), and fatigue (from 4.80 to 2.30) with P Reiki, we found 176 (82.6%) of participants liked the Reiki session, 176 (82.6%) found the Reiki session helpful, 157 (73.7%) plan to continue using Reiki, and 175 (82.2%) would recommend Reiki to others. Qualitative analyses found that individuals reported that Reiki induced relaxation and enhanced spiritual well-being. An integrative Reiki volunteer program shows promise as a component of supportive care for cancer patients. More research is needed to evaluate and understand the impact that Reiki may have for patients, caregivers, and staff whose lives have been affected by cancer.

Pilot Evaluation Study of the Life Skills Program REBOUND

Directory of Open Access Journals (Sweden)

Henrik Jungaberle

2015-11-01

Full Text Available The main aim of the study is pilot evaluation of the life skills program REBOUND in a school context focusing on substance use, risk perception, and knowledge about psychoactive substances ( n IG + CG = 723 students in five schools and 46 classes, Mage = 14.8, range 14-18 for the total sample and in the subgroups gender, age, and school type. Main goal of the study is collecting evidence for program optimization. A controlled study was carried out with repeated measurement before and after the intervention (4-6 months. Multilevel analyses, ANCOVA, and logistic regression analyses were applied to measure the effects. Overall, significantly lower incidence rates of drunkenness (odds ratio [OR] = .55; p = .033, improved knowledge about psychoactive substances (p = .006, lower personal (p = .013 and general tobacco risk perception among users (p = .002, and lower general tobacco (p = .018 and cannabis (p = .000 risk perception in non-users were found in the total intervention group. In subgroups, significantly lower rates for the incidence of drunkenness can be shown for males (p = .008 and for younger participants (p = .004. Students at academic high school (German Gymnasium showed a decrease in 30-day prevalence for alcohol (p = .017 and cannabis (p = .014, and they improved in their knowledge about psychoactive substances (p = .000. In vocational high school classes (German Realschule, there was an increase in the relative alcohol risk perception of the students (p = .019. REBOUND contributes to a controlled use of alcohol and increases knowledge about psychoactive substances. REBOUND has various effects on the examined subgroups age, gender, and school type: Males, younger students, and students in academic high school benefitted more from the course regarding consumption-related criteria. We suggest a program optimization specific to school form and age, inclusion of a tobacco intervention, and the use of more gender-segregated interventions.

Alpena Community College Commercial Driver's License Program. Evaluation Summary.

Science.gov (United States)

Alpena Community Coll., MI.

The Alpena Community College (ACC) Drivers Education Program was developed to deliver a basic skills program providing specific job-related basic skills instruction to approximately 300 workers throughout Michigan who desired to pass the Commercial Drivers License (CDL) examination. Other program goals were to establish greater partnerships…

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

Science.gov (United States)

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

summarized using descriptive statistics. An inductive approach was used to identify themes in the qualitative data related to the evaluation questions. The findings demonstrated the program was implemented as intended, and that there was a need for the program, with six clients on the 10-month pilot. The findings also indicated achievement of program-level outcomes and progress toward system-level outcomes. Clients/families and healthcare providers were satisfied with the program and perceived it to be meeting its objectives. The program model was also perceived to be transferrable to other First Nations communities. The results demonstrate how a rural First Nations community can build capacity and develop a palliative care program tailored to their unique culture and context that builds upon and is integrated into existing services. The Wiisokotaatiwin Program allowed community members to receive their palliative care at home, improved client experience and enhanced service integration. This article provides a First Nations specific model for a palliative care program that overcomes jurisdictional issues at the local level, and a methodology for developing and evaluating community-based palliative care programs in rural First Nations communities. The article demonstrates how local, federal and provincial healthcare providers and organizations collaborated to build capacity, fund and deliver community-based palliative care. The described process of developing the program has applicability in other First Nations (Indigenous) communities and for healthcare decisionmakers.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

Science.gov (United States)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Developing and implementing an assessment method to evaluate a virtual canine anatomy program.

Science.gov (United States)

Linton, Andrea; Schoenfeld-Tacher, Regina; Whalen, L Ray

2005-01-01

A computer-based anatomy program, Virtual Canine Anatomy: The Head, was incorporated into a first-year veterinary dissection laboratory two years ago to address challenges inherent in the traditional pedagogical approach. The program uses specimen photographs, QuickTime Virtual Reality, and interactive features to help students study the dissection, osteology, and radiology of the canine head. Photographs of each phase of dissection are displayed in the program, along with dissection instructions. Students can click on anatomical structures in each photograph to highlight the selected structure and display a complete description of it. Related structures and views are accessible through hyperlinks. This study was designed to measure student and faculty attitudes toward the instructional software, to gauge its effect on student achievement, and to propose evaluation methodology and instrumentation for similar projects. Observations, interviews, focus groups, surveys, and test results were used for this assessment. Results suggest positive student and faculty attitudes toward the program. Students felt the program met their needs, increased their confidence and efficiency, and was easy to use. Both students and instructors felt the program was beneficial during dissection. There was no significant change in student achievement on course tests. Future research will measure the program's effect on student-instructor interactions.

Risk evaluation for motor operated valves in an Inservice Testing Program at a PWR nuclear power plant in Taiwan

International Nuclear Information System (INIS)

Li, Y.C.; Chen, K.T.; Su, Y.L.; Ting, K.; Chien, F.T.; Li, G.D.; Huang, S.H.

2012-01-01

Safety related valves such as Motor Operated Valves (MOV), Air Operated Valves (AOV) or Check Valves (CV) play an important role in nuclear power plant. Functioning of these valves mainly aim at emergency reactivity control, post-accident residue heat removal, post-accident radioactivity removal and containment isolation when a design basis accident occurred. In order to maintain these valves under operable conditions, an Inservice Testing Program (IST) is defined for routine testing tasks based on the ASME Boiler and Pressure Vessel Code section XI code requirements. Risk based Inservice Testing Programs have been studied and developed extensively in the nuclear energy industry since the 1990s. Risk Based evaluations of IST can bring positive advantages to the licensee such as identifying the vulnerability of the system, reducing unnecessary testing burden, concentrating testing resources on the critical pass oriented valves and saving plant’s personnel dose exposure. This risk evaluation is incorporated with quantitative and qualitative analyses to the Motor Operated Valves under current Inservice Testing Program for PWR nuclear power plant in Taiwan. With the outcome of the risk classifications for the safety related MOVs through numerical or deterministic analyses, a risk based testing frequency relief is suggested to demonstrate the benefits received from the risk based Inservice Testing Program. The goal made of this study, it could be as a reference and cornerstone for the licensee to perform overall scope Risk-Informed Inservice Testing Program (RI-IST) evaluation by referring relevant methodologies established in this study.

Evaluation of the Tier 1 Program of Project P.A.T.H.S.: Secondary Data Analyses of Conclusions Drawn by the Program Implementers

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2008-01-01

Full Text Available The Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes is a curricula-based positive youth development program. In the experimental implementation phase, 52 schools participated in the program. Based on subjective outcome evaluation data collected from the program participants (Form A and program implementers (Form B in each school, the program implementers were invited to write down five conclusions based on an integration of the evaluation findings (N = 52. The conclusions stated in the 52 evaluation reports were further analyzed via secondary data analyses in this paper. Results showed that most of the conclusions concerning perceptions of the Tier 1 Program, instructors, and effectiveness of the programs were positive in nature. There were also conclusions reflecting the respondents’ appreciation of the program. Finally, responses on the difficulties encountered and suggestions for improvements were observed. In conjunction with the previous evaluation findings, the present study suggests that the Tier 1 Program was well received by the stakeholders and the program was beneficial to the development of the program participants.

Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program

Directory of Open Access Journals (Sweden)

Ebrahim Jaafaripooyan

2014-09-01

Full Text Available Background Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs and professionals were approached for two-stage process of data collection. Results Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

The Lassen Astrobiology Intern Program - Concept, Implementation and Evaluation

Science.gov (United States)

Des Marais, D. J.; Dueck, S. L.; Davis, H. B.; Parenteau, M. N.; Kubo, M. D.

2014-12-01

The program goal was to provide a hands-on astrobiology learning experience to high school students by introducing astrobiology and providing opportunities to conduct field and lab research with NASA scientists. The program sought to increase interest in interdisciplinary science, technology, engineering, math and related careers. Lassen Volcanic National Park (LVNP), Red Bluff High School and the Ames Team of the NASA Astrobiology Institute led the program. LVNP was selected because it shares aspects of volcanism with Mars and it hosts thermal springs with microbial mat communities. Students documented volcanic deposits, springs and microbial mats. They analyzed waters and sampled rocks, water and microorganisms. They cultured microorganisms and studied chemical reactions between rocks and simulated spring waters. Each student prepared a report to present data and discuss relationships between volcanic rocks and gases, spring waters and microbial mats. At a "graduation" event the students presented their findings to the Red Bluff community. They visited Ames Research Center to tour the facilities and learn about science and technology careers. To evaluate program impact, surveys were given to students after lectures, labs, fieldwork and discussions with Ames scientists. Students' work was scored using rubrics (labs, progress reports, final report, presentation). Students took pre/post tests on core astrobiology concepts. Parents, teachers, rangers, Ames staff and students completed end-of-year surveys on program impact. Several outcomes were documented. Students had a unique and highly valued learning experience with NASA scientists. They understood what scientists do through authentic scientific work, and what scientists are like as individuals. Students became knowledgeable about astrobiology and how it can be pursued in the lab and in the field. The students' interest increased markedly in astrobiology, interdisciplinary studies and science generally.

Self–Evaluation of Distance Learning Study Program as a Part of Internal Quality Assurance

Directory of Open Access Journals (Sweden)

Radojka Krneta

2012-02-01

Full Text Available This paper features quality assurance of specific distance learning master study program through self-evaluation. This unique program involving e-learning as the program content, as well as delivery method, is presented in the paper from the aspects of its quality assurance. Student evaluation of this study program as a part of the internal quality assurance is performed at the end of every school year in the aim of its quality assurance. Results and conclusions of self-evaluation conducted in this school year by known SEVAQ+ evaluation tool are presented here.

Assessment and Evaluation of the Utah Master Naturalist Program: Implications for Targeting Audiences

Science.gov (United States)

Larese-Casanova, Mark

2011-01-01

The Utah Master Naturalist Program trains citizens who provide education, outreach, and service to promote citizen stewardship of natural resources within their communities. In 2007-2008, the Watersheds module of the program was evaluated for program success, and participant knowledge was assessed. Assessment and evaluation results indicated that…

The effect of supervised Tai Chi intervention compared to a physiotherapy program on fall-related clinical outcomes: a randomized clinical trial.

Science.gov (United States)

Tousignant, Michel; Corriveau, Hélène; Roy, Pierre-Michel; Desrosiers, Johanne; Dubuc, Nicole; Hébert, Réjean; Tremblay-Boudreault, Valérie; Beaudoin, Audrée-Jeanne

2012-01-01

To assess some fall-related clinical variables (balance, gait, fear of falling, functional autonomy, self-actualization and self-efficacy) that might explain the fact that supervised Tai Chi has a better impact on preventing falls compared to a conventional physiotherapy program. The participants (152 older adults over 65 who were admitted to a geriatric day hospital program) were randomly assigned to either a supervised Tai Chi group or the usual physiotherapy. The presence of the clinical variables related to falls was evaluated before the intervention (T1), immediately after (T2), and 12 months after the end of the intervention (T3). Both exercise programs significantly improved fall-related outcomes but only the Tai Chi intervention group decreased the incidence of falls. For both groups, most variables followed the same pattern, i.e. showed significant improvement with the intervention between T1 and T2, and followed by a statistically significant decrease at the T3 evaluation. However, self-efficacy was the only variable that improved solely with the Tai Chi intervention (p = 0.001). The impact of supervised Tai Chi on fall prevention can not be explained by a differential effect on balance, gait and fear of falling. It appeared to be related to an increase of general self-efficacy, a phenomenon which is not seen in the conventional physiotherapy program.

The Evaluator's Role in Recommending Program Closure: A Model for Decision Making and Professional Responsibility

Science.gov (United States)

Eddy, Rebecca M.; Berry, Tiffany

2009-01-01

Evaluators face challenges when programs consistently fail to meet expectations for performance or improvement and consequently, evaluators may recommend that closing a program is the most prudent course of action. However, the evaluation literature provides little guidance regarding when an evaluator might recommend program closure. Given…

Energy poverty reduction by fuel switching. Impact evaluation of the LPG conversion program in Indonesia

International Nuclear Information System (INIS)

Andadari, Roos Kities; Mulder, Peter; Rietveld, Piet

2014-01-01

In low- and middle-income countries, Liquefied Petroleum Gas (LPG) can be an attractive alternative to the widespread use of traditional kerosene. Not only is LPG a relatively clean, safe and cost-effective fuel for households, its large-scale adoption also reduces the heavy burden of kerosene consumption subsidies on government budgets. Against this background, we evaluate the impact of a large government program to substitute LPG for kerosene in Indonesia. Using a household survey across urban, suburban and rural regions we find that this program was very effective in causing a large scale shift from kerosene to LPG. This shift was positively influenced by level of education, household size and household income. Contradicting the energy-ladder model, the LPG program, reinforced by an increase in the price of kerosene, led to increased stacking of fuels, including increasing consumption of both electricity and traditional biomass. In addition, our analysis shows that the LPG program failed to substantially reduce the overall number of energy-poor people, but it has been effective in alleviating extreme energy-poverty. Finally, we find that medium and higher income households in suburban areas benefitted most from the LPG program. - Highlights: • Impact evaluation of a government program to substitute LPG for kerosene in Indonesia. • The program caused a large scale shift from kerosene to LPG. • Contradicting the energy-ladder model, the program led to increased stacking of fuels. • The program did not substantially reduce overall energy poverty, but alleviated extreme energy-poverty. • Medium and higher income households in suburban areas benefitted most from the LPG program