Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

NASA Astrophysics E/PO Impact: NASA SOFIA AAA Program Evaluation Results

Science.gov (United States)

Harman, Pamela; Backman, Dana E.; Clark, Coral; Inverness Research Sofia Aaa Evaluation Team, Wested Sofia Aaa Evaluation Team

2015-01-01

SOFIA is an airborne observatory, studying the universe at infrared wavelengths, capable of making observations that are impossible for even the largest and highest ground-based telescopes. SOFIA also inspires the development of new scientific instrumentation and fosters the education of young scientists and engineers.SOFIA is an 80% - 20% partnership of NASA and the German Aerospace Center (DLR), consisting of an extensively modified Boeing 747SP aircraft carrying a reflecting telescope with an effective diameter of 2.5 meters (100 inches). The SOFIA aircraft is based at NASA Armstrong Flight Research Center, Building 703, in Palmdale, California. The Science Program and Outreach Offices are located at NASA Ames Research center. SOFIA is a program in NASA's Science Mission Directorate, Astrophysics Division.Data will be collected to study many different kinds of astronomical objects and phenomena, including star cycles, solar system formation, identification of complex molecules in space, our solar system, galactic dust, nebulae and ecosystems.Airborne Astronomy Ambassador (AAA) Program:The SOFIA Education and Communications program exploits the unique attributes of airborne astronomy to contribute to national goals for the reform of science, technology, engineering, and math (STEM) education, and to elevate public scientific and technical literacy.The AAA effort is a professional development program aspiring to improve teaching, inspire students, and inform the community. To date, 55 educators from 21 states; Cycles 0, 1 and 2; have completed their astronomy professional development and their SOFIA science flight experience. Evaluation has confirmed the program's positive impact on the teacher participants, on their students, and in their communities. The inspirational experience has positively impacted their practice and career trajectory. AAAs have incorporated content knowledge and specific components of their experience into their curricula, and have given

[Promotion of media competence and prevention of cyberbullying using the Medienhelden program: results from an evaluation study ].

Science.gov (United States)

Scheithauer, Herbert; Schultze-Krumbholz, Anja; Wölfer, Ralf; Zagorscak, Pavle

2014-01-01

The manualized Medienhelden (engl. Media Heroes) program (Schultze-Krumbholz, Zagorscak, Siebenbrock, Scheithauer, 2012) is implemented in the school environment either as a ten-week program during lessons (curriculum; IGL) or as a single project day with reduced content of the long version (IGK). In consecutive lessons, topics of the program are, for example: definition of cyberbullying, its negative impact, how to protect oneself on the internet, and opportunities to react in appropriate ways. The program utilizes mainly cognitive-behavioral methods. In the present contribution the program and selected results from a controlled, pre-follow-up evaluation study with 570 adolescents (Ncontrolgroup = 289, NIGK = 98 and NIGL = 183), from one general high school and four college preparatory high schools from a German major city will be presented. Results show that cyberbullying decreased in both intervention groups (project day, curriculum) compared to the control group while at the same time an increase of social competencies, self-esteem, and subjective health was observed. These effects were more pronounced for the curriculum intervention group. An opposite pattern was found for the control group: Cyberbullying and empathy worsened, and no change was found for perspective-taking, self-esteem, and subjective health. The program shows both preventive and intervention effects.

Reporting Newborn Audiologic Results to State EHDI Programs.

Science.gov (United States)

Chung, Winnie; Beauchaine, Kathryn L; Grimes, Alison; O'Hollearn, Tammy; Mason, Craig; Ringwalt, Sharon

All US states and territories have an Early Hearing Detection and Intervention (EHDI) program to facilitate early hearing evaluation and intervention for infants who are deaf or hard of hearing. To ensure efficient coordination of care, the state EHDI programs rely heavily on audiologists' prompt reporting of a newborn's hearing status. Several states have regulations requiring mandatory reporting of a newborn's hearing status. This is an important public health responsibility of pediatric audiologists. Reasons for failing to report vary. The Early Hearing Detection and Intervention-Pediatric Audiology Links to Services (EHDI) facility survey was used to inform reporting compliance of audiology facilities throughout the United States. The survey was disseminated via articles, newsletters, and call-to-action notices to audiologists. Among 1024 facilities surveyed, 88 (8.6%) reported that they did not report newborn's hearing findings to their state EHDI program. Not knowing how to report to the state EHDI program was the most frequently chosen reason (60%). However, among the 936 facilities that were compliant with the reporting requirements, 51 estimated that they reported less than two-third of all hearing evaluation results (5.4%). Some facilities did not report a normal-hearing result and some failed to report because they assumed another facility would report the hearing results. Survey results indicated that audiologists were compliant reporting hearing results to the state EHDI programs. However, there is room for improvement. Regular provider outreach and training by the state EHDI program is necessary to ensure those who are not reporting will comply and to clarify reporting requirements for those who are already compliant.

Applying national survey results for strategic planning and program improvement: the National Diabetes Education Program.

Science.gov (United States)

Griffey, Susan; Piccinino, Linda; Gallivan, Joanne; Lotenberg, Lynne Doner; Tuncer, Diane

2015-02-01

Since the 1970s, the federal government has spearheaded major national education programs to reduce the burden of chronic diseases in the United States. These prevention and disease management programs communicate critical information to the public, those affected by the disease, and health care providers. The National Diabetes Education Program (NDEP), the leading federal program on diabetes sponsored by the National Institutes of Health (NIH) and the Centers for Disease Control and Prevention (CDC), uses primary and secondary quantitative data and qualitative audience research to guide program planning and evaluation. Since 2006, the NDEP has filled the gaps in existing quantitative data sources by conducting its own population-based survey, the NDEP National Diabetes Survey (NNDS). The NNDS is conducted every 2–3 years and tracks changes in knowledge, attitudes and practice indicators in key target audiences. This article describes how the NDEP has used the NNDS as a key component of its evaluation framework and how it applies the survey results for strategic planning and program improvement. The NDEP's use of the NNDS illustrates how a program evaluation framework that includes periodic population-based surveys can serve as an evaluation model for similar national health education programs.

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Results of 200 KW fuel cell evaluation programs

Energy Technology Data Exchange (ETDEWEB)

Torrey, J.M.; Merten, G.P. [SAIC, San Diego, CA (United States); Binder, M.J. [Army Construction Engineering Research Labs., Champaign, IL (United States)] [and others

1996-12-31

Science Applications International Corporation (SAIC) has installed six monitoring systems on ONSI Corporation 200 kW phosphoric acid fuel cells. Three of the systems were installed for the U.S. Army Construction Engineering Research Laboratories (USACERL) which is coordinating the Department of Defense (DoD) fuel cell Demonstration Program and three were installed under a contract with the New York State Energy Research and Development Authority (NYSERDA). Monitoring of the three NYSERDA sites has been completed. Monitoring systems for the DoD fuel cells were installed in August, 1996 and thus no operating data was available at the time of this writing, but will be presented at the Fuel Cell Seminar. This paper will present the monitoring configuration and research approach for each program. Additionally, summary performance data is presented for the completed NYSERDA program.

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Energy Conservation Program Evaluation : Practical Methods, Useful Results : Proceedings of the 1987 Conference.

Energy Technology Data Exchange (ETDEWEB)

Argonne National Laboratory; International Conference on Energy Conservation Program Evaluation (3rd : 1987 : Chicago, ILL.)

1987-01-01

The success of cutting-edge evaluation methodologies depends on our ability to merge, manage, and maintain huge amounts of data. Equally important is presenting results of the subsequent analysis in a meaningful way. These topics are addressed at this session. The considerable amounts of data that have been collected about energy conservation programs are rarely used by other researchers, either because they are not available in computerized form or, if they are, because of the difficulties of interpreting someone else's data, format inconsistencies, incompatibility of computers, lack of documentation, data entry errors, and obtaining data use agreements. Even census, RECS, and AHS data can be best used only by a researcher who is intimately familiar with them. Once the data have been accessed and analyzed, the results need to be put in a format that can be readily understood by others. This is a particularly difficult task when submetered data is the basis of the analysis. Stoops and Gilbride will demonstrate their methods of using off-the-shelf graphics software to illustrate complex hourly data from nonresidential buildings.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.

2000-01-01

The action program Energy 2000 has been continually reviewed by independent experts in view of its effects. This resulted in around 50 scientific studies between 1991 and 1999, dealing with different aspects of the program. In the book 'Energy 2000: effects of the program and conclusions from its evaluation', the results of these evaluations are summarised, and conclusions for the design of the follow-up program are drawn. The organisational frame of the program is presented and the question answered whether the determining principles of the program proved practical. Besides, the effects of state intervention, of the conflict solving groups and the voluntary actions of Energy 2000 are appraised. A separate chapter is dedicated to the evaluation strategy of the program, its implementation and the benefits of the evaluations. Propositions for the evaluation of the follow-up program are formulated as well. Dr. Andreas Balthasar is President of the Swiss Evaluation Society. (author)

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Improved self-exclusion program: preliminary results.

Science.gov (United States)

Tremblay, Nicole; Boutin, Claude; Ladouceur, Robert

2008-12-01

The gambling industry has offered self-exclusion programs for quite a long time. Such measures are designed to limit access to gaming opportunities and provide problem gamblers with the help they need to cease or limit their gambling behaviour. However, few studies have empirically evaluated these programs. This study has three objectives: (1) to observe the participation in an improved self-exclusion program that includes an initial voluntary evaluation, phone support, and a mandatory meeting, (2) to evaluate satisfaction and usefulness of this service as perceived by self-excluders, (3) to measure the preliminary impact of this improved program. One hundred sixteen self-excluders completed a questionnaire about their satisfaction and their perception of the usefulness during the mandatory meeting. Among those participants, 39 attended an initial meeting. Comparisons between data collected at the initial meeting and data taken at the final meeting were made for those 39 participants. Data showed that gamblers chose the improved self-exclusion program 75% of the time; 25% preferred to sign a regular self-exclusion contract. Among those who chose the improved service, 40% wanted an initial voluntary evaluation and 37% of these individuals actually attended that meeting. Seventy percent of gamblers came to the mandatory meeting, which was a required condition to end their self-exclusion. The majority of participants were satisfied with the improved self-exclusion service and perceived it as useful. Major improvements were observed between the final and the initial evaluation on time and money spent, consequences of gambling, DSM-IV score, and psychological distress. The applicability of an improved self-exclusion program is discussed and, as shown in our study, the inclusion of a final mandatory meeting might not be so repulsive for self-excluders. Future research directives are also proposed.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Active Aging Promotion: Results from the Vital Aging Program

Directory of Open Access Journals (Sweden)

Mariagiovanna Caprara

2013-01-01

Full Text Available Active aging is one of the terms in the semantic network of aging well, together with others such as successful, productive, competent aging. All allude to the new paradigm in gerontology, whereby aging is considered from a positive perspective. Most authors in the field agree active aging is a multidimensional concept, embracing health, physical and cognitive fitness, positive affect and control, social relationships and engagement. This paper describes Vital Aging, an individual active aging promotion program implemented through three modalities: Life, Multimedia, and e-Learning. The program was developed on the basis of extensive evidence about individual determinants of active aging. The different versions of Vital Aging are described, and four evaluation studies (both formative and summative are reported. Formative evaluation reflected participants’ satisfaction and expected changes; summative evaluations yielded some quite encouraging results using quasi-experimental designs: those who took part in the programs increased their physical exercise, significantly improved their diet, reported better memory, had better emotional balance, and enjoyed more cultural, intellectual, affective, and social activities than they did before the course, thus increasing their social relationships. These results are discussed in the context of the common literature within the field and, also, taking into account the limitations of the evaluations accomplished.

Active aging promotion: results from the vital aging program.

Science.gov (United States)

Caprara, Mariagiovanna; Molina, María Ángeles; Schettini, Rocío; Santacreu, Marta; Orosa, Teresa; Mendoza-Núñez, Víctor Manuel; Rojas, Macarena; Fernández-Ballesteros, Rocío

2013-01-01

Active aging is one of the terms in the semantic network of aging well, together with others such as successful, productive, competent aging. All allude to the new paradigm in gerontology, whereby aging is considered from a positive perspective. Most authors in the field agree active aging is a multidimensional concept, embracing health, physical and cognitive fitness, positive affect and control, social relationships and engagement. This paper describes Vital Aging, an individual active aging promotion program implemented through three modalities: Life, Multimedia, and e-Learning. The program was developed on the basis of extensive evidence about individual determinants of active aging. The different versions of Vital Aging are described, and four evaluation studies (both formative and summative) are reported. Formative evaluation reflected participants' satisfaction and expected changes; summative evaluations yielded some quite encouraging results using quasi-experimental designs: those who took part in the programs increased their physical exercise, significantly improved their diet, reported better memory, had better emotional balance, and enjoyed more cultural, intellectual, affective, and social activities than they did before the course, thus increasing their social relationships. These results are discussed in the context of the common literature within the field and, also, taking into account the limitations of the evaluations accomplished.

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

practices include selecting appropriate data collection methods given a program's duration and corresponding intended outcomes. Data collection methods for programs of short duration might involve simple evaluation activities, whereas programs of longer duration might involve ongoing data collection measures including longitudinal student surveys, implementation logs, student journals, and student achievement measures. During our presentation, we will share examples from our own experience to illustrate how effective evaluation practices can be applied to various EPO programs based on program duration. Irrespective of duration, we find that EPO program developers and providers want both formative feedback to guide improvements and summative feedback on outcomes. More often than not, evaluation budgets for EPO programs are meager at best, yet come with the same information needs and priorities as programs with larger evaluation budgets. So how do program providers get the information they need given their limited funds for evaluation? We will offer several recommendations for helping EPO program providers work with evaluators to become better-informed consumers of evaluation by maximizing evaluation offerings and minimizing costs. During our presentation we also will share examples of communicating and reporting results for EPO program developers, EPO facilitators and practitioners, and funders.

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Strategies and policies for improving energy efficiency programs: Closing the loop between evaluation and implementation

International Nuclear Information System (INIS)

Vine, Edward

2008-01-01

Program implementers often use evaluation results to improve the performance of their programs, but, as described in this paper, this is not always the case. Based on a review of the literature, participation in workshops, and interviews with over 50 program implementers, evaluators, and regulators in the United States and Canada, the utilization of evaluation results is investigated by asking the following questions: (1) How are program evaluation results used by program implementers and other stakeholders? (2) How are program evaluation results communicated to program implementers and other stakeholders? (3) Are the needs of program implementers being met by program evaluation? (4) What is the role of the utility regulator in facilitating the use of program evaluation results? (5) What other mechanisms can facilitate the use of program evaluation results? While there is some consensus on the answers to these questions, the type of interest in and use of evaluation varies by functional role (e.g., evaluator versus implementer), maturity of the energy efficiency market, institutional context (e.g., evaluation and implementation conducted inside the same organization, or evaluation and implementation conducted by separate entities), and by regulatory demands and evaluation interests

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Impact of methodology on the results of economic evaluations of varicella vaccination programs: is it important for decision-making?

Directory of Open Access Journals (Sweden)

Patrícia Coelho de Soárez

2009-01-01

Full Text Available This study aims to review the literature on economic evaluation of childhood varicella vaccination programs and to discuss how heterogeneity in methodological aspects and estimation of parameters can affect the studies' results. After applying the inclusion criteria, 27 studies published from 1980 to 2008 were analyzed in relation to methodological differences. There was great heterogeneity in the perspective adopted, evaluation of indirect costs, type of model used, modeling of the effect on herpes zoster, and estimation of vaccine price and efficacy parameters. The factor with the greatest impact on results was the inclusion of indirect costs, followed by the perspective adopted and vaccine price. The choice of a particular methodological aspect or parameter affected the studies' results and conclusions. It is essential that authors present these choices transparently so that users of economic evaluations understand the implications of such choices and the direction in which the results of the analysis were conducted.

Cost-effectiveness of an exercise program during pregnancy to prevent gestational diabetes: Results of an economic evaluation alongside a randomised controlled trial

Directory of Open Access Journals (Sweden)

Oostdam Nicolette

2012-07-01

Full Text Available Abstract Background The prevalence of gestational diabetes mellitus (GDM is increasing worldwide. GDM and the risks associated with GDM lead to increased health care costs and losses in productivity. The objective of this study is to evaluate whether the FitFor2 exercise program during pregnancy is cost-effective from a societal perspective as compared to standard care. Methods A randomised controlled trial (RCT and simultaneous economic evaluation of the FitFor2 program were conducted. Pregnant women at risk for GDM were randomised to an exercise program to prevent high maternal blood glucose (n = 62 or to standard care (n = 59. The exercise program consisted of two sessions of aerobic and strengthening exercises per week. Clinical outcome measures were maternal fasting blood glucose levels, insulin sensitivity and infant birth weight. Quality of life was measured using the EuroQol 5-D and quality-adjusted life-years (QALYs were calculated. Resource utilization and sick leave data were collected by questionnaires. Data were analysed according to the intention-to-treat principle. Missing data were imputed using multiple imputations. Bootstrapping techniques estimated the uncertainty surrounding the cost differences and incremental cost-effectiveness ratios. Results There were no statistically significant differences in any outcome measure. During pregnancy, total health care costs and costs of productivity losses were statistically non-significant (mean difference €1308; 95%CI €-229 - €3204. The cost-effectiveness analyses showed that the exercise program was not cost-effective in comparison to the control group for blood glucose levels, insulin sensitivity, infant birth weight or QALYs. Conclusion The twice-weekly exercise program for pregnant women at risk for GDM evaluated in the present study was not cost-effective compared to standard care. Based on these results, implementation of this exercise program for the prevention of

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

The German carbide program: Performance, experimental findings, and evaluation of irradiation results

International Nuclear Information System (INIS)

Steiner, H.; Freund, D.; Geithoff, D.

1982-09-01

In this report a synopsis of the German carbide program is presented. The program comprises the irradiation of about 100 carbide pins equipped with pelletted fuel. Most of these fuel pins were He-bonded, the sodium bonding concept taken as a back-up solution. The main design parameters such as smear and pellet density, gap size, pin diameter and wall thickness as well as the irradiation conditions were varied mostly within wide ranges. Based on a compilation of relevant pin parameters, irradiation conditions, and the results of various irradiation experiments conclusions on the optimum ranges of the main design parameters are drawn. Furthermore, some important aspects of fuel pin behaviour are discussed based on quantitative results from post irradiation examinations. (orig.) [de

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Organizational Structures that Support Internal Program Evaluation

Science.gov (United States)

Lambur, Michael T.

2008-01-01

This chapter explores how the structure of large complex organizations such as Cooperative Extension affects their ability to support internal evaluation of their programs and activities. Following a literature review of organizational structure and its relation to internal evaluation capacity, the chapter presents the results of interviews with…

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Battelle integrity of nuclear piping program. Summary of results and implications for codes/standards

International Nuclear Information System (INIS)

Miura, Naoki

2005-01-01

The BINP(Battelle Integrity of Nuclear Piping) program was proposed by Battelle to elaborate pipe fracture evaluation methods and to improve LBB and in-service flaw evaluation criteria. The program has been conducted from October 1998 to September 2003. In Japan, CRIEPI participated in the program on behalf of electric utilities and fabricators to catch up the technical backgrounds for possible future revision of LBB and in-service flaw evaluation standards and to investigate the issues needed to be reflected to current domestic standards. A series of the results obtained from the program has been well utilized for the new LBB Regulatory Guide Program by USNRC and for proposal of revised in-service flaw evaluation criteria to the ASME Code Committee. The results were assessed whether they had implications for the existing or future domestic standards. As a result, the impact of many of these issues, which were concerned to be adversely affected to LBB approval or allowable flaw sizes in flaw evaluation criteria, was found to be relatively minor under actual plant conditions. At the same time, some issues that needed to be resolved to address advanced and rational standards in the future were specified. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Current results for the NRC's short cracks in piping and piping welds research program

International Nuclear Information System (INIS)

Wilkowski, G.; Krishnaswamy, P. Brust, F.; Francini, R.; Ghadiali, N.; Kilinski, T.; Marschall, C.; Rahman, S.; Rosenfield, A.; Scott, P.

1994-01-01

The overall objective of the Short Cracks in Piping and Piping Welds Program is to verify and improve engineering analyses to predict the fracture behavior of circumferentially cracked pipe under quasi-static loading with particular attention to crack lengths typically used in LBB or flaw evaluation criteria. The program consists of 8 technical tasks as listed below. Task 1 Short through-wall-cracked (TWC) pipe evaluations. Task 2 Short surface-cracked pipe evaluations. Task 3 Bi-metallic weld crack evaluations. Task 4 Dynamic strain aging and crack instabilities. Task 5 Fracture evaluations of anisotropic pipe. Task 6 Crack-opening-area evaluations. Task 7 NRCPIPE Code improvements. Task 8 Additional efforts. Since the last WRSM meeting several additional tasks have been initiated in this program. These are discussed in Task 8. Based on results to date, the first seven tasks have also been modified as deemed necessary. The most significant accomplishments in each of these tasks since the last WRSIM meeting are discussed below. The details of all the results presented here are published in the semiannual reports from this program

AAAS Communicating Science Program: Reflections on Evaluation

Science.gov (United States)

Braha, J.

2015-12-01

The AAAS Center for Public Engagement (Center) with science builds capacity for scientists to engage public audiences by fostering collaboration among natural or physical scientists, communication researchers, and public engagement practitioners. The recently launched Leshner Leadership Institute empowers cohorts of mid-career scientists to lead public engagement by supporting their networks of scientists, researchers, and practitioners. The Center works closely with social scientists whose research addresses science communication and public engagement with science to ensure that the Communicating Science training program builds on empirical evidence to inform best practices. Researchers ( Besley, Dudo, & Storkdieck 2015) have helped Center staff and an external evaluator develop pan instrument that measures progress towards goals that are suggested by the researcher, including internal efficacy (increasing scientists' communication skills and confidence in their ability to engage with the public) and external efficacy (scientists' confidence in engagement methods). Evaluation results from one year of the Communicating Science program suggest that the model of training yields positive results that support scientists in the area that should lead to greater engagement. This talk will explore the model for training, which provides a context for strategic communication, as well as the practical factors, such as time, access to public engagement practitioners, and technical skill, that seems to contribute to increased willingness to engage with public audiences. The evaluation program results suggest willingness by training participants to engage directly or to take preliminary steps towards engagement. In the evaluation results, 38% of trained scientists reported time as a barrier to engagement; 35% reported concern that engagement would distract from their work as a barrier. AAAS works to improve practitioner-researcher-scientist networks to overcome such barriers.

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

Broadening measures of success: results of a behavioral health translational research training program.

Science.gov (United States)

Baldwin, Julie A; Williamson, Heather J; Eaves, Emery R; Levin, Bruce L; Burton, Donna L; Massey, Oliver T

2017-07-24

While some research training programs have considered the importance of mentoring in inspiring professionals to engage in translational research, most evaluations emphasize outcomes specific to academic productivity as primary measures of training program success. The impact of such training or mentoring programs on stakeholders and local community organizations engaged in translational research efforts has received little attention. The purpose of this evaluation is to explore outcomes other than traditional academic productivity in a translational research graduate certificate program designed to pair graduate students and behavioral health professionals in collaborative service-learning projects. Semi-structured qualitative interviews with scholars, community mentors, and academic mentors were conducted regarding a translational research program to identify programmatic impacts. Interviews were transcribed and coded by the research team to identify salient themes related to programmatic outcomes. Results are framed using the Translational Research Impact Scale which is organized into three overarching domains of potential impact: (1) research-related impacts, (2) translational impacts, and (3) societal impacts. This evaluation demonstrates the program's impact in all three domains of the TRIS evaluation framework. Graduate certificate participants (scholars) reported that gaining experience in applied behavioral health settings added useful skills and expertise to their present careers and increased their interest in pursuing translational research. Scholars also described benefits resulting from networks gained through participation in the program, including valuable ties between the university and community behavioral health organizations. This evaluation of the outcomes of a graduate certificate program providing training in translational research highlights the need for more community-oriented and practice-based measures of success. Encouraging practitioner

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

Science.gov (United States)

This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

Cost-effectiveness of an exercise program during pregnancy to prevent gestational diabetes: results of an economic evaluation alongside a randomised controlled trial.

Science.gov (United States)

Oostdam, Nicolette; Bosmans, Judith; Wouters, Maurice G A J; Eekhoff, Elisabeth M W; van Mechelen, Willem; van Poppel, Mireille N M

2012-07-04

The prevalence of gestational diabetes mellitus (GDM) is increasing worldwide. GDM and the risks associated with GDM lead to increased health care costs and losses in productivity. The objective of this study is to evaluate whether the FitFor2 exercise program during pregnancy is cost-effective from a societal perspective as compared to standard care. A randomised controlled trial (RCT) and simultaneous economic evaluation of the FitFor2 program were conducted. Pregnant women at risk for GDM were randomised to an exercise program to prevent high maternal blood glucose (n = 62) or to standard care (n = 59). The exercise program consisted of two sessions of aerobic and strengthening exercises per week. Clinical outcome measures were maternal fasting blood glucose levels, insulin sensitivity and infant birth weight. Quality of life was measured using the EuroQol 5-D and quality-adjusted life-years (QALYs) were calculated. Resource utilization and sick leave data were collected by questionnaires. Data were analysed according to the intention-to-treat principle. Missing data were imputed using multiple imputations. Bootstrapping techniques estimated the uncertainty surrounding the cost differences and incremental cost-effectiveness ratios. There were no statistically significant differences in any outcome measure. During pregnancy, total health care costs and costs of productivity losses were statistically non-significant (mean difference €1308; 95%CI €-229 - €3204). The cost-effectiveness analyses showed that the exercise program was not cost-effective in comparison to the control group for blood glucose levels, insulin sensitivity, infant birth weight or QALYs. The twice-weekly exercise program for pregnant women at risk for GDM evaluated in the present study was not cost-effective compared to standard care. Based on these results, implementation of this exercise program for the prevention of GDM cannot be recommended. NTR1139.

Results of scatterometer systems analysis for NASA/MSC Earth Observation Sensor Evaluation Program.

Science.gov (United States)

Krishen, K.; Vlahos, N.; Brandt, O.; Graybeal, G.

1971-01-01

Radar scatterometers have applications in the NASA/MSC Earth Observation Aircraft Program. Over a period of several years, several missions have been flown over both land and ocean. In this paper a system evaluation of the NASA/MSC 13.3-GHz Scatterometer System is presented. The effects of phase error between the Scatterometer channels, antenna pattern deviations, aircraft attitude deviations, environmental changes, and other related factors such as processing errors, system repeatability, and propeller modulation, were established. Furthermore, the reduction in system errors and calibration improvement was investigated by taking into account these parameter deviations. Typical scatterometer data samples are presented.

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. (eds.); Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Evaluation of LLTR series II test A-7 results

International Nuclear Information System (INIS)

Knittle, D.E.; Amos, J.C.; Yang, T.M.

1981-09-01

This report evaluates the test A-7 data and assesses the capability of the analytical methodology (as a result of Series I program) to predict the thermal/hydraulic phenomena associated with a large SWR event occurring after the sodium system pressure has increased to near the rupture disc burst pressure due to a smaller size leak event. Evaluation of intertest examination data to determine the extent of test article damage resulting from test A-7 is also included

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Evaluation of a quality control program in radiodiagnosis

International Nuclear Information System (INIS)

Yacovenco, Alejandro; Infantosi, A.F.C.; Tauhata, L.

1996-01-01

A quality assurance program, implemented at the Radiologic Service of the Hospital of the Military Police in Rio de Janeiro, Brazil, is evaluated. The results show a reduction around of 70% in the number of rejected films and 75% in the costs. A return to the former conditions is reported as after the discontinuation of the program

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

[Evaluating the effectiveness of a disease management program diabetes in the German Statutory Health Insurance: first results and methodological considerations].

Science.gov (United States)

Drabik, Anna; Graf, Christian; Büscher, Guido; Stock, Stephanie

2012-01-01

Disease management programs (DMPs) were implemented in the German Statutory Health Insurance (SHI) in a nationwide rollout in 2002. The explicit goal of the programs is to improve coordination and quality of care for the chronically ill (Sect. 137f, SGB V). To reach this goal extensive quality assurance measures in the programs are mandatory, enrolment and coordination of care rests with the primary care or DMP physician, treatment is based on evidence-based care guidelines, and patients are offered diabetes education classes to support self-management. The present study evaluates the DMP diabetes mellitus type II, a nationwide program offered by the BARMER, a German health insurance company. To minimize selection bias we formed a control group of administrative data using a propensity score matching approach. In comparison to the control group DMP participants have a significantly lower mortality rate, and their average drug and hospital costs are reduced. Enrolled patients also had a lower mean number of hospital stays and shorter hospital stays. These results indicate that the programs meet the initial goal of improving the quality of care for the chronically ill. Copyright © 2011. Published by Elsevier GmbH.

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

Evaluation of Pre-Departure English Training Program

Directory of Open Access Journals (Sweden)

Ali Saukah

2016-02-01

Full Text Available The program evaluation reported in this article covers three batches of participants, from 1996 through 1997, sponsored by the Directorate General of Higher Education projects to prepare faculty members of teacher training institutions for overseas studies. The result outcomes could be achieved when the initial English competence requirred for participating in the program was at least at the Pre-Advanced level. The criterion validity of the TOEFL-Equivalent test developed by the program was assured, and the test could, therefore, be used as a good predictor of the International TOEFL. Other recommendations are also given for the improvement of the planning and implementation of the program in the future

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Evaluating Nutrition Education Programming by Using a Dietary Screener

Science.gov (United States)

Schultz, Jennifer; Litchfield, Ruth

2016-01-01

Short dietary assessment instruments known as screeners have potential for use in evaluating nutrition education programming because detecting change in dietary intake can demonstrate movement toward program goals. Using screeners results in objective dietary intake data but involves less administrative time, training, and cost than other…

Evaluating public participation in environmental decision-making: EPA's superfund community involvement program.

Science.gov (United States)

Susan Charnley; Bruce. Engelbert

2005-01-01

This article discusses an 8-year, ongoing project that evaluates the Environmental Protection Agency's Superfund community involvement program. The project originated as a response to the Government Performance and Results Act, which requires federal agencies to articulate program goals, and evaluate and report their progress in meeting those goals. The evaluation...

Evaluation Strategies for EWP Programs: A Marketing Perspective.

Science.gov (United States)

Turkewych, Christine

1986-01-01

Describes how evaluation strategies can be implemented to increase the effectiveness of English in the Work Place programs. Discusses the design and implementation of the strategy, how to analyze its results and produce a final report, and ways to get the results used. (SED)

Operating experience review for nuclear power plants in the Systematic Evaluation Program

International Nuclear Information System (INIS)

Mays, G.T.; Harrington, K.H.

1982-01-01

The Systematic Evaluation Program Branch (SEPB) of the Nuclear Regulatory Commission (NRC) is conducting the Systematic Evaluation Program (SEP) whose purpose is to determine the safety margins of the design and operation of the eleven oldest operating commercial nuclear power plants in the United States. This paper describes the methodology and results of the operational experience review portion of the SEP evaluation. SEPB will combine the results from these operational reviews with other safety topic evaluations to perform an integrated assessment of the SEP plants

Evaluating the impacts of the clean cities program.

Science.gov (United States)

Qiu, Shiyong; Kaza, Nikhil

2017-02-01

The Department of Energy's Clean Cities program was created in 1993 to reduce petroleum usage in the transportation sector. The program promotes alternative fuels such as biofuels and fuel-saving strategies such as idle reduction and fleet management through coalitions of local government, non-profit, and private actors. Few studies have evaluated the impact of the program because of its complexity that include interrelated strategies of grants, education and training and diversity of participants. This paper uses a Difference-in-Differences (DiD) approach to evaluate the effectiveness of the program between 1990 and 2010. We quantify the effectiveness of the Clean Cities program by focusing on performance measures such as air quality, number of alternative fueling stations, private vehicle occupancy and transit ridership. We find that counties that participate in the program perform better on all these measures compared to counties that did not participate. Compared to the control group, counties in the Clean Cities program experienced a reduction in days with bad air quality (3.7%), a decrease in automobile commuters (2.9%), an overall increase in transit commuters (2.1%) and had greater numbers of new alternative fueling stations (12.9). The results suggest that the program is a qualified success. Copyright © 2016 Elsevier B.V. All rights reserved.

Human Reliability Data Bank: evaluation results

International Nuclear Information System (INIS)

Comer, M.K.; Donovan, M.D.; Gaddy, C.D.

1985-01-01

The US Nuclear Regulatory Commission (NRC), Sandia National Laboratories (SNL), and General Physics Corporation are conducting a research program to determine the practicality, acceptability, and usefulness of a Human Reliability Data Bank for nuclear power industry probabilistic risk assessment (PRA). As part of this program, a survey was conducted of existing human reliability data banks from other industries, and a detailed concept of a Data Bank for the nuclear industry was developed. Subsequently, a detailed specification for implementing the Data Bank was developed. An evaluation of this specification was conducted and is described in this report. The evaluation tested data treatment, storage, and retrieval using the Data Bank structure, as modified from NUREG/CR-2744, and detailed procedures for data processing and retrieval, developed prior to this evaluation and documented in the test specification. The evaluation consisted of an Operability Demonstration and Evaluation of the data processing procedures, a Data Retrieval Demonstration and Evaluation, a Retrospective Analysis that included a survey of organizations currently operating data banks for the nuclear power industry, and an Internal Analysis of the current Data Bank System

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

A Process and Outcome Evaluation of Police Working with Youth Programs

Directory of Open Access Journals (Sweden)

Stephen A. Anderson

2008-09-01

Full Text Available A process and outcome evaluation of 10 Police Working with Youth Programs was conducted. Process results indicated that the core components of the programs were consistent with those identified in previous literature as characteristic of quality youth development programs. Outcome results indicated that youth participants reported significantly improved attitudes toward police and social support received from significant, non-familial adults. Two subgroups of youth, most notably minority youth and younger participants in lower grade levels, reported positive changes in their capacity to resist peer pressures. Minority youth reported positive changes in their sense of mastery over stressful life situations. Relationships between core program components and youth outcomes also were examined. Implications of the findings and future process and outcome evaluations of youth programs are discussed.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Computer programs for evaluation of turbulence characteristics from hot-wire measurements

International Nuclear Information System (INIS)

Vosahlo, L.

1984-06-01

This report describes the set of the computer programs for evaluation of the turbulent flow characteristics from hot-wire experimental data. Three different methods and, in addition, some variants are solved in these programs. This enables a comparison of the results obtained by these methods and the analysis of the influence of individual calculation parameters and calibration coefficients on the evaluated results. The results are printed in lucid numerical tables and written into files for further processing into graphs by plotting routines. (orig.) [de

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Evaluation of Early Performance Results for Massachusetts Homes in the National Grid Pilot Deep Energy Retrofit Program

Energy Technology Data Exchange (ETDEWEB)

Gates, C. [Building Science Corporation, Somerville, MA (United States); Neuhauser, K. [Building Science Corporation, Somerville, MA (United States)

2013-11-01

This research project evaluates post-retrofit performance measurements, energy use data and construction costs for 13 projects that participated in the National Grid Deep Energy Retrofit Pilot program. The projects implemented a package of measures defined by performance targets for building enclosure components and building enclosure air tightness. Nearly all of the homes reached a post-retrofit air tightness result of 1.5 ACH 50. Homes that used the chainsaw retrofit technique along with roof insulation, and wall insulation applied to the exterior had the best air tightness results and the lowest heating and cooling source energy use. Analysis of measure costs and project objectives yielded a categorization of costs relative to energy performance objectives. On average about 1/2 of the energy-related measure costs correspond primarily to energy-related objectives, and 20% of energy-related measure costs relate primarily to non-energy objectives.

Evaluation of Early Performance Results for Massachusetts Homes in the National Grid Pilot Deep Energy Retrofit Program

Energy Technology Data Exchange (ETDEWEB)

Neuhauser, K. [Building Science Corporation, Somerville, MA (United States); Gates, C. [Building Science Corporation, Somerville, MA (United States)

2013-11-01

This research project evaluates post-retrofit performance measurements, energy use data and construction costs for 13 projects that participated in the National Grid Deep Energy Retrofit Pilot program. The projects implemented a package of measures defined by performance targets for building enclosure components and building enclosure air tightness. Nearly all of the homes reached a post-retrofit air tightness result of 1.5 ACH 50. Homes that used the chainsaw retrofit technique along with roof insulation, and wall insulation applied to the exterior had the best air tightness results and the lowest heating and cooling source energy use. Analysis of measure costs and project objectives yielded a categorization of costs relative to energy performance objectives. On average about ½ of the energy-related measure costs correspond primarily to energy-related objectives, and 20% of energy-related measure costs relate primarily to non-energy objectives.

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Evaluating disease management program effectiveness: an introduction to time-series analysis.

Science.gov (United States)

Linden, Ariel; Adams, John L; Roberts, Nancy

2003-01-01

Currently, the most widely used method in the disease management (DM) industry for evaluating program effectiveness is referred to as the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer a plausible rationale explaining the change from baseline. Furthermore, with the current inclination of DM programs to use financial indicators rather than program-specific utilization indicators as the principal measure of program success, additional biases are introduced that may cloud evaluation results. This paper presents a non-technical introduction to time-series analysis (using disease-specific utilization measures) as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Assessment and Evaluation of the Utah Master Naturalist Program: Implications for Targeting Audiences

Science.gov (United States)

Larese-Casanova, Mark

2011-01-01

The Utah Master Naturalist Program trains citizens who provide education, outreach, and service to promote citizen stewardship of natural resources within their communities. In 2007-2008, the Watersheds module of the program was evaluated for program success, and participant knowledge was assessed. Assessment and evaluation results indicated that…

Computer programs for TRIGA calibration, burnup evaluation, and bookkeeping

International Nuclear Information System (INIS)

Nelson, George W.

1978-01-01

Several computer programs have been developed at the University of Arizona to assist the direction and operation of the TRIGA Reactor Laboratory. The programs fall into the following three categories: 1. Programs for calculation of burnup of each fuel element in the reactor core, for maintaining an inventory of fuel element location and fissile content at any time, and for evaluation of the reactivity effects of burnup or proposed fuel element rearrangement in the core. 2. Programs for evaluation, function fitting, and tabulation of control rod measurements. 3. Bookkeeping programs to summarize and tabulate reactor runs and irradiations according to time, energy release, purpose, responsible party, etc. These summarized data are reported in an annual operating report for the facility. The use of these programs has saved innumerable hours of repetitious work, assuring more accurate, objective results, and requiring a minimum of effort to repeat calculations when input data are modified. The programs are written in FORTRAN-IV, and have been used on a CDC-6400 computer. (author)

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

Directory of Open Access Journals (Sweden)

Burgers Jako S

2007-11-01

Full Text Available Abstract Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes

Data verification and evaluation techniques for groundwater monitoring programs

International Nuclear Information System (INIS)

Mercier, T.M.; Turner, R.R.

1990-12-01

To ensure that data resulting from groundwater monitoring programs are of the quality required to fulfill program objectives, it is suggested that a program of data verification and evaluation be implemented. These procedures are meant to supplement and support the existing laboratory quality control/quality assurance programs by identifying aberrant data resulting from a variety of unforeseen circumstances: sampling problems, data transformations in the lab, data input at the lab, data transfer, end-user data input. Using common-sense principles, pattern recognition techniques, and hydrogeological principles, a computer program was written which scans the data for suspected abnormalities and produces a text file stating sample identifiers, the suspect data, and a statement of how the data has departed from the expected. The techniques described in this paper have been developed to support the Y-12 Plant Groundwater Protection Program Management Plan

Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

Science.gov (United States)

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Workplace Literacy Program (WPL) at Chinatown Manpower Project, Inc. Final Evaluation.

Science.gov (United States)

Friedenberg, Joan E.

This document describes the procedures for and results of the external evaluation of the workplace literacy program for underemployed garment industry workers with low English skills at Chinatown Manpower Project, Inc. in Chinatown in New York City. The document describes the evaluation design and methodology as well as the evaluation results,…

Seismic II over I Drop Test Program results and interpretation

International Nuclear Information System (INIS)

Thomas, B.

1993-03-01

The consequences of non-seismically qualified (Category 2) objects falling and striking essential seismically qualified (Category 1) objects has always been a significant, yet analytically difficult problem, particularly in evaluating the potential damage to equipment that may result from earthquakes. Analytical solutions for impact problems are conservative and available for mostly simple configurations. In a nuclear facility, the open-quotes sourcesclose quotes and open-quotes targetsclose quotes requiring evaluation are frequently irregular in shape and configuration, making calculations and computer modeling difficult. Few industry or regulatory rules are available on this topic even though it is a source of considerable construction upgrade costs. A drop test program was recently conducted to develop a more accurate understanding of the consequences of seismic interactions. The resulting data can be used as a means to improve the judgment of seismic qualification engineers performing interaction evaluations and to develop realistic design criteria for seismic interactions. Impact tests on various combinations of sources and targets commonly found in one Savannah River Site (SRS) nuclear facility were performed by dropping the sources from various heights onto the targets. This report summarizes results of the Drop Test Program. Force and acceleration time history data are presented as well as general observations on the overall ruggedness of various targets when subjected to impacts from different types of sources

Seismic II over I Drop Test Program results and interpretation

Energy Technology Data Exchange (ETDEWEB)

Thomas, B.

1993-03-01

The consequences of non-seismically qualified (Category 2) objects falling and striking essential seismically qualified (Category 1) objects has always been a significant, yet analytically difficult problem, particularly in evaluating the potential damage to equipment that may result from earthquakes. Analytical solutions for impact problems are conservative and available for mostly simple configurations. In a nuclear facility, the {open_quotes}sources{close_quotes} and {open_quotes}targets{close_quotes} requiring evaluation are frequently irregular in shape and configuration, making calculations and computer modeling difficult. Few industry or regulatory rules are available on this topic even though it is a source of considerable construction upgrade costs. A drop test program was recently conducted to develop a more accurate understanding of the consequences of seismic interactions. The resulting data can be used as a means to improve the judgment of seismic qualification engineers performing interaction evaluations and to develop realistic design criteria for seismic interactions. Impact tests on various combinations of sources and targets commonly found in one Savannah River Site (SRS) nuclear facility were performed by dropping the sources from various heights onto the targets. This report summarizes results of the Drop Test Program. Force and acceleration time history data are presented as well as general observations on the overall ruggedness of various targets when subjected to impacts from different types of sources.

Seismic II over I Drop Test Program results and interpretation

Energy Technology Data Exchange (ETDEWEB)

Thomas, B.

1993-03-01

The consequences of non-seismically qualified (Category 2) objects falling and striking essential seismically qualified (Category 1) objects has always been a significant, yet analytically difficult problem, particularly in evaluating the potential damage to equipment that may result from earthquakes. Analytical solutions for impact problems are conservative and available for mostly simple configurations. In a nuclear facility, the [open quotes]sources[close quotes] and [open quotes]targets[close quotes] requiring evaluation are frequently irregular in shape and configuration, making calculations and computer modeling difficult. Few industry or regulatory rules are available on this topic even though it is a source of considerable construction upgrade costs. A drop test program was recently conducted to develop a more accurate understanding of the consequences of seismic interactions. The resulting data can be used as a means to improve the judgment of seismic qualification engineers performing interaction evaluations and to develop realistic design criteria for seismic interactions. Impact tests on various combinations of sources and targets commonly found in one Savannah River Site (SRS) nuclear facility were performed by dropping the sources from various heights onto the targets. This report summarizes results of the Drop Test Program. Force and acceleration time history data are presented as well as general observations on the overall ruggedness of various targets when subjected to impacts from different types of sources.

Evaluation of an Online Youth Ambassador Program to Promote Mental Health

Science.gov (United States)

Beamish, Nicola; Cannan, Philippa; Fujiyama, Hakuei; Matthews, Allison; Spiranovic, Caroline; Briggs, Kate; Kirkby, Kenneth; Mobsby, Caroline; Daniels, Brett

2011-01-01

This article presents results of an evaluation of an online Youth Ambassador (YA) program designed to promote internet resources for mental health in an adolescent population. Results suggest that an online YA program delivered in school is useful in improving mental health awareness for workshop participants. (Contains 1 table.)

An Evaluation System for the Online Training Programs in Meteorology and Hydrology

Science.gov (United States)

Wang, Yong; Zhi, Xiefei

2009-01-01

This paper studies the current evaluation system for the online training program in meteorology and hydrology. CIPP model that includes context evaluation, input evaluation, process evaluation and product evaluation differs from Kirkpatrick model including reactions evaluation, learning evaluation, transfer evaluation and results evaluation in…

Quantitative Evaluation of the Community Research Fellows Training Program

Directory of Open Access Journals (Sweden)

Lucy eD'Agostino McGowan

2015-07-01

Full Text Available Context: The Community Research Fellows Training (CRFT program is a community-based participatory research (CBPR initiative for the St. Louis area. This fifteen week program, based on a Master in Public Health curriculum, was implemented by the Division of Public Health Sciences at Washington University School of Medicine in partnership with the Siteman Cancer Center. Objectives: We measure the knowledge gained by participants and evaluate participant and faculty satisfaction of the CRFT program both in terms of meeting learning objectives and actively engaging the community in the research process.Participants: We conducted analyses on 44 community members who participated in the CRFT program and completed the baseline and follow-up knowledge assessments.Main Outcome Measures: Knowledge gain is measured by a baseline and follow-up assessment given at the first and final session. Additionally, pre- and post-tests are given after the first 12 sessions. To measure satisfaction, program evaluations are completed by both the participants and faculty after each topic. Mid-way through the program, a mid-term assessment was administered to assess the program’s community engagement. We analyzed the results from the assessments, pre- and post-tests, and evaluations.Results: The CRFT participants’ knowledge increased at follow-up as compared with baseline on average by a 16.5 point difference (p<0.0001. Post-test scores were higher than pre-test scores for 11 of the 12 sessions. Both participants and faculty enjoyed the training and rated all session well.Conclusions: The CRFT program was successful in increasing community knowledge, in participant satisfaction, and in faculty satisfaction. This success has enhanced the infrastructure for CBPR as well as led to CBPR pilot projects that address health disparities in the St. Louis Greater Metropolitan Area.

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Evaluating public involvement in the National Low-Level Radioactive Waste Management Program

International Nuclear Information System (INIS)

1982-09-01

The Department of Energy contracted with the Keystone Center to evaluate the effectiveness of the National Low-Level Radioactive Waste Management Program's public-involvement efforts. The Center chose six evaluators with diverse training and experience related to low-level waste management and public-participation programs. Keystone's evaluation was based on (a) observations by the evaluators who attended the National Program-sponsored strategy review meetings and fairs; (b) interviews with low-level waste generators, local government officials, state legislators, public-interest groups, and members of the general public; and (c) observations of the final National Program strategy task force meeting. The evaluators concluded that, overall, the public-participation processes yielded some very positive results - for policy development and for DOE and the EG and G staff. They judged the strategy document to be complete, concise, and helpful to public dialogue on low-level waste issues. They also made specific recommendations for improvements to the public-participation program

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

Science.gov (United States)

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Targeted breast cancer screening in women younger than 40: results from a statewide program.

Science.gov (United States)

Sarff, MaryClare; Schmidt, Katherine; Vetto, John T

2008-05-01

Our state Breast and Cervical Cancer Program (BCCP) has previously reported a paucity of data supporting breast screening for asymptomatic women younger than 40 (cancer detection rate of .25% per screening-year). In partnership with the local Affiliate of the Susan G. Komen for the Cure Foundation, we began a targeted "screening" program to evaluate women younger than 40 referred for symptoms or other concerns. Retrospective data review of program results, including demographics, symptoms, evaluations performed, and outcomes. A total of 176 women, ages 16 to 39 years, were referred to the BCCP/Komen program. Of the women with documented presenting symptoms, the most common was breast lump (81%). Evaluation triggered 75 surgical referrals and 69 biopsies, yielding 16 cancers (a biopsy positive rate of 23% and overall cancer detection rate from the program of 9%). For women younger than age 40, targeted breast cancer screening is a more efficient utilization of screening resources, with a higher cancer detection rate than asymptomatic screening.

Evaluation of a Life Skills Program for Women Inmates in Michigan.

Science.gov (United States)

Schram, Pamela J.; Morash, Merry

2002-01-01

Describes and evaluates a life skills program that focuses on addressing the special needs of female inmates. Analyses of pre- and post-test scores of program participants compared emotional empathy, self-esteem, coping resources, problem solving, parenting stress, employability, and well-being. Results suggest tat the program does address some of…

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

Science.gov (United States)

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

National Uranium Resource Evaluation Program: the Hydrogeochemical Stream Sediment Reconnaissance Program at LLNL

International Nuclear Information System (INIS)

Higgins, G.H.

1980-08-01

From early 1975 to mid 1979, Lawrence Livermore National Laboratory (LLNL) participated in the Hydrogeochemical Stream Sediment Reconnaissance (HSSR), part of the National Uranium Resource Evaluation (NURE) program sponsored by the Department of Energy (DOE). The Laboratory was initially responsible for collecting, analyzing, and evaluating sediment and water samples from approximately 200,000 sites in seven western states. Eventually, however, the NURE program redefined its sampling priorities, objectives, schedules, and budgets, with the increasingly obvious result that LLNL objectives and methodologies were not compatible with those of the NURE program office, and the LLNL geochemical studies were not relevant to the program goal. The LLNL portion of the HSSR program was consequently terminated, and all work was suspended by June 1979. Of the 38,000 sites sampled, 30,000 were analyzed by instrumental neutron activation analyses (INAA), delayed neutron counting (DNC), optical emission spectroscopy (OES), and automated chloride-sulfate analyses (SC). Data from about 13,000 sites have been formally reported. From each site, analyses were published of about 30 of the 60 elements observed. Uranium mineralization has been identified at several places which were previously not recognized as potential uranium source areas, and a number of other geochemical anomalies were discovered

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Self–Evaluation of Distance Learning Study Program as a Part of Internal Quality Assurance

Directory of Open Access Journals (Sweden)

Radojka Krneta

2012-02-01

Full Text Available This paper features quality assurance of specific distance learning master study program through self-evaluation. This unique program involving e-learning as the program content, as well as delivery method, is presented in the paper from the aspects of its quality assurance. Student evaluation of this study program as a part of the internal quality assurance is performed at the end of every school year in the aim of its quality assurance. Results and conclusions of self-evaluation conducted in this school year by known SEVAQ+ evaluation tool are presented here.

Evaluation of thermal network correction program using test temperature data

Science.gov (United States)

Ishimoto, T.; Fink, L. C.

1972-01-01

An evaluation process to determine the accuracy of a computer program for thermal network correction is discussed. The evaluation is required since factors such as inaccuracies of temperatures, insufficient number of temperature points over a specified time period, lack of one-to-one correlation between temperature sensor and nodal locations, and incomplete temperature measurements are not present in the computer-generated information. The mathematical models used in the evaluation are those that describe a physical system composed of both a conventional and a heat pipe platform. A description of the models used, the results of the evaluation of the thermal network correction, and input instructions for the thermal network correction program are presented.

Nuclear power plant emergency preparedness: results from an evaluation of Michigan's potassium iodide distribution program.

Science.gov (United States)

Zwolinski, Laura R; Stanbury, Martha; Manente, Susan

2012-10-01

In 2009, the Michigan Department of Community Health (MDCH) made potassium iodide (KI), a nonprescription radio-protective drug, available by mailing vouchers redeemable at local pharmacies for KI tablets, at no cost to residents living within 10 miles of Michigan's 3 nuclear power plants (NPPs). MDCH conducted an evaluation of this program to determine Michigan's KI coverage and to assess general emergency preparedness among residents living near the NPPs. KI coverage was estimated based on redeemed voucher counts and the 2010 Census. Telephone surveys were administered to a random sample (N = 153) of residents living near Michigan's NPPs to evaluate general emergency preparedness, reasons for voucher use or nonuse, and KI knowledge. Only 5.3% of eligible residences redeemed KI vouchers. Most surveyed residents (76.5%) were aware of living near an NPP, yet 42.5% reported doing "nothing" to plan for an emergency. Almost half of surveyed voucher users did not know when to take KI or which body part KI protects. Among voucher nonusers, 48.0% were either unaware of the program or did not remember receiving a voucher. Additional efforts are needed to ensure that all residents are aware of the availability of KI and that recipients of the drug understand when and why it should be taken. Minimal emergency planning among residents living near Michigan's NPPs emphasizes the need for increased emergency preparedness and awareness. Findings are particularly salient given the March 2011 Fukushima Daiichi Nuclear Power Plant emergency in Japan.

Educational Program Evaluation Model, From the Perspective of the New Theories

Directory of Open Access Journals (Sweden)

Soleiman Ahmady

2014-05-01

Full Text Available Introduction: This study is focused on common theories that influenced the history of program evaluation and introduce the educational program evaluation proposal format based on the updated theory. Methods: Literature searches were carried out in March-December 2010 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface, ERIC (Education Resources Information Center and the main journal of medical education regarding current evaluation models and theories. We included all study designs in our study. We found 810 articles related to our topic, and finally 63 with the full text article included. We compared documents and used expert consensus for selection the best model. Results: We found that the complexity theory using logic model suggests compatible evaluation proposal formats, especially with new medical education programs. Common components of a logic model are: situation, inputs, outputs, and outcomes that our proposal format is based on. Its contents are: title page, cover letter, situation and background, introduction and rationale, project description, evaluation design, evaluation methodology, reporting, program evaluation management, timeline, evaluation budget based on the best evidences, and supporting documents. Conclusion: We found that the logic model is used for evaluation program planning in many places, but more research is needed to see if it is suitable for our context.

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

Health insurers promoting employee wellness: strategies, program components and results.

Science.gov (United States)

Murphy, Brigid M; Schoenman, Julie A; Pirani, Hafiza

2010-01-01

To examine health insurance companies' role in employee wellness. Case studies of eight insurers. Wellness activities in work, clinical, online, and telephonic settings. Senior executives and wellness program leaders from Blue Cross Blue Shield health insurers and from one wellness organization. Telephone interviews with 20 informants. Health insurers were engaged in wellness as part of their mission to promote health and reduce health care costs. Program components included the following: education, health risk assessments, incentives, coaching, environmental consultation, targeted programming, onsite biometric screening, professional support, and full-time wellness staff. Programs relied almost exclusively on positive incentives to encourage participation. Results included participation rates as high as 90%, return on investment ranging from $1.09 to $1.65, and improved health outcomes. Health insurers have expertise in developing, implementing, and marketing health programs and have wide access to employers and their employees' health data. These capabilities make health insurers particularly well equipped to expand the reach of wellness programming to improve the health of many Americans. By coupling members' medical data with wellness-program data, health insurers can better understand an individual's health status to develop and deliver targeted interventions. Through program evaluation, health insurers can also contribute to the limited but growing evidence base on employee wellness programs.

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Evaluating Additionality of an Innovation Subsidy Program Targeted at SMEs: An Exploratory Study

Directory of Open Access Journals (Sweden)

Sonja Radas

2013-04-01

Full Text Available This paper explores the effectiveness of a recently introduced innovation subsidy program targeted at SMEs in Croatia. Three aspects of program additionality were evaluated: input, output and behavioral aspects. Both qualitative and survey research was employed, and four case studies with selected recipient companies were conducted. This study is a response to the policy-makers’ need for early program assessment. It attempts to show that even with early evaluation and small population of recipients it is possible to gain insight into program effectiveness. The analysis suggests that the effects of programs targeted at innovative SMEs might need to be evaluated differently than general subsidies. This is especially evident in the evaluation of input additionality. The analysis indicates that SMEs which started with a higher R&D capability tend to increase R&D intensity while participating in the program. The program raised R&D and innovation capability of the participating SMEs, but commercialization of project results remains a concern.

Levers supporting program evaluation culture and capacity in Romanian public administration: The role of leadership

OpenAIRE

Cristina Mora; Raluca Antonie

2012-01-01

Program evaluation culture and capacity is at the very beginning of its development in Romania. In this article we highlight one of the fundamental, but not always obvious, connections that support sustainable evaluation culture and capacity building and development: the link between leadership and program evaluation. If properly used, program evaluation results can be a strong instrument in leadership, just as leadership can fundamentally encourage the development of evaluation culture and c...

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

Developing a hazmat incident evaluation program

International Nuclear Information System (INIS)

Williams, D.L.; Kaikumba, F.

1991-01-01

This paper reports that all communities are at risk of experiencing a hazardous materials incident, whether in transportation or at a fixed facility (such as petroleum refineries, oil fields, processing plants, etc.). However, many communities are unprepared to cope with this emergency. Administrators of state agencies and local response organizations often face fierce competition for tax dollars in support of their hazardous materials emergency response programs. Historically, little statistical information has been available to support their call for additional budget dollars in the areas of personnel, training, and equipment. It is difficult to plan for an emergency when you have little understanding of the risks, the frequency of incidents, the type of chemicals generally involved, and other vital information. The Illinois Hazardous Materials Incident Evaluation Program was designed to address the state and local needs, and position government and industry in a more responsive and proactive mode. The result is a program that works

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

Development of detailed analysis program for high-temperature crack growth evaluation

Energy Technology Data Exchange (ETDEWEB)

Takahashi, Yukio; Nakayama, Yasunari [Central Research Inst. of Electric Power Industry, Komae, Tokyo (Japan). Komae Research Lab

2001-04-01

Evaluation of crack growth as well as crack initiation is necessary to make realistic evaluation of structural integrity and life management of high-temperature plant components. Domain integral formulae for three kinds of nonlinear fracture mechanics parameters, i.e. J-integral, fatigue J-integral range and creep J-integral were derived for two-dimensional, three-dimensional and axi-symmetrical structures. Furthermore, methods for applying them to finite element results were derived and a computer program was developed for the general-purpose finite element program, MARC. The program was applied to various problems and its effectiveness was demonstrated. (author)

Curriculum Evaluation and Employers Opinions: the case study of Educational Technology Program in Bachelor Degree (Continuing Program

Directory of Open Access Journals (Sweden)

Nakhon Lalognam

2016-09-01

Full Text Available The purposes of this research were: 1 to evaluate the Educational Technology Program (Continuing Program in Bachelor Degree curriculum which is revised in 2007 by applying CIPP model for evaluation. 2 to study the opinions of the employers about the ideal characteristics and actual characteristics of graduates. 3 to study the opinions for the requirements of the Educational Technology Program in Bachelor Degree (Continuing Program and knowledge implementation in work of graduates. 4 to make the suggestions and guidelines to improve the Educational Technology Program in Bachelor Degree (Continuing Program to achieve potentiality and responsive for the requirements of learners and employers. The sample of this research were 310 persons ; consisted of graduates in the Educational Technology Program in Bachelor Degree (Continuing Program in academic year 2006 - 2010, the committee of the Educational Technology Program in Bachelor Degree (Continuing Program , instructors and employers by using Multi-stage Random Sampling and Simple Random Sampling. The instruments of this research were the 5 levels rating scale questionnaire and the structured interview type. They consisted of 3 sets: 1 for graduates, 2 for the committee of the Educational Technology Program in Bachelor Degree (Continuing Program and 3 for instructors and employers. The research found that: 1. The results of evaluation on the Educational Technology Program in Bachelor Degree (Continuing Program which is revised in 2007 were: 1.1 The opinions of graduates to curriculum in all of aspects were average at the uncertain level which the context aspect was at the high level, input aspect was at the uncertain level, process aspect was at the uncertain level and product aspect was at the high level. 1.2 The opinions of the curriculum committee and instructors to curriculum in all of aspects were average at the high level which the context aspect was at the high level, input aspect was at the

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Toy Control Program evaluation.

Science.gov (United States)

Stewart, H A; Ormond, C; Seeger, B R

1991-08-01

The Toy Control Program for the Apple IIe microcomputer is a software and hardware package developed for the training of single-switch scanning skills. The specially designed scanning programs provide on screen visual feedback and activate a battery-powered toy to reinforce performance. This study examined whether the training of preschool subjects in single-switch scanning skills with the Toy Control Program would result in increased task completion scores and increased levels of attention to task, as compared with conditions of toy activation only and microcomputer programs with screen reinforcement only. The results showed that the subjects paid significantly more attention to the toys as reinforcers (p less than .01). No significant difference was found for the performance results of the three conditions. These findings support the use of a program like the Toy Control Program, which integrates the instructional capabilities of a computer with the reinforcement potential of a toy and the creativity of a therapist.

Impact Evaluation of an Addiction Intervention Program in a Quebec Prison

Directory of Open Access Journals (Sweden)

Catherine Arseneault

2015-01-01

Full Text Available Objectives This study evaluates the effects of a prison-based addiction intervention program. The evaluation is based on a multidimensional data collection that draws a portrait of the respondents’ substance use, and of their psychological/emotional, social, and judicial spheres. It measures the changes, or lack thereof, in substance use; the psychological/emotional, social, and judicial spheres; as well as the post-treatment services used. Method A quasi-experimental repeated measures design (0, 6 weeks, and 6 months was used. Effects of the program were identified by comparing the results obtained by a group of inmates who had participated in the program ( n = 80; experimental group with those of another group who had received no intervention ( n = 70; control group. Results The preliminary results suggested a certain treatment effect related to impulsivity and psychological distress. Conclusion Although the preliminary results were promising, the experimental and control groups did not differ significantly when more robust analyses were used.

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

Physical activity across the curriculum: year one process evaluation results

Directory of Open Access Journals (Sweden)

Sullivan Debra K

2008-07-01

Full Text Available Abstract Background Physical Activity Across the Curriculum (PAAC is a 3-year elementary school-based intervention to determine if increased amounts of moderate intensity physical activity performed in the classroom will diminish gains in body mass index (BMI. It is a cluster-randomized, controlled trial, involving 4905 children (2505 intervention, 2400 control. Methods We collected both qualitative and quantitative process evaluation data from 24 schools (14 intervention and 10 control, which included tracking teacher training issues, challenges and barriers to effective implementation of PAAC lessons, initial and continual use of program specified activities, and potential competing factors, which might contaminate or lessen program effects. Results Overall teacher attendance at training sessions showed exceptional reach. Teachers incorporated active lessons on most days, resulting in significantly greater student physical activity levels compared to controls (p Conclusion In the first year of the PAAC intervention, process evaluation results were instrumental in identifying successes and challenges faced by teachers when trying to modify existing academic lessons to incorporate physical activity.

Mapping Out Your Success: Using Mind Maps to Evaluate Youth Development Programs

Directory of Open Access Journals (Sweden)

Mary Sara Wells

2009-06-01

Full Text Available A primary component of any youth program is documenting and promoting the results through evaluation. Frequently, however, administrators in youth development programs struggle to find meaningful ways of evaluating the impacts they have on the lives of youth. It is often difficult to capture the unique benefits these programs offer to participants, especially when traditional methods such as focus groups and interviews may be too time consuming and questionnaires may yield poor response rates. This article presents a creative form of evaluation targeted at demonstrating the success of programs in outcomes that are historically more difficult to measure. A “mind map” is designed to be a pictorial representation of the impact of programs in areas such as connections to community organization and adult role models. Employing this technique can enable administrators in youth development programs to demonstrate to stakeholders the benefits they provide in a non-traditional, but highly effective, way.

SKB's program for societal research 2004-2011. An evaluation

International Nuclear Information System (INIS)

Soederberg, Olof

2012-04-01

This evaluation of the program of societal research that SKB conducted the years 2004-2011 has been performed on behalf of Swedish Nuclear Fuel and Waste Management Company (SKB). The review has focused on answers to a series of questions as follows: General questions - Why was a program started? - What was SKB's purpose with the program? - Does the result mean that the objective has been achieved? - Has the program had effects (positive or negative) that were not anticipated when the purpose was formulated? - Strengths and weaknesses of the program? Questions about the implementation - How did announcement and selection procedures work? - Which forms were used for reporting results from the research projects? Questions about the continued investment in societal research - Are there such needs? - In that case, is it in SKB's interest to contribute financially to such research? - What forms might be appropriate if SKB sees interest to contribute financially to such research?

HEXANN-EVALU - a Monte Carlo program system for pressure vessel neutron irradiation calculation

International Nuclear Information System (INIS)

Lux, Ivan

1983-08-01

The Monte Carlo program HEXANN and the evaluation program EVALU are intended to calculate Monte Carlo estimates of reaction rates and currents in segments of concentric angular regions around a hexagonal reactor-core region. The report describes the theoretical basis, structure and activity of the programs. Input data preparation guides and a sample problem are also included. Theoretical considerations as well as numerical experimental results suggest the user a nearly optimum way of making use of the Monte Carlo efficiency increasing options included in the program

IPEP: Laboratory performance evaluation reports for management of DOE EM programs

International Nuclear Information System (INIS)

Hensley, J.E.; Lindahl, P.C.; Streets, W.E.

1995-01-01

Environmental restoration program/project managers at DOE's Office of Environmental Management (EM) are making important decisions based on analytical data generated by contracted laboratories. The Analytical Services Division, EM-263, is developing the Integrated Performance Evaluation Program (IPEP) to assess the performance of those laboratories, based on results from Performance Evaluation (PE) programs. The IPEP reports will be used by the laboratories to foster self-assessment and improvement. In addition, IPEP will produce PE reports for three levels of EM management (Operations/Project Offices, Area Program Offices, and Deputy Assistant Secretary Office). These reports will be used to assess whether contracted analytical laboratories have the capability to produce environmental data of the quality necessary for making environmental restoration and waste management decisions

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

[Process evaluation in relation to effectiveness assessment: experiences with school-based programs].

Science.gov (United States)

Ariza, Carles; Villalbí, Joan R; Sánchez-Martínez, Francesca; Nebot, Manel

2011-06-01

Evaluation of public health interventions usually focus on the quality of design and research methods, and less on the quality of the intervention or process evaluation. In process evaluation of school-based interventions, key issues are how completely the intervention is carried out and adherence to the protocol. In addition, exploration of intermediate variables, such as those that influence (and often predict) preventable behavior, is highly useful. This article describes the basic concepts in this topic, using examples of the effectiveness of some preventive interventions carried out in schools. The interventions discussed were mainly quasi-experimental studies, based on data from programs promoted by public health teams in the city of Barcelona. Data from process evaluation of preventive programs in secondary schools that underwent formal assessment of their effectiveness is provided. The examples are drawn from preventive programs of HIV infection or unprotected sexual intercourse (PRESSEC program) and drug consumption prevention (the PASE, PASE.bcn and x kpts programs). These examples show why the intervention process influences the impact of the programs and their results. Thorough planning of process evaluation is essential to obtain valid indicators that will identify, in the effectiveness evaluation of the intervention, the most efficacious strategies to obtain positive outcomes. Copyright © 2011 Sociedad Española de Salud Pública y Administración Sanitaria. Published by Elsevier Espana. All rights reserved.

Super-Efficient Refrigerator Program (SERP) evaluation volume 2: Preliminary impact and market transformation assessment

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-08-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. It is one of the first examples of a large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the preliminary impact and market transformation evaluation of SERP ({open_quotes}the Program{close_quotes}). Pacific Northwest National Laboratory (PNNL) conducted this evaluation for the U.S. Department of Energy. This study focuses on the preliminary impact evaluation and market transformation assessment, but also presents limited process evaluation information. It is based on interviews with refrigerator dealers and manufacturers, interviews with utility participants, industry data, and information from the Program administrators. Results from this study complement those from prior process evaluation also conducted by PNNL. 42 refs., 5 figs., 4 tabs.

[Evaluation of the results of the prevention program "Protect your voice" implemented by The Greater Poland Center of Occupational Medicine of Poznan].

Science.gov (United States)

Jałowska, Magdalena; Wośkowiak, Grażyna; Wiskirska-Woźnica, Bożena

2017-07-26

The aim of the study was to evaluate the rationale for training in voice emission and voice prophylaxis among teachers and to assess the effects of voice disorders rehabilitation in the selected group of teachers participating in the program "Protect your voice." An anonymous survey was conducted among 463 teachers participating in the training part of the program. The effectivness of rehabilitation of teachers with occupational voice disorders was evaluated among 51 subjects (average age: 43 years) taking part in diagnostic and rehabilitation part of the program. Phonation voice exercises with speech therapist and physiotherapy (iontophoresis, inhalations and elektrostimulation) were administered. Evaluation of rehabilitation was based on phoniatric examination, including videostroboscopy and statistical calculations. The survey showed that among teachers there is high demand (98%) for training in proper voice emission, hygiene and prevention of voice. The effectiveness of rehabilitation has been confirmed by the observed improvements in phonatory activities of larynx, proper breathing during phonation (p = 0.0000), the voice quality (p = 0.0022), prolonged phonation time (an average of 1.39 s), increased number of people who correctly activated resonators (p = 0.0000) and increased number of people with phonation without excesive muscle tension of the neck. The results indicate that among all the professionally active teachers, there is a need for regular training of proper voice emission and vocal hygiene and then conduct individually phonation and breathing exercises, supported by the physiotherapy. This should be an effective method of voice disorders prevention in teachers. Med Pr 2017;68(5):593-603. This work is available in Open Access model and licensed under a CC BY-NC 3.0 PL license.

Evaluation of the Tier 1 Program of Project P.A.T.H.S.: Secondary Data Analyses of Conclusions Drawn by the Program Implementers

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2008-01-01

Full Text Available The Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes is a curricula-based positive youth development program. In the experimental implementation phase, 52 schools participated in the program. Based on subjective outcome evaluation data collected from the program participants (Form A and program implementers (Form B in each school, the program implementers were invited to write down five conclusions based on an integration of the evaluation findings (N = 52. The conclusions stated in the 52 evaluation reports were further analyzed via secondary data analyses in this paper. Results showed that most of the conclusions concerning perceptions of the Tier 1 Program, instructors, and effectiveness of the programs were positive in nature. There were also conclusions reflecting the respondents’ appreciation of the program. Finally, responses on the difficulties encountered and suggestions for improvements were observed. In conjunction with the previous evaluation findings, the present study suggests that the Tier 1 Program was well received by the stakeholders and the program was beneficial to the development of the program participants.

Evaluation of the results of the prevention program “Protect your voice” implemented by The Greater Poland Center of Occupational Medicine of Poznań

Directory of Open Access Journals (Sweden)

Magdalena Jałowska

2017-10-01

Full Text Available Background: The aim of the study was to evaluate the rationale for training in voice emission and voice prophylaxis among teachers and to assess the effects of voice disorders rehabilitation in the selected group of teachers participating in the program “Protect your voice.” Material and Methods: An anonymous survey was conducted among 463 teachers participating in the training part of the program. The effectivness of rehabilitation of teachers with occupational voice disorders was evaluated among 51 subjects (average age: 43 years taking part in diagnostic and rehabilitation part of the program. Phonation voice exercises with speech therapist and physiotherapy (iontophoresis, inhalations and elektrostimulation were administered. Evaluation of rehabilitation was based on phoniatric examination, including videostroboscopy and statistical calculations. Results: The survey showed that among teachers there is high demand (98% for training in proper voice emission, hygiene and prevention of voice. The effectiveness of rehabilitation has been confirmed by the observed improvements in phonatory activities of larynx, proper breathing during phonation (p = 0.0000, the voice quality (p = 0.0022, prolonged phonation time (an average of 1.39 s, increased number of people who correctly activated resonators (p = 0.0000 and increased number of people with phonation without excesive muscle tension of the neck. Conclusions: The results indicate that among all the professionally active teachers, there is a need for regular training of proper voice emission and vocal hygiene and then conduct individually phonation and breathing exercises, supported by the physiotherapy. This should be an effective method of voice disorders prevention in teachers. Med Pr 2017;68(5:593–603

Evaluation of medical education virtual program: P3 model

Directory of Open Access Journals (Sweden)

RITA REZAEE

2016-10-01

Full Text Available Introduction: In e-learning, people get involved in a process and create the content (product and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76, but they declared technical support as the less desirable part (1.17±1.23. Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

is to post evaluation reports on our EPO website so that other groups may be able to benefit from our evaluation results. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis Method. Abstract ED53D-0871, 2015 Fall Meeting, AGU.

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

Science.gov (United States)

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

Science.gov (United States)

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2014-03-01

Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

Boraflex test results and evaluation

International Nuclear Information System (INIS)

Lindquist, K.; Kline, D.E.; Haley, T.C.

1993-02-01

New data developed, collected, and evaluated to further assess the in-pool performance of the neutron absorber material, Boraflex. The data are from new EPRI test programs, utility surveillance programs, and blackness testing at a number of plants. This new data provides a basis for quantifying the gap phenomenon in full length panels of Boraflex in spent fuel racks; the maximum anticipated gap size, frequency of gap occurrence, and axial distribution of gaps. Methods have been developed to assess the reactivity effects of gaps and Boraflex shrinkage. The analyses presented demonstrates that the reactivity effect of gaps is very small, not much larger than the statistical variations inherent in the calculational method. The data and analyses presented serve to close the issue of gap formation and shrinkage in panels of Boraflex and the effect of such gaps and shrinkage on the reactivity of the fuel/rack configuration. Ongoing EPRI programs to assess the long term performance of Boraflex in spent fuel storage racks are described

Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program

Directory of Open Access Journals (Sweden)

Ebrahim Jaafaripooyan

2014-09-01

Full Text Available Background Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs and professionals were approached for two-stage process of data collection. Results Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

ANA - a program for evaluation of gamma spectra from environmental samples

International Nuclear Information System (INIS)

Mishev, P.

1993-01-01

The program aims at for evaluation of gamma spectra, collected in different multichannel analyzers. It provides file format conversion from most popular file spectra formats. The program includes: spectra visualization; energy and shape calibration; efficiency calibration; automatic peak search; resolving of multiplets and peak calculations, based on program KATOK; isotope library; isotope identification and activity calculations. Three types of efficiency calibrations are possible: spline approximation; two branches logarithmic approximation; and polynomial approximation based on orthonormal polynomials. The suggestions of the International Atomic Energy Agency were taken into account in development of the algorithms. The program allows batch spectra processing appropriate for routine tasks and user controlled evaluations. Calculations of lower detection limits of some user defined isotopes are also possible. The program calculates precisely the statistical uncertainties of the final results. The error sources taken into account are: standard source activity errors, efficiency approximation errors and current measurement errors. (author)

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

Systematic evaluation program. Status report and initial evaluation

International Nuclear Information System (INIS)

1983-06-01

The MHB Ongoing Systematic Evaluation Program (SEP) Assessment Study was initiated by the Swedish Nuclear Power Inspectorate (SKI) in 1980. This MHB report is a status report and initial evaluation of SEP. The methodology and results of SEP are disscused with particular emphasis on the first two SEP plant reviews - the Palisades and R.E. Ginna nuclear power plants. The comments of cognizant persons in the NRC and the ACRS, as well as private consultants, are included herein. MHBs major findings are as follows: The SEP plant review methodology was acceptable to the NRC Commissioners, the ACRS, and the NRC Staffs consultants who evaluated the first two SEP plant reviews. A concern raised by all who commented on SEP was the absence of Three Mile Island Action Plan Items and Unresolved Safety Issues from current SEP reviews. The SEP reviews of the Palisades and R.E. Ginna plants concluded that the two plant designs were adequate with respect to a majority of safety topics. Several topics remain unresolved in both the Palisades and R.E. Ginna SEP reviews. In the case of the Ginna plant, several related topics have been grouped together in a major structural reevaluation study. In general, due to the number of unresolved and excluded topics, SEP has not at this time produced a plant safety evaluation which can be considered complete and integrated. (author)

Wilderness educators' evaluation of the Impact Monster Program

Science.gov (United States)

William W. Hendricks; Alan E. Watson

1999-01-01

Since its development by Jim Bradley in the late 1970s, the Impact Monster, a wilderness education skit designed to teach minimum impact techniques, has been used as a wilderness education tool by federal land management agencies. This paper reports on an evaluation of the perceived effectiveness of the Impact Monster program and its content. Results indicate that the...

Materials balance area Custodian Performance Evaluation Program at PNL

International Nuclear Information System (INIS)

Dickman, D.A.

1991-07-01

The material balance area (MBA) custodian has primary responsibility for control and accountability of nuclear material within an MBA. In this role, the custodian operates as an extension of the facility material control and accountability (MC ampersand A) organization. To effectively meet administrative requirements and protection needs, the custodian must be fully trained in all aspects of MC ampersand A related to the MBA, and custodian performance must be periodically evaluated. DOE Policy requires that each facility provide for a program which assures that each facility provide for a program which assures that personnel performing MC ampersand A functions are (1) trained and/or qualified to perform their duties and responsibilities and (2) knowledgeable of requirements and procedures related to their functions. The MBA Custodian Performance Evaluation Program at PNL uses a variety of assessment techniques to meet this goal, including internal and independent MBA audits, periodic custodian testing, conduct of limited scope performance tests, daily monitoring of MC ampersand A documentation, and reviewing custodian performance during physical inventories. The data collected from these sources is analyzed and incorporated into an annual custodian performance evaluation document, given to each custodian and line management. Development of this program has resulted in significantly improved custodian performance and a marked decrease in finding and observations identified during MBA audits

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

Science.gov (United States)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Evaluation of the Finnish nuclear safety research program 'SAFIR2010'

International Nuclear Information System (INIS)

2010-01-01

A panel of three members has been asked by the Ministry of Employment and the Economy (MEE) to evaluate SAFIR2010, the Finnish research program on nuclear power plant safety. The program was established for the period 2007-2010 to help maintain expertise in nuclear safety, to integrate young people into the research in order to help assure the future availability of expertise, and to support international collaborations. The program is directed by a Steering Group, appointed by MEE, with representatives from all organizations involved with nuclear safety in Finland. SAFIR2010 has consisted of approximately 30 projects from year to year that fall into eight subject areas: 1. Organization and human factors 2. Automation and control room 3. Fuel and reactor physics 4. Thermal hydraulics 5. Severe accidents 6. Structural safety of reactor circuit 7. Construction safety 8. Probabilistic safety analysis (PSA) For each of these areas there are Reference Groups that provide oversight of the projects within their jurisdiction. The panel carried out its evaluation by reviewing copies of relevant documents and, during a one-week period 17-22 January 2010, meeting with key individuals. The results of the panel are provided as general conclusions, responses to questions posed by MEE, challenges and recommendations and comments on specific projects in each subject area. The general conclusions reflect the panel's view that SAFIR2010 is meeting its objectives and carrying out quality research. The questions addressed are: (a.) Are the achieved results in balance with the funding? Are the results exploited efficiently in practice? (b.) How well does the expertise cover the field? Is the entire SAFIR2010 programme balanced to all different fields in nuclear safety? Does it raise efficiently new experts? (c.) Have the 2006 evaluation results been implemented successfully into SAFIR2010 program? (d.) Challenges and recommendations. In general the panel was very positive about SAFIR

SIMS analysis: Development and evaluation program summary

International Nuclear Information System (INIS)

Groenewold, G.S.; Appelhans, A.D.; Ingram, J.C.; Delmore, J.E.; Dahl, D.A.

1996-11-01

This report provides an overview of the ''SIMS Analysis: Development and Evaluation Program'', which was executed at the Idaho National Engineering Laboratory from mid-FY-92 to the end of FY-96. It should be noted that prior to FY-1994 the name of the program was ''In-Situ SIMS Analysis''. This report will not go into exhaustive detail regarding program accomplishments, because this information is contained in annual reports which are referenced herein. In summary, the program resulted in the design and construction of an ion trap secondary ion mass spectrometer (IT-SIMS), which is capable of the rapid analysis of environmental samples for adsorbed surface contaminants. This instrument achieves efficient secondary ion desorption by use of a molecular, massive ReO 4 - primary ion particle. The instrument manages surface charge buildup using a self-discharging principle, which is compatible with the pulsed nature of the ion trap. The instrument can achieve high selectivity and sensitivity using its selective ion storage and MS/MS capability. The instrument was used for detection of tri-n-butyl phosphate, salt cake (tank cake) characterization, and toxic metal speciation studies (specifically mercury). Technology transfer was also an important component of this program. The approach that was taken toward technology transfer was that of component transfer. This resulted in transfer of data acquisition and instrument control software in FY-94, and ongoing efforts to transfer primary ion gun and detector technology to other manufacturers

Economic impact evaluation of the Procap 1000: Deep Water Qualification Program from PETROBRAS

International Nuclear Information System (INIS)

Furtado, Andre T.; Pereira, Newton M.; Suslick, Saul; Freitas, Adriana G. de; Bach, Laurent

1999-01-01

PETROBRAS, a Brazilian petroleum company, managed between 1986 and 1992 a program with purpose to dominate the necessary technology for the petroleum production up to 1000 meters depth. This program was going called Procap 1000. The aim of the work was to evaluate the impacts of Procap 1000. The proposed evaluation method by Beta was going used. The results are presented

Methods for evaluating educational programs: does Writing Center participation affect student achievement?

Science.gov (United States)

Bredtmann, Julia; Crede, Carsten J; Otten, Sebastian

2013-02-01

This paper evaluates the effectiveness of the introduction of a Writing Center at a university, which aims at improving students' scientific writing abilities. In order to deal with the presumed limited utility of student feedback surveys for evaluating the effectiveness of educational programs, we use students' actual learning outcomes as our quality measure. Based on this objective measure, different statistical evaluation methods established in the labor market treatment literature are applied. We present and discuss the validity of these methods to evaluate educational programs and compare the results of these approaches to implications obtained using corresponding student surveys. Although almost all students reported the writing courses to be helpful, we find no significant effect of course participation on students' grades. This result highlights the need for institutions not to rely solely on student course evaluations for evidence-based policy decisions. Copyright © 2012 Elsevier Ltd. All rights reserved.

Results of prevention programs with adolescents.

Science.gov (United States)

Perry, C L

1987-09-01

Programs for preventing smoking and alcohol and drug abuse have radically changed in the past decade. Instead of being regarded as a health or discipline problem that involves only a few deviant adolescents, drug use has begun to be viewed as social behavior that is functional for adolescents, not capricious, and is normative for that population. The most successful prevention programs have sought to delay the onset of tobacco use. Based on theoretical and etiological research, these programs target factors that have repeatedly been predictive of adolescent smoking, alcohol and drug use. The programs teach adolescents (1) why people their age smoke tobacco or use alcohol and drugs; (2) how these meanings get established by peers, older role models and advertising; (3) how to resist these influences to smoke or to use alcohol and drugs; and (4) life skills and competencies to counterbalance the functions that drug use serves. Because of the association with the onset of smoking and the onset of using other drugs, these strategies are being studied for alcohol use and other drugs. In addition, elected peer leaders are trained to conduct these activities with their classmates and act as new role models for non-use. Evaluations of these approaches are optimistic. Studies in northern California and Minnesota reveal 50-70% reductions in the onset of smoking. Botvin's 'Life Skills Training' program demonstrates success in delaying heavy alcohol and marijuana use.

Evaluation results of the GlobalWatershed GK-12 Fellowship Program - a model for increased science literacy and partnership

Science.gov (United States)

Mayer, A. S.; Vye, E.

2016-12-01

The Michigan Tech GlobalWatershed GK-12 Fellowship program bridges the gap between K-12 learning institutions and the scientific community with a focus on watershed research. Michigan Tech graduate students (fellows) work in tandem with teachers on the development of relevant hands-on, inquiry based lesson plans and activities based on their doctoral research projects in watershed science. By connecting students and teachers to state of the art academic research in watershed science, teachers are afforded a meaningful way in which to embed scientific research as a component of K-12 curricula, while mentoring fellows on the most pertinent and essential topics for lesson plan development. Fellows fulfill their vital responsibility of communicating their academic research to a broader public while fostering improved teaching and communication skills. A goal of the project is to increase science literacy among students so they may understand, communicate and participate in decisions made at local, regional, and global levels. The project largely works with schools located in Michigan's western Upper Peninsula but also partners with K-12 systems in Sonora, Mexico. While focusing on local and regional issues, the international element of the project helps expand student, teacher, and fellow worldviews and global awareness of watershed issues and creates meaningful partnerships. Lesson plans are available online and teacher workshops are held regularly to disseminate the wealth of information and resources available to the broader public. Evaluation results indicate that fellows' skill and confidence in their ability to communicate science increased as a results of their participation of the program, as well as their desire to communicate science in their future careers. Teachers' confidence in their capacity to present watershed science to their students increased, along with their understanding of how scientific research contributes to understanding of water

Development of object oriented program `SONSHO` for strength evaluation. Manual of Version 4.0 program

Energy Technology Data Exchange (ETDEWEB)

Hosogai, Hiromi [Joyo Industries Co. Ltd., Tokai, Ibaraki (Japan); Kasahara, Naoto

1998-07-01

Object Oriented Program `SONSHO` predicts creep fatigue damage factors based on Elevated Temperature Structural Design Guide for `Monju` and other various procedures from stress classification data obtained from structural analysis results. From view point of program implementation, it is required that external programs interface and frequent revise from update of material and creep fatigue evaluation methods. Object oriented approach was continuously introduced to improve these aspects of the program. Version 4.0 has the following new functions. (1) Material strength library was implemented as an independent program module based on Microsoft Active X control and 32bitDLL technologies, which can be accessed by general Windows programs. (2) Self instruction system `Wizard` enables manual less operation. (3) Microsoft common object model (COM) was adopted for program interface, and this program can communicate with Excel sheet data on memory. Sonsho Ver.4.0 can work on Windows 95 or Windows NT4.0. Microsoft Visual Basic 5.0 (Enterprose Edition) and Microsoft FORTRAN Power Station 4.0 were adopted for program. (author)

Economic Evaluation of a Comprehensive Teenage Pregnancy Prevention Program: Pilot Program

Science.gov (United States)

Rosenthal, Marjorie S.; Ross, Joseph S.; Bilodeau, RoseAnne; Richter, Rosemary S.; Palley, Jane E.; Bradley, Elizabeth H.

2011-01-01

Background Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic are effective in reducing births among enrolled teenagers. However, there have been limited data on costs and cost-effectiveness of such programs. Objectives To use a community-based participatory research approach, to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Methods Using data from 1997-2003, we conducted an in-time intervention analysis to determine program cost-benefit while teenagers were enrolled and then used an extrapolation analysis to estimate accyrred economibc benefits and cost-benefit up to age 30. Results The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage females, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1,599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 on average, with social benefits outweighing total social costs by age 20.1. Conclusions We estimate that this comprehensive teenage pregnancy prevention program would provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost-effectiveness of similarly comprehensive programs when implemented more widely in high-risk neighborhoods. PMID:19896030

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

Final results of the Cuban program for children from areas affected by the Chernobyl accident

International Nuclear Information System (INIS)

Medina, Julio; García, Omar

2016-01-01

From 1990 till 2011, a free health care program for children from areas affected by the Chernobyl accident was organized and implemented by the Cuban Government. A significant number of qualified personal in medicine and science collaborated with this program. The information gathered for more than 21 years and the conclusive results obtained in the program are presented here. During this time, 26 114 patients, 84 % children, mostly from Ukraine, Russia and Belarus were treated in the mentioned program. Other aspects of the Cuban medical assistance in Ukraine and the main results obtained in the radiological impact evaluation of the accident on the children treated in Cuba are also included. (author)

Evaluation of the Super Efficient Refrigerator Program (SERP) in the Bonneville Power Administration service territory

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-06-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. it is one of the first examples of large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the evaluation of SERP ({open_quotes}the Program{close_quotes}) in the Bonneville Power Administration`s (Bonneville`s) service territory. Pacific Northwest National Laboratory (PNNL) conducted this evaluation for Bonneville. This study includes the process evaluation, preliminary impact evaluation, and market transformation assessment. It is based on site visits and interviews with refrigerator dealers and manufacturers, industry data, and Bonneville information. Results from this study are compared with those from a parallel study that examines the Program across the 24 participating utilities.

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

GPRA (Government Performance and Results Act) and research evaluation for basic science

International Nuclear Information System (INIS)

Takahashi, Shoji

2002-08-01

The purpose of the Government Performance and Results Act of 1993 (GPRA) is to ask federal agencies for evaluating their program performance especially from cost-efficiency aspect and to report to Congress. GPRA is to hold agencies accountable for their programs by requiring that they think strategically (in most cases every 5 years) and set, measure and report goals annually. The agencies which have responsibilities for enhancing basic science like Department of Energy (DOE) and National Science Fund (NSF) are not excluded by reasons of the difficulties of economic evaluations. In Japan, based on 'the Rationalization program for the public corporations' of 2001, the research developing type corporations should make a cost-performance evaluation in addition to the conventional ones. They have same theme as US agencies struggles. The purpose of this report is to get some hints for this theme by surveying GPRA reports of DOE and NSF and analyzing related information. At present, I have to conclude although everybody accepts the necessities of socio-economic evaluations and investment criteria for basic research, studies and discussions about ways and means are still continuing even in the US. (author)

Development and evaluation of a pharmacogenomics educational program for pharmacists.

Science.gov (United States)

Formea, Christine M; Nicholson, Wayne T; McCullough, Kristen B; Berg, Kevin D; Berg, Melody L; Cunningham, Julie L; Merten, Julianna A; Ou, Narith N; Stollings, Joanna L

2013-02-12

Objectives. To evaluate hospital and outpatient pharmacists' pharmacogenomics knowledge before and 2 months after participating in a targeted, case-based pharmacogenomics continuing education program.Design. As part of a continuing education program accredited by the Accreditation Council for Pharmacy Education (ACPE), pharmacists were provided with a fundamental pharmacogenomics education program.Evaluation. An 11-question, multiple-choice, electronic survey instrument was distributed to 272 eligible pharmacists at a single campus of a large, academic healthcare system. Pharmacists improved their pharmacogenomics test scores by 0.7 questions (pretest average 46%; posttest average 53%, p=0.0003).Conclusions. Although pharmacists demonstrated improvement, overall retention of educational goals and objectives was marginal. These results suggest that the complex topic of pharmacogenomics requires a large educational effort in order to increase pharmacists' knowledge and comfort level with this emerging therapeutic opportunity.

Use of qualitative analysis to supplement program evaluation of a faculty development program

Directory of Open Access Journals (Sweden)

Thomas V Chacko

2013-01-01

Full Text Available Introduction: Generally for Program Evaluation of workshops, a structured questionnaire is used to measure learner satisfaction and learning and it yields results in quantitative terms and if there are open-ended questions, it yields a long list of responses which the evaluator finds it difficult to use. Hence, we used qualitative research methods to supplement it for a holistic understanding of the quality and extent of their learning. Materials and Methods: A faculty development program was used opportunistically to gather data using open-ended questions designed to elicit "thick descriptions" about their learning. Using the Grounded Theory approach where the data drives further analysis, data analysis was done by faculty in three groups using inductive reasoning leading to emergence of themes and categories of responses. The commonalities in the themes that emerged independently in the three groups as well as member checking to seek their agreement with the group′s observation of the primary data were used to ensure validity of the findings. Results: Themes and categories of new learning in terms of knowledge, skills, attitudes and processes emerged which gives a better understanding of the extent of the learning and its applicability to future professional tasks. The open-ended questions encouraging participants to give "thick description" of their learning yielded many quotable quotes which indicate the quality of their learning. Conclusion: The use of open-ended questions and qualitative research method of data analysis using the Grounded Theory approach helps in holistic understanding of the focus and quality of learning that is not usually possible through quantitative research methods. Hence, it is recommended that when understanding of the extent and quality of learning is important, traditional method of program evaluation should be supplemented with qualitative research methods as they are more effective in convincing decision

IPEP: The integrated performance evaluation program for the Department of Energy's Office of Environmental Management

International Nuclear Information System (INIS)

Lindahl, P.C.; Streets, W.E.; Bass, D.A.

1995-01-01

The quality of the analytical data being provided to DOE's Office of Environmental Management (EM) for environmental restoration activities and the extent to which these data meet the data quality objectives are critical in the decision-making process. One of several quality metrics that can be used in evaluating a laboratory is its performance in performance evaluation (PE) programs. In support of DOE's environmental restoration and waste management efforts, EM has been charged with developing and implementing a program to assess the performance of participating laboratories. Argonne National Laboratory (ANL) and DOE's Environmental Measurements Laboratory (EML) and Radiological and Environmental Sciences Laboratory (RESL) have been collaborating on the development and implementation of a comprehensive Integrated Performance Evaluation Program (IPEP) for DOE-wide implementation. The IPEP will use results from existing inorganic, organic, and radiological PE programs when these are available and appropriate for the analytes and matrices being determined for DOE's EM activities. Existing programs include the U.S. Environmental Protection Agency's (EPA's) Contract Laboratory Program (CLP), the Water Supply (WS) and Water Pollution (WP) PE studies for inorganic and organic analytes, and DOE's Quality Assessment Program (QAP) for radiological analytes. In addition, DOE has begun the development of the Mixed Analyte Performance Evaluation Program (MAPEP) to address the needs of the DOE Complex. These PE programs provide a spectrum of matrices and analytes covering the various inorganic, organic, and low-level radiologic categories found in routine environmental and waste samples. These PE programs already provide some assessment of laboratory performance; IPEP will expand these assessments by evaluating historical performance, as well as results from multiple PE programs, thereby providing an enhanced usage of the PE program information

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

An evaluation of the Australian Rotavirus Surveillance Program.

Science.gov (United States)

Roberts-Witteveen, April R; Patel, Mahomed S; Roche, Paul W

2008-09-01

The Australian Rotavirus Serotyping Program (ARSP) serotypes rotavirus isolates obtained from stool samples sent from Australian laboratories. In collaboration with ARSP the Australian Government Department of Health and Ageing evaluated the program for its utility and capacity to monitor effectiveness of the rotavirus vaccines recently introduced into the Australian National Immunisation Program. The system was described using ARSP annual reports and staff interviews. The attributes of the system were assessed by adapting standard guidelines for evaluating a surveillance system. Email surveys or face to face interviews were conducted with staff of ARSP, participating laboratories, rotavirus vaccine manufacturing companies and representatives of the Communicable Diseases Network Australia. The ability of the ARSP to monitor changes in rotavirus serotype epidemiology was assessed. ARSP serotypes rotavirus isolates received from participating laboratories at least bi-annually, with results being reported at least as often. Serotype analyses have informed formulation of rotavirus vaccines and contributed to forecasting the extent of outbreaks caused by novel serotypes. The ARSP will be able to monitor changes in rotavirus serotype epidemiology and identify probable vaccination failures. Enhancement of the representativeness and sensitivity of the system are needed for the data to remain useful in the public health context. Methods for transferring data between the program and state and territory health departments need to be developed.

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Preliminary Results of the Louisiana Sex Offender Treatment Program

Directory of Open Access Journals (Sweden)

Lee A. Underwood

2015-12-01

Full Text Available The purpose of this study was to offer preliminary support for the Louisiana Sex Offender Treatment Program (LSOTP in addressing the needs of juvenile sex offenders. Research objectives were (1 to offer statistical evidence for reductions in anxiety, depression, cognitive distortion and negative attitudes towards women comparing a group of 21 adolescents, 12 of whom received services as usual and nine of whom participated in the LSOTP. A controlled experimental evaluation design was utilized. The juvenile sex offenders were randomly assigned to the experimental group for 12 weeks receiving treatment services and a control group receiving care “as usual” in a residential group care program. Participants in the experimental group experienced statistically significant decreases in cognitive distortions related specifically to rape and molestation.The results of this study offer preliminary support of the LSOTP as a best practices alternative to other treatment modalities.

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

Evaluation of radiological teaching programs in the Internet

International Nuclear Information System (INIS)

Seitz, J.; Schubert, S.; Voelk, M.; Scheibl, K.; Paetzel, C.; Schreyer, A.; Djavidani, B.; Feuerbach, S.; Strotzer, M.

2003-01-01

Evaluation of web based training programs,which can be contacted from the homepages of radiological departments of German universities.Material and method From june 2000 to january 2002 the 75 web based training programs of 57 providers,which can be contacted from the web pages of the radiological departments of german universities were evaluated in a prospective study.A medical student experienced in using the world wide web examined each training program three times in an interval of six months using the following criteria: availability of the web sites,target group,kind of training program,contents and structure and the technical solution. 51 of the 57 the homepages were fully available at each visit. 64 of the 75 web based training programs which could be connected from these sites were available at all three visitis.One program was only partially available at one spot check. 8 of the 75 programs were designed for physicians and medically trained personal, 23 were made for medical students and 44 addressed both target groups (partially more than once mentioned).The number of the presented cases ranged between one single and 3700. In 31 of 75 training programs links to other teaching files were found.A complete presentation of cases was presented by 48 of the 75 web sites.5 of the 75 web sites offered physiological images for comparison. In 20 training programs the pathological changes were optically marked in the x-ray images.A logical and didactical structure was found in 24 teaching files, 14 gave the possibility to check the learning results.No provider made use of the possibility to pass credits to the students or physicians acount with regard to official training programs. Multimedia techniques were used in 15 training programs.43 sites used data reduced preview images (thumbnails).The latest update of the site is mentioned in 55 of the 75 web sites. 19 of 57 providers had either no possibility of contact or did not answer to an e-mail. From the homepages

The efficacy of stuttering measurement training: evaluating two training programs.

Science.gov (United States)

Bainbridge, Lauren A; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J

2015-04-01

Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of stuttering events on eight 3-min audiovisual speech samples from adults and children who stutter. Stuttering judgment training involved use of either the Stuttering Measurement System (SMS), Stuttering Measurement Assessment and Training (SMAAT) programs, or no training. To test for the reliability of any training effect, SMS training was repeated with the 4th group. Both SMS-trained groups produced approximately 34% improvement, significantly better than no training or the SMAAT program. The SMAAT program produced a mixed result. The SMS program was shown to produce a "medium" effect size improvement in the accuracy of stuttering event counts, and this improvement was almost perfectly replicated in a 2nd group. Half of the SMAAT judges produced a 36% improvement in accuracy, but the other half showed no improvement. Additional studies are needed to demonstrate the durability of the reported improvements, but these positive effects justify the importance of stuttering measurement training.

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

Development and evaluation of addiction treatment programs in Latin America.

Science.gov (United States)

Marín-Navarrete, Rodrigo; Medina-Mora, María Elena; Pérez-López, Alejandro; Horigian, Viviana E

2018-07-01

The aim of this article is to present a state-of-the-art review of the scientific studies that have evaluated healthcare systems, services and programs for addiction treatment in Latin America. As a secondary aim, this article presents a brief description and analysis of the addiction prevention and treatment resources and programs available in Latin America, based on information from the ATLAS on Substance Use (ATLAS-SU) project led by the WHO. Substance use disorders (SUDs) are among the main causes associated with global burden of disease. Around the world, many initiatives have been proposed to promote policies to reduce substance use and reduce the impact of SUD, including integrating treatments into healthcare systems, increasing access to treatment programs and impacting outcome measures. In Latin America, multiple efforts have been implemented to improve addiction services and programs, although little is known about the impact they have generated. International studies report the availability of strategies and public inicitatives on prevention and treatment of addiction in Latin America. These studies also report established networks of public and private services that include prevention and detoxification programs, outpatient and residential treatment, and also social reintegration initiatives. However, despite these advances, information on the evaluation of the progress, results and impact of these programs is limited.

C-program LINOP for the evaluation of film dosemeters by linear optimization. User manual

International Nuclear Information System (INIS)

Kragh, P.

1995-11-01

Linear programming results in an optimal measuring value for film dosemeters. The Linop program was developed to be used for linear programming. The program permits the evaluation and control of film dosemeters and of all other multi-component dosemeters. This user manual for the Linop program contains the source program, a description of the program and installation and use instructions. The data sets with programs and examples are available upon request. (orig.) [de

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Scaling Research Results: Design and Evaluation | IDRC ...

International Development Research Centre (IDRC) Digital Library (Canada)

Design and evaluation The project will provide helpful guidance to IDRC management and ... scaling and programming for scalable research Offer the monograph in multiple forms, ... Asian outlook: New growth dependent on new productivity.

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

Advanced gas cooled nuclear reactor materials evaluation and development program

International Nuclear Information System (INIS)

1977-01-01

Results of work performed from January 1, 1977 through March 31, 1977 on the Advanced Gas Cooled Nuclear Reactor Materials Evaluation and Development Program are presented. The objectives of this program are to evaluate candidate alloys for Very High Temperature Reactor (VHTR) Process Heat and Direct Cycle Helium Turbine (DCHT) applications, in terms of the effect of simulated reactor primary coolant (impure Helium), high temperatures, and long time exposures, on the mechanical properties and structural and surface stability of selected candidate alloys. A second objective is to select and recommend materials for future test facilities and more extensive qualification programs. Work covered in this report includes progress to date on alloy selection for VHTR Nuclear Process Heat (NPH) applications and for DCHT applications. The present status on the simulated reactor helium loop design and on designs for the testing and analysis facilities and equipment is discussed

Evaluation of farmer's participation in National Special Program for ...

African Journals Online (AJOL)

Evaluation of farmer's participation in National Special Program for Food Security in Niger State, Nigeria. ... Loans provided for the project participants assisted the recipients in boosting their farm production. The t-test result revealed that significant increases were found in the farm size, output, p. 0.01 (1%) and income of ...

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

Science.gov (United States)

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

Scintigraphic evaluation of primary congenital hypothyroidism: results of the Greek screening program

Energy Technology Data Exchange (ETDEWEB)

Panoutsopoulos, G.; Ilias, I.; Batsakis, C.; Christakopoulou, I. [Dept. of Nuclear Medicine, ' ' Sotiria' ' Hospital, Athens (Greece); Mengreli, C. [Inst. of Child Health, Athens (Greece)

2001-04-01

The Greek screening program for primary congenital hypothyroidism was initiated in 1979. By early 2000, thyrotropin measurements had been performed in 1,976,719 newborns, using dried blood spots obtained by heel prick. Among these children, 584 were diagnosed with congenital hypothyroidism (incidence: 1/3,384 births) and were given L-thyroxine (L-T{sub 4}) replacement therapy. In order to further evaluate and classify the children as having either an aplastic (AT) or an ectopic thyroid gland (ET) or as showing thyroidal dyshormonogenesis (DN, with a nomotopic gland), scintigraphic studies were performed at the age of 2-3 years. In 413 children of this age group (including 24 subsequently diagnosed as having had transient hypothyroidism, in whom L-T{sub 4} therapy was not resumed), thyroid hormones were measured and scintigraphic studies were done after withdrawal of L-T{sub 4} replacement treatment for 3 weeks. Given the long duration of the study, we used various scintigraphic modalities. In 96 children (group A), scintigraphy was performed using technetium-99m pertechnetate ({sup 99m}TcO{sub 4}{sup -}; 18.5 MBq given i.v.) and a rectilinear scanner. Seventy-three children (group B) were studied with {sup 99m}TcO{sub 4}{sup -} (18.5 MBq given i.v.) and a gamma camera equipped with a pinhole collimator. In these groups, atropine was administered 30 min prior to the study (0.02 mg/kg i.v. or i.m.) in order to reduce the secretion of saliva from the salivary glands. Finally, in the remaining 220 children (group C) iodine-123 sodium iodide ({sup 123}I-Na) (0.74-1.85 MBq i.v.) and the same gamma camera were used. Between-group comparisons of scintigraphic findings were done with the chi square test. In 191 children from group C, thyroglobulin (Tg) was measured and in 49 children ultrasound (US) was performed (categorising the gland as AT or ET/DN). Comparison of these modalities was done with the kappa statistic. In group A, 61.5% of children had AT, 26.0% had ET and

The efficacy of an educational program for parents of children with epilepsy (FAMOSES): Results of a controlled multicenter evaluation study.

Science.gov (United States)

Hagemann, Anne; Pfäfflin, Margarete; Nussbeck, Fridtjof W; May, Theodor W

2016-11-01

The objective of this study was to evaluate the efficacy of the educational program FAMOSES (modular service package epilepsy for families) for parents of children with epilepsy. Parents of children with epilepsy from Germany and Austria were included in a controlled prospective multicenter study using a pre-post design. Participants of the FAMOSES program (FAMOSES group, n=148) completed a standardized questionnaire immediately before the program and six months later. The matched control group of parents not participating in the program (n=74, matching ratio 2:1) also answered the questionnaire twice, at an interval of six months. The questionnaire comprised epilepsy-specific outcome measures (e.g., knowledge, coping, fears) and disease-related variables (e.g., seizure frequency). The generalized estimation equation approach was used for statistical analysis. In addition, parents' satisfaction with the FAMOSES program was assessed six months after participation. Parents of the FAMOSES group significantly improved in epilepsy-specific knowledge (group×time interaction: pepilepsy-related fears (pepilepsy with their child (pepilepsy and reduce epilepsy-related fears. Copyright © 2016 Elsevier Inc. All rights reserved.

Developing medical educators - a mixed method evaluation of a teaching education program.

Science.gov (United States)

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

Background It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) 'Reaction' on a professional and emotional level using standardized questionnaires; 2) 'Learning' applying a multiple choice test; 3) 'Behavior' by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) 'Results' from student evaluations. Results Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (Pteaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students' evaluations. Conclusions Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

Youth Can! Grow Healthy: A Formative Evaluation of a Positive Youth Development Program

Directory of Open Access Journals (Sweden)

Andrew Carberry

2013-06-01

Full Text Available This paper presents a formative evaluation of an afterschool program that combined positive youth development and school garden curricula. Novel approaches were used to teach elementary school children about gardening and nutrition, and to engage them in advocacy for healthy community physical activity and nutrition environments. The youth development curriculum included sessions on team building, community pride, healthy eating, physical activity, and advocacy. Photovoice methods were used to allow participants to assess their community and communicate findings with community leaders. The school garden curriculum included nutrition and gardening lessons. Formative evaluation was conducted for each session. Themes of the evaluation were: successful methods for engaging youth, issues in the social environment, and implications for program management. Evaluation results are discussed in relationship to relevant youth development literature to provide recommendations that will strengthen future programs.

Process Evaluation for a Prison-based Substance Abuse Program.

Science.gov (United States)

Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

2000-01-01

Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

Development and Evaluation of Science and Technology Education Program Using Interferometric SAR

Science.gov (United States)

Ito, Y.; Ikemitsu, H.; Nango, K.

2016-06-01

This paper proposes a science and technology education program to teach junior high school students to measure terrain changes by using interferometric synthetic aperture radar (SAR). The objectives of the proposed program are to evaluate and use information technology by performing SAR data processing in order to measure ground deformation, and to incorporate an understanding of Earth sciences by analyzing interferometric SAR processing results. To draft the teaching guidance plan for the developed education program, this study considers both science and technology education. The education program was used in a Japanese junior high school. An educational SAR processor developed by the authors and the customized Delft object-oriented radar interferometric software package were employed. Earthquakes as diastrophism events were chosen as practical teaching materials. The selected events indicate clear ground deformation in differential interferograms with high coherence levels. The learners were able to investigate the ground deformations and disasters caused by the events. They interactively used computers and became skilled at recognizing the knowledge and techniques of information technology, and then they evaluated the technology. Based on the results of pre- and post-questionnaire surveys and self-evaluation by the learners, it was clarified that the proposed program was applicable for junior high school education, and the learners recognized the usefulness of Earth observation technology by using interferometric SAR. The usefulness of the teaching materials in the learning activities was also shown through the practical teaching experience.

A classification of components of workplace disability management programs: results from a systematic review.

Science.gov (United States)

Gensby, U; Labriola, M; Irvin, E; Amick, B C; Lund, T

2014-06-01

This paper presents results from a Campbell systematic review on the nature and effectiveness of workplace disability management programs (WPDM) promoting return to work (RTW), as implemented and practiced by employers. A classification of WPDM program components, based on the review results, is proposed. Twelve databases were searched between 1948 to July 2010 for peer-reviewed studies of WPDM programs provided by employers to re-entering workers with occupational or non-occupational illnesses or injuries. Screening of articles, risk of bias assessment and data extraction were conducted in pairs of reviewers. Studies were clustered around various dimensions of the design and context of programs. 16,932 records were identified by the initial search. 599 papers were assessed for relevance. Thirteen studies met inclusion criteria. Twelve peer reviewed articles (two non-randomized studies, and ten single group experimental before and after studies), including ten different WPDM programs informed the synthesis of results. Narrative descriptions of the included program characteristics provided insight on program scope, components, procedures and human resources involved. However, there were insufficient data on the characteristics of the sample and the effect sizes were uncertain. A taxonomy classifying policies and practices around WPDM programs is proposed. There is insufficient evidence to draw conclusions on the effectiveness of employer provided WPDM programs promoting RTW. It was not possible to determine if specific program components or specific sets of components are driving effectiveness. The proposed taxonomy may guide future WPDM program evaluation and clarify the setup of programs offered to identify gaps in existing company strategies.

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

Evaluation of a Spiritually Based Child Maltreatment Prevention Training Program

Science.gov (United States)

Baker, Louisa K.; Rigazio-DiGilio, Sandra A.

2013-01-01

The authors empirically evaluated a spiritually based 1-day child maltreatment training program. Pretest, posttest, and follow-up results indicated that participants' recognition of hypothetical maltreatment did not increase after training. Furthermore, although participants decreased their use of items known to dissuade decisions to report, they…

Evaluating the effect of a reader worker program on team performance

International Nuclear Information System (INIS)

Hahn, H.A.; Alvarez, Y.P.

1994-01-01

When safety, security, or other logistical concerns prevent direct objective assessment of team performance, other evaluation techniques become necessary. In this paper, the effect of a Department of Energy-mandated reader worker program on team performance at a particular DOE facility was evaluated using unstructured observations, informal discussions with technicians, and human reliability analysis. The reader worker program is intended to enhance nuclear explosive safety by improving the reliability of team performance. The three methods used for the evaluation combine to provide a strong indication that team performance is in fact enhanced by a properly implemented reader worker procedure. Because direct quantitative data on dependent variables particular to the task of interest is not available, however, there has been some skepticism regarding the results by staff at the facility

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

American College of Radiology Accreditation Program for mammographic screening sites: Physical evaluation criteria

International Nuclear Information System (INIS)

Hendrick, R.E.; Haus, A.G.; Hubbard, L.B.; Lasky, H.J.; McCrohan, J.; McLelland, R.; Rothenberg, L.N.; Tanner, R.L.; Zinninger, M.D.

1987-01-01

The American College of Radiology has initiated a program for the accreditation of mammographic screening sites, which includes evaluation by mail of image quality and average glandular breast dose. Image quality is evaluated by use of a specially designed phantom (a modified RMI 152D Mammographic Phantom) containing simulated microcalcifications, fibrils and masses. Average glandular dose to a simulated 4.5-cm-thick (50% glandular, 50% fat) compressed breast is evaluated by thermoluminescent dosimeter measurements of entrance exposure and half value layer. Standards for acceptable image quality and patient doses are presented and preliminary results of the accreditation program are discussed

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

A comparative evaluation of sequence classification programs

Directory of Open Access Journals (Sweden)

Bazinet Adam L

2012-05-01

Full Text Available Abstract Background A fundamental problem in modern genomics is to taxonomically or functionally classify DNA sequence fragments derived from environmental sampling (i.e., metagenomics. Several different methods have been proposed for doing this effectively and efficiently, and many have been implemented in software. In addition to varying their basic algorithmic approach to classification, some methods screen sequence reads for ’barcoding genes’ like 16S rRNA, or various types of protein-coding genes. Due to the sheer number and complexity of methods, it can be difficult for a researcher to choose one that is well-suited for a particular analysis. Results We divided the very large number of programs that have been released in recent years for solving the sequence classification problem into three main categories based on the general algorithm they use to compare a query sequence against a database of sequences. We also evaluated the performance of the leading programs in each category on data sets whose taxonomic and functional composition is known. Conclusions We found significant variability in classification accuracy, precision, and resource consumption of sequence classification programs when used to analyze various metagenomics data sets. However, we observe some general trends and patterns that will be useful to researchers who use sequence classification programs.

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Results evaluation of the environmental monitoring program of the Centro de Desenvolvimento da Tecnologia Nuclear - CDTN

International Nuclear Information System (INIS)

Peixoto, Claudia M.; Pego, Valdivio D.

1997-01-01

Due to the research works preformed at CDTN, solid, liquid and gaseous wastes are produced and released to the environment. Consequently, CDTN has been performing since 1985 an Environmental Monitoring Program . In this Program, matrix samples, sampling frequencies and the analysis to be realized for measuring the radiation and radioactive contamination levels are specified. The paper also presents the analytical results of the radionuclides monitored within the period 1991-1995, concerning the sampling points located at Corrego Engenho Nogueira, which receives liquid contaminants that are eventually released by CDTN. Moreover, an estimation of radiation dose due to water consumption is presented. (author). 4 refs., 5 figs., 9 tabs

Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

Science.gov (United States)

Maher, Charles A.

1981-01-01

Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

Development of the COMPRE-A Program for Evaluating Proliferation Resistance (PR) and Physical Protection (PP) of the Nuclear Facility

Energy Technology Data Exchange (ETDEWEB)

Kim, Sukhoon; Kim, Juyub; Shin, Kwangyoung [FNC Technology Co., Yongin (Korea, Republic of); Seo, Janghoon; Jang, Sungsoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2016-10-15

In order to make up for the limitation inherent in these methodologies, a new methodology called 'Comprehensive Methodology for PR and PP Evaluation (COMPRE)' is being developed by the Korea Institute of Nuclear Non-proliferation and Control (KINAC). Currently, a project for improving a computational program implementing the COMPRE methodology is ongoing in KINAC, and the 'COMPRE-A (i.e. COMPRE-Advanced model)' program was developed as part of this project. This paper describes details of the COMPRE-A program developed for establishing the platform corresponding to features of the evaluation factor derived for COMPRE, and for enhancing easiness of the result analysis through embodying the visualization and comparison tools for the evaluation result. As part of the project for improving a computational program implementing the COMPRE methodology, the COMPRE-A program was developed. This program provides not only the platform corresponding to features of the evaluation factor derived for COMPRE but also the visualization and comparison tools for enhancing easiness of the result analysis. The V and V for the developed program was performed through comparison with the result obtained by using MS-Excel for a sample case consisting of three (3) measures, six (6) sections and twenty-six (26) attributes. From the comparison result, it was confirmed that the risk in aspects of PR and PP at nuclear facilities could be quantitatively evaluated within the acceptable range using the COMPRE-A program.

Manipulator system man-machine interface evaluation program. [technology assessment

Science.gov (United States)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Evaluation of otolaryngology residency program websites.

Science.gov (United States)

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42

Physical protection evaluation methodology program development and application

International Nuclear Information System (INIS)

Seo, Janghoon; Yoo, Hosik

2015-01-01

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Physical protection evaluation methodology program development and application

Energy Technology Data Exchange (ETDEWEB)

Seo, Janghoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2015-10-15

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

A computer program to evaluate optical systems

Science.gov (United States)

Innes, D.

1972-01-01

A computer program is used to evaluate a 25.4 cm X-ray telescope at a field angle of 20 minutes of arc by geometrical analysis. The object is regarded as a point source of electromagnetic radiation, and the optical surfaces are treated as boundary conditions in the solution of the electromagnetic wave propagation equation. The electric field distribution is then determined in the region of the image and the intensity distribution inferred. A comparison of wave analysis results and photographs taken through the telescope shows excellent agreement.

Clemson University Science Master's Program in Sustainable and Resilient Infrastructure: A program evaluation

Science.gov (United States)

O'Sell, Elizabeth Eberhart

The Clemson University Science Master's Program (SMP) in Sustainable and Resilient Infrastructure is a program which aims to link engineering, materials, construction, environment, architecture, business, and public policy to produce graduates with unique holistic perspective and expertise to immediately contribute to the workforce in the area of sustainable and resilient infrastructure. A program evaluation of the SMP has been performed to study the effectiveness of the SMP and identify areas where the goals and vision of the SMP are achieved and areas where improvements can be made. This was completed by analysis of trends within survey responses, review of Master's thesis reports, and review of courses taken. It was found that the SMP has facilitated new interdisciplinary research collaborations of faculty in different concentration areas within the Glenn Department of Civil Engineering, as well as collaboration with faculty in other departments. It is recommended that a course which provides instruction in all eight competency areas be required for all SMP students to provide a comprehensive overview and ensure all students are exposed to concepts of all competency areas. While all stakeholders are satisfied with the program and believe it has been successful thus far, efforts do need to be made as the program moves forward to address and improve some items that have been mentioned as needing improvement. The concerns about concentration courses, internship planning, and advising should be addressed. This evaluation provides benefits to prospective students, current SMP participants, and outside program supporters. The goal of this evaluation is to provide support that the SMP is an effective and worthwhile program for participating students, while attempting to identify any necessary program improvements and provide recommendations for achieving these improvements. This goal has been accomplished.

Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emeral Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2007-03-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others.

Silver Memories: implementation and evaluation of a unique radio program for older people.

Science.gov (United States)

Travers, Catherine; Bartlett, Helen P

2011-03-01

A unique radio program, Silver Memories, specifically designed to address social isolation and loneliness in older people by broadcasting music (primarily), serials and other programs relevant to the period when older people grew up--the 1920-1950s--first aired in Brisbane, Australia, in April 2008. The impact of the program upon older listeners' mood, quality of life (QOL) and self-reported loneliness was independently evaluated. One hundred and thirteen community-dwelling persons and residents of residential care facilities, aged 60 years and older participated in a three month evaluation of Silver Memories. They were asked to listen to the program daily and baseline and follow-up measures of depression, QOL and loneliness were obtained. Participants were also asked for their opinions regarding the program's quality and appeal. The results showed a statistically significant improvement in measures of depression and QOL from baseline to follow-up but there was no change on the measure of loneliness. The results did not vary by living situation (community vs. residential care), whether the participant was lonely or not lonely, socially isolated or not isolated, or whether there had been any important changes in the participant's health or social circumstances throughout the evaluation. It was concluded that listening to Silver Memories appears to improve the QOL and mood of older people and is an inexpensive intervention that is flexible and readily implemented.

Relevance Evaluation of Engineering Master's Program in Peru

OpenAIRE

Miñán, Erick; Lavalle, Carlos; Díaz-Puente, José M.

2012-01-01

In a context of mass higher education, it is necessary to ensure not only quality but also the relevance of engineering master's programs, namely the appropriateness of the objectives and outcomes to the needs and interests of the program beneficiaries. After a literature review we analyzed the evaluation models of three organizations in Peru: the Board of Evaluation, Accreditation and Certification of the University Education Quality CONEAU, the Institute of Quality and Accreditation of Comp...

Challenges to Evaluating Physical Activity Programs in American Indian/Alaska Native Communities

Science.gov (United States)

Roberts, Erica Blue; Butler, James; Green, Kerry M.

2018-01-01

Despite the importance of evaluation to successful programming, a lack of physical activity program (PAP) evaluation for American Indian/Alaska Native (AI/AN) programs exists, which is significant given the high rates of obesity and diabetes in this population. While evaluation barriers have been identified broadly among AI/AN programs, challenges…

Developing medical educators--a mixed method evaluation of a teaching education program.

Science.gov (United States)

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) 'Reaction' on a professional and emotional level using standardized questionnaires; 2) 'Learning' applying a multiple choice test; 3) 'Behavior' by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) 'Results' from student evaluations. Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (Pteaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students' evaluations. Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE), Version 5.0: Models and Results Database (MAR-D) reference manual. Volume 8

International Nuclear Information System (INIS)

Russell, K.D.; Skinner, N.L.

1994-07-01

The Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) refers to a set of several microcomputer programs that were developed to create and analyze probabilistic risk assessments (PRAs), primarily for nuclear power plants. The primary function of MAR-D is to create a data repository for completed PRAs and Individual Plant Examinations (IPEs) by providing input, conversion, and output capabilities for data used by IRRAS, SARA, SETS, and FRANTIC software. As probabilistic risk assessments and individual plant examinations are submitted to the NRC for review, MAR-D can be used to convert the models and results from the study for use with IRRAS and SARA. Then, these data can be easily accessed by future studies and will be in a form that will enhance the analysis process. This reference manual provides an overview of the functions available within MAR-D and step-by-step operating instructions

Pilot evaluation of a media literacy program for tobacco prevention targeting early adolescents shows mixed results.

Science.gov (United States)

Kaestle, Christine E; Chen, Yvonnes; Estabrooks, Paul A; Zoellner, Jamie; Bigby, Brandon

2013-01-01

The purpose of this pilot study was to assess the impact of media literacy for tobacco prevention for youth delivered through a community site. A randomized pretest-posttest evaluation design with matched-contact treatment and control conditions. The pilot study was delivered through the YMCA in a lower-income suburban and rural area of Southwest Virginia, a region long tied, both economically and culturally, to the tobacco industry. Children ages 8 to 14 (76% white, 58% female) participated in the study (n = 38). The intervention was an antismoking media literacy program (five 1-hour lessons) compared with a matched-contact creative writing control program. General media literacy, three domains of tobacco-specific media literacy ("authors and audiences," "messages and meanings," and "representation and reality"), tobacco attitudes, and future expectations were assessed. Multiple regression modeling assessed the impact of the intervention, controlling for pretest measures, age, and sex. General media literacy and tobacco-specific "authors and audiences" media literacy improved significantly for treatment compared with control (p literacy measures and for tobacco attitudes were not significant. Future expectations of smoking increased significantly for treatment participants ages 10 and younger (p literacy are accompanied by an increase in future expectations to smoke for younger children.

Guide for Conducting Benefit-Cost Evaluation of Realized Impacts of Public R&D Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emerald Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2011-08-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others. Retrospective evaluations may be contrasted to prospective evaluations that reflect expected or potential outcomes only if assumptions hold. The retrospective approach described in this Guide is based on realized results only and the extent they can be attributed to the efforts of an R&D program. While it has been prepared specifically to guide retrospective benefit-cost analysis of EERE R&D Programs, this report may be used for similar analysis of other public R&D organizations.

The program success story: a valuable tool for program evaluation.

Science.gov (United States)

Lavinghouze, Rene; Price, Ann Webb; Smith, Kisha-Ann

2007-10-01

Success stories are evaluation tools that have been used by professionals across disciplines for quite some time. They are also proving to be useful in promoting health programs and their accomplishments. The increasing popularity of success stories is due to the innovative and effective way that they increase a program's visibility, while engaging potential participants, partners, and funders in public health efforts. From the community level to the federal level, program administrators are using success stories as vehicles for celebrating achievements, sharing challenges, and communicating lessons learned. Success stories are an effective means to move beyond the numbers and connect to readers-with a cause they can relate to and want to join. This article defines success stories and provides an overview of several types of story formats, how success stories can be systematically collected, and how they are used to communicate program success.

Quasi-Experimental Evaluation of a Student Mentoring Program

OpenAIRE

Sandner, Malte

2013-01-01

This paper presents evidence from a natural-experiment which evaluates the effectiveness of a student mentoring program. The mentoring includes several compulsory, scheduled, faceto- face appointments between a mentor and a student in the first study year. All mentors are graduated and employed by the institution. For the evaluation, I use the fact that the mentoring is only offered to students in an economics and management program, whereas it is not offered to students in an industrial engi...

Impacting Binational Health through Leadership Development: A Program Evaluation of the Leaders across Borders Program, 2010–2014

Directory of Open Access Journals (Sweden)

Omar A. Contreras

2017-08-01

Full Text Available BackgroundWorkforce and leadership development is imperative for the advancement of public health along the U.S./Mexico border. The Leaders across borders (LaB program aims to train the public health and health-care workforce of the border region. The LaB is a 6-month intensive leadership development program, which offers training in various areas of public health. Program curriculum topics include: leadership, border health epidemiology, health diplomacy, border public policies, and conflict resolution.MethodsThis article describes the LaB program evaluation outcomes across four LaB cohort graduates between 2010 and 2014. LaB graduates received an invitation to participate via email in an online questionnaire. Eighty-five percent (n = 34 of evaluation participants indicated an improvement in the level of binationality since participating in the LaB program. Identified themes in the evaluation results included increased binational collaborations and partnerships across multidisciplinary organizations that work towards improving the health status of border communities. Approximately 93% (n = 37 of the LaB samples were interested in participating in future binational projects while 80% (n = 32 indicated interest in the proposal of other binational initiatives. Participants expressed feelings of gratitude from employers who supported their participation and successful completion of LaB.DiscussionPrograms such as LaB are important in providing professional development and education to a health-care workforce along the U.S./Mexico border that is dedicated to positively impacting the health outcomes of vulnerable populations residing in this region.

Independent auto evaluation of an operative radiological protection program

International Nuclear Information System (INIS)

Medrano L, M.A.; Rodriguez C, C.C.; Linares R, D.; Zarate M, N.; Zempoalteca B, R.

2006-01-01

The program of operative radiological protection of a nuclear power plant consists of multiple procedures and associate tasks that have as purpose the radiological protection of the workers of the power station. It is for this reason that the constant evaluation of the one it programs it is an important tool in the identification of their weaknesses (and strengths), so they can be assisted appropriately. In this work the main elements of the program of independent auto evaluation of the program of operative radiological protection of the Laguna Verde Central that has been developed and implemented by the National Institute of Nuclear Research are described. (Author)

Taiwan Teacher Preparation Program Evaluation: Some Critical Perspectives

Science.gov (United States)

Liu, Tze-Chang

2015-01-01

This paper focuses on the influences and changes of recent Taiwan teacher preparation program evaluation (TTPPE) as one of the national evaluation projects conducted by the Higher Education Evaluation and Accreditation Council of Taiwan. The main concerns are what kind of ideology is transformed through the policy by means of evaluation, and what…

Evolution of a multilevel framework for health program evaluation.

Science.gov (United States)

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Evaluation of a liaison librarian program: client and liaison perspectives.

Science.gov (United States)

Tennant, Michele R; Cataldo, Tara Tobin; Sherwill-Navarro, Pamela; Jesano, Rae

2006-10-01

This paper describes a survey-based evaluation of the five-year old Liaison Librarian Program at the University of Florida. Liaison librarians, faculty, students, staff, residents, and post-doctoral associates were queried via Web-based surveys. Questions addressed client and liaison perspectives on a variety of issues, including program and service awareness and usage, client-library relations and communication, client support for the program, and liaison workload. Approximately 43% of the 323 client respondents were aware of liaison services; 72% (n = 163) of these clients had had contact with their liaison. Ninety-five percent (n = 101) of faculty and students who reported contact with their liaison supported the continuation of the program. Liaison services were used by a greater percentage of faculty than students, although they had similar patterns of usage and reported the same "traditional" services to be most important. Liaisons indicated that communications with clients had increased, the reputation of the library was enhanced, and their workloads had increased as a result of the Liaison Librarian Program. Survey results suggest that the Liaison Librarian Program has a core set of clients who use and highly value the services provided by liaisons. Recommendations addressing workload, training, marketing, and administrative support are provided.

Multicenter Collaborative Quality Assurance Program for the Province of Ontario, Canada: First-Year Results

International Nuclear Information System (INIS)

Létourneau, Daniel; McNiven, Andrea; Jaffray, David A.

2013-01-01

Purpose: The objective of this work was to develop a collaborative quality assurance (CQA) program to assess the performance of intensity modulated radiation therapy (IMRT) planning and delivery across the province of Ontario, Canada. Methods and Materials: The CQA program was designed to be a comprehensive end-to-end test that can be completed on multiple planning and delivery platforms. The first year of the program included a head-and-neck (H and N) planning exercise and on-site visit to acquire dosimetric measurements to assess planning and delivery performance. A single dosimeter was used at each institution, and the planned to measured dose agreement was evaluated for both the H and N plan and a standard plan (linear-accelerator specific) that was created to enable a direct comparison between centers with similar infrastructure. Results: CQA program feasibility was demonstrated through participation of all 13 radiation therapy centers in the province. Planning and delivery was completed on a variety of infrastructure (treatment planning systems and linear accelerators). The planning exercise was completed using both static gantry and rotational IMRT, and planned-to-delivered dose agreement (pass rates) for 3%/3-mm gamma evaluation were greater than 90% (92.6%-99.6%). Conclusions: All centers had acceptable results, but variation in planned to delivered dose agreement for the same planning and delivery platform was noted. The upper end of the range will provide an achievable target for other centers through continued quality improvement, aided by feedback provided by the program through the use of standard plans and simple test fields

Compulsory Project-Level Involvement and the Use of Program-Level Evaluations: Evaluating the Local Systemic Change for Teacher Enhancement Program

Science.gov (United States)

Johnson, Kelli; Weiss, Iris R.

2011-01-01

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Methods for evaluating a mature substance abuse prevention/early intervention program.

Science.gov (United States)

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

The US Department of Energy Personnel Dosimetry Evaluation and Upgrade Program

International Nuclear Information System (INIS)

Faust, L.G.; Stroud, C.M.; Swinth, K.L.; Vallario, E.J.

1987-11-01

The US Department of Energy (DOE) Personnel Dosimetry Evaluation and Upgrade Program is designed to identify and evaluate dosimetry deficiencies and to conduct innovative research and development programs that will improve overall capabilities, thus ensuring that DOE can comply with applicable standards and regulations for dose measurement. To achieve these goals, two programs were initiated to evaluate and upgrade beta measurement and neutron dosimetry. 3 refs

[Development of a program theory as a basis for the evaluation of a dementia special care unit].

Science.gov (United States)

Adlbrecht, Laura; Bartholomeyczik, Sabine; Mayer, Hanna

2018-06-01

Background: An existing dementia special care unit should be evaluated. In order to build a sound foundation of the evaluation a deep theoretical understanding of the implemented intervention is needed, which has not been explicated yet. One possibility to achieve this is the development of a program theory. Aim: The aim is to present a method to develop a program theory for the existing living and care concept of the dementia special care unit, which is used in a larger project to evaluate the concept theory-drivenly. Method: The evaluation is embedded in the framework of van Belle et al. (2010) and an action model and a change model (Chen, 2015) is created. For the specification of the change model the contribution analysis (Mayne, 2011) is applied. Data were collected in workshops with the developers and the nurses of the dementia special care unit and a literature research concerning interventions and outcomes was carried out. The results were synthesized in a consens workshop. Results: The action model describes the interventions of the dementia special care unit, the implementers, the organization and the context. The change model compromises the mechanisms through which interventions achieve outcomes. Conclusions: The results of the program theory can be employed to choose data collection methods and instruments for the evaluation. On the basis of the results of the evaluation the program theory can be refined and adapted.

Child Development Program Evaluation Scale.

Science.gov (United States)

Fiene, Richard J.

The Child Development Program Evaluation Scale (CDPES) is actually two scales in one, a licensing scale and a quality scale. Licensing predictor items have been found to predict overall compliance of child day care centers with state regulations in four states. Quality scale items have been found to predict the overall quality of child day care…

A report on evaluation of research and development subjects in fiscal year 2001. Evaluation subject on the 'Middle- and long-term business program'

International Nuclear Information System (INIS)

2001-09-01

The middle- and long-term business program determined by the Japan Nuclear Cycle Development Institute (JNC) is for elucidation of middle- and long-term targets to be expanded by JNC and is a base to promote individual R and D. This program is to be revised at a chance established on new long-term plan on research, development and application of nuclear energy on November, 2000 by the Committee of Atomic Energy under consideration of condition change after March, 1999. This report is a summary of evaluation results on the present middle- and long-term business program established by JNC, especially at a center of its revised portion, as a form of opinion. The evaluated results are described on two forms of the subject evaluation committees on the fast reactor and fuel cycle and on the wastes processing and disposal. (G.K.)

Objective Evaluation in an Online Geographic Information System Certificate Program

OpenAIRE

Scott L. WALKER

2005-01-01

Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program....

Nondestructive Evaluation Program: Progress in 1986

International Nuclear Information System (INIS)

1987-07-01

The increasing cost of equipment for power generating plants and the potential increases in productivity and safety available through rapidly developing Nondestructive Evaluation (NDE) technology led EPRI to initiate a Nondestructive Evaluation Program in 1974. To date, the major focus has been on light water reactor inspection problems; however, increased application to other systems is now under way. This report presents a comprehensive review of the EPRI effort in the NDE area. Most of the report consists of contractor-supplied progress reports on each current project. An organizational plan of the program is presented in overview. In addition, organization from several viewpoints is presented, e.g., in-service inspection operators, R and D personnel, and utility representatives. The report summarizes significant progress made since the previous EPRI Special Report NP-4315-SR was issued in May 1986. Section 1 contains information about the program organization, and the sections that follow contain contractor-supplied progress reports of each current project. The progress reports are grouped by plant components - pipe, pressure vessel, steam generator and boiler tubes, and turbine. In addition, Part 6 is devoted to discussions of technology transfer

Year One Evaluation of "Encendiendo Una Llama" Bilingual Gifted and Talented Program. Report 80-12.

Science.gov (United States)

Barstow, Daniel; Roby, Wallace R.

The document reports activities of "Encendiendo Una Llama," a bilingual gifted and talented program serving 60 students in grades K through 6 in a school day resource room component or in an after school program. Twelve program objectives are outlined in terms of proposed activities, proposed evaluation, actual results, and…

Engaging Street Youth in an Evaluation of a Community-Based Arts Program

Directory of Open Access Journals (Sweden)

Robin Wright

2008-06-01

Full Text Available Data from the Edmonton Arts & Youth Feasibility Study (EAYFS was used to ascertain the feasibility of engaging street youth in a structured community-based arts program and an outcome-based evaluation. The study engaged 23 street youth in a ten-week multi-media arts program focused on developing prosocial communication, team-building, and problem-solving skills. Results have shown that street youth are highly interested in artistic endeavors; will participate to the best of their circumstances; and will provide reliable data. The youth and staff reported improved art skills, problem-solving capacity, and prosocial communication as well as a decrease in drug use, depression, loneliness, and a greater sense of enjoyment about life. Strengths of the program included the arts media, the non-judgmental environment, and the support from staff. The study suggests that community-based arts programs for street youth could be subjected to a rigorous outcome-based evaluation.

[Construction of abridged life table for health evaluation of local resident using Excel program].

Science.gov (United States)

Chen, Qingsha; Wang, Feng; Li, Xiaozhen; Yang, Jian; Yu, Shouyi; Hu, Jun

2012-05-01

To provide an easy computational tool for evaluating the health condition of local residents. An abridged life table was programmed by applying mathematical functions and formula in Excel program and tested with the real study data to evaluate the results computed. The Excel was capable of computing group death probability of age in the life table ((n)q(x)), number of survivors (l(x)), number of death ((n)d(x)), survival per person-year ((n)L(x)), survival total per person-year (T(x)) and life expectancy (e(x)). The calculated results were consistent with those by SAS. The abridged life table constructed using Microsoft Excel can conveniently and accurately calculate the relevant indices for evaluating the health condition of the residents.

Evaluation of the RATU2 and RETU research programs

International Nuclear Information System (INIS)

Faidy, C.; Hayns, M.R.

1998-05-01

The report is an evaluation of the Finnish RATU2 (Structural Integrity of Nuclear Power Plants) and RETU (Reactor Safety) programs. The first generation of nuclear safety research programs were started in 1988-1990. Mid-term reviews were carried out and published in 1992. Many of the recommendations from those reviews have been implemented and they are referred to in this evaluation report

24 CFR 266.115 - Program monitoring and evaluation.

Science.gov (United States)

2010-04-01

... AUTHORITIES HOUSING FINANCE AGENCY RISK-SHARING PROGRAM FOR INSURED AFFORDABLE MULTIFAMILY PROJECT LOANS Housing Finance Agency Requirements § 266.115 Program monitoring and evaluation. (a) HFA certifications... under this part, basic underwriting and closing information must be submitted in a format specified by...

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

Science.gov (United States)

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper

EVOLUT - a computer program for fast burnup evaluation

International Nuclear Information System (INIS)

Craciunescu, T.; Dobrin, R.; Stamatescu, L.; Alexa, A.

1999-01-01

EVOLUT is a computer program for burnup evaluation. The input data consist on the one hand of axial and radial gamma-scanning profiles (for the experimental evaluation of the number of nuclei of a fission product - the burnup monitor - at the end of irradiation) and on the other hand of the history of irradiation (the time length and values proportional to the neutron flux for each step of irradiation). Using the equation of evolution of the burnup monitor the flux values are iteratively adjusted, by a multiplier factor, until the calculated number of nuclei is equal to the experimental one. The flux values are used in the equation of evolution of the fissile and fertile nuclei to determine the fission number and consequently the burnup. EVOLUT was successfully used in the analysis of several hundreds of CANDU and TRIGA-type fuel rods. We appreciate that EVOLUT is a useful tool in the burnup evaluation based on gamma spectrometry measurements. EVOLUT can be used on an usual AT computer and in this case the results are obtained in a few minutes. It has an original and user-friendly graphical interface and it provides also output in script MATLAB files for graphical representation and further numerical analysis. The computer program needs simple data and it is valuable especially when a large number of burnup analyses are required quickly. (authors)

The pollution reduction technology program for can-annular combustor engines - Description and results

Science.gov (United States)

Roberts, R.; Fiorentino, A. J.; Diehl, L.

1976-01-01

Pollutant reduction and performance characteristics were determined for three successively more advanced combustor concepts. Program Element I consisted of minor modifications to the current production JT8D combustor and fuel system to evaluate means of improved fuel preparation and changes to the basic airflow distribution. Element II addressed versions of the two-staged Vorbix (vortex burning and mixing) combustor and represented a moderate increase in hardware complexity and difficulty of development. The concept selected for Element III employed vaporized fuel as a means of achieving minimum emission levels and represented the greatest difficulty of development and adaptation to the JT8D engine. Test results indicate that the Element I single-stage combustors were capable of dramatic improvement in idle pollutants. The multistage combustors evaluated in Program Elements II and III simultaneously reduced CO, THC and NOx emissions, but were unable to satisfy the current 1979 EPA standards.

Evaluation of effects of program for improving skills and motivation for employment

Directory of Open Access Journals (Sweden)

Marić Zorica

2011-01-01

Full Text Available Contemporary programs that have been implemented in order to help unemployed reduce time for finding a job are based on clear theoretical background and empirical evidence. In addition to providing opportunities to learn necessary skills, these programs also incorporate important psychological components which will be addressed in this paper. The goal of these interventions is to reduce time for finding a job, prevent long-term unemployment and negative effects of unemployment on individuals“ mental health. The paper presents evaluation of the effects of these psychological interventions. The program was based on Ajzen’s theory of planned behavior (2005, Bandura’s social-cognitive theory (1997 and cognitive-behavior theory of behavioral change (Meichenbaum, 1993. The goal of this program was to help unemployed individuals take an active role in finding a job, reduce time for finding a job and prevent negative effects of unemployment on their mental health. The target group of the program were young unemployed individuals ages 19 - 30, with at least high school level of education. Evaluation study was conducted on a sample of 92 male and female individuals who attended 3-day psychological program. Participants filled out five short scales specifically designed to assess variables that were targeted for change, such as, active approach to finding a job, attitudes toward process of employment, self-efficacy and resilience to frustrations and obstacles. Scales were administered before and after the training. Evaluation results, based on these pre and post measures, showed significant positive effects of this program on all five variables.

Using GIS to evaluate a fire safety program in North Carolina.

Science.gov (United States)

Dudley, Thomas; Creppage, Kathleen; Shanahan, Meghan; Proescholdbell, Scott

2013-10-01

Evaluating program impact is a critical aspect of public health. Utilizing Geographic Information Systems (GIS) is a novel way to evaluate programs which try to reduce residential fire injuries and deaths. The purpose of this study is to demonstrate the application of GIS within the evaluation of a smoke alarm installation program in North Carolina. This approach incorporates national fire incident data which, when linked with program data, provides a clear depiction of the 10 years impact of the Get Alarmed, NC! program and estimates the number of potential lives saved. We overlapped Get Alarmed, NC! program installation data with national information on fires using GIS to identify homes that experienced a fire after an alarm was installed and calculated potential lives saved based on program documentation and average housing occupancy. We found that using GIS was an efficient and quick way to match addresses from two distinct sources. From this approach we estimated that between 221 and 384 residents were potentially saved due to alarms installed in their homes by Get Alarmed, NC!. Compared with other program evaluations that require intensive and costly participant telephone surveys and/or in-person interviews, the GIS approach is inexpensive, quick, and can easily analyze large disparate datasets. In addition, it can be used to help target the areas most at risk from the onset. These benefits suggest that by incorporating previously unutilized data, the GIS approach has the potential for broader applications within public health program evaluation.

Tuberculosis control program in the municipal context: performance evaluation

Directory of Open Access Journals (Sweden)

Tiemi Arakawa

Full Text Available ABSTRACT OBJECTIVE The objective of this study is to evaluate the performance of the Tuberculosis Control Program in municipalities of the State of São Paulo. METHODS This is a program evaluation research, with ecological design, which uses three non-hierarchical groups of the municipalities of the State of São Paulo according to their performance in relation to operational indicators. We have selected 195 municipalities with at least five new cases of tuberculosis notified in the Notification System of the State of São Paulo and with 20,000 inhabitants or more in 2010. The multiple correspondence analysis was used to identify the association between the groups of different performances, the epidemiological and demographic characteristics, and the characteristics of the health systems of the municipalities. RESULTS The group with the worst performance showed the highest rates of abandonment (average [avg] = 10.4, standard deviation [sd] = 9.4 and the lowest rates of supervision of Directly Observed Treatment (avg = 6.1, sd = 12.9, and it was associated with low incidence of tuberculosis, high tuberculosis and HIV, small population, high coverage of the Family Health Strategy/Program of Community Health Agents, and being located on the countryside. The group with the best performance presented the highest cure rate (avg = 83.7, sd = 10.5 and the highest rate of cases in Directly Observed Treatment (avg = 83.0, sd = 12.7; the group of regular performance showed regular results for outcome (avg cure = 79.8, sd = 13.2; abandonment avg = 9.5, sd = 8.3 and supervision of the Directly Observed Treatment (avg = 42.8, sd = 18.8. Large population, low coverage of the Family Health Strategy/Program of Community Health Agents, high incidence of tuberculosis and AIDS, and being located on the coast and in metropolitan areas were associated with these groups. CONCLUSIONS The findings highlight the importance of the Directly Observed Treatment in relation

Results from the Evaluation of the Massachusetts Nursing Home Connection Program

Science.gov (United States)

1989-10-01

For the rollovers, the midpoint data was collected at the time of transfer to the new system of care. The basic comparisons were from admission to...claims data from both the Medicare and Medicaid programs as well as nursing home data from the Massachusetts Medicaid Medical Information System ...Patients Rollovers )ieaes of nervus systern 13 15 Dementia 31 35 CVA 27 29 HIP 18 1 5 b Cancer 07 041) Neurologic disorders 6(30 62 )epression 03 04

Implementation and evaluation of a training program as part of the Cooperative Biological Engagement Program in Azerbaijan

Directory of Open Access Journals (Sweden)

April eJohnson

2015-10-01

Full Text Available A training program for animal and human health professionals has been implemented in Azerbaijan through a joint agreement between the United States Defense Threat Reduction Agency and the Government of Azerbaijan. The training program is administered as part of the Cooperative Biological Engagement Program, and targets key employees in Azerbaijan’s disease surveillance system including physicians, veterinarians, epidemiologists, and laboratory personnel. Training is aimed at improving detection, diagnosis, and response to especially dangerous pathogens, although the techniques and methodologies can be applied to other pathogens and diseases of concern. Biosafety and biosecurity training is provided to all trainees within the program. Prior to 2014, a variety of international agencies and organizations provided training, which resulted in gaps related to lack of coordination of training materials and content. In 2014 a new training program was implemented in order to address those gaps. This paper provides an overview of the Cooperative Biological Engagement Program training program in Azerbaijan, a description of how the program fits into existing national training infrastructure, and an evaluation of the new program’s effectiveness to date. Long-term sustainability of the program is also discussed.

Evaluation of an online continuing education program from the perspective of new graduate nurses.

Science.gov (United States)

Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike

2014-05-01

The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.

Evaluation of a program to enhance young drivers' safety in Israel.

Science.gov (United States)

Toledo, Tomer; Lotan, Tsippy; Taubman-Ben-Ari, Orit; Grimberg, Einat

2012-03-01

Young drivers in Israel, as in other parts of the world, are involved in car crashes more than any other age group. The graduated driver licensing system in Israel requires that all new drivers be accompanied by an experienced driver whenever they drive for the first 3 months after obtaining a driving license. In an effort to make the accompanied driving phase more effective, a novel program which targets both young drivers and their parents was initiated in 2005. The program administers a personal meeting with the young driver and the accompanying parent scheduled for the beginning of the accompanied driving phase. In this meeting guidance is given regarding best practices for undertaking the accompanied driving, as well as tips for dealing with in-vehicle parent-teen dynamics. Through 2008, almost 130,000 families of young drivers have participated in the program. In order to evaluate the effectiveness of the program, injury crash records of the young drivers who participated in the program were compared with those of all other young drivers that were licensed at the same time period. The results obtained indicate statistically significant lower crash records for young drivers that participated in the program. Limitations of the evaluation related to self-selection biases are discussed, and practical implications are suggested. Copyright © 2011 Elsevier Ltd. All rights reserved.

A multi-stakeholder evaluation of the Baltimore City virtual supermarket program

Directory of Open Access Journals (Sweden)

Pooja Lagisetty

2017-10-01

Full Text Available Abstract Background Increasing access to healthy foods and beverages in disadvantaged communities is a public health priority due to alarmingly high rates of obesity. The Virtual Supermarket Program (VSP is a Baltimore City Health Department program that uses online grocery ordering to deliver food to low-income neighborhoods. This study evaluates stakeholder preferences and barriers of program implementation. Methods This study assessed the feasibility, sustainability and efficacy of the VSP by surveying 93 customers and interviewing 14 programmatic stakeholders who had recently used the VSP or been involved with program design and implementation. Results We identified the following themes: The VSP addressed transportation barriers and food availability. The VSP impacted customers and the city by including improving food purchasing behavior, creating a food justice “brand for the city”, and fostering a sense of community. Customers appreciated using Supplemental Nutrition Assistance Program (SNAP benefits to pay for groceries, but policy changes are needed allow online processing of SNAP benefits. Conclusions This evaluation summarizes lessons learned and serves as a guide to other public health leaders interested in developing similar programs. Provisions in the U.S. Department of Agriculture (USDA Farm Bill 2014 allow for select grocers to pilot online transactions with SNAP benefits. If these pilots are efficacious, the VSP model could be easily disseminated.

Structural aging program -- a summary of activities, results, and conclusions

International Nuclear Information System (INIS)

Naus, D.J.; Oland, C.B.; Ellingwood, B.R.

1997-01-01

Research has been conducted by the Oak Ridge National Laboratory to address aging management of nuclear power plant concrete structures. The purpose was to identify potential structural safety issues and acceptance criteria for use in continued service assessments. Primary program accomplishments have included formulation of a Structural Materials Information Center that contains data and information on the time variation of material properties under the influence of pertinent environmental stressors and aging factors for 144 materials, an aging assessment methodology to identify critical structures and degradation factors that can potentially impact their performance, guidelines and evaluation criteria for use in condition assessments of reinforced concrete structures, and a reliability-based methodology for current condition assessments and estimations of future performance of reinforced concrete nuclear power plant structures. In addition, the Structural Aging Program conducted in-depth evaluations of several nondestructive evaluation and repair-related technologies to develop guidance on their applicability

Enhancing pediatric residents’ scholar role: the development of a Scholarly Activity Guidance and Evaluation program

Directory of Open Access Journals (Sweden)

Catherine M. Pound

2015-06-01

Full Text Available Background: Research training is essential to the development of well-rounded physicians. Although many pediatric residency programs require residents to complete a research project, it is often challenging to integrate research training into educational programs. Objective: We aimed to develop an innovative research program for pediatric residents, called the Scholarly Activity Guidance and Evaluation (SAGE program. Methods: We developed a competency-based program which establishes benchmarks for pediatric residents, while providing ongoing academic mentorship. Results: Feedback from residents and their research supervisors about the SAGE program has been positive. Preliminary evaluation data have shown that all final-year residents have met or exceeded program expectations. Conclusions: By providing residents with this supportive environment, we hope to influence their academic career paths, increase their research productivity, promote evidence-based practice, and ultimately, positively impact health outcomes.

Evaluation of the Navy Master Planning Program

Science.gov (United States)

1976-05-01

Navy planning directives, interviews with Navy planning personnel, researc " of applicable literature on planning and program evaluation, and the...master planning has absorbed the additional roles of program management and public relations marketing . The Navy planner is now deeply involved in...master planning 62conducted by NAVFAC headquarters in 1972, various Navy planning directives, a " Market Survey" of NAVFAC services and customer 63

Preliminary Evaluation of a Practice-Based EBVM Skills Development Program

Directory of Open Access Journals (Sweden)

Ava Firth

2016-12-01

Full Text Available Whilst there is a small body of research that investigates the development of EBVM skills in veterinary undergraduates there is a paucity of research that aims to understand the development of EBVM skills in practice-based post-graduate veterinary surgeons. This paper is a small step in remedying that shortfall. In particular, the paper provides a progress report on an RCVS Knowledge funded study that is evaluating a practice-based EBVM development program. The program is being conducted with a cohort of 20 veterinary surgeons and veterinary nurses employed in a private practice veterinary company across multiple sites. The facilitated instruction approach incorporates multiple supports including; group based and one-to-one, synchronous and asynchronous, and, face-to-face and online strategies. This paper will provide details of both the facilitation and evaluation approaches that have been adopted. The paper will also report on preliminary results of the evaluation which focuses on barriers and facilitators to EBVM development.This is a podcast of Ava and Ian's talk at the Veterinary Evidence Today conference, Edinburgh November 2, 2016.

38 CFR 1.15 - Standards for program evaluation.

Science.gov (United States)

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... intent, contain a method to measure fulfillment of the objectives, ascertain the degree to which goals... the data. (f) Each program evaluation requires a systematic research design to collect the data...

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

Science.gov (United States)

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

[The German program for disease management guidelines. Results and perspectives].

Science.gov (United States)

Ollenschläger, Günter; Kopp, Ina

2007-05-15

The Program for National Disease Management Guidelines (German DM-CPG Program) is a joint initiative of the German Medical Association (umbrella organization of the German Chambers of Physicians), the Association of the Scientific Medical Societies (AWMF), and of the National Association of Statutory Health Insurance Physicians (NASHIP). The program aims at developing, implementing and continuously updating best-practice recommendations for countrywide and regional disease management programs in Germany. Since 2003 twelve national guidelines (topics: asthma, chronic obstructive pulmonary disease, HI (Chronic heart failure), CVD (Chronic coronary heart disease) back pain, depression, several aspects of diabetes) have been produced by use of a standardized procedure in accordance with internationally consented methodologies. For countrywide dissemination and implementation the program uses a wide range of specialist journals, continuous medical education and quality management programs. So far, 36 out of 150 national scientific medical associations, four allied health profession organizations, and twelve national consumer organizations have been participating in the DM-CPG Program. Studies to evaluate the program's effects on health-care providers' behavior and patients' outcomes are under way.

UTILIZATION OF EVALUATION RESULTS IN LEGAL POLICY-MAKING AND ADMINISTRATION

Directory of Open Access Journals (Sweden)

Hellmut Wollmann

2017-01-01

Full Text Available The article is devoted to the analysis of evaluation method and its impact on legal policy development in governance, including in the area of law enforcement.The author outlines the importance of question whether, when and how the evaluation results of public policies, programs and measures has been utilized (or not utilized in policy making and policy implementation.In the pursuit of this guiding question the article will come in five steps.First, major variants of evaluation will be briefly presented particularly with an eye on their respective “utilization potential”.Second, different concepts will be sketched that have been forwarded to capture the utilization of social science generated knowledge by political, administrative and social actors. The author outlines a detailed description of types of evaluations: a retrospective, prelimi-nary, ongoing, interactive, – as well as existing concepts of application of its results.Third, looking at Germany, Switzerland and the European Union as “cases in point” perti-ent research findings will be discussed. The article also subjected to a detailed analysis of the experience of Germany, Switzerland and the European Union in the field of utilization of evaluation results.Fourth, a summary and conclusion will be given.Fifth, some remarks on pertinent research needs will be made.The author comes to the conclusion that that the rate of the utilization of evaluation-generated knowledge has so far turned out be, by and large, scarce. The author says that re-garding the politically crucial decisions the political rationality and its underlying political will of the decision-makers prevail while concerning less important decisions evaluation-generated evidence does show some effect and, hence, a dose of scientific rationality comes to the fore.There is also a need for further research on the subject of how should (and should not use assessment results when making legal and political decisions.

Experiential Education and Empowerment Evaluation: Mars Rover Educational Program Case Example.

Science.gov (United States)

Fetterman, David; Bowman, Cassie

2002-01-01

Empowerment evaluation helps people improve their programs using self-evaluation. Empowerment evaluation has three steps: establishing a mission; taking stock of the most significant activities; and planning for the future by establishing goals, strategies, and criteria for evidence. A NASA experiential program for small, distributed groups of…

A synthesis of evaluation monitoring projects by the forest health monitoring program (1998-2007)

Science.gov (United States)

William A. Bechtold; Michael J. Bohne; Barbara L. Conkling; Dana L. Friedman

2012-01-01

The national Forest Health Monitoring Program of the Forest Service, U.S. Department of Agriculture, has funded over 200 Evaluation Monitoring projects. Evaluation Monitoring is designed to verify and define the extent of deterioration in forest ecosystems where potential problems have been identified. This report is a synthesis of results from over 150 Evaluation...

U.S. experience in seismic re-evaluation and verification programs

International Nuclear Information System (INIS)

Stevenson, J.D.

1995-01-01

The purpose of this paper is to present a summary of the development of a seismic re-evaluation program for older nuclear power plants in the U.S. The principal focus of this reevaluation is the use of actual strong motion earthquake response data for structures and mechanical and electrical systems and components. These data are supplemented by generic shake table test results. Use of this type of seismic re-evaluation has led to major cost reductions as compared to more conventional analytical and component specific testing procedures. (author)

Evaluation of a workplace bullying cognitive rehearsal program in a hospital setting.

Science.gov (United States)

Stagg, Sharon J; Sheridan, Daniel; Jones, Ruth Ann; Speroni, Karen Gabel

2011-09-01

Workplace bullying is a serious problem faced by nurses nationally. This study was conducted to determine the frequency of workplace bullying and evaluate the effectiveness of a training program on cognitive rehearsal of responses to common bullying behaviors. This program to increase staff nurses' knowledge of management of workplace bullying consisted of three components: pilot survey testing, a piloted Internet-based survey administered to the medical and surgical nurses, and a 2-hour cognitive rehearsal training program on management of workplace bullying. The results showed that 80% of the nurses surveyed had experienced workplace bullying over the previous year. After the training program, nurses' knowledge of workplace bullying management significantly increased. Additionally, nurses were significantly more likely to report that they had observed bullying and had bullied others. Further, nurses felt more adequately prepared to handle workplace bullying. Results of the research support the provision of a workplace bullying management program for nurses and the need for a specific policy on workplace bullying. Copyright 2011, SLACK Incorporated.

Evaluating a Psychology Graduate Student Peer Mentoring Program

Science.gov (United States)

Fleck, Christina; Mullins, Morell E.

2012-01-01

Research on mentoring outcomes and characteristics of various types of mentoring programs in different settings is limited. The present study sampled 39 graduate students at a small Midwestern university to evaluate peer mentoring in a graduate school setting. Mentoring function and outcome relationships as well as program characteristics were…

IAEA coordinated research program on the evaluation of solidified high-level radioactive waste products

International Nuclear Information System (INIS)

Grover, J.R.; Schneider, K.J.

1979-01-01

A coordinated research program on the evaluation of solidified high-level radioactive waste products has been active with the IAEA since 1976. The program's objectives are to integrate research and to provide a data bank on an international basis in this subject area. Results and considerations to date are presented

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 1

Science.gov (United States)

Greenburg, J. S.; Gaelick, C.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

Commercial organizations as well as government agencies invest in spacecraft (S/C) technology programs that are aimed at increasing the performance of communications satellites. The value of these programs must be measured in terms of their impacts on the financial performane of the business ventures that may ultimately utilize the communications satellites. An economic evaluation and planning capability was developed and used to assess the impact of NASA on-orbit propulsion and space power programs on typical fixed satellite service (FSS) and direct broadcast service (DBS) communications satellite business ventures. Typical FSS and DBS spin and three-axis stabilized spacecraft were configured in the absence of NASA technology programs. These spacecraft were reconfigured taking into account the anticipated results of NASA specified on-orbit propulsion and space power programs. In general, the NASA technology programs resulted in spacecraft with increased capability. The developed methodology for assessing the value of spacecraft technology programs in terms of their impact on the financial performance of communication satellite business ventures is described. Results of the assessment of NASA specified on-orbit propulsion and space power technology programs are presented for typical FSS and DBS business ventures.

An evaluation of a coal mining company's return to work program

International Nuclear Information System (INIS)

Allen, R.G.

1990-01-01

This study consolidates and evaluates information and data obtained from a coal mining company's return to work program called the Work Therapy Program. Organizational information and economic and statistical data were available for the study based on the company's records. Analysis of the data included descriptive statistics such as total injuries, the frequency rate of injuries, total days away from work due to injury, average days away per employee, and severity rates. A cost-benefit analysis was conducted to determine if the Program was economically beneficial to the company. Data from an opinion survey of the management at the mine where the Program was first instituted was used to determine the perceptions of mine management with respect to the Work Therapy Program. Conclusions were that the Work Therapy Program was economically beneficial to the Company and that the Program resulted in a significant reduction in compensable injuries. The Program did not significantly reduce days away from work due to mine injury. Perceptions of mine management were mostly positive

The management of evaluating the European programs and policies implemented in Romania

Directory of Open Access Journals (Sweden)

Doctoral student ROMAN MIHAELA

2011-12-01

Full Text Available Starting with the reform and modernization of the public administration in Romania in the mid 1990s, an important element of this process being the development of the management process, respectively of planning and managing public policies, the Romanian government started also a process of developing the capacity for evaluating public programs and policies, both the ones with European or foreign financing and the ones with domestic financing. Up-to-date analyses and studies have showed, however, that at the level of the national public sector there is a major discrepancy between the progress made in the evaluation of European programs or the ones with foreign financing and the programs financed from public funds, namely that there is a consolidated evaluation practice as regards the first types of programs, which is virtually inexistent as regards programs financed from the public budget.This paper intends to identify the progress made at the level of the Romanian public administration as regards the management of evaluating programs with European financing, to see the characteristics of building the evaluation capacity within the national system of these programs and the motivation stimulating such approaches. The first part of this paper shall contain a presentation of the background of the current evaluation system, including both the legislative framework and the institutional framework with duties of management and evaluation of European programs; further, I shall analyze the evolution of this system in order to be able to draw conclusions regarding the evaluation capacity of Romania.

Evaluation of a Hospital-Based Pneumonia Nurse Navigator Program.

Science.gov (United States)

Seldon, Lisa E; McDonough, Kelly; Turner, Barbara; Simmons, Leigh Ann

2016-12-01

The aim of this study is to evaluate the effectiveness of a hospital-based pneumonia nurse navigator program. This study used a retrospective, formative evaluation. Data of patients admitted from January 2012 through December 2014 to a large community hospital with a primary or secondary diagnosis of pneumonia, excluding aspiration pneumonia, were used. Data included patient demographics, diagnoses, insurance coverage, core measures, average length of stay (ALOS), disposition, readmission rate, financial outcomes, and patient barriers to care were collected. Descriptive statistics and parametric testing were used to analyze data. Core measure performance was sustained at the 90th percentile 2 years after the implementation of the navigator program. The ALOS did not decrease to established benchmarks; however, the SD for ALOS decreased by nearly half after implementation of the navigator program, suggesting the program decreased the number and length of extended stays. Charges per case decreased by 21% from 2012 to 2014. Variable costs decreased by 4% over a 2-year period, which increased net profit per case by 5%. Average readmission payments increased by 8% from 2012 to 2014, and the net revenue per case increased by 8.3%. The pneumonia nurse navigator program may improve core measures, reduce ALOS, and increase net revenue. Future evaluations are necessary to substantiate these findings and optimize the cost and quality performance of navigator programs.

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

Science.gov (United States)

Ewell, Bob

1998-01-01

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs

Evaluating a food bank recipe-tasting program.

Science.gov (United States)

Keller-Olaman, Susan J; Edwards, Vicki; Elliott, Susan J

2005-01-01

Food banks mitigate immediate food insecurity, but their ability to promote healthy nutrition is constrained by how often recipients may visit and the range of foods available. In a descriptive study, a formative evaluation was completed of a combined heart-healthy recipe-tasting and education program that aims to promote healthy eating knowledge and skills in a group of food bank recipients in Hamilton, Ontario. Fifty-five adults were surveyed about food bank attendance, program awareness, perceived enhancement of knowledge and skills, and suggestions for program improvement. Most participants (73%) were positive about the program, and 91% wanted the program to continue. In addition, 78% would prepare the recipes sampled. In contrast, program awareness and planning food bank visits to coincide with the program were generally low. Food banks are potential sites for effective nutrition promotion programs. To reach more recipients, more frequent implementation and seeking the use of a designated room are suggested for the current program. The findings also suggest that the sampling approach to promoting healthy eating to food bank recipients deserves further study. For example, monitoring the selection of featured recipe ingredients would be a useful indicator of behaviour.

Evaluation Methodologies for Estimating the Likelihood of Program Implementation Failure

Science.gov (United States)

Durand, Roger; Decker, Phillip J.; Kirkman, Dorothy M.

2014-01-01

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

Secondary Education Programs in Kuwait: An Evaluation Study

Science.gov (United States)

Eid, Ghada K.; Koushki, Parviz A.

2005-01-01

This paper evaluates the effectiveness of the semester and the credit programs of high school education in Kuwait in terms of their graduating students' preparedness for continued and successful academic performance in programs of higher education. Students' percentile graduation rank from high school and their performances in the English, math…

GESAT: System for management and evaluation of training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper describe the criteria considered to design the GESAT system, the elements considered to select the relational model, selection of the database language and the main features and possibilities of this system. GESAT allow the management of training programs based on the Systematic Approach to Training. Include the information related with all SAT phases, the results of the job analysis, training plans design, development of materials, training implementation, and the subsequent evaluation

Using Program Theory-Driven Evaluation Science to Crack the Da Vinci Code

Science.gov (United States)

Donaldson, Stewart I.

2005-01-01

Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

Evaluation of a class wide teaching program for developing preschool life skills.

Science.gov (United States)

Hanley, Gregory P; Heal, Nicole A; Tiger, Jeffrey H; Ingvarsson, Einar T

2007-01-01

Recently, nonmaternal center-based child care has been linked to problem behavior in young children (National Institute of Child Health and Human Development, 2003). In response, a comprehensive program to promote prosocial skills was evaluated in a classroom of 16 children between the ages of 3 and 5 years. Classroom observations were conducted during evocative situations to determine the likelihood of problem behavior (noncompliance, vocal or motor disruptions, aggression) and preschool life skills. A classwide teaching program was then implemented in a staggered manner across instruction following, functional communication, delay tolerance, and friendship skills. These four categories of preschool life skills, which included two to four related skills, were selected for classwide teaching because they were either identified by educators as important for early school success, have often been taught following functional assessments of more severe problem behavior, or both. Skills were taught on a classwide basis during typically scheduled activities (circle, free play, transitions, meals) via instructions, modeling, role play, and feedback. A multiple probe design showed that the program resulted in an 74% reduction in problem behavior and a more than four-fold increase in preschool life skills. Similar beneficial effects of the program were evident in questionnaire data gathered prior to and at the close of the evaluation. Finally, the teachers who implemented the program reported overall high levels of satisfaction with the classwide teaching program, the target skills, and the results. Implications for the design of early childhood experiences for preempting the development of serious problem behavior are discussed.

Systematic evaluation program, status summary report

International Nuclear Information System (INIS)

1983-01-01

Status reports are presented on the systematic evaluation program for the Big Rock Point reactor, Dresden-1 reactor, Dresden-2 reactor, Ginna-1 reactor, Connecticut Yankee reactor, LACBWR reactor, Millstone-1 reactor, Oyster Creek-1 reactor, Palisades-1 reactor, San Onofre-1 reactor, and Rowe Yankee reactor

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

EVALUATION OF CORPORATE SOCIAL RESPONSIBILITY PROGRAM IMPLEMENTATION IN BOGOR PDAM TIRTA PAKUAN, WEST JAVA PROVINCE

Directory of Open Access Journals (Sweden)

Ismartaya Ismartaya

2017-07-01

Full Text Available The purpose of this research is to determine whether the evaluation corporate social responsibility program implementation in Bogor PDAM Tirta Pakuan has been implemented in accordance with the vision, mission, and objectives of the company. PDAM Tirta Pakuan has a vision of CSR as a pioneer in the implementation of social responsibility in Bogor city especially and Indonesia in general. Through this vision, PDAM Tirta Pakuan Bogor city, would really seriously on the implementation of the CSR programs. Based on these purposes, this research is done by evaluating the CSR programs which implemented by PDAM Tirta Pakuan Bogor city and use CIPP evaluation model to conduct an evaluation of the program. The type which used on this research is evaluation research with using a qualitative approach. The source of information used is the Chief Executive of CSR PDAM Tirta Pakuan Bogor. Data collected by the observation, interview and documentation. Test validity of this research by using triangulation technique, while data analysis is done by reducing the data, presenting and concluding. The result shows that the program Tirta Pakuan care as the company’s strategy goes according to the purposes and plans that have been made by the company.

Defence Health Service Mentoring Program Evaluation 2001

National Research Council Canada - National Science Library

Highfield, Jane

2002-01-01

...). DHS commissioned the Directorate of Strategic Personnel Planning and Research (DSPPR) to evaluate a recent Mentoring Program trial in order to assess the effectiveness and organizational value of Mentoring within DHS...

An Evaluation of Taiwan Vocational and Technical Education Programs in Agriculture.

Science.gov (United States)

Meaders, O. Donald; Chi-ho, Hu

Presented in both English and Chinese, this study of the system of agricultural education in Taiwan secondary and postsecondary schools resulted from the author's five-month stay in Taiwan and subsequent visits. Focus of the study is on evaluation of Taiwan's vocational agriculture education programs with information about students, faculties,…

Report of the evaluation by the Ad Hoc Review Committee on advance science research. Result evaluation, interim evaluation, in-advance evaluation in fiscal year 2003

International Nuclear Information System (INIS)

2003-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Advanced Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the accomplishments of the research completed in Fiscal Year 2002, the accomplishments of the research started in Fiscal Year 2001, and the adequacy of the programs of the research to be started in Fiscal Year 2004 at Advanced Science Research Center of JAERI. The Ad Hoc Review Committee consisted of nine specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from May to July 2003. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 24, 2003, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on August 4, 2003. This report describes the result of the evaluation by the Ad Hoc Review Committee on Advanced Science Research. (author)

Report of the evaluation by the Ad Hoc Review Committee on Advance Science Research. Result evaluation, interim evaluation, in-advance evaluation in fiscal year 2002

Energy Technology Data Exchange (ETDEWEB)

NONE

2002-11-01

The Research Evaluation Committee, which consisted of 13 members from outside of the Japan Atomic Energy Research Institute (JAERI), set up an Ad Hoc Review Committee on Advanced Science Research in accordance with the Fundamental Guideline for the Evaluation of Research and Development (R and D) at JAERI' and its subsidiary regulations in order to evaluate the accomplishments of the research completed in Fiscal Year 2001, the accomplishments of the research started in Fiscal Year 2000, and the adequacy of the programs of the research to be started in Fiscal Year 2003 at Advanced Science Research Center of JAERI. The Ad Hoc Review Committee consisted of eight specialists from outside of JAERI. The Ad Hoc Review Committee conducted its activities from May to July 2002. The evaluation was performed on the basis of the materials submitted in advance and of the oral presentations made at the Ad Hoc Review Committee meeting which was held on June 4, 2002, in line with the items, viewpoints, and criteria for the evaluation specified by the Research Evaluation Committee. The result of the evaluation by the Ad Hoc Review Committee was submitted to the Research Evaluation Committee, and was judged to be appropriate at its meeting held on August 5, 2002. This report describes the result of the evaluation by the Ad Hoc Review Committee on Advanced Science Research. (author)

Process evaluation of the Regional Biomass Energy Program

Energy Technology Data Exchange (ETDEWEB)

Wilson, C.R.; Brown, M.A.; Perlack, R.D.

1994-03-01

The U.S. Department of Energy (DOE) established the Regional Biomass Energy Program (RBEP) in 1983 to increase the production and use of biomass energy resources. Through the creation of five regional program (the Great Lakes, Northeast, Pacific Northwest, Southeast, and West), the RBEP focuses on regionally specific needs and opportunities. In 1992, Oak Ridge National (ORNL) conducted a process evaluation of the RBEP Program designed to document and explain the development of the goals and strategies of the five regional programs; describe the economic and market context surrounding commercialization of bioenergy systems; assess the criteria used to select projects; describe experiences with cost sharing; identify program accomplishments in the transfer of information and technology; and offer recommendations for program improvement.

29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

Science.gov (United States)

2010-07-01

... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

SKB's program for societal research 2004-2011. An evaluation; SKB:s program foer samhaellsforskning 2004-2011. En utvaerdering

Energy Technology Data Exchange (ETDEWEB)

Soederberg, Olof [Energi- och miljoestrategi O. Soederberg, Solna (Sweden)

2012-04-15

This evaluation of the program of societal research that SKB conducted the years 2004-2011 has been performed on behalf of Swedish Nuclear Fuel and Waste Management Company (SKB). The review has focused on answers to a series of questions as follows: General questions - Why was a program started? - What was SKB's purpose with the program? - Does the result mean that the objective has been achieved? - Has the program had effects (positive or negative) that were not anticipated when the purpose was formulated? - Strengths and weaknesses of the program? Questions about the implementation - How did announcement and selection procedures work? - Which forms were used for reporting results from the research projects? Questions about the continued investment in societal research - Are there such needs? - In that case, is it in SKB's interest to contribute financially to such research? - What forms might be appropriate if SKB sees interest to contribute financially to such research?.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-01-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Objective Evaluation in an Online Geographic Information System Certificate Program

Directory of Open Access Journals (Sweden)

Scott L. WALKER

2005-01-01

Full Text Available Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program. The evaluation utilized several methods that strived to inject objectivity in evaluation and subsequent decision-making. A rapid multi-modal approach included evaluation methods of (1 considering the online psychosocial learning environment, (2 content analyses comparing the online version of classes to face-to-face versions, (3 cost comparisons in online vs. face-to-face classes, (4 student outcomes, (5 student retention, and (6 benchmarking. These approaches offer opportunities for departmental administrators and decision-making committees to make judgments informed by facts rather than being influenced by the emotions, beliefs, or opinions of organizational dynamics.

DOE Hydrogen Program: 2005 Annual Merit Review and Peer Evaluation Report

Energy Technology Data Exchange (ETDEWEB)

Chalk, S. G.

2005-09-01

This report summarizes comments from the Peer Review Panel at the FY 2005 DOE Hydrogen Program Annual Merit Review, held on May 23-26, 2005, in Arlington, Virginia. The projects evaluated support the Department of Energy and President Bush's Hydrogen Initiative. The results of this merit review and peer evaluation are major inputs used by DOE to make funding decisions. Project areas include hydrogen production and delivery; hydrogen storage; fuel cells; technology validation; safety, codes and standards; education; and systems analysis.

DOE Hydrogen Program: 2006 Annual Merit Review and Peer Evaluation Report

Energy Technology Data Exchange (ETDEWEB)

Milliken, J.

2006-09-01

This report summarizes comments from the Peer Review Panel at the FY 2006 DOE Hydrogen Program Annual Merit Review, held on May 16-19, 2006, in Arlington, Virginia. The projects evaluated support the Department of Energy and President Bush's Hydrogen Initiative. The results of this merit review and peer evaluation are major inputs used by DOE to make funding decisions. Project areas include hydrogen production and delivery; hydrogen storage; fuel cells; technology validation; safety, codes and standards; education; and systems analysis.

Evaluating the High School Lunar Research Projects Program

Science.gov (United States)

Shaner, A. J.; Shipp, S. S.; Allen, J.; Kring, D. A.

2012-12-01

The Center for Lunar Science and Exploration (CLSE), a collaboration between the Lunar and Planetary Institute and NASA's Johnson Space Center, is one of seven member teams of the NASA Lunar Science Institute (NLSI). In addition to research and exploration activities, the CLSE team is deeply invested in education and outreach. In support of NASA's and NLSI's objective to train the next generation of scientists, CLSE's High School Lunar Research Projects program is a conduit through which high school students can actively participate in lunar science and learn about pathways into scientific careers. The objectives of the program are to enhance 1) student views of the nature of science; 2) student attitudes toward science and science careers; and 3) student knowledge of lunar science. In its first three years, approximately 140 students and 28 teachers from across the United States have participated in the program. Before beginning their research, students undertake Moon 101, a guided-inquiry activity designed to familiarize them with lunar science and exploration. Following Moon 101, and guided by a lunar scientist mentor, teams choose a research topic, ask their own research question, and design their own research approach to direct their investigation. At the conclusion of their research, teams present their results to a panel of lunar scientists. This panel selects four posters to be presented at the annual Lunar Science Forum held at NASA Ames. The top scoring team travels to the forum to present their research. Three instruments have been developed or modified to evaluate the extent to which the High School Lunar Research Projects meets its objectives. These three instruments measure changes in student views of the nature of science, attitudes towards science and science careers, and knowledge of lunar science. Exit surveys for teachers, students, and mentors were also developed to elicit general feedback about the program and its impact. The nature of science

Presentation of economic evaluation results.

Science.gov (United States)

Chaikledkaew, Usa

2014-05-01

The first HTA guidelines for Thailand included a chapter outlining a set of guidelines on how best to report the findings of health economic evaluations, based on a review of best practice and existing guidelines on the presentation of economic evaluation results from around the world. In this second edition of HTA guidelines for Thailand, the recommendations build on the first edition by using a case study to illustrate how the guidelines can be applied in a real research context. The guidelines propose that all reporting include ten key elements: defining the scope of the study, selection of comparator(s), defining the type of economic evaluation, measurement of costs, measurement of clinical effects, handling time in economic evaluation studies, handling uncertainty and sensitivity analysis, presentation of the results, discussion of the results, and disclosure of funding and authors conflict of interest.

Challenges and solutions in the evaluation of a low back pain disease management program.

Science.gov (United States)

Kotsos, Thomas; Muldowney, Kevin; Chapa, Griselda; Martin, J Eric; Linares, Antonio

2009-02-01

This paper examines a novel approach to evaluating a nurse-run telephonic low back pain (LBP) disease management (DM) program offered by a fully-insured commercial health plan population with approximately 150,000 members located in the northeastern United States. Members with at least 6 member months of eligibility were identified to have LBP using administrative claims and eligibility data. The LBP program relies on telephonic nurse management augmented by printed materials, adapting and advocating HEDIS imaging guidelines, and drug utilization review. Outcomes of this LBP DM program were assessed using a pre-post population-based approach as recommended in the DMAA Outcomes Guidelines Report. Baseline year and program year populations were segmented into 5 LBP clinical categories and each was weight adjusted using population size. LBP-related medical service utilization and pharmacy utilization also were evaluated. Individuals under active LBP management exhibited a decrease in LBP-related imaging and surgeries. Overall analgesic use also decreased. These data suggest the LBP DM program is associated with a decrease in imaging, surgeries, and analgesic use. The magnitude of the clinically segmented weight-adjusted return on investment (ROI) was lower than the unadjusted ROI, but was directionally positive indicating program impact. This adjustment is necessary in order to gain insight into and consistency of the results of a comprehensive LBP DM program evaluation.

Chemistry technician performance evaluation program Palo Verde Nuclear Generating Station

International Nuclear Information System (INIS)

Shawver, J.M.

1992-01-01

The Arizona Nuclear Power Project (ANPP), a three-reactor site located 50 miles west of Phoenix, Arizona, has developed and implemented a program for evaluating individual chemistry technician analytical performance on a routine basis. About 45 chemistry technicians are employed at the site, 15 at each operating unit. The technicians routinely perform trace level analyses for impurities of concern to PWRs. Each month a set of blind samples is provided by an outside vendor. The blind samples contain 16 parameters which are matrixed to approximate the PWR's primary and secondary cycles. Nine technicians receive the samples, three from each operating unit, and perform the required analyses. Acceptance criteria for successful performance on the blind parameters is based on the values found in the Institute of Nuclear Power Operations (INPO) Document 83-016, Revision 2, August 1989, Chemistry Quality Control Program. The goal of the program is to have each technician demonstrate acceptable performance on each of 16 analytical parameters. On completion of each monthly set, a summary report of all of the analytical results for the sample set is prepared. From the summary report, analytical bias can be detected, technician performance is documented, and overall laboratory performance can be evaluated. The program has been very successful at satisfying the INPO requirement that the analytical performance of each individual technician should be checked on at least a six-month frequency for all important parameters measured. This paper describes the program as implemented at the Palo Verde Nuclear Generating Station and provides a summary report and trend and bias graphs for illustrative purposes

Program Evaluation in Cost Benefit Terms.

Science.gov (United States)

Tanner, C. Kenneth

This paper advances a model, called the expected opportunity loss model, for curriculum evaluation. This decision-making technique utilizes subjective data by ranking courses according to their expected contributions to the primary objective of the total program. The model also utilizes objective data in the form of component costs, and differs…

Automated Critical PeakPricing Field Tests: 2006 Pilot ProgramDescription and Results

Energy Technology Data Exchange (ETDEWEB)

Piette, Mary Ann; Watson, David; Motegi, Naoya; Kiliccote, Sila

2007-06-19

During 2006 Lawrence Berkeley National Laboratory (LBNL) and the Demand Response Research Center (DRRC) performed a technology evaluation for the Pacific Gas and Electric Company (PG&E) Emerging Technologies Programs. This report summarizes the design, deployment, and results from the 2006 Automated Critical Peak Pricing Program (Auto-CPP). The program was designed to evaluate the feasibility of deploying automation systems that allow customers to participate in critical peak pricing (CPP) with a fully-automated response. The 2006 program was in operation during the entire six-month CPP period from May through October. The methodology for this field study included site recruitment, control strategy development, automation system deployment, and evaluation of sites' participation in actual CPP events through the summer of 2006. LBNL recruited sites in PG&E's territory in northern California through contacts from PG&E account managers, conferences, and industry meetings. Each site contact signed a memorandum of understanding with LBNL that outlined the activities needed to participate in the Auto-CPP program. Each facility worked with LBNL to select and implement control strategies for demand response and developed automation system designs based on existing Internet connectivity and building control systems. Once the automation systems were installed, LBNL conducted communications tests to ensure that the Demand Response Automation Server (DRAS) correctly provided and logged the continuous communications of the CPP signals with the energy management and control system (EMCS) for each site. LBNL also observed and evaluated Demand Response (DR) shed strategies to ensure proper commissioning of controls. The communication system allowed sites to receive day-ahead as well as day-of signals for pre-cooling, a DR strategy used at a few sites. Measurement of demand response was conducted using two different baseline models for estimating peak load savings. One

An approach for evaluating the market effects of energy efficiency programs

International Nuclear Information System (INIS)

Vine, E.; Prahl, R.; Meyers, S.; Turiel, I.

2010-01-01

This paper presents work currently being carried out in California on evaluating market effects. We first outline an approach for conducting market effect studies that includes the six key steps that were developed in study plans: (1) a scoping study that characterizes a particular market, reviews relevant market effects studies, develops integrated market and program theories, and identifies market indicators; (2) analysis of market evolution, using existing data sources; (3) analysis of market effects, based on sales data and interviews with key market actors; (4) analysis of attribution; (5) estimation of energy savings; and (6) assessment of sustainability (i.e., the extent to which any observed market effects are likely to persist in the absence or reduction of public intervention, and thus has helped to transform the market). We describe the challenges in conducting this type of analysis (1) selecting a comparison state(s) to California for a baseline, (2) availability and quality of data (limiting analyses), (3) inconsistent patterns of results, and (4) conducting market effects evaluations at one point in time, without the benefit of years of accumulated research findings, and then provide some suggestions for future research on the evaluation of market effects. With the promulgation of market transformation programs, the evaluation of market effects will be critical. We envision that these market effects studies will help lay the foundation for the refinement of techniques for measuring the impacts of programs that seek to transform markets for energy efficiency products and practices.

Mixed Waste Integrated Program interim evaluation report on thermal treatment technologies

International Nuclear Information System (INIS)

Gillins, R.L.; DeWitt, L.M.; Wollerman, A.L.

1993-02-01

The Mixed Waste Integrated Program (MWIP) is one of several US Department of Energy (DOE) integrated programs established to organize and coordinate throughout the DOE complex the development of technologies for treatment of specific waste categories. The goal of the MWIP is to develop and deploy appropriate technologies for -the treatment of DOE mixed low-level and alpha-contaminated wastes in order to bring all affected DOE installations and projects into compliance with environmental laws. Evaluation of treatment technologies by the MWIP will focus on meeting waste form performance requirements for disposal. Thermal treatment technologies were an early emphasis for the MWIP because thermal treatment is indicated (or mandated) for many of the hazardous constituents in DOE mixed waste and because these technologies have been widely investigated for these applications. An advisory group, the Thermal Treatment Working Group (TTWG), was formed during the program's infancy to assist the MWIP in evaluating and prioritizing thermal treatment technologies suitable for development. The results of the overall evaluation scoring indicate that the four highest-rated technologies were rotary kilns, slagging kilns, electric-arc furnaces, and plasma-arc furnaces. The four highest-rated technologies were all judged to be applicable on five of the six waste streams and are the only technologies in the evaluation with this distinction. Conclusions as to the superiority of one technology over others are not valid based on this preliminary study, although some general conclusions can be drawn

Development of a program for evaluating the temperature of SMART-P fuel rod

Energy Technology Data Exchange (ETDEWEB)

Cheon, Jin Sik; Lee, Byung Ho; Koo, Yang Hyun; Oh, Je Yong; Yim, Jeong Sik; Sohn, Dong Seong

2003-11-01

A code for evaluating the temperature of SMART-P fuel rod has been developed. Finite Element (FE) method is adopted for the developed code sharing the user subroutines which has been prepared for the ABAQUS commercial FE code. The developed program for SMART-P fuel rod corresponds to a nonlinear transient heat transfer problem, and uses a sparse matrix solver for FE equations during iterations at every time step. The verifications of the developed program were conducted using the ABAQUS code. Steady state and transient problems were analyzed for 1/8 rod model due to the symmetry of the fuel rod and full model. From the evaluation of temperature for the 1/8 rod model at steady state, maximal error of 0.18 % was present relative to the ABAQUS result. Analysis for the transient problem using the fuel rod model resulted in the same as the variation of centerline temperature from the ABAQUS code during a hypothetical power transient. Also, given a power depression in fuel meat as a function of burnup, its effect on the centerline temperature was more precisely evaluated by the developed program compared to the ABAQUS code. The distribution of heat flux for the entire cross section and surface was almost identical for the two codes.

Status of beta measurement evaluation and upgrade program

International Nuclear Information System (INIS)

Swinth, K.L.

1986-01-01

In 1983, the US Department of Energy (DOE) initiated a program to evaluate and upgrade beta dosimetry capabilities at DOE and DOE-contractor facilities. The program has several elements which structure the development of improvements in beta measurement practices. In addition to Pacific Northwest Laboratory (PNL), universities, private corporations, and other DOE facilities are involved in the research efforts

Using program logic model analysis to evaluate and better deliver what works

International Nuclear Information System (INIS)

Megdal, Lori; Engle, Victoria; Pakenas, Larry; Albert, Scott; Peters, Jane; Jordan, Gretchen

2005-01-01

There is a rich history in using program theories and logic models (PT/LM) for evaluation, monitoring, and program refinement in a variety of fields, such as health care, social and education programs. The use of these tools to evaluate and improve energy efficiency programs has been growing over the last 5-7 years. This paper provides an overview of the state-of-the-art methods of logic model development, with analysis that significantly contributed to: Assessing the logic behind how the program expects to be able to meets its ultimate goals, including the 'who', the 'how', and through what mechanism. In doing so, gaps and questions that still need to be addressed can be identified. Identifying and prioritize the indicators that should be measured to evaluate the program and program theory. Determining key researchable questions that need to be answered by evaluation/research, to assess whether the mechanism assumed to cause the changes in actions, attitudes, behaviours, and business practices is workable and efficient. Also will assess the validity in the program logic and the likelihood that the program can accomplish its ultimate goals. Incorporating analysis of prior like programs and social science theories in a framework to identify opportunities for potential program refinements. The paper provides an overview of the tools, techniques and references, and uses as example the energy efficiency program analysis conducted for the New York State Energy Research and Development Authority's (NYSERDA) New York ENERGY $MART SM programs

Cost-effectiveness of an exercise program during pregnancy to prevent gestational diabetes: Results of an economic evaluation alongside a randomised controlled trial

NARCIS (Netherlands)

Oostdam, E.W.M.; Bosmans, J.E.; Wouters, M.G.A.J.; Eekhoff, E.M.W.; van Mechelen, W.; van Poppel, M.N.M.

2012-01-01

Background: The prevalence of gestational diabetes mellitus (GDM) is increasing worldwide. GDM and the risks associated with GDM lead to increased health care costs and losses in productivity. The objective of this study is to evaluate whether the FitFor2 exercise program during pregnancy is

Summative Evaluation Findings from the Interstellar Boundary Explorer (IBEX) Education and Public Outreach Program

Science.gov (United States)

Bartolone, L.; Nichols-Yehling, M.; Davis, H. B.; Davey, B.

2014-07-01

The Interstellar Boundary Explorer mission includes a comprehensive Education and Public Outreach (EPO) program in heliophysics that is overseen and implemented by the Adler Planetarium and evaluated by Technology for Learning Consortium, Inc. Several components of the IBEX EPO program were developed during the prime phase of the mission that were specifically designed for use in informal institutions, especially museums and planetaria. The program included a widely distributed planetarium show with accompanying informal education activities, printed posters, lithographs and other resources, funding for the development of the GEMS Space Science Sequence for Grades 6-8 curriculum materials, development of the IBEX mission website, development of materials for people with special needs, participation in the Heliophysics Educator Ambassador program, and support for the Space Explorers Afterschool Science Club for Chicago Public Schools. In this paper, we present an overview of the IBEX EPO program summative evaluation techniques and results for 2008 through 2012.

In Situ Remediation Integrated Program, Evaluation and assessment of containment technology

International Nuclear Information System (INIS)

Gerber, M.A.; Fayer, M.J.

1994-04-01

The In Situ Remediation Integrated Program (ISRIP) was established by the US Department of Energy (DOE) to advance the state-of-the art of innovative in situ remediation technologies to the point of demonstration and to broaden the applicability of these technologies to the widely varying site remediation requirements throughout the DOE complex. This program complements similar ongoing integrated demonstration programs being conducted at several DOE sites. The ISRIP has been conducting baseline assessments on in situ technologies to support program planning. Pacific Northwest Laboratory conducted an assessment and evaluation of subsurface containment barrier technology in support of ISRIP's Containment Technology Subprogram. This report summarizes the results of that activity and provides a recommendation for priortizing areas in which additional research and development is needed to advance the technology to the point of demonstration in support of DOE's site restoration activities

29 CFR 1960.79 - Self-evaluations of occupational safety and health programs.

Science.gov (United States)

2010-07-01

... 29 Labor 9 2010-07-01 2010-07-01 false Self-evaluations of occupational safety and health programs. 1960.79 Section 1960.79 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs...

Development of System for Evaluating Concrete Strength Deterioration Due to Radiation and Resultant Heat

International Nuclear Information System (INIS)

Maruyama, I.; Kontani, O.; Ishizawa, A.; Takizawa, M.; Sato, O.

2012-01-01

Evaluation of the soundness of concrete exposed to irradiation has been studied within the framework of a project of the Nuclear and Industrial Safety Agency (NISA) 'Japan Ageing Management Program for System Safety'. This contribution presents the background to the existing evaluation processes, a review of the irradiation exposure effect on concrete and needs for irradiation testing. Based on results of this study, working assumptions for the development of an evaluation system are derived, and an overall picture of a numerical model as well as a framework for evaluating concrete soundness under irradiated conditions are proposed. (author)

Review of Evaluation, Measurement and Verification Approaches Used to Estimate the Load Impacts and Effectiveness of Energy Efficiency Programs

Energy Technology Data Exchange (ETDEWEB)

Messenger, Mike; Bharvirkar, Ranjit; Golemboski, Bill; Goldman, Charles A.; Schiller, Steven R.

2010-04-14

Public and private funding for end-use energy efficiency actions is expected to increase significantly in the United States over the next decade. For example, Barbose et al (2009) estimate that spending on ratepayer-funded energy efficiency programs in the U.S. could increase from $3.1 billion in 2008 to $7.5 and 12.4 billion by 2020 under their medium and high scenarios. This increase in spending could yield annual electric energy savings ranging from 0.58% - 0.93% of total U.S. retail sales in 2020, up from 0.34% of retail sales in 2008. Interest in and support for energy efficiency has broadened among national and state policymakers. Prominent examples include {approx}$18 billion in new funding for energy efficiency programs (e.g., State Energy Program, Weatherization, and Energy Efficiency and Conservation Block Grants) in the 2009 American Recovery and Reinvestment Act (ARRA). Increased funding for energy efficiency should result in more benefits as well as more scrutiny of these results. As energy efficiency becomes a more prominent component of the U.S. national energy strategy and policies, assessing the effectiveness and energy saving impacts of energy efficiency programs is likely to become increasingly important for policymakers and private and public funders of efficiency actions. Thus, it is critical that evaluation, measurement, and verification (EM&V) is carried out effectively and efficiently, which implies that: (1) Effective program evaluation, measurement, and verification (EM&V) methodologies and tools are available to key stakeholders (e.g., regulatory agencies, program administrators, consumers, and evaluation consultants); and (2) Capacity (people and infrastructure resources) is available to conduct EM&V activities and report results in ways that support program improvement and provide data that reliably compares achieved results against goals and similar programs in other jurisdictions (benchmarking). The National Action Plan for Energy

Using student satisfaction data to evaluate a new online accelerated nursing education program.

Science.gov (United States)

Gazza, Elizabeth A; Matthias, April

2016-10-01

As increasing numbers of students enroll in online education, institutions of higher education are responsible for delivering quality online courses and programs. Agencies that accredit institutions and programs require evidence of program quality, including student satisfaction. A large state university in the Southeastern United States transitioned an online nursing education degree completion, or Registered Nurse-to-Bachelor of Science in Nursing, program to an online accelerated format in order to meet the needs of working nurses and ultimately, increase the number of nurses prepared at the baccalaureate level. This article describes a descriptive, cross-sectional study that evaluated the effectiveness of the new online accelerated program using the quality indicator of student satisfaction. Ninety-one (32%) of the 284 students who were enrolled or had been enrolled in a course within the online accelerated degree completion program between fall 2013 session 1 and summer 2014 session participated in the study. The electronic Noel-Levitz Priorities Survey for Online Learners™ was used to measure student satisfaction with the program and associated services. Results provided insight into the students' satisfaction with the new program format and served as the basis for an interdepartmental program enhancement plan aimed at maintaining and enhancing student satisfaction and overall program quality. Findings indicated that measuring and evaluating student satisfaction can provide valuable information about the effectiveness of an online program. Recommendations for using the measurement tool in online program planning and studying student satisfaction in relation to retention and program completion were identified. Copyright © 2016 Elsevier Ltd. All rights reserved.

Efficiency evaluation of grant policy in sport by principles of program financing

Directory of Open Access Journals (Sweden)

Vladimír Hobza

2010-03-01

Full Text Available The paper concerns with mutual interconnection of goals of municipal development concepts and methods of their assessment. Based on grant policy of selected municipalities (regions, communities and on the principles of program financing, a specific method of evaluation performance is suggested, which enables to evaluate closer control of sport development, visions, proclaimed goals and sport support programs. The principle of the proposed procedure is based on the use of indicators and methods: CEA, CBA, CUA and CMA in program financing of sport - a field where it is not possible to calculate only direct economic results but it is necessary to consider the impact of externalities (benefits. The authors suggest procedures, which lead to a higher level of control, transparency and efficiency of public spending in the municipal sphere. The goal of this contribution is to point out possible means of assessing grant proposals, as a support tool for decision-making and subsequent control.

The Evaluation Market in Germany: Estimating Market Size for Evaluation of Political Programs

Science.gov (United States)

Lowenbein, Oded

2008-01-01

The United States has a long tradition in evaluation of political programs. In the 1930s and 1940s, programs were initiated to reduce unemployment and improve social security as part of the "New Deal." In the late 1960s, somewhat comparable to the U. S. at that time, Germany's new government started its own "New Deal."…

Evaluating the Effects of Virtual Pair Programming on Students’ Achievement and Satisfaction

Directory of Open Access Journals (Sweden)

Nick Zacharis

2009-09-01

Full Text Available Pair programming is a lightweight software development technique in which two programmers work together at one computer. In literature, many benefits of pair programming have been proposed, such as increased productivity, improved code quality, enhanced job satisfaction and confidence. Although pair programming provides clear pedagogical benefits, its collocation requirement and the limited time during a lab session are serious barriers in the full deployment and evaluation of this programming technique. This paper reports on a study that investigated the effectiveness of Virtual Pair Programming (VPP on student performance and satisfaction in an introductory Java course where students worked collaboratively in pairs on homework programming assignments, using online tools that integrated desktop sharing and real time communication. The results of this study support previous research findings and suggest that VPP is an effective pedagogical tool for flexible collaboration and an acceptable alternative to individual/solo programming experience, regarding productivity, code quality, academic performance and student satisfaction.

Implementing and evaluating a program to facilitate chronic disease prevention and screening in primary care: a mixed methods program evaluation.

Science.gov (United States)

Manca, Donna Patricia; Aubrey-Bassler, Kris; Kandola, Kami; Aguilar, Carolina; Campbell-Scherer, Denise; Sopcak, Nicolette; O'Brien, Mary Ann; Meaney, Christopher; Faria, Vee; Baxter, Julia; Moineddin, Rahim; Salvalaggio, Ginetta; Green, Lee; Cave, Andrew; Grunfeld, Eva

2014-10-08

The objectives of this paper are to describe the planned implementation and evaluation of the Building on Existing Tools to Improve Chronic Disease Prevention and Screening in Primary Care (BETTER 2) program which originated from the BETTER trial. The pragmatic trial, informed by the Chronic Care Model, demonstrated the effectiveness of an approach to Chronic Disease Prevention and Screening (CDPS) involving the use of a new role, the prevention practitioner. The desired goals of the program are improved clinical outcomes, reduction in the burden of chronic disease, and improved sustainability of the health-care system through improved CDPS in primary care. The BETTER 2 program aims to expand the implementation of the intervention used in the original BETTER trial into communities across Canada (Alberta, Ontario, Newfoundland and Labrador, the Northwest Territories and Nova Scotia). This proactive approach provides at-risk patients with an intervention from the prevention practitioner, a health-care professional. Using the BETTER toolkit, the prevention practitioner determines which CDPS actions the patient is eligible to receive, and through shared decision-making and motivational interviewing, develops a unique and individualized 'prevention prescription' with the patient. This intervention is 1) personalized; 2) addressing multiple conditions; 3) integrated through linkages to local, regional, or national resources; and 4) longitudinal by assessing patients over time. The BETTER 2 program brings together primary care providers, policy/decision makers and researchers to work towards improving CDPS in primary care. The target patient population is adults aged 40-65. The reach, effectiveness, adoption, implementation, maintain (RE-AIM) framework will inform the evaluation of the program through qualitative and quantitative methods. A composite index will be used to quantitatively assess the effectiveness of the prevention practitioner intervention. The CDPS actions

The SBIRT program matrix: a conceptual framework for program implementation and evaluation.

Science.gov (United States)

Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna

2017-02-01

Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.

DOE Hydrogen Program: 2007 Annual Merit Review and Peer Evaluation Report

Energy Technology Data Exchange (ETDEWEB)

Milliken, J.

2007-09-01

This report summarizes comments from the Peer Review Panel at the FY 2007 DOE Hydrogen Program Annual Merit Review, held on May 14-18, 2007, in Washington, D.C. The projects evaluated support the Department of Energy and President Bush's Hydrogen Initiative. The results of this merit review and peer evaluation are major inputs used by DOE to make funding decisions. Project areas include hydrogen production and delivery; hydrogen storage; fuel cells; technology validation; safety, codes and standards; education; and systems analysis.

Alternative Aviation Jet Fuel Sustainability Evaluation Report Task 1 : Report Evaluating Existing Sustainability Evaluation Programs

Science.gov (United States)

2011-10-25

This report describes how existing biofuel sustainability evaluation programs meet requirements that are under consideration or are in early phases of adoption and implementation in various US and international contexts. Biofuel sustainability evalua...

Hanford performance evaluation program for Hanford site analytical services

International Nuclear Information System (INIS)

Markel, L.P.

1995-09-01

The U.S. Department of Energy (DOE) Order 5700.6C, Quality Assurance, and Title 10 of the Code of Federal Regulations, Part 830.120, Quality Assurance Requirements, states that it is the responsibility of DOE contractors to ensure that ''quality is achieved and maintained by those who have been assigned the responsibility for performing the work.'' Hanford Analytical Services Quality Assurance Plan (HASQAP) is designed to meet the needs of the Richland Operations Office (RL) for maintaining a consistent level of quality for the analytical chemistry services provided by contractor and commmercial analytical laboratory operations. Therefore, services supporting Hanford environmental monitoring, environmental restoration, and waste management analytical services shall meet appropriate quality standards. This performance evaluation program will monitor the quality standards of all analytical laboratories supporting the Hanforad Site including on-site and off-site laboratories. The monitoring and evaluation of laboratory performance can be completed by the use of several tools. This program will discuss the tools that will be utilized for laboratory performance evaluations. Revision 0 will primarily focus on presently available programs using readily available performance evaluation materials provided by DOE, EPA or commercial sources. Discussion of project specific PE materials and evaluations will be described in section 9.0 and Appendix A

Evaluation of Medical Education virtual Program: P3 model.

Science.gov (United States)

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Exploration for fossil and nuclear fuels from orbital altitudes. [results of ERTS program for oil exploration

Science.gov (United States)

Short, N. M.

1974-01-01

Results from the ERTS program pertinent to exploration for oil, gas, and uranium are discussed. A review of achievements in relevant geological studies from ERTS, and a survey of accomplishments oriented towards exploration for energy sources are presented along with an evaluation of the prospects and limitations of the space platform approach to fuel exploration, and an examination of continuing programs designed to prove out the use of ERTS and other space system in exploring for fuel resources.

Subjective evaluation of a peer support program by women with breast cancer: A qualitative study.

Science.gov (United States)

Ono, Miho; Tsuyumu, Yuko; Ota, Hiroko; Okamoto, Reiko

2017-01-01

The aim of this study was to determine the subjective evaluation of a breast cancer peer support program based on a survey of the participants who completed the program. Semistructured interviews were held with 10 women with breast cancer. The responses were subject to a qualitative inductive analysis. Women with breast cancer who participated in the breast cancer peer support program evaluated the features of the program and cited benefits, such as "Receiving individual peer support tailored to your needs," "Easily consulted trained peer supporters," and "Excellent coordination." Also indicated were benefits of the peer support that was received, such as "Receiving peer-specific emotional support," "Obtaining specific experimental information," "Re-examining yourself," and "Making preparations to move forward." The women also spoke of disadvantages, such as "Strict management of personal information" and "Matching limitations." In this study, the subjective evaluation of a peer support program by women with breast cancer was clarified . The women with breast cancer felt that the program had many benefits and some disadvantages. These results suggest that there is potential for peer support-based patient-support programs in medical services that are complementary to the current support that is provided by professionals. © 2016 Japan Academy of Nursing Science.

Traffic Control Device Evaluation Program : FY 2017

Science.gov (United States)

2018-03-01

This report presents findings on the activities conducted in the Traffic Control Device Evaluation Program during the 2017 fiscal year. The research on sponsored changeable message signs (continued from the previous year) was terminated by the Federa...

Process evaluation of a Toolbox-training program for construction foremen in Denmark

DEFF Research Database (Denmark)

Jeschke, Katharina Christiane; Kines, Pete; Rasmussen, Liselotte

2017-01-01

foremen’s knowledge and communication skills in daily planning of work tasks and their related OSH risks on construction sites. The program builds on the popular 'toolbox meeting' concept, however there is very little research evaluating these types of meetings. This article describes the development...... and revised until the final version after the fifth group. The evaluation utilized an action research strategy with a mixed–methods approach of triangulating questionnaire, interview, and observation data. Process evaluation results showed that the eight Toolbox-training topics were relevant and useful...

Evaluating Extension Based Leadership Development Programs in the Southern United States

Science.gov (United States)

Lamm, Kevan W.; Carter, Hannah S.; Lamm, Alexa J.

2016-01-01

The ability to evaluate and accurately articulate the outcomes associated with leadership development programs is critical to their continued financial and administrative support. With calls for outcome-based accountability, the need for rigorous evaluation is particularly relevant for those programs administered through the Cooperative Extension…

Monitoring and evaluation of green public procurement programs

Energy Technology Data Exchange (ETDEWEB)

Adell, Aure [Ecoinstitut, Barcelona (Spain); Schaefer, Bettina [Ecoinstitut, Barcelona (Spain); Ravi, Kavita [US Department of Energy, Washington, DC (United States); Corry, Jenny [Collaborative Labeling and Appliance Standards Program (United States)

2013-10-15

Effective procurement policies can help governments save considerable amounts of money while also reducing energy consumption. Additionally, private sector companies which purchase large numbers of energy-consuming devices can benefit from procurement policies that minimize life-cycle energy costs. Both public and private procurement programs offer opportunities to generate market-transforming demand for energy efficient appliances and lighting fixtures. In recent years, several governments have implemented policies to procure energy efficient products and services. When deploying these policies, efforts have focused on developing resources for implementation (guidelines, energy efficiency specifications for tenders, life cycle costing tools, training, etc.) rather than defining monitoring systems to track progress against the set objectives. Implementation resources are necessary to make effective policies; however, developing Monitoring and Evaluation (M and E) mechanisms are critical to ensure that the policies are effective. The purpose of this article is to provide policy makers and procurement officials with a preliminary map of existing approaches and key components to monitor Energy Efficient Procurement (EEP) programs in order to contribute to the improvement of their own systems. Case studies are used throughout the paper to illustrate promising approaches to improve the M and E of EEP programs, from the definition of the system or data collection to complementary instruments to improve both the monitoring response and program results.