Evaluating the Effects of Virtual Pair Programming on Students’ Achievement and Satisfaction

Directory of Open Access Journals (Sweden)

Nick Zacharis

2009-09-01

Full Text Available Pair programming is a lightweight software development technique in which two programmers work together at one computer. In literature, many benefits of pair programming have been proposed, such as increased productivity, improved code quality, enhanced job satisfaction and confidence. Although pair programming provides clear pedagogical benefits, its collocation requirement and the limited time during a lab session are serious barriers in the full deployment and evaluation of this programming technique. This paper reports on a study that investigated the effectiveness of Virtual Pair Programming (VPP on student performance and satisfaction in an introductory Java course where students worked collaboratively in pairs on homework programming assignments, using online tools that integrated desktop sharing and real time communication. The results of this study support previous research findings and suggest that VPP is an effective pedagogical tool for flexible collaboration and an acceptable alternative to individual/solo programming experience, regarding productivity, code quality, academic performance and student satisfaction.

Evaluation of the effectiveness of a school-based cannabis prevention program.

Science.gov (United States)

Ariza, Carles; Pérez, Anna; Sánchez-Martínez, Francesca; Diéguez, Marta; Espelt, Albert; Pasarín, M Isabel; Suelves, Josep M; De la Torre, Rafael; Nebot, Manuel

2013-09-01

The effectiveness of a cannabis prevention program in high school students was assessed. A quasi-experimental study was designed to evaluate the effectiveness of an intervention implemented in an intervention group (IG) with 39 schools compared with a control group (CG) of 47 schools not exposed to the intervention. Of 224 secondary schools in Barcelona, 86 were assessed in the 2005-2006 school year through a personal questionnaire administered at baseline and 15 months after the intervention. Participants consisted of 4848 ninth graders (14-15 year-olds), 2803 assigned to the IG and 2043 to the CG, according to the type and size of the school and the socioeconomic status of the school's neighborhood. The intervention consisted of a school-based cannabis prevention program (xkpts.com), with four sessions and 16 activities, implemented over 6-10h, with materials for parents and web-based student involvement. Last-month cannabis use was assessed at baseline and at 15 months' follow-up. Process evaluation indicators were assessed. At 15 months follow-up, 8.2% of boys and 8.3% of girls in the IG became last-month cannabis users versus 11.8% of boys and 11.6% of girls in the CG. These differences were statistically significant (p=0.003), representing a 29% reduction in last-month cannabis users in the IG compared with the CG. The incidence of last-month cannabis use was lowest in classrooms that adhered to the program protocol. The xkpts.com program was effective in preventing progression to last-month cannabis use. Effectiveness was higher in classrooms that adhered closely to the protocol. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Evaluation of a Digital Game-Based Learning Program for Enhancing Youth Mental Health: A Structural Equation Modeling of the Program Effectiveness.

Science.gov (United States)

Huen, Jenny My; Lai, Eliza Sy; Shum, Angie Ky; So, Sam Wk; Chan, Melissa Ky; Wong, Paul Wc; Law, Y W; Yip, Paul Sf

2016-10-07

Digital game-based learning (DGBL) makes use of the entertaining power of digital games for educational purposes. Effectiveness assessment of DGBL programs has been underexplored and no attempt has been made to simultaneously model both important components of DGBL: learning attainment (ie, educational purposes of DGBL) and engagement of users (ie, entertaining power of DGBL) in evaluating program effectiveness. This study aimed to describe and evaluate an Internet-based DGBL program, Professor Gooley and the Flame of Mind, which promotes mental health to adolescents in a positive youth development approach. In particular, we investigated whether user engagement in the DGBL program could enhance their attainment on each of the learning constructs per DGBL module and subsequently enhance their mental health as measured by psychological well-being. Users were assessed on their attainment on each learning construct, psychological well-being, and engagement in each of the modules. One structural equation model was constructed for each DGBL module to model the effect of users' engagement and attainment on the learning construct on their psychological well-being. Of the 498 secondary school students that registered and participated from the first module of the DGBL program, 192 completed all 8 modules of the program. Results from structural equation modeling suggested that a higher extent of engagement in the program activities facilitated users' attainment on the learning constructs on most of the modules and in turn enhanced their psychological well-being after controlling for users' initial psychological well-being and initial attainment on the constructs. This study provided evidence that Internet intervention for mental health, implemented with the technologies and digital innovations of DGBL, could enhance youth mental health. Structural equation modeling is a promising approach in evaluating the effectiveness of DGBL programs.

Effectiveness of computer ergonomics interventions for an engineering company: a program evaluation.

Science.gov (United States)

Goodman, Glenn; Landis, James; George, Christina; McGuire, Sheila; Shorter, Crystal; Sieminski, Michelle; Wilson, Tamika

2005-01-01

Ergonomic principles at the computer workstation may reduce the occurrence of work related injuries commonly associated with intensive computer use. A program implemented in 2001 by an occupational therapist and a physical therapist utilized these preventative measures with education about ergonomics, individualized evaluations of computer workstations, and recommendations for ergonomic and environmental changes. This study examined program outcomes and perceived effectiveness based on review of documents, interviews, and surveys of the employees and the plant manager. The program was deemed successful as shown by 59% of all therapist recommendations and 74% of ergonomic recommendations being implemented by the company, with an 85% satisfaction rate for the ergonomic interventions and an overall employee satisfaction rate of 70%. Eighty-one percent of the physical problems reported by employees were resolved to their satisfaction one year later. Successful implementation of ergonomics programs depend upon effective communication and education of the consumers, and the support, cooperation and collaboration of management and employees.

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Use of children's artwork to evaluate the effectiveness of a hospital preparation program.

Science.gov (United States)

Wilson, C J

1991-01-01

Approximately 1.5 million children are hospitalized on an emergency basis per year and are not able to be fully prepared for the event due to the emergency (Azarnoff & Woody, 1981). For this reason many pre-crisis hospital preparation programs are being instituted by hospitals and pediatric nurses. This pilot study investigated the use of children's artwork to evaluate the effectiveness of a hospital preparation program. The 6 to 10 year old children attending summer school at a day care center participated in a hospital preparation program. The purpose of the program was to decrease children's anxieties and fears in the event of an emergency hospitalization.

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

Review of Evaluation, Measurement and Verification Approaches Used to Estimate the Load Impacts and Effectiveness of Energy Efficiency Programs

Energy Technology Data Exchange (ETDEWEB)

Messenger, Mike; Bharvirkar, Ranjit; Golemboski, Bill; Goldman, Charles A.; Schiller, Steven R.

2010-04-14

Public and private funding for end-use energy efficiency actions is expected to increase significantly in the United States over the next decade. For example, Barbose et al (2009) estimate that spending on ratepayer-funded energy efficiency programs in the U.S. could increase from $3.1 billion in 2008 to $7.5 and 12.4 billion by 2020 under their medium and high scenarios. This increase in spending could yield annual electric energy savings ranging from 0.58% - 0.93% of total U.S. retail sales in 2020, up from 0.34% of retail sales in 2008. Interest in and support for energy efficiency has broadened among national and state policymakers. Prominent examples include {approx}$18 billion in new funding for energy efficiency programs (e.g., State Energy Program, Weatherization, and Energy Efficiency and Conservation Block Grants) in the 2009 American Recovery and Reinvestment Act (ARRA). Increased funding for energy efficiency should result in more benefits as well as more scrutiny of these results. As energy efficiency becomes a more prominent component of the U.S. national energy strategy and policies, assessing the effectiveness and energy saving impacts of energy efficiency programs is likely to become increasingly important for policymakers and private and public funders of efficiency actions. Thus, it is critical that evaluation, measurement, and verification (EM&V) is carried out effectively and efficiently, which implies that: (1) Effective program evaluation, measurement, and verification (EM&V) methodologies and tools are available to key stakeholders (e.g., regulatory agencies, program administrators, consumers, and evaluation consultants); and (2) Capacity (people and infrastructure resources) is available to conduct EM&V activities and report results in ways that support program improvement and provide data that reliably compares achieved results against goals and similar programs in other jurisdictions (benchmarking). The National Action Plan for Energy

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

The Effect of Persuasion on the Utilization of Program Evaluation Information: A Preliminary Study.

Science.gov (United States)

Eason, Sandra H.; Thompson, Bruce

The utilization of program evaluation may be made more effective by means of the application of contemporary persuasion theory. The Elaboration Likelihood Model--a model of cognitive processing, ability, and motivation--was used in this study to test the persuasive effects of source credibility and involvement on message acceptance of evaluation…

Evaluating Effectiveness of Pair Programming as a Teaching Tool in Programming Courses

Science.gov (United States)

Faja, Silvana

2014-01-01

This study investigates the effectiveness of pair programming on student learning and satisfaction in introductory programming courses. Pair programming, used in the industry as a practice of an agile development method, can be adopted in classroom settings to encourage peer learning, increase students' social skills, and enhance student…

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Faculty Development Effectiveness: Insights from a Program Evaluation

Directory of Open Access Journals (Sweden)

Anupma Wadhwa

2014-01-01

Full Text Available Background. Faculty development programs are often time and resource intensive. In order to accommodate time constrained clinicians a limited time commitment faculty development program was developed and was shown to be effective in improving participant’s scholarly productivity. Objectives. The objective of this study was to assess participants’ perceptions of why the faculty development program was effective in promoting scholarship in education. Methods. In-depth semistructured interviews of course participants were conducted a year after completing a faculty development program. The interviews were audiotaped and transcribed verbatim. The transcriptions were coded independently by the investigators for dominant themes. The investigators held coding meetings to further refine the themes and discrepancies were handled by referring to the transcripts and reaching consensus. Results. The participants’ satisfaction with the course as described in the interviews correlated with the early satisfaction surveys. Reasons offered for this impact fell into four broad categories: course content, course format, social networking during the course, and the course facilitation coaching strategies to achieve goals. Conclusions. Course focusing on the process, experiential learning, and situating the course facilitator in the role of a functional mentor or coach to complete projects can be effective in facilitating behaviour change after faculty development programs.

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Evaluating Knowledge, Attitudinal, and Behavioral Change Effects from a Multinational HIV/AIDS Education Program for Youth

Science.gov (United States)

Hardre, Patricia L.; Garcia, Fe; Apamo, Peter; Mutheu, Lucy; Ndege, Monica; Bois, Iderle

2010-01-01

This project tracked the mid-term evaluation processes, practices, and products of a multinational program to reduce at-risk behaviors for HIV/AIDS among children in Kenya, Tanzania, and Haiti. It focused on participant and community perceptions; program effectiveness in promoting abstinence and monogamy decisions; and factors supporting ongoing…

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

Science.gov (United States)

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

The Teachers of Quality Academy: Evaluation of the Effectiveness and Impact of a Health Systems Science Training Program.

Science.gov (United States)

Walsh, Danielle S; Lazorick, Suzanne; Lawson, Luan; Lake, Donna; Garrison, Herbert G; Higginson, Jason; Vos, Paul; Baxley, Elizabeth

2018-05-01

This project aimed to evaluate the effectiveness of a faculty development program in health systems science (HSS)-the Teachers of Quality Academy (TQA). Participants in TQA and a comparison group were evaluated before, during, and 1 year after the program using self-perception questionnaires, tests of HSS knowledge, and tracking of academic productivity and career advancement. Among program completers (n = 27), the mean self-assessed ratings of knowledge and skills of HSS topics immediately after the program, as compared to baseline, increased significantly compared to controls (n = 30). Participants demonstrated progressive improvement of self-perceived skills and attitudes, and retention of HSS knowledge, from baseline to completion of the program. Participants also demonstrated substantially higher HSS scholarly productivity, leadership, and career advancement compared to the comparison group. The TQA effectively created a faculty cadre able to role model, teach, and create a curriculum in HSS competencies for medical students, resident physicians, and other health professionals.

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Manipulator system man-machine interface evaluation program. [technology assessment

Science.gov (United States)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

The program success story: a valuable tool for program evaluation.

Science.gov (United States)

Lavinghouze, Rene; Price, Ann Webb; Smith, Kisha-Ann

2007-10-01

Success stories are evaluation tools that have been used by professionals across disciplines for quite some time. They are also proving to be useful in promoting health programs and their accomplishments. The increasing popularity of success stories is due to the innovative and effective way that they increase a program's visibility, while engaging potential participants, partners, and funders in public health efforts. From the community level to the federal level, program administrators are using success stories as vehicles for celebrating achievements, sharing challenges, and communicating lessons learned. Success stories are an effective means to move beyond the numbers and connect to readers-with a cause they can relate to and want to join. This article defines success stories and provides an overview of several types of story formats, how success stories can be systematically collected, and how they are used to communicate program success.

Limited economic evaluation to assess the effectiveness of a university-wide office ergonomics program.

Science.gov (United States)

Bidassie, Balmatee; McGlothlin, James D; Goh, Alina; Feyen, Robert G; Barany, James W

2010-05-01

The objective of this research was to evaluate the effectiveness and provide a limited economic evaluation of an office ergonomics program at a major university from 1995 to 2007. The relationship between office-related recordable injuries, reported lost time, severity of these injuries, and the Workers' Compensation (WC) paid was analyzed and the corresponding incident cost was calculated. Two major datasets analyzed were OSHA 200/300 logs (1991-2007) and WC claims paid (1999-2007). Since the beginning of the office ergonomics program in 1995 and through 2007 (13-year period), the number of office cumulative trauma disorder (CTD) cases decreased by 53%. Since the official start (in 1999) of a 50-50 cost share agreement for office equipment purchases between the university's Safety and Health Department (SHD) and the university departments evaluated, it was observed that the incident rate decreased by 63%, Total Days Away/restrict or Transfer (DART) rate decreased by 41%, Lost Time Case (LTC) rate decreased by 71% and office-related carpal tunnel syndrome decreased by almost 50%. The long-term goal of this research is to demonstrate the self-sustainability of an office ergonomics program by showing that equipment costs are eventually offset by a decrease in WC claims paid and lost time from office-related injuries and illnesses. While limited, this research helps in cost-justifying the implementation of future office ergonomics programs for large organizations. Copyright (c) 2009 Elsevier Ltd. All rights reserved.

Evaluating the effectiveness of a post-license education program for young novice drivers in Belgium.

Science.gov (United States)

Brijs, Kris; Cuenen, Ariane; Brijs, Tom; Ruiter, Robert A C; Wets, Geert

2014-05-01

The disproportionately large number of traffic accidents of young novice drivers highlights the need for an effective driver education program. The Goals for Driving Education (GDE) matrix shows that driver education must target both lower and higher levels of driver competences. Research has indicated that current education programs do not emphasize enough the higher levels, for example awareness and insight. This has raised the importance of insight programs. On the Road (OtR), a Flemish post-license driver education program, is such an insight program that aims to target these higher levels. The program focus is on risky driving behavior like speeding and drink driving. In addition, the program addresses risk detection and risk-related knowledge. The goal of the study was to do an effect evaluation of this insight program at immediate post-test and 2 months follow-up. In addition, the study aimed to generalize the results of this program to comparable programs in order to make usable policy recommendations. A questionnaire based on the Theory of Planned Behavior (TPB) was used in order to measure participants' safety consciousness of speeding and drink driving. Moreover, we focused on risk detection and risk-related knowledge. Participants (N=366) were randomly assigned to a baseline-follow-up group or a post-test-follow-up group. Regarding speeding and driving, we found OtR to have little effect on the TPB variables. Regarding risk detection, we found no significant effect, even though participants clearly needed substantial improvement when stepping into the program. Regarding risk-related knowledge, the program did result in a significant improvement at post-test and follow-up. It is concluded that the current program format is a good starting point, but that it requires further attention to enhance high level driving skills. Program developers are encouraged to work in a more evidence-based manner when they select target variables and methods to influence

The Effects of a Statewide Evaluation Initiative in Gifted Education on Practitioner Knowledge, Concerns, and Program Documentation

Science.gov (United States)

Robinson, Ann; Cotabish, Alicia; Wood, Betty K.; O'Tuel, Fran S.

2014-01-01

When well-considered and grounded in current knowledge, program evaluations of services to gifted learners can be a powerful tool for increasing practitioners' knowledge and self-efficacy, and for effecting positive programmatic changes. The Arkansas Evaluation Initiative (AEI) in Gifted Education, a Jacob K. Javits-funded project, was implemented…

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

Environmental assessment for the satellite power system concept development and evaluation program: atmospheric effects

International Nuclear Information System (INIS)

Rote, D.M.; Brubaker, K.L.; Lee, J.L.

1980-11-01

The US Department of Energy (DOE) has undertaken a preliminary, three-year program to investigate the impacts of the construction and operation of a satellite power system, of unprecedented scale. The Department of Energy's program, titled The Concept Development and Evaluation Program, focused its investigations on a Reference System description that calls for the use of either silicon (Si) or gallium aluminum-arsenide (GaAlAs) photovoltaic cells on 60 satellites to be constructed in GEO over a 30-yr period. Rectennas would be constructed on the ground to receive microwave energy from the satellites. Each satellite-rectenna pair is designed to produce 5 GW of power on an essentially continuous basis for use as a baseload power source for an electric power distribution system. The environmental assessment part of the program was divided into five interdependent task areas. The present document constitutes the final technical report on one of the five task areas, the Assessment of the Atmospheric Effects, and as such presents an in-depth summary of work performed during the assessment program. The issues associated with SPS activities in the troposphere are examined. These include tropospheric weather modification related to rectenna operations and rocket launches, and air quality impacts related to rocketlaunch ground clouds. Then progressing upward through the various levels of the atmosphere, the principal middle and upper atmospheric effects associated with rocket effluents are analyzed. Finally, all of the potential SPS atmospheric effects are summarized

Evaluating the impacts of the clean cities program.

Science.gov (United States)

Qiu, Shiyong; Kaza, Nikhil

2017-02-01

The Department of Energy's Clean Cities program was created in 1993 to reduce petroleum usage in the transportation sector. The program promotes alternative fuels such as biofuels and fuel-saving strategies such as idle reduction and fleet management through coalitions of local government, non-profit, and private actors. Few studies have evaluated the impact of the program because of its complexity that include interrelated strategies of grants, education and training and diversity of participants. This paper uses a Difference-in-Differences (DiD) approach to evaluate the effectiveness of the program between 1990 and 2010. We quantify the effectiveness of the Clean Cities program by focusing on performance measures such as air quality, number of alternative fueling stations, private vehicle occupancy and transit ridership. We find that counties that participate in the program perform better on all these measures compared to counties that did not participate. Compared to the control group, counties in the Clean Cities program experienced a reduction in days with bad air quality (3.7%), a decrease in automobile commuters (2.9%), an overall increase in transit commuters (2.1%) and had greater numbers of new alternative fueling stations (12.9). The results suggest that the program is a qualified success. Copyright © 2016 Elsevier B.V. All rights reserved.

Defence Health Service Mentoring Program Evaluation 2001

National Research Council Canada - National Science Library

Highfield, Jane

2002-01-01

...). DHS commissioned the Directorate of Strategic Personnel Planning and Research (DSPPR) to evaluate a recent Mentoring Program trial in order to assess the effectiveness and organizational value of Mentoring within DHS...

A STUDY EVALUATING THE EFFECTS OF BOMBAY HOSPITAL PHYSIOTHERAPY PROGRAM AND CONVENTIONAL PHYSIOTHERAPY EXERCISE PROGRAM ON GERIATRIC PATIENTS PRESENTING WITH CALF PAIN

OpenAIRE

Rohit Subhedar; Pallavi Dave; Priyanka Mishra; Shailee Jain

2015-01-01

Objective: To investigate the effects of (BHP-Program) on geriatric patients with calf pain. Method: This research was designed by evaluating the progress report of Geriatric Physiotherapy patients at Multi-specialty Department of Physiotherapy- Bombay Hospital-Indore. The subjects were the patients receiving Physiotherapy at Multi specialty Physiotherapy Department - Bombay Hospital, Indore. VAS scale was used for the pain evaluation. Pain Scale parameters of 30 Patients of age group 60...

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

Science.gov (United States)

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

Environmental assessment for the satellite power system concept development and evaluation program: nonmicrowave health and ecological effects

Energy Technology Data Exchange (ETDEWEB)

White, M R

1980-11-01

A Concept Development and Evaluation Program is being carried out for a proposed Satellite Power System (SPS). For purposes of this evaluation, a preliminary reference system has been developed. SPS, as described in the reference system, would collect solar energy on satellites in geosychronous orbit in space. The energy would be converted to microwaves and beamed to an earth-receiving antenna (rectenna). One task in the environmental part of the program is the assessment of the nonmicrowave effects on health and the environment. These effects would result from all phases of SPS development and operation. This report covers the current knowledge regarding these effects, and is based on the reference system. The assessment is summarized as to scope, methodology, impacts of terrestrial development, launch and recovery of spacecraft, space activities (including health effects of the space environment, ionizing radiation, electromagnetic exposure, spacecraft charging and environmental interactions, occupational hazards, etc.) and construction and operation of rectenna (ground receiving station).

Environmental assessment for the satellite power system concept development and evaluation program: nonmicrowave health and ecological effects

International Nuclear Information System (INIS)

White, M.R.

1980-11-01

A Concept Development and Evaluation Program is being carried out for a proposed Satellite Power System (SPS). For purposes of this evaluation, a preliminary reference system has been developed. SPS, as described in the reference system, would collect solar energy on satellites in geosychronous orbit in space. The energy would be converted to microwaves and beamed to an earth-receiving antenna (rectenna). One task in the environmental part of the program is the assessment of the nonmicrowave effects on health and the environment. These effects would result from all phases of SPS development and operation. This report covers the current knowledge regarding these effects, and is based on the reference system. The assessment is summarized as to scope, methodology, impacts of terrestrial development, launch and recovery of spacecraft, space activities (including health effects of the space environment, ionizing radiation, electromagnetic exposure, spacecraft charging and environmental interactions, occupational hazards, etc.) and construction and operation of rectenna

Quasi-Experimental Evaluation of a Student Mentoring Program

OpenAIRE

Sandner, Malte

2013-01-01

This paper presents evidence from a natural-experiment which evaluates the effectiveness of a student mentoring program. The mentoring includes several compulsory, scheduled, faceto- face appointments between a mentor and a student in the first study year. All mentors are graduated and employed by the institution. For the evaluation, I use the fact that the mentoring is only offered to students in an economics and management program, whereas it is not offered to students in an industrial engi...

Evaluating the Effectiveness of a Health Promotion Intervention Program Among Physiotherapy Undergraduate Students

Science.gov (United States)

Korn, Liat; Ben-Ami, Noa; Azmon, Michal; Einstein, Ofira; Lotan, Meir

2017-01-01

This study evaluated the effectiveness of a health promotion (HP) intervention program among physiotherapy undergraduate students in an academic institution by examining pre- and post-intervention health perceptions and behaviors compared to a control group (non-physiotherapy students). Participants completed questionnaires on their health perceptions and behaviors at T1 (April 2009–May 2009) before the intervention program was initiated, and at T2 (April 2015–May 2015) after the intervention program was implemented for several years. At T1, 1,087 undergraduate students, including 124 physiotherapy students, participated. At T2, 810 undergraduate students, including 133 physiotherapy students participated. Self-reported health-related perceptions and behaviors were compared in the study group (physiotherapy students) over time (T1 versus T2), and between the study group and the control group (non-physiotherapy students) pre-intervention (T1) and post-intervention (T2). Findings showed more positive perceptions and behaviors at T2 compared to T1 in the study group (51.0% at T2 versus 35.2% at T1; p<0.05). There was no significant difference at T2 compared to T1 in health perceptions reported by the control group (37.8% at T2 versus 32.8% at T1; non-significant difference). Our findings demonstrated the effectiveness of the intervention program. PMID:28735335

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Increasing team skills: an evaluation of program effectiveness.

Science.gov (United States)

Jacobsen-Webb, M L

1985-11-01

The need for health professionals with caring values and good communication skills is well established. To develop these skills requires building self-esteem, as is supported by the work of Carl Rogers, Maslow, and Jourard, and the development of communication skills, as is supported by Carkhuff. A six-hour developmental program was evaluated using alternate forms of the highly validated Personal Skills Map. The differences in participants' scores showed increases in self-esteem, comfort, and management skills (p less than .00), while aggression (p = .05) and deference (p less than .00) decreased. A longitudinal follow-up of participants showed that 65% continued to use the assessment tool six months to one year later. The program appears to be well suited for service settings, continuing education, and academic settings, and meets the need of a high tech, high touch era of change.

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

Evaluating Additionality of an Innovation Subsidy Program Targeted at SMEs: An Exploratory Study

Directory of Open Access Journals (Sweden)

Sonja Radas

2013-04-01

Full Text Available This paper explores the effectiveness of a recently introduced innovation subsidy program targeted at SMEs in Croatia. Three aspects of program additionality were evaluated: input, output and behavioral aspects. Both qualitative and survey research was employed, and four case studies with selected recipient companies were conducted. This study is a response to the policy-makers’ need for early program assessment. It attempts to show that even with early evaluation and small population of recipients it is possible to gain insight into program effectiveness. The analysis suggests that the effects of programs targeted at innovative SMEs might need to be evaluated differently than general subsidies. This is especially evident in the evaluation of input additionality. The analysis indicates that SMEs which started with a higher R&D capability tend to increase R&D intensity while participating in the program. The program raised R&D and innovation capability of the participating SMEs, but commercialization of project results remains a concern.

Evaluation of the effectiveness of a voice training program for teachers.

Science.gov (United States)

Pizolato, Raquel Aparecida; Beltrati Cornacchioni Rehder, Maria Inês; dos Santos Dias, Carlos Tadeu; de Castro Meneghim, Marcelo; Bovi Ambrosano, Glaúcia Maria; Mialhe, Fábio Luiz; Pereira, Antonio Carlos

2013-09-01

To investigate the effects of a voice education program to teachers on vocal function exercise and voice hygiene and compare a pre- and post-vocal exercise for the teacher's voice quality. A random sample of 102 subjects was divided into two groups: experimental group (29 women and seven men) with vocal hygiene and training exercises and control group (52 women and 14 men) with vocal hygiene. Two sessions were held about voice hygiene for the control group and five sessions for the experimental group, one being with reference to the vocal hygiene habit and four vocal exercise sessions. Acoustic analysis of the vowel [i] was made pre- and post-vocal exercise and for the situations of initial and final evaluation of the educational program. Student t test (paired) and Proc MIXED (repeated measures) were used for analyses with level of significance (α = 0.05). The training exercises, posture and relaxation cervical, decreased the mean of fundamental frequency (f(0)) for men (P = 0.04), and for the phonation, intensity, and frequency exercises, there was a significant increase for f(0) in woman (P = 0.02) and glottal to noise excitation ratio (P = 0.04). There was no statistically significant difference intergroup evaluations after 3 months. The control group presented increased mean voice intensity in the final evaluation (P = 0.01). Voice training exercises showed a positive and immediate impact on the teacher's quality of voice, but it was not sustained longitudinally, suggesting that actions for this purpose should be continued at schools. Copyright © 2013 The Voice Foundation. Published by Mosby, Inc. All rights reserved.

Evaluating Program Effectiveness or, If the Program is Competency-Based, How Come the Evaluation Is Costing So Much?

Science.gov (United States)

Scriven, Michael

The concern with competency-based education is not whether it is any different from the more traditional approaches but whether it is worth the considerable effort it involves. There are several aspects of a competency-based program to be considered in its evaluation. The first is whether or not there is a justifiable need for the specified…

Secondary Education Programs in Kuwait: An Evaluation Study

Science.gov (United States)

Eid, Ghada K.; Koushki, Parviz A.

2005-01-01

This paper evaluates the effectiveness of the semester and the credit programs of high school education in Kuwait in terms of their graduating students' preparedness for continued and successful academic performance in programs of higher education. Students' percentile graduation rank from high school and their performances in the English, math…

Application gives the technique the analytic tree in the evaluation the effectiveness programs to radiological protection

International Nuclear Information System (INIS)

Perez Gonzalez, F.; Perez Velazquez, R.S.; Fornet Rodriguez, O.; Mustelier Hechevarria, A.; Miller Clemente, A.

1998-01-01

In the work we develop the IAEA recommendations in the application the analytic tree as instrument for the evaluation the effectiveness the occupational radiological protection programs. Is reflected like it has been assimilated and converted that technique in daily work istruments in the evaluation process the security conditions in the institutions that apply the nuclear techniques with a view to its autorization on the part of the regulatory organ

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

Clemson University Science Master's Program in Sustainable and Resilient Infrastructure: A program evaluation

Science.gov (United States)

O'Sell, Elizabeth Eberhart

The Clemson University Science Master's Program (SMP) in Sustainable and Resilient Infrastructure is a program which aims to link engineering, materials, construction, environment, architecture, business, and public policy to produce graduates with unique holistic perspective and expertise to immediately contribute to the workforce in the area of sustainable and resilient infrastructure. A program evaluation of the SMP has been performed to study the effectiveness of the SMP and identify areas where the goals and vision of the SMP are achieved and areas where improvements can be made. This was completed by analysis of trends within survey responses, review of Master's thesis reports, and review of courses taken. It was found that the SMP has facilitated new interdisciplinary research collaborations of faculty in different concentration areas within the Glenn Department of Civil Engineering, as well as collaboration with faculty in other departments. It is recommended that a course which provides instruction in all eight competency areas be required for all SMP students to provide a comprehensive overview and ensure all students are exposed to concepts of all competency areas. While all stakeholders are satisfied with the program and believe it has been successful thus far, efforts do need to be made as the program moves forward to address and improve some items that have been mentioned as needing improvement. The concerns about concentration courses, internship planning, and advising should be addressed. This evaluation provides benefits to prospective students, current SMP participants, and outside program supporters. The goal of this evaluation is to provide support that the SMP is an effective and worthwhile program for participating students, while attempting to identify any necessary program improvements and provide recommendations for achieving these improvements. This goal has been accomplished.

The Danish national return-to-work program - aims, content, and design of the process and effect evaluation

DEFF Research Database (Denmark)

Aust, Birgit; Helverskov, Trine; Nielsen, Maj Britt D.

2012-01-01

approximately 19 500 working-age adults on long-term sickness absence, regardless of reason for sickness absence or employment status. It consists of three core elements: (i) establishment of multidisciplinary RTW teams, (ii) introduction of standardized workability assessments and sickness absence management......The Danish national return-to-work (RTW) program aims to improve the management of municipal sickness benefit in Denmark. A study is currently ongoing to evaluate the RTW program. The purpose of this article is to describe the study protocol. The program includes 21 municipalities encompassing...... procedures, and (iii) a comprehensive training course for the RTW teams. The effect evaluation is based on a parallel group randomized trial and a stratified cluster controlled trial and focuses on register-based primary outcomes - duration of sickness absence and RTW - and questionnaire-based secondary...

Testing Mediators of Intervention Effects in Randomized Controlled Trials: An Evaluation of Three Depression Prevention Programs

Science.gov (United States)

Stice, Eric; Rohde, Paul; Seeley, John R.; Gau, Jeff M.

2010-01-01

Objective: Evaluate a new 5-step method for testing mediators hypothesized to account for the effects of depression prevention programs. Method: In this indicated prevention trial, at-risk teens with elevated depressive symptoms were randomized to a group cognitive-behavioral (CB) intervention, group supportive expressive intervention, CB…

Implementing and evaluating a program to facilitate chronic disease prevention and screening in primary care: a mixed methods program evaluation.

Science.gov (United States)

Manca, Donna Patricia; Aubrey-Bassler, Kris; Kandola, Kami; Aguilar, Carolina; Campbell-Scherer, Denise; Sopcak, Nicolette; O'Brien, Mary Ann; Meaney, Christopher; Faria, Vee; Baxter, Julia; Moineddin, Rahim; Salvalaggio, Ginetta; Green, Lee; Cave, Andrew; Grunfeld, Eva

2014-10-08

The objectives of this paper are to describe the planned implementation and evaluation of the Building on Existing Tools to Improve Chronic Disease Prevention and Screening in Primary Care (BETTER 2) program which originated from the BETTER trial. The pragmatic trial, informed by the Chronic Care Model, demonstrated the effectiveness of an approach to Chronic Disease Prevention and Screening (CDPS) involving the use of a new role, the prevention practitioner. The desired goals of the program are improved clinical outcomes, reduction in the burden of chronic disease, and improved sustainability of the health-care system through improved CDPS in primary care. The BETTER 2 program aims to expand the implementation of the intervention used in the original BETTER trial into communities across Canada (Alberta, Ontario, Newfoundland and Labrador, the Northwest Territories and Nova Scotia). This proactive approach provides at-risk patients with an intervention from the prevention practitioner, a health-care professional. Using the BETTER toolkit, the prevention practitioner determines which CDPS actions the patient is eligible to receive, and through shared decision-making and motivational interviewing, develops a unique and individualized 'prevention prescription' with the patient. This intervention is 1) personalized; 2) addressing multiple conditions; 3) integrated through linkages to local, regional, or national resources; and 4) longitudinal by assessing patients over time. The BETTER 2 program brings together primary care providers, policy/decision makers and researchers to work towards improving CDPS in primary care. The target patient population is adults aged 40-65. The reach, effectiveness, adoption, implementation, maintain (RE-AIM) framework will inform the evaluation of the program through qualitative and quantitative methods. A composite index will be used to quantitatively assess the effectiveness of the prevention practitioner intervention. The CDPS actions

A Cost-Effectiveness Analysis Model for Evaluating and Planning Secondary Vocational Programs

Science.gov (United States)

Kim, Jin Eun

1977-01-01

This paper conceptualizes a cost-effectiveness analysis and describes a cost-effectiveness analysis model for secondary vocational programs. It generates three kinds of cost-effectiveness measures: program effectiveness, cost efficiency, and cost-effectiveness and/or performance ratio. (Author)

Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model: A Web-based program designed to evaluate the cost-effectiveness of disease management programs in heart failure.

Science.gov (United States)

Reed, Shelby D; Neilson, Matthew P; Gardner, Matthew; Li, Yanhong; Briggs, Andrew H; Polsky, Daniel E; Graham, Felicia L; Bowers, Margaret T; Paul, Sara C; Granger, Bradi B; Schulman, Kevin A; Whellan, David J; Riegel, Barbara; Levy, Wayne C

2015-11-01

Heart failure disease management programs can influence medical resource use and quality-adjusted survival. Because projecting long-term costs and survival is challenging, a consistent and valid approach to extrapolating short-term outcomes would be valuable. We developed the Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model, a Web-based simulation tool designed to integrate data on demographic, clinical, and laboratory characteristics; use of evidence-based medications; and costs to generate predicted outcomes. Survival projections are based on a modified Seattle Heart Failure Model. Projections of resource use and quality of life are modeled using relationships with time-varying Seattle Heart Failure Model scores. The model can be used to evaluate parallel-group and single-cohort study designs and hypothetical programs. Simulations consist of 10,000 pairs of virtual cohorts used to generate estimates of resource use, costs, survival, and incremental cost-effectiveness ratios from user inputs. The model demonstrated acceptable internal and external validity in replicating resource use, costs, and survival estimates from 3 clinical trials. Simulations to evaluate the cost-effectiveness of heart failure disease management programs across 3 scenarios demonstrate how the model can be used to design a program in which short-term improvements in functioning and use of evidence-based treatments are sufficient to demonstrate good long-term value to the health care system. The Tools for Economic Analysis of Patient Management Interventions in Heart Failure Cost-Effectiveness Model provides researchers and providers with a tool for conducting long-term cost-effectiveness analyses of disease management programs in heart failure. Copyright © 2015 Elsevier Inc. All rights reserved.

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 2

Science.gov (United States)

Greenburg, J. S.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

The computational procedures used in the evaluation of spacecraft technology programs that impact upon commercial communication satellite operations are discussed. Computer programs and data bases are described.

Evaluating the Effectiveness of the 2002-2003 NASA SCIence Files(TM) Program

Science.gov (United States)

Pinelli, Thomas E.; Lambert, Matthew A.; Williams, Amy C.

2004-01-01

NASA SCIence Files (tm) is a research-, inquiry-, and standards-based, integrated mathematics, science, and technology series of 60-minute instructional distance learning (television and web-based) programs for students in grades 3-5. Respondents who evaluated the programs in the 2002-2003 NASA SCIence Files (tm) series reported that (1) they used the programs in the series; (2) the goals and objectives for the series were met; (3) the programs were aligned with the national mathematics, science, and technology standards; (4) the program content was developmentally appropriate for grade level; and (5) the programs in the series enhanced and enriched the teaching of mathematics, science, and technology.

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

The Effects of the Wildlife Habitat Evaluation Program on Targeted Life Skills

Science.gov (United States)

Allen, Kevin; Elmore, R. Dwayne

2012-01-01

Does participation in the Wildlife Habitat Evaluation Program (WHEP) help develop life skills? 4-H members and coaches who participated in the National WHEP Contest between the years 2003-2005 and 2007-2009 were asked to complete an evaluation at the end of each contest. A portion of the evaluation asked participants and coaches to determine if…

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Evaluating the Effectiveness of Traditional and Alternative Principal Preparation Programs

Science.gov (United States)

Pannell, Summer; Peltier-Glaze, Bernnell M.; Haynes, Ingrid; Davis, Delilah; Skelton, Carrie

2015-01-01

This study sought to determine the effectiveness on increasing student achievement of principals trained in a traditional principal preparation program and those trained in an alternate route principal preparation program within the same Mississippi university. Sixty-six Mississippi principals and assistant principals participated in the study. Of…

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

Science.gov (United States)

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper

Evaluation of a Workplace Basic Skills Program: An Impact Study of AVC Edmonton's 1990 Job Effectiveness Training Program at Stelco Steel. Report Summary.

Science.gov (United States)

Barker, Kathryn Chang

The pilot Job Effectiveness Training (JET) workplace basic skills program, developed by Canada's Alberta Vocational College (AVC), Edmonton, for Stelco Steel during 1989-90, was evaluated in terms of impacts or changes from the perspective of the four major stakeholder groups: the students (12 Stelco employees); the employers (Stelco management);…

ITERATIVE EVALUATION IN A MOBILE COUNSELING AND TESTING PROGRAM TO REACH PEOPLE OF COLOR AT RISK FOR HIV—NEW STRATEGIES IMPROVE PROGRAM ACCEPTABILITY, EFFECTIVENESS, AND EVALUATION CAPABILITIES

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2016-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program’s results show that an increased focus on mobile outreach using rapid testing, incentives and health information technology tools may improve program acceptability, quality, productivity and timeliness of reports. This article describes program design decisions based on continuous quality assessment efforts. It also examines the impact of the Computer Assessment and Risk Reduction Education computer tool on HIV testing rates, staff perception of counseling quality, program productivity, and on the timeliness of evaluation reports. The article concludes with a discussion of implications for programmatic responses to the Centers for Disease Control and Prevention’s HIV testing recommendations. PMID:21689041

When Unintended Consequences Become the Main Effect: Evaluating the Development of a Foster Parent Training Program.

Science.gov (United States)

Loesch-Griffin, Deborah A.; Ringstaff, Cathy

A program of education, training, and support provided to foster parents in a California county through a nonprofit agency is evaluated. The evaluators' experience indicates that: (1) evaluations are gaining in popularity; (2) role shifts by evaluators are sometimes difficult to perceive; (3) program staff are unlikely to use evaluative feedback…

Regulatory activities in gaining assurance of training program effectiveness in Canada

International Nuclear Information System (INIS)

Legare, Michele

2003-01-01

This presentation shows the regulator's point of view on evaluating a training program effectiveness. The mission of the Training Program Evaluation Section of the Canadian Atomic Energy Control Board is to obtain and document assurance that the training of NPP operators is effective in providing them with the knowledge and skills needed to become and remain competent. Proposals are made to be considered when drafting the IAEA guideline on evaluation of training program effectiveness

Reliability-based maintenance evaluations and standard preventive maintenance programs

International Nuclear Information System (INIS)

Varno, M.; McKinley, M.

1993-01-01

Due to recent issuance of 10CFR50.65, the U.S. Nuclear Regulatory Commission maintenance rule (Rule), and the open-quotes Industry Guideline for Monitoring the Effectiveness of Maintenance at Nuclear Power Plantsclose quotes prepared by the Nuclear Management and Resources Council, many utilities are undertaking review or evaluation of current preventive maintenance (PM) programs. Although PM optimization and documentation are not specifically required by the Rule, an appropriate and effective PM program (PMP) will be the cornerstone of the successful and cost-effective implementation of the Rule. Currently, a project is being conducted at the Vermont Yankee Nuclear Power Station (VYNPS) in conjunction with Quadrex Energy Services to evaluate, optimize, and document the PMP. The project began in March 1993 and is scheduled for completion in mid-1995. The initial scope for the project is the evaluation of those structures, systems, and components that are within the scope of the Rule. Because of the number of systems to be evaluated (∼50), the desired completion schedule, and cost considerations, a streamlined approach to PM optimization and documentation is being utilized

Economic Evaluation of a Comprehensive Teenage Pregnancy Prevention Program: Pilot Program

Science.gov (United States)

Rosenthal, Marjorie S.; Ross, Joseph S.; Bilodeau, RoseAnne; Richter, Rosemary S.; Palley, Jane E.; Bradley, Elizabeth H.

2011-01-01

Background Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic are effective in reducing births among enrolled teenagers. However, there have been limited data on costs and cost-effectiveness of such programs. Objectives To use a community-based participatory research approach, to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Methods Using data from 1997-2003, we conducted an in-time intervention analysis to determine program cost-benefit while teenagers were enrolled and then used an extrapolation analysis to estimate accyrred economibc benefits and cost-benefit up to age 30. Results The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage females, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1,599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 on average, with social benefits outweighing total social costs by age 20.1. Conclusions We estimate that this comprehensive teenage pregnancy prevention program would provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost-effectiveness of similarly comprehensive programs when implemented more widely in high-risk neighborhoods. PMID:19896030

Economic evaluation of a comprehensive teenage pregnancy prevention program: pilot program.

Science.gov (United States)

Rosenthal, Marjorie S; Ross, Joseph S; Bilodeau, Roseanne; Richter, Rosemary S; Palley, Jane E; Bradley, Elizabeth H

2009-12-01

Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic support are effective in reducing births among enrolled teenagers. However, there have been limited data on the costs and cost effectiveness of such programs. The study used a community-based participatory research approach to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Using data from 1997-2003, an in-time intervention analysis was conducted to determine program cost-benefit while teenagers were enrolled; an extrapolation analysis was then used to estimate accrued economic benefits and cost-benefit up to age 30 years. The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage girls, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 years on average, with social benefits outweighing total social costs by age 20.1 years. This comprehensive teenage pregnancy prevention program is estimated to provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost effectiveness of similarly comprehensive programs when they are implemented more widely in high-risk neighborhoods.

Computer programs at SRL to evaluate environmental effects SRP operations and postulated accidental releases

International Nuclear Information System (INIS)

Cooper, R.E.

1975-09-01

Savannah River Plant operations unavoidably result in the release of some chemical and radioactive effluents to the environs. The most environmentally significant releases are gaseous effluents to the atmosphere; computer codes dealing with these atmospheric releases are discussed in this report. There is a wide variety of effluents, both chemical and radioactive, to be considered, and each must be correlated with meteorological dispersion data as a function of time to estimate the environmental effects. In addition, large inventories of toxic and radioactive materials in some facilities represent a potential for accidental releases. Accidents are postulated for these facilities, and the environmental effects of resulting releases are again evaluated by correlating with meteorological dispersion data. In accordance with AEC Regulatory Guide 23, a 2-year meteorological data base is used in performing all analyses. Due to the diversity of possible releases and the large meteorological data base, the environmental analyses are necessarily performed with the aid of a large computer facility. Several computer programs have been written to facilitate these analyses according to the type of analysis desired. The computer programs described in this report are basically of three categories: probability distributions of estimated concentrations or doses as a function of distance from a point of origin, estimates of average concentrations or doses over a specified time period such as annual averages, and some miscellaneous programs in support of the first two categories to optimize the use of the computing facility. A complete documentation of each program is included with a program listing and sample input-output

Neighborhood-based physical activity differences: Evaluation of the effect of health promotion program.

Directory of Open Access Journals (Sweden)

Amanda Cristina de Souza Andrade

Full Text Available The practice of physical activity is an important factor in the prevention of health problems. However, a small portion of the population is physically active. Recent reviews show that physical activity classes in community settings have the potential to increase population levels of physical activity and reduce health inequalities.To evaluate the effect of the Academias da Cidade Program in Belo Horizonte on the practice of physical activity in leisure time (PALT by non-users living near the program centers.We conducted a home-based health survey in Belo Horizonte (2008-2009 with 1,581 adults who were non-users of the program and who lived within a 1,500-meter radius of one active program center (exposed group and two nonoperational centers with sites reserved for their construction (unexposed group. We collected data on PALT levels (≥150 minutes/week, which was measured with the Physical Activity International Questionnaire and analyzed with binary logistic regression using the Generalized Estimating Equations method. The propensity score was used as an adjustment variable to control the potential confusion in the measures of effect of exposure studied.The overall prevalence of the PALT was 26.5% in the exposed group and 22.7% in the unexposed group. The exposed group was more likely to be active in leisure time (OR = 1.05; CI 95%: 1.01-1.10. When considering the interaction between exposed group and distance, individuals in the exposed group who lived less than 500 meters from the program center were more likely to be active in leisure time (OR = 1.18, CI 95%: 1.03-1.35 compared to their counterparts.Promoting physical activity in the community can favorably affect PALT levels among residents, especially those living closest to intervention centers. We believe the Academias da Cidade Program is a promising strategy to facilitate the access to appropriate spaces for the practice of physical activity and contribute to increase the levels

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Effectiveness of the Army Mentorship Program

National Research Council Canada - National Science Library

Nieberding, Richard J

2007-01-01

...). From the artifacts associated with this mentorship program, it appears that the Army highly values this program as a way to create a culture and climate that fosters learning and development for future leadership. This project will examine the effectiveness of mentorship in the today's Army and evaluate whether the program is sufficient to meet the needs for the Army's next generation of soldiers and leaders.

Are Job Search Programs a Promising Tool? : A Microeconometric Evaluation for Austria

OpenAIRE

Weber, Andrea Maria; Hofer, Helmut

2004-01-01

In Austria job search programs were introduced on a large scale in 1999. These programs aim at activating unemployed at an early stage and bringing them back to work by training job search related skills. We evaluate the impact of active labour market programs in Austria on individual unemployment durations, and allow program effects to vary between job search programs and formal training programs. We use the timing-of-events method which estimates the program effect as a shift in the transit...

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Cost-effectiveness of an exercise program during pregnancy to prevent gestational diabetes: Results of an economic evaluation alongside a randomised controlled trial

Directory of Open Access Journals (Sweden)

Oostdam Nicolette

2012-07-01

Full Text Available Abstract Background The prevalence of gestational diabetes mellitus (GDM is increasing worldwide. GDM and the risks associated with GDM lead to increased health care costs and losses in productivity. The objective of this study is to evaluate whether the FitFor2 exercise program during pregnancy is cost-effective from a societal perspective as compared to standard care. Methods A randomised controlled trial (RCT and simultaneous economic evaluation of the FitFor2 program were conducted. Pregnant women at risk for GDM were randomised to an exercise program to prevent high maternal blood glucose (n = 62 or to standard care (n = 59. The exercise program consisted of two sessions of aerobic and strengthening exercises per week. Clinical outcome measures were maternal fasting blood glucose levels, insulin sensitivity and infant birth weight. Quality of life was measured using the EuroQol 5-D and quality-adjusted life-years (QALYs were calculated. Resource utilization and sick leave data were collected by questionnaires. Data were analysed according to the intention-to-treat principle. Missing data were imputed using multiple imputations. Bootstrapping techniques estimated the uncertainty surrounding the cost differences and incremental cost-effectiveness ratios. Results There were no statistically significant differences in any outcome measure. During pregnancy, total health care costs and costs of productivity losses were statistically non-significant (mean difference €1308; 95%CI €-229 - €3204. The cost-effectiveness analyses showed that the exercise program was not cost-effective in comparison to the control group for blood glucose levels, insulin sensitivity, infant birth weight or QALYs. Conclusion The twice-weekly exercise program for pregnant women at risk for GDM evaluated in the present study was not cost-effective compared to standard care. Based on these results, implementation of this exercise program for the prevention of

Cost-effectiveness of an exercise program during pregnancy to prevent gestational diabetes: results of an economic evaluation alongside a randomised controlled trial.

Science.gov (United States)

Oostdam, Nicolette; Bosmans, Judith; Wouters, Maurice G A J; Eekhoff, Elisabeth M W; van Mechelen, Willem; van Poppel, Mireille N M

2012-07-04

The prevalence of gestational diabetes mellitus (GDM) is increasing worldwide. GDM and the risks associated with GDM lead to increased health care costs and losses in productivity. The objective of this study is to evaluate whether the FitFor2 exercise program during pregnancy is cost-effective from a societal perspective as compared to standard care. A randomised controlled trial (RCT) and simultaneous economic evaluation of the FitFor2 program were conducted. Pregnant women at risk for GDM were randomised to an exercise program to prevent high maternal blood glucose (n = 62) or to standard care (n = 59). The exercise program consisted of two sessions of aerobic and strengthening exercises per week. Clinical outcome measures were maternal fasting blood glucose levels, insulin sensitivity and infant birth weight. Quality of life was measured using the EuroQol 5-D and quality-adjusted life-years (QALYs) were calculated. Resource utilization and sick leave data were collected by questionnaires. Data were analysed according to the intention-to-treat principle. Missing data were imputed using multiple imputations. Bootstrapping techniques estimated the uncertainty surrounding the cost differences and incremental cost-effectiveness ratios. There were no statistically significant differences in any outcome measure. During pregnancy, total health care costs and costs of productivity losses were statistically non-significant (mean difference €1308; 95%CI €-229 - €3204). The cost-effectiveness analyses showed that the exercise program was not cost-effective in comparison to the control group for blood glucose levels, insulin sensitivity, infant birth weight or QALYs. The twice-weekly exercise program for pregnant women at risk for GDM evaluated in the present study was not cost-effective compared to standard care. Based on these results, implementation of this exercise program for the prevention of GDM cannot be recommended. NTR1139.

The efficacy of stuttering measurement training: evaluating two training programs.

Science.gov (United States)

Bainbridge, Lauren A; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J

2015-04-01

Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of stuttering events on eight 3-min audiovisual speech samples from adults and children who stutter. Stuttering judgment training involved use of either the Stuttering Measurement System (SMS), Stuttering Measurement Assessment and Training (SMAAT) programs, or no training. To test for the reliability of any training effect, SMS training was repeated with the 4th group. Both SMS-trained groups produced approximately 34% improvement, significantly better than no training or the SMAAT program. The SMAAT program produced a mixed result. The SMS program was shown to produce a "medium" effect size improvement in the accuracy of stuttering event counts, and this improvement was almost perfectly replicated in a 2nd group. Half of the SMAAT judges produced a 36% improvement in accuracy, but the other half showed no improvement. Additional studies are needed to demonstrate the durability of the reported improvements, but these positive effects justify the importance of stuttering measurement training.

Effective prevention programs for tobacco use.

Science.gov (United States)

Pentz, M A

1999-01-01

Several types of prevention programs have shown effects on delaying or reducing youth tobacco use for periods of 1-5 years or more. These are referred to as evidence-based programs. However, they are not widely used. At the same time, with few exceptions, adolescent tobacco use rates have been stable or have increased in the 1990s. The challenge for prevention is to identify critical components shared by effective prevention programs--that is, components most associated with effect, and then to evaluate factors that are most likely to promote adoption, implementation, and diffusion of effective programs across schools and communities in the United States. Effective tobacco prevention programs focus on counteracting social influences on tobacco use, include either direct training of youth in resistance and assertiveness skills or, for policy and community organization interventions, direct or indirect (through adults) training in community activism, and are mainly theory-based, with an emphasis on three levels of theory: (a) personal (attitudes, normative expectations, and beliefs); (b) social (social or group behavior); and/or (c) environmental (communications and diffusion). Program effects increase with the use of booster sessions, standardized implementor training and support, multiple program components, and multiple levels of theory. Overall, multi-component community programs that have a school program as a basis, with supportive parent, media, and community organization components, have shown the most sustained effects on tobacco use. Positive program adoption by the school or community, extent and quality of program implementation, and existence of credible networks of leaders to promote the program are critical for any effect. Research on predictors of adoption, implementation, and diffusion of evidence-based programs is scanty relative to outcome research. In addition, more research is needed on why multi-component programs appear to be most effective

Learning Under the Tree : Evaluating Skillful Parenting Program in West Kenya ICS Full Evaluation Report

NARCIS (Netherlands)

van Esch, R.P.|info:eu-repo/dai/nl/371571502; de Haan, M.J.|info:eu-repo/dai/nl/074405624

2016-01-01

Summary The central purpose of this evaluation is to determine if and how the Skillful Parenting Program (SPP) effects the parenting of its participants. In addition, it aims to determine how the parenting program was adapted to the West Kenyan setting, and how the specific content and processes of

Make a Move: A Comprehensive Effect Evaluation of a Sexual Harassment Prevention Program in Dutch Residential Youth Care.

Science.gov (United States)

van Lieshout, Sanne; Mevissen, Fraukje E F; van Breukelen, Gerard; Jonker, Marianne; Ruiter, Robert A C

2016-06-27

Sexual harassment-unwanted sexual comments, advances, or behaviors-and sexual violence are still prevalent worldwide, leading to a variety of physical, cognitive, and emotional problems among those being harassed. In particular, youth in care are at risk of becoming perpetrators (and victims) of sexual harassment. However, in general, there are very few interventions targeting this at-risk group, and no such programs exist in the Netherlands. To this end, a group intervention program-Make a Move-targeting determinants of sexual harassment was developed. This program was implemented and evaluated among boys (N = 177) in Dutch residential youth care (20 institutions). A pre-test, post-test, and 6-month follow-up design including an intervention and a waiting list control group with randomized assignment of institutions (cluster randomized trial) was used to measure the effects of the intervention on determinants of sexual harassment. Multilevel (mixed) regression analysis with Bonferroni correction for multiple testing (α = .005) showed no significant effects of Make a Move on determinants of sexual harassment (ps > .03, Cohen's ds < .44). Results are discussed in light of a three-way explanatory model focusing on intervention content, evaluation, and implementation as potential explanations for not finding any measurable intervention effects. © The Author(s) 2016.

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Effectiveness of mentoring programs for youth: a meta-analytic review.

Science.gov (United States)

DuBois, David L; Holloway, Bruce E; Valentine, Jeffrey C; Cooper, Harris

2002-04-01

We used meta-analysis to review 55 evaluations of the effects of mentoring programs on youth. Overall, findings provide evidence of only a modest or small benefit of program participation for the average youth. Program effects are enhanced significantly, however, when greater numbers of both theory-based and empirically based "best practices" are utilized and when strong relationships are formed between mentors and youth. Youth from backgrounds of environmental risk and disadvantage appear most likely to benefit from participation in mentoring programs. Outcomes for youth at-risk due to personal vulnerabilities have varied substantially in relation to program characteristics, with a noteworthy potential evident for poorly implemented programs to actually have an adverse effect on such youth. Recommendations include greater adherence to guidelines for the design and implementation of effective mentoring programs as well as more in-depth assessment of relationship and contextual factors in the evaluation of programs.

Using ecological theory to evaluate the effectiveness of an indigenous community intervention: A study of Sexual Assault Nurse Examiner (SANE) programs.

Science.gov (United States)

Campbell, Rebecca; Patterson, Debra; Fehler-Cabral, Giannina

2010-12-01

In recent years, there has been renewed interest among community psychologists in indigenous interventions, which are programs created by local practitioners (rather than researchers) already rooted in their communities. Indigenous interventions have strong ecological validity, but their effectiveness is often unknown because so few are rigorously evaluated. The goal of this project was to use Kelly and Trickett's ecological theory as a conceptual framework for evaluating an indigenous intervention and its mediating mechanisms of effectiveness. The focal intervention was a midwestern Sexual Assault Nurse Examiner (SANE) program, which provides post-assault medical care, crisis intervention, and medical forensic exams for sexual assault survivors. Prior studies of SANE programs have suggested that these interventions may help increase sexual assault prosecution rates. In this case example, we used a mixed methods design to determine if this program contributed to increased prosecution rates, and if so, why. Based on qualitative interviews with key stakeholders, we found substantial evidence for the Principle of Interdependence such that the SANE program strengthened the interconnections between the legal and medical systems, which contributed to increased prosecution. The intervention was effective in these outcomes because it promoted Cycling of Resources throughout the systems and fostered Adaptation of new roles for legal and medical personnel. Moving beyond this specific case example, this paper also examines cross-cutting advantages and struggles of using an ecological approach in the evaluation of indigenous community interventions.

Training effectiveness evaluation model

International Nuclear Information System (INIS)

Penrose, J.B.

1993-01-01

NAESCO's Training Effectiveness Evaluation Model (TEEM) integrates existing evaluation procedures with new procedures. The new procedures are designed to measure training impact on organizational productivity. TEEM seeks to enhance organizational productivity through proactive training focused on operation results. These results can be identified and measured by establishing and tracking performance indicators. Relating training to organizational productivity is not easy. TEEM is a team process. It offers strategies to assess more effectively organizational costs and benefits of training. TEEM is one organization's attempt to refine, manage and extend its training evaluation program

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Kentucky Preschool Evaluation Project: Differential Effects, Program Characteristics and Child Outcomes, and Longitudinal and Cumulative Findings. Reports 1-4, 1998-1999.

Science.gov (United States)

Hemmeter, Mary Louise; Townley, Kim; Wilson, Stephen; Epstein, Ann; Hines, Huyi

This document is comprised of four reports related to the evaluation of the Kentucky Preschool Program (KPP), serving 4-year-olds who qualify for the free lunch program and 3- and 4-year-olds with disabilities. Report 1 focuses on the differential effects of the preschool program related to race and to gender. Three key findings are reported: (1)…

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

Computer programs for TRIGA calibration, burnup evaluation, and bookkeeping

International Nuclear Information System (INIS)

Nelson, George W.

1978-01-01

Several computer programs have been developed at the University of Arizona to assist the direction and operation of the TRIGA Reactor Laboratory. The programs fall into the following three categories: 1. Programs for calculation of burnup of each fuel element in the reactor core, for maintaining an inventory of fuel element location and fissile content at any time, and for evaluation of the reactivity effects of burnup or proposed fuel element rearrangement in the core. 2. Programs for evaluation, function fitting, and tabulation of control rod measurements. 3. Bookkeeping programs to summarize and tabulate reactor runs and irradiations according to time, energy release, purpose, responsible party, etc. These summarized data are reported in an annual operating report for the facility. The use of these programs has saved innumerable hours of repetitious work, assuring more accurate, objective results, and requiring a minimum of effort to repeat calculations when input data are modified. The programs are written in FORTRAN-IV, and have been used on a CDC-6400 computer. (author)

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Effectiveness of the Surviving the Teens® Suicide Prevention and Depression Awareness Program: An Impact Evaluation Utilizing a Comparison Group

Science.gov (United States)

Strunk, Catherine M.; King, Keith A.; Vidourek, Rebecca A.; Sorter, Michael T.

2014-01-01

Youth suicide is a serious public health issue in the United States. It is currently the third leading cause of death for youth aged 10 to 19. School-based prevention programs may be an effective method of educating youth and enhancing their help-seeking. Most school-based suicide prevention programs have not been rigorously evaluated for their…

An interprofessional palliative care oncology rehabilitation program: effects on function and predictors of program completion.

Science.gov (United States)

Chasen, M R; Feldstain, A; Gravelle, D; Macdonald, N; Pereira, J

2013-12-01

After treatment, patients with active cancer face a considerable burden from the effects of both the disease and its treatment. The Palliative Rehabilitation Program (prp) is designed to ameliorate disease effects and to improve the patient's functioning. The present study evaluated predictors of program completion and changes in functioning, symptoms, and well-being after the program. The program received referrals for 173 patients who had finished anticancer therapy. Of those 173 patients, 116 with advanced cancer were eligible and enrolled in the 8-week interprofessional prp; 67 completed it. Measures of physical, nutritional, social, and psychological functioning were evaluated at entry to the program and at completion. Participants experienced significant improvements in physical performance (p program not challenging enough), death, and personal or unknown reasons. A normal level of C-reactive protein (program completion. Patients living with advanced cancers who underwent the interprofessional prp experienced significant improvement in functioning across several domains. Program completion can be predicted by a normal level of C-reactive protein.

Evaluating traffic informers: testing the behavioral and social-cognitive effects of an adolescent bicycle safety education program.

Science.gov (United States)

Feenstra, Hans; Ruiter, Robert A C; Kok, Gerjo

2014-12-01

In The Netherlands, 12-24 years old are over-represented in the total number of traffic fatalities and injuries. In this study, the traffic informer program - designed to promote safe traffic behavior in the pre-driver population - was experimentally evaluated, with a specific focus on bicycle use. Students were subjected to graphic videos of traffic accidents and listened to a first-person narrative provided by a traffic accident victim. The influence of the program on concepts derived from the theory of planned behavior and protection motivation theory (attitudes, norms, self-efficacy, risk-perception, intention and behavior) was assessed. Students from various schools (N=1593;M age=15 years, SD=.84) participated in a quasi-experimental study, either in an experimental or a control group, completing self-report questionnaires one week prior to the program implementation and approximately one month after the program implementation. Mixed regression analyses showed significant positive and negative time × intervention interaction effects on attitude toward traffic violations, relative attitude toward traffic safety, and risk comparison, but not on intention and behavior. More research is needed to find effective behavioral change techniques (other than increasing risk awareness) for promoting safe traffic behavior in adolescents. Research is also needed to address how these can be translated into effective interventions and educational programs. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Outcome Evaluation of the Hands-On Parent Empowerment (HOPE) Program

Science.gov (United States)

Leung, Cynthia; Tsang, Sandra; Dean, Suzanne

2011-01-01

This study evaluated the effectiveness of the HOPE program. Participants included 120 Chinese new immigrant parents with preschool children in Hong Kong from 13 preschools which were randomized into intervention group (HOPE) and comparison group (6-session parent education program). Parent participants completed measures on child behavior,…

High Burnup Effects Program

International Nuclear Information System (INIS)

Barner, J.O.; Cunningham, M.E.; Freshley, M.D.; Lanning, D.D.

1990-04-01

This is the final report of the High Burnup Effects Program (HBEP). It has been prepared to present a summary, with conclusions, of the HBEP. The HBEP was an international, group-sponsored research program managed by Battelle, Pacific Northwest Laboratories (BNW). The principal objective of the HBEP was to obtain well-characterized data related to fission gas release (FGR) for light water reactor (LWR) fuel irradiated to high burnup levels. The HBEP was organized into three tasks as follows: Task 1 -- high burnup effects evaluations; Task 2 -- fission gas sampling; and Task 3 -- parameter effects study. During the course of the HBEP, a program that extended over 10 years, 82 fuel rods from a variety of sources were characterized, irradiated, and then examined in detail after irradiation. The study of fission gas release at high burnup levels was the principal objective of the program and it may be concluded that no significant enhancement of fission gas release at high burnup levels was observed for the examined rods. The rim effect, an as yet unquantified contributor to athermal fission gas release, was concluded to be the one truly high-burnup effect. Though burnup enhancement of fission gas release was observed to be low, a full understanding of the rim region and rim effect has not yet emerged and this may be a potential area of further research. 25 refs., 23 figs., 4 tabs

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

Evaluating a food bank recipe-tasting program.

Science.gov (United States)

Keller-Olaman, Susan J; Edwards, Vicki; Elliott, Susan J

2005-01-01

Food banks mitigate immediate food insecurity, but their ability to promote healthy nutrition is constrained by how often recipients may visit and the range of foods available. In a descriptive study, a formative evaluation was completed of a combined heart-healthy recipe-tasting and education program that aims to promote healthy eating knowledge and skills in a group of food bank recipients in Hamilton, Ontario. Fifty-five adults were surveyed about food bank attendance, program awareness, perceived enhancement of knowledge and skills, and suggestions for program improvement. Most participants (73%) were positive about the program, and 91% wanted the program to continue. In addition, 78% would prepare the recipes sampled. In contrast, program awareness and planning food bank visits to coincide with the program were generally low. Food banks are potential sites for effective nutrition promotion programs. To reach more recipients, more frequent implementation and seeking the use of a designated room are suggested for the current program. The findings also suggest that the sampling approach to promoting healthy eating to food bank recipients deserves further study. For example, monitoring the selection of featured recipe ingredients would be a useful indicator of behaviour.

Evaluation Strategies for EWP Programs: A Marketing Perspective.

Science.gov (United States)

Turkewych, Christine

1986-01-01

Describes how evaluation strategies can be implemented to increase the effectiveness of English in the Work Place programs. Discusses the design and implementation of the strategy, how to analyze its results and produce a final report, and ways to get the results used. (SED)

Evaluating public involvement in the National Low-Level Radioactive Waste Management Program

International Nuclear Information System (INIS)

1982-09-01

The Department of Energy contracted with the Keystone Center to evaluate the effectiveness of the National Low-Level Radioactive Waste Management Program's public-involvement efforts. The Center chose six evaluators with diverse training and experience related to low-level waste management and public-participation programs. Keystone's evaluation was based on (a) observations by the evaluators who attended the National Program-sponsored strategy review meetings and fairs; (b) interviews with low-level waste generators, local government officials, state legislators, public-interest groups, and members of the general public; and (c) observations of the final National Program strategy task force meeting. The evaluators concluded that, overall, the public-participation processes yielded some very positive results - for policy development and for DOE and the EG and G staff. They judged the strategy document to be complete, concise, and helpful to public dialogue on low-level waste issues. They also made specific recommendations for improvements to the public-participation program

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

Science.gov (United States)

Ewell, Bob

1998-01-01

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs

Offense History and the Effectiveness of Juvenile Diversion Programs.

Science.gov (United States)

Osgood, D. Wayne; And Others

Some evaluations have concluded that diversion programs for juvenile offenders (programs intended as community-based alternatives to formal justice dispositions) reduce recidivism only among youths with the least serious offense histories. To investigate the relationship of offense history to program effectiveness, three diversion programs were…

New approach in the evaluation of a fitness program at a worksite.

Science.gov (United States)

Shirasaya, K; Miyakawa, M; Yoshida, K; Tanaka, C; Shimada, N; Kondo, T

1999-03-01

The most common methods for the economic evaluation of a fitness program at a worksite are cost-effectiveness, cost-benefit, and cost-utility analyses. In this study, we applied a basic microeconomic theory, "neoclassical firm's problems," as the new approach for it. The optimal number of physical-exercise classes that constitute the core of the fitness program are determined using the cubic health production function. The optimal number is defined as the number that maximizes the profit of the program. The optimal number corresponding to any willingness-to-pay amount of the participants for the effectiveness of the program is presented using a graph. For example, if the willingness-to-pay is $800, the optimal number of classes is 23. Our method can be applied to the evaluation of any health care program if the health production function can be estimated.

Evaluating the effectiveness of an online medical laboratory technician program.

Science.gov (United States)

Hansen-Suchy, Kara

2011-01-01

The purpose of this study was to analyze the effectiveness of an online medical laboratory technician program in the academic preparation and development of laboratory professionals. A semi-quantitative comparative research design was used. Several factors were considered in this evaluation. Academic outcomes between online and campus medical laboratory technician (MLT) students was determined by comparing overall and categorical scores on certification exams as well as first time pass rate. Certification exam scores and first time pass rates were also compared to national norms when possible to do so. Demographic data, including age and experience were compared. Additionally, learning styles were assessed to determine if there was a correlation to overall GPA and MLT GPA and if learning styles could be used to predict successful completion of an online Associates of Applied Science. The research was conducted at an academic university located in the mountain west United States. Participants consisted of online and campus students enrolled in a Medical Laboratory Technician program that graduated with their Associate of Applied Science degree between the years 2007-2009. Results of these years were also compared to graduates from 2004-2006 in the same program. Certification performance and first time pass rates were the major outcomes measured. Age and experience were correlated. Online learning styles and GPA were also compared to successful degree completion. The researcher found no significant difference in certification performance with regard to total and categorical scores, and first time pass rates between campus and online MLT students. Online students were slightly older and had more experience working in a laboratory in some capacity. Correlation studies showed significant positive correlation between learning styles, GPA, and successful completion of an Associate of Applied Science degree. When registry scores were compared to the prior cohort of online

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

The Pennsylvania certified safety committee program: an evaluation of participation and effects on work injury rates.

Science.gov (United States)

Liu, Hangsheng; Burns, Rachel M; Schaefer, Agnes G; Ruder, Teague; Nelson, Christopher; Haviland, Amelia M; Gray, Wayne B; Mendeloff, John

2010-08-01

Since 1994, Pennsylvania, like several other states, has provided a 5% discount on workers' compensation insurance premiums for firms with a certified joint labor management safety committee. This study explored the factors affecting program participation and evaluated the effect of this program on work injuries. Using Pennsylvania unemployment insurance data (1996-2006), workers' compensation data (1998-2005), and the safety committee audit data (1999-2007), we conducted propensity score matching and regression analysis on the program's impact on injury rates. Larger firms, firms with higher injury rates, firms in high risk industries, and firms without labor unions were more likely to join the safety committee program and less likely to drop out of the program. The injury rates of participants did not decline more than the rates for non-participants; however, rates at participant firms with good compliance dropped more than the rates at participant firms with poor compliance. Firm size and prior injury rates are key predictors of program participation. Firms that complied with the requirement to train their safety committee members did experience reductions in injuries, but non-compliance with that and other requirements was so widespread that no overall impact of the program could be detected. Copyright 2010 Wiley-Liss, Inc.

Evaluating Teen Pregnancy Prevention Programs: Decades of Evolving Strategies and Practices

Directory of Open Access Journals (Sweden)

Susan Philliber

2015-09-01

Full Text Available This paper reviews the changing strategies for both process and outcome evaluations of teen pregnancy prevention programs over the past few decades. Implementation evaluations have emphasized discovery of what program attributes are most effective in reducing teen pregnancy and its antecedents. Outcome evaluations have moved from collecting data to measure knowledge, attitudes, and program satisfaction to measuring behavior change including postponement of sexual involvement, increased used of contraception, or reduction in teen pregnancy. High quality randomized control trials or quasi-experimental designs are being increasingly emphasized, as are sophisticated analysis techniques using multi-variate analyses, controls for cluster sampling, and other strategies designed to build a more solid knowledge base about how to prevent early pregnancy.

Evaluation of otolaryngology residency program websites.

Science.gov (United States)

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42

Methods for evaluating educational programs: does Writing Center participation affect student achievement?

Science.gov (United States)

Bredtmann, Julia; Crede, Carsten J; Otten, Sebastian

2013-02-01

This paper evaluates the effectiveness of the introduction of a Writing Center at a university, which aims at improving students' scientific writing abilities. In order to deal with the presumed limited utility of student feedback surveys for evaluating the effectiveness of educational programs, we use students' actual learning outcomes as our quality measure. Based on this objective measure, different statistical evaluation methods established in the labor market treatment literature are applied. We present and discuss the validity of these methods to evaluate educational programs and compare the results of these approaches to implications obtained using corresponding student surveys. Although almost all students reported the writing courses to be helpful, we find no significant effect of course participation on students' grades. This result highlights the need for institutions not to rely solely on student course evaluations for evidence-based policy decisions. Copyright © 2012 Elsevier Ltd. All rights reserved.

Evaluation of a Hospital-Based Pneumonia Nurse Navigator Program.

Science.gov (United States)

Seldon, Lisa E; McDonough, Kelly; Turner, Barbara; Simmons, Leigh Ann

2016-12-01

The aim of this study is to evaluate the effectiveness of a hospital-based pneumonia nurse navigator program. This study used a retrospective, formative evaluation. Data of patients admitted from January 2012 through December 2014 to a large community hospital with a primary or secondary diagnosis of pneumonia, excluding aspiration pneumonia, were used. Data included patient demographics, diagnoses, insurance coverage, core measures, average length of stay (ALOS), disposition, readmission rate, financial outcomes, and patient barriers to care were collected. Descriptive statistics and parametric testing were used to analyze data. Core measure performance was sustained at the 90th percentile 2 years after the implementation of the navigator program. The ALOS did not decrease to established benchmarks; however, the SD for ALOS decreased by nearly half after implementation of the navigator program, suggesting the program decreased the number and length of extended stays. Charges per case decreased by 21% from 2012 to 2014. Variable costs decreased by 4% over a 2-year period, which increased net profit per case by 5%. Average readmission payments increased by 8% from 2012 to 2014, and the net revenue per case increased by 8.3%. The pneumonia nurse navigator program may improve core measures, reduce ALOS, and increase net revenue. Future evaluations are necessary to substantiate these findings and optimize the cost and quality performance of navigator programs.

Research and evaluation of the effectiveness of e-learning in the case of linear programming

Directory of Open Access Journals (Sweden)

Ljiljana Miletić

2016-04-01

Full Text Available The paper evaluates the effectiveness of the e-learning approach to linear programming. The goal was to investigate how proper use of information and communication technologies (ICT and interactive learning helps to improve high school students’ understanding, learning and retention of advanced non-curriculum material. The hypothesis was that ICT and e-learning is helpful in teaching linear programming methods. In the first phase of the research, a module of lessons for linear programming (LP was created using the software package Loomen Moodle and other interactive software packages such as Geogebra. In the second phase, the LP module was taught as a short course to two groups of high school students. These two groups of students were second-grade students in a Croatian high school. In Class 1, the module was taught using ICT and e-learning, while the module was taught using classical methods in Class 2. The action research methodology was an integral part in delivering the course to both student groups. The sample student groups were carefully selected to ensure that differences in background knowledge and learning potential were statistically negligible. Relevant data was collected while delivering the course. Statistical analysis of the collected data showed that the student group using the e-learning method produced better results than the group using a classical learning method. These findings support previous results on the effectiveness of e-learning, and also establish a specific approach to e-learning in linear programming.

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

Effectiveness and Cost-benefit Evaluation of a Comprehensive Workers' Health Surveillance Program for Sustainable Employability of Meat Processing Workers

NARCIS (Netherlands)

Holland, van Berry J.; Reneman, Michiel F; Soer, Remko; Brouwer, Sandra; de Boer, Michiel R

Objective To evaluate the effectiveness of a comprehensive workers' health surveillance (WHS) program on aspects of sustainable employability and cost-benefit. Methods A cluster randomized stepped wedge trial was performed in a Dutch meat processing company from february 2012 until march 2015. In

Effectiveness and Cost-benefit Evaluation of a Comprehensive Workers' Health Surveillance Program for Sustainable Employability of Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry J; Reneman, Michiel F; Soer, Remko; Brouwer, Sandra; de Boer, Michiel R

2017-01-01

Objective To evaluate the effectiveness of a comprehensive workers' health surveillance (WHS) program on aspects of sustainable employability and cost-benefit. Methods A cluster randomized stepped wedge trial was performed in a Dutch meat processing company from february 2012 until march 2015. In

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Sustainability of donor programs: evaluating and informing the transition of a large HIV prevention program in India to local ownership

Directory of Open Access Journals (Sweden)

Sara Bennett

2011-12-01

Full Text Available Sustainability is the holy grail of many development projects, yet there is limited evidence about strategies that effectively support transition of programs from donor funding to national governments. The first phase of Avahan, the India AIDS Initiative supported by the Bill and Melinda Gates Foundation (2003–2009, aimed to demonstrate an HIV/AIDS prevention program at scale, primarily targeted at high-risk groups. During the second phase (2009–2013, this large-scale program will be transitioned to its natural owners: the Government of India and local communities. This paper describes the evaluation design for the Avahan transition strategy.A detailed logic model for the transition was developed. The Avahan transition strategy focuses on three activities: 1 enhancing capacities among communities, non-governmental organizations (NGOs, and government entities, in line with India's national AIDS control strategy; 2 aligning technical and managerial aspects of Avahan programs with government norms and standards; and 3 promoting and sustaining commitment to services for most-at-risk populations. It is anticipated that programs will then transfer smoothly to government and community ownership, become institutionalized within the government system, and support a sustained HIV/AIDS response.The research design evaluates the implementation and effectiveness of 1 activities undertaken by the program; 2 intermediate effects including the process of institutionalization and the extent to which key Avahan organizational procedures and behaviors are integrated into government systems; and 3 overarching effects namely the impact of the transition process on the sustained delivery of HIV/AIDS prevention services to high-risk groups. Both qualitative and quantitative research approaches are employed so that the evaluation will both assess outcomes and explain why they have occurred.It is unusual for donor-supported projects in low- and middle

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Evaluating the market transformation impacts of a DSM program in the Province of Quebec

Energy Technology Data Exchange (ETDEWEB)

Baillargeon, P.; Michaud, N. [Econoler, 160 St-Paul Street, Quebec, QC, G1K 3W1 (Canada); Schmitt, B. [Hydro-Quebec, Complexe Desjardins, East Tower, C.P. 10000, Place Desjardins, Montreal, QC, H5B 1H7 (Canada); Megdal, L. [Megdal and Associates, 198 High Street, Acton, MA 01720 (United States)

2012-01-15

In 2006, Hydro-Quebec introduced a large DSM program on the market to promote the adoption of compact fluorescent lamps in Quebec households. After 3 years of program implementation, there was significant indication on the part of market actors that the promotional campaign component was quite effective in transforming the Quebec market. Hydro-Quebec therefore decided to modify its approach to program evaluation to include the quantification of market effects. Econoler led a team including American partners, Opinion Dynamics Inc. and Megdal and Associates to conduct an evaluation of program impacts on market transformation. An evaluation strategy was designed where different research tools would be integrated to determine market evolution over the two previous years. Each research method was used to determine an estimate of program impacts, then triangulated with other approaches to determine the most appropriate impact evaluation method regarding the Hydro-Quebec program. Research efforts included a non-participant survey, interviews at manufacturer headquarters across Canada, interviews with banner distributor representatives across Canada, the collection of sales and market share data from manufacturers and retailers as well as secondary research to identify other players that could influence the market. The evaluation revealed that savings of 168 GWh could be attributed to direct and indirect impacts of the program for the 2006-2007 period.

[Psychological Effects of Forest Therapy Program on Workers].

Science.gov (United States)

Ikei, Harumi; Koizumi, Haruka; Song, Chorong; Kouzuki, Mitsunori; Teratani, Seiichiro; Sakuma, Takahiro; Miyazaki, Yoshifumi

2015-01-01

To examine the psychological effects of forest therapy program on workers. The subjective symptoms index, a shortened version of the profile of mood states (POMS), and a semantic differential (SD) method were used to measure the psychological effects. The evaluations were performed 3 days before, during, and 1, 3, and 5 days after the forest therapy. The following results were obtained: (1) the subjective symptoms improved before breakfast and continued for 5 days; (2) the mood evaluated using POMS improved before breakfast and continued for 3 days; and (3) “comfortable,” “relaxed,” and “natural” feelings evaluated using the SD method were enhanced before breakfast, lunch, and dinner during forest therapy. These results provided scientific evidence of the psychological effects of forest therapy program on workers.

Effectiveness of blood pressure educational and evaluation program for the improvement of measurement accuracy among nurses.

Science.gov (United States)

Rabbia, Franco; Testa, Elisa; Rabbia, Silvia; Praticò, Santina; Colasanto, Claudia; Montersino, Federica; Berra, Elena; Covella, Michele; Fulcheri, Chiara; Di Monaco, Silvia; Buffolo, Fabrizio; Totaro, Silvia; Veglio, Franco

2013-06-01

To assess the procedure for measuring blood pressure (BP) among hospital nurses and to assess if a training program would improve technique and accuracy. 160 nurses from Molinette Hospital were included in the study. The program was based upon theoretical and practical lessons. It was one day long and it was held by trained nurses and physicians who have practice in the Hypertension Unit. An evaluation of nurses' measuring technique and accuracy was performed before and after the program, by using a 9-item checklist. Moreover we calculated the differences between measured and effective BP values before and after the training program. At baseline evaluation, we observed inadequate performance on some points of clinical BP measurement technique, specifically: only 10% of nurses inspected the arm diameter before placing the cuff, 4% measured BP in both arms, 80% placed the head of the stethoscope under the cuff, 43% did not remove all clothing that covered the location of cuff placement, did not have the patient seat comfortably with his legs uncrossed and with his back and arms supported. After the training we found a significant improvement in the technique for all items. We didn't observe any significant difference of measurement knowledge between nurses working in different settings such as medical or surgical departments. Periodical education in BP measurement may be required, and this may significantly improve the technique and consequently the accuracy.

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Development of detailed analysis program for high-temperature crack growth evaluation

Energy Technology Data Exchange (ETDEWEB)

Takahashi, Yukio; Nakayama, Yasunari [Central Research Inst. of Electric Power Industry, Komae, Tokyo (Japan). Komae Research Lab

2001-04-01

Evaluation of crack growth as well as crack initiation is necessary to make realistic evaluation of structural integrity and life management of high-temperature plant components. Domain integral formulae for three kinds of nonlinear fracture mechanics parameters, i.e. J-integral, fatigue J-integral range and creep J-integral were derived for two-dimensional, three-dimensional and axi-symmetrical structures. Furthermore, methods for applying them to finite element results were derived and a computer program was developed for the general-purpose finite element program, MARC. The program was applied to various problems and its effectiveness was demonstrated. (author)

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

The SBIRT program matrix: a conceptual framework for program implementation and evaluation.

Science.gov (United States)

Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna

2017-02-01

Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.

The Program Manager's Guide to Evaluation, Second Edition

Science.gov (United States)

Administration for Children & Families, 2010

2010-01-01

The Office of Planning, Research and Evaluation (OPRE), a unit within the Administration for Children and Families (ACF), is responsible for advising the Assistant Secretary for Children and Families on increasing the effectiveness and efficiency of programs to improve the economic and social well-being of children and families. In collaboration…

A Census of Prison-Based Drug Treatment Programs: Implications for Programming, Policy, and Evaluation

Science.gov (United States)

Welsh, Wayne N.; Zajac, Gary

2004-01-01

Despite a growing realization that unmeasured programmatic differences influence prison-based drug treatment effectiveness, few attempts to systematically measure such differences have been made. To improve program planning and evaluation in this area, we developed a census instrument to collect descriptive information about 118 prison-based drug…

Preparing for terrorism: tools for evaluating the Metropolitan Medical Response System Program

National Research Council Canada - National Science Library

Manning, Frederick J; Goldfrank, Lewis R

2002-01-01

.... DHHS asked the Institute of Medicine (IOM) to assist in assessing the effectiveness of the MMRS program by developing appropriate evaluation methods, tools, and processes to assess both its own management of the program and local preparedness...

Impact Evaluation of an Addiction Intervention Program in a Quebec Prison

Directory of Open Access Journals (Sweden)

Catherine Arseneault

2015-01-01

Full Text Available Objectives This study evaluates the effects of a prison-based addiction intervention program. The evaluation is based on a multidimensional data collection that draws a portrait of the respondents’ substance use, and of their psychological/emotional, social, and judicial spheres. It measures the changes, or lack thereof, in substance use; the psychological/emotional, social, and judicial spheres; as well as the post-treatment services used. Method A quasi-experimental repeated measures design (0, 6 weeks, and 6 months was used. Effects of the program were identified by comparing the results obtained by a group of inmates who had participated in the program ( n = 80; experimental group with those of another group who had received no intervention ( n = 70; control group. Results The preliminary results suggested a certain treatment effect related to impulsivity and psychological distress. Conclusion Although the preliminary results were promising, the experimental and control groups did not differ significantly when more robust analyses were used.

Evaluation of Medical Education virtual Program: P3 model.

Science.gov (United States)

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Evaluation of the effectiveness of a phonoaudiology program for the rehabilitation of dysphagia in the elderly.

Science.gov (United States)

Santoro, P; e Silva, I L; Cardoso, F; Dias, E; Beresford, H

2011-01-01

The object of this study was to evaluate the effectiveness of a phonoaudiology rehabilitation program directed towards the degenerative changes of the neurophysiological mechanisms responsible for the upper digestive system compromised by the age between 80 and 90 years, in a regime of internment in a long permanence institution in the city of Rio de Janeiro, which express, bodily, their difficulty in swallowing food of liquid or pasty consistency. To achieve such an object, the current study was developed in an experimental format or design, comprised of a sample group of 23 elderly subjects, of both genders, undergoing evaluation by the phonoaudiology protocol for evaluating the risk of dysphagia (abbreviated from the Portuguese name: Protocolo de Avaliação do Risco para Disfagia=PARD), pre- and post-intervention procedure. The developed program used the indirect therapy approach based on the adaptive myotherapeutic and myofunctional stimulation, contemplating two isometric and isokinetic orofacial active myotherapeutic exercises, two passive myotherapeutic manipulations for the supra-hyoidal musculature, as well as adaptive cephalic postural maneuvres, associated to the intra-oral olfactive and gustative sensory stimulation. The evolution of the individuals was analyzed before and after the therapy by estimating the capacity of swallowing food in the liquid fluid (LF) consistency, by the paired Student t-test, giving a p=0.01, making the difference of 2.31 between the 2 evaluations statistically significant. The changes produced by the PARD program in the capacity of individuals in swallowing food of a pasty consistency were also significant when analyzing the variance of the results on the 2 instances by using the F-test (pre- and post-intervention difference=4.47, p=0.039). Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.

Mapping Out Your Success: Using Mind Maps to Evaluate Youth Development Programs

Directory of Open Access Journals (Sweden)

Mary Sara Wells

2009-06-01

Full Text Available A primary component of any youth program is documenting and promoting the results through evaluation. Frequently, however, administrators in youth development programs struggle to find meaningful ways of evaluating the impacts they have on the lives of youth. It is often difficult to capture the unique benefits these programs offer to participants, especially when traditional methods such as focus groups and interviews may be too time consuming and questionnaires may yield poor response rates. This article presents a creative form of evaluation targeted at demonstrating the success of programs in outcomes that are historically more difficult to measure. A “mind map” is designed to be a pictorial representation of the impact of programs in areas such as connections to community organization and adult role models. Employing this technique can enable administrators in youth development programs to demonstrate to stakeholders the benefits they provide in a non-traditional, but highly effective, way.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

Science.gov (United States)

Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

2014-06-01

Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluating a prevention program for teenagers on sexual coercion: a differential effectiveness approach.

Science.gov (United States)

Pacifici, C; Stoolmiller, M; Nelson, C

2001-06-01

The authors evaluated a coeducational program for teenagers on preventing sexual coercion in dating situations. Students examined individual and social attitudes underlying coercive sexual behavior and learned communication skills aimed at preventing or dealing with unwanted sexual advances. Instruction was enhanced by video and an interactive video "virtual date." Outcomes were assessed using sexual attitude scales with a sample of 458 high school students. Student health education classes were randomly assigned to either a treatment or a control condition. Findings, based on a latent variable model of differential effectiveness, showed that students in the treatment group with initial coercive attitude scores at or above the mean benefited significantly more than students with the same range of scores in the control group.

Effects of a Community-Based, Post-Rehabilitation Exercise Program in COPD: Protocol for a Randomized Controlled Trial With Embedded Process Evaluation.

Science.gov (United States)

Desveaux, Laura; Beauchamp, Marla K; Lee, Annemarie; Ivers, Noah; Goldstein, Roger; Brooks, Dina

2016-05-11

This manuscript (1) outlines the intervention, (2) describes how its effectiveness is being evaluated in a pragmatic randomized controlled trial, and (3) summarizes the embedded process evaluation aiming to understand key barriers and facilitators for implementation in new environments. Participating centers refer eligible individuals with COPD following discharge from their local PR program. Consenting patients are assigned to a year-long community exercise program or usual care using block randomization and stratifying for supplemental oxygen use. Patients in the intervention arm are asked to attend an exercise session at least twice per week at their local community facility where their progress is supervised by a case manager. Each exercise session includes a component of aerobic exercise, and activities designed to optimize balance, flexibility, and strength. All study participants will have access to routine follow-up appointments with their respiratory physician, and additional health care providers as part of their usual care. Assessments will be completed at baseline (post-PR), 6, and 12 months, and include measures of functional exercise capacity, quality of life, self-efficacy, and health care usage. Intervention effectiveness will be assessed by comparing functional exercise capacity between intervention and control groups. A mixed-methods process evaluation will be conducted to better understand intervention implementation, guided by Normalization Process Theory and the Consolidated Framework for Implementation Research. Based on results from our pilot work, we anticipate a maintenance of exercise capacity and improved health-related quality of life in the intervention group, compared with a decline in exercise capacity in the usual care group. Findings from this study will improve our understanding of the effectiveness of community-based exercise programs for maintaining benefits following PR in patients with COPD and provide information on how best

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Integrating hypermedia into the environmental education setting: Developing a program and evaluating its effect

Science.gov (United States)

Parker, Tehri Davenport

1997-09-01

This study designed, implemented, and evaluated an environmental education hypermedia program for use in a residential environmental education facility. The purpose of the study was to ascertain whether a hypermedia program could increase student knowledge and positive attitudes toward the environment and environmental education. A student/computer interface, based on the theory of social cognition, was developed to direct student interactions with the computer. A quasi-experimental research design was used. Students were randomly assigned to either the experimental or control group. The experimental group used the hypermedia program to learn about the topic of energy. The control group received the same conceptual information from a teacher/naturalist. An Environmental Awareness Quiz was administered to measure differences in the students' cognitive understanding of energy issues. Students participated in one on one interviews to discuss their attitudes toward the lesson and the overall environmental education experience. Additionally, members of the experimental group were tape recorded while they used the hypermedia program. These tapes were analyzed to identify aspects of the hypermedia program that promoted student learning. The findings of this study suggest that computers, and hypermedia programs, can be integrated into residential environmental education facilities, and can assist environmental educators in meeting their goals for students. The study found that the hypermedia program was as effective as the teacher/naturalist for teaching about environmental education material. Students who used the computer reported more positive attitudes toward the lesson on energy, and thought that they had learned more than the control group. Students in the control group stated that they did not learn as much as the computer group. The majority of students had positive attitudes toward the inclusion of computers in the camp setting, and stated that they were a good

Evaluations of the Overjustification Effect

Science.gov (United States)

Peters, Kerri P.; Vollmer, Timothy R.

2014-01-01

The utility of reinforcement-based procedures has been well established in the behavior analysis literature and is commonly used in educational settings. However, the overjustification effect is one commonly cited criticism of programs that use tangible items as reinforcers. In the current studies, we evaluated the effects of tangible rewards…

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Evaluation of spacecraft technology programs (effects on communication satellite business ventures), volume 1

Science.gov (United States)

Greenburg, J. S.; Gaelick, C.; Kaplan, M.; Fishman, J.; Hopkins, C.

1985-01-01

Commercial organizations as well as government agencies invest in spacecraft (S/C) technology programs that are aimed at increasing the performance of communications satellites. The value of these programs must be measured in terms of their impacts on the financial performane of the business ventures that may ultimately utilize the communications satellites. An economic evaluation and planning capability was developed and used to assess the impact of NASA on-orbit propulsion and space power programs on typical fixed satellite service (FSS) and direct broadcast service (DBS) communications satellite business ventures. Typical FSS and DBS spin and three-axis stabilized spacecraft were configured in the absence of NASA technology programs. These spacecraft were reconfigured taking into account the anticipated results of NASA specified on-orbit propulsion and space power programs. In general, the NASA technology programs resulted in spacecraft with increased capability. The developed methodology for assessing the value of spacecraft technology programs in terms of their impact on the financial performance of communication satellite business ventures is described. Results of the assessment of NASA specified on-orbit propulsion and space power technology programs are presented for typical FSS and DBS business ventures.

Evaluation of the Tier 1 Program of Project P.A.T.H.S.: Secondary Data Analyses of Conclusions Drawn by the Program Implementers

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2008-01-01

Full Text Available The Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes is a curricula-based positive youth development program. In the experimental implementation phase, 52 schools participated in the program. Based on subjective outcome evaluation data collected from the program participants (Form A and program implementers (Form B in each school, the program implementers were invited to write down five conclusions based on an integration of the evaluation findings (N = 52. The conclusions stated in the 52 evaluation reports were further analyzed via secondary data analyses in this paper. Results showed that most of the conclusions concerning perceptions of the Tier 1 Program, instructors, and effectiveness of the programs were positive in nature. There were also conclusions reflecting the respondents’ appreciation of the program. Finally, responses on the difficulties encountered and suggestions for improvements were observed. In conjunction with the previous evaluation findings, the present study suggests that the Tier 1 Program was well received by the stakeholders and the program was beneficial to the development of the program participants.

Wilderness educators' evaluation of the Impact Monster Program

Science.gov (United States)

William W. Hendricks; Alan E. Watson

1999-01-01

Since its development by Jim Bradley in the late 1970s, the Impact Monster, a wilderness education skit designed to teach minimum impact techniques, has been used as a wilderness education tool by federal land management agencies. This paper reports on an evaluation of the perceived effectiveness of the Impact Monster program and its content. Results indicate that the...

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Attributable effects from information and outreach programs: Net to gross, NEBs, and beyond

Energy Technology Data Exchange (ETDEWEB)

Freeman, David Juri; Skumatz, Lisa A. [Skumatz Economic Research Associates, Inc. (SERA) (United States)

2007-07-01

Education, outreach, advertising, and training programs provide particular difficulties in evaluation, as they focus on modifying behaviors and purchases rather than directly installing measures. This paper summarizes the results of a literature review of more than 80 studies evaluating strengths and weaknesses of evaluation work on outreach and education programs. Then, the paper presents the results of several applications of advanced evaluation techniques that are being applied to outreach, education, and training programs. This paper provides the results from detailed net-to-gross (NTG) and non-energy benefits (NEB) evaluations of outreach, training, and education programs, including:A training and education geared toward commercial architects and engineers; Two similar programs geared toward residential builders and remodelers; Residential appliance-related education and outreach programs (Energy Star); and An information-based university program.We provide information from detailed evaluations of the share of energy savings and attributable effects that are due to the program's efforts (net-to-gross ratio), and the non-energy benefits (NEBs) recognized by participants. These results augment the usual evaluation studies, and provide insights that can guide informational, outreach, and training programs to maximize their effectiveness. The attribution and NEB results provide a fuller picture of the benefits from the program, support more sophisticated benefit-cost analysis, provide direction for maximizing program 'bang for the buck', and help support program decision-making and marketing.

Evaluation of a complementary cyber education program for a pathophysiology class.

Science.gov (United States)

Yoo, Ji-Soo; Ryue, Sook-Hee; Lee, Jung Eun; Ahn, Jeong-Ah

2009-12-01

The goal of this study was to develop and evaluate a complementary cyber education program for a required pathophysiology class for nursing students. The cyber education program comprised electronic bulletin boards, correspondence material storage, an announcement section, a report submission section, reference sites, and statistics on learning rates. Twelve online lectures complemented five lectures in the classroom. To evaluate the course's educational effectiveness, we performed an online objective questionnaire and an open questionnaire survey anonymously, and compared the complementary cyber education program with traditional classroom education. The complementary cyber education program effected significant improvements in scores for importance with regard to major, clarity of goals and education plans for courses, professor readiness, preciseness and description of lectures, amount and efficiency of assignments, and fairness in appraisal standards compared with the traditional classroom education group. This study indicates that a complementary cyber education program provides nursing students with the flexibility of time and space, the newest information through updated lectures, efficient motivational aids through intimacy between the lecturer and students, and concrete and meaningful tasks. The complementary cyber education course also increased student effort toward studying and student satisfaction with the class.

Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review.

Science.gov (United States)

Nicoll, Pam; MacRury, Sandra; van Woerden, Hugo C; Smyth, Keith

2018-04-11

Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner

Evaluation of medical education virtual program: P3 model

Directory of Open Access Journals (Sweden)

RITA REZAEE

2016-10-01

Full Text Available Introduction: In e-learning, people get involved in a process and create the content (product and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76, but they declared technical support as the less desirable part (1.17±1.23. Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

A Cost-Effectiveness Evaluation Approach to Improving Resource Allocations for School Systems. Administering for Change Program. A Professional Paper.

Science.gov (United States)

Temkin, Sanford

This dissertation begins with a description of some methods employed in making public-sector resource-allocation decisions, with conclusions on the appropriateness of each method for evaluating the ongoing programs of a school system. The second section has been rewritten and published as "A Comprehensive Theory of Cost-Effectiveness" (EA 002…

An evaluation of an aggression management training program to cope with workplace violence in the healthcare sector

NARCIS (Netherlands)

J.K. Oostrom (Janneke); H. van Mierlo (Heleen)

2008-01-01

textabstractWorkplace violence is a major occupational hazard for healthcare workers, generating a need for effective intervention programs. The purpose of this study was to evaluate the effectiveness of an aggression management training program. The evaluation design was based on the internal

Economic effectiveness of disease management programs: a meta-analysis.

Science.gov (United States)

Krause, David S

2005-04-01

The economic effectiveness of disease management programs, which are designed to improve the clinical and economic outcomes for chronically ill individuals, has been evaluated extensively. A literature search was performed with MEDLINE and other published sources for the period covering January 1995 to September 2003. The search was limited to empirical articles that measured the direct economic outcomes for asthma, diabetes, and heart disease management programs. Of the 360 articles and presentations evaluated, only 67 met the selection criteria for meta-analysis, which included 32,041 subjects. Although some studies contained multiple measurements of direct economic outcomes, only one average effect size per study was included in the meta-analysis. Based on the studies included in the research, a meta-analysis provided a statistically significant answer to the question of whether disease management programs are economically effective. The magnitude of the observed average effect size for equally weighted studies was 0.311 (95% CI = 0.272-0.350). Statistically significant differences of effect sizes by study design, disease type and intensity of disease management program interventions were not found after a moderating variable, disease severity, was taken into consideration. The results suggest that disease management programs are more effective economically with severely ill enrollees and that chronic disease program interventions are most effective when coordinated with the overall level of disease severity. The findings can be generalized, which may assist health care policy makers and practitioners in addressing the issue of providing economically effective care for the growing number of individuals with chronic illness.

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Shifting the evaluative gaze: Community-based program evaluation in the homeless sector

Directory of Open Access Journals (Sweden)

Bruce Wallace

2015-09-01

Full Text Available Homelessness is a growing social issue that is a consequence of structural inequities and contributor to the development of health inequities. Community-based research (CBR has been proposed as an effective research strategy for addressing health equities and promoting social justice through participatory processes. The purpose of this article is to examine the application of CBR principles and practices in the homeless sector and the implications for the production of knowledge and social change to address homelessness. Drawing on our experiences as researchers and service providers, we reflect on the significant successes and challenges associated with using CBR in the homelessness sector. In our discussion we emphasise insights, challenges and lessons learned from a community-university partnership that focused on an evaluation of a transitional shelter program in a large urban centre where housing is expensive and often unavailable. Keywords: Homelessness, housing, transitional housing, transitional shelter, program evaluation, community-based research

Teaching-skills training programs for family medicine residents: systematic review of formats, content, and effects of existing programs.

Science.gov (United States)

Lacasse, Miriam; Ratnapalan, Savithiri

2009-09-01

To review the literature on teaching-skills training programs for family medicine residents and to identify formats and content of these programs and their effects. Ovid MEDLINE (1950 to mid-July 2008) and the Education Resources Information Center database (pre-1966 to mid-July 2008) were searched using and combining the MeSH terms teaching, internship and residency, and family practice; and teaching, graduate medical education, and family practice. The initial MEDLINE and Education Resources Information Center database searches identified 362 and 33 references, respectively. Titles and abstracts were reviewed and studies were included if they described the format or content of a teaching-skills program or if they were primary studies of the effects of a teaching-skills program for family medicine residents or family medicine and other specialty trainees. The bibliographies of those articles were reviewed for unidentified studies. A total of 8 articles were identified for systematic review. Selection was limited to articles published in English. Teaching-skills training programs for family medicine residents vary from half-day curricula to a few months of training. Their content includes leadership skills, effective clinical teaching skills, technical teaching skills, as well as feedback and evaluation skills. Evaluations mainly assessed the programs' effects on teaching behaviour, which was generally found to improve following participation in the programs. Evaluations of learner reactions and learning outcomes also suggested that the programs have positive effects. Family medicine residency training programs differ from all other residency training programs in their shorter duration, usually 2 years, and the broader scope of learning within those 2 years. Few studies on teaching-skills training, however, were designed specifically for family medicine residents. Further studies assessing the effects of teaching-skills training in family medicine residents are

Is Something Better than Nothing? An Evaluation of Early Childhood Programs in Cambodia

Science.gov (United States)

Rao, Nirmala; Sun, Jin; Pearson, Veronica; Pearson, Emma; Liu, Hongyun; Constas, Mark A.; Engle, Patrice L.

2012-01-01

This study evaluated the relative effectiveness of home-based, community-based, and state-run early childhood programs across Cambodia. A total of 880 five-year-olds (55% girls) from 6 rural provinces in Cambodia attending State Preschools, Community Preschools, Home-Based Programs, or no programs were assessed twice using the Cambodian…

The Effectiveness of Parenting Programs: A Review of Campbell Reviews

Science.gov (United States)

Barlow, Jane; Coren, Esther

2018-01-01

Parenting practices predict important outcomes for children, and parenting programs are potentially effective means of supporting parents to promote optimal outcomes for children. This review summarizes findings of systematic reviews of parenting programs published in the Campbell Library. Six reviews evaluated the effectiveness of a range of…

The Judicial Process as a Form of Program Evaluation.

Science.gov (United States)

Ellsberry, James

1980-01-01

Maintaining that the judicial process is particularly effective as a form of program evaluation, this article details organizational procedures and lists the following advantages for use of the judicial process: issues are investigated in an open forum, the community can participate, and exciting opportunities for teaching and learning are…

Evaluating the Effectiveness of School Instrumental Programs.

Science.gov (United States)

Holtz, Glenn

2001-01-01

Describes the analysis of "Strengths and Weaknesses and Opportunities and Threats" (SWOT). Discusses the study, "Gemeinhardt 4," that used the SWOT analysis to determine 13 different types of music programs. Addresses how music teachers can utilize this information. Includes other sections such as, "Possible Solution to Music Program Threats."…

Evaluation of the BEAM--BEAM effect in PEP using Myer's simulation program

International Nuclear Information System (INIS)

Hutton, A.

1982-09-01

The program BEAM BEAM written by Steve Myers for the LEP machine at CERN has given encouraging results in the simulation of the beam-beam effect in electron-positron storage rings. It therefore seemed worthwhile to apply the program to PEP with two main intentions. Firstly, to confirm the validity of the program by comparison with experimental data from previous PEP runs and secondly, to search for an improvement in the operating conditions of PEP. Clearly a successful prediction would also enhance the credibility of the program. The program itself has been extensively described in the literature and will not be repeated here, except for some comments of direct relevance to the present simulation. 14 refs., 15 figs., 4 tabs

Sustained employability of workers in a production environment: design of a stepped wedge trial to evaluate effectiveness and cost-benefit of the POSE program.

Science.gov (United States)

van Holland, Berry J; de Boer, Michiel R; Brouwer, Sandra; Soer, Remko; Reneman, Michiel F

2012-11-20

Sustained employability and health are generating awareness of employers in an aging and more complex work force. To meet these needs, employers may offer their employees health surveillance programs, to increase opportunities to work on health and sustained employability. However, evidence for these health surveillance programs is lacking. The FLESH study (Functional Labour Evaluation for Sustained Health and employment) was developed to evaluate a comprehensive workers' health promotion program on its effectiveness, cost-benefit, and process of the intervention. The study is designed as a cluster randomised stepped wedge trial with randomisation at company plant level and is carried out in a large meat processing company. Every contracted employee is offered the opportunity to participate in the POSE program (Promotion Of Sustained Employability). The main goals of the POSE program are 1) providing employee's insight into their current employability and health status, 2) offering opportunities to improve employability and decrease health risks and 3) improving employability and health sustainably in order to keep them healthy at work. The program consists of a broad assessment followed by a counselling session and, if needed, a tailored intervention. Measurements will be performed at baseline and will be followed up at 20, 40, 60, 80, 106 and 132 weeks. The primary outcome measures are work ability, productivity and absenteeism. Secondary outcomes include health status, vitality, and psychosocial workload. A cost-benefit study will be conducted from the employers' perspective. A process evaluation will be conducted and the satisfaction of employer and employees with the program will be assessed. This study provides information on the effectiveness of the POSE program on sustained employment. When the program proves to be effective, employees benefit by improved work ability, and health. Employers benefit from healthier employees, reduced sick leave (costs) and

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

Materials balance area Custodian Performance Evaluation Program at PNL

International Nuclear Information System (INIS)

Dickman, D.A.

1991-07-01

The material balance area (MBA) custodian has primary responsibility for control and accountability of nuclear material within an MBA. In this role, the custodian operates as an extension of the facility material control and accountability (MC ampersand A) organization. To effectively meet administrative requirements and protection needs, the custodian must be fully trained in all aspects of MC ampersand A related to the MBA, and custodian performance must be periodically evaluated. DOE Policy requires that each facility provide for a program which assures that each facility provide for a program which assures that personnel performing MC ampersand A functions are (1) trained and/or qualified to perform their duties and responsibilities and (2) knowledgeable of requirements and procedures related to their functions. The MBA Custodian Performance Evaluation Program at PNL uses a variety of assessment techniques to meet this goal, including internal and independent MBA audits, periodic custodian testing, conduct of limited scope performance tests, daily monitoring of MC ampersand A documentation, and reviewing custodian performance during physical inventories. The data collected from these sources is analyzed and incorporated into an annual custodian performance evaluation document, given to each custodian and line management. Development of this program has resulted in significantly improved custodian performance and a marked decrease in finding and observations identified during MBA audits

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

Science.gov (United States)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Evaluation of an online continuing education program from the perspective of new graduate nurses.

Science.gov (United States)

Karaman, Selcuk; Kucuk, Sevda; Aydemir, Melike

2014-05-01

The aim of this study is to evaluate the online continuing education program from the perspectives of new graduate nurses. An evaluation framework includes five factors (program and course structure, course materials, technology, support services and assessment). In this study, descriptive research methods were used. Participants of the study included 2.365 registered nurses enrolled in the first online nursing bachelor completion degree program in the country. Data were collected by survey. The findings indicated that students were mostly satisfied with this program. The results of this study suggest that well designed asynchronous online education methods can be effective and appropriate for registered nurses. However, the provision of effective support and technological infrastructure is as vital as the quality of teaching for online learners. © 2013.

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Monitoring and evaluation of green public procurement programs

Energy Technology Data Exchange (ETDEWEB)

Adell, Aure [Ecoinstitut, Barcelona (Spain); Schaefer, Bettina [Ecoinstitut, Barcelona (Spain); Ravi, Kavita [US Department of Energy, Washington, DC (United States); Corry, Jenny [Collaborative Labeling and Appliance Standards Program (United States)

2013-10-15

Effective procurement policies can help governments save considerable amounts of money while also reducing energy consumption. Additionally, private sector companies which purchase large numbers of energy-consuming devices can benefit from procurement policies that minimize life-cycle energy costs. Both public and private procurement programs offer opportunities to generate market-transforming demand for energy efficient appliances and lighting fixtures. In recent years, several governments have implemented policies to procure energy efficient products and services. When deploying these policies, efforts have focused on developing resources for implementation (guidelines, energy efficiency specifications for tenders, life cycle costing tools, training, etc.) rather than defining monitoring systems to track progress against the set objectives. Implementation resources are necessary to make effective policies; however, developing Monitoring and Evaluation (M and E) mechanisms are critical to ensure that the policies are effective. The purpose of this article is to provide policy makers and procurement officials with a preliminary map of existing approaches and key components to monitor Energy Efficient Procurement (EEP) programs in order to contribute to the improvement of their own systems. Case studies are used throughout the paper to illustrate promising approaches to improve the M and E of EEP programs, from the definition of the system or data collection to complementary instruments to improve both the monitoring response and program results.

Identifying potentially cost effective chronic care programs for people with COPD

NARCIS (Netherlands)

L.M.G. Steuten (Lotte); K.M.M. Lemmens (Karin); A.P. Nieboer (Anna); H.J.M. Vrijhoef (Hubertus)

2009-01-01

textabstractObjective: To review published evidence regarding the cost effectiveness of multi-component COPD programs and to illustrate how potentially cost effective programs can be identified. Methods: Systematic search of Medline and Cochrane databases for evaluations of multicomponent disease

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations.

Science.gov (United States)

Wasserman, Deborah L

2010-05-01

This paper offers a framework for using a systems orientation and "foundational theory" to enhance theory-driven evaluations and logic models. The framework guides the process of identifying and explaining operative relationships and perspectives within human service program systems. Self-Determination Theory exemplifies how a foundational theory can be used to support the framework in a wide range of program evaluations. Two examples illustrate how applications of the framework have improved the evaluators' abilities to observe and explain program effect. In both exemplars improvements involved addressing and organizing into a single logic model heretofore seemingly disparate evaluation issues regarding valuing (by whose values); the role of organizational and program context; and evaluation anxiety and utilization. Copyright 2009 Elsevier Ltd. All rights reserved.

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Evaluation of a Positive Youth Development Program Based on the Repertory Grid Test

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2012-01-01

Full Text Available The repertory grid test, based on personal construct psychology, was used to evaluate the effectiveness of Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes in Hong Kong. One hundred and four program participants (n=104 were randomly invited to complete a repertory grid based on personal construct theory in order to provide both quantitative and qualitative data for measuring self-identity changes after joining the program. Findings generally showed that the participants perceived that they understood themselves better and had stronger resilience after joining the program. Participants also saw themselves as closer to their ideal selves and other positive role figures (but farther away from a loser after joining the program. This study provides additional support for the effectiveness of the Tier 1 Program of Project P.A.T.H.S. in the Chinese context. This study also shows that the repertory grid test is a useful evaluation method to measure self-identity changes in participants in positive youth development programs.

Evaluation of a program to enhance young drivers' safety in Israel.

Science.gov (United States)

Toledo, Tomer; Lotan, Tsippy; Taubman-Ben-Ari, Orit; Grimberg, Einat

2012-03-01

Young drivers in Israel, as in other parts of the world, are involved in car crashes more than any other age group. The graduated driver licensing system in Israel requires that all new drivers be accompanied by an experienced driver whenever they drive for the first 3 months after obtaining a driving license. In an effort to make the accompanied driving phase more effective, a novel program which targets both young drivers and their parents was initiated in 2005. The program administers a personal meeting with the young driver and the accompanying parent scheduled for the beginning of the accompanied driving phase. In this meeting guidance is given regarding best practices for undertaking the accompanied driving, as well as tips for dealing with in-vehicle parent-teen dynamics. Through 2008, almost 130,000 families of young drivers have participated in the program. In order to evaluate the effectiveness of the program, injury crash records of the young drivers who participated in the program were compared with those of all other young drivers that were licensed at the same time period. The results obtained indicate statistically significant lower crash records for young drivers that participated in the program. Limitations of the evaluation related to self-selection biases are discussed, and practical implications are suggested. Copyright © 2011 Elsevier Ltd. All rights reserved.

Findings from the Evaluation of OJJDP's Gang Reduction Program. Juvenile Justice Bulletin

Science.gov (United States)

Cahill, Meagan; Hayeslip, David

2010-01-01

This bulletin draws on findings from an independent evaluation, conducted by the Urban Institute, of the Gang Reduction Program's (GRP) Impact in Los Angeles, California; Milwaukee, Wisconsin; North Miami Beach, Florida; and Richmond, Virginia, to examine how effectively these sites implemented the program. Following are some of the authors' key…

Development of Program Evaluating the Effects on the Secondary Side of Steam Generator due to Foreign Objects

International Nuclear Information System (INIS)

Ju, Yoo Hyun; Nam, Choi Sung

2005-01-01

When materials such as metal are into the secondary side of steam generator, they, so called foreign objects, may have influences on the integrity of the steam generator tubes. They cause the tube wear due to the relative motion between the tubes and foreign objects and the tube impact due to flow. The best way to avoid the effects is to remove all the foreign objects. However, it is not easy to remove the foreign materials thoroughly due to their condition such as the location. If the locations of the foreign materials are in the middle of tube bundle and the tube arrangement of the steam generator is the triangle type, the equipment such as FOSAR(Foreign Object Search and Retrieval) can not reach their locations. If the foreign materials stick together with the tubes or tube sheet, they can not be removed. In the case of operating the steam generator with the foreign materials, the licensee must prove that the materials do not affect the tube integrity and do not threaten the pressure boundary with the analytical method. Considering the wear and impact by the foreign materials, KEPRI(Korea Electric Power Research Institute) developed the methodology to evaluate the foreign materials analytically. This methodology was described with a computer program in order to obtain the fast results. The program informs whether the tubes have the structural integrity when the foreign material strikes the tubes. Moreover, this gives us the remaining life of the steam generator tubes. In this paper, the program, which evaluates the effects of the foreign objects in the secondary side of steam generator, is introduced

Evaluation of a preschool nutrition education program based on the theory of multiple intelligences.

Science.gov (United States)

Cason, K L

2001-01-01

This report describes the evaluation of a preschool nutrition education program based on the theory of multiple intelligences. Forty-six nutrition educators provided a series of 12 lessons to 6102 preschool-age children. The program was evaluated using a pretest/post-test design to assess differences in fruit and vegetable identification, healthy snack choices, willingness to taste foods, and eating behaviors. Subjects showed significant improvement in food identification and recognition, healthy snack identification, willingness to taste foods, and frequency of fruit, vegetable, meat, and dairy consumption. The evaluation indicates that the program was an effective approach for educating preschool children about nutrition.

Effective Programming

DEFF Research Database (Denmark)

Frost, Jacob

To investigate the use of VTLoE as a basis for formal derivation of functional programs with effects. As a part of the process, a number of issues central to effective formal programming are considered. In particular it is considered how to develop a proof system suitable for pratical reasoning......, how to implement this system in the generic proof assistant Isabelle and finally how to apply the logic and the implementation to programming....

An Interactive Web-Based Program for Stepfamilies: Development and Evaluation of Efficacy

Science.gov (United States)

Gelatt, Vicky A.; Adler-Baeder, Francesca; Seeley, John R.

2010-01-01

This study evaluated the efficacy of a family life education program for stepfamilies that is self-administered, interactive, and web-based. The program uses behavior-modeling videos to demonstrate effective couple, parenting, and stepparenting practices. A diverse sample of 300 parents/stepparents of a child aged 11-15 years were randomized into…

An evaluation of the Australian Rotavirus Surveillance Program.

Science.gov (United States)

Roberts-Witteveen, April R; Patel, Mahomed S; Roche, Paul W

2008-09-01

The Australian Rotavirus Serotyping Program (ARSP) serotypes rotavirus isolates obtained from stool samples sent from Australian laboratories. In collaboration with ARSP the Australian Government Department of Health and Ageing evaluated the program for its utility and capacity to monitor effectiveness of the rotavirus vaccines recently introduced into the Australian National Immunisation Program. The system was described using ARSP annual reports and staff interviews. The attributes of the system were assessed by adapting standard guidelines for evaluating a surveillance system. Email surveys or face to face interviews were conducted with staff of ARSP, participating laboratories, rotavirus vaccine manufacturing companies and representatives of the Communicable Diseases Network Australia. The ability of the ARSP to monitor changes in rotavirus serotype epidemiology was assessed. ARSP serotypes rotavirus isolates received from participating laboratories at least bi-annually, with results being reported at least as often. Serotype analyses have informed formulation of rotavirus vaccines and contributed to forecasting the extent of outbreaks caused by novel serotypes. The ARSP will be able to monitor changes in rotavirus serotype epidemiology and identify probable vaccination failures. Enhancement of the representativeness and sensitivity of the system are needed for the data to remain useful in the public health context. Methods for transferring data between the program and state and territory health departments need to be developed.

Multifaceted academic detailing program to increase pharmacotherapy for alcohol use disorder: interrupted time series evaluation of effectiveness.

Science.gov (United States)

Harris, Alex H S; Bowe, Thomas; Hagedorn, Hildi; Nevedal, Andrea; Finlay, Andrea K; Gidwani, Risha; Rosen, Craig; Kay, Chad; Christopher, Melissa

2016-09-15

Active consideration of effective medications to treat alcohol use disorder (AUD) is a consensus standard of care, yet knowledge and use of these medications are very low across diverse settings. This study evaluated the overall effectiveness a multifaceted academic detailing program to address this persistent quality problem in the US Veterans Health Administration (VHA), as well as the context and process factors that explained variation in effectiveness across sites. An interrupted time series design, analyzed with mixed-effects segmented logistic regression, was used to evaluate changes in level and rate of change in the monthly percent of patients with a clinically documented AUD who received naltrexone, acamprosate, disulfiram, or topiramate. Using data from a 20 month post-implementation period, intervention sites (n = 37) were compared to their own 16 month pre-implementation performance and separately to the rest of VHA. From immediately pre-intervention to the end of the observation period, the percent of patients in the intervention sites with AUD who received medication increased over 3.4 % in absolute terms and 68 % in relative terms (i.e., 4.9-8.3 %). This change was significant compared to the pre-implementation period in the intervention sites and secular trends in control sites. Sites with lower pre-implementation adoption, more person hours of detailing, but fewer people detailed, had larger immediate increases in medication receipt after implementation. The average number of detailing encounters per person was associated with steeper increases in slope over time. This study found empirical support for a multifaceted quality improvement strategy aimed at increasing access to and utilization of pharmacotherapy for AUD. Future studies should focus on determining how to enhance the programs effects, especially in non-responsive locations.

Evaluating Value Chain Development Programs: Assessing Effectiveness, Efficiency, and Equity Effects of Contract Choice

NARCIS (Netherlands)

Ruben, R.

2015-01-01

Provides insights regarding the possible procedures for assessing welfare, efficiency, and equity effects of value chain development (VCD) programs, taking advantage of available analytical tools derived from impact analysis, transaction cost theory, and contract choice approaches and briefly

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

77 FR 72435 - Pipeline Safety: Using Meaningful Metrics in Conducting Integrity Management Program Evaluations

Science.gov (United States)

2012-12-05

... effectiveness of their integrity management programs. Program evaluation is one of the key required program... activities that are in place to control risk. These measures indicate how well an operator is implementing... outcome is being achieved or not, despite the risk control activities in place. Failure Measures that...

Advanced gas cooled nuclear reactor materials evaluation and development program

International Nuclear Information System (INIS)

1977-01-01

Results of work performed from January 1, 1977 through March 31, 1977 on the Advanced Gas Cooled Nuclear Reactor Materials Evaluation and Development Program are presented. The objectives of this program are to evaluate candidate alloys for Very High Temperature Reactor (VHTR) Process Heat and Direct Cycle Helium Turbine (DCHT) applications, in terms of the effect of simulated reactor primary coolant (impure Helium), high temperatures, and long time exposures, on the mechanical properties and structural and surface stability of selected candidate alloys. A second objective is to select and recommend materials for future test facilities and more extensive qualification programs. Work covered in this report includes progress to date on alloy selection for VHTR Nuclear Process Heat (NPH) applications and for DCHT applications. The present status on the simulated reactor helium loop design and on designs for the testing and analysis facilities and equipment is discussed

Understanding Effective Higher Education Programs in Prisons: Considerations from the Incarcerated Individuals Program in North Carolina

Science.gov (United States)

Anders, Allison Daniel; Noblit, George W.

2011-01-01

The North Carolina Workplace and Community Transition Youth Offender Program (YOP), recently renamed the Incarcerated Individuals Program (IPP), has proven to be effective in terms of its growth and expansion, the support of education directors across the correctional facilities, university collaboration, student evaluations, and a low recidivism…

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Participatory Evaluation and Learning: A Case Example Involving Ripple Effects Mapping of a Tourism Assessment Program

Science.gov (United States)

Bhattacharyya, Rani; Templin, Elizabeth; Messer, Cynthia; Chazdon, Scott

2017-01-01

Engaging communities through research-based participatory evaluation and learning methods can be rewarding for both a community and Extension. A case study of a community tourism development program evaluation shows how participatory evaluation and learning can be mutually reinforcing activities. Many communities value the opportunity to reflect…

Issues in assessing the cost-effectiveness of coordinated DSM programs

International Nuclear Information System (INIS)

Hill, L.J.; Brown, M.A.

1995-01-01

Coordinated demand-side management (DSM) programs, co-administered by government agencies and electric and gas utilities, are likely to grow in importance in the coming years. Because of the unique features of these types of DSM programs, special care must be taken in assessing their cost-effectiveness. In this paper, we discuss these features, suggest how standard cost-effectiveness measures must be adapted to accommodate them, and show how important these adaptations are in assessing the cost-effectiveness of coordinated programs. At first, we use a least-cost, financial approach. The discussion indicates that failure to account properly for the special features of coordinated programs materially affects estimates of cost-effectiveness and, in extreme cases, may lead to rejection of otherwise cost-effective programs. Then extending the analysis to include economic factors, we speculate that most types of coordinated programs are more attractive than when evaluated on a financial basis. (author)

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Sustained employability of workers in a production environment: design of a stepped wedge trial to evaluate effectiveness and cost-benefit of the POSE program

Directory of Open Access Journals (Sweden)

van Holland Berry J

2012-11-01

Full Text Available Abstract Background Sustained employability and health are generating awareness of employers in an aging and more complex work force. To meet these needs, employers may offer their employees health surveillance programs, to increase opportunities to work on health and sustained employability. However, evidence for these health surveillance programs is lacking. The FLESH study (Functional Labour Evaluation for Sustained Health and employment was developed to evaluate a comprehensive workers’ health promotion program on its effectiveness, cost-benefit, and process of the intervention. Methods The study is designed as a cluster randomised stepped wedge trial with randomisation at company plant level and is carried out in a large meat processing company. Every contracted employee is offered the opportunity to participate in the POSE program (Promotion Of Sustained Employability. The main goals of the POSE program are 1 providing employee’s insight into their current employability and health status, 2 offering opportunities to improve employability and decrease health risks and 3 improving employability and health sustainably in order to keep them healthy at work. The program consists of a broad assessment followed by a counselling session and, if needed, a tailored intervention. Measurements will be performed at baseline and will be followed up at 20, 40, 60, 80, 106 and 132 weeks. The primary outcome measures are work ability, productivity and absenteeism. Secondary outcomes include health status, vitality, and psychosocial workload. A cost-benefit study will be conducted from the employers’ perspective. A process evaluation will be conducted and the satisfaction of employer and employees with the program will be assessed. Discussion This study provides information on the effectiveness of the POSE program on sustained employment. When the program proves to be effective, employees benefit by improved work ability, and health. Employers benefit

Evaluation of the Pilot Mentoring Program at the Research Foundation for SUNY

Science.gov (United States)

Henderson-Harr, Amy; Caggiano-Siino, Kathleen; Prewitt, Ashlee

2016-01-01

This article provides a description of an 18-month pilot program focused on the leadership development of the next generation of research administrators (RAs) in the State University of New York system (SUNY). The key questions for the evaluators were: 1) can we create a developmental program that effectively prepares the next generation of RAs;…

The Danish national return-to-work program - aims, content, and design of the process and effect evaluation

NARCIS (Netherlands)

Aust, Birgit; Helverskov, Trine; Nielsen, Maj Britt D.; Bjorner, Jakob Bue; Rugulies, Reiner; Nielsen, Karina; Sorensen, Ole H.; Grundtvig, Gry; Andersen, Malene F.; Hansen, Jorgen V.; Buchardt, Helle L.; Nielsen, Lisbeth; Lund, Trine L.; Andersen, Irene; Andersen, Mogens H.; Clausen, Aksel S.; Heinesen, Eskil; Mortensen, Ole S.; Ektor-Andersen, John; Orbaek, Palle; Winzor, Glen; Bultmann, Ute; Poulsen, Otto M.

The Danish national return-to-work (RTW) program aims to improve the management of municipal sickness benefit in Denmark. A study is currently ongoing to evaluate the RTW program. The purpose of this article is to describe the study protocol. The program includes 21 municipalities encompassing

Building capacity for change: evaluation of an organisation-wide leadership development program.

Science.gov (United States)

Schultz, Tim; Shoobridge, Jodie; Harvey, Gill; Carter, Libby; Kitson, Alison

2018-05-23

Objective. This study evaluated Leading 4 Change, a change leadership development program designed to support healthcare middle managers through a period of significant organisational change and enhance workplace resilience. Methods. A mixed methods evaluation was conducted within the program's framework of a quality improvement activity. Quantitative measures were participant responses (n=160) to online questionnaires, which were compared before and after the program, using an uncontrolled pre-post study design. Four questionnaires were used: Resilience @ Work, General Self-Efficacy, the 11-item Learning Organization Survey and organisational climate. Differences between the pre- and post-program periods were compared using linear mixed-effects models, incorporating repeated measures between 'pre' and 'post' periods. Qualitative data were obtained by interviewing four participants on three occasions during the program, and through text responses provided by participants during a presentation session after the program finished. Both interview data and textual data were subjected to thematic analysis. Results. Integration of data from quantitative and qualitative analyses generated three main findings: (1) participants were satisfied and engaged with the program, which met their learning objectives; (2) the program led to increased workplace resilience, in particular the ability to manage stress and self-efficacy for individuals; and (3) organisational learning perceptions were unchanged. Conclusion. Although conducted during a period of intense internal and external pressure, Leading 4 Change led to demonstrable effects. It effectively engaged middle managers across a health system. However, there was no evidence that the effect of the program extended beyond individual participants to their perceptions of their work environment as a learning organisation. What is known about the topic? Although much has been written about change management and change leadership

SKB's program for societal research 2004-2011. An evaluation

International Nuclear Information System (INIS)

Soederberg, Olof

2012-04-01

This evaluation of the program of societal research that SKB conducted the years 2004-2011 has been performed on behalf of Swedish Nuclear Fuel and Waste Management Company (SKB). The review has focused on answers to a series of questions as follows: General questions - Why was a program started? - What was SKB's purpose with the program? - Does the result mean that the objective has been achieved? - Has the program had effects (positive or negative) that were not anticipated when the purpose was formulated? - Strengths and weaknesses of the program? Questions about the implementation - How did announcement and selection procedures work? - Which forms were used for reporting results from the research projects? Questions about the continued investment in societal research - Are there such needs? - In that case, is it in SKB's interest to contribute financially to such research? - What forms might be appropriate if SKB sees interest to contribute financially to such research?

Curriculum Evaluation and Employers Opinions: the case study of Educational Technology Program in Bachelor Degree (Continuing Program

Directory of Open Access Journals (Sweden)

Nakhon Lalognam

2016-09-01

to circular of evaluation of the curriculum. During of using the program, the committee and instructors of Bachelor of Education Program in Educational Technology (Continuing Program should have conference together, show output of evaluation of instructors and learners and analyze information of evaluation for awareness to problems and solving problems, improve and effectively management. 4.4 Product Evaluation Aspect: should be enhanced to provide opportunities for students to practice real-world experience to the agencies or workplace by doing a collaboration project between department of Educational Technology and the agencies or workplace for opportunities of students to practice directed experience, to stimulate thinking and encourage students to express ideas or new ideas. During the study should focus on activities to teach students to practice presenting new ideas to other people to understand as easy and interesting.

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

Learning from internships in gerontology and geriatrics: assessment and program evaluation.

Science.gov (United States)

Karasik, Rona J

2009-01-01

Internships are an essential component of gerontological education. Harvesting the learning from internships, however, requires careful attention to assessing an intern's work. In addition to providing feedback to students, internship assessment can also yield data useful for academic program evaluation. Drawing on internship assessment data collected from undergraduate and graduate gerontology interns and their community preceptors over a period of seven semesters, this article explores (1) concerns regarding how to assess what interns are learning, (2) ways to provide students with additional opportunities for learning from their internships, and (3) how information from these student-learning outcomes may be used to evaluate the effectiveness of the overall academic program.

Developing medical educators - a mixed method evaluation of a teaching education program.

Science.gov (United States)

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

Background It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) 'Reaction' on a professional and emotional level using standardized questionnaires; 2) 'Learning' applying a multiple choice test; 3) 'Behavior' by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) 'Results' from student evaluations. Results Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (Pteaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students' evaluations. Conclusions Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

Developing medical educators--a mixed method evaluation of a teaching education program.

Science.gov (United States)

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) 'Reaction' on a professional and emotional level using standardized questionnaires; 2) 'Learning' applying a multiple choice test; 3) 'Behavior' by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) 'Results' from student evaluations. Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (Pteaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students' evaluations. Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

Strongwomen® Program Evaluation: Effect of Strength Training Exercises on Physical Fitness of Participants

Science.gov (United States)

Chaudhary, Anil Kumar; Van Horn, Beth; Corbin, Marilyn

2015-01-01

The Strongwomen® Program (SWP) is a nationally disseminated group strength-training exercise and nutrition education program delivered by Extension. The study reported here examined the effect of strength training exercises in SWP on improvement in physical fitness of program participants. Senior Fitness Test was used to collect data. Upon…

Using a Mixed-Methods RE-AIM Framework to Evaluate Community Health Programs for Older Latinas.

Science.gov (United States)

Schwingel, Andiara; Gálvez, Patricia; Linares, Deborah; Sebastião, Emerson

2017-06-01

This study used the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework to evaluate a promotora-led community health program designed for Latinas ages 50 and older that sought to improve physical activity, nutrition, and stress management. A mixed-methods evaluation approach was administered at participant and organizational levels with a focus on the efficacy, adoption, implementation, and maintenance components of the RE-AIM theoretical model. The program was shown to be effective at improving participants' eating behaviors, increasing their physical activity levels, and lowering their depressive symptoms. Promotoras felt motivated and sufficiently prepared to deliver the program. Some implementation challenges were reported. More child care opportunities and an increased focus on mental well-being were suggested. The promotora delivery model has promise for program sustainability with both promotoras and participants alike expressing interest in leading future programs.

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

Science.gov (United States)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Evaluating the Effects of Child Savings Accounts Program Participation on Parental Well-Being

Science.gov (United States)

Okech, David

2012-01-01

Objectives: Using baseline and second wave data, the study evaluated the impact of child savings accounts participation on parenting stress, personal mastery, and economic strain with N = 381 lower income parents who decided to join and those who did not join in a child development savings account program. Methods: Structural equation modeling for…

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Using student satisfaction data to evaluate a new online accelerated nursing education program.

Science.gov (United States)

Gazza, Elizabeth A; Matthias, April

2016-10-01

As increasing numbers of students enroll in online education, institutions of higher education are responsible for delivering quality online courses and programs. Agencies that accredit institutions and programs require evidence of program quality, including student satisfaction. A large state university in the Southeastern United States transitioned an online nursing education degree completion, or Registered Nurse-to-Bachelor of Science in Nursing, program to an online accelerated format in order to meet the needs of working nurses and ultimately, increase the number of nurses prepared at the baccalaureate level. This article describes a descriptive, cross-sectional study that evaluated the effectiveness of the new online accelerated program using the quality indicator of student satisfaction. Ninety-one (32%) of the 284 students who were enrolled or had been enrolled in a course within the online accelerated degree completion program between fall 2013 session 1 and summer 2014 session participated in the study. The electronic Noel-Levitz Priorities Survey for Online Learners™ was used to measure student satisfaction with the program and associated services. Results provided insight into the students' satisfaction with the new program format and served as the basis for an interdepartmental program enhancement plan aimed at maintaining and enhancing student satisfaction and overall program quality. Findings indicated that measuring and evaluating student satisfaction can provide valuable information about the effectiveness of an online program. Recommendations for using the measurement tool in online program planning and studying student satisfaction in relation to retention and program completion were identified. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Effective flow-accelerated corrosion programs in nuclear facilities

International Nuclear Information System (INIS)

Esselman, Thomas C.; McBrine, William J.

2004-01-01

Piping Flow-Accelerated Corrosion Programs in nuclear power generation facilities are classically comprised of the selection of inspection locations with the assistance of a predictive methodology such as the Electric Power Research Institute computer codes CHECMATE or CHECWORKS, performing inspections, conducting structural evaluations on the inspected components, and implementing the appropriate sample expansion and corrective actions. Performing such a sequence of steps can be effective in identifying thinned components and implementing appropriate short term and long term actions necessary to resolve flow-accelerated corrosion related problems. A maximally effective flow-accelerated corrosion (FAC) program requires an understanding of many programmatic details. These include the procedural control of the program, effective use of historical information, managing the activities performed during a limited duration outage, allocating resources based on risk allocation, having an acute awareness of how the plant is operated, investigating components removed from the plant, and several others. This paper will describe such details and methods that will lead to a flow-accelerated corrosion program that effectively minimizes the risk of failure due to flow-accelerated corrosion and provide full and complete documentation of the program. (author)

A testing program to evaluate the effects of simulant mixed wastes on plastic transportation packaging components

International Nuclear Information System (INIS)

Nigrey, P.J.; Dickens, T.G.

1997-01-01

Based on regulatory requirements for Type A and B radioactive material packaging, a Testing Program was developed to evaluate the effects of mixed wastes on plastic materials which could be used as liners and seals in transportation containers. The plastics evaluated in this program were butadiene-acrylonitrile copolymer (Nitrile rubber), cross-linked polyethylene, epichlorohydrin, ethylene-propylene rubber (EPDM), fluorocarbons, high-density polyethylene (HDPE), butyl rubber, polypropylene, polytetrafluoroethylene, and styrene-butadiene rubber (SBR). These plastics were first screened in four simulant mixed wastes. The liner materials were screened using specific gravity measurements and seal materials by vapor transport rate (VTR) measurements. For the screening of liner materials, Kel-F, HDPE, and XLPE were found to offer the greatest resistance to the combination of radiation and chemicals. The tests also indicated that while all seal materials passed exposure to the aqueous simulant mixed waste, EPDM and SBR had the lowest VTRs. In the chlorinated hydrocarbon simulant mixed waste, only Viton passed the screening tests. In both the simulant scintillation fluid mixed waste and the ketone mixture waste, none of the seal materials met the screening criteria. Those materials which passed the screening tests were subjected to further comprehensive testing in each of the simulant wastes. The materials were exposed to four different radiation doses followed by exposure to a simulant mixed waste at three temperatures and four different exposure times (7, 14, 28, 180 days). Materials were tested by measuring specific gravity, dimensional, hardness, stress cracking, VTR, compression set, and tensile properties. The second phase of this Testing Program involving the comprehensive testing of plastic liner has been completed and for seal materials is currently in progress

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

A leadership development program for surgeons: First-year participant evaluation.

Science.gov (United States)

Pradarelli, Jason C; Jaffe, Gregory A; Lemak, Christy Harris; Mulholland, Michael W; Dimick, Justin B

2016-08-01

In a dynamic health care system, strong leadership has never been more important for surgeons. Little is known about how to design and conduct effectively a leadership program specifically for surgeons. We sought to evaluate critically a Leadership Development Program for practicing surgeons by exploring how the program's strengths and weaknesses affected the surgeons' development as physician-leaders. At a large academic institution, we conducted semistructured interviews with 21 surgical faculty members who applied voluntarily, were selected, and completed a newly created Leadership Development Program in December 2012. Interview transcripts underwent qualitative descriptive analysis with thematic coding based on grounded theory. Themes were extracted regarding surgeons' evaluations of the program on their development as physician-leaders. After completing the program, surgeons reported personal improvements in the following 4 areas: self-empowerment to lead, self-awareness, team-building skills, and knowledge in business and leadership. Surgeons felt "more confident about stepping up as a leader" and more aware of "how others view me and my interactions." They described a stronger grasp on "giving feedback" as well as a better understanding of "business/organizational issues." Overall, surgeon-participants reported positive impacts of the program on their day-to-day work activities and general career perspective as well as on their long-term career development plans. Surgeons also recommended areas where the program could potentially be improved. These interviews detailed self-reported improvements in leadership knowledge and capabilities for practicing surgeons who completed a Leadership Development Program. A curriculum designed specifically for surgeons may enable future programs to equip surgeons better for important leadership roles in a complex health care environment. Copyright © 2016 Elsevier Inc. All rights reserved.

The evaluation of the effectiveness of occupational therapy, using its different programs for the people who are experiencing shoulder impingement syndrome

OpenAIRE

Sadauskytė, Sigita

2015-01-01

S. Sadauskytė: The evaluation of the effectiveness of occupational therapy, using its different programs for the people who are experiencing shoulder impingement syndrome. A Master‘s thesis. Research supervisor is dr. E. Sendžikaitė; Institute of sports, Faculty of nursing, Medical Academy,Lithuanian University of Health Sciences, – Kaunas, 2015.

Customizing Process to Align with Purpose and Program: The 2003 MS PHD'S in Ocean Sciences Program Evaluative Case Study

Science.gov (United States)

Williamson, V. A.; Pyrtle, A. J.

2004-12-01

its vision, mission, goals and activities. In addition to the documentation of evaluative process, the case study also provides insight on the establishment of mutually supportive principal investigator and evaluator partnerships as necessary foundations for building effective teams. The study addresses frequently asked questions (FAQ's) on the formation and sustenance of partnerships among visionaries and evaluators and the impact of this partnership on the achievement of program outcomes.

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

Science.gov (United States)

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

["StigMa" - Evaluation of a Psychological Therapy Program for Stigma-Management].

Science.gov (United States)

Schenner, Manuela; Kohlbauer, Daniela; Meise, Ullrich; Haller, Christina; Pixner-Huber, Martina; Stürz, Kristina; Günther, Verena

2018-01-01

The project "Stigma Management - StigMa" aims on the evaluation of an adaptive therapy program for patients with psychiatric illness to help them in managing internalized stigma and self-stigmatization. The patients for this pilot-study were recruited in day-hospitals of pro mente tirol . 26 patients participated in 11 group sessions, following 6 modules: "Education", "Activation of Resources", "Social Network", "Self-Esteem", "Social competence in public places" and "My personal stigma management". The control group consisted of 20 patients who did not participate in StigMa. Pre-post-evaluation was done by the Internalized Stigma of Mental Illness-Scale 1. No significant interaction effects could be observed, although in the treatment group, the burden of perceived discrimination was significantly less pronounced after training than before it. The program, however, was evaluated as being extremely positive by the participants. The program StigMa will be adapted in accordance with the suggestions of the participants and reevaluated taking into consideration methodological optimization. © Georg Thieme Verlag KG Stuttgart · New York.

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

A comparative evaluation of sequence classification programs

Directory of Open Access Journals (Sweden)

Bazinet Adam L

2012-05-01

Full Text Available Abstract Background A fundamental problem in modern genomics is to taxonomically or functionally classify DNA sequence fragments derived from environmental sampling (i.e., metagenomics. Several different methods have been proposed for doing this effectively and efficiently, and many have been implemented in software. In addition to varying their basic algorithmic approach to classification, some methods screen sequence reads for ’barcoding genes’ like 16S rRNA, or various types of protein-coding genes. Due to the sheer number and complexity of methods, it can be difficult for a researcher to choose one that is well-suited for a particular analysis. Results We divided the very large number of programs that have been released in recent years for solving the sequence classification problem into three main categories based on the general algorithm they use to compare a query sequence against a database of sequences. We also evaluated the performance of the leading programs in each category on data sets whose taxonomic and functional composition is known. Conclusions We found significant variability in classification accuracy, precision, and resource consumption of sequence classification programs when used to analyze various metagenomics data sets. However, we observe some general trends and patterns that will be useful to researchers who use sequence classification programs.

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

An experimental evaluation of theory-based mother and mother-child programs for children of divorce.

Science.gov (United States)

Wolchik, S A; West, S G; Sandler, I N; Tein, J Y; Coatsworth, D; Lengua, L; Weiss, L; Anderson, E R; Greene, S M; Griffin, W A

2000-10-01

This study evaluated the efficacy of 2 theory-based preventive interventions for divorced families: a program for mothers and a dual component mother-child program. The mother program targeted mother-child relationship quality, discipline, interparental conflict, and the father-child relationship. The child program targeted active coping, avoidant coping, appraisals of divorce stressors, and mother-child relationship quality. Families with a 9- to 12-year-old child (N = 240) were randomly assigned to the mother, dual-component, or self-study program. Postintervention comparisons showed significant positive program effects of the mother program versus self-study condition on relationship quality, discipline, attitude toward father-child contact, and adjustment problems. For several outcomes, more positive effects occurred in families with poorer initial functioning. Program effects on externalizing problems were maintained at 6-month follow-up. A few additive effects of the dual-component program occurred for the putative mediators; none occurred for adjustment problems.

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Effectiveness and Cost-benefit Evaluation of a Comprehensive Workers' Health Surveillance Program for Sustainable Employability of Meat Processing Workers.

Science.gov (United States)

van Holland, Berry J; Reneman, Michiel F; Soer, Remko; Brouwer, Sandra; de Boer, Michiel R

2018-03-01

Objective To evaluate the effectiveness of a comprehensive workers' health surveillance (WHS) program on aspects of sustainable employability and cost-benefit. Methods A cluster randomized stepped wedge trial was performed in a Dutch meat processing company from february 2012 until march 2015. In total 305 workers participated in the trial. Outcomes were retrieved during a WHS program, by multiple questionnaires, and from company registries. Primary outcomes were sickness absence, work ability, and productivity. Secondary outcomes were health, vitality, and psychosocial workload. Data were analyzed with linear and logistic multilevel models. Cost-benefit analyses from the employer's perspective were performed as well. Results Primary outcomes sickness absence (OR = 1.40), work ability (B = -0.63) and productivity (OR = 0.71) were better in the control condition. Secondary outcomes did not or minimally differ between conditions. Of the 12 secondary outcomes, the only outcome that scored better in the experimental condition was meaning of work (B = 0.18). Controlling for confounders did not or minimally change the results. However, our stepped wedge design did not enable adjustment for confounding in the last two periods of the trial. The WHS program resulted in higher costs for the employer on the short and middle term. Conclusions Primary outcomes did not improve after program implementation and secondary outcomes remained equal after implementation. The program was not cost-beneficial after 1-3 year follow-up. Main limitation that may have contributed to absence of positive effects may be program failure, because interventions were not deployed as intended.

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

The effects of stakeholder involvement on perceptions of an evaluation's credibility.

Science.gov (United States)

Jacobson, Miriam R; Azzam, Tarek

2018-06-01

This article presents a study of the effects of stakeholder involvement on perceptions of an evaluation's credibility. Crowdsourced members of the public and a group of educational administrators read a description of a hypothetical program and two evaluations of the program: one conducted by a researcher and one conducted by program staff (i.e. program stakeholders). Study participants were randomly assigned versions of the scenario with different levels of stakeholder credibility and types of findings. Results showed that both samples perceived the researcher's evaluation findings to be more credible than the program staff's, but that this difference was significantly reduced when the program staff were described to be highly credible. The article concludes with implications for theory and research on evaluation dissemination and stakeholder involvement. Copyright © 2018 Elsevier Ltd. All rights reserved.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

Energy Technology Data Exchange (ETDEWEB)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il [Korea Atomic Energy Research Institute, Daejeon (Korea, Republic of)

2015-10-15

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

International Nuclear Information System (INIS)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il

2015-01-01

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit

Evaluating employee assistance programs. A review of methods, outcomes, and future directions.

Science.gov (United States)

Jerrell, J M; Rightmyer, J F

1982-01-01

Renewed interest in assisting troubled employees has led to an upsurge in the development of employee assistance programs, coupled with demands for demonstrable effectiveness. This review examines the nature and scope of these programs, their administrative and methodological context, and the types and outcomes of evaluation studies conducted thus far. Proposals for improving future investigations through a number of different approaches and strategies are then made.

A cross-cultural, long-term outcome evaluation of the ISTAR Comprehensive Stuttering Program across Dutch and Canadian adults who stutter.

NARCIS (Netherlands)

Langevin, M.; Huinck, W.J.; Kully, D.; Peters, H.F.M.; Lomheim, H.; Tellers, M.

2006-01-01

There is a need to evaluate the effectiveness of stuttering treatment programs delivered in domestic and international contexts and to determine if treatment delivered internationally is culturally sensitive. Evaluation of the effectiveness of the ISTAR Comprehensive Stuttering Program (CSP) within

Evaluation of a community-based falls prevention program in South Florida, 2008-2009.

Science.gov (United States)

Batra, Anamica; Melchior, Michael; Seff, Laura; Frederick, Newman; Palmer, Richard C

2012-01-01

Many older adults experience fear of falling, which may reduce participation in routine activities. A Matter of Balance (MOB) and Un Asunto de Equilibrio (ADE) workshops were offered in South Florida to reduce fear of falling and increase activity levels in older adults. The objectives of this study were to evaluate the effectiveness of the lay leader model of the programs in the first year of their implementation and to further report on participant outcome measures. We analyzed reach, adoption, and implementation data for participants who attended workshops between October 1, 2008, and December 31, 2009, who were aged 60 years or older, and who had both baseline and posttest outcome data. Workshops were in English and Spanish and consisted of 8 two-hour sessions. Participants completed a 7-item baseline and posttest questionnaire that consisted of a falls management scale, a social activity item, and modified version of Physician-Based Assessment and Counseling on Exercise. We analyzed outcome data on multiple characteristics using a general linear model. A class evaluation questionnaire measured participant satisfaction. Results for 562 participants who provided both baseline and posttest data showed significant improvement on 6 of 7 questions for MOB and all questions for ADE (P < .001). The 391 participants who provided evaluation data indicated that the programs were effective, beneficial, and well organized. Lay leaders successfully implemented the programs in community settings. The programs were effective in reducing fear of falling among older adults.

Applying Matched Sampling to Evaluate a University Tutoring Program for First-Year Students

Science.gov (United States)

Walvoord, Mark E.; Pleitz, Jacob D.

2016-01-01

Our study used a case-control matching design to assess the influence of a voluntary tutoring program in improving first-year students' Grade Point Averages (GPA). To evaluate program effectiveness, we applied case-control matching to obtain 215 pairs of students with or without participation in tutoring, but matched on high school GPA and…

The Role of Ethnographic Interviewing in Climate Change Evaluation Research: Investigating Intended and Unintended program effects

Science.gov (United States)

Lloro-Bidart, T.

2012-12-01

Ethnographic interviewing is an under-utilized tool in climate change evaluation research, even though it has the potential to serve as a powerful method of data collection. The utility of the ethnographic interview lies in its ability to elicit responses from program participants describing what a program is in practice, shedding light on both intended and unintended program impacts. Drawing on evaluation work involving a federally-funded climate change grant at the University of California, Riverside, I will discuss how to design an ethnographic interview protocol in an effort to share "best practices" with other climate change evaluators. Particular attention will be given to applying ethnographic approaches to various program types, even those differing from the one discussed. I will share some of the concrete findings from my work on this grant, to serve as examples of the kinds of data evaluators can collect when employing an ethnographic approach to interviewing. UC Riverside's climate change grant is multi-faceted, however the component studied ethnographically was a science fair mentoring program. About twenty K-12 students from high poverty, ethnically diverse schools who expressed an interest in participating in science fair were paired up with graduate student mentors to simultaneously research climate change and design authentic science fair projects to compete at various levels. Since one of the stated goals of the grant is to "stimulate…students to consider climate science as a career track through experiential education activities" I was particularly interested in how student experiences with the project might differ from school science which has historically "pushed out" ethnically diverse students like those in many of Riverside's schools. (In the program students are able to interact one-on-one with a mentor and in school settings there is typically one teacher for more than thirty students). I also sought to understand student perceptions of

Evaluation of the Effectiveness of the "Friends for Life" Program on Children’s Anxiety and Depression

Directory of Open Access Journals (Sweden)

Fatemeh Moharrari

2017-10-01

Full Text Available Introduction: Anxiety disorders and depression during childhood and adolescence are among highly prevalent serious mental health problems, which lead to reduced performance in children and can also negatively affect on children’s emotional and social long-term development.Methods: This study is a controlled clinical trial that evaluates the effectiveness of the "Friends for Life" cognitive-behavioral program in reducing the symptoms of anxiety and depression in children. In this study, 248 male students aged 10 were screened using the Revised Children’s Manifest Anxiety (RCMA and the Children’s Depression Inventory (CDI in terms of mild to moderate symptoms of anxiety and depression. Of the subjects, 40 students met the inclusion criteria.The demographic questionnaire, the Strengths and Difficulties Questionnaire (SDQ and the Depression-Anxiety-Stress Scale (DASS were filled out by parents. The children in the experimental group received the "Friends for Life" cognitive-behavioral training program for eight 1-hour weekly sessions. RCMA, CDI, SDQ, and DASS were filled out again in both groups at the end of the sessions and 3 months later.Results: Children’s depression and manifest anxiety scores before intervention were not significantly different in the two groups; however, their changes immediately after intervention and during 3 months of follow-up were significant (p<0.001. Moreover, hyperactivity (p=0.039, peer problems (p=0.011 and parental depression (p=0.015 scores significantly changed in both groups over time.Conclusions: Implementation of "Friends for Life" program is effective in prevention and treatment of the symptoms of anxiety and depression in children.

The effectiveness of tools used to evaluate successful critical decision making skills for applicants to healthcare graduate educational programs: a systematic review.

Science.gov (United States)

Benham, Brian; Hawley, Diane

2015-05-15

Students leave healthcare academic programs for a variety of reasons. When they attrite, it is disappointing for the student as well as their faculty. Advanced practice nursing and other healthcare professions require not only extensive academic preparation, but also the ability to critically evaluate patient care situations. The ability to critically evaluate a situation is not innate. Critical decision making skills are high level skills that are difficult to assess. For the purpose of this review, critical decision making and critical thinking skills refer to the same constructs and will be referred to globally as critical decision making skills. The objective of this review was to identify the effectiveness of tools used to evaluate critical decision making skills for applicants to healthcare graduate educational programs. Adult (18 years of age or older) applicants, students enrolled and/or recent graduates (within one year from completion) of healthcare graduate educational programs. Types of interventions: This review considered studies that evaluated the utilization of unique tools as well as standard tools, such as the Graduate Record Exam or grade point average, to evaluate critical decision making skills in graduate healthcare program applicants. Types of studies: Experimental and non-experimental studies were considered for inclusion. Types of outcomes: Successful quantitative evaluations based on specific field of study standards. The search strategy aimed to find both published and unpublished studies. Studies published in English after 1969 were considered for inclusion in this review. Databases that included both published and unpublished (grey) literature were searched. Additionally, reference lists from all articles retrieved were examined for articles for inclusion. Selected papers were assessed by two independent reviewers using standardized critical appraisal instruments from Joanna Briggs Institute. Any disagreement between reviewers was

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Effects of Parenting Programs on Child Maltreatment Prevention: A Meta-Analysis.

Science.gov (United States)

Chen, Mengtong; Chan, Ko Ling

2016-01-01

The objective of this study is to evaluate the effectiveness of parenting programs in reducing child maltreatment and modifying associated factors as well as to examine the moderator variables that are linked to program effects. For this meta-analysis, we searched nine electronic databases to identify randomized controlled trials published before September 2013. The effect sizes of various outcomes at different time points were computed. From the 3,578 studies identified, we selected 37 studies for further analysis. The total random effect size was 0.296. Our results showed that parenting programs successfully reduced substantiated and self-reported child maltreatment reports and reduced the potential for child maltreatment. The programs also reduced risk factors and enhanced protective factors associated with child maltreatment. However, the effects of the parenting programs on reducing parental depression and stress were limited. Parenting programs produced positive effects in low-, middle-, and high-income countries and were effective in reducing child maltreatment when applied as primary, secondary, or tertiary child maltreatment intervention. In conclusion, parenting programs are effective public health approaches to reduce child maltreatment. The evidence-based service of parenting programs could be widely adopted in future practice. © The Author(s) 2015.

Assessing the Effectiveness of a School-Based Dental Clinic on the Oral Health of Children Who Lack Access to Dental Care: A Program Evaluation

Science.gov (United States)

Carpino, Rachel; Walker, Mary P.; Liu, Ying; Simmer-Beck, Melanie

2017-01-01

This program evaluation examines the effectiveness of a school-based dental clinic. A repeated-measures design was used to longitudinally examine secondary data from participants (N = 293). Encounter intensity was developed to normalize data. Multivariate analysis of variance and Kruskal-Wallis test were used to investigate the effect of encounter…

Physical protection evaluation methodology program development and application

International Nuclear Information System (INIS)

Seo, Janghoon; Yoo, Hosik

2015-01-01

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Physical protection evaluation methodology program development and application

Energy Technology Data Exchange (ETDEWEB)

Seo, Janghoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2015-10-15

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

A 1-year follow-up evaluation of a sexual-health education program for Spanish adolescents compared with a well-established program.

Science.gov (United States)

Morales, Alexandra; Espada, José P; Orgilés, Mireia

2016-02-01

Competencies for adolescents with a healthy sexuality (COMPAS) is the only school-based sexual health promotion program in Spain that has been found to be as effective as an evidence-based intervention (¡Cuídate!) in the short term. This study's aim was to compare data from a 12-month follow-up evaluation on the effects of COMPAS on adolescents' sexual risks (knowledge, attitudes, perceived norms, sexual risk perception and intentions) and sexual behaviours (age of the first sex, consistent condom use and multiple partners) with an evidence-based intervention (¡Cuídate!) and a control group. Eighteen schools from five provinces of Spain were randomly assigned to one of three conditions: COMPAS, ¡Cuídate! and a control group. The adolescents (N = 1563; 34% attrition) were evaluated 1 week before and after the program, and 1 year post-program implementation. We found that the COMPAS program was as effective as ¡Cuídate!, the evidence-based program, in increasing the adolescents' knowledge about sexually transmitted infections and in fostering favourable attitudes about condom use and people living with HIV/AIDS. COMPAS was more effective than ¡Cuídate! in increasing the adolescents' perceptions of their peer's consistent condom use and the age delay of their first vaginal intercourse. However, it was less effective in maintaining the adolescents' intentions to use condoms and in delaying the age of their first oral sex experience. COMPAS was as effective as ¡Cuídate! in reducing sexual risk among adolescents. © The Author 2015. Published by Oxford University Press on behalf of the European Public Health Association. All rights reserved.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Multi-criteria group decision making for evaluating the performance of e-waste recycling programs under uncertainty.

Science.gov (United States)

Wibowo, Santoso; Deng, Hepu

2015-06-01

This paper presents a multi-criteria group decision making approach for effectively evaluating the performance of e-waste recycling programs under uncertainty in an organization. Intuitionistic fuzzy numbers are used for adequately representing the subjective and imprecise assessments of the decision makers in evaluating the relative importance of evaluation criteria and the performance of individual e-waste recycling programs with respect to individual criteria in a given situation. An interactive fuzzy multi-criteria decision making algorithm is developed for facilitating consensus building in a group decision making environment to ensure that all the interest of individual decision makers have been appropriately considered in evaluating alternative e-waste recycling programs with respect to their corporate sustainability performance. The developed algorithm is then incorporated into a multi-criteria decision support system for making the overall performance evaluation process effectively and simple to use. Such a multi-criteria decision making system adequately provides organizations with a proactive mechanism for incorporating the concept of corporate sustainability into their regular planning decisions and business practices. An example is presented for demonstrating the applicability of the proposed approach in evaluating the performance of e-waste recycling programs in organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Vocal problems among teachers: evaluation of a preventive voice program.

Science.gov (United States)

Bovo, Roberto; Galceran, Marta; Petruccelli, Joseph; Hatzopoulos, Stavros

2007-11-01

Vocal education programs for teachers may prevent the emergence of vocal disorders; however, only a few studies have tried to evaluate the effectiveness of these preventive programs, particularly in the long term. Two hundred and sixty-four subjects, mostly kindergarten and primary school female teachers, participated in a course on voice care, including a theoretical seminar (120 minutes) and a short voice group therapy (180 minutes, small groups of 20 subjects). For 3 months, they had to either attend the vocal ergonomics norms and, as psychological reinforcement, they had to make out a daily report of vocal abuse, or to follow the given exercises for a more efficient vocal technique, reporting on whether the time scheduled was respected or not. The effectiveness of the course was assessed in a group of 21 female teachers through a randomized controlled study. Evaluation comprehended stroboscopy, perceptual and electro-acoustical voice analysis, Voice Handicap Index, and a course benefit questionnaire. A group of 20 teachers matched for age, working years, hoarseness grade, and vocal demand served as a control group. At 3 months evaluation, participants demonstrated amelioration in the global dysphonia rates (P=0.0003), jitter (P=0.0001), shimmer (P=0.0001), MPT (P=0.0001), and VHI (P=0.0001). Twelve months after the course, the positive effects remained, although they were slightly reduced. In conclusion, a course inclusive of two lectures, a short group voice therapy, home-controlled voice exercises, and hygiene, represents a feasible and cost-effective primary prevention of voice disorders in a homogeneous and well-motivated population of teachers.

Long-term effect of social skills training program for second graders

OpenAIRE

Motiejūnaitė, Miglė; Žardeckaitė-Matulaitienė, Kristina

2017-01-01

Middle childhood is an important period for reducing social and behavioural difficulties, though existing social skills training programs in Lithuania are not effective to help solving these problems. The aim of this study was to create and evaluate the short-term and long-term effects of a social skills training program based on an integrated theoretical model for second grade schoolchildren. The purpose of the program was to teach children non-verbal language, empathy, conflict resolution, ...

Effectiveness of an intensive multidisciplinary headache treatment program.

Science.gov (United States)

Gunreben-Stempfle, Birgit; Griessinger, Norbert; Lang, Eberhard; Muehlhans, Barbara; Sittl, Reinhard; Ulrich, Kathrin

2009-07-01

To investigate if the effectiveness of a 96-hour multidisciplinary headache treatment program exceeds the effectiveness of a 20-hour program and primary care. When dealing with chronic back pain, low-intensity multidisciplinary treatment yields no significantly better results than standard care and monodisciplinary therapy; however, high-intensity treatment does. For multidisciplinary headache treatment, such comparisons are not yet available. In a previous study undertaken by our Pain Center, the outcome of a minimal multidisciplinary intervention model (20-hour) did not exceed primary care. Forty-two patients suffering from frequent headaches (20 +/- 9 headache days/month; range: 8-30) were treated and evaluated in a 96-hour group program. The results were compared with the outcomes of the previous study. Subjects who had undergone either the 20-hour multidisciplinary program or the primary care were used as historical control groups. A significant reduction in migraine days (P tension-type headache days (P tension-type headache days (P = .016), and frequency of migraine attacks (P = .016). In comparison with the 20-hour multidisciplinary program, the 96-hour program showed significantly better effects only in the reduction of migraine days (P = .037) and depression score (P = .003). The responder-rates (> or =50% improvement) in the 96-hour program were significantly higher than in the 20-hour program (migraine days, P = .008; tension-type headache days, P = .044) and primary care (migraine days, P = .007; tension-type headache days, P = .003; tension-type headache intensity, P = .037). The effect sizes were small to medium in the 96-hour program. Particularly with the reduction of migraine symptomatology, the 96-hour program performed better than the 20-hour program, which produced only negligible or small effects. Intensive multidisciplinary headache treatment is highly effective for patients with chronic headaches. Furthermore, migraine symptomatology

Evaluation of Monticello Nuclear Power Plant, Environmental Impact Prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1976-11-01

This report evaluates quantitatively the nonradiological environmental monitoring programs at Monticello Nuclear Generating Plant. The general objective of the study is to assess the effectiveness of monitoring programs in the measurement of environmental impacts. Specific objectives include the following: (1) Assess the validity of environmental impact predictions made in the Environmental Statement by analysis of nonradiological monitoring data; (2) evaluate the general adequacy of environmental monitoring programs for detecting impacts and their responsiveness to Technical Specifications objectives; (3) assess the adequacy of preoperational monitoring programs in providing a sufficient data base for evaluating operational impacts; (4) identify possible impacts that were not predicted in the environmental statement and identify monitoring activities that need to be added, modified or deleted; and (5) assist in identifying environmental impacts, monitoring methods, and measurement problems that need additional research before quantitative predictions can be attempted. Preoperational as well as operational monitoring data were examined to test the usefulness of baseline information in evaluating impacts. This included an examination of the analytical methods used to measure ecological and physical parameters, and an assessment of sampling periodicity and sensitivity where appropriate data were available

Subjective Outcome Evaluation of the Project P.A.T.H.S. (Secondary 2 Program: Views of the Program Participants

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2009-01-01

Full Text Available A total of 196 secondary schools participated in the Secondary 2 Program of the Full Implementation Phase of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes. After completion of the Tier 1 Program, 30,731 students responded to the Subjective Outcome Evaluation Form (Form A to assess their perceptions of the program, instructors, and perceived effectiveness of the program. Based on the consolidated reports submitted by the schools to the funding body, the research team aggregated the consolidated data to form a “reconstructed” overall profile on the perceptions of the program participants. Findings demonstrated that high proportions of the respondents had positive perceptions of the program and the instructors, and roughly four-fifths of the respondents regarded the program as beneficial to them. Correlation analyses showed that perceived program and instructor characteristics were positively associated with perceived benefits of the program.

Conducting evaluations to determine training effectiveness

International Nuclear Information System (INIS)

Hall, J. Doug; Yoder, John A. Yoder

2003-01-01

Training organizations must answer the question: Is the training program adding value in terms of workforce productivity and safety? To answer this question, one needs to know what circumstances led to the development of training to determine how to measure the result of Gaining. The Idaho National Engineering and Environmental Laboratory (ENEEL), under contract with the United States Department Of Energy (U.S. DOE), has conducted extensive research hi the area of training effectiveness. A comprehensive Training Performance Indicator Model has been developed, which has become the basis for a DRAFT document entitled Guidance for Conducting Evaluations to Determine Training Effectiveness'. The indicator Model includes the performance indicators, strategies, and methods for measuring training effectiveness. A common nomenclature is used throughout the DRAFT document to aid in using and understanding training effectiveness evaluations. The model incorporates elements of Dr. Donald L. Kirkpatrick's evaluation model, other models from industry leaders, and the findings of a benchmarking study involving both nuclear and non-nuclear industry professionals. This presentation communicates recent Department of Energy efforts in evaluating effectiveness of training, including valuable lessons learned. (author)

Evaluation of Millstone Nuclear Power Plant, Environmental Impact prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1977-02-01

This report evaluates the nonradiological monitoring program at Millstone Nuclear Power Plant. Both operational as well as preoperational monitoring programs were analyzed to produce long-term (5 yr or longer) data sets, where possible. In order to determine the effectiveness of these monitoring programs, the appropriate data sets have to be analyzed by the appropriate statistical analysis. Thus, both open literature and current statistical analysis being developed at Pacific Northwest Laboratories (PNL) were employed in data analysis

Evaluation of Millstone Nuclear Power Plant, Environmental Impact prediction, based on monitoring programs

Energy Technology Data Exchange (ETDEWEB)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1977-02-01

This report evaluates the nonradiological monitoring program at Millstone Nuclear Power Plant. Both operational as well as preoperational monitoring programs were analyzed to produce long-term (5 yr or longer) data sets, where possible. In order to determine the effectiveness of these monitoring programs, the appropriate data sets have to be analyzed by the appropriate statistical analysis. Thus, both open literature and current statistical analysis being developed at Pacific Northwest Laboratories (PNL) were employed in data analysis.

Implemented or not implemented? Process evaluation of the school-based obesity prevention program DOiT and associations with program effectiveness

NARCIS (Netherlands)

van Nassau, F.; Singh, A.S.; Hoekstra, T.; van Mechelen, W.; Brug, J.; Chinapaw, M.J.M.

This study investigates if and to what extent the Dutch Obesity Intervention in Teenagers (DOiT) program was implemented as intended and how this affected program effectiveness. We collected data at 20 prevocational education schools in the Netherlands. We assessed seven process indicators:

Implemented or not implemented? : Process evaluation of the school-based obesity prevention program DOiT and associations with program effectiveness

NARCIS (Netherlands)

van Nassau, Femke; Singh, Amika S; Hoekstra, T.; van Mechelen, Willem; Brug, Johannes; Chinapaw, Mai J M

This study investigates if and to what extent the Dutch Obesity Intervention in Teenagers (DOiT) program was implemented as intended and how this affected program effectiveness. We collected data at 20 prevocational education schools in the Netherlands. We assessed seven process indicators:

Alternative Transportation Program, P.L. 94-142. 1985-86 Evaluation Report.

Science.gov (United States)

Case, Elizabeth J.; Bouchard, Donald

Overall effectiveness and impact were evaluated for the Alternative Transportation Program (ATP) of the Albuquerque (New Mexico) Public Schools, funded under Public Law 94-142, the Education for All Handicapped Children Act. Two specialists implemented the ATP, which developed and presented curricula and assemblies tailored to handicapped students…

INSPECT: a package of computer programs for planning and evaluating safeguards inspections

International Nuclear Information System (INIS)

Mullen, M.F.

1980-01-01

As part of the US Program of Technical Assistance to IAEA Safeguards, PNL has developed a package of computer programs, called INSPECT, that can be used in planning and evaluating safeguards inspections of various types of nuclear facilities. The programs are based on the statistical methods described in Part F of the IAEA Safeguards Technical Manual and can be used to calculate the variance components of the MUF (Material Unaccounted For) statistic, the variance components of the D (difference) statistic, attribute and variables sampling plans, and a measure of the effectiveness of the inspection plan. The paper describes the programs, reviews a number of applications, and indicates areas for future work

The effectiveness of environmental education programs from the perspectives of three stakeholders: Participants, sponsors, and professionals

Science.gov (United States)

Luera, Gail Rose

As the field of environmental education has matured since its inception in 1970, so have the number and variety of environmental programs. Along with the increased number of programs has come a need for in-depth program evaluations. This is especially critical because of reductions in educational funding and competition for a place in an already crowded curriculum. Evaluation is essential to convince the educational community that environmental education can improve the curriculum, ensure cost effectiveness, and become more relevant to students. Drawing on program evaluation research, action research, and interpretive (qualitative) research to strengthen the research design and methodology, this dissertation explores how different stakeholders of two environmental education programs determine program effectiveness. Effectiveness was investigated primarily through the use of in-depth interviews of participants, program sponsors, and professionals. Program success at the professional field level was determined by criteria set by the North American Association for Environmental Education. Characteristics considered in the selection of programs for this study included: method of dissemination, sponsor, subject focus, the method of action which they encourage, and their vision for the future. Using the qualitative case study approach, the Orange County Outdoor Science School in California and Project WILD in Michigan were evaluated. The results show that all levels of stakeholders perceived the two programs to be effective. Areas of effectiveness varied with each program and by stakeholder level. Issues facing each program also differed. At the Orange County Outdoor Science School, program cost was named as the major issue. The most often cited issues for Project WILD was public awareness of the program and stabilizing long term financial support for the Michigan program. Interview data were analyzed at the question level in addition to the thematic level. Themes which

Process Evaluation for a Prison-based Substance Abuse Program.

Science.gov (United States)

Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

2000-01-01

Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Use of qualitative analysis to supplement program evaluation of a faculty development program

Directory of Open Access Journals (Sweden)

Thomas V Chacko

2013-01-01

Full Text Available Introduction: Generally for Program Evaluation of workshops, a structured questionnaire is used to measure learner satisfaction and learning and it yields results in quantitative terms and if there are open-ended questions, it yields a long list of responses which the evaluator finds it difficult to use. Hence, we used qualitative research methods to supplement it for a holistic understanding of the quality and extent of their learning. Materials and Methods: A faculty development program was used opportunistically to gather data using open-ended questions designed to elicit "thick descriptions" about their learning. Using the Grounded Theory approach where the data drives further analysis, data analysis was done by faculty in three groups using inductive reasoning leading to emergence of themes and categories of responses. The commonalities in the themes that emerged independently in the three groups as well as member checking to seek their agreement with the group′s observation of the primary data were used to ensure validity of the findings. Results: Themes and categories of new learning in terms of knowledge, skills, attitudes and processes emerged which gives a better understanding of the extent of the learning and its applicability to future professional tasks. The open-ended questions encouraging participants to give "thick description" of their learning yielded many quotable quotes which indicate the quality of their learning. Conclusion: The use of open-ended questions and qualitative research method of data analysis using the Grounded Theory approach helps in holistic understanding of the focus and quality of learning that is not usually possible through quantitative research methods. Hence, it is recommended that when understanding of the extent and quality of learning is important, traditional method of program evaluation should be supplemented with qualitative research methods as they are more effective in convincing decision

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

Science.gov (United States)

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

Meditation programs for veterans with posttraumatic stress disorder: Aggregate findings from a multi-site evaluation.

Science.gov (United States)

Heffner, Kathi L; Crean, Hugh F; Kemp, Jan E

2016-05-01

Interest in meditation to manage posttraumatic stress disorder (PTSD) symptoms is increasing. Few studies have examined the effectiveness of meditation programs offered to Veterans within Department of Veterans Affairs (VA) mental health services. The current study addresses this gap using data from a multisite VA demonstration project. Evaluation data collected at 6 VA sites (N = 391 Veterans) before and after a meditation program, and a treatment-as-usual (TAU) program, were examined here using random effects meta-analyses. Site-specific and aggregate between group effect sizes comparing meditation programs to TAU were determined for PTSD severity measured by clinical interview and self-report. Additional outcomes included experiential avoidance and mindfulness. In aggregate, analyses showed medium effect sizes for meditation programs compared to TAU for PTSD severity (clinical interview: effect size (ES) = -0.32; self-report: ES = -0.39). Similarly sized effects of meditation programs were found for overall mindfulness (ES = 0.41) and 1 specific aspect of mindfulness, nonreactivity to inner experience (ES = .37). Additional findings suggested meditation type and program completion differences each moderated program effects. VA-sponsored meditation programs show promise for reducing PTSD severity in Veterans receiving mental health services. Where meditation training fits within mental health services, and for whom programs will be of interest and effective, require further clarification. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Implementation and evaluation of a training program as part of the Cooperative Biological Engagement Program in Azerbaijan

Directory of Open Access Journals (Sweden)

April eJohnson

2015-10-01

Full Text Available A training program for animal and human health professionals has been implemented in Azerbaijan through a joint agreement between the United States Defense Threat Reduction Agency and the Government of Azerbaijan. The training program is administered as part of the Cooperative Biological Engagement Program, and targets key employees in Azerbaijan’s disease surveillance system including physicians, veterinarians, epidemiologists, and laboratory personnel. Training is aimed at improving detection, diagnosis, and response to especially dangerous pathogens, although the techniques and methodologies can be applied to other pathogens and diseases of concern. Biosafety and biosecurity training is provided to all trainees within the program. Prior to 2014, a variety of international agencies and organizations provided training, which resulted in gaps related to lack of coordination of training materials and content. In 2014 a new training program was implemented in order to address those gaps. This paper provides an overview of the Cooperative Biological Engagement Program training program in Azerbaijan, a description of how the program fits into existing national training infrastructure, and an evaluation of the new program’s effectiveness to date. Long-term sustainability of the program is also discussed.

Evaluating a Graduate Professional Development Program for Informal Science Educators

Science.gov (United States)

Lake, Jeremy Paul

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the Informal Science Institutions Environmental Education Graduate Certificate Program truly provided the long term professional development needed to enhance the skills of the formal and informal educators participating so that they could contribute meaningfully to the improvement of science literacy in their respective communities. My role as an internal evaluator provided an extraordinary opportunity to know the intent of the learning opportunities and why they were constructed in a particular fashion. Through the combination of my skills, personal experiences both within the certificate's predecessor and as an educator, I was uniquely qualified to explore the outcomes of this program and evaluate its effectiveness in providing a long-term professional development for participants. After conducting a literature review that emphasized a need for greater scientific literacy in communities across America, it was evident that the formal education enterprise needs the support of informal educators working on the ground in myriad different settings in ways that provide science as both content and process, learning science facts and doing real science. Through a bridging of informal science educators with formal teachers, it was thought each could learn the culture of the other, making each more fluent in accessing community resources to help make these educators more collaborative and able to bridge the classroom with the outside world. This bridge promotes ongoing, lifelong learning, which in turn can help the national goal of greater scientific literacy. This study provided insight into the thinking involved in the learners' growth as they converted theory presented in course materials into practice. Through an iterative process of reviewing the course

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Evaluation of a multicomponent workplace health promotion program conducted in Japan for improving employees' cardiovascular disease risk factors.

Science.gov (United States)

Muto, T; Yamauchi, K

2001-12-01

The long-term effectiveness of multicomponent worksite health promotion programs targeting cardiovascular disease risk factors remains unclear in Japan. This study was conducted to evaluate the effectiveness of such a health promotion program consisting of a main program provided over 4 days and a follow-up program provided over 1 year. The subjects of this randomized controlled trial were male employees working for a building maintenance company in Japan. The intervention group (n = 152) and the control group (n = 150) consisted of employees having abnormal findings in at least one of the following items at baseline health examination: body mass index (BMI), systolic (SBP) or diastolic blood pressure, total cholesterol, HDL cholesterol, triglycerides, and fasting blood glucose. Evaluation was conducted at 18 months after the main program. BMI, SBP, total cholesterol, and triglycerides improved significantly in the intervention group compared with the control group (P < 0.05). When comparisons were limited to those who showed abnormality at baseline, BMI, total cholesterol, and triglycerides improved significantly in the intervention group (P < 0.05). The multicomponent health promotion program provided to employees was shown to be effective in improving obesity, high blood pressure, and hyperlipidemia when evaluated 18 months after the main intervention program. Copyright 2001 American Health Foundation and Elsevier Science.

Telemedicine-based diabetic retinopathy screening programs: an evaluation of utility and cost-effectiveness

Directory of Open Access Journals (Sweden)

Cuadros JA

2015-06-01

Full Text Available Jorge A Cuadros Optometry/Vision Science, University of California, Berkeley, CA, USA Abstract: Diabetes is the main cause of blindness among working age adults, although treatment is highly effective in preventing vision loss. Eye examinations are recommended on a yearly basis for most patients for timely detection of retinal disease. Telemedicine-based diabetic retinopathy screening (TMDRS programs have been developed to identify patients with sight-threatening diabetic eye disease because patients are often noncompliant with recommended live eye examinations. This article reviews the cost-effectiveness of the various forms of TMDRS. A review of relevant articles, mostly published since 2008, shows that societal benefits generally outweigh the costs of TMDRS. However, advances in technology to improve efficacy, lower costs, and broaden screening to other sight-threatening conditions, such as glaucoma and refractive error, are necessary to improve the sustainability of TMDRS within health care organizations. Patient satisfaction with these telemedicine programs is generally high. New models of shared care with primary care providers and staff are emerging to improve patient engagement and follow-up care when individuals are found to have sight-threatening eye disease. TMDRS programs are growing and provide valuable clinical benefit. The cost-utility is currently well proven in locations with limited access to regular eye care services, such as rural areas, poor communities, and prison systems; however, improvements over time are necessary for these programs to be cost-effective in mainstream medical settings in the future. Keywords: telemedicine, diabetes, retinopathy, retinal imaging

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

Keys to success: Ten case studies of effective weatherization programs

Energy Technology Data Exchange (ETDEWEB)

Brown, M.A.; Berry, L.G.; Kolb, J.O.; White, D.L. [Oak Ridge National Lab., TN (United States); Kinney, L.F.; Wilson, T. [Synertech Systems Corp., Syracuse, NY (United States)

1993-11-01

In 1990, DOE initiated a nationwide evaluation of its Weatherization Program, with assistance from Oak Ridge National Laboratory and an advisory group of 40 weatherization professionals, program managers, and researchers. The evaluation is comprised of three impact studies covering the Program`s major market segments: Single-family homes, mobile homes, and dwellings in small (2 to 4-unit) multifamily buildings (the Single-Family Study), Single-family homes heated primarily with fuel oil (the Fuel-Oil Study), and Dwellings in buildings with five or more units (the Multifamily Study). The Single-Family Study, the subject of this report, is a critical part of this coordinated evaluation effort. Its focus on single-family dwellings, mobile homes, and dwellings in small multifamily buildings covers 83% of the income-eligible population and 96% of the dwellings weatherized during Program Year 1989. The first phase of the Single-Family Study involved the analysis of a massive data base of information collected from 368 local weatherization agencies and 543 electric and gas utilities. This analysis resulted in energy-saving and cost-effectiveness estimates for the Weatherization Program and the identification of a set of ten high-performing agencies located throughout the country. The second phase, which is the subject of this report, involves a ``process`` evaluation of these ten high performers, aimed at identifying those weatherization practices that explain their documented success.

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Emergency Food Assistance in Northern Syria: An Evaluation of Transfer Programs in Idleb Governorate.

Science.gov (United States)

Doocy, Shannon; Tappis, Hannah; Lyles, Emily; Witiw, Joseph; Aken, Vicki

2017-06-01

The war in Syria has left millions struggling to survive amidst violent conflict, pervasive unemployment, and food insecurity. Although international assistance funding is also at an all-time high, it is insufficient to meet the needs of conflict-affected populations, and there is increasing pressure on humanitarian stakeholders to find more efficient, effective ways to provide assistance. To evaluate 3 different assistance programs (in-kind food commodities, food vouchers, and unrestricted vouchers) in Idleb Governorate of Syria from December 2014 and March 2015. The evaluation used repeated survey data from beneficiary households to determine whether assistance was successful in maintaining food security at the household level. Shopkeeper surveys and program monitoring data were used to assess the impact on markets at the district/governorate levels and compare the cost-efficiency and cost-effectiveness of transfer modalities. Both in-kind food assistance and voucher programs showed positive effects on household food security and economic measures in Idleb; however, no intervention was successful in improving all outcomes measured. Food transfers were more likely to improve food access and food security than vouchers and unrestricted vouchers. Voucher programs were found to be more cost-efficient than in-kind food assistance, and more cost-effective for increasing household food consumption. Continuation of multiple types of transfer programs, including both in-kind assistance and vouchers, will allow humanitarian actors to remain responsive to evolving access and security considerations, local needs, and market dynamics.

Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

Science.gov (United States)

Maher, Charles A.

1981-01-01

Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

Evaluating the Effectiveness of Tutoring: An Easier Way

Science.gov (United States)

Holliday, Tacy

2012-01-01

Many learning center administrators understand the need to evaluate the effectiveness of their tutoring programs, but they do not have much free time to design and conduct meaningful research. This article presents a method of evaluation that can be used to determine whether students were able to demonstrate understanding after a tutoring…

Evaluation of an educational program on deciphering heterogeneity for medical coverage decisions.

Science.gov (United States)

Warholak, Terri L; Hilgaertner, Jianhua W; Dean, Joni L; Taylor, Ann M; Hines, Lisa E; Hurwitz, Jason; Brown, Mary; Malone, Daniel C

2014-06-01

It is increasingly important for decision makers, such as medical and pharmacy managers (or pharmacy therapeutics committee members and staff), to understand the variation and diversity in treatment response as decisions shift from an individual patient perspective to optimizing care for populations of patients. To assess the effectiveness of an instructional program on heterogeneity designed for medical and pharmacy managers. A live educational program was offered to members of the Academy of Managed Care Pharmacy at the fall 2012 educational meeting and also to medical directors and managers attending a national payer roundtable meeting in October 2012. Participants completed a retrospective pretest-posttest assessment of their knowledge, attitudes, and self-efficacy immediately following the program. Participants were offered the opportunity to participate in a follow-up assessment 6 months later. Willing participants for the follow-up assessment were contacted via e-mail and telephone. Rasch rating scale models were used to compare pre- and postscores measuring participants' knowledge about and attitude towards heterogeneity. A total of 49 individuals completed the retrospective pretest-posttest assessment and agreed to be a part of the program evaluation. Fifty percent (n = 25) of participants had heard of the phrase "heterogeneity of treatment effect," and 36 (72%) were familiar with the phrase "individualized treatment effect" prior to the live program. Participants reported a significant improvement in knowledge of heterogeneity (P  less than  0.01) and attitudes about heterogeneity (P  less than  0.01) immediately after attending the program. At the time of the educational program, participants had either never considered heterogeneity (26%) or reported not knowing (28%) whether their organizations considered it when determining basic coverage. Participants were more likely to report "sometimes" considering heterogeneity for determining

Development and evaluation of a leadership program for veterinary students.

Science.gov (United States)

Moore, D A; Klingborg, D J

2001-01-01

Leadership skills are important for many facets of professional life, but no known leadership training programs exist in North American veterinary schools. It was the purpose of this project to develop, deliver, and evaluate a leadership program for first-year veterinary students. Leadership attributes emphasized in the course included effective communication, openness to learning from others, self-awareness, commitment beyond self-interest, motivation, decision making, understanding issue complexity, and team building. The five-day course was delivered to 21 new veterinary students randomly selected just prior to their first-year orientation in the fall of 2000. Participants ranked themselves higher than non-participants in a post-course evaluation on their ability to be effective leaders. Participants reported an increase in self-confidence and a clearer understanding of their leadership roles. Participants also noted new support systems among co-participants and expressed a new ability to consider complex issues more broadly. Most reported that they frequently used enhanced skills in giving and receiving feedback and team building. Other leadership tools identified as valuable included negotiation, group dynamics, a structured approach to problem solving, time management, and an awareness of personal learning style preferences as a means to improve communication.

Guide for monitoring effectiveness of utility Reliability Centered Maintenance (RCM) programs

International Nuclear Information System (INIS)

Midgett, W.D.; Wilson, J.F.; Krochmal, D.F.; Owsenek, L.W.

1991-02-01

Reliability centered maintenance (RCM) programs help utilities optimize preventive maintenance efforts while improving plant safety and economy through increased dependability of plant components. The project team developed this guide and accompanying methodology based on status updates from the Ginna and San Onofre demonstration projects. These updates addressed areas ranging from system selection to the effectiveness of RCM program implementation. In addition, the team incorporated information from a 12-utility survey soliciting opinions on the need for a methodology to monitor RCM cost-effectiveness. An analysis of the 12-utility survey showed that no techniques had been developed to measure RCM program cost-effectiveness. Thus, this guide addresses two key areas: Pros and cons of various monitoring techniques available to assess the overall effectiveness of RCM and a methodology for specifically evaluating the cost-effectiveness of RCM programs. 1 fig

Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emeral Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2007-03-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others.

Relevance Evaluation of Engineering Master's Program in Peru

OpenAIRE

Miñán, Erick; Lavalle, Carlos; Díaz-Puente, José M.

2012-01-01

In a context of mass higher education, it is necessary to ensure not only quality but also the relevance of engineering master's programs, namely the appropriateness of the objectives and outcomes to the needs and interests of the program beneficiaries. After a literature review we analyzed the evaluation models of three organizations in Peru: the Board of Evaluation, Accreditation and Certification of the University Education Quality CONEAU, the Institute of Quality and Accreditation of Comp...

Challenges to Evaluating Physical Activity Programs in American Indian/Alaska Native Communities

Science.gov (United States)

Roberts, Erica Blue; Butler, James; Green, Kerry M.

2018-01-01

Despite the importance of evaluation to successful programming, a lack of physical activity program (PAP) evaluation for American Indian/Alaska Native (AI/AN) programs exists, which is significant given the high rates of obesity and diabetes in this population. While evaluation barriers have been identified broadly among AI/AN programs, challenges…

Evaluating the effectiveness of a laboratory-based professional development program for science educators

Science.gov (United States)

Amolins, Michael W.; Ezrailson, Cathy M.; Pearce, David A.; Elliott, Amy J.

2015-01-01

The process of developing effective science educators has been a long-standing objective of the broader education community. Numerous studies have recommended not only depth in a teacher's subject area but also a breadth of professional development grounded in constructivist principles, allowing for successful student-centered and inquiry-based instruction. Few programs, however, have addressed the integration of the scientific research laboratory into the science classroom as a viable approach to professional development. Additionally, while occasional laboratory training programs have emerged in recent years, many lack a component for translating acquired skills into reformed classroom instruction. Given the rapid development and demand for knowledgeable employees and an informed population from the biotech and medical industries in recent years, it would appear to be particularly advantageous for the physiology and broader science education communities to consider this issue. The goal of this study was to examine the effectiveness of a laboratory-based professional development program focused on the integration of reformed teaching principles into the classrooms of secondary teachers. This was measured through the program's ability to instill in its participants elevated academic success while gaining fulfillment in the classroom. The findings demonstrated a significant improvement in the use of student-centered instruction and other reformed methods by program participants as well as improved self-efficacy, confidence, and job satisfaction. Also revealed was a reluctance to refashion established classroom protocols. The combination of these outcomes allowed for construction of an experiential framework for professional development in applied science education that supports an atmosphere of reformed teaching in the classroom. PMID:26628658

A Controlled and Retrospective Study of 144 Chronic Low Back Pain Patients to Evaluate the Effectiveness of an Intensive Functional Restoration Program in France

Directory of Open Access Journals (Sweden)

Isabelle Caby

2016-04-01

Full Text Available Study Design: A controlled and retrospective study of 144 chronic low back pain patients to evaluate the effectiveness of an intensive functional restoration program in France. Objective: Evaluating the efficiency of an intensive, dynamic and multidisciplinary functional restoration program in patients with chronic low back pain (LBP, during 6 and 12 months follow up. Summary of background data: Chronic low back pain disease has a multifactor nature, involving physical, psychological professional and social factors. A functional restoration program (FRP has been included in a multidisciplinary training program which provides an efficient therapeutic solution. However, the effectiveness of an FRP has not been yet established. Methods: 144 subjects (71 males, 73 females with chronic low back pain were included in a functional restoration program. The FRP includes physiotherapy and occupational therapy interventions together with psychological counselling. Patients participated as in- or outpatients 6 h per day, 5 days a week over 5 weeks. Pain intensity, trunk flexibility, trunk strength, lifting ability, quality of life and return to work were recorded before, immediately after, and at 6 months and 12 months after the treatment period. Results: All outcome measures were significantly higher just after the FRP (144 patients and at 6 and 12 months (from available data in 31 subjects compared to pre-treatment values. This FRP for chronic low back pain maintained its benefits whatever the patient’s activities. Conclusions: The effects reflected on all outcome measures, both on short and long term follow-up. The multidisciplinary FRP for chronic low back pain patients durably stopped the de-conditioning syndrome and involved new life-style habits for the patient, daily pain management and a return to work.

Terra Nova Environmental effects monitoring program

International Nuclear Information System (INIS)

Williams, U.; Murdoch, M.

2000-01-01

Elements of the environmental effects monitoring program in the Terra Nova oil field, about 350 km east-southeast of St. John's, Newfoundland, are described. This oilfield is being developed using a floating production storage and offloading (FPSO) facility. A total of 24 wells are expected to be drilled through seven subsea templates located in four glory holes to protect them from icebergs. Subsea installations will be linked to the FPSO by trenched flowlines connected to flexible risers. The FPSO will offload to shuttle tankers. First oil is expected in 2001. The environmental effects monitoring program will be conducted annually for the first two years beginning in 2000. Subsequent scheduling will be determined after a review of monitoring data collected during the first three years. Input to the design of the monitoring program was provided by all stakeholders, i. e. owners, local public, government agencies and regional and international experts. A model was developed linking project discharges and possible effects to the environment, including marine resources in the area, and the information derived from these activities was used to generate a set of predictions and hypotheses to be tested in the monitoring program. The monitoring program will use two spatial models: a regression or gradient design and a control-impact design. The gradient design will monitor water column and sediment chemistry, sediment toxicity and benthic invertebrate communities. The control-impact design will be used to monitor larger and more mobile fish or shellfish. The evaluated results will serve as the basis for determining impact predictions and to provide information to allow for decisions pertaining to the protection of the marine environment

Material balance area custodian performance evaluation program at PNL

International Nuclear Information System (INIS)

Dickman, D.A.

1991-01-01

This paper reports that the material balance area (MBA) custodian has primary responsibility for control and accountability of nuclear material within an MBA. In this role, the custodian operates as an extension of the facility material control and accountability (MC and A) organization. To effectively meet administrative requirements and protection needs, the custodian must be fully trained in all aspects of MC and A related to the MBA, and custodian performance must be periodically evaluated. U.S. Department of Energy (DOE) Policy requires that each facility provide for a program which ensures that personnel performing MC and A functions are trained and/or qualified to perform their duties and responsibilities and knowledgeable of requirements and procedures related to their functions. the MBA Custodian Performance Evaluation Program at Pacific Northwest Laboratory (PNL) uses a variety of assessment techniques to meet this goal, including internal and independent MBA audits, periodic custodian testing, limited scope performance tests, daily monitoring of MC and A documentation, and reviewing custodian performance during physical inventories

Design of a study evaluating the effects, health economics, and stakeholder perspectives of a multi-component occupational rehabilitation program with an added workplace intervention - a  study protocol.

Science.gov (United States)

Rise, Marit B; Skagseth, Martin; Klevanger, Nina E; Aasdahl, Lene; Borchgrevink, Petter; Jensen, Chris; Tenggren, Hanne; Halsteinli, Vidar; Jacobsen, Trym N; Løland, Svein B; Johnsen, Roar; Fimland, Marius S

2018-02-05

Recent research has suggested that interventions at the workplace might be the most potent ingredient in return to work interventions, but few studies have investigated the different effects of workplace interventions as part of occupational rehabilitation programs. The comprehensive design described in this article includes effect (on return to work and health outcomes), and health economic evaluations of a workplace intervention added to a multicomponent rehabilitation program. Qualitative and mixed method studies will investigate sick-listed persons', rehabilitation therapists' and employers' perspectives on the usability and outcomes of the rehabilitation program and the workplace intervention. The program and intervention are provided to patients with musculoskeletal, psychological or general and unspecified diagnoses. The program is multi-component and includes Acceptance and Commitment Therapy, physical exercise, patient education and creating a plan for increased work participation. Persons who are employed, aged from 18 to 60 years, with a current sick leave status of 50% or more and a diagnosis within the musculoskeletal, psychological or general and unspecified chapters of International Classification of Primary Care-2 (ICPC-2) will be recruited to a researcher-blinded parallel-group randomized controlled trial. All participants take part in an in-patient occupational rehabilitation program, while the intervention group also takes part in an intervention at the workplace. The effect and economic evaluation will investigate the effect of the added workplace intervention. The primary outcome measures will be time until full sustainable return to work and total number of sickness absence days in the 12 months after inclusion. Health economic evaluations will investigate the cost-effectiveness and cost-utility. Qualitative studies will investigate rehabilitation therapists' experiences with working towards return to work within an ACT-approach and

Evaluation of utility residential energy conservation programs: A Pacific Northwest example

Energy Technology Data Exchange (ETDEWEB)

Hirst, E; Bronfman, B; Goeltz, R; Keating, K; Lerman, D; Timble, J

1984-03-01

This paper describes a detailed quantitative evaluation of the Residential Weatherization Pilot Program, operated by the Bonneville Power Administration from 1980 through 1982. The program provided free energy audits to more than 6000 electrically-heated homes and gave zero-interest loans to weatherize almost 4000 of these audited homes. The total cost of the program was almost $8 million. Using actual electricity consumption records for program participants and nonparticipants, we calculated the energy-saving effect of the pilot program in several ways and always reached the same conclusion. Households that received an audit and weatherization loan reduced their annual electricity consumption by about 3500 kWh relative to what they would have done without the program; this 3500 kWh is the saving that can be directly attributed to the program. Using a simple net present worth approach, the authors computed program benefits and costs for participating households, the BPA power system, and the Pacific Northwest region as a whole. Under a wide range of assumptions concerning discount rate, years until the weatherization loan is repaid, program energy saving, and BPA's marginal cost of power, the program is economically attractive from all three perspectives.

Cost-Effectiveness Evaluation of a Novel Integrated Bite Case Management Program for the Control of Human Rabies, Haiti 2014-2015.

Science.gov (United States)

Undurraga, Eduardo A; Meltzer, Martin I; Tran, Cuc H; Atkins, Charisma Y; Etheart, Melissa D; Millien, Max F; Adrien, Paul; Wallace, Ryan M

2017-06-01

AbstractHaiti has the highest burden of rabies in the Western hemisphere, with 130 estimated annual deaths. We present the cost-effectiveness evaluation of an integrated bite case management program combining community bite investigations and passive animal rabies surveillance, using a governmental perspective. The Haiti Animal Rabies Surveillance Program (HARSP) was first implemented in three communes of the West Department, Haiti. Our evaluation encompassed all individuals exposed to rabies in the study area ( N = 2,289) in 2014-2015. Costs (2014 U.S. dollars) included diagnostic laboratory development, training of surveillance officers, operational costs, and postexposure prophylaxis (PEP). We used estimated deaths averted and years of life gained (YLG) from prevented rabies as health outcomes. HARSP had higher overall costs (range: $39,568-$80,290) than the no-bite-case-management (NBCM) scenario ($15,988-$26,976), partly from an increased number of bite victims receiving PEP. But HARSP had better health outcomes than NBCM, with estimated 11 additional annual averted deaths in 2014 and nine in 2015, and 654 additional YLG in 2014 and 535 in 2015. Overall, HARSP was more cost-effective (US$ per death averted) than NBCM (2014, HARSP: $2,891-$4,735, NBCM: $5,980-$8,453; 2015, HARSP: $3,534-$7,171, NBCM: $7,298-$12,284). HARSP offers an effective human rabies prevention solution for countries transitioning from reactive to preventive strategies, such as comprehensive dog vaccination.

Effects of Mentoring Programs on New Teacher Retention: A Literature Review

Science.gov (United States)

Waterman, Sheryn; He, Ye

2011-01-01

Building upon previous literature reviews, this article highlights research and evaluation efforts regarding the effectiveness of mentoring programs for new teacher retention in the USA since 2005. Through the analysis of various mentoring program components, different research methods used, and major findings from these studies, we discuss the…

A counterfactual impact evaluation of a bilingual program on students' grade point average at a spanish university.

Science.gov (United States)

Arco-Tirado, J L; Fernández-Martín, F; Ramos-García, A M; Littvay, L; Villoria, J; Naranjo, J A

2018-02-21

This observational study intends to estimate the causal effects of an English as a Medium of Instruction (EMI) program (as predictor) on students Grade Point Average (GPA) (as outcome) at a particular University in Spain by using a Counterfactual Impact Evaluation (CIE). The need to address the crucial question of causal inferences in EMI programs to produce credible evidences of successful interventions contrasts, however, with the absence of experimental or quasi-experimental research and evaluation designs in the field. CIE approach is emerging as a methodologically viable solution to bridge that gap. The program evaluated here consisted in delivering an EMI program in a Primary Education Teacher Training Degree group. After achieving balance on the observed covariates and recreating a situation that would have been expected in a randomized experiment, three matching approaches such as genetic matching, nearest neighbor matching and Coarsened Exact Matching were used to analyze observational data from a total of 1288 undergraduate students, including both treatment and control group. Results show unfavorable effects of the bilingual group treatment condition. Potential interpretations and recommendations are provided in order to strengthen future causal evidences of bilingual education programs' effectiveness in Higher Education. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Integrating design science theory and methods to improve the development and evaluation of health communication programs.

Science.gov (United States)

Neuhauser, Linda; Kreps, Gary L

2014-12-01

Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.

Profiling the Psychological Training and Support Needs of Oncology Staff, and Evaluating the Effectiveness of a Level 2 Psychological Support Training Program Workshop.

Science.gov (United States)

Laffan, Amanda J; Daniels, Jo; Osborn, Michael

2015-01-01

The importance of training non-psychology healthcare professionals to offer psychological support to people with cancer is becoming increasingly recognized. This small-scale pilot project sought to identify the training and support needs of oncology staff and to evaluate the effectiveness of a Level 2 Psychological Support Training Program workshop. Semi-structured interviews with five members of multidisciplinary oncology staff identified that training needs were primarily around communication skills, recognizing and dealing with emotions, offering support and empathy, and self-care. Pre and post-training questionnaires developed with these themes in mind revealed that the Level 2 Training Program workshops run in this network of hospitals are effective in increasing participants' levels of perceived knowledge and confidence across each of these domains. Recommendations are made for further enhancing this effectiveness.

Cost-effectiveness analysis of public education and incentive programs for controlling radon in the home. Final report

International Nuclear Information System (INIS)

Bierma, T.J.; Swartzman, D.

1988-12-01

The objective of this study was to evaluate the cost-effectiveness in Illinois of five radon public education and incentive program options. Programs evaluated included (1) no program, (2) a toll-free hotline and information packet, (3) free short-term monitors, (4) free confirmatory monitors, and (5) low-interest loans. Existing literature and expert opinion were used to estimate program costs and public responses under the various programs. Computer simulation, with Monte Carlo sampling, was used for uncertainty and sensitivity analysis. The cost-effectiveness model was analyzed based on assumed radon exposures to Illinois citizens. Results for standard conditions indicate that budget levels under approximately $30,000 do not warrant a radon education and incentive program. For budget levels of approximately $30,000 to $1 million, Program 2 was most effective, and Program 3 was most effective above this level. Sensitivity analyses indicate the results are relatively insensitive to input variable assumptions with the exception of public-response estimates. Study results suggest that all of the programs evaluated are likely to be relatively ineffective. Considerable improvement may be possible using more innovative approaches to public education

Eco-labeling for energy efficiency and sustainability: a meta-evaluation of US programs

Energy Technology Data Exchange (ETDEWEB)

Banerjee, Abhijit; Solomon, Barry D

2003-01-01

Eco-labeling is a promising market-based approach for improving the environmental performance of products through consumer choice. While eco-labeling itself is not new, eco-labeling to promote energy efficiency or sustainability is a more recent phenomenon. Five such energy-labeling programs in the US are evaluated: Green Seal, Scientific Certification Systems, Energy Guide, Energy Star, and Green-e. Of these, the first four certify energy-efficient appliances while the last one certifies renewable electricity. While Energy Guide and Energy Star are government-run programs, the rest are privately administered. Two evaluation criteria were used--consumer response and manufacturer/marketer response. Very few studies have been done on the private programs making comparative analysis more difficult. It was found that government programs, in general, and Energy Star, in particular, were much more successful than the private programs. For appliance energy labeling, the private programs were found to have an almost insignificant effect on the market. Government support proved to be crucial in determining a program's credibility, financial stability, and long-term viability. Further, targeting of specific product categories, legislative mandates, incentives, and partnerships were found to be other important factors for program success. Simple seal-of-approval logos and labels have generally affected consumer behavior more than the complex information-disclosure labels.

Eco-labeling for energy efficiency and sustainability: a meta-evaluation of US programs

International Nuclear Information System (INIS)

Banerjee, Abhijit; Solomon, Barry D.

2003-01-01

Eco-labeling is a promising market-based approach for improving the environmental performance of products through consumer choice. While eco-labeling itself is not new, eco-labeling to promote energy efficiency or sustainability is a more recent phenomenon. Five such energy-labeling programs in the US are evaluated: Green Seal, Scientific Certification Systems, Energy Guide, Energy Star, and Green-e. Of these, the first four certify energy-efficient appliances while the last one certifies renewable electricity. While Energy Guide and Energy Star are government-run programs, the rest are privately administered. Two evaluation criteria were used--consumer response and manufacturer/marketer response. Very few studies have been done on the private programs making comparative analysis more difficult. It was found that government programs, in general, and Energy Star, in particular, were much more successful than the private programs. For appliance energy labeling, the private programs were found to have an almost insignificant effect on the market. Government support proved to be crucial in determining a program's credibility, financial stability, and long-term viability. Further, targeting of specific product categories, legislative mandates, incentives, and partnerships were found to be other important factors for program success. Simple seal-of-approval logos and labels have generally affected consumer behavior more than the complex information-disclosure labels

Designing cost effective water demand management programs in Australia.

Science.gov (United States)

White, S B; Fane, S A

2002-01-01

This paper describes recent experience with integrated resource planning (IRP) and the application of least cost planning (LCP) for the evaluation of demand management strategies in urban water. Two Australian case studies, Sydney and Northern New South Wales (NSW) are used in illustration. LCP can determine the most cost effective means of providing water services or alternatively the cheapest forms of water conservation. LCP contrasts to a traditional approach of evaluation which looks only at means of increasing supply. Detailed investigation of water usage, known as end-use analysis, is required for LCP. End-use analysis allows both rigorous demand forecasting, and the development and evaluation of conservation strategies. Strategies include education campaigns, increasing water use efficiency and promoting wastewater reuse or rainwater tanks. The optimal mix of conservation strategies and conventional capacity expansion is identified based on levelised unit cost. IRP uses LCP in the iterative process, evaluating and assessing options, investing in selected options, measuring the results, and then re-evaluating options. Key to this process is the design of cost effective demand management programs. IRP however includes a range of parameters beyond least economic cost in the planning process and program designs, including uncertainty, benefit partitioning and implementation considerations.

Energy poverty reduction by fuel switching. Impact evaluation of the LPG conversion program in Indonesia

International Nuclear Information System (INIS)

Andadari, Roos Kities; Mulder, Peter; Rietveld, Piet

2014-01-01

In low- and middle-income countries, Liquefied Petroleum Gas (LPG) can be an attractive alternative to the widespread use of traditional kerosene. Not only is LPG a relatively clean, safe and cost-effective fuel for households, its large-scale adoption also reduces the heavy burden of kerosene consumption subsidies on government budgets. Against this background, we evaluate the impact of a large government program to substitute LPG for kerosene in Indonesia. Using a household survey across urban, suburban and rural regions we find that this program was very effective in causing a large scale shift from kerosene to LPG. This shift was positively influenced by level of education, household size and household income. Contradicting the energy-ladder model, the LPG program, reinforced by an increase in the price of kerosene, led to increased stacking of fuels, including increasing consumption of both electricity and traditional biomass. In addition, our analysis shows that the LPG program failed to substantially reduce the overall number of energy-poor people, but it has been effective in alleviating extreme energy-poverty. Finally, we find that medium and higher income households in suburban areas benefitted most from the LPG program. - Highlights: • Impact evaluation of a government program to substitute LPG for kerosene in Indonesia. • The program caused a large scale shift from kerosene to LPG. • Contradicting the energy-ladder model, the program led to increased stacking of fuels. • The program did not substantially reduce overall energy poverty, but alleviated extreme energy-poverty. • Medium and higher income households in suburban areas benefitted most from the LPG program

Effectiveness of a self-regulated remedial program for handwriting difficulties.

Science.gov (United States)

Van Waelvelde, Hilde; De Roubaix, Amy; Steppe, Lien; Troubleyn, Evy; De Mey, Barbara; Dewitte, Griet; Debrabant, Julie; Van de Velde, Dominique

2017-09-01

Handwriting difficulties may have pervasive effects on a child's school performance. I Can! is a remedial handwriting program with a focus on self-regulated learning and applying motor learning principles combined with a behavioural approach. It is developed for typically developing children with handwriting problems. The study aim was to evaluate the program's effectiveness. Thirty-one children aged 7-8 year participated in a cross-over study. Handwriting quality and speed were repeatedly assessed by means of the Systematic Screening of Handwriting Difficulties test. Difficulties addressed were fluency in letter formation, fluency in letter connections, letter height, regularity of letter height, space between words, and line path. Mixed model analysis revealed improved quality of writing and speed for all children but significantly more improvement in handwriting quality for the children participating in the program. Although writing speed improved over time, no additional effects of the program occurred. 'I Can!' is found to be an effective instructive program to ameliorate handwriting quality in typically developing children with handwriting difficulties. The program's success was by a therapy burst of only 7 weeks focusing on the child's self-regulated learning capacities, within an individualized education plan according to their needs and goals.

Independent auto evaluation of an operative radiological protection program

International Nuclear Information System (INIS)

Medrano L, M.A.; Rodriguez C, C.C.; Linares R, D.; Zarate M, N.; Zempoalteca B, R.

2006-01-01

The program of operative radiological protection of a nuclear power plant consists of multiple procedures and associate tasks that have as purpose the radiological protection of the workers of the power station. It is for this reason that the constant evaluation of the one it programs it is an important tool in the identification of their weaknesses (and strengths), so they can be assisted appropriately. In this work the main elements of the program of independent auto evaluation of the program of operative radiological protection of the Laguna Verde Central that has been developed and implemented by the National Institute of Nuclear Research are described. (Author)

Taiwan Teacher Preparation Program Evaluation: Some Critical Perspectives

Science.gov (United States)

Liu, Tze-Chang

2015-01-01

This paper focuses on the influences and changes of recent Taiwan teacher preparation program evaluation (TTPPE) as one of the national evaluation projects conducted by the Higher Education Evaluation and Accreditation Council of Taiwan. The main concerns are what kind of ideology is transformed through the policy by means of evaluation, and what…

An evaluation of an aggression management training program to cope with workplace violence in the healthcare sector.

Science.gov (United States)

Oostrom, Janneke K; van Mierlo, Heleen

2008-08-01

Workplace violence is a major occupational hazard for healthcare workers, generating a need for effective intervention programs. The purpose of this study was to evaluate the effectiveness of an aggression management training program. The evaluation design was based on the internal referencing strategy, an unobtrusive and applicable evaluation method that rules out some major threats to internal validity without the need for a control group. On three occasions, training participants completed a questionnaire containing experimental and control variables. As hypothesized, there was a significant improvement in the experimental variables that was larger than the non-significant change in the control variable. We conclude that aggression management training may be an effective instrument in the fight against workplace violence. 2008 Wiley Periodicals, Inc

Evolution of a multilevel framework for health program evaluation.

Science.gov (United States)

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Effectiveness of a Death-Education Program in Reducing Death Anxiety of Nursing Students.

Science.gov (United States)

Johansson, Noreen; Lally, Terry

1991-01-01

Evaluated effectiveness of death education program in reducing death anxiety experienced by 22 junior and senior nursing students. Subjects were pre- and posttested with State Form of State-Trait Anxiety Inventory and viewed film of death experience. Posttest analysis indicated that death education program was effective in decreasing death anxiety…

Effects of a Self-Management Educational Program for the Control of Childhood Asthma.

Science.gov (United States)

Perez, Maria Gabriela; Feldman, Lya; Caballero, Fernan

1999-01-01

Evaluates the effects of a self-management educational program on 29 children and their parents. Program consists of six sessions of information giving and cognitive-behavioral strategies for the children, and two talks and a brochure for the parents. Results indicate a significant effect on children's asthma knowledge and practice of…

Organizational Structures that Support Internal Program Evaluation

Science.gov (United States)

Lambur, Michael T.

2008-01-01

This chapter explores how the structure of large complex organizations such as Cooperative Extension affects their ability to support internal evaluation of their programs and activities. Following a literature review of organizational structure and its relation to internal evaluation capacity, the chapter presents the results of interviews with…

Evaluating the effectiveness of a laboratory-based professional development program for science educators.