Development of detailed analysis program for high-temperature crack growth evaluation

Energy Technology Data Exchange (ETDEWEB)

Takahashi, Yukio; Nakayama, Yasunari [Central Research Inst. of Electric Power Industry, Komae, Tokyo (Japan). Komae Research Lab

2001-04-01

Evaluation of crack growth as well as crack initiation is necessary to make realistic evaluation of structural integrity and life management of high-temperature plant components. Domain integral formulae for three kinds of nonlinear fracture mechanics parameters, i.e. J-integral, fatigue J-integral range and creep J-integral were derived for two-dimensional, three-dimensional and axi-symmetrical structures. Furthermore, methods for applying them to finite element results were derived and a computer program was developed for the general-purpose finite element program, MARC. The program was applied to various problems and its effectiveness was demonstrated. (author)

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

Science.gov (United States)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Professional Development through Organizational Assessment: Using APPA's Facilities Management Evaluation Program

Science.gov (United States)

Medlin, E. Lander; Judd, R. Holly

2013-01-01

APPA's Facilities Management Evaluation Program (FMEP) provides an integrated system to optimize organizational performance. The criteria for evaluation not only provide a tool for organizational continuous improvement, they serve as a compelling leadership development tool essential for today's facilities management professional. The senior…

SIMS analysis: Development and evaluation program summary

International Nuclear Information System (INIS)

Groenewold, G.S.; Appelhans, A.D.; Ingram, J.C.; Delmore, J.E.; Dahl, D.A.

1996-11-01

This report provides an overview of the ''SIMS Analysis: Development and Evaluation Program'', which was executed at the Idaho National Engineering Laboratory from mid-FY-92 to the end of FY-96. It should be noted that prior to FY-1994 the name of the program was ''In-Situ SIMS Analysis''. This report will not go into exhaustive detail regarding program accomplishments, because this information is contained in annual reports which are referenced herein. In summary, the program resulted in the design and construction of an ion trap secondary ion mass spectrometer (IT-SIMS), which is capable of the rapid analysis of environmental samples for adsorbed surface contaminants. This instrument achieves efficient secondary ion desorption by use of a molecular, massive ReO 4 - primary ion particle. The instrument manages surface charge buildup using a self-discharging principle, which is compatible with the pulsed nature of the ion trap. The instrument can achieve high selectivity and sensitivity using its selective ion storage and MS/MS capability. The instrument was used for detection of tri-n-butyl phosphate, salt cake (tank cake) characterization, and toxic metal speciation studies (specifically mercury). Technology transfer was also an important component of this program. The approach that was taken toward technology transfer was that of component transfer. This resulted in transfer of data acquisition and instrument control software in FY-94, and ongoing efforts to transfer primary ion gun and detector technology to other manufacturers

Advanced gas cooled nuclear reactor materials evaluation and development program

International Nuclear Information System (INIS)

1977-01-01

Results of work performed from January 1, 1977 through March 31, 1977 on the Advanced Gas Cooled Nuclear Reactor Materials Evaluation and Development Program are presented. The objectives of this program are to evaluate candidate alloys for Very High Temperature Reactor (VHTR) Process Heat and Direct Cycle Helium Turbine (DCHT) applications, in terms of the effect of simulated reactor primary coolant (impure Helium), high temperatures, and long time exposures, on the mechanical properties and structural and surface stability of selected candidate alloys. A second objective is to select and recommend materials for future test facilities and more extensive qualification programs. Work covered in this report includes progress to date on alloy selection for VHTR Nuclear Process Heat (NPH) applications and for DCHT applications. The present status on the simulated reactor helium loop design and on designs for the testing and analysis facilities and equipment is discussed

Character Development Pilot Evaluation of Two Programs for Youth with Chronic Illness

Directory of Open Access Journals (Sweden)

Gary Maslow

2016-05-01

Full Text Available This article describes the pilot evaluation of two Positive Youth Development (PYD programs for youth with child onset chronic illness (COCI, reporting how the programs influenced participants’ character development. College students with COCI led high school students with COCI through activities pertaining to different aspects of growing up with a chronic illness. Participants completed the Positive Youth Development Inventory-Short Form (PYDI-S, which measures seven domains of youth perceptions of the contribution to their development from the program. Participants reported that both programs helped them the most with personal standards, which corresponds well to character development on the full version of the Positive Youth Development Inventory (PYDI. They also had high scores on prosocial behavior and future orientation, both important domains for character development. We discuss the idea that interventions promoting character development for youth with COCI are critical for promoting a positive narrative for chronically-ill youth, their parents, and society.

Evaluation of an international faculty development program for developing countries in Asia: the Seoul Intensive Course for Medical Educators.

Science.gov (United States)

Kim, Do-Hwan; Yoon, Hyun Bae; Sung, Minsun; Yoo, Dong-Mi; Hwang, Jinyoung; Kim, Eun Jung; Lee, Seunghee; Shin, Jwa-Seop

2015-12-18

The issue of collaboration in medical education is becoming prominent. Some faculty development programs have suggested an approach for promoting collaboration on a global level. However, non-English-speaking developing countries in Asia, especially in Southeast Asia, do not take advantage of them due to their unique context, such as language and culture. To address these issues, Seoul National University College of Medicine initiated a 6-week international faculty development program called the "Seoul Intensive Course for Medical Educators" for 16 fellows from five Asian countries (Cambodia, Laos, Mongolia, Myanmar, and Vietnam). The aim of this study is to report the evaluation results of the outcome of the program and discuss better ways of collaborating with developing countries. Three levels of collaboration-intraorganizational, intranational, and international-were central initiatives of the program. Prior to setting up the program details, we first established four design principles, following which the contents, materials, and facilitators were determined to maintain consistency with the design principles. The evaluation of the program was done with Kirkpatrick's four-level model. Most of the evaluation data for level 1 were collected by two questionnaires, the post-module survey and the post-program survey. Portfolios and progress reports were mainly used to collect outcome data for levels 2 and 3, respectively. The reaction was generally positive throughout the program and there was a significant correlation between satisfaction and relevance to one's job or needs. Despite the fellows' propensity for overestimating themselves, both the evaluators and fellows reported that there was significant improvement in learning. Opinions on the impact or urgency of the topics were slightly different from country to country; however, the answers regarding feasibility were fairly similar. Moreover, we could observe from the post-program progress reports that the

Enhancing pediatric residents’ scholar role: the development of a Scholarly Activity Guidance and Evaluation program

Directory of Open Access Journals (Sweden)

Catherine M. Pound

2015-06-01

Full Text Available Background: Research training is essential to the development of well-rounded physicians. Although many pediatric residency programs require residents to complete a research project, it is often challenging to integrate research training into educational programs. Objective: We aimed to develop an innovative research program for pediatric residents, called the Scholarly Activity Guidance and Evaluation (SAGE program. Methods: We developed a competency-based program which establishes benchmarks for pediatric residents, while providing ongoing academic mentorship. Results: Feedback from residents and their research supervisors about the SAGE program has been positive. Preliminary evaluation data have shown that all final-year residents have met or exceeded program expectations. Conclusions: By providing residents with this supportive environment, we hope to influence their academic career paths, increase their research productivity, promote evidence-based practice, and ultimately, positively impact health outcomes.

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

[Evaluating training programs on occupational health and safety: questionnaire development].

Science.gov (United States)

Zhou, Xiao-Yan; Wang, Zhi-Ming; Wang, Mian-Zhen

2006-03-01

To develop a questionnaire to evaluate the quality of training programs on occupational health and safety. A questionnaire comprising five subscales and 21 items was developed. The reliability and validity of the questionnaire was tested. Final validation of the questionnaire was undertaken in 700 workers in an oil refining company. The Cronbach's alpha coefficients of the five subscales ranged from 0.6194 to 0.6611. The subscale-scale Pearson correlation coefficients ranged from 0.568 to 0.834 . The theta coefficients of the five subscales were greater than 0.7. The factor loadings of the five subscales in the principal component analysis ranged from 0.731 to 0.855. Use of the questionnaire in the 700 workers produced a good discriminability, with excellent, good, fair and poor comprising 22.2%, 31.2%, 32.4% and 14.1 respectively. Given the fact that 18.7% of workers had never been trained and 29.7% of workers got one-off training only, the training program scored an average of 57.2. The questionnaire is suitable to be used in evaluating the quality of training programs on occupational health and safety. The oil refining company needs to improve training for their workers on occupational health and safety.

Development of a program for evaluating the temperature of SMART-P fuel rod

Energy Technology Data Exchange (ETDEWEB)

Cheon, Jin Sik; Lee, Byung Ho; Koo, Yang Hyun; Oh, Je Yong; Yim, Jeong Sik; Sohn, Dong Seong

2003-11-01

A code for evaluating the temperature of SMART-P fuel rod has been developed. Finite Element (FE) method is adopted for the developed code sharing the user subroutines which has been prepared for the ABAQUS commercial FE code. The developed program for SMART-P fuel rod corresponds to a nonlinear transient heat transfer problem, and uses a sparse matrix solver for FE equations during iterations at every time step. The verifications of the developed program were conducted using the ABAQUS code. Steady state and transient problems were analyzed for 1/8 rod model due to the symmetry of the fuel rod and full model. From the evaluation of temperature for the 1/8 rod model at steady state, maximal error of 0.18 % was present relative to the ABAQUS result. Analysis for the transient problem using the fuel rod model resulted in the same as the variation of centerline temperature from the ABAQUS code during a hypothetical power transient. Also, given a power depression in fuel meat as a function of burnup, its effect on the centerline temperature was more precisely evaluated by the developed program compared to the ABAQUS code. The distribution of heat flux for the entire cross section and surface was almost identical for the two codes.

Impacting Binational Health through Leadership Development: A Program Evaluation of the Leaders across Borders Program, 2010–2014

Directory of Open Access Journals (Sweden)

Omar A. Contreras

2017-08-01

Full Text Available BackgroundWorkforce and leadership development is imperative for the advancement of public health along the U.S./Mexico border. The Leaders across borders (LaB program aims to train the public health and health-care workforce of the border region. The LaB is a 6-month intensive leadership development program, which offers training in various areas of public health. Program curriculum topics include: leadership, border health epidemiology, health diplomacy, border public policies, and conflict resolution.MethodsThis article describes the LaB program evaluation outcomes across four LaB cohort graduates between 2010 and 2014. LaB graduates received an invitation to participate via email in an online questionnaire. Eighty-five percent (n = 34 of evaluation participants indicated an improvement in the level of binationality since participating in the LaB program. Identified themes in the evaluation results included increased binational collaborations and partnerships across multidisciplinary organizations that work towards improving the health status of border communities. Approximately 93% (n = 37 of the LaB samples were interested in participating in future binational projects while 80% (n = 32 indicated interest in the proposal of other binational initiatives. Participants expressed feelings of gratitude from employers who supported their participation and successful completion of LaB.DiscussionPrograms such as LaB are important in providing professional development and education to a health-care workforce along the U.S./Mexico border that is dedicated to positively impacting the health outcomes of vulnerable populations residing in this region.

Development and Evaluation of Science and Technology Education Program Using Interferometric SAR

Science.gov (United States)

Ito, Y.; Ikemitsu, H.; Nango, K.

2016-06-01

This paper proposes a science and technology education program to teach junior high school students to measure terrain changes by using interferometric synthetic aperture radar (SAR). The objectives of the proposed program are to evaluate and use information technology by performing SAR data processing in order to measure ground deformation, and to incorporate an understanding of Earth sciences by analyzing interferometric SAR processing results. To draft the teaching guidance plan for the developed education program, this study considers both science and technology education. The education program was used in a Japanese junior high school. An educational SAR processor developed by the authors and the customized Delft object-oriented radar interferometric software package were employed. Earthquakes as diastrophism events were chosen as practical teaching materials. The selected events indicate clear ground deformation in differential interferograms with high coherence levels. The learners were able to investigate the ground deformations and disasters caused by the events. They interactively used computers and became skilled at recognizing the knowledge and techniques of information technology, and then they evaluated the technology. Based on the results of pre- and post-questionnaire surveys and self-evaluation by the learners, it was clarified that the proposed program was applicable for junior high school education, and the learners recognized the usefulness of Earth observation technology by using interferometric SAR. The usefulness of the teaching materials in the learning activities was also shown through the practical teaching experience.

Integrating design science theory and methods to improve the development and evaluation of health communication programs.

Science.gov (United States)

Neuhauser, Linda; Kreps, Gary L

2014-12-01

Traditional communication theory and research methods provide valuable guidance about designing and evaluating health communication programs. However, efforts to use health communication programs to educate, motivate, and support people to adopt healthy behaviors often fail to meet the desired goals. One reason for this failure is that health promotion issues are complex, changeable, and highly related to the specific needs and contexts of the intended audiences. It is a daunting challenge to effectively influence health behaviors, particularly culturally learned and reinforced behaviors concerning lifestyle factors related to diet, exercise, and substance (such as alcohol and tobacco) use. Too often, program development and evaluation are not adequately linked to provide rapid feedback to health communication program developers so that important revisions can be made to design the most relevant and personally motivating health communication programs for specific audiences. Design science theory and methods commonly used in engineering, computer science, and other fields can address such program and evaluation weaknesses. Design science researchers study human-created programs using tightly connected build-and-evaluate loops in which they use intensive participatory methods to understand problems and develop solutions concurrently and throughout the duration of the program. Such thinking and strategies are especially relevant to address complex health communication issues. In this article, the authors explore the history, scientific foundation, methods, and applications of design science and its potential to enhance health communication programs and their evaluation.

The Impact of a Developed Measurement and Evaluation Development Program on Pre-Service Physical Education Teachers' Perceptions Related to Measurement and Evaluation

Science.gov (United States)

Arslan, Yunus; Erturan Ilker, Gokce; Demirhan, Giyasettin

2013-01-01

The purpose of this study was to investigate the impact of the Measurement and Evaluation Development Program on pre-service physical education teachers' general perceptions and competency perceptions related to alternative assessment in physical education, and their competency perceptions related to educational measurement and evaluation. The…

Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

Science.gov (United States)

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2014-03-01

Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

Science.gov (United States)

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

Building capacity for change: evaluation of an organisation-wide leadership development program.

Science.gov (United States)

Schultz, Tim; Shoobridge, Jodie; Harvey, Gill; Carter, Libby; Kitson, Alison

2018-05-23

Objective. This study evaluated Leading 4 Change, a change leadership development program designed to support healthcare middle managers through a period of significant organisational change and enhance workplace resilience. Methods. A mixed methods evaluation was conducted within the program's framework of a quality improvement activity. Quantitative measures were participant responses (n=160) to online questionnaires, which were compared before and after the program, using an uncontrolled pre-post study design. Four questionnaires were used: Resilience @ Work, General Self-Efficacy, the 11-item Learning Organization Survey and organisational climate. Differences between the pre- and post-program periods were compared using linear mixed-effects models, incorporating repeated measures between 'pre' and 'post' periods. Qualitative data were obtained by interviewing four participants on three occasions during the program, and through text responses provided by participants during a presentation session after the program finished. Both interview data and textual data were subjected to thematic analysis. Results. Integration of data from quantitative and qualitative analyses generated three main findings: (1) participants were satisfied and engaged with the program, which met their learning objectives; (2) the program led to increased workplace resilience, in particular the ability to manage stress and self-efficacy for individuals; and (3) organisational learning perceptions were unchanged. Conclusion. Although conducted during a period of intense internal and external pressure, Leading 4 Change led to demonstrable effects. It effectively engaged middle managers across a health system. However, there was no evidence that the effect of the program extended beyond individual participants to their perceptions of their work environment as a learning organisation. What is known about the topic? Although much has been written about change management and change leadership

Evaluating a Graduate Professional Development Program for Informal Science Educators

Science.gov (United States)

Lake, Jeremy Paul

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the Informal Science Institutions Environmental Education Graduate Certificate Program truly provided the long term professional development needed to enhance the skills of the formal and informal educators participating so that they could contribute meaningfully to the improvement of science literacy in their respective communities. My role as an internal evaluator provided an extraordinary opportunity to know the intent of the learning opportunities and why they were constructed in a particular fashion. Through the combination of my skills, personal experiences both within the certificate's predecessor and as an educator, I was uniquely qualified to explore the outcomes of this program and evaluate its effectiveness in providing a long-term professional development for participants. After conducting a literature review that emphasized a need for greater scientific literacy in communities across America, it was evident that the formal education enterprise needs the support of informal educators working on the ground in myriad different settings in ways that provide science as both content and process, learning science facts and doing real science. Through a bridging of informal science educators with formal teachers, it was thought each could learn the culture of the other, making each more fluent in accessing community resources to help make these educators more collaborative and able to bridge the classroom with the outside world. This bridge promotes ongoing, lifelong learning, which in turn can help the national goal of greater scientific literacy. This study provided insight into the thinking involved in the learners' growth as they converted theory presented in course materials into practice. Through an iterative process of reviewing the course

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

Science.gov (United States)

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

Approximately 474 000 Indigenous people live in 617 First Nations communities across Canada; 125 of those communities are located in Ontario, primarily in rural and remote areas. Common rural health challenges, including for palliative care, involve quality and access. The need for culturally relevant palliative care programs in First Nations communities is urgent because the population is aging with a high burden of chronic and terminal disease. Because local palliative care is lacking, most First Nations people now leave their culture, family and community to receive care in distant hospitals or long-term care homes. Due to jurisdictional issues, a policy gap exists where neither federal nor provincial governments takes responsibility for funding palliative care in First Nations communities. Further, no Canadian program models existed for how different levels of government can collaborate to fund and deliver palliative care in First Nations communities. This article describes an innovative, community-based palliative care program (Wiisokotaatiwin) developed in rural Naotkamegwanning, and presents the results of a process evaluation of its pilot implementation. The evaluation aimed to (i) document the program's pilot implementation, (ii) assess progress toward intended program outcomes and (iii) assess the perceived value of the program. The Wiisokotaatiwin Program was developed and implemented over 5 years using participatory action research (http://www.eolfn.lakeheadu.ca). A mixed-method evaluation approach was adopted. Descriptive data were extracted from program documents (eg client registration forms). Client tracking forms documented service provision data for a 4-month sample period. Quantitative and qualitative data were collected through client and family member questionnaires (n=7) and healthcare provider questionnaires (n=22). A focus group was conducted with the program leadership team responsible for program development. Quantitative data were

Developing a hazmat incident evaluation program

International Nuclear Information System (INIS)

Williams, D.L.; Kaikumba, F.

1991-01-01

This paper reports that all communities are at risk of experiencing a hazardous materials incident, whether in transportation or at a fixed facility (such as petroleum refineries, oil fields, processing plants, etc.). However, many communities are unprepared to cope with this emergency. Administrators of state agencies and local response organizations often face fierce competition for tax dollars in support of their hazardous materials emergency response programs. Historically, little statistical information has been available to support their call for additional budget dollars in the areas of personnel, training, and equipment. It is difficult to plan for an emergency when you have little understanding of the risks, the frequency of incidents, the type of chemicals generally involved, and other vital information. The Illinois Hazardous Materials Incident Evaluation Program was designed to address the state and local needs, and position government and industry in a more responsive and proactive mode. The result is a program that works

Evaluation of a Classwide Teaching Program for Developing Preschool Life Skills

Science.gov (United States)

Hanley, Gregory P.; Heal, Nicole A.; Tiger, Jeffrey H.; Ingvarsson, Einar T.

2007-01-01

Recently, nonmaternal center-based child care has been linked to problem behavior in young children (National Institute of Child Health and Human Development, 2003). In response, a comprehensive program to promote prosocial skills was evaluated in a classroom of 16 children between the ages of 3 years and 5 years. Classroom observations were…

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

Evaluation of a class wide teaching program for developing preschool life skills.

Science.gov (United States)

Hanley, Gregory P; Heal, Nicole A; Tiger, Jeffrey H; Ingvarsson, Einar T

2007-01-01

Recently, nonmaternal center-based child care has been linked to problem behavior in young children (National Institute of Child Health and Human Development, 2003). In response, a comprehensive program to promote prosocial skills was evaluated in a classroom of 16 children between the ages of 3 and 5 years. Classroom observations were conducted during evocative situations to determine the likelihood of problem behavior (noncompliance, vocal or motor disruptions, aggression) and preschool life skills. A classwide teaching program was then implemented in a staggered manner across instruction following, functional communication, delay tolerance, and friendship skills. These four categories of preschool life skills, which included two to four related skills, were selected for classwide teaching because they were either identified by educators as important for early school success, have often been taught following functional assessments of more severe problem behavior, or both. Skills were taught on a classwide basis during typically scheduled activities (circle, free play, transitions, meals) via instructions, modeling, role play, and feedback. A multiple probe design showed that the program resulted in an 74% reduction in problem behavior and a more than four-fold increase in preschool life skills. Similar beneficial effects of the program were evident in questionnaire data gathered prior to and at the close of the evaluation. Finally, the teachers who implemented the program reported overall high levels of satisfaction with the classwide teaching program, the target skills, and the results. Implications for the design of early childhood experiences for preempting the development of serious problem behavior are discussed.

Faculty Development Effectiveness: Insights from a Program Evaluation

Directory of Open Access Journals (Sweden)

Anupma Wadhwa

2014-01-01

Full Text Available Background. Faculty development programs are often time and resource intensive. In order to accommodate time constrained clinicians a limited time commitment faculty development program was developed and was shown to be effective in improving participant’s scholarly productivity. Objectives. The objective of this study was to assess participants’ perceptions of why the faculty development program was effective in promoting scholarship in education. Methods. In-depth semistructured interviews of course participants were conducted a year after completing a faculty development program. The interviews were audiotaped and transcribed verbatim. The transcriptions were coded independently by the investigators for dominant themes. The investigators held coding meetings to further refine the themes and discrepancies were handled by referring to the transcripts and reaching consensus. Results. The participants’ satisfaction with the course as described in the interviews correlated with the early satisfaction surveys. Reasons offered for this impact fell into four broad categories: course content, course format, social networking during the course, and the course facilitation coaching strategies to achieve goals. Conclusions. Course focusing on the process, experiential learning, and situating the course facilitator in the role of a functional mentor or coach to complete projects can be effective in facilitating behaviour change after faculty development programs.

Use of qualitative analysis to supplement program evaluation of a faculty development program

Directory of Open Access Journals (Sweden)

Thomas V Chacko

2013-01-01

Full Text Available Introduction: Generally for Program Evaluation of workshops, a structured questionnaire is used to measure learner satisfaction and learning and it yields results in quantitative terms and if there are open-ended questions, it yields a long list of responses which the evaluator finds it difficult to use. Hence, we used qualitative research methods to supplement it for a holistic understanding of the quality and extent of their learning. Materials and Methods: A faculty development program was used opportunistically to gather data using open-ended questions designed to elicit "thick descriptions" about their learning. Using the Grounded Theory approach where the data drives further analysis, data analysis was done by faculty in three groups using inductive reasoning leading to emergence of themes and categories of responses. The commonalities in the themes that emerged independently in the three groups as well as member checking to seek their agreement with the group′s observation of the primary data were used to ensure validity of the findings. Results: Themes and categories of new learning in terms of knowledge, skills, attitudes and processes emerged which gives a better understanding of the extent of the learning and its applicability to future professional tasks. The open-ended questions encouraging participants to give "thick description" of their learning yielded many quotable quotes which indicate the quality of their learning. Conclusion: The use of open-ended questions and qualitative research method of data analysis using the Grounded Theory approach helps in holistic understanding of the focus and quality of learning that is not usually possible through quantitative research methods. Hence, it is recommended that when understanding of the extent and quality of learning is important, traditional method of program evaluation should be supplemented with qualitative research methods as they are more effective in convincing decision

Evaluation of a Positive Youth Development Program Based on the Repertory Grid Test

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2012-01-01

Full Text Available The repertory grid test, based on personal construct psychology, was used to evaluate the effectiveness of Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes in Hong Kong. One hundred and four program participants (n=104 were randomly invited to complete a repertory grid based on personal construct theory in order to provide both quantitative and qualitative data for measuring self-identity changes after joining the program. Findings generally showed that the participants perceived that they understood themselves better and had stronger resilience after joining the program. Participants also saw themselves as closer to their ideal selves and other positive role figures (but farther away from a loser after joining the program. This study provides additional support for the effectiveness of the Tier 1 Program of Project P.A.T.H.S. in the Chinese context. This study also shows that the repertory grid test is a useful evaluation method to measure self-identity changes in participants in positive youth development programs.

Development of the COMPRE-A Program for Evaluating Proliferation Resistance (PR) and Physical Protection (PP) of the Nuclear Facility

Energy Technology Data Exchange (ETDEWEB)

Kim, Sukhoon; Kim, Juyub; Shin, Kwangyoung [FNC Technology Co., Yongin (Korea, Republic of); Seo, Janghoon; Jang, Sungsoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2016-10-15

In order to make up for the limitation inherent in these methodologies, a new methodology called 'Comprehensive Methodology for PR and PP Evaluation (COMPRE)' is being developed by the Korea Institute of Nuclear Non-proliferation and Control (KINAC). Currently, a project for improving a computational program implementing the COMPRE methodology is ongoing in KINAC, and the 'COMPRE-A (i.e. COMPRE-Advanced model)' program was developed as part of this project. This paper describes details of the COMPRE-A program developed for establishing the platform corresponding to features of the evaluation factor derived for COMPRE, and for enhancing easiness of the result analysis through embodying the visualization and comparison tools for the evaluation result. As part of the project for improving a computational program implementing the COMPRE methodology, the COMPRE-A program was developed. This program provides not only the platform corresponding to features of the evaluation factor derived for COMPRE but also the visualization and comparison tools for enhancing easiness of the result analysis. The V and V for the developed program was performed through comparison with the result obtained by using MS-Excel for a sample case consisting of three (3) measures, six (6) sections and twenty-six (26) attributes. From the comparison result, it was confirmed that the risk in aspects of PR and PP at nuclear facilities could be quantitatively evaluated within the acceptable range using the COMPRE-A program.

Program Evaluation - Automotive Lightweighting Materials Program Research and Development Projects Assessment of Benefits - Case Studies No. 2

Energy Technology Data Exchange (ETDEWEB)

Das, S.

2003-01-23

This report is the second of a series of studies to evaluate research and development (R&D) projects funded by the Automotive Lightweighting Materials (ALM) Program of the Office of Advanced Automotive Technologies (OAAT) of the U.S. Department of Energy (DOE). The objectives of the program evaluation are to assess short-run outputs and long-run outcomes that may be attributable to the ALM R&D projects. The ALM program focuses on the development and validation of advanced technologies that significantly reduce automotive vehicle body and chassis weight without compromising other attributes such as safety, performance, recyclability, and cost. Funded projects range from fundamental materials science research to applied research in production environments. Collaborators on these projects include national laboratories, universities, and private sector firms, such as leading automobile manufacturers and their suppliers. Three ALM R&D projects were chosen for this evaluation: Design and Product Optimization for Cast Light Metals, Durability of Lightweight Composite Structures, and Rapid Tooling for Functional Prototyping of Metal Mold Processes. These projects were chosen because they have already been completed. The first project resulted in development of a comprehensive cast light metal property database, an automotive application design guide, computerized predictive models, process monitoring sensors, and quality assurance methods. The second project, the durability of lightweight composite structures, produced durability-based design criteria documents, predictive models for creep deformation, and minimum test requirements and suggested test methods for establishing durability properties and characteristics of random glass-fiber composites for automotive structural composites. The durability project supported Focal Project II, a validation activity that demonstrates ALM program goals and reduces the lead time for bringing new technology into the marketplace. Focal

Development and Evaluation of vetPAL, a Student-Led, Peer-Assisted Learning Program.

Science.gov (United States)

Bates, Lucy S W; Warman, Sheena; Pither, Zoe; Baillie, Sarah

Based on an idea from a final-year student, Bristol Veterinary School introduced vetPAL, a student-led, peer-assisted learning program. The program involved fifth-year (final-year) students acting as tutors and leading sessions for fourth-year students (tutees) in clinical skills and revision (review) topics. The initiative aimed to supplement student learning while also providing tutors with opportunities to further develop a range of skills. All tutors received training and the program was evaluated using questionnaires collected from tutees and tutors after each session. Tutees' self-rated confidence increased significantly in clinical skills and for revision topics. Advantages of being taught by students rather than staff included the informal atmosphere, the tutees' willingness to ask questions, and the relatability of the tutors. The small group size and the style of learning in the revision sessions (i.e., group work, discussions, and interactivity) were additional positive aspects identified by both tutees and tutors. Benefits for tutors included developing their communication and teaching skills. The training sessions were considered key in helping tutors feel prepared to lead sessions, although the most difficult aspects were the lack of teaching experience and time management. Following the successful pilot of vetPAL, plans are in place to make the program permanent and sustainable, while incorporating necessary changes based on the evaluation and the student leader's experiences running the program. A vetPAL handbook has been created to facilitate organization of the program for future years.

Development of program for evaluating the temperature of Zr-U metallic fuel rod

International Nuclear Information System (INIS)

Chun, J. S.; Lee, B. H.; Ku, Y. H.; Oh, J. Y.; Im, J. S.; Sohn, D. S.

2003-01-01

A code for evaluating the temperature of Zr-U metallic rod has been developed. Finite element (FE) method is adopted for the developed code sharing the user subroutines which has been prepared for the ABAQUS commercial FE code. The developed program for the Zr-U metallic fuel rod corresponds to a nonlinear transient heat transfer problem, and uses a sparse matrix solver for FE equations during iterations at every time step. The verifications of the developed program were conducted using the ABAQUS code. Steady state and transient problems were analyzed for 1/8 rod model due to the symmetry of the fuel rod and full model. From the evaluation of temperature for the 1/8 rod model at steady state, maximal error of 0.18 % was present relative to the ABAQUS result. Analysis for the transient problem using the fuel rod model resulted in the same as the variation of centerline temperature from the ABAQUS code during a hypothetical power transient. The distribution of heat flux for the entire cross section and surface was almost identical for the two codes

Development of the Integrated Performance Evaluation Program (IPEP) for the Department of Energy's Office of Environmental Management

International Nuclear Information System (INIS)

Lindahl, P.; Streets, E.; Bass, D.; Hensley, J.; Newberry, R.; Carter, M.

1995-01-01

Argonne National Laboratory (ANL) and DOE's Radiological and Environmental Sciences Laboratory (RESL), Environmental Measurements Laboratory (EML), and Grand Junction Project office (GJPO) are collaborating with DOE's Office of Environmental Management (EM), Analytical Services Division (ASD, EM-263) and the Environmental Protection Agency (EPA) to develop an Integrated Performance Evaluation Program (IPEP). The purpose of the IPEP is to integrate information from existing PE programs with expanded QA activities to develop information about the quality of radiological, mixed waste, and hazardous environmental sample analyses provided by all laboratories supporting EM programs. The IPEP plans to utilize existing PE programs when available and appropriate for use by DOE; new PE programs will be developed only when no existing program meets DOEs needs. Interagency Agreements have been developed between EPA and DOE to allow DOE to use major existing PE programs developed by EPA. In addition, the DOE radiological Quality Assessment Program (QAP) administered by EML is being expanded for use in EM work. RESL and GJPO are also developing the Mixed Waste Performance Evaluation Program (MAPEP) to provide radiological, inorganic, and organic analytes of interest to EM programs. The use of information from multiple PE programs will allow a more global assessment of an individual laboratory's performance, as well as providing a means of more fairly comparing laboratories' performances in a given analytical area. The EPEP will interact with other aspects of the ASD such as audit and methods development activities to provide an integrated system for assessment and improvement of data quality

[Development of a program theory as a basis for the evaluation of a dementia special care unit].

Science.gov (United States)

Adlbrecht, Laura; Bartholomeyczik, Sabine; Mayer, Hanna

2018-06-01

Background: An existing dementia special care unit should be evaluated. In order to build a sound foundation of the evaluation a deep theoretical understanding of the implemented intervention is needed, which has not been explicated yet. One possibility to achieve this is the development of a program theory. Aim: The aim is to present a method to develop a program theory for the existing living and care concept of the dementia special care unit, which is used in a larger project to evaluate the concept theory-drivenly. Method: The evaluation is embedded in the framework of van Belle et al. (2010) and an action model and a change model (Chen, 2015) is created. For the specification of the change model the contribution analysis (Mayne, 2011) is applied. Data were collected in workshops with the developers and the nurses of the dementia special care unit and a literature research concerning interventions and outcomes was carried out. The results were synthesized in a consens workshop. Results: The action model describes the interventions of the dementia special care unit, the implementers, the organization and the context. The change model compromises the mechanisms through which interventions achieve outcomes. Conclusions: The results of the program theory can be employed to choose data collection methods and instruments for the evaluation. On the basis of the results of the evaluation the program theory can be refined and adapted.

Development and evaluation of a leadership program for veterinary students.

Science.gov (United States)

Moore, D A; Klingborg, D J

2001-01-01

Leadership skills are important for many facets of professional life, but no known leadership training programs exist in North American veterinary schools. It was the purpose of this project to develop, deliver, and evaluate a leadership program for first-year veterinary students. Leadership attributes emphasized in the course included effective communication, openness to learning from others, self-awareness, commitment beyond self-interest, motivation, decision making, understanding issue complexity, and team building. The five-day course was delivered to 21 new veterinary students randomly selected just prior to their first-year orientation in the fall of 2000. Participants ranked themselves higher than non-participants in a post-course evaluation on their ability to be effective leaders. Participants reported an increase in self-confidence and a clearer understanding of their leadership roles. Participants also noted new support systems among co-participants and expressed a new ability to consider complex issues more broadly. Most reported that they frequently used enhanced skills in giving and receiving feedback and team building. Other leadership tools identified as valuable included negotiation, group dynamics, a structured approach to problem solving, time management, and an awareness of personal learning style preferences as a means to improve communication.

Evaluating professional development

CERN Document Server

Guskey, Thomas R

2000-01-01

This is a practical guide to evaluating professional development programs at five increasing levels of sophistication: participants' reaction to professional development; how much participants learned; evaluating organizational support and change; how participants use their new knowledge and skills; and improvements in student learning.

Development and process evaluation of a Web-based responsible beverage service training program.

Science.gov (United States)

Danaher, Brian G; Dresser, Jack; Shaw, Tracy; Severson, Herbert H; Tyler, Milagra S; Maxwell, Elisabeth D; Christiansen, Steve M

2012-09-22

Responsible beverage service (RBS) training designed to improve the appropriate service of alcohol in commercial establishments is typically delivered in workshops. Recently, Web-based RBS training programs have emerged. This report describes the formative development and subsequent design of an innovative Web-delivered RBS program, and evaluation of the impact of the program on servers' knowledge, attitudes, and self-efficacy. Formative procedures using focus groups and usability testing were used to develop a Web-based RBS training program. Professional alcohol servers (N = 112) who worked as servers and/or mangers in alcohol service settings were recruited to participate. A pre-post assessment design was used to assess changes associated with using the program. Participants who used the program showed significant improvements in their RBS knowledge, attitudes, and self-efficacy. Although the current study did not directly observe and determine impact of the intervention on server behaviors, it demonstrated that the development process incorporating input from a multidisciplinary team in conjunction with feedback from end-users resulted in creation of a Web-based RBS program that was well-received by servers and that changed relevant knowledge, attitudes, and self-efficacy. The results also help to establish a needed evidence base in support of the use of online RBS training, which has been afforded little research attention.

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

Science.gov (United States)

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Development and Implementation of a Web-based Evaluation System for an Internal Medicine Residency Program.

Science.gov (United States)

Rosenberg, Mark E.; Watson, Kathleen; Paul, Jeevan; Miller, Wesley; Harris, Ilene; Valdivia, Tomas D.

2001-01-01

Describes the development and implementation of a World Wide Web-based electronic evaluation system for the internal medicine residency program at the University of Minnesota. Features include automatic entry of evaluations by faculty or students into a database, compliance tracking, reminders, extensive reporting capabilities, automatic…

Process Evaluation for Improving K12 Program Effectiveness: Case Study of a National Institutes of Health Building Interdisciplinary Research Careers in Women's Health Research Career Development Program.

Science.gov (United States)

Raymond, Nancy C; Wyman, Jean F; Dighe, Satlaj; Harwood, Eileen M; Hang, Mikow

2018-06-01

Process evaluation is an important tool in quality improvement efforts. This article illustrates how a systematic and continuous evaluation process can be used to improve the quality of faculty career development programs by using the University of Minnesota's Building Interdisciplinary Research Careers in Women's Health (BIRCWH) K12 program as an exemplar. Data from a rigorous process evaluation incorporating quantitative and qualitative measurements were analyzed and reviewed by the BIRCWH program leadership on a regular basis. Examples are provided of how this evaluation model and processes were used to improve many aspects of the program, thereby improving scholar, mentor, and advisory committee members' satisfaction and scholar outcomes. A rigorous evaluation plan can increase the effectiveness and impact of a research career development plan.

Development of Safety Significance Evaluation Program for Accidents and Events in NPPs

International Nuclear Information System (INIS)

Yang, Hui Chang; Hong, Seok Jin; Cho, Nam Chul; Chung, Dae Wook; Lee, Chang Joo

2010-01-01

To evaluate the significance in terms of safety for the accidents and events occurred in nuclear power plants using probabilistic safety assessment techniques can provide useful insights to the regulator. Based on the quantified risk information of accident or event occurred, regulators can decide which regulatory areas should be focused than the others. To support these regulatory analysis activities, KINS-ASP program was developed. KINS-ASP program can supports the risk increase due to the occurred accidents or events by providing the graphic interfaces and linked quantification engines for the PSA experts and non- PSA acquainted regulators both

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

federal, state, and local initiatives. For example, the use of computerized audits has increased, cooling and baseload measures have been added, weatherization approaches tailored to the unique construction characteristics of mobile homes have been developed, the weatherization of large multifamily buildings has expanded and become more sophisticated, the flexibility to improve 'energy-related' health and safety has been provided, and leveraging with utilities, other state programs, and owners of large multifamily buildings has increased considerably. The Department of Energy tasked ORNL with planning the new evaluation in light of its experience in conducting the previous national evaluation and the metaevaluations. This preliminary evaluation plan, developed by ORNL, documents how the new national evaluation will be performed. In the remaining portion of this section, the purpose and fundamental questions the evaluation will address are identified and how these questions were derived is discussed.

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Development and application of course-embedded assessment system for program outcome evaluation in the Korean nursing education: A pilot study.

Science.gov (United States)

Park, Jee Won; Seo, Eun Ji; You, Mi-Ae; Song, Ju-Eun

2016-03-01

Program outcome evaluation is important because it is an indicator for good quality of education. Course-embedded assessment is one of the program outcome evaluation methods. However, it is rarely used in Korean nursing education. The study purpose was to develop and apply preliminarily a course-embedded assessment system to evaluate one program outcome and to share our experiences. This was a methodological study to develop and apply the course-embedded assessment system based on the theoretical framework in one nursing program in South Korea. Scores for 77 students generated from the three practicum courses were used. The course-embedded assessment system was developed following the six steps suggested by Han's model as follows. 1) One program outcome in the undergraduate program, "nursing process application ability", was selected and 2) the three clinical practicum courses related to the selected program outcome were identified. 3) Evaluation tools including rubric and items were selected for outcome measurement and 4) performance criterion, the educational goal level for the program, was established. 5) Program outcome was actually evaluated using the rubric and evaluation items in the three practicum courses and 6) the obtained scores were analyzed to identify the achievement rate, which was compared with the performance criterion. Achievement rates for the selected program outcome in adult, maternity, and pediatric nursing practicum were 98.7%, 100%, and 66.2% in the case report and 100% for all three in the clinical practice, and 100%, 100%, and 87% respectively for the conference. These are considered as satisfactory levels when compared with the performance criterion of "at least 60% or more". Course-embedded assessment can be used as an effective and economic method to evaluate the program outcome without running an integrative course additionally. Further studies to develop course-embedded assessment systems for other program outcomes in nursing

Evaluation of a District-Wide Inservice Professional Development Program for Science Teachers: Challenges Faced and Lessons Learned.

Science.gov (United States)

Dass, Pradeep Maxwell

Nation-wide dissemination of the Iowa Chautauqua Model for inservice professional development of K-12 science teachers has led to new professional development programs in many states. The Collier Chautauqua Program (CCP) implemented the Iowa Chautauqua model at the district level in Collier County, Florida. A formative evaluation of the…

Independent review of Oak Ridge HCTW test program and development of seismic evaluation criteria

International Nuclear Information System (INIS)

1995-05-01

Many of the existing buildings at the Oak Ridge Y-12 Plant are steel frame construction with unreinforced hollow clay tile infill walls (HCTW). The HCTW infill provides some lateral seismic resistance to the design/evaluation basis earthquake; however acceptance criteria for this construction must be developed. The basis for the development of seismic criteria is the Oak Ridge HCTW testing and analysis program and the target performance goals of DOE 5480.28 and DOE-STD-1020-94. This report documents and independent review of the testing and analysis program and development of recommended acceptance criteria for Oak Ridge HCTW construction. The HCTW test program included ''macro'' wall in-plane and out-of-plane tests, full-scale wall in-plane and out-of-plane tests, in-situ out-of-plane test, shake table tests, and masonry component tests

Development and Implementation of a Mental Health Work Rehabilitation Program: Results of a Developmental Evaluation.

Science.gov (United States)

Sylvain, Chantal; Durand, Marie-José; Velasquez Sanchez, Astrid; Lessard, Nathalie; Maillette, Pascale

2018-05-23

Purpose Long-term work disability due to common mental disorders (CMDs) is a growing problem. Yet optimal interventions remain unclear and little is known about implementation challenges in everyday practice. This study aimed to support and evaluate, in real time, the development and implementation of a work rehabilitation program (WRP) designed to promote post-CMD return-to-work (RTW). Methods A 2-year developmental evaluation was performed using a participatory approach. At program outset, the researchers held five work meetings to revise the program's logic model and discuss its underlying change theory with clinicians. Data collection tools used throughout the study period were structured charts of activities conducted with workers (n = 41); in-depth interviews with program clinicians and managers (n = 9); and participant observation during work meetings. Quantitative data were analyzed using descriptive statistics. Qualitative data underwent thematic analysis using a processual approach. Results Three types of activity were developed and implemented: individual and group interventions targeting workers, and joint activities targeting partners (physicians, employers, others). While worker-targeted activities were generally implemented as planned, joint activities were sporadic. Analysis of the implementation process revealed five challenges faced by clinicians. Determinants included clinicians, host organization, sociopolitical context and resources provided by the evaluation. Conclusion The program studied is original in that it is based on the best available scientific knowledge, yet adapted to contextual particularities. The identified implementation challenges highlight the need for greater importance to be placed on the external, non-program context to ensure sustainable implementation in everyday practice.

Standards & Criteria for the Development and Evaluation of a Comprehensive Employee Assistance Program.

Science.gov (United States)

Health Resources and Services Administration, Rockville, MD. Bureau of Health Care Delivery and Assistance.

This document was designed for use by persons or agencies interested in both establishing and evaluating employee assistance programs (EAP) for federal employees. It contains essential elements, standards, and assessment criteria which have been developed to assist in the planning and implementation of services, and to provide a framework for…

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Development and Evaluation of a Model-Supported Scientific Inquiry Training Program for Elementary Teachers in Indonesia

OpenAIRE

Chandra Ertikanto; Herpratiwi; Tina Yunarti; Post-graduate School of Mathematics Education, Faculty of Teacher Training and Education, University of Lampung, Indonesia,

2017-01-01

A teacher training program, named Model-Supported Scientific Inquiry Training Program (MSSITP) has been successfully developed to improve the inquiry skills of Indonesian elementary teachers. The skills enhanced by MSSITP are defining problems, formulating hypotheses, planning and doing investigations, drawing conclusions, and communicating the results. This teacher training program was evaluated by 48 teachers selected by stratified random sampling technique from 48 element...

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

A standardized motor imagery introduction program (MIIP) for neuro-rehabilitation: development and evaluation

OpenAIRE

Wondrusch, C.; Schuster-Amft, C.

2013-01-01

Background: For patients with central nervous system (CNS) lesions and sensorimotor impairments a solid motor imagery (MI) introduction is crucial to understand and use MI to improve motor performance. The study's aim was to develop and evaluate a standardized MI group introduction program (MIIP) for patients after stroke, multiple sclerosis (MS), Parkinson's disease (PD), and traumatic brain injury (TBI). Methods: Phase 1: Based on literature a MIIP was developed comprising MI theory (def...

A standardized motor imagery introduction program (MIIP) for neuro-rehabilitation: development and evaluation

OpenAIRE

Christine eWondrusch; Corina eSchuster; Corina eSchuster

2013-01-01

Background: For patients with central nervous system lesions and sensorimotor impairments a solid motor imagery (MI) introduction is crucial to understand and use MI to improve motor performance. The study’s aim was to develop and evaluate a standardized MI group introduction program (MIIP) for patients after stroke, multiple sclerosis, Parkinson’s disease, and traumatic brain injury. Methods:Phase 1: Based on literature a MIIP was developed comprising MI theory (definition, type, mode, persp...

A report on evaluation of research and development subjects in fiscal year 2001. Evaluation subject on the 'Middle- and long-term business program'

International Nuclear Information System (INIS)

2001-09-01

The middle- and long-term business program determined by the Japan Nuclear Cycle Development Institute (JNC) is for elucidation of middle- and long-term targets to be expanded by JNC and is a base to promote individual R and D. This program is to be revised at a chance established on new long-term plan on research, development and application of nuclear energy on November, 2000 by the Committee of Atomic Energy under consideration of condition change after March, 1999. This report is a summary of evaluation results on the present middle- and long-term business program established by JNC, especially at a center of its revised portion, as a form of opinion. The evaluated results are described on two forms of the subject evaluation committees on the fast reactor and fuel cycle and on the wastes processing and disposal. (G.K.)

Evaluation Program initiative

International Nuclear Information System (INIS)

Rich, B.L.

1987-01-01

The purpose of this paper is to provide the Department of Energy's (DOE) safeguards and security community with some insights on an important management initiative by the Office of Security Evaluations (OSE). The paper will present the ''what, where, who, when, and why'' of a new Evaluation Program. The Evaluation Program will be comprised of a continuing series of regular and special evaluations of DOE safeguards and security programs and policies. The evaluations will be integrative and ''crosscutting,'' i.e. will extend across DOE organizational lines. Evaluations will be offered as positive advisories to DOE managers with safeguards and security responsibilities and will not be rated. They will complement the ongoing OSE Inspection Program of inspections conducted by OSE's Inspection Division. The purpose for the evaluations is to establish an accurate and current assessment of the effectiveness and status of safeguards and security programs and policies and to provide DOE managers with required information on program and policy effectiveness

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emeral Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2007-03-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others.

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and Evaluation of the Efficiency of In-Service Training Program with the Theme of Peace Education

Science.gov (United States)

Basaran, Semra Demir; Karakurt, Sevgi Özden

2017-01-01

In this article, an in-service training program was developed and evaluated to improve the peace education competencies of primary school teachers. This program, named as In-Service Training Program with the Theme of Peace Education for Primary Teachers (BEHEP), was based on the system approach. The implementation was completed in 28 hours with…

Development of an Integrated Performance Evaluation Program (IPEP) for the Department of Energy's Office of Environmental Restoration and Waste Management

International Nuclear Information System (INIS)

Streets, W.E.; Ka; Lindahl, P.C.; Bottrell, D.; Newberry, R.; Morton, S.; Karp, K.

1993-01-01

Argonne National Laboratory (ANL), in collaboration with DOE's Radiological and Environmental Sciences Laboratory (RESL), Environmental Measurements Laboratory (EML), and Grand Junction Project Office (GJPO), is working with the Department of Energy (DOE) Headquarters and the US Environmental Protection Agency (EPA) to develop the Integrated Performance Evaluation Program (IPEP). The purpose of IPEP is to integrate performance evaluation (PE) information from existing PE programs with expanded quality assurance (QA) activities to develop information about the quality of radiological, mixed waste, and hazardous environmental sample analyses provided by all laboratories supporting DOE Environmental Restoration and Waste Management (EM) programs. The IPEP plans to utilize existing PE programs when available and appropriate for use by DOE-EM; new PE programs will be developed only when no existing program meets DOE's needs

Development and evaluation of addiction treatment programs in Latin America.

Science.gov (United States)

Marín-Navarrete, Rodrigo; Medina-Mora, María Elena; Pérez-López, Alejandro; Horigian, Viviana E

2018-07-01

The aim of this article is to present a state-of-the-art review of the scientific studies that have evaluated healthcare systems, services and programs for addiction treatment in Latin America. As a secondary aim, this article presents a brief description and analysis of the addiction prevention and treatment resources and programs available in Latin America, based on information from the ATLAS on Substance Use (ATLAS-SU) project led by the WHO. Substance use disorders (SUDs) are among the main causes associated with global burden of disease. Around the world, many initiatives have been proposed to promote policies to reduce substance use and reduce the impact of SUD, including integrating treatments into healthcare systems, increasing access to treatment programs and impacting outcome measures. In Latin America, multiple efforts have been implemented to improve addiction services and programs, although little is known about the impact they have generated. International studies report the availability of strategies and public inicitatives on prevention and treatment of addiction in Latin America. These studies also report established networks of public and private services that include prevention and detoxification programs, outpatient and residential treatment, and also social reintegration initiatives. However, despite these advances, information on the evaluation of the progress, results and impact of these programs is limited.

Development of an aging evaluation and life extension program for the Advanced Test Reactor

International Nuclear Information System (INIS)

Dwight, J.E. Jr.

1988-01-01

A life extension program has been developed for the US Department of Energy's Advanced Test Reactor. The program is an adaptation of life extension pilot programs at the Surry Unit 1 and Monticello generating stations and is being completed in three phases. In Phase 1, the critical plant components were identified. In Phase 2, existing lifetime analyses and support data for the critical components were reviewed. The results from the review give a preliminary indication that an overall plant lifetime in excess of forty years is feasible. In Phase 3, now in progress, detailed evaluations for component life extensions are being performed. 2 refs., 2 figs., 1 tab

Innovative Technology Development Program. Final summary report

International Nuclear Information System (INIS)

Beller, J.

1995-08-01

Through the Office of Technology Development (OTD), the U.S. Department of Energy (DOE) has initiated a national applied research, development, demonstration, testing, and evaluation program, whose goal has been to resolve the major technical issues and rapidly advance technologies for environmental restoration and waste management. The Innovative Technology Development (ITD) Program was established as a part of the DOE, Research, Development, Demonstration, Testing, and Evaluation (RDDT ampersand E) Program. The plan is part of the DOE's program to restore sites impacted by weapons production and to upgrade future waste management operations. On July 10, 1990, DOE issued a Program Research and Development Announcement (PRDA) through the Idaho Operations Office to solicit private sector help in developing innovative technologies to support DOE's clean-up goals. This report presents summaries of each of the seven projects, which developed and tested the technologies proposed by the seven private contractors selected through the PRDA process

Development and evaluation of a pharmacogenomics educational program for pharmacists.

Science.gov (United States)

Formea, Christine M; Nicholson, Wayne T; McCullough, Kristen B; Berg, Kevin D; Berg, Melody L; Cunningham, Julie L; Merten, Julianna A; Ou, Narith N; Stollings, Joanna L

2013-02-12

Objectives. To evaluate hospital and outpatient pharmacists' pharmacogenomics knowledge before and 2 months after participating in a targeted, case-based pharmacogenomics continuing education program.Design. As part of a continuing education program accredited by the Accreditation Council for Pharmacy Education (ACPE), pharmacists were provided with a fundamental pharmacogenomics education program.Evaluation. An 11-question, multiple-choice, electronic survey instrument was distributed to 272 eligible pharmacists at a single campus of a large, academic healthcare system. Pharmacists improved their pharmacogenomics test scores by 0.7 questions (pretest average 46%; posttest average 53%, p=0.0003).Conclusions. Although pharmacists demonstrated improvement, overall retention of educational goals and objectives was marginal. These results suggest that the complex topic of pharmacogenomics requires a large educational effort in order to increase pharmacists' knowledge and comfort level with this emerging therapeutic opportunity.

Office of Technology Development FY 1993 program summary: Office of Research and Development, Office of Demonstration, Testing and Evaluation. Revision 1

Energy Technology Data Exchange (ETDEWEB)

1994-02-01

This report summarizes significant FY93 programmatic information and accomplishments relevant to the individual activities within the Office of Technology Development Program for Research, Development, Demonstration, Testing, and Evaluation (RDDT&E). A brief discussion of the mission of the Office of Environmental Restoration and Waste Management (EM) and the Office of Technology Development is presented. An overview is presented of the major problem areas confronting DOE. These problem areas include: groundwater and soils cleanup; waste retrieval and processing; and pollution prevention. The organizational elements within EM are highlighted. An EM-50 Funding Summary for FY92 and FY93 is also provided. RDDT&E programs are discussed and their key problem areas are summarized. Three salient program-formulating concepts are explained. They are: Integrated Demonstrations, Integrated Programs, and the technology window of opportunity. Detailed information for each of the programs within RDDT&E is presented and includes a fact sheet, a list of technical task plans and an accomplishments and objectives section.

Office of Technology Development FY 1993 program summary: Office of Research and Development, Office of Demonstration, Testing and Evaluation. Revision 1

International Nuclear Information System (INIS)

1994-02-01

This report summarizes significant FY93 programmatic information and accomplishments relevant to the individual activities within the Office of Technology Development Program for Research, Development, Demonstration, Testing, and Evaluation (RDDT ampersand E). A brief discussion of the mission of the Office of Environmental Restoration and Waste Management (EM) and the Office of Technology Development is presented. An overview is presented of the major problem areas confronting DOE. These problem areas include: groundwater and soils cleanup; waste retrieval and processing; and pollution prevention. The organizational elements within EM are highlighted. An EM-50 Funding Summary for FY92 and FY93 is also provided. RDDT ampersand E programs are discussed and their key problem areas are summarized. Three salient program-formulating concepts are explained. They are: Integrated Demonstrations, Integrated Programs, and the technology window of opportunity. Detailed information for each of the programs within RDDT ampersand E is presented and includes a fact sheet, a list of technical task plans and an accomplishments and objectives section

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Development and Evaluation of an Economic-Driving Assistance Program for Transit Vehicles

OpenAIRE

Baoxin Han; Wanjing Ma; Hanzhou Xie

2012-01-01

This paper focuses on development and evaluation of an economic-driving assistance program for transit vehicles (EDTV) which can minimize energy consumption, air pollution emission of buses, and improve the level of service of transit system as well. Taking advantage of the latest advances in information and communication technologies, the EDTV system can provide bus drivers with optimal recommended bus holding times at near-side bus stops and dynamic bus speed to adapt to the real-time traff...

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Development and evaluation of a leadership training program for public health emergency response: results from a Chinese study

Directory of Open Access Journals (Sweden)

Xu Yihua

2008-10-01

Full Text Available Abstract Background Since the 9/11 attack and severe acute respiratory syndrome (SARS, the development of qualified and able public health leaders has become a new urgency in building the infrastructure needed to address public health emergencies. Although previous studies have reported that the training of individual leaders is an important approach, the systemic and scientific training model need further improvement and development. The purpose of this study was to develop, deliver, and evaluate a participatory leadership training program for emergency response. Methods Forty-one public health leaders (N = 41 from five provinces completed the entire emergency preparedness training program in China. The program was evaluated by anonymous questionnaires and semi-structured interviews held prior to training, immediately post-training and 12-month after training (Follow-up. Results The emergency preparedness training resulted in positive shifts in knowledge, self-assessment of skills for public health leaders. More than ninety-five percent of participants reported that the training model was scientific and feasible. Moreover, the response of participants in the program to the avian influenza outbreak, as well as the planned evaluations for this leadership training program, further demonstrated both the successful approaches and methods and the positive impact of this integrated leadership training initiative. Conclusion The emergency preparedness training program met its aims and objectives satisfactorily, and improved the emergency capability of public health leaders. This suggests that the leadership training model was effective and feasible in improving the emergency preparedness capability.

Development of a Logic Model to Guide Evaluations of the ASCA National Model for School Counseling Programs

Science.gov (United States)

Martin, Ian; Carey, John

2014-01-01

A logic model was developed based on an analysis of the 2012 American School Counselor Association (ASCA) National Model in order to provide direction for program evaluation initiatives. The logic model identified three outcomes (increased student achievement/gap reduction, increased school counseling program resources, and systemic change and…

Development and evaluation of a learner-centered educational summer camp program on soft skills for baccalaureate nursing students.

Science.gov (United States)

Lau, Ying; Wang, Wenru

2014-01-01

The objectives were to develop a learner-centered educational camp program for nursing students and to evaluate 4 areas of soft skills, communication ability, clinical interaction, interpersonal relationships, and social problem solving, before and after the program. The results showed that the summer camp program was effective in improving nursing students' soft skills.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

Assessing a GTA professional development program

OpenAIRE

Alicea-Muñoz, Emily; Masip, Joan Espar; Sullivan, Carol Subiño; Schatz, Michael F.

2018-01-01

For the last four years, the School of Physics at Georgia Tech have been preparing new Graduate Teaching Assistants (GTAs) through a program that integrates pedagogy, physics content, and professional development strategies. Here we discuss various assessments we have used to evaluate the program, among them surveys, GTA self-reporting, and end-of-semester student evaluations. Our results indicate that GTAs who participate in the program find its practical activities useful, feel better prepa...

An Evaluation of the Employee Training and Development Process for Nicolet Area Technical College's Basic Education Program.

Science.gov (United States)

Karl, Luis C.

The adult basic education (ABE) program at Nicolet Area Technical College (NATC) evaluated its training and development (T&D) process for new basic education instructors. The study gathered monitoring and screening criteria that addressed valuable components for use in an instrument for validating effectiveness of the ABE program (T&D)…

Development and evaluation of a peer-tutoring program for graduate students*.

Science.gov (United States)

Copeland, H Liesel; Kinzy, Terri Goss

2005-03-01

Many interdisciplinary Ph.D. programs admit students of different educational backgrounds who receive a first year of a general curriculum education. However, student preparation for this curriculum varies, and methods are needed to provide academic support. Graduate student peer tutoring was piloted as an initiative funded by a National Institutes of Health (NIH) Initiative for Minority Student Development award to the University of Medicine and Dentistry of New Jersey-Robert Wood Johnson Medical School (UMDNJ-RWJMS) and is now offered to all students in the interdisciplinary Molecular Biosciences Ph.D. program between Rutgers, The State University of New Jersey, and UMDNJ-RWJMS. Tutoring occurs individually or in small groups and has grown over the past 5 years in the number of students tutored and hours of tutoring. The program was evaluated by surveying and interviewing both tutors and students concerning process variables (e.g. awareness, frequency) and impact variables (e.g. perceived benefits, motivators), as well as by assessing changes in exam scores for the four core courses of the first-year graduate curriculum. Copyright © 2005 International Union of Biochemistry and Molecular Biology, Inc.

Misprescribing controlled substances: An evaluation of a professional development program.

Science.gov (United States)

Dewey, Charlene M; Ghulyan, Marine V; Swiggart, William H

2016-01-01

Controlled prescription drug (CPD) abuse has reached epidemic proportions in the United States. Most physicians attending a 3-day continuing medical education (CME) professional development program (PDP) lack training in identifying risk and in managing patients who misuse CPDs. To address this issue, the authors conducted an evaluation of a PDP that trains physicians on proper prescribing, identifying substance abuse, utilizing screening, brief intervention, and referral to treatment (SBIRT), and implementing motivational interviewing (MI). The authors conducted a program evaluation to assess the efficacy and impact of the PDP on physicians' knowledge and prescribing behaviors. Participants (N = 174) were typically middle-aged (average age of 53 years), male (89%), and physicians (82%) and other health care professionals (18%). Many physicians practice in solo primary care settings (46%). Course evaluations were completed by n = 155 (89%) participants who rated the course and presenters highly (mean 4.8/5 respectively). Physicians' knowledge scores on pre/post assessments increased significantly: pretest (M = 58.7, SD = 13.12) and posttest (M = 78.28, SD = 9.83) (t(173) = 20.06, P ≤ .0001, 95% confidence interval, CI: [-21.51, -17.65]). Almost half of the participants, n = 83/174 (48%), completed the follow-up survey, and 93% agreed/strongly agreed (A/SA) they made professional practice changes. Of participants practicing with an active DEA (Drug Enforcement Administration) registration (n = 57), most agreed/strongly agreed they implemented changes to align their practices with current guidelines (89%), used CPD more appropriately (87%), implemented office policies on prescribing (81%), identified and referred more substance abuse patients to treatment (80%), shared new information/experience from course with other 25 health professionals (93%), and felt the course positively impacted their behaviors personally and professionally (90% and 96%, respectively

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

An evaluation of a positive youth development program for adolescents with chronic illness.

Science.gov (United States)

Maslow, Gary; Adams, Cathleen; Willis, Matthew; Neukirch, Jodie; Herts, Kate; Froehlich, Wendy; Calleson, Diane; Rickerby, Michelle

2013-02-01

Youth with chronic illness often struggle transitioning to adulthood and adult medical care. This article examines the outcomes of a group mentoring program called The Adolescent Leadership Council (TALC) that brings together high school participants and college mentors, all with chronic illness. TALC uses a positive youth development (PYD) approach, emphasizing strong relationships between youth and adults in an environment where youth can learn important life skills and take a leadership role. A pre-/postprogram participant survey was conducted for high school participants using a loneliness scale and a transition readiness survey. An alumni survey was conducted with all high school and college mentor graduates to assess educational-, vocational-, and health care-related outcomes. Program records review and the alumni survey indicated that TALC was consistent with the PYD program model. Twenty high school students participated in the pre-/postprogram outcomes evaluation, which demonstrated a decrease in loneliness from 46 to 38.5 (p < .001) and an increase in health care self-advocacy from 3.8 to 4.2 (p < .001). Thirty-four alumni participated in the alumni survey. All high school and college mentor alumni had graduated from high school and college, respectively, and all were either currently in school or working. The majority of alumni were seeing adult providers for medical care. The TALC program applies the principles of PYD to support positive educational, vocational, and health care outcomes for youth with chronic illness. Program development using the PYD perspective is an important new approach for supporting adult development of youth with chronic illness. Copyright © 2013 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

Development and Evaluation of a Continuing Education Program for Nursing Technicians at a Pediatric Cardiac Intensive Care Unit in a Developing Country.

Science.gov (United States)

Borim, Bruna Cury; Croti, Ulisses A; Silveira, Patricia C; De Marchi, Carlos H; Moscardini, Airton C; Hickey, Patricia; Jenkins, Kathy

2017-11-01

The nursing profession faces continuous transformations demonstrating the importance of professional continuing education to extend knowledge following technological development without impairing quality of care. Nursing assistants and technicians account for nearly 80% of nursing professionals in Brazil and are responsible for uninterrupted patient care. Extensive knowledge improvement is needed to achieve excellence in nursing care. The objective was to develop and evaluate a continuing education program for nursing technicians at a pediatric cardiac intensive care unit (PCICU) using a virtual learning environment entitled EDUCATE. From July to September 2015, a total of 24 nursing technicians working at the PCICU at a children's hospital located in the northwestern region of São Paulo state (Brazil) fully participated in the continuing education program developed in a virtual learning environment using Wix platform, allowing access to video classes and pre- and post-training theoretical evaluation questionnaires outside the work environment. The evaluation tools recorded participants' knowledge evolution, technological difficulties, educational, and overall rating. Knowledge development was descriptively presented as positive in more than 66.7%. Content and training were considered "excellent" by most participants and 90% showed an interest in the use of technological resources. Technical difficulties were found and quickly resolved by 40% of participants including Internet access, login, and lack of technical expertise. The continuing education program using a virtual learning environment positively contributed to the improvement in theoretical knowledge of nursing technicians in PCICU.

Development of parallel/serial program analyzing tool

International Nuclear Information System (INIS)

Watanabe, Hiroshi; Nagao, Saichi; Takigawa, Yoshio; Kumakura, Toshimasa

1999-03-01

Japan Atomic Energy Research Institute has been developing 'KMtool', a parallel/serial program analyzing tool, in order to promote the parallelization of the science and engineering computation program. KMtool analyzes the performance of program written by FORTRAN77 and MPI, and it reduces the effort for parallelization. This paper describes development purpose, design, utilization and evaluation of KMtool. (author)

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

Development and Evaluation of a Model-Supported Scientific Inquiry Training Program for Elementary Teachers in Indonesia

Directory of Open Access Journals (Sweden)

Chandra Ertikanto

2017-07-01

Full Text Available A teacher training program, named Model-Supported Scientific Inquiry Training Program (MSSITP has been successfully developed to improve the inquiry skills of Indonesian elementary teachers. The skills enhanced by MSSITP are defining problems, formulating hypotheses, planning and doing investigations, drawing conclusions, and communicating the results. This teacher training program was evaluated by 48 teachers selected by stratified random sampling technique from 48 elementary schools in Bandar Lampung City, Lampung Province, Indonesia. The program was designed to follow Bandura’s stages of social learning: attention, retention, production, and motivation. The impact of MSSITP was evaluated in three ways. First, by analyzing the improvements of inquiry skills compared to conventional SITP through pretest and posttest control group design. Second, by using an inquiry questionnaire to describe teachers’ perceptions of inquiry learning. Last, by using a response instrument to elicit teachers’ opinions of the program. The results indicate a significant difference (sig 0.00 in teachers’ skills acquired from the two different training programs. Mean posttest scores, varying from 34.7 to 56.9 for the control group and 58.3 to 98.6 for the experimental group, confirmed the effectiveness of MSSITP.

Environmental assessment for the satellite power system concept development and evaluation program: nonmicrowave health and ecological effects

Energy Technology Data Exchange (ETDEWEB)

White, M R

1980-11-01

A Concept Development and Evaluation Program is being carried out for a proposed Satellite Power System (SPS). For purposes of this evaluation, a preliminary reference system has been developed. SPS, as described in the reference system, would collect solar energy on satellites in geosychronous orbit in space. The energy would be converted to microwaves and beamed to an earth-receiving antenna (rectenna). One task in the environmental part of the program is the assessment of the nonmicrowave effects on health and the environment. These effects would result from all phases of SPS development and operation. This report covers the current knowledge regarding these effects, and is based on the reference system. The assessment is summarized as to scope, methodology, impacts of terrestrial development, launch and recovery of spacecraft, space activities (including health effects of the space environment, ionizing radiation, electromagnetic exposure, spacecraft charging and environmental interactions, occupational hazards, etc.) and construction and operation of rectenna (ground receiving station).

Environmental assessment for the satellite power system concept development and evaluation program: nonmicrowave health and ecological effects

International Nuclear Information System (INIS)

White, M.R.

1980-11-01

A Concept Development and Evaluation Program is being carried out for a proposed Satellite Power System (SPS). For purposes of this evaluation, a preliminary reference system has been developed. SPS, as described in the reference system, would collect solar energy on satellites in geosychronous orbit in space. The energy would be converted to microwaves and beamed to an earth-receiving antenna (rectenna). One task in the environmental part of the program is the assessment of the nonmicrowave effects on health and the environment. These effects would result from all phases of SPS development and operation. This report covers the current knowledge regarding these effects, and is based on the reference system. The assessment is summarized as to scope, methodology, impacts of terrestrial development, launch and recovery of spacecraft, space activities (including health effects of the space environment, ionizing radiation, electromagnetic exposure, spacecraft charging and environmental interactions, occupational hazards, etc.) and construction and operation of rectenna

Satellite power system concept development and evaluation program system definition technical assessment report

Energy Technology Data Exchange (ETDEWEB)

1980-12-01

The results of the system definition studies conducted by NASA as a part of the Department of Energy/National Aeronautics and Space Administration SPS Concept Development and Evaluation Program are summarized. The purpose of the system definition efforts was to identify and define candidate SPS concepts and to evaluate the concepts in terms of technical and cost factors. Although the system definition efforts consisted primarily of evaluation and assessment of alternative technical approaches, a reference system was also defined to facilitate economic, environmental, and societal assessments by the Department of Energy. This reference system was designed to deliver 5 GW of electrical power to the utility grid. Topics covered include system definition; energy conversion and power management; power transmission and reception; structures, controls, and materials; construction and operations; and space transportation.

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Development of object oriented program `SONSHO` for strength evaluation. Manual of Version 4.0 program

Energy Technology Data Exchange (ETDEWEB)

Hosogai, Hiromi [Joyo Industries Co. Ltd., Tokai, Ibaraki (Japan); Kasahara, Naoto

1998-07-01

Object Oriented Program `SONSHO` predicts creep fatigue damage factors based on Elevated Temperature Structural Design Guide for `Monju` and other various procedures from stress classification data obtained from structural analysis results. From view point of program implementation, it is required that external programs interface and frequent revise from update of material and creep fatigue evaluation methods. Object oriented approach was continuously introduced to improve these aspects of the program. Version 4.0 has the following new functions. (1) Material strength library was implemented as an independent program module based on Microsoft Active X control and 32bitDLL technologies, which can be accessed by general Windows programs. (2) Self instruction system `Wizard` enables manual less operation. (3) Microsoft common object model (COM) was adopted for program interface, and this program can communicate with Excel sheet data on memory. Sonsho Ver.4.0 can work on Windows 95 or Windows NT4.0. Microsoft Visual Basic 5.0 (Enterprose Edition) and Microsoft FORTRAN Power Station 4.0 were adopted for program. (author)

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

[Development and evaluation of the Empowering A Self-Efficacy (EASE) program for children with epilepsy].

Science.gov (United States)

Yoo, Hana; Kim, Hee-Soon

2015-02-01

The purpose of this study was to verify effects of the Empowering A Self-Efficacy (EASE) program on self-efficacy, self-management, and child attitude toward illness in children with epilepsy. This was a quasi-experimental study with a non-equivalent control group pre-post test design. Participants were 10 to 15 year old children with epilepsy (11 in the experimental group and 10 in the control group) who were registered at one hospital in S city. The experimental group received the EASE program for 3 weeks. In the first week, a group meeting lasting 570 minutes was conducted on a single day. Over the next two weeks, telephone counselling was conducted twice a week. Data were analyzed using SPSS 18.0. There was a significant difference of pre-post evaluation of the epilepsy self-management scores in the experimental group. However, differences between the experimental group and the control group for seizure self-efficacy and child attitude toward illness were not significant. This is the first study in Korea to develop and evaluate an intervention program for children with epilepsy. Further studies are needed to confirm the effects of the EASE program.

Calculation and evaluation methodology of the flawed pipe and the compute program development

International Nuclear Information System (INIS)

Liu Chang; Qian Hao; Yao Weida; Liang Xingyun

2013-01-01

Background: The crack will grow gradually under alternating load for a pressurized pipe, whereas the load is less than the fatigue strength limit. Purpose: Both calculation and evaluation methodology for a flawed pipe that have been detected during in-service inspection is elaborated here base on the Elastic Plastic Fracture Mechanics (EPFM) criteria. Methods: In the compute, the depth and length interaction of a flaw has been considered and a compute program is developed per Visual C++. Results: The fluctuating load of the Reactor Coolant System transients, the initial flaw shape, the initial flaw orientation are all accounted here. Conclusions: The calculation and evaluation methodology here is an important basis for continue working or not. (authors)

The Development of the system of evaluation of public policies and programs in the Republic of Kazakhstan

Directory of Open Access Journals (Sweden)

Nigmetov Kaisar Kairkenovich

2014-07-01

Full Text Available This article discusses the features of the assessment in the Republic of Kazakhstan and abroad. Recommendations on further development of evaluation of public policies and programs in the Republic of Kazakhstan.

The Charlotte-Mecklenburg Teacher Career Development Program.

Science.gov (United States)

Schlechty, Phillip C.; And Others

1985-01-01

Effective training, evaluation, and incentives are key aspects of this school system's six-level career ladder program for teacher development. The three-pronged committee structure for planning and communication and the program's ownership by everyone involved have been vital to its successful planning and development. (DCS)

Conceptual framework for development of comprehensive e-health evaluation tool.

Science.gov (United States)

Khoja, Shariq; Durrani, Hammad; Scott, Richard E; Sajwani, Afroz; Piryani, Usha

2013-01-01

The main objective of this study was to develop an e-health evaluation tool based on a conceptual framework including relevant theories for evaluating use of technology in health programs. This article presents the development of an evaluation framework for e-health programs. The study was divided into three stages: Stage 1 involved a detailed literature search of different theories and concepts on evaluation of e-health, Stage 2 plotted e-health theories to identify relevant themes, and Stage 3 developed a matrix of evaluation themes and stages of e-health programs. The framework identifies and defines different stages of e-health programs and then applies evaluation theories to each of these stages for development of the evaluation tool. This framework builds on existing theories of health and technology evaluation and presents a conceptual framework for developing an e-health evaluation tool to examine and measure different factors that play a definite role in the success of e-health programs. The framework on the horizontal axis divides e-health into different stages of program implementation, while the vertical axis identifies different themes and areas of consideration for e-health evaluation. The framework helps understand various aspects of e-health programs and their impact that require evaluation at different stages of the life cycle. The study led to the development of a new and comprehensive e-health evaluation tool, named the Khoja-Durrani-Scott Framework for e-Health Evaluation.

Development of a Positive Youth Development Program: Helping Parents to Improve Their Parenting Skills

Directory of Open Access Journals (Sweden)

Daniel T.L. Shek

2006-01-01

Full Text Available The Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programs is a positive youth development program that attempts to promote holistic development in adolescents in Hong Kong. In the Tier 2 Program of this project, social workers are expected to develop positive youth development programs for adolescents having greater psychosocial needs. They are required to submit proposals that will be evaluated in terms of whether the proposals are evidence based, and appropriate evaluation mechanisms are included. With reference to the literature on parental control processes that Chinese parents may be loose in their behavioral control and they tend to overemphasize academic excellence, it is argued that improvement of the parenting skills of parents of Chinese adolescents is an important area to be addressed. To facilitate social workers to prepare the related proposals, a sample proposal on how to improve the parenting skills of Chinese parents is described, including its conceptual framework, proposed program, and evaluation plan. It is argued that this supportive approach (i.e., preparation of a sample proposal can help social workers to develop quality proposals on positive youth development programs in Hong Kong.

Evaluation of integrated child development services program in rajasthan, India

Directory of Open Access Journals (Sweden)

Madan Singh Rathore

2015-01-01

Full Text Available Background: The Integrated Child Development Services (ICDS scheme is the largest program for promotion of maternal and child health and nutrition. Aims: The present study is aimed to evaluate ICDS program in terms of infrastructure of anganwadi centers (AWCs, characteristics of anganwadi workers (AWWs, coverage of supplementary nutrition (SN, and preschool education (PSE to the beneficiaries. Methods: A total of 39 AWCs from a rural area and 15 from the urban area were surveyed. AWWs were interviewed, and records were reviewed. Information was collected using a predesigned and pretested questionnaire. Results: In the selected AWCs, 88.9% were running in Pucca buildings, 38.9% had electricity, 35.1% had a separate kitchen, 1.8% had cooking gas, and toilets were available in 59.3% AWCs. All the AWW have received job training, 83.3% AWW have received refresher training. 38.8% AWW have received orientation training, 37% have received skill training in World Health Organization growth standards and 18.5% AWW have received skill training in mother and child health. 86.9% registered pregnant women, 90.7% registered lactating women, 72.6% registered adolescent girls were availing SN. 95.4% registered children 6 months to 3 years and 92.4% registered children 3-6 years of age were availing SN. Interruption in SN in last 6 months was seen in 22.2% AWCs. Appropriate and adequate PSE material was available in 59.2% AWCs. Conclusion: There are program gaps in the infrastructure of AWCs, training of AWW, coverage of SN, interruption in the supply of SN.

Using insects for STEM outreach: Development and evaluation of the UA Insect Discovery Program

Science.gov (United States)

Beal, Benjamin D.

Science and technology impact most aspects of modern daily life. It is therefore important to create a scientifically literate society. Since the majority of Americans do not take college-level science courses, strong K-12 science education is essential. At the K-5 level, however, many teachers lack the time, resources and background for effective science teaching. Elementary teachers and students may benefit from scientist-led outreach programs created by Cooperative Extension or other institutions. One example is the University of Arizona Insect Discovery Program, which provides short-duration programing that uses insects to support science content learning, teach critical thinking and spark interest in science. We conducted evaluations of the Insect Discovery programming to determine whether the activities offered were accomplishing program goals. Pre-post tests, post program questionnaires for teachers, and novel assessments of children's drawings were used as assessment tools. Assessments were complicated by the short duration of the program interactions with the children as well as their limited literacy. In spite of these difficulties, results of the pre-post tests indicated a significant impact on content knowledge and critical thinking skills. Based on post-program teacher questionnaires, positive impacts on interest in science learning were noted as much as a month after the children participated in the program. New programming and resources developed to widen the potential for impact are also described.

The evaluation of a clinical development unit leadership preparation program by focus group interviews - part 2: negative aspects.

Science.gov (United States)

Greenwood, Jennifer; Parsons, Myra

2002-10-01

In Western Sydney, Australia, in 1996, the Area Health Service and the University of Western Sydney entered a strategic alliance to develop a nursing research culture in the health services. One of the strategies implemented to achieve this was the establishment of a network of research-receptive environments known as Clinical Development Units (CDUs). In terms of research receptivity, evidence at the time suggested that it could only be developed in units where the leadership style is democratic and participatory. In terms of CDUs, evidence suggested that their successful development depended critically on the effective management of CDU leadership stressors. In light of this, it was agreed to conduct a CDU leadership preparation program in Western Sydney. The program aimed to furnish CDU leaders with the participatory leadership skills required to develop and manage their units. It was expected that the acquisition of such leadership skills would serve to minimize the leadership stessors they could expect to experience. This is the second of two papers which report course evaluation data. The first focused on the more positive evaluation data; this paper focuses on the negative evaluation data and outlines how the current program has been modified in light of these data. In addition, it discusses two themes which emerged during data analysis. These were nurses' apparent mutual lack of trust and their pressing needs to be recognized as valuable and merit-worthy.

Back to the basics: identifying positive youth development as the theoretical framework for a youth drug prevention program in rural Saskatchewan, Canada amidst a program evaluation.

Science.gov (United States)

Dell, Colleen Anne; Duncan, Charles Randy; DesRoches, Andrea; Bendig, Melissa; Steeves, Megan; Turner, Holly; Quaife, Terra; McCann, Chuck; Enns, Brett

2013-10-22

Despite endorsement by the Saskatchewan government to apply empirically-based approaches to youth drug prevention services in the province, programs are sometimes delivered prior to the establishment of evidence-informed goals and objectives. This paper shares the 'preptory' outcomes of our team's program evaluation of the Prince Albert Parkland Health Region Mental Health and Addiction Services' Outreach Worker Service (OWS) in eight rural, community schools three years following its implementation. Before our independent evaluation team could assess whether expectations of the OWS were being met, we had to assist with establishing its overarching program goals and objectives and 'at-risk' student population, alongside its alliance with an empirically-informed theoretical framework. A mixed-methods approach was applied, beginning with in-depth focus groups with the OWS staff to identify the program's goals and objectives and targeted student population. These were supplemented with OWS and school administrator interviews and focus groups with school staff. Alignment with a theoretical focus was determined though a review of the OWS's work to date and explored in focus groups between our evaluation team and the OWS staff and validated with the school staff and OWS and school administration. With improved understanding of the OWS's goals and objectives, our evaluation team and the OWS staff aligned the program with the Positive Youth Development theoretical evidence-base, emphasizing the program's universality, systems focus, strength base, and promotion of assets. Together we also gained clarity about the OWS's definition of and engagement with its 'at-risk' student population. It is important to draw on expert knowledge to develop youth drug prevention programming, but attention must also be paid to aligning professional health care services with a theoretically informed evidence-base for evaluation purposes. If time does not permit for the establishment of

FY 1994 program summary: Office of Technology Development, Office of Research and Development, Office of Demonstration, Testing, and Evaluation

International Nuclear Information System (INIS)

1994-10-01

The US Department of Energy (DOE) Office of Environmental Management, formerly the Office of Environmental Restoration and Waste Management (EM), was established in November 1989 as the first step toward correcting contamination problems resulting from nearly 50 years of nuclear weapons production and fuel processing activities. EM consolidates several DOE organizations previously responsible for the handling, treatment, and disposition of radioactive and hazardous waste. Within EM, the Office of Technology Development (OTD/EM-50) is responsible for developing technologies to meet DOE's goal for environmental restoration. OTD manages an aggressive national program of applied research, development, demonstration, testing, and evaluation (RDDT and E) for environmental cleanup, waste management, and related technologies. The program is designed to resolve major technical issues, to rapidly advanced beyond current technologies for environmental restoration and waste management operations, and to expedite compliance with applicable environmental laws and regulations. This report summarizes Fiscal Year 1994 (FY94) programmatic information, accomplishments, and planned activities relevant to the individual activities within OTD's RDDT and E

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Evolution of a multilevel framework for health program evaluation.

Science.gov (United States)

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

The development of quality assurance program for cyberknife

International Nuclear Information System (INIS)

Jang, Ji Sun; Lee, Dong Han; Kang, Young Nam

2006-01-01

Standardization quality assurance (QA)program of Cyberknife for suitable circumstances in Korea has not been established. In this research, we investigated the development of QA program for Cyberknife and evaluation of the feasibility under applications. Considering the feature of constitution for systems and the therapeutic methodology of Cyberknife, the list of quality control (QC) was established and divided dependent on the each period of operations. And then all these developed QC lists were categorized into three groups such as basic QC, delivery specific QC, and patient specific QC based on the each purpose of QA. In order to verify the validity of the established QA program, this QC lists was applied to two Cyberknife centers. The acceptable tolerance was based on the undertaking inspection list from the Cyberknife manufacturer and the QC results during last three years of two Cyberknife centers in Korea. The acquired measurement results were evaluated for the analysis of the current QA status and the verification of the propriety for the developed QA program. The current QA status of two Cyberknife centers was evaluated from the accuracy of all measurements in relation with application of the established QA program. Each measurement result was verified having a good agreement within the acceptable tolerance limit of the developed QA program. It is considered that the developed QA program in this research could be established the standardization of QC methods for Cyberknife and confirmed the accuracy and stability for the image-guided stereotactic radiotherapy

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Program of internal training of the ININ personnel participating in the PERE of the CLV (1998). II. Development and final evaluation

International Nuclear Information System (INIS)

Suarez, G.

1999-04-01

According to the results of the initial evaluation, he/she was carried out the program of the personnel's of the participant ININ internal training in the PERE of the CLV (1998). The purpose of this report is to describe the development of the one it programs and the results of the final evaluation. (Author)

Employment Assistance Planning Programs for Welfare Recipients: An Evaluation and the Development of a Screening Measure.

Science.gov (United States)

Peterson, Gary W.; And Others

A project was conducted to develop an assessment instrument for use in identifying welfare recipients who are potentially employable and to evaluate the effectiveness of Florida's three existing pilot employment assistance planning programs (termed PAPAs after the Public Assistance Productivity Act). Data on the employment status of 98 individuals…

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

The development of a taste education program for preschoolers and evaluation of a program by parents and childcare personnel.

Science.gov (United States)

Shon, Choengmin; Park, Young; Ryou, Hyunjoo; Na, Woori; Choi, Kyungsuk

2012-10-01

The change in people's dietary life has led to an increase in an intake of processed foods and food chemicals, raising awareness about taste education for preschoolers whose dietary habits start to grow. This study aims to evaluate the effectiveness and satisfaction of parents and childcare personnel after developing a taste education program and demonstrating it in class. A part of the curriculum developed by Piusais and Pierre was referred for the program. After educating 524 preschoolers in child care facilities in Seoul, a satisfaction survey was conducted on the program. The data in this study were analyzed using SPSS 14.0. Statistical analysis was conducted based on the frequency after collecting the data. Mean ± SD used to determine satisfaction with taste education, with preferences marked on a five-point scale and the alpha was set at 0.05. The program includes five teachers' guides with subjects of sweetness, saltiness, sourness, bitterness and harmony of flavor, and ten kinds of teaching tools. For the change in parents' recognition of the need for taste education based on five-point scale, the average of 4.06 ± 0.62 before the program has significantly increased to 4.32 ± 0.52 (P facilities, the average scores for education method, education effect, education contents and nutritionists, and teaching tools were at 4.15 ± 0.63, 3.91 ± 0.50, 4.18 ± 0.50, and 3.80 ± 0.56 respectively. In addition, the need for a continuous taste education scored 4.42 ± 0.67. This program has created a positive change in preschoolers' dietary life, therefore the continuation and propagation of the taste education program should be considered.

[Development and Evaluation of a Self-Reflection Program for Intensive Care Unit Nurses Who Have Experienced the Death of Pediatric Patients].

Science.gov (United States)

Kang, Hyun Ju; Bang, Kyung Sook

2017-06-01

This study aims to develop a self-reflection program for nurses who have experienced the death of pediatric patients in the intensive care unit and to evaluate its effectiveness. The self-reflection program was developed by means of the following four steps: establishment of the goal through investigation of an initial request, drawing up the program, preliminary research, and implementation and improvement of the program. The study employed a methodological triangulation to evaluate the effectiveness of the program. Participants were 38 nurses who had experienced the death of pediatric patients (experimental group=15, control group=23); they were recruited using convenience sampling. The self-reflection program was provided over 6 weeks (6 sessions). Data were collected from April to August, 2014 and analyzed using t-tests and content analysis. The quantitative results showed that changes in personal growth (t=-6.33, pself-reflection program developed by this study was effective in helping nurses who had experienced the death of pediatric patients to achieve personal growth through self-reflection, and it was confirmed that the program can be applied in a realistic clinical nursing setting. Furthermore, it can be recommended as an intervention program for clinical nurses. © 2017 Korean Society of Nursing Science

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

New developments in employee assistance programs.

Science.gov (United States)

White, R K; McDuff, D R; Schwartz, R P; Tiegel, S A; Judge, C P

1996-04-01

Employee assistance programs have developed from alcoholism assessment and referral centers to specialized behavioral health programs. Comprehensive employee assistance programs are defined by six major components: identification of problems based on job performance, consultation with supervisors, constructive confrontation, evaluation and referral, liaison with treatment providers, and substance abuse expertise. Other services have been added as enhancements to the basic model and include managed behavioral health activities and professional assistance committees, which provide services for impaired professionals and executives. Recent developments in the field are illustrated through examples from the experience of the employee assistance program at the University of Maryland Medical System in Baltimore.

["Active in rehab": development and formative evaluation of a patient education program to increase health literacy of patients with chronic illness].

Science.gov (United States)

Ullrich, A; Schöpf, A C; Nagl, M; Farin, E

2015-04-01

The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.

Robotics Technology Development Program

International Nuclear Information System (INIS)

1994-02-01

The Robotics Technology Development Program (RTDP) is a ''needs-driven'' effort. A lengthy series of presentations and discussions at DOE sites considered critical to DOE's Environmental Restoration and Waste Management (EM) Programs resulted in a clear understanding of needed robotics applications toward resolving definitive problems at the sites. A detailed analysis of the Tank Waste Retrieval (TWR), Contaminant Analysis Automation (CAA), Mixed Waste Operations (MWO), and Decontamination ampersand Dismantlement (D ampersand D). The RTDP Group realized that much of the technology development was common (Cross Cutting-CC) to each of these robotics application areas, for example, computer control and sensor interface protocols. Further, the OTD approach to the Research, Development, Demonstration, Testing, and Evaluation (RDDT ampersand E) process urged an additional organizational break-out between short-term (1--3 years) and long-term (3--5 years) efforts (Advanced Technology-AT). The RDTP is thus organized around these application areas -- TWR, CAA, MWO, D ampersand D and CC ampersand AT -- with the first four developing short-term applied robotics. An RTDP Five-Year Plan was developed for organizing the Program to meet the needs in these application areas

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Why so many "rigorous" evaluations fail to identify unintended consequences of development programs: How mixed methods can contribute.

Science.gov (United States)

Bamberger, Michael; Tarsilla, Michele; Hesse-Biber, Sharlene

2016-04-01

Many widely-used impact evaluation designs, including randomized control trials (RCTs) and quasi-experimental designs (QEDs), frequently fail to detect what are often quite serious unintended consequences of development programs. This seems surprising as experienced planners and evaluators are well aware that unintended consequences frequently occur. Most evaluation designs are intended to determine whether there is credible evidence (statistical, theory-based or narrative) that programs have achieved their intended objectives and the logic of many evaluation designs, even those that are considered the most "rigorous," does not permit the identification of outcomes that were not specified in the program design. We take the example of RCTs as they are considered by many to be the most rigorous evaluation designs. We present a numbers of cases to illustrate how infusing RCTs with a mixed-methods approach (sometimes called an "RCT+" design) can strengthen the credibility of these designs and can also capture important unintended consequences. We provide a Mixed Methods Evaluation Framework that identifies 9 ways in which UCs can occur, and we apply this framework to two of the case studies. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluation Influence: The Evaluation Event and Capital Flow in International Development.

Science.gov (United States)

Bell, David A

2017-12-01

Assessing program effectiveness in human development is central to informing foreign aid policy-making and organizational learning. Foreign aid effectiveness discussions have increasingly given attention to the devaluing effects of aid flow volatility. This study reveals that the external evaluation event influences actor behavior, serving as a volatility-constraining tool. A case study of a multidonor aid development mechanism served examining the influence of an evaluation event when considering anticipatory effects. The qualitative component used text and focus group data combined with individual interview data (organizations n = 10, including 26 individuals). Quantitative data included financial information on all 75 capital investments. The integrated theory of influence and model of alternative mechanisms used these components to identify the linkage between the evaluation event and capital flow volatility. Aid approved in the year of the midterm evaluation was disbursed by the mechanism with low capital volatility. Anticipating the evaluation event influenced behavior resulting in an empirical record that program outcomes were enhanced and the mechanism was an improved organization. Formative evaluations in a development program can trigger activity as an interim process. That activity provides for a more robust assessment of ultimate consequence of interest. Anticipating an evaluation can stimulate donor reality testing. The findings inform and strengthen future research on the influence of anticipating an evaluation. Closely examining activities before, during, and shortly after the evaluation event can aid development of other systematic methods to improve understanding this phenomenon, as well as improve donor effectiveness strategies.

Environmental Biotechnology Research and Development Program 1989-1992

OpenAIRE

Brinkman J; Rulkens WH; Visscher K

1989-01-01

This report is an English translation of the Dutch Research and Development Program on environmental biotechnology 1989-1992. In this program an overview is given of the recent developments in environmental biotechnology. Based on this overview, the possibilities of biotechnology for management of the environment are evaluated. In this program two kinds of research are distinguished. Applied research directly focusses on specific environmental problems. Fundamental research aims at developing...

Disease-Specific Care: Spine Surgery Program Development.

Science.gov (United States)

Koerner, Katie; Franker, Lauren; Douglas, Barbara; Medero, Edgardo; Bromeland, Jennifer

2017-10-01

Minimal literature exists describing the process for development of a Joint Commission comprehensive spine surgery program within a community hospital health system. Components of a comprehensive program include structured communication across care settings, preoperative education, quality outcomes tracking, and patient follow-up. Organizations obtaining disease-specific certification must have clear knowledge of the planning, time, and overall commitment, essential to developing a successful program. Health systems benefit from disease-specific certification because of their commitment to a higher standard of service. Certification standards establish a framework for organizational structure and management and provide institutions a competitive edge in the marketplace. A framework for the development of a spine surgery program is described to help guide organizations seeking disease-specific certification. In developing a comprehensive program, it is critical to define the program's mission and vision, identify key stakeholders, implement clinical practice guidelines, and evaluate program outcomes.

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

Enhancing medical students' communication skills: development and evaluation of an undergraduate training program

Science.gov (United States)

2012-01-01

Background There is a relative lack of current research on the effects of specific communication training offered at the beginning of the medical degree program. The newly developed communication training "Basics and Practice in Communication Skills" was pilot tested in 2008 and expanded in the following year at the University Medical Centre Hamburg-Eppendorf in Germany. The goal was to promote and improve the communicative skills of participants and show the usefulness of an early offered intervention on patient-physician communication within the medical curriculum. Methods The students participating in the project and a comparison group of students from the standard degree program were surveyed at the beginning and end of the courses. The survey consisted of a self-assessment of their skills as well as a standardised expert rating and an evaluation of the modules by means of a questionnaire. Results Students who attended the communication skills course exhibited a considerable increase of communication skills in this newly developed training. It was also observed that students in the intervention group had a greater degree of self-assessed competence following training than the medical students in the comparison group. This finding is also reflected in the results from a standardised objective measure. Conclusions The empirical results of the study showed that the training enabled students to acquire specialised competence in communication through the course of a newly developed training program. These findings will be used to establish new communication training at the University Medical Centre Hamburg-Eppendorf. PMID:22443807

Development and evaluation of a self care program on breastfeeding in Japan: A quasi-experimental study

Directory of Open Access Journals (Sweden)

Awano Masayo

2010-08-01

Full Text Available Abstract Background Although the importance of breastfeeding is well known in Japan, in recent years less than 50% of mothers were fully breastfeeding at one month after birth. The purpose of this study was to develop a self-care program for breastfeeding aimed at increasing mothers' breastfeeding confidence and to evaluate its effectiveness. Methods A quasi-experimental pretest-posttest design was conducted in Japan. The intervention, a breastfeeding self-care program, was created to improve mothers' self-efficacy for breastfeeding. This Breastfeeding Self-Care Program included: information on the advantages and basics of breastfeeding, a breastfeeding checklist to evaluate breastfeeding by mothers and midwives, and a pamphlet and audiovisual materials on breastfeeding. Mothers received this program during their postpartum hospital stay. A convenience sample of 117 primiparous women was recruited at two clinical sites from October 2007 to March 2008. The intervention group (n = 55, who gave birth in three odd-numbered months, received standard care and the Breastfeeding Self-Care Program while the control group (n = 62 gave birth in three even numbered months and received standard breastfeeding care. To evaluate the effectiveness of the Breastfeeding Self-Care Program, breastfeeding self-efficacy and breastfeeding rate were measured early postpartum, before the intervention, and after the intervention at one month postpartum. The study used the Japanese version of The Breastfeeding Self-Efficacy Scale Short Form (BSES-SF to measure self-efficacy. Results The BSES-SF score of the intervention group rose significantly from 34.8 at early postpartum to 49.9 at one month after birth (p Conclusion Results indicate that the Breastfeeding Self-Care Program increased mothers' self-efficacy for breastfeeding and had a positive effect on the continuation of breastfeeding. Trial Registration Number UMIN000003517

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

Evaluation of a Web-Based Professional Development Program (Project ACE) for Teachers of Children with Autism Spectrum Disorders

Science.gov (United States)

Rakap, Salih; Jones, Hazel A.; Emery, Alice Kaye

2015-01-01

This article describes the development, implementation, and second-year evaluation of Project Autism Competencies for Endorsement (ACE), a web-based professional development (PD) program that is designed to train teachers currently working in the field to meet the unique and diverse needs of children with autism spectrum disorders (ASDs). A…

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

Development and evaluation of a cancer-related fatigue patient education program: protocol of a randomized controlled trial

Directory of Open Access Journals (Sweden)

Görres Stefan

2008-07-01

Full Text Available Abstract Background Cancer-related fatigue (CRF and its impact on patients' quality of life has been an increasing subject of research. However, in Germany there is a lack of evidence-based interventions consistent with the multidimensional character of fatigue. The objective of this study is to develop and evaluate a self-management program for disease-free cancer patients to cope with CRF. Methods Based on evidence extracted from a literature review, a curriculum for the self-management program was elaborated. The curriculum was reviewed and validated by an interdisciplinary expert group and the training-modules will be pretested with a small number of participants and discussed in terms of feasibility and acceptance. To determine the efficacy of the program a randomised controlled trial will be carried out: 300 patients will be recruited from oncological practices in Bremen, Germany, and will be allocated to intervention or control group. The intervention group participates in the program, whereas the control group receives standard care and the opportunity to take part in the program after the end of the follow-up (waiting control group. Primary outcome measure is the level of fatigue, secondary outcome measures are quality of life, depression, anxiety, self-efficacy and physical activity. Data will be collected before randomisation, after intervention, and after a follow-up of 6 months. Discussion Because there are no comparable self-management programs for cancer survivors with fatigue, the development of the curriculum has been complex; therefore, the critical appraisal by the experts was an important step to validate the program and their contributions have been integrated into the curriculum. The experts appreciated the program as filling a gap in outpatient cancer care. If the results of the evaluation prove to be satisfactory, the outpatient care of cancer patients can be broadened and supplemented. Trial Registration Clinical

FY 1994 program summary: Office of Technology Development, Office of Research and Development, Office of Demonstration, Testing, and Evaluation

Energy Technology Data Exchange (ETDEWEB)

1994-10-01

The US Department of Energy (DOE) Office of Environmental Management, formerly the Office of Environmental Restoration and Waste Management (EM), was established in November 1989 as the first step toward correcting contamination problems resulting from nearly 50 years of nuclear weapons production and fuel processing activities. EM consolidates several DOE organizations previously responsible for the handling, treatment, and disposition of radioactive and hazardous waste. Within EM, the Office of Technology Development (OTD/EM-50) is responsible for developing technologies to meet DOE`s goal for environmental restoration. OTD manages an aggressive national program of applied research, development, demonstration, testing, and evaluation (RDDT and E) for environmental cleanup, waste management, and related technologies. The program is designed to resolve major technical issues, to rapidly advanced beyond current technologies for environmental restoration and waste management operations, and to expedite compliance with applicable environmental laws and regulations. This report summarizes Fiscal Year 1994 (FY94) programmatic information, accomplishments, and planned activities relevant to the individual activities within OTD`s RDDT and E.

An Interactive Web-Based Program for Stepfamilies: Development and Evaluation of Efficacy

Science.gov (United States)

Gelatt, Vicky A.; Adler-Baeder, Francesca; Seeley, John R.

2010-01-01

This study evaluated the efficacy of a family life education program for stepfamilies that is self-administered, interactive, and web-based. The program uses behavior-modeling videos to demonstrate effective couple, parenting, and stepparenting practices. A diverse sample of 300 parents/stepparents of a child aged 11-15 years were randomized into…

Evaluation of Articles Related to Program Development in Education Published in the Journal of Primary Education

Science.gov (United States)

Guclu, Mustafa

2013-01-01

The purpose of this study was to make an overall assessment of articles related to program development in education that appeared in the "Journal of Primary Education," which had been published between 1939 and 1966. For this purpose, the articles in the journal were analyzed by using content analysis, and evaluated in terms of program…

Regional Innovation System Strengthening Program (SIDa as an Exit Strategy National Community Development Program (PNPM

Directory of Open Access Journals (Sweden)

Teguh Narutomo

2014-06-01

Full Text Available The aim of this study was to evaluate the PNPM program and follow the program with SIDA Strengthening Program. The research method used is a qualitative method approach of this research through the evaluation research design that builds on the CIPP evaluation model (Context-Input-Process-Product. Since the failure of theories and models of development are too glorifies growth, makes many people turn to focus on people development, which includes requiring optimization of local resources, participation, and empowerment. Since then, "empowerment" which was introduced in Indonesia has been anesthetized and made many hopes among many parties. In 2007 started the National Program for Community Empowerment (PNPM which continue Kecamatan Development Program (KDP. PNPM 2014 which is part of the United Indonesia Cabinet Volume 2 is going to end. For that we need to look for an exit strategy program that can maintain sustainability of PNPM. Regional Innovation Systems Strengthening Program (SIDA is a program of the whole process in one system to foster innovation made between government institutions, local governments, research institutions, educational institutions, innovation support institutions, businesses, and communities in areas that have been implemented since the 2012 SIDA program is an empowerment program as well, both to the public and even empowering to all elements such as academia, private industry, government and society.

The ALIVE program: developing a web-based professional development program for nursing leaders in the home healthcare sector.

Science.gov (United States)

Lankshear, Sara; Huckstep, Sherri; Lefebre, Nancy; Leiterman, Janis; Simon, Deborah

2010-05-01

Home healthcare nurses often work in isolation and rarely have the opportunity to meet or congregate in one location. As a result, nurse leaders must possess unique leadership skills to supervise and manage a dispersed employee base from a distance. The nature of this dispersed workforce creates an additional challenge in the ability to identify future leaders, facilitate leadership capacity, and enhance skill development to prepare them for future leadership positions. The ALIVE (Actively Leading In Virtual Environments) web-based program was developed to meet the needs of leaders working in virtual environments such as the home healthcare sector. The program, developed through a partnership of three home healthcare agencies, used nursing leaders as content experts to guide program development and as participants in the pilot. Evaluation findings include the identification of key competencies for nursing leaders in the home healthcare sector, development of program learning objectives and participant feedback regarding program content and delivery.

An Evaluation of a School-Based Professional Development Program on Teachers' Efficacy for Technology Integration: Findings from an Initial Study

Science.gov (United States)

Skoretz, Yvonne; Childress, Ronald

2013-01-01

The purpose of this program evaluation was to determine the impact of a school-based, job-embedded professional development program on elementary and middle school teacher efficacy for technology integration. Participant bi-weekly journal postings were analyzed using Grappling's "Technology and Learning Spectrum" (Porter, 2001) to…

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Integrating parts of the APhA Career Pathway Evaluation Program for pharmacy professionals into a career development lab.

Science.gov (United States)

Linn, Brooke A; Burton, Samantha J; Shepler, Brian M

To use parts of the APhA Career Pathway Evaluation Program for Pharmacy Professionals in a career development laboratory designed to provide students with relevant information that will help them prepare for successful careers across the profession of pharmacy. Students enrolled in the second professional year of pharmacy school participated in an interactive three-hour career development laboratory. Students completed the APhA Career Pathway Evaluation Program for Pharmacy Professionals Online Assessment Tool prior to the laboratory. In class, the students were randomized into eight groups. Two career profiles were assigned to each group for discussion during a thirty-minute brainstorming session. The groups reported their knowledge for each career profile to the entire class, and the instructors supplemented the discussion with details and more specific information about each profile. Two years of data were collected (n=300 students). One hundred and twenty four (41.3%) students responded to the voluntary post-laboratory survey questions. Overall, students rated the career pathway activities favorably with an average score of 8.13 out of 10. After participation in the discussion, 74 (59.7%) respondents indicated their career interests had been impacted. This career development laboratory is one example of how the APhA Career Pathway Evaluation Program for Pharmacy Professionals can be effectively incorporated into the PharmD curriculum in order to help students explore the various career options they might not have otherwise discovered on their own. Published by Elsevier Inc.

Development and Evaluation of a Student-Initiated Test Preparation Program for the USMLE Step 1 Examination.

Science.gov (United States)

Schwartz, Lindsay F; Lineberry, Matthew; Park, Yoon Soo; Kamin, Carol S; Hyderi, Abbas A

2018-01-01

Studies have documented performance on the United States Medical Licensing Examination® (USMLE) Step 1 exam as an important factor that residency program directors consider when deciding which applicants to interview and rank. Therefore, success on this exam, though only one aspect of applicant evaluation, is important in determining future career prospects for medical students. Unfortunately, mean test scores at the University of Illinois College of Medicine at Chicago (UIC) have historically been below the national average. This retrospective and quasi-experimental mixed-methods study describes the development, evaluation, and effects of a student-initiated USMLE Step 1 preparatory program at UIC. The program provided second year students with First Aid for the USMLE Step 1 at the beginning of the academic year, as well as a six month subscription to the USMLE World question bank midyear. In addition, optional peer review sessions covering basic sciences and organ systems were taught by high-performing upperclassmen. The goals of the program were to raise mean USMLE Step 1 exam scores and increase the percentage of students passing the exam on their first time. The program premiered during the 2012-13 academic year. Data from this cohort as well as four others (N = 830; 2010-2014 examinees) were gathered. Performances between preintervention (2010-12 examinees) and postintervention (2013-14 examinees) cohorts of students were compared. Focus groups and interviews with staff and students were conducted, recorded, and analyzed to investigate the impact that the program had on student interactions and perceptions of the learning environment. There was a significant difference in exam performance pre- versus postintervention, with average USMLE Step 1 scores improving by 8.82 points following the implementation of the student-initiated program, t(5.61) = 828, p Step 1 (odds ratio = 3.08, SE = 1.07, p < .01). Students and staff commented on the sense of community and

Development and evaluation of a patient centered cardiovascular health education program for insured patients in rural Nigeria (QUICK - II

Directory of Open Access Journals (Sweden)

Osibogun Akin

2011-03-01

Full Text Available Abstract Background In Sub Saharan Africa, the incidence of hypertension and other modifiable cardiovascular risk factors is growing rapidly. Poor adherence to prescribed prevention and treatment regimens by patients can compromise treatment outcomes. Patient-centered cardiovascular health education is likely to improve shortcomings in adherence. This paper describes a study that aims to develop a cardiovascular health education program for patients participating in a subsidized insurance plan in Nigeria and to evaluate the applicability and effectiveness in patients at increased risk for cardiovascular disease. Methods/Design Design: The study has two parts. Part 1 will develop a cardiovascular health education program, using qualitative interviews with stakeholders. Part 2 will evaluate the effectiveness of the program in patients, using a prospective (pre-post observational design. Setting: A rural primary health center in Kwara State, Nigeria. Population: For part 1: 40 patients, 10 healthcare professionals, and 5 insurance managers. For part 2: 150 patients with uncontrolled hypertension or other cardiovascular risk factors after one year of treatment. Intervention: Part 2: patient-centered cardiovascular health education program. Measurements: Part 1: Semi-structured interviews to identify stakeholder perspectives. Part 2: Pre- and post-intervention assessments including patients' demographic and socioeconomic data, blood pressure, body mass index and self-reporting measures on medication adherence and perception of care. Feasibility of the intervention will be measured using process data. Outcomes: For program development (part 1: overview of healthcare professionals' perceptions on barriers and facilitators to care, protocol for patient education, and protocol implementation plan. For program evaluation (part 2: changes in patients' scores on adherence to medication and life style changes, blood pressure, and other physiological and self

A standardized motor imagery introduction program (MIIP for neuro-rehabilitation: development and evaluation

Directory of Open Access Journals (Sweden)

Christine eWondrusch

2013-08-01

Full Text Available Background: For patients with central nervous system lesions and sensorimotor impairments a solid motor imagery (MI introduction is crucial to understand and use MI to improve motor performance. The study’s aim was to develop and evaluate a standardized MI group introduction program (MIIP for patients after stroke, multiple sclerosis, Parkinson’s disease, and traumatic brain injury. Methods:Phase 1: Based on literature a MIIP was developed comprising MI theory (definition, type, mode, perspective, planning and MI practice (performance, control. Phase 2: Development of a 27-item self-administered MIIP evaluation questionnaire, assessing MI knowledge self-evaluation of the ability to perform MI and patient satisfaction with the MIIP. Phase 3: Evaluation of MIIP and MI questionnaire by 2 independent MI experts based on predefined criteria and 2 patients using semi-structured interviews.Phase 4: Case series with a pre-post design to evaluate MIIP (3x30minutes using the MI questionnaire, Imaprax, Kinaesthetic and Visual Imagery Questionnaire, and Mental Chronometry. The paired t-test and the Wilcoxon signed-rank test were used to determine significant changes.Results: Data of eleven patients were analysed (5 females; age 62.3±14.1 years. Declarative MI knowledge improved significantly from 5.4±2.2 to 8.8±2.9 (p=0.010. Patients demonstrated good satisfaction with MIIP (mean satisfaction score: 83.2±11.4 %. MI ability remained on a high level but showed no significant change, except a significant decrease in the Kinaesthetic and Visual Imagery Questionnaire score.Conclusion: The presented MIIP seems to be valid and feasible for patients with central nervous system lesions and sensorimotor impairments resulting in improved MI knowledge. MIIP sessions can be held in groups of four or less. MI ability and Mental Chronometry remained unchanged after 3 training sessions.

A standardized motor imagery introduction program (MIIP) for neuro-rehabilitation: development and evaluation.

Science.gov (United States)

Wondrusch, C; Schuster-Amft, C

2013-01-01

For patients with central nervous system (CNS) lesions and sensorimotor impairments a solid motor imagery (MI) introduction is crucial to understand and use MI to improve motor performance. The study's aim was to develop and evaluate a standardized MI group introduction program (MIIP) for patients after stroke, multiple sclerosis (MS), Parkinson's disease (PD), and traumatic brain injury (TBI). Phase 1: Based on literature a MIIP was developed comprising MI theory (definition, type, mode, perspective, planning) and MI practice (performance, control). Phase 2: Development of a 27-item self-administered MIIP evaluation questionnaire, assessing MI knowledge self-evaluation of the ability to perform MI and patient satisfaction with the MIIP. Phase 3: Evaluation of MIIP and MI questionnaire by 2 independent MI experts based on predefined criteria and 2 patients using semi-structured interviews. Phase 4: Case series with a pre-post design to evaluate MIIP (3 × 30 min) using the MI questionnaire, Imaprax, Kinaesthetic and Visual Imagery Questionnaire, and Mental Chronometry. The paired t-test and the Wilcoxon signed-rank test were used to determine significant changes. Data of eleven patients were analysed (5 females; age 62.3 ± 14.1 years). Declarative MI knowledge improved significantly from 5.4 ± 2.2 to 8.8 ± 2.9 (p = 0.010). Patients demonstrated good satisfaction with MIIP (mean satisfaction score: 83.2 ± 11.4%). MI ability remained on a high level but showed no significant change, except a significant decrease in the Kinaesthetic and Visual Imagery Questionnaire score. The presented MIIP seems to be valid and feasible for patients with CNS lesions and sensorimotor impairments resulting in improved MI knowledge. MIIP sessions can be held in groups of four or less. MI ability and Mental Chronometry remained unchanged after 3 training sessions.

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State.

Science.gov (United States)

Patel, Sapana R; Margolies, Paul J; Covell, Nancy H; Lipscomb, Cristine; Dixon, Lisa B

2018-01-01

Implementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs) that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support. This report describes the application of an instructional design framework-Analyze, Design, Develop, Implement, and Evaluate (ADDIE) model-in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS), a model of supported employment for community behavioral health treatment programs, in New York State. We applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR). Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change) quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation. Formative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book . Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning management system. Summative evaluation revealed that

When Unintended Consequences Become the Main Effect: Evaluating the Development of a Foster Parent Training Program.

Science.gov (United States)

Loesch-Griffin, Deborah A.; Ringstaff, Cathy

A program of education, training, and support provided to foster parents in a California county through a nonprofit agency is evaluated. The evaluators' experience indicates that: (1) evaluations are gaining in popularity; (2) role shifts by evaluators are sometimes difficult to perceive; (3) program staff are unlikely to use evaluative feedback…

Online Support Program for Parents of Children With a Chronic Kidney Disease Using Intervention Mapping: A Development and Evaluation Protocol.

Science.gov (United States)

Geense, Wytske W; van Gaal, Betsie Gi; Knoll, Jacqueline L; Cornelissen, Elisabeth Am; Schoonhoven, Lisette; Kok, Gerjo

2016-01-13

The care for children with a chronic kidney disease (CKD) is complex. Parents of these children may experience high levels of stress in managing their child's disease, potentially leading to negative effects on their child's health outcomes. Although the experienced problems are well known, adequate (online) support for these parents is lacking. The objective of the study is to describe the systematic development of an online support program for parents of children with CKD, and how this program will be evaluated. Intervention Mapping (IM) was used for the development of the program. After conducting a needs assessment, defining program objectives, searching for theories, and selecting practical applications, the online program e-Powered Parents was developed. e-Powered Parents consist of three parts: (1) an informative part with information about CKD and treatments, (2) an interactive part where parents can communicate with other parents and health care professionals by chat, private messages, and a forum, and (3) a training platform consisting of four modules: Managing stress, Setting limits, Communication, and Coping with emotions. In a feasibility study, the potential effectiveness and effect size of e-Powered Parents will be evaluated using an explorative randomized controlled trial with parents of 120 families. The outcomes will be the child's quality of life, parental stress and fatigue, self-efficacy in the communication with health care professionals, and family management. A process evaluation will provide insight in parents' experiences, including their experienced level of support. Study results are expected to be published in the summer of 2016. Although the development of e-Powered Parents using IM was time-consuming, IM has been a useful protocol. IM provided us with a systematic framework for structuring the development process. The participatory planning group was valuable as well; knowledge, experiences, and visions were shared, ensuring us that

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

Science.gov (United States)

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

A formal mentorship program for faculty development.

Science.gov (United States)

Jackevicius, Cynthia A; Le, Jennifer; Nazer, Lama; Hess, Karl; Wang, Jeffrey; Law, Anandi V

2014-06-17

To describe the development, implementation, and evaluation of a formal mentorship program at a college of pharmacy. After extensive review of the mentorship literature within the health sciences, a formal mentorship program was developed between 2006 and 2008 to support and facilitate faculty development. The voluntary program was implemented after mentors received training, and mentors and protégés were matched and received an orientation. Evaluation consisted of conducting annual surveys and focus groups with mentors and protégés. Fifty-one mentor-protégé pairs were formed from 2009 to 2012. A large majority of the mentors (82.8%-96.9%) were satisfied with the mentorship program and its procedures. The majority of the protégés (≥70%) were satisfied with the mentorship program, mentor-protégé relationship, and program logistics. Both mentors and protégés reported that the protégés most needed guidance on time management, prioritization, and work-life balance. While there were no significant improvements in the proteges' number of grant submissions, retention rates, or success in promotion/tenure, the total number of peer-reviewed publications by junior faculty members was significantly higher after program implementation (mean of 7 per year vs 21 per year, p=0.03) in the college's pharmacy practice and administration department. A formal mentorship program was successful as measured by self-reported assessments of mentors and protégés.

Devolving Programs (2009) | IDRC - International Development ...

International Development Research Centre (IDRC) Digital Library (Canada)

2016-04-25

Apr 25, 2016 ... ... senior management requested that past experience with devolution ... The primary objective of this evaluation is to develop guiding principles that could inform future devolution practice. ... External Program Reviews (2015).

The US Department of Energy Personnel Dosimetry Evaluation and Upgrade Program

International Nuclear Information System (INIS)

Faust, L.G.; Stroud, C.M.; Swinth, K.L.; Vallario, E.J.

1987-11-01

The US Department of Energy (DOE) Personnel Dosimetry Evaluation and Upgrade Program is designed to identify and evaluate dosimetry deficiencies and to conduct innovative research and development programs that will improve overall capabilities, thus ensuring that DOE can comply with applicable standards and regulations for dose measurement. To achieve these goals, two programs were initiated to evaluate and upgrade beta measurement and neutron dosimetry. 3 refs

Let’s Talk Critical. Development and Evaluation of a Communication Skills Training Program for Critical Care Fellows

Science.gov (United States)

Hsieh, S. Jean; Howes, Jennifer M.; Keene, Adam B.; Fausto, James A.; Pinto, Priya A.; Gong, Michelle Ng

2015-01-01

Rationale: Although expert communication between intensive care unit clinicians with patients or surrogates improves patient- and family-centered outcomes, fellows in critical care medicine do not feel adequately trained to conduct family meetings. Objectives: We aimed to develop, implement, and evaluate a communication skills program that could be easily integrated into a U.S. critical care fellowship. Methods: We developed four simulation cases that provided communication challenges that critical care fellows commonly face. For each case, we developed a list of directly observable tasks that could be used by faculty to evaluate fellows during each simulation. We developed a didactic curriculum of lectures/case discussions on topics related to palliative care, end-of-life care, communication skills, and bioethics; this month-long curriculum began and ended with the fellows leading family meetings in up to two simulated cases with direct observation by faculty who were not blinded to the timing of the simulation. Our primary measures of effectiveness were the fellows’ self-reported change in comfort with leading family meetings after the program was completed and the quality of the communication as measured by the faculty evaluators during the family meeting simulations at the end of the month. Measurements and Main Results: Over 3 years, 31 critical care fellows participated in the program, 28 of whom participated in 101 family meeting simulations with direct feedback by faculty facilitators. Our trainees showed high rates of information disclosure during the simulated family meetings. During the simulations done at the end of the month compared with those done at the beginning, our fellows showed significantly improved rates in: (1) verbalizing an agenda for the meeting (64 vs. 41%; Chi-square, 5.27; P = 0.02), (2) summarizing what will be done for the patient (64 vs. 39%; Chi-square, 6.21; P = 0.01), and (3) providing a follow-up plan (60 vs. 37%; Chi

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

Developing a successful robotics program.

Science.gov (United States)

Luthringer, Tyler; Aleksic, Ilija; Caire, Arthur; Albala, David M

2012-01-01

Advancements in the robotic surgical technology have revolutionized the standard of care for many surgical procedures. The purpose of this review is to evaluate the important considerations in developing a new robotics program at a given healthcare institution. Patients' interest in robotic-assisted surgery has and continues to grow because of improved outcomes and decreased periods of hospitalization. Resulting market forces have created a solid foundation for the implementation of robotic surgery into surgical practice. Given proper surgeon experience and an efficient system, robotic-assisted procedures have been cost comparable to open surgical alternatives. Surgeon training and experience is closely linked to the efficiency of a new robotics program. Formally trained robotic surgeons have better patient outcomes and shorter operative times. Training in robotics has shown no negative impact on patient outcomes or mentor learning curves. Individual economic factors of local healthcare settings must be evaluated when planning for a new robotics program. The high cost of the robotic surgical platform is best offset with a large surgical volume. A mature, experienced surgeon is integral to the success of a new robotics program.

Evaluation of Team Development in a Corporate Adventure Training Program.

Science.gov (United States)

Bronson, Jim; And Others

1992-01-01

An intact work unit of 17 corporate managers participated in a 3-day adventure training program to develop teamwork and group unity. The unit improved significantly on 8 of 10 items of the Team Development Inventory, administered before and 2 months after training, relative to an intact control group. (SV)

The development of macros program-based cognitive evaluation model via e-learning course mathematics in senior high school based on curriculum 2013

Directory of Open Access Journals (Sweden)

Djoko Purnomo

2017-02-01

Full Text Available The specific purpose of this research is: The implementation of the application of the learning tool with a form cognitive learning evaluation model based macros program via E-learning at High School grade X at july-december based on 2013 curriculum. The method used in this research followed the procedures is research and development by Borg and Gall [2]. In second year, population analysis has conducted at several universities in Semarang. The results of the research and application development of macro program-based cognitive evaluation model is effective which can be seen from (1 the student learning result is over KKM, (2 The student independency affects learning result positively, (3 the student learning a result by using macros program-based cognitive evaluation model is better than students class control. Based on the results above, the development of macros program-based cognitive evaluation model that have been tested have met quality standards according to Akker (1999. Large-scale testing includes operational phase of field testing and final product revision, i.e trials in the wider class that includes students in mathematics education major in several universities, they are the Universitas PGRI Semarang, Universitas Islam Sultan Agung and the Universitas Islam NegeriWalisongo Semarang. The positive responses is given by students at the Universitas PGRI Semarang, Universitas Islam Sultan Agung and the Universitas Islam NegeriWalisongo Semarang.

Levers supporting program evaluation culture and capacity in Romanian public administration: The role of leadership

OpenAIRE

Cristina Mora; Raluca Antonie

2012-01-01

Program evaluation culture and capacity is at the very beginning of its development in Romania. In this article we highlight one of the fundamental, but not always obvious, connections that support sustainable evaluation culture and capacity building and development: the link between leadership and program evaluation. If properly used, program evaluation results can be a strong instrument in leadership, just as leadership can fundamentally encourage the development of evaluation culture and c...

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

Science.gov (United States)

This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

Using Instructional Design, Analyze, Design, Develop, Implement, and Evaluate, to Develop e-Learning Modules to Disseminate Supported Employment for Community Behavioral Health Treatment Programs in New York State

Directory of Open Access Journals (Sweden)

Sapana R. Patel

2018-05-01

Full Text Available BackgroundImplementation science lacks a systematic approach to the development of learning strategies for online training in evidence-based practices (EBPs that takes the context of real-world practice into account. The field of instructional design offers ecologically valid and systematic processes to develop learning strategies for workforce development and performance support.ObjectiveThis report describes the application of an instructional design framework—Analyze, Design, Develop, Implement, and Evaluate (ADDIE model—in the development and evaluation of e-learning modules as one strategy among a multifaceted approach to the implementation of individual placement and support (IPS, a model of supported employment for community behavioral health treatment programs, in New York State.MethodsWe applied quantitative and qualitative methods to develop and evaluate three IPS e-learning modules. Throughout the ADDIE process, we conducted formative and summative evaluations and identified determinants of implementation using the Consolidated Framework for Implementation Research (CFIR. Formative evaluations consisted of qualitative feedback received from recipients and providers during early pilot work. The summative evaluation consisted of levels 1 and 2 (reaction to the training, self-reported knowledge, and practice change quantitative and qualitative data and was guided by the Kirkpatrick model for training evaluation.ResultsFormative evaluation with key stakeholders identified a range of learning needs that informed the development of a pilot training program in IPS. Feedback on this pilot training program informed the design document of three e-learning modules on IPS: Introduction to IPS, IPS Job development, and Using the IPS Employment Resource Book. Each module was developed iteratively and provided an assessment of learning needs that informed successive modules. All modules were disseminated and evaluated through a learning

Consumer engagement and the development, evaluation and dissemination of evidence-based parenting programs

Science.gov (United States)

Sanders, Matthew R.; Kirby, James N.

2013-01-01

A consumer perspective can contribute much to enhancing the “ecological fit” of population level parenting interventions so they meet the needs of parents. This approach involves building relationships with consumer groups and soliciting consumer input into the relevance and acceptability of interventions, clarifying the enablers and barriers to engagement and involvement of parents, and clarifying variables that influence a parent’s program completion. The adoption of a more collaborative approach to working with consumers is important if meaningful population level change in the prevalence of serious social, emotional and behavioral problems in children and young people is to be achieved. Parents seeking assistance for their children’s behavior come from a diverse range of socioeconomic backgrounds, educational levels, cultures and languages. This paper examines consumer engagement strategies that can be employed throughout the process of program development, evaluation, training and dissemination and in “scaling up” the intervention. We argue that a multi-level public health approach to parenting intervention requires a strong consumer perspective to enable interventions to be more responsive to the preferences and needs of families and to ensure improved population reach of interventions. Examples from large scale dissemination trials are used to illustrate how consumer input can result in an increasingly differentiated suite of evidence-based parenting programs. PMID:22440062

Development of Technology for Structural Integrity Evaluation

International Nuclear Information System (INIS)

Choun, Young Sun; Choi, I. K.; Kim, M. K. and others

2005-03-01

The purpose of this study is a development of seismic safety and structural integrity evaluation method of the structure in the Nuclear Power plant (NPP). The purpose of 1st sub-Topic is the development and improvement of the seismic safety evaluation methodology for the Nuclear Power Plant structures and safety related equipment. The purpose of 2nd sub-topic is the increasing of structure and equipment seismic capacity through the reducing of seismic force. The purpose of 3rd sub-topic is the development of 3-D nonlinear finite element analysis program for prestressed concrete containment building. The last purpose if the evaluation of the failure mechanism of containment structure and structure capacity and the assessment of integrity of containment through the of leakage test. As a result of this research, there are many research results were produced. The scenario earthquake developing method was developed and the effect of the structures and equipment was analyzed. The effectiveness of isolation system was determined and optimum isolation systems for each equipment were selected. The NUCAS-3D program for the 3 dimensional numerical analysis of containment building using the embedded tendon element and rebar element was developed. The tension behavior of containment building was examined and the leakage rate of the concrete crack was determined. The results of this research can be successfully used for many fields of integrity of NPP site. It can be used for development of design earthquake for the seismic design and safety evaluation and establishment of seismic safety evaluation program and seismic capacity improvement program for existing NPP. In case of seismic isolation part, it can be used for the application to the selection of optimum isolation devices for equipment isolation and to the effective evaluation of each seismic isolation devices. In containment analysis part, it can be used for ultimate pressure capacity evaluation of prestressed concrete

Situated Research Design and Methodological Choices in Formative Program Evaluation

Science.gov (United States)

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

Developing medical educators - a mixed method evaluation of a teaching education program.

Science.gov (United States)

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

Background It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) 'Reaction' on a professional and emotional level using standardized questionnaires; 2) 'Learning' applying a multiple choice test; 3) 'Behavior' by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) 'Results' from student evaluations. Results Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (Pteaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students' evaluations. Conclusions Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

Developing medical educators--a mixed method evaluation of a teaching education program.

Science.gov (United States)

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) 'Reaction' on a professional and emotional level using standardized questionnaires; 2) 'Learning' applying a multiple choice test; 3) 'Behavior' by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) 'Results' from student evaluations. Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (Pteaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students' evaluations. Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

Using Interprofessional Learning for Continuing Education: Development and Evaluation of the Graduate Certificate Program in Health Professional Education for Clinicians.

Science.gov (United States)

Henderson, Saras; Dalton, Megan; Cartmel, Jennifer

2016-01-01

Health professionals may be expert clinicians but do not automatically make effective teachers and need educational development. In response, a team of health academics at an Australian university developed and evaluated the continuing education Graduate Certificate in Health Professional Education Program using an interprofessional learning model. The model was informed by Collins interactional expertise and Knowles adult learning theories. The team collaboratively developed and taught four courses in the program. Blended learning methods such as web-based learning, face-to-face workshops, and online discussion forums were used. Twenty-seven multidisciplinary participants enrolled in the inaugural program. Focus group interview, self-report questionnaires, and teacher observations were used to evaluate the program. Online learning motivated participants to learn in a collaborative virtual environment. The workshops conducted in an interprofessional environment promoted knowledge sharing and helped participants to better understand other discipline roles, so they could conduct clinical education within a broader health care team context. Work-integrated assessments supported learning relevance. The teachers, however, observed that some participants struggled because of lack of computer skills. Although the interprofessional learning model promoted collaboration and flexibility, it is important to note that consideration be given to participants who are not computer literate. We therefore conducted a library and computer literacy workshop in orientation week which helped. An interprofessional learning environment can assist health professionals to operate outside their "traditional silos" leading to a more collaborative approach to the provision of care. Our experience may assist other organizations in developing similar programs.

Independent auto evaluation of an operative radiological protection program

International Nuclear Information System (INIS)

Medrano L, M.A.; Rodriguez C, C.C.; Linares R, D.; Zarate M, N.; Zempoalteca B, R.

2006-01-01

The program of operative radiological protection of a nuclear power plant consists of multiple procedures and associate tasks that have as purpose the radiological protection of the workers of the power station. It is for this reason that the constant evaluation of the one it programs it is an important tool in the identification of their weaknesses (and strengths), so they can be assisted appropriately. In this work the main elements of the program of independent auto evaluation of the program of operative radiological protection of the Laguna Verde Central that has been developed and implemented by the National Institute of Nuclear Research are described. (Author)

Development, implementation and evaluation of a clinical research engagement and leadership capacity building program in a large Australian health care service.

Science.gov (United States)

Misso, Marie L; Ilic, Dragan; Haines, Terry P; Hutchinson, Alison M; East, Christine E; Teede, Helena J

2016-01-14

Health professionals need to be integrated more effectively in clinical research to ensure that research addresses clinical needs and provides practical solutions at the coal face of care. In light of limited evidence on how best to achieve this, evaluation of strategies to introduce, adapt and sustain evidence-based practices across different populations and settings is required. This project aims to address this gap through the co-design, development, implementation, evaluation, refinement and ultimately scale-up of a clinical research engagement and leadership capacity building program in a clinical setting with little to no co-ordinated approach to clinical research engagement and education. The protocol is based on principles of research capacity building and on a six-step framework, which have previously led to successful implementation and long-term sustainability. A mixed methods study design will be used. Methods will include: (1) a review of the literature about strategies that engage health professionals in research through capacity building and/or education in research methods; (2) a review of existing local research education and support elements; (3) a needs assessment in the local clinical setting, including an online cross-sectional survey and semi-structured interviews; (4) co-design and development of an educational and support program; (5) implementation of the program in the clinical environment; and (6) pre- and post-implementation evaluation and ultimately program scale-up. The evaluation focuses on research activity and knowledge, attitudes and preferences about clinical research, evidence-based practice and leadership and post implementation, about their satisfaction with the program. The investigators will evaluate the feasibility and effect of the program according to capacity building measures and will revise where appropriate prior to scale-up. It is anticipated that this clinical research engagement and leadership capacity building

LUDEP: A Lung Dose Evaluation Program

International Nuclear Information System (INIS)

Birchall, A.; Bailey, M.R.; James, A.C.

1990-06-01

A Task Group of the ICRP is currently reviewing its dosimetric model for the respiratory tract with the aim of producing a more comprehensive and realistic model which can be used both for dosimetry and bioassay purposes. This in turn requires deposition, clearance, and dosimetry to be treated in a more detailed manner in than in the current model. In order to examine the practical application and radiological implications of the proposed model, a microcomputer program has been developed in a modular form so that changes can be easily included as the model develops. LUDEP (Lung Dose Evaluation Program) is a user-friendly menu-driven program which can be operated on any IBM-compatible PC. It enables the user to calculate (a) doses to each region of the respiratory tract and all other body organs, and (b) excretion rates and retention curves for bioassay purposes. 11 refs., 4 figs., 6 tabs

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

Status of beta measurement evaluation and upgrade program

International Nuclear Information System (INIS)

Swinth, K.L.

1986-01-01

In 1983, the US Department of Energy (DOE) initiated a program to evaluate and upgrade beta dosimetry capabilities at DOE and DOE-contractor facilities. The program has several elements which structure the development of improvements in beta measurement practices. In addition to Pacific Northwest Laboratory (PNL), universities, private corporations, and other DOE facilities are involved in the research efforts

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Environmental assessment for the satellite power system concept development and evaluation program: atmospheric effects

International Nuclear Information System (INIS)

Rote, D.M.; Brubaker, K.L.; Lee, J.L.

1980-11-01

The US Department of Energy (DOE) has undertaken a preliminary, three-year program to investigate the impacts of the construction and operation of a satellite power system, of unprecedented scale. The Department of Energy's program, titled The Concept Development and Evaluation Program, focused its investigations on a Reference System description that calls for the use of either silicon (Si) or gallium aluminum-arsenide (GaAlAs) photovoltaic cells on 60 satellites to be constructed in GEO over a 30-yr period. Rectennas would be constructed on the ground to receive microwave energy from the satellites. Each satellite-rectenna pair is designed to produce 5 GW of power on an essentially continuous basis for use as a baseload power source for an electric power distribution system. The environmental assessment part of the program was divided into five interdependent task areas. The present document constitutes the final technical report on one of the five task areas, the Assessment of the Atmospheric Effects, and as such presents an in-depth summary of work performed during the assessment program. The issues associated with SPS activities in the troposphere are examined. These include tropospheric weather modification related to rectenna operations and rocket launches, and air quality impacts related to rocketlaunch ground clouds. Then progressing upward through the various levels of the atmosphere, the principal middle and upper atmospheric effects associated with rocket effluents are analyzed. Finally, all of the potential SPS atmospheric effects are summarized

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Intervention mapping: a process for developing theory- and evidence-based health education programs.

Science.gov (United States)

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

Use of Community Readiness Model to Develop and Evaluate a Pilot Culinary Training Program for School Nutrition Staff.

Science.gov (United States)

Hildebrand, Deana A; Blevins, Priscilla; Carl, Lillian; Brown, Barbara; Betts, Nancy M; Poe, Tiffany

2018-02-01

Use the Community Readiness Model (CRM) to develop and evaluate a contextually appropriate pilot culinary training program for school nutrition staff members. Mixed methods to guide intervention development. Six school districts in rural and urban areas of a southwestern state. School nutrition staff (n = 36; female; 20 years' experience). Pre- and post-training assessments used the CRM. Findings from the pre-assessment were used to develop the pilot culinary training intervention. Readiness to integrate new food preparation methods into existing practices. The researchers used t and Wilcoxon tests to compare overall readiness and dimension scores (P ≤ .05). Thematic analysis was used to identify themes from the discussion component of the assessments. Overall readiness increased from vague awareness to preparation (P = .02). Improved dimensions were knowledge of efforts (P = .004), leadership (P = .05), and knowledge of issues (P = .04). Themes included barriers, leadership, and motivation. The CRM was useful for developing and evaluating a contextually appropriate and effective culinary training program for school nutrition staff. Future efforts should address the provision of additional resources such as on-site chefs, small equipment grants, and engaging school stakeholders. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Wood Programs. Courseware Evaluation for Vocational and Technical Education.

Science.gov (United States)

Kaylor, Robert; And Others

This courseware evaluation rates the Wood Programs software developed by the Iowa Department of Public Instruction. (These programs--not contained in this document--include understanding board feet, wood characteristics, wood safety drill, wood dimensions, wood moisture, operating the table saw, radial arm, measurement drill, fraction drill, and…

Advanced Emissions Control Development Program

Energy Technology Data Exchange (ETDEWEB)

A.P.Evans; K.E. Redinger; M.J. Holmes

1998-04-01

The objective of the Advanced Emissions Control Development Program (AECDP) is to develop practical, cost-effective strategies for reducing the emissions of air toxics from coal-fired boilers. Ideally, the project aim is to effectively control air toxic emissions through the use of conventional flue gas cleanup equipment such as electrostatic precipitators (ESPS), fabric filters (baghouse), and wet flue gas desulfurization. Development work to date has concentrated on the capture of mercury, other trace metals, fine particulate and hydrogen chloride. Following the construction and evaluation of a representative air toxics test facility in Phase I, Phase II focused on the evaluation of mercury and several other air toxics emissions. The AECDP is jointly funded by the United States Department of Energy's Federal Energy Technology Center (DOE), the Ohio Coal Development Office within the Ohio Department of Development (oCDO), and Babcock& Wilcox-a McDermott company (B&W).

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

The management of evaluating the European programs and policies implemented in Romania

Directory of Open Access Journals (Sweden)

Doctoral student ROMAN MIHAELA

2011-12-01

Full Text Available Starting with the reform and modernization of the public administration in Romania in the mid 1990s, an important element of this process being the development of the management process, respectively of planning and managing public policies, the Romanian government started also a process of developing the capacity for evaluating public programs and policies, both the ones with European or foreign financing and the ones with domestic financing. Up-to-date analyses and studies have showed, however, that at the level of the national public sector there is a major discrepancy between the progress made in the evaluation of European programs or the ones with foreign financing and the programs financed from public funds, namely that there is a consolidated evaluation practice as regards the first types of programs, which is virtually inexistent as regards programs financed from the public budget.This paper intends to identify the progress made at the level of the Romanian public administration as regards the management of evaluating programs with European financing, to see the characteristics of building the evaluation capacity within the national system of these programs and the motivation stimulating such approaches. The first part of this paper shall contain a presentation of the background of the current evaluation system, including both the legislative framework and the institutional framework with duties of management and evaluation of European programs; further, I shall analyze the evolution of this system in order to be able to draw conclusions regarding the evaluation capacity of Romania.

Impact of a student leadership development program.

Science.gov (United States)

Chesnut, Renae; Tran-Johnson, Jennifer

2013-12-16

To assess the effectiveness of the Student Leadership Development Series (SLDS), an academic-year--long, co-curricular approach to developing leadership skills in pharmacy students. Participants met once per month for activities and a college-wide guest speaker session. Students also completed monthly forms regarding what they had learned, participated in poster presentations, and created a personal leadership platform. One hundred twenty-three students participated in the program between 2008 and 2013. On monthly evaluation forms and a summative evaluation, students indicated that the program helped them feel prepared for leadership opportunities and increased their desire to pursue leadership. They valued interacting with pharmacy leaders from the community and learning how they could distinguish themselves as leaders. The SLDS provided pharmacy students with an opportunity to explore personal leadership styles and develop broader understanding of leadership, and increased their desire to pursue leadership positions in the future.

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Leadership development programs for physicians: a systematic review.

Science.gov (United States)

Frich, Jan C; Brewster, Amanda L; Cherlin, Emily J; Bradley, Elizabeth H

2015-05-01

Physician leadership development programs typically aim to strengthen physicians' leadership competencies and improve organizational performance. We conducted a systematic review of medical literature on physician leadership development programs in order to characterize the setting, educational content, teaching methods, and learning outcomes achieved. Articles were identified through a search in Ovid MEDLINE from 1950 through November 2013. We included articles that described programs designed to expose physicians to leadership concepts, outlined teaching methods, and reported evaluation outcomes. A thematic analysis was conducted using a structured data entry form with categories for setting/target group, educational content, format, type of evaluation and outcomes. We identified 45 studies that met eligibility criteria, of which 35 reported on programs exclusively targeting physicians. The majority of programs focused on skills training and technical and conceptual knowledge, while fewer programs focused on personal growth and awareness. Half of the studies used pre/post intervention designs, and four studies used a comparison group. Positive outcomes were reported in all studies, although the majority of studies relied on learner satisfaction scores and self-assessed knowledge or behavioral change. Only six studies documented favorable organizational outcomes, such as improvement in quality indicators for disease management. The leadership programs examined in these studies were characterized by the use of multiple learning methods, including lectures, seminars, group work, and action learning projects in multidisciplinary teams. Physician leadership development programs are associated with increased self-assessed knowledge and expertise; however, few studies have examined outcomes at a system level. Our synthesis of the literature suggests important gaps, including a lack of programs that integrate non-physician and physician professionals, limited use of more

Evaluation of Pre-Departure English Training Program

Directory of Open Access Journals (Sweden)

Ali Saukah

2016-02-01

Full Text Available The program evaluation reported in this article covers three batches of participants, from 1996 through 1997, sponsored by the Directorate General of Higher Education projects to prepare faculty members of teacher training institutions for overseas studies. The result outcomes could be achieved when the initial English competence requirred for participating in the program was at least at the Pre-Advanced level. The criterion validity of the TOEFL-Equivalent test developed by the program was assured, and the test could, therefore, be used as a good predictor of the International TOEFL. Other recommendations are also given for the improvement of the planning and implementation of the program in the future

Cooperation and human development projects as bachelor, master and PhD thesis: evaluating an internship program

OpenAIRE

Ferrer Martí, Laia; Garfi, Marianna; Ferrer Martí, Ivet

2015-01-01

The Research Group on Cooperation and Human Development (GRECDH) of the Technical University of Catalonia (UPC) has long promoted Bachelor, Master and PhD Theses in the framework of sustainable energy projects in low income countries. In this way, students combine their work at UPC with tasks in these countries. The aim of this paper is to present and evaluate the program through the experience of several students who participated in sustainable energy projects in Central and South America.

Developing an evaluation framework for clinical redesign programs: lessons learnt.

Science.gov (United States)

Samaranayake, Premaratne; Dadich, Ann; Fitzgerald, Anneke; Zeitz, Kathryn

2016-09-19

Purpose The purpose of this paper is to present lessons learnt through the development of an evaluation framework for a clinical redesign programme - the aim of which was to improve the patient journey through improved discharge practices within an Australian public hospital. Design/methodology/approach The development of the evaluation framework involved three stages - namely, the analysis of secondary data relating to the discharge planning pathway; the analysis of primary data including field-notes and interview transcripts on hospital processes; and the triangulation of these data sets to devise the framework. The evaluation framework ensured that resource use, process management, patient satisfaction, and staff well-being and productivity were each connected with measures, targets, and the aim of clinical redesign programme. Findings The application of business process management and a balanced scorecard enabled a different way of framing the evaluation, ensuring measurable outcomes were connected to inputs and outputs. Lessons learnt include: first, the importance of mixed-methods research to devise the framework and evaluate the redesigned processes; second, the need for appropriate tools and resources to adequately capture change across the different domains of the redesign programme; and third, the value of developing and applying an evaluative framework progressively. Research limitations/implications The evaluation framework is limited by its retrospective application to a clinical process redesign programme. Originality/value This research supports benchmarking with national and international practices in relation to best practice healthcare redesign processes. Additionally, it provides a theoretical contribution on evaluating health services improvement and redesign initiatives.

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

A comparative evaluation of the process of developing and implementing an emergency department HIV testing program

Directory of Open Access Journals (Sweden)

Weiser Sheri

2011-03-01

Full Text Available Abstract Background The 2006 Centers for Disease Control and Prevention (CDC HIV testing guidelines recommend screening for HIV infection in all healthcare settings, including the emergency department (ED. In urban areas with a high background prevalence of HIV, the ED has become an increasingly important site for identifying HIV infection. However, this public health policy has been operationalized using different models. We sought to describe the development and implementation of HIV testing programs in three EDs, assess factors shaping the adoption and evolution of specific program elements, and identify barriers and facilitators to testing. Methods We performed a qualitative evaluation using in-depth interviews with fifteen 'key informants' involved in the development and implementation of HIV testing in three urban EDs serving sizable racial/ethnic minority and socioeconomically disadvantaged populations. Testing program HIV prevalence ranged from 0.4% to 3.0%. Results Three testing models were identified, reflecting differences in the use of existing ED staff to offer and perform the test and disclose results. Factors influencing the adoption of a particular model included: whether program developers were ED providers, HIV providers, or both; whether programs took a targeted or non-targeted approach to patient selection; and the extent to which linkage to care was viewed as the responsibility of the ED. A common barrier was discomfort among ED providers about disclosing a positive HIV test result. Common facilitators were a commitment to underserved populations, the perception that testing was an opportunity to re-engage previously HIV-infected patients in care, and the support and resources offered by the medical setting for HIV-infected patients. Conclusions ED HIV testing is occurring under a range of models that emerge from local realities and are tailored to institutional strengths to optimize implementation and overcome provider

Office of Technology Development`s Research, Development, Demonstration, Testing and Evaluation Mid-Year Program Review. Volume 1

Energy Technology Data Exchange (ETDEWEB)

1994-08-01

This document presents brief summaries of waste management, remedial action, decommissioning/decontamination, and waste processing programs and issues currently being developed at Department of Energy Facilities.

Lessons learned: Evaluating the program fidelity of UNWomen Partnership for Peace domestic violence diversion program in the Eastern Caribbean.

Science.gov (United States)

Jeremiah, Rohan D; Quinn, Camille R; Alexis, Jicinta M

2018-08-01

To date, there have been a plethora of punitive and diversion programs to address domestic violence around the world. However, the evaluative scholarship of such programs overwhelmingly reflects studies in developed countries while barely showcasing the realities of addressing domestic violence in developing countries. This paper features a multi-year (2008-2011) evaluation study that measured the fidelity of the United Nations Partnership for Peace (PfP) domestic violence diversion program in the Eastern Caribbean country of Grenada. Our findings illuminate organic engagement strategies that were built within existing multi-sectoral partnerships that included magistrate court judges, law enforcement officials, and social service agencies. Furthermore, we documented how the locally-devised implementation strategies ensured the program's fidelity within a resource-limited context. This paper contributes to the global evaluative scholarship, highlighting the lessons learned about implementing culturally-adapted and theoretically-driven domestic violence diversion within a developing country. Copyright © 2018 Elsevier Ltd. All rights reserved.

Economic Evaluation of a Comprehensive Teenage Pregnancy Prevention Program: Pilot Program

Science.gov (United States)

Rosenthal, Marjorie S.; Ross, Joseph S.; Bilodeau, RoseAnne; Richter, Rosemary S.; Palley, Jane E.; Bradley, Elizabeth H.

2011-01-01

Background Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic are effective in reducing births among enrolled teenagers. However, there have been limited data on costs and cost-effectiveness of such programs. Objectives To use a community-based participatory research approach, to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Methods Using data from 1997-2003, we conducted an in-time intervention analysis to determine program cost-benefit while teenagers were enrolled and then used an extrapolation analysis to estimate accyrred economibc benefits and cost-benefit up to age 30. Results The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage females, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1,599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 on average, with social benefits outweighing total social costs by age 20.1. Conclusions We estimate that this comprehensive teenage pregnancy prevention program would provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost-effectiveness of similarly comprehensive programs when implemented more widely in high-risk neighborhoods. PMID:19896030

Economic evaluation of a comprehensive teenage pregnancy prevention program: pilot program.

Science.gov (United States)

Rosenthal, Marjorie S; Ross, Joseph S; Bilodeau, Roseanne; Richter, Rosemary S; Palley, Jane E; Bradley, Elizabeth H

2009-12-01

Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic support are effective in reducing births among enrolled teenagers. However, there have been limited data on the costs and cost effectiveness of such programs. The study used a community-based participatory research approach to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Using data from 1997-2003, an in-time intervention analysis was conducted to determine program cost-benefit while teenagers were enrolled; an extrapolation analysis was then used to estimate accrued economic benefits and cost-benefit up to age 30 years. The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage girls, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 years on average, with social benefits outweighing total social costs by age 20.1 years. This comprehensive teenage pregnancy prevention program is estimated to provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost effectiveness of similarly comprehensive programs when they are implemented more widely in high-risk neighborhoods.

Return on investment in healthcare leadership development programs.

Science.gov (United States)

Jeyaraman, Maya M; Qadar, Sheikh Muhammad Zeeshan; Wierzbowski, Aleksandra; Farshidfar, Farnaz; Lys, Justin; Dickson, Graham; Grimes, Kelly; Phillips, Leah A; Mitchell, Jonathan I; Van Aerde, John; Johnson, Dave; Krupka, Frank; Zarychanski, Ryan; Abou-Setta, Ahmed M

2018-02-05

Purpose Strong leadership has been shown to foster change, including loyalty, improved performance and decreased error rates, but there is a dearth of evidence on effectiveness of leadership development programs. To ensure a return on the huge investments made, evidence-based approaches are needed to assess the impact of leadership on health-care establishments. As a part of a pan-Canadian initiative to design an effective evaluative instrument, the purpose of this paper was to identify and summarize evidence on health-care outcomes/return on investment (ROI) indicators and metrics associated with leadership quality, leadership development programs and existing evaluative instruments. Design/methodology/approach The authors performed a scoping review using the Arksey and O'Malley framework, searching eight databases from 2006 through June 2016. Findings Of 11,868 citations screened, the authors included 223 studies reporting on health-care outcomes/ROI indicators and metrics associated with leadership quality (73 studies), leadership development programs (138 studies) and existing evaluative instruments (12 studies). The extracted ROI indicators and metrics have been summarized in detail. Originality/value This review provides a snapshot in time of the current evidence on ROI indicators and metrics associated with leadership. Summarized ROI indicators and metrics can be used to design an effective evaluative instrument to assess the impact of leadership on health-care organizations.

Developing Leaders: Implementation of a Peer Advising Program for a Public Health Sciences Undergraduate Program

Directory of Open Access Journals (Sweden)

Megan eGriffin

2015-01-01

Full Text Available Peer advising is an integral part of our undergraduate advising system in the Public Health Sciences major at the University of Massachusetts Amherst. The program was developed in 2009 to address the advising needs of a rapidly growing major that went from 25 to over 530 majors between 2007 and 2014. Each year, 9-12 top performing upper-level students are chosen through an intensive application process. A major goal of the program is to provide curriculum and career guidance to students in the major and empower students in their academic and professional pursuits. The year-long program involves several components, including: staffing the drop-in advising center, attending training seminars, developing and presenting workshops for students, meeting prospective students and families, evaluating ways to improve the program, and collaborating on self-directed projects. The peer advisors also provide program staff insight into the needs and perspectives of students in the major. In turn, peer advisors gain valuable leadership and communication skills, and learn strategies for improving student success. The Peer Advising Program builds community and fosters personal and professional development for the peer advisors. In this paper, we will discuss the undergraduate peer advising model, the benefits and challenges of the program, and lessons learned. Several methods were used to understand the perceived benefits and challenges of the program and experiences of students who utilized the Peer Advising Center. The data for this evaluation were drawn from three sources: 1 archival records from the Peer Advising Center; 2 feedback from peer advisors who completed the year-long internship; and 3 a survey of students who utilized the Peer Advising Center. Results of this preliminary evaluation indicate that peer advisors gain valuable skills that they can carry into their professional world. The program is also a way to engage students in building community

Using program logic model analysis to evaluate and better deliver what works

International Nuclear Information System (INIS)

Megdal, Lori; Engle, Victoria; Pakenas, Larry; Albert, Scott; Peters, Jane; Jordan, Gretchen

2005-01-01

There is a rich history in using program theories and logic models (PT/LM) for evaluation, monitoring, and program refinement in a variety of fields, such as health care, social and education programs. The use of these tools to evaluate and improve energy efficiency programs has been growing over the last 5-7 years. This paper provides an overview of the state-of-the-art methods of logic model development, with analysis that significantly contributed to: Assessing the logic behind how the program expects to be able to meets its ultimate goals, including the 'who', the 'how', and through what mechanism. In doing so, gaps and questions that still need to be addressed can be identified. Identifying and prioritize the indicators that should be measured to evaluate the program and program theory. Determining key researchable questions that need to be answered by evaluation/research, to assess whether the mechanism assumed to cause the changes in actions, attitudes, behaviours, and business practices is workable and efficient. Also will assess the validity in the program logic and the likelihood that the program can accomplish its ultimate goals. Incorporating analysis of prior like programs and social science theories in a framework to identify opportunities for potential program refinements. The paper provides an overview of the tools, techniques and references, and uses as example the energy efficiency program analysis conducted for the New York State Energy Research and Development Authority's (NYSERDA) New York ENERGY $MART SM programs

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Green supplier development program selection using NGT and VIKOR under fuzzy environment

DEFF Research Database (Denmark)

Awasthi, Anjali; Govindan, Kannan

2016-01-01

Developing environmental performance of suppliers is critical for green supply chain management. Organizations are nowadays investing in various green supplier development programs to enhance their supplier performances. The decision to select the right program for green supplier development...... is often a challenging decision due to lack of prior experience, limited quantitative information, specific context of the organization, and varying supplier backgrounds. This paper addresses the problem of evaluating green supplier development programs and proposes a fuzzy NGT (Nominal Group Technique......)-VIKOR (VlseKriterijumska Optimizacija I Kompromisno Resenje) based solution approach. NGT is used to identify criteria for evaluating green supplier development programs. Fuzzy theory is used to address qualitative (linguistic) ratings for the alternatives and the selected criteria used under lack...

Evaluating the effectiveness of a laboratory-based professional development program for science educators

Science.gov (United States)

Amolins, Michael W.; Ezrailson, Cathy M.; Pearce, David A.; Elliott, Amy J.

2015-01-01

The process of developing effective science educators has been a long-standing objective of the broader education community. Numerous studies have recommended not only depth in a teacher's subject area but also a breadth of professional development grounded in constructivist principles, allowing for successful student-centered and inquiry-based instruction. Few programs, however, have addressed the integration of the scientific research laboratory into the science classroom as a viable approach to professional development. Additionally, while occasional laboratory training programs have emerged in recent years, many lack a component for translating acquired skills into reformed classroom instruction. Given the rapid development and demand for knowledgeable employees and an informed population from the biotech and medical industries in recent years, it would appear to be particularly advantageous for the physiology and broader science education communities to consider this issue. The goal of this study was to examine the effectiveness of a laboratory-based professional development program focused on the integration of reformed teaching principles into the classrooms of secondary teachers. This was measured through the program's ability to instill in its participants elevated academic success while gaining fulfillment in the classroom. The findings demonstrated a significant improvement in the use of student-centered instruction and other reformed methods by program participants as well as improved self-efficacy, confidence, and job satisfaction. Also revealed was a reluctance to refashion established classroom protocols. The combination of these outcomes allowed for construction of an experiential framework for professional development in applied science education that supports an atmosphere of reformed teaching in the classroom. PMID:26628658

Integrating Professional Development into STEM Graduate Programs: Student-Centered Programs for Career Preparation

Science.gov (United States)

Lautz, L.; McCay, D.; Driscoll, C. T.; Glas, R. L.; Gutchess, K. M.; Johnson, A.; Millard, G.

2017-12-01

Recognizing that over half of STEM Ph.D. graduates are finding work outside of academia, a new, NSF-funded program at Syracuse University, EMPOWER (or Education Model Program on Water-Energy Research) is encouraging its graduate students to take ownership of their graduate program and design it to meet their anticipated needs. Launched in 2016, EMPOWER's goal is to prepare graduate students for careers in the water-energy field by offering targeted workshops, professional training coursework, a career capstone experience, a professional development mini-grant program, and an interdisciplinary "foundations" seminar. Through regular student feedback and program evaluation, EMPOWER has learned some important lessons this first year: career options and graduate students' interests are diverse, requiring individualized programs designed to meet the needs of prospective employers and employees; students need exposure to the range of careers in their field to provide a roadmap for designing their own graduate school experience; effective programs nurture a culture that values professional development thereby giving students permission to pursue career paths and professional development opportunities that meet their own needs and interests; and existing university resources support the effective and efficient integration of professional development activities into graduate programs. Many of the positive outcomes experienced by EMPOWER students may be achieved in departmental graduate programs with small changes to their graduate curricula.

CRECTJ: a computer program for compilation of evaluated nuclear data

Energy Technology Data Exchange (ETDEWEB)

Nakagawa, Tsuneo [Japan Atomic Energy Research Inst., Tokai, Ibaraki (Japan). Tokai Research Establishment

1999-09-01

In order to compile evaluated nuclear data in the ENDF format, the computer program CRECTJ has been developed. CRECTJ has two versions; CRECTJ5 treats the data in the ENDF/B-IV and ENDF/B-V format, and CRECTJ6 the data in the ENDF-6 format. These programs have been frequently used to make Japanese Evaluated Nuclear Data Library (JENDL). This report describes input data and examples of CRECTJ. (author)

Integrating hypermedia into the environmental education setting: Developing a program and evaluating its effect

Science.gov (United States)

Parker, Tehri Davenport

1997-09-01

This study designed, implemented, and evaluated an environmental education hypermedia program for use in a residential environmental education facility. The purpose of the study was to ascertain whether a hypermedia program could increase student knowledge and positive attitudes toward the environment and environmental education. A student/computer interface, based on the theory of social cognition, was developed to direct student interactions with the computer. A quasi-experimental research design was used. Students were randomly assigned to either the experimental or control group. The experimental group used the hypermedia program to learn about the topic of energy. The control group received the same conceptual information from a teacher/naturalist. An Environmental Awareness Quiz was administered to measure differences in the students' cognitive understanding of energy issues. Students participated in one on one interviews to discuss their attitudes toward the lesson and the overall environmental education experience. Additionally, members of the experimental group were tape recorded while they used the hypermedia program. These tapes were analyzed to identify aspects of the hypermedia program that promoted student learning. The findings of this study suggest that computers, and hypermedia programs, can be integrated into residential environmental education facilities, and can assist environmental educators in meeting their goals for students. The study found that the hypermedia program was as effective as the teacher/naturalist for teaching about environmental education material. Students who used the computer reported more positive attitudes toward the lesson on energy, and thought that they had learned more than the control group. Students in the control group stated that they did not learn as much as the computer group. The majority of students had positive attitudes toward the inclusion of computers in the camp setting, and stated that they were a good

Evaluation of the Tier 1 Program of Project P.A.T.H.S.: Secondary Data Analyses of Conclusions Drawn by the Program Implementers

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2008-01-01

Full Text Available The Tier 1 Program of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes is a curricula-based positive youth development program. In the experimental implementation phase, 52 schools participated in the program. Based on subjective outcome evaluation data collected from the program participants (Form A and program implementers (Form B in each school, the program implementers were invited to write down five conclusions based on an integration of the evaluation findings (N = 52. The conclusions stated in the 52 evaluation reports were further analyzed via secondary data analyses in this paper. Results showed that most of the conclusions concerning perceptions of the Tier 1 Program, instructors, and effectiveness of the programs were positive in nature. There were also conclusions reflecting the respondents’ appreciation of the program. Finally, responses on the difficulties encountered and suggestions for improvements were observed. In conjunction with the previous evaluation findings, the present study suggests that the Tier 1 Program was well received by the stakeholders and the program was beneficial to the development of the program participants.

Development and Evaluation of an Economic-Driving Assistance Program for Transit Vehicles

Directory of Open Access Journals (Sweden)

Baoxin Han

2012-02-01

Full Text Available This paper focuses on development and evaluation of an economic-driving assistance program for transit vehicles (EDTV which can minimize energy consumption, air pollution emission of buses, and improve the level of service of transit system as well. Taking advantage of the latest advances in information and communication technologies, the EDTV system can provide bus drivers with optimal recommended bus holding times at near-side bus stops and dynamic bus speed to adapt to the real-time traffic control plan at downstream intersections. In order to address the impacts of the stochastic variation of bus dwell time, the total link between adjacent intersections is divided into three parts: upstream of bus stop part; bus stop part; and downstream of bus stop part. The methods for calculating recommended parameters, including bus holding time and bus speed in each of the three parts are proposed based on real-time bus status and signal status at downstream intersections. A VISSIM-based simulation platform was designed and used for simulating and evaluating the proposed EDTV system. Extensive experimental analyses have shown that the proposed EDTV system can improve the performance of a transit system in terms of reducing fuel consumption, air pollution emissions and level of service of the transit system.

Statistical Process Control in the Practice of Program Evaluation.

Science.gov (United States)

Posavac, Emil J.

1995-01-01

A technique developed to monitor the quality of manufactured products, statistical process control (SPC), incorporates several features that may prove attractive to evaluators. This paper reviews the history of SPC, suggests how the approach can enrich program evaluation, and illustrates its use in a hospital-based example. (SLD)

Development of a Teen-Friendly Health Education Program on Facebook: Lessons Learned.

Science.gov (United States)

Park, Bu Kyung; Nahm, Eun-Shim; Rogers, Valerie E

2016-01-01

Facebook is the most popular online platform among adolescents and can be an effective medium to deliver health education. Although Korean American (KA) adolescents are at risk of obesity, a culturally tailored health education program is not available for them. Thus, our research team developed a health education program for KA adolescents on Facebook called "Healthy Teens." The aim of this study was to discuss important lessons learned through the program development process. This program includes culturally tailored learning modules about healthy eating and physical activity. The program was developed on the basis of the social cognitive theory, and the online program was developed by applying Web usability principles for adolescents. Upon completion, the usability of the program was assessed using heuristic evaluation. The findings from the heuristic evaluation showed that the Healthy Teens program was usable for KA adolescents. The findings from this study will assist researchers who are planning to build similar Facebook-based health education programs. Copyright © 2016 National Association of Pediatric Nurse Practitioners. Published by Elsevier Inc. All rights reserved.

MHD magnet technology development program summary, September 1982

Energy Technology Data Exchange (ETDEWEB)

1983-11-01

The program of MHD magnet technology development conducted for the US Department of Energy by the Massachusetts Institute of Technology during the past five years is summarized. The general strategy is explained, the various parts of the program are described and the results are discussed. Subjects covered include component analysis, research and development aimed at improving the technology base, preparation of reference designs for commercial-scale magnets with associated design evaluations, manufacturability studies and cost estimations, the detail design and procurement of MHD test facility magnets involving transfer of technology to industry, investigations of accessory subsystem characteristics and magnet-flow-train interfacing considerations and the establishment of tentative recommendations for design standards, quality assurance procedures and safety procedures. A systematic approach (framework) developed to aid in the selection of the most suitable commercial-scale magnet designs is presented and the program status as of September 1982 is reported. Recommendations are made for future work needed to complete the design evaluation and selection process and to provide a sound technological base for the detail design and construction of commercial-scale MHD magnets. 85 references.

MHD magnet technology development program summary, September 1982

International Nuclear Information System (INIS)

1983-11-01

The program of MHD magnet technology development conducted for the US Department of Energy by the Massachusetts Institute of Technology during the past five years is summarized. The general strategy is explained, the various parts of the program are described and the results are discussed. Subjects covered include component analysis, research and development aimed at improving the technology base, preparation of reference designs for commercial-scale magnets with associated design evaluations, manufacturability studies and cost estimations, the detail design and procurement of MHD test facility magnets involving transfer of technology to industry, investigations of accessory subsystem characteristics and magnet-flow-train interfacing considerations and the establishment of tentative recommendations for design standards, quality assurance procedures and safety procedures. A systematic approach (framework) developed to aid in the selection of the most suitable commercial-scale magnet designs is presented and the program status as of September 1982 is reported. Recommendations are made for future work needed to complete the design evaluation and selection process and to provide a sound technological base for the detail design and construction of commercial-scale MHD magnets. 85 references

Process evaluation of the Regional Biomass Energy Program

Energy Technology Data Exchange (ETDEWEB)

Wilson, C.R.; Brown, M.A.; Perlack, R.D.

1994-03-01

The U.S. Department of Energy (DOE) established the Regional Biomass Energy Program (RBEP) in 1983 to increase the production and use of biomass energy resources. Through the creation of five regional program (the Great Lakes, Northeast, Pacific Northwest, Southeast, and West), the RBEP focuses on regionally specific needs and opportunities. In 1992, Oak Ridge National (ORNL) conducted a process evaluation of the RBEP Program designed to document and explain the development of the goals and strategies of the five regional programs; describe the economic and market context surrounding commercialization of bioenergy systems; assess the criteria used to select projects; describe experiences with cost sharing; identify program accomplishments in the transfer of information and technology; and offer recommendations for program improvement.

Promoting Success: A Professional Development Coaching Program for Interns in Medicine.

Science.gov (United States)

Palamara, Kerri; Kauffman, Carol; Stone, Valerie E; Bazari, Hasan; Donelan, Karen

2015-12-01

Residency is an intense period. Challenges, including burnout, arise as new physicians develop their professional identities. Residency programs provide remediation, but emotional support for interns is often limited. Professional development coaching of interns, regardless of their performance, has not been reported. Design, implement, and evaluate a program to support intern professional development through positive psychology coaching. We implemented a professional development coaching program in a large residency program. The program included curriculum development, coach-intern interactions, and evaluative metrics. A total of 72 internal medicine interns and 26 internal medicine faculty participated in the first year. Interns and coaches were expected to meet quarterly; expected time commitments per year were 9 hours (per individual coached) for coaches, 5 1/2 hours for each individual coachee, and 70 hours for the director of the coaching program. Coaches and interns were asked to complete 2 surveys in the first year and to participate in qualitative interviews. Eighty-two percent of interns met with their coaches 3 or more times. Coaches and their interns assessed the program in multiple dimensions (participation, program and professional activities, burnout, coping, and coach-intern communication). Most of the interns (94%) rated the coaching program as good or excellent, and 96% would recommend this program to other residency programs. The experience of burnout was lower in this cohort compared with a prior cohort. There is early evidence that a coaching program of interactions with faculty trained in positive psychology may advance intern development and partially address burnout.

Evaluating the effectiveness of a laboratory-based professional development program for science educators.

Science.gov (United States)

Amolins, Michael W; Ezrailson, Cathy M; Pearce, David A; Elliott, Amy J; Vitiello, Peter F

2015-12-01

The process of developing effective science educators has been a long-standing objective of the broader education community. Numerous studies have recommended not only depth in a teacher's subject area but also a breadth of professional development grounded in constructivist principles, allowing for successful student-centered and inquiry-based instruction. Few programs, however, have addressed the integration of the scientific research laboratory into the science classroom as a viable approach to professional development. Additionally, while occasional laboratory training programs have emerged in recent years, many lack a component for translating acquired skills into reformed classroom instruction. Given the rapid development and demand for knowledgeable employees and an informed population from the biotech and medical industries in recent years, it would appear to be particularly advantageous for the physiology and broader science education communities to consider this issue. The goal of this study was to examine the effectiveness of a laboratory-based professional development program focused on the integration of reformed teaching principles into the classrooms of secondary teachers. This was measured through the program's ability to instill in its participants elevated academic success while gaining fulfillment in the classroom. The findings demonstrated a significant improvement in the use of student-centered instruction and other reformed methods by program participants as well as improved self-efficacy, confidence, and job satisfaction. Also revealed was a reluctance to refashion established classroom protocols. The combination of these outcomes allowed for construction of an experiential framework for professional development in applied science education that supports an atmosphere of reformed teaching in the classroom. Copyright © 2015 The American Physiological Society.

Promoting Healthy Development among Adolescent Girls: A Mixed-Methods Evaluation of the HERstory Program

Directory of Open Access Journals (Sweden)

Emily MacFarlane

2013-03-01

Full Text Available The Leadership Program’s HERstory is a school-based, universal, preventative intervention designed to promote healthy youth development among adolescent girls by increasing their connections to pro-social peers and to school and community while developing social-emotional skills that serve as protective factors. In this school-year-long program, a facilitator implements three program phases: group development activities in Community Building, self-reflective Writing Workshop exercises, and a final Creative Output project, an ethnographic theater production or literary journal developed from participants’ Writing Workshop responses. The current mixed-methods study presents early evidence of program effectiveness based on focus groups and school record data review at two NYC public schools during the 2010-2011 school year. Participants reported improvements in key areas targeted by HERstory, including peer connectedness, academic achievement, and a range of protective factors including future orientation and goal setting. Results suggest this program approach may be suitable promoting healthy adolescent development for girls.

Developing fire management mixes for fire program planning

Science.gov (United States)

Armando González-Cabán; Patricia B. Shinkle; Thomas J. Mills

1986-01-01

Evaluating economic efficiency of fire management program options requires information on the firefighting inputs, such as vehicles and crews, that would be needed to execute the program option selected. An algorithm was developed to translate automatically dollars allocated to type of firefighting inputs to numbers of units, using a set of weights for a specific fire...

Westinghouse corporate development of a decision software program for Radiological Evaluation Decision Input (REDI)

International Nuclear Information System (INIS)

Bush, T.S.

1995-01-01

In December 1992, the Department of Energy (DOE) implemented the DOE Radiological Control Manual (RCM). Westinghouse Idaho Nuclear Company, Inc. (WINCO) submitted an implementation plan showing how compliance with the manual would be achieved. This implementation plan was approved by DOE in November 1992. Although WINCO had already been working under a similar Westinghouse RCM, the DOE RCM brought some new and challenging requirements. One such requirement was that of having procedure writers and job planners create the radiological input in work control procedures. Until this time, that information was being provided by radiological engineering or a radiation safety representative. As a result of this requirement, Westinghouse developed the Radiological Evaluation Decision Input (REDI) program

Westinghouse corporate development of a decision software program for Radiological Evaluation Decision Input (REDI)

Energy Technology Data Exchange (ETDEWEB)

Bush, T.S. [Westinghosue Idaho Nuclear Co., Inc., Idaho Falls, ID (United States)

1995-03-01

In December 1992, the Department of Energy (DOE) implemented the DOE Radiological Control Manual (RCM). Westinghouse Idaho Nuclear Company, Inc. (WINCO) submitted an implementation plan showing how compliance with the manual would be achieved. This implementation plan was approved by DOE in November 1992. Although WINCO had already been working under a similar Westinghouse RCM, the DOE RCM brought some new and challenging requirements. One such requirement was that of having procedure writers and job planners create the radiological input in work control procedures. Until this time, that information was being provided by radiological engineering or a radiation safety representative. As a result of this requirement, Westinghouse developed the Radiological Evaluation Decision Input (REDI) program.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Nondestructive Evaluation Program: Progress in 1986

International Nuclear Information System (INIS)

1987-07-01

The increasing cost of equipment for power generating plants and the potential increases in productivity and safety available through rapidly developing Nondestructive Evaluation (NDE) technology led EPRI to initiate a Nondestructive Evaluation Program in 1974. To date, the major focus has been on light water reactor inspection problems; however, increased application to other systems is now under way. This report presents a comprehensive review of the EPRI effort in the NDE area. Most of the report consists of contractor-supplied progress reports on each current project. An organizational plan of the program is presented in overview. In addition, organization from several viewpoints is presented, e.g., in-service inspection operators, R and D personnel, and utility representatives. The report summarizes significant progress made since the previous EPRI Special Report NP-4315-SR was issued in May 1986. Section 1 contains information about the program organization, and the sections that follow contain contractor-supplied progress reports of each current project. The progress reports are grouped by plant components - pipe, pressure vessel, steam generator and boiler tubes, and turbine. In addition, Part 6 is devoted to discussions of technology transfer

Boron neutron capture therapy: Brain Tumor Treatment Evaluation Program

International Nuclear Information System (INIS)

Griebenow, M.L.; Dorn, R.V. III; Gavin, P.R.; Spickard, J.H.

1988-01-01

The United States (US) Department of Energy (DOE) recently initiated a focused, multidisciplined program to evaluate Boron Neutron Capture Therapy (BNCT) for the treatment of brain tumors. The program, centered at the DOE/endash/Idaho National Engineering Laboratory (INEL), will develop the analytical, diagnostic and treatment tools, and the database required for BNCT technical assessment. The integrated technology will be evaluated in a spontaneously-occurring canine brain-tumor model. Successful animal studies are expected to lead to human clinical trials within four to five years. 2 refs., 3 figs

Development of public health program for type 1 diabetes in a university community: preliminary evaluation of behavioural change wheel.

Science.gov (United States)

Nwose, Ezekiel Uba; Digban, K A; Anyasodor, A E; Bwititi, P T; Richards, R S; Igumbor, E O

2017-10-23

Diabetes mellitus, including type 1 is a global public health problem among the young persons. While public health campaign and screening program is a potential strategy, but communication skills, knowledge and opinion of the healthcare personnel are indicated as variables that can impact patient's education, which will lead to better outcome of care. Thus, in designing or planning a program for public health, workforce development considers opinion and behavioural change wheel of prospective personnel. The purpose of this preliminary study was to evaluate if a university academic department has the behavioural change wheel to function as workforce infrastructure for an envisioned program. Survey of knowledge, attitude and practice (KAP) of a university community regarding diabetes type 1 was performed. The KAP were translated into behavioural change wheel comprising capacity, motivation and opportunity (CMO). There are baseline indications of the behavioural change wheel potential of the public health department to run a T1D screening program. The number of participants who knew someone with T1D was significantly higher than the subgroup with no such knowledge (pwheel or CMO to develop a workforce infrastructure for T1D screening program, the experience that comes with age of lecturers will be an important factor to enable such program to succeed.

Update on the development and evaluation of a program of regional collaboration for non-proliferation and transparency

International Nuclear Information System (INIS)

Furaus, James P.; Hori, Masato; Glidewell, Don

2003-01-01

The purpose of the research is to develop and evaluate a Program of Regional Cooperation for Non-proliferation and transparency in the Pacific Rim arena. There has been interest in the development of regional collaboration in the Pacific Rim for over thirty years, but without the kind of results that have been observed in other areas of the world, such as Europe and South America. While there have been many discussions and many papers written on the topic, there has not been a concept or a program that has been proposed and successfully implemented. This research will identify attributes of existing successful regional collaborations in other parts of the world, research the open literature for past ideas and attempts for regional collaboration in the Pacific Rim, and propose a model for a sustainable regional collaboration in the Pacific Rim. One of the strategies for developing the program of collaboration is to create a Joint Program Plan for the Implementation of Technology Based Regional Cooperation. This plan will be developed jointly by Japan Nuclear Cycle Development Institute (JNC) and Sandia National Laboratories (SNL), with input from the US Department of Energy/National Nuclear Security Administration/National Nuclear Security Administration (USDOE/NNSA), the International Atomic Energy Agency (IAEA) and other interested organizations. The plan will be a 'living plan,' that will be reviewed on a yearly basis to review status, and update as necessary. Another strategy is to implement technical objectives in parallel with the development of the program plan. This would include the completion of the implementation of a Virtual Private Network (VPN) system at JNC and sharing transparency data with SNL, USDOE/NNSA, IAEA, and other interested Pacific Rim entities. The availability of commercial off-the-shelf VPN systems, a technology that allows secure, inexpensive transfer of data across the Internet, will potentially be a key ingredient in the development

Reliability database development for use with an object-oriented fault tree evaluation program

Science.gov (United States)

Heger, A. Sharif; Harringtton, Robert J.; Koen, Billy V.; Patterson-Hine, F. Ann

1989-01-01

A description is given of the development of a fault-tree analysis method using object-oriented programming. In addition, the authors discuss the programs that have been developed or are under development to connect a fault-tree analysis routine to a reliability database. To assess the performance of the routines, a relational database simulating one of the nuclear power industry databases has been constructed. For a realistic assessment of the results of this project, the use of one of existing nuclear power reliability databases is planned.

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

DEVELOPING VENDOR IMPROVEMENT PROGRAM IN MALAYSIA AUTOMOTIVE COMPANY

Directory of Open Access Journals (Sweden)

SHUKRIAH ABDULLAH

2016-04-01

Full Text Available Improvement Program seek to do evaluation well, request to become sufficiently versed in evaluation or to integrate on improvement perspective in all phase of performance, from needs assessment to implementation and evaluation itself. The purpose of this program in the automotive company is to assist vendor as global manufacturer in preparation towards ASEAN Free Trade Agreement (AFTA 2015. This development vendor improvement program emphasize on the downtime reduction to below 200 minutes per month with the ultimate end of improving not only program or solutions but also the organizations and customer. A practical approach either planned or unplanned by the automotive company require policies and procedures that address the same consideration on the downtime identification. 20 top bottom rank vendor were determined based on the downtime performance, followed by classification into different group based on severity. To execute the vendor improvement program three among 20 top bottom rank vendors were selected due to willingness to participate and ease of data access in the program. Selected vendors have high ranking in terms of downtime. The case study method involved an interview and plant observation. The used of secondary data from the automotive company, and previous researcher are also utilised. This improvement program assists the automobile manufacturer to improve its supplier’s performance. The vendor improvement program is implemented through a whole supplier operation assessment.

Measuring the Impacts of a Volunteer-Based Community Development Program in Developing Volunteers' Leadership Skills

Science.gov (United States)

Meier, Amy; Singletary, Loretta; Hill, George

2012-01-01

This article summarizes the results of an evaluation of the impacts of a community development program to develop leadership skills in its adult volunteers. The evaluation featured 20 questions about leadership skills learned as a result of volunteer experiences. Data analysis strategies beyond a simple means ranking resulted in evidence…

Computer programs for TRIGA calibration, burnup evaluation, and bookkeeping

International Nuclear Information System (INIS)

Nelson, George W.

1978-01-01

Several computer programs have been developed at the University of Arizona to assist the direction and operation of the TRIGA Reactor Laboratory. The programs fall into the following three categories: 1. Programs for calculation of burnup of each fuel element in the reactor core, for maintaining an inventory of fuel element location and fissile content at any time, and for evaluation of the reactivity effects of burnup or proposed fuel element rearrangement in the core. 2. Programs for evaluation, function fitting, and tabulation of control rod measurements. 3. Bookkeeping programs to summarize and tabulate reactor runs and irradiations according to time, energy release, purpose, responsible party, etc. These summarized data are reported in an annual operating report for the facility. The use of these programs has saved innumerable hours of repetitious work, assuring more accurate, objective results, and requiring a minimum of effort to repeat calculations when input data are modified. The programs are written in FORTRAN-IV, and have been used on a CDC-6400 computer. (author)

Development of total systems of piping stress analysis and evaluation: ISAPPS

International Nuclear Information System (INIS)

Oki, Teizaburo; Koyanagi, Ryoichi; Fukuda, Masanao

1978-01-01

IHI has developed the systems of piping stress analysis and evaluation: ISAPPS (IHI Stress Analysis Program for Piping Systems), which are further described in this paper. In addition, the results of structural analysis and heat transfer analysis were confirmed. An example of stress evaluation in accordance with the modified ASME Code Sec. III is shown. ISAPPS consists of the following seven parts, and is designed for easy adoption of other programs by making modifications. 1. Piping design oriented language programs 2. Structural analysis programs 3. Isometric plotting programs 4. Multi-file dumping program 5. Load combination program 6. Heat transfer program 7. Stress evaluation programs As one of the examples of structural analysis programs, IHI make use of the modified SAP IV developed by the University of California. Evaluations of stresses are performed in accordance with: 1. ASME Boiler and Pressure Vessel Code, Sec. III Class 1, 2 and 3 2. ANSI Code, B31.1 and B31.3 3. MITI (Ministry of International Trade and Industry ) Code ISAPPS is very useful for design of nuclear and chemical pipings and so on. (author)

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

The DOE safeguards and security technology development program

International Nuclear Information System (INIS)

Cherry, R.C.; Wheelock, A.J.

1991-01-01

This paper reports that strategic planning for safeguards and security within the Department of Energy emphasizes the contributions of advanced technologies to the achievement of Departmental protection program goals. The Safeguards and Security Technology Development Program provides state-of-the-art technologies, systems and technical services in support of the policies and programmatic requirements for the protection of Departmental assets. The Program encompasses research and development in physical security, nuclear material control and accountability, information security and personnel security, and the integration of these disciplines in advanced applications. Technology development tasks serve goals that range from the maintenance of an effective technology base to the development, testing and evaluation of applications to meet field needs. A variety of factors, from the evolving threat to reconfiguration of the DOE complex and the technical requirements of new facilities, are expected to influence safeguards and security technology requirements and development efforts. Implementation of the Program is based on the systematic identification, prioritization and alignment of technology development tasks and needs. Initiatives currently underway are aimed at enhancing technology development project management. Increased management attention is also being placed on efforts to promote the benefits of the Program through technology transfer and interagency liaison

Dissemination of Technology to Evaluate Healthy Food Incentive Programs.

Science.gov (United States)

Freedman, Darcy A; Hunt, Alan R; Merritt, Katie; Shon, En-Jung; Pike, Stephanie N

2017-03-01

Federal policy supports increased implementation of monetary incentive interventions for chronic disease prevention among low-income populations. This study describes how a Prevention Research Center, working with a dissemination partner, developed and distributed technology to support nationwide implementation and evaluation of healthy food incentive programming focused on Supplemental Nutrition Assistance Program recipients. FM Tracks, an iOS-based application and website, was developed to standardize evaluation methods for healthy food incentive program implementation at direct-to-consumer markets. This evaluation examined diffusion and adoption of the technology over 9 months (July 2015-March 2016). Data were analyzed in 2016. FM Tracks was disseminated to 273 markets affiliated with 37 regional networks in 18 states and Washington, DC. All markets adopted the sales transaction data collection feature, with nearly all recording at least one Supplemental Nutrition Assistance Program (99.3%) and healthy food incentive (97.1%) transaction. A total of 43,493 sales transactions were recorded. By the ninth month of technology dissemination, markets were entering individual sales transactions using the application (34.5%) and website (29.9%) and aggregated transactions via website (35.6%) at similar rates. Use of optional evaluation features like recording a customer ID with individual transactions increased successively with a low of 22.2% during the first month to a high of 69.2% in the ninth month. Systematic and widely used evaluation technology creates possibilities for pragmatic research embedded within ongoing, real-world implementation of food access interventions. Technology dissemination requires supportive technical assistance and continuous refinement that can be advanced through academic-practitioner partnerships. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Logic models as a tool for sexual violence prevention program development.

Science.gov (United States)

Hawkins, Stephanie R; Clinton-Sherrod, A Monique; Irvin, Neil; Hart, Laurie; Russell, Sarah Jane

2009-01-01

Sexual violence is a growing public health problem, and there is an urgent need to develop sexual violence prevention programs. Logic models have emerged as a vital tool in program development. The Centers for Disease Control and Prevention funded an empowerment evaluation designed to work with programs focused on the prevention of first-time male perpetration of sexual violence, and it included as one of its goals, the development of program logic models. Two case studies are presented that describe how significant positive changes can be made to programs as a result of their developing logic models that accurately describe desired outcomes. The first case study describes how the logic model development process made an organization aware of the importance of a program's environmental context for program success; the second case study demonstrates how developing a program logic model can elucidate gaps in organizational programming and suggest ways to close those gaps.

Evaluation of four building energy analysis computer programs against ASHRAE standard 140-2007

CSIR Research Space (South Africa)

Szewczuk, S

2014-08-01

Full Text Available ) standard or code of practice. Agrément requested the CSIR to evaluate a range of building energy simulation computer programs. The standard against which these computer programs were to be evaluated was developed by the American Society of Heating...

Experimental program for development and evaluation of nondestructive assay techniques for plutonium holdup

International Nuclear Information System (INIS)

Brumbach, S.B.

1977-05-01

An outline is presented for an experimental program to develop and evaluate nondestructive assay techniques applicable to holdup measurement in plutonium-containing fuel fabrication facilities. The current state-of-the-art in holdup measurements is reviewed. Various aspects of the fuel fabrication process and the fabrication facility are considered for their potential impact on holdup measurements. The measurement techniques considered are those using gamma-ray counting, neutron counting, and temperature measurement. The advantages and disadvantages of each technique are discussed. Potential difficulties in applying the techniques to holdup measurement are identified. Experiments are proposed to determine the effects of such problems as variation in sample thickness, in sample distribution, and in background radiation. These experiments are also directed toward identification of techniques most appropriate to various applications. Also proposed are experiments to quantify the uncertainties expected for each measurement

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

Evaluating the effectiveness of a laboratory-based professional development program for science educators

Science.gov (United States)

Amolins, Michael Wayne

The development of effective science educators has been a long-standing goal of the American education system. Numerous studies have suggested a breadth of professional development programs that have sought to utilize constructivist principles in order to orchestrate movement toward student-led, inquiry-based instruction. Very few, however, have addressed a missing link between the modern scientific laboratory and the traditional science classroom. While several laboratory-based training programs have begun to emerge in recent years, the skills necessary to translate this information into the classroom are rarely addressed. The result is that participants are often left without an outlet or the confidence to integrate these into their lessons. The purpose of this study was to examine the effectiveness of a laboratory-based professional development program focused on classroom integration and reformed science teaching principles. This was measured by the ability to invigorate its seven participants in order to achieve higher levels of success and fulfillment in the classroom. These participants all taught at public high schools in South Dakota, including both rural and urban locations, and taught a variety of courses. Participants were selected for this study through their participation in the Sanford Research/USD Science Educator Research Fellowship Program. Through the use of previously collected data acquired by Sanford Research, this study attempted to detail the convergence of three assessments in order to demonstrate the growth and development of its participants. First, pre- and post-program surveys were completed in order to display the personal and professional growth of its participants. Second, pre- and post-program classroom observations employing the Reformed Teaching Observation Protocol allowed for the assessment of pedagogical modifications being integrated by each participant, as well as the success of such modifications in constructively

Evaluation of a case-based urology learning program.

Science.gov (United States)

Mishra, Kirtishri; Snow-Lisy, Devon C; Ross, Jonathan; Goldfarb, David A; Goldman, Howard; Campbell, Steven C

2013-12-01

To address the challenges that today's trainees encounter, such as information overload and reduced immersion in the field, and recognizing their preference for novel educational resources, an electronic case-based urology learning program was developed. Each case was designed to illustrate the basic principles of the disease process and the fundamentals of evaluation and management using the Socratic method, recapitulating a prototypical patient encounter. A 21-question survey was developed after review of published reports of classroom and clinical learning environment surveys. The target group was 2 pilot urology training programs (the Cleveland Clinic and University Hospitals-Case Medical Center). The responses were entirely anonymous. A total of 32 trainees participated (8 fellows and 24 residents), representing a 53% response rate. Most trainees (79%) were able to process cases within an average of ≤ 10 minutes. Of the trainees, 91% reported referring back to particular cases for patient care, to review for examinations, or for studying. Most trainees believed a case-based urology learning program would be a potentially important resource for clinical practice (69%) and for preparing for the in-service (63%) or board (69%) examinations. Most trainees believed the program met its goals of illustrating the basics principles of the disease process (88%), outlining the fundamentals of evaluation and management (94%), and improving the trainees' knowledge base (91%). An electronic case-based urology learning program is feasible and useful and stimulates learning at all trainee levels. Copyright © 2013 Elsevier Inc. All rights reserved.

Development of integrity evaluation technology for pressurized components in nuclear power plant and IT based integrity evaluation system

International Nuclear Information System (INIS)

Kim, Young Jin; Choi, Jae Boong; Shim, Do Jun

2004-02-01

The objective of this research is to develop on efficient integrity evaluation technology and to investigate the applicability of the newly-developed technology such as internet-based cyber platform etc. to Nuclear Power Plant(NPP) components. The development of an efficient structural integrity evaluation system is necessary for safe operation of NPP as the increase of operating periods. Moreover, material test data as well as emerging structural integrity assessment technology are also needed for the evaluation of aged components. The following five topics are covered in this project: development of the wall-thinning evaluation program for nuclear piping; development of structural integrity evaluation criteria for steam generator tubes with cracks of various shape; development of fatigue life evaluation system for major components of NPP; ingegration of internet-based cyber platform and integrity evaluation program for primary components of NPP; effects of aging on strength of dissimilar welds

Development of integrity evaluation technology for pressurized components in nuclear power plant and IT based integrity evaluation system

Energy Technology Data Exchange (ETDEWEB)

Kim, Young Jin; Choi, Jae Boong; Shim, Do Jun [Sungkyunkwan Univ., Seoul (Korea, Republic of)] (and others)

2004-02-15

The objective of this research is to develop on efficient integrity evaluation technology and to investigate the applicability of the newly-developed technology such as internet-based cyber platform etc. to Nuclear Power Plant(NPP) components. The development of an efficient structural integrity evaluation system is necessary for safe operation of NPP as the increase of operating periods. Moreover, material test data as well as emerging structural integrity assessment technology are also needed for the evaluation of aged components. The following five topics are covered in this project: development of the wall-thinning evaluation program for nuclear piping; development of structural integrity evaluation criteria for steam generator tubes with cracks of various shape; development of fatigue life evaluation system for major components of NPP; ingegration of internet-based cyber platform and integrity evaluation program for primary components of NPP; effects of aging on strength of dissimilar welds.

Customizing Process to Align with Purpose and Program: The 2003 MS PHD'S in Ocean Sciences Program Evaluative Case Study

Science.gov (United States)

Williamson, V. A.; Pyrtle, A. J.

2004-12-01

How did the 2003 Minorities Striving and Pursuing Higher Degrees of Success (MS PHD'S) in Ocean Sciences Program customize evaluative methodology and instruments to align with program goals and processes? How is data captured to document cognitive and affective impact? How are words and numbers utilized to accurately illustrate programmatic outcomes? How is compliance with implicit and explicit funding regulations demonstrated? The 2003 MS PHD'S in Ocean Sciences Program case study provides insightful responses to each of these questions. MS PHD'S was developed by and for underrepresented minorities to facilitate increased and sustained participation in Earth system science. Key components of this initiative include development of a community of scholars sustained by face-to-face and virtual mentoring partnerships; establishment of networking activities between and among undergraduate, graduate, postgraduate students, scientists, faculty, professional organization representatives, and federal program officers; and provision of forums to address real world issues as identified by each constituent group. The evaluative case study of the 2003 MS PHD'S in Ocean Sciences Program consists of an analysis of four data sets. Each data set was aligned to document progress in the achievement of the following program goals: Goal 1: The MS PHD'S Ocean Sciences Program will successfully market, recruit, select, and engage underrepresented student and non-student participants with interest/ involvement in Ocean Sciences; Goal 2: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by quantitative analysis of user-feedback; Goal 3: The MS PHD'S Ocean Sciences Program will provide meaningful engagement for participants as determined by qualitative analysis of user-feedback, and; Goal 4: The MS PHD'S Ocean Sciences Program will develop a constituent base adequate to demonstrate evidence of interest, value, need and sustainability in

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

Science.gov (United States)

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Designing faculty development to support the evaluation of resident competency in the intrinsic CanMEDS roles: practical outcomes of an assessment of program director needs.

Science.gov (United States)

Puddester, Derek; MacDonald, Colla J; Clements, Debbie; Gaffney, Jane; Wiesenfeld, Lorne

2015-06-05

The Royal College of Physicians and Surgeons of Canada and the College of Family Physicians of Canada mandate that faculty members demonstrate they are evaluating residents on all CanMEDS (Canadian Medical Education Directions for Specialists) roles as part of the accreditation process. Postgraduate Medical Education at the University of Ottawa initiated a 5-year project to develop and implement a comprehensive system to assess the full spectrum of CanMEDS roles. This paper presents the findings from a needs assessment with Program Directors, in order to determine how postgraduate medical faculty can be motivated and supported to evaluate residents on the intrinsic CanMEDS roles. Semi-structured individual interviews were conducted with 60 Postgraduate Program Directors in the Faculty of Medicine. Transcribed interviews were analyzed using qualitative analysis. Once the researchers were satisfied the identified themes reflected the views of the participants, the data was assigned to categories to provide rich, detailed, and comprehensive information that would indicate what faculty need in order to effectively evaluate their residents on the intrinsic roles. Findings indicated faculty members need faculty development and shared point of care resources to support them with how to not only evaluate, but also teach, the intrinsic roles. Program Directors expressed the need to collaborate and share resources across departments and national specialty programs. Based on our findings, we designed and delivered workshops with companion eBooks to teach and evaluate residents at the point of care (Developing the Professional, Health Advocate and Scholar). Identifying stakeholder needs is essential for designing effective faculty development. By sharing resources, faculties can prevent 'reinventing the wheel' and collaborate to meet the Colleges' accreditation requirements more efficiently.

Towards Bridging the Gap Programming Language and Partial Evaluation

DEFF Research Database (Denmark)

Le Meur, Anne-Francoise; Lawall, Julia Laetitia; Consel, Charles

2002-01-01

Partial evaluation is a program-transformation technique that automatically specializes a program with respect to user-supplied invariants. Despite successful applications in areas such as graphics, operating systems, and software engineering, partial evaluators have yet to achieve widespread use....... One reason is the difficulty of adequately describing specialization opportunities. Indeed, under-specialization or over-specialization often occurs, without any direct feedback to the user as to the source of the problem.We have developed a high-level, module-based language allowing the programmer...... to guide the choice of both the code to specialize and the invariants to exploit during the specialization process. To ease the use of partial evaluation, the syntax of this language is similar to the declaration syntax of the target language of the partial evaluator. To provide feedback to the programmer...

NRC systematic evaluation program: seismic review

International Nuclear Information System (INIS)

Levin, H.A.

1980-01-01

The NRC Systematic Evaluation Program is currently making an assessment of the seismic design safety of 11 older nuclear power plant facilities. The general review philosophy and review criteria relative to seismic input, structural response, and equipment functionability are presented, including the rationale for the development of these guidelines considering the significant evolution of seismic design criteria since these plants were originally licensed. Technical approaches thought more realistic in light of current knowledge are utilized. Initial findings for plants designed to early seismic design procedures suggest that with minor exceptions, these plants possess adequate seismic design margins when evaluated against the intent of current criteria. However, seismic qualification of electrical equipment has been identified as a subject which requires more in-depth evaluation

[The intervention mapping protocol: A structured process to develop, implement and evaluate health promotion programs].

Science.gov (United States)

Fassier, J-B; Lamort-Bouché, M; Sarnin, P; Durif-Bruckert, C; Péron, J; Letrilliart, L; Durand, M-J

2016-02-01

Health promotion programs are expected to improve population health and reduce social inequalities in health. However, their theoretical foundations are frequently ill-defined, and their implementation faces many obstacles. The aim of this article is to describe the intervention mapping protocol in health promotion programs planning, used recently in several countries. The challenges of planning health promotion programs are presented, and the six steps of the intervention mapping protocol are described with an example. Based on a literature review, the use of this protocol, its requirements and potential limitations are discussed. The intervention mapping protocol has four essential characteristics: an ecological perspective (person-environment), a participative approach, the use of theoretical models in human and social sciences and the use of scientific evidence. It comprises six steps: conduct a health needs assessment, define change objectives, select theory-based change techniques and practical applications, organize techniques and applications into an intervention program (logic model), plan for program adoption, implementation, and sustainability, and generate an evaluation plan. This protocol was used in different countries and domains such as obesity, tobacco, physical activity, cancer and occupational health. Although its utilization requires resources and a critical stance, this protocol was used to develop interventions which efficacy was demonstrated. The intervention mapping protocol is an integrated process that fits the scientific and practical challenges of health promotion. It could be tested in France as it was used in other countries, in particular to reduce social inequalities in health. Copyright © 2016. Published by Elsevier Masson SAS.

Development and Evaluation of a Training Program for Organ Procurement Coordinators Using Standardized Patient Methodology.

Science.gov (United States)

Odabasi, Orhan; Elcin, Melih; Uzun Basusta, Bilge; Gulkaya Anik, Esin; Aki, Tuncay F; Bozoklar, Ata

2015-12-01

The low rate of consent by next of kin of donor-eligible patients is a major limiting factor in organ transplant. Educating health care professionals about their role may lead to measurable improvements in the process. Our aim was to describe the developmental steps of a communication skills training program for health care professionals using standardized patients and to evaluate the results. We developed a rubric and 5 cases for standardized family interviews. The 20 participants interviewed standardized families at the beginning and at the end of the training course, with interviews followed by debriefing sessions. Participants also provided feedback before and after the course. The performance of each participant was assessed by his or her peers using the rubric. We calculated the generalizability coefficient to measure the reliability of the rubric and used the Wilcoxon signed rank test to compare achievement among participants. Statistical analyses were performed with SPSS software (SPSS: An IBM Company, version 17.0, IBM Corporation, Armonk, NY, USA). All participants received higher scores in their second interview, including novice participants who expressed great discomfort during their first interview. The participants rated the scenarios and the standardized patients as very representative of real-life situations, with feedback forms showing that the interviews, the video recording sessions, and the debriefing sessions contributed to their learning. Our program was designed to meet the current expectations and implications in the field of donor consent from next of kin. Results showed that our training program developed using standardized patient methodology was effective in obtaining the communication skills needed for family interviews during the consent process. The rubric developed during the study was a valid and reliable assessment tool that could be used in further educational activities. The participants showed significant improvements in

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Socioeconomic impact assessment in ex ante evaluations: a case study on the rural development programs of the European Union.

Science.gov (United States)

Vidueira, Pablo; Díaz-Puente, José M; Rivera, María

2014-08-01

Ex ante impact assessment has become a fundamental tool for effective program management, and thus, a compulsory task when establishing a new program in the European Union (EU). This article aims to analyze benefits from ex ante impact assessment, methodologies followed, and difficulties encountered. This is done through the case study on the rural development programs (RDPs) in the EU. Results regarding methodologies are then contrasted with the international context in order to provide solid insights to evaluators and program managing authorities facing ex ante impact assessment. All European RDPs from the period 2007 through 2013 (a total of 88) and their corresponding available ex ante evaluations (a total of 70) were analyzed focusing on the socioeconomic impact assessment. Only 46.6% of the regions provide quantified impact estimations on socioeconomic impacts in spite of it being a compulsory task demanded by the European Commission (EC). Recommended methods by the EC are mostly used, but there is a lack of mixed method approaches since qualitative methods are used in substitution of quantitative ones. Two main difficulties argued were the complexity of program impacts and the lack of needed program information. Qualitative approaches on their own have been found as not suitable for ex ante impact assessment, while quantitative approaches-such as microsimulation models-provide a good approximation to actual impacts. However, time and budgetary constraints make that quantitative and mixed methods should be mainly applied on the most relevant impacts for the program success. © The Author(s) 2014.

Evaluating public involvement in the National Low-Level Radioactive Waste Management Program

International Nuclear Information System (INIS)

1982-09-01

The Department of Energy contracted with the Keystone Center to evaluate the effectiveness of the National Low-Level Radioactive Waste Management Program's public-involvement efforts. The Center chose six evaluators with diverse training and experience related to low-level waste management and public-participation programs. Keystone's evaluation was based on (a) observations by the evaluators who attended the National Program-sponsored strategy review meetings and fairs; (b) interviews with low-level waste generators, local government officials, state legislators, public-interest groups, and members of the general public; and (c) observations of the final National Program strategy task force meeting. The evaluators concluded that, overall, the public-participation processes yielded some very positive results - for policy development and for DOE and the EG and G staff. They judged the strategy document to be complete, concise, and helpful to public dialogue on low-level waste issues. They also made specific recommendations for improvements to the public-participation program

Developing and implementing an assessment method to evaluate a virtual canine anatomy program.

Science.gov (United States)

Linton, Andrea; Schoenfeld-Tacher, Regina; Whalen, L Ray

2005-01-01

A computer-based anatomy program, Virtual Canine Anatomy: The Head, was incorporated into a first-year veterinary dissection laboratory two years ago to address challenges inherent in the traditional pedagogical approach. The program uses specimen photographs, QuickTime Virtual Reality, and interactive features to help students study the dissection, osteology, and radiology of the canine head. Photographs of each phase of dissection are displayed in the program, along with dissection instructions. Students can click on anatomical structures in each photograph to highlight the selected structure and display a complete description of it. Related structures and views are accessible through hyperlinks. This study was designed to measure student and faculty attitudes toward the instructional software, to gauge its effect on student achievement, and to propose evaluation methodology and instrumentation for similar projects. Observations, interviews, focus groups, surveys, and test results were used for this assessment. Results suggest positive student and faculty attitudes toward the program. Students felt the program met their needs, increased their confidence and efficiency, and was easy to use. Both students and instructors felt the program was beneficial during dissection. There was no significant change in student achievement on course tests. Future research will measure the program's effect on student-instructor interactions.

Development and pilot evaluation of Native CREST-a Cancer Research Experience and Student Training program for Navajo undergraduate students.

Science.gov (United States)

Hughes, Christine A; Bauer, Mark C; Horazdovsky, Bruce F; Garrison, Edward R; Patten, Christi A; Petersen, Wesley O; Bowman, Clarissa N; Vierkant, Robert A

2013-03-01

The Mayo Clinic Cancer Center and Diné College received funding for a 4-year collaborative P20 planning grant from the National Cancer Institute in 2006. The goal of the partnership was to increase Navajo undergraduates' interest in and commitment to biomedical coursework and careers, especially in cancer research. This paper describes the development, pilot testing, and evaluation of Native CREST (Cancer Research Experience and Student Training), a 10-week cancer research training program providing mentorship in a Mayo Clinic basic science or behavioral cancer research lab for Navajo undergraduate students. Seven Native American undergraduate students (five females, two males) were enrolled during the summers of 2008-2011. Students reported the program influenced their career goals and was valuable to their education and development. These efforts may increase the number of Native American career scientists developing and implementing cancer research, which will ultimately benefit the health of Native American people.

Human Research Program Science Management: Overview of Research and Development Activities

Science.gov (United States)

Charles, John B.

2007-01-01

An overview of research and development activities of NASA's Human Research Science Management Program is presented. The topics include: 1) Human Research Program Goals; 2) Elements and Projects within HRP; 3) Development and Maintenance of Priorities; 4) Acquisition and Evaluation of Research and Technology Proposals; and 5) Annual Reviews

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

GCRA review and appraisal of fuel material development programs

International Nuclear Information System (INIS)

1980-09-01

The Fuel material Development Program has as its principal objective and responsibility the development of a fuel that is both economical and licensable and that, at the same time, will fulfill the required performance criteria. To accomplish this, the program is broken down into the following major fuel development task areas: development of the experimental and analytical data base for selecting, qualifying, and verifying the reference fuel design; providing the data base and developing models for evaluating fuel performance under upset and accident conditions; and developing and justifying fuel fabrication specifications which are consistent with the overall fuel performance criteria and with the fuel fabrication process capabilities

Development and evaluation of a training program for therapeutic radiographers as a basis for online adaptive radiation therapy for bladder carcinoma

International Nuclear Information System (INIS)

Foroudi, Farshad; Wong, Jacky; Kron, Tomas; Roxby, Paul; Haworth, Annette; Bailey, Alistair; Rolfo, Aldo; Paneghel, Andrea; Styles, Colin; Laferlita, Marcus; Tai, Keen Hun; Williams, Scott; Duchesne, Gillian

2010-01-01

Aims: Online adaptive radiotherapy requires a new level of soft tissue anatomy recognition and decision making by therapeutic radiographers at the linear accelerator. We have developed a therapeutic radiographer training workshop encompassing soft tissue matching for an online adaptive protocol for muscle invasive bladder cancer. Our aim is to present the training program, and its evaluation which compares pre and post training staff soft tissue matching and bladder contouring using Cone Beam Computer Tomography (CBCT). Materials and Methods: Prior to commencement of an online adaptive bladder protocol, a staff training program for 33 therapeutic radiographers, with a separate ethics approved evaluation component was developed. A multidisciplinary training program over two days was carried out with a total of 11 h of training, covering imaging technology, pelvic anatomy and protocol specific decision making in both practical and theoretical sessions. The evaluation included both pre training and post training testing of staff. Results: Pre training and post training, the standard deviations in the contoured bladder between participants in left-right direction were 0.64 vs 0.59 cm, superior-inferior 0.89 vs 0.77 cm and anterior-posterior direction was 0.88 vs 0.52 cm respectively. Similarly the standard deviation in the volume contoured decreased from 40.7 cc pre training to 24.5 cc post training. Time taken in contouring was reduced by the training program (19.8 vs 17.2 min) as was the discrepancy in choice of adaptive radiotherapy plans. The greatest reduction in variations in contouring was seen in staff whose pre training had the largest deviations from the reference radiation oncologist contours. Conclusion: A formalized staff training program is feasible, well received by staff and reduces variation in organ matching and contouring. The improvement was particularly noticed in staff who pre training had larger deviations from the reference standard.

Capacity Development in an Undergraduate Nursing Program in Vietnam

Directory of Open Access Journals (Sweden)

Sunjoo Kang

2018-05-01

Full Text Available Background: Nurses are an essential human resource to ensure a healthy population and support the socio-economic development. However, little research has focused on the capacity development of nurses.Objective: The performance of a capacity development project for an undergraduate nursing program in Vietnam was reviewed to share lessons.Design: A descriptive case report.Setting: A baccalaureate nursing program in Vietnam from June 2014 to June 2016.Methods: A case report was analyzed in terms of the project's process, and the outcomes of 2 years' activities were evaluated.Results: Practice-based curriculum redesign and two basic nursing subjects were developed after five rounds of curriculum workshops. To improve application efficiency, two nursing experts were dispatched to provide instructions regarding the application of the new subjects. Three candidates were invited to complete their master's and doctoral studies in Korea. An advanced nursing education environment was supported with simulation labs equipped within a ubiquitous network. The result of experts' evaluation was excellent by every criterion of the Organization for Economic Co-operation and Development—Development Assistance Committee.Conclusions: The capacity development of a nursing program was possible through ownership, accountability, and results-based management. Gradual improvement in nursing academic and clinical capacity building based on research evidence can empower partner countries' nursing leadership. Introduction.

Multimedia messages in genetics: design, development, and evaluation of a computer-based instructional resource for secondary school students in a Tay Sachs disease carrier screening program.

Science.gov (United States)

Gason, Alexandra A; Aitken, MaryAnne; Delatycki, Martin B; Sheffield, Edith; Metcalfe, Sylvia A

2004-01-01

Tay Sachs disease is a recessively inherited neurodegenerative disorder, for which carrier screening programs exist worldwide. Education for those offered a screening test is essential in facilitating informed decision-making. In Melbourne, Australia, we have designed, developed, and evaluated a computer-based instructional resource for use in the Tay Sachs disease carrier screening program for secondary school students attending Jewish schools. The resource entitled "Genetics in the Community: Tay Sachs disease" was designed on a platform of educational learning theory. The development of the resource included formative evaluation using qualitative data analysis supported by descriptive quantitative data. The final resource was evaluated within the screening program and compared with the standard oral presentation using a questionnaire. Knowledge outcomes were measured both before and after either of the educational formats. Data from the formative evaluation were used to refine the content and functionality of the final resource. The questionnaire evaluation of 302 students over two years showed the multimedia resource to be equally effective as an oral educational presentation in facilitating participants' knowledge construction. The resource offers a large number of potential benefits, which are not limited to the Tay Sachs disease carrier screening program setting, such as delivery of a consistent educational message, short delivery time, and minimum financial and resource commitment. This article outlines the value of considering educational theory and describes the process of multimedia development providing a framework that may be of value when designing genetics multimedia resources in general.

Office of Technology Development's Research, Development, Demonstration, Testing and Evaluation Mid-Year Program Review. Volume 1

International Nuclear Information System (INIS)

1994-01-01

This document presents brief summaries of waste management, remedial action, decommissioning/decontamination, and waste processing programs and issues currently being developed at Department of Energy Facilities

Evaluating Realized Impacts of DOE/EERE R&D Programs. Standard impact evaluation method

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc. (United States); O' Connor, Alan C. [RTI International, Research Triangle Park, NC (United States); Loomis, Ross J. [RTI International, Research Triangle Park, NC (United States)

2014-08-01

This document provides guidance for evaluators who conduct impact assessments of research and development (R&D) programs for the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE). It is also targeted at EERE program staff responsible for initiating and managing commissioned impact studies. The guide specifies how to estimate economic benefits and costs, energy saved and installed or generated, environmental impacts, energy security impacts, and knowledge impacts of R&D investments in advanced energy technologies.

Development and Implementation of a Peer Mentoring Program for Early Career Gerontological Faculty

Science.gov (United States)

Bryant, Ashley Leak; Brody, Ab; Perez, Adriana; Shillam, Casey; Edelman, Linda S.; Bond, Stewart M.; Foster, Victoria; Siegel, Elena

2016-01-01

Purpose In conjunction with the National Hartford Centers of Gerontological Nursing Excellence (NHCGNE), formerly known as the Building Academic Geriatric Nursing Capacity Initiative (BAGNC), the Hartford Gerontological Nursing Leaders (HGNL) developed and executed a program beginning in 2011 to enhance both (a) the experience of newly selected scholars and fellows to the NHCGNE and (b) the ongoing professional development of the HGNL. The purpose of this article is to describe key strategies used to develop and execute the mentoring program and to present the formative and summative program evaluation. Design The program was launched in January 2011 with seven peer mentor and mentee matches. In June 2012, the peer mentoring committee solicited feedback on the development of the peer mentoring program and changes were made for the subsequent cohorts. Findings An additional 12 matches were made in the following 2 years (2012 and 2013), for a total of 31 matches to date. We have learned several key lessons from our three cohorts regarding how to structure, implement, and carefully evaluate a peer mentoring program. Conclusions Informal evaluation of our peer mentoring program noted several challenges for both peer mentors and mentees. Having knowledge of and addressing those challenges may increase the overall quality and effectiveness of peer mentoring programs and, in turn, benefit academic nursing by strengthening the faculty workforce. Clinical Relevance Findings from development and implementation of a peer mentoring program for gerontological faculty could lead to new and adaptable programs in a variety of clinical and education settings. PMID:25808927

Development and implementation of a peer mentoring program for early career gerontological faculty.

Science.gov (United States)

Bryant, Ashley Leak; Aizer Brody, Abraham; Perez, Adriana; Shillam, Casey; Edelman, Linda S; Bond, Stewart M; Foster, Victoria; Siegel, Elena O

2015-05-01

The Hartford Gerontological Nursing Leaders (HGNL) formerly known as the Building Academic Geriatric Nursing Capacity Initiative (BAGNC), in conjunction with the National Hartford Centers of Gerontological Nursing Excellence (NHCGNE), developed and executed a peer mentoring program beginning in 2011 to enhance both (a) the experience of newly selected scholars and fellows to the NHCGNE and (b) the ongoing professional development of HGNL members. The purpose of this article is to describe key strategies used to develop and execute the peer mentoring program and to present formative program evaluation. The program was launched in January 2011 with seven peer mentor and mentee matches. In June 2012, the peer mentoring committee solicited feedback on the development of the peer mentoring program and changes were made for the subsequent cohorts. An additional 12 matches were made in the following 2 years (2012 and 2013), for a total of 31 matches to date. We have learned several key lessons from our three cohorts regarding how to structure, implement, and carefully evaluate a peer mentoring program. Informal evaluation of our peer mentoring program noted several challenges for both peer mentors and mentees. Having knowledge of and addressing those challenges may increase the overall quality and effectiveness of peer mentoring programs and, in turn, benefit academic nursing by strengthening the faculty workforce. Findings from development and implementation of a peer mentoring program for gerontological faculty could lead to new and adaptable programs in a variety of clinical and education settings. © 2015 Sigma Theta Tau International.

Development and evaluation of an educational intervention program for pre-professional adolescent ballet dancers: nutrition for optimal performance.

Science.gov (United States)

Doyle-Lucas, Ashley F; Davy, Brenda M

2011-06-01

The purpose of this investigation was to develop, implement, and evaluate a theoretically based nutritional education intervention through a DVD lecture series (three 30-minute classes) in summer intensive programs for pre-professional, adolescent ballet dancers. Objectives of this intervention program were to increase knowledge of basic sports nutrition principles and the Female Athlete Triad and promote self-efficacy for adopting healthier dietary habits. Dancers ranging from 13 to 18 years old who were attending summer intensive programs affiliated with professional ballet companies were recruited. Group One (n = 231) participated in the nutrition education program, while Group Two the control participants (n = 90) did not. Assessments of the participants' dietary status consisted of a demographic questionnaire, a Sports Nutrition Knowledge and Behavior Questionnaire, and a Food Frequency Questionnaire. The intervention group was assessed at baseline, immediately post-program, and at six weeks post-program. The control group was assessed at baseline and at six weeks post-baseline. The intervention program was effective at increasing nutrition knowledge, perceived susceptibility to the Female Athlete Triad, and self-efficacy constructs. Improvements in dietary intake were also observed among intervention group participants. To improve overall health and performance nutrition education should be incorporated into the training regimens of adolescent dancers. This potentially replicable DVD-based program may be an effective, low-cost mechanism for doing that.

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

Science.gov (United States)

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across

Developing medical educators – a mixed method evaluation of a teaching education program

Directory of Open Access Journals (Sweden)

Marco Roos

2014-03-01

Full Text Available Background: It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods: An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1 ‘Reaction’ on a professional and emotional level using standardized questionnaires; 2 ‘Learning’ applying a multiple choice test; 3 ‘Behavior’ by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4 ‘Results’ from student evaluations. Results: Our data indicate the success of the educational intervention at all observed levels. 1 Reaction: The participants showed a high acceptance of the instructional content. 2 Learning: There was a significant increase in knowledge (P<0.001 as deduced from a pre-post multiple-choice questionnaire, which was retained at 6 months (P<0.001. 3 Behavior: Peer-, self-, and expert-assessment indicated a transfer of learning into teaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4 Results: Teaching performance ratings improved in students’ evaluations. Conclusions: Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

Providing Effective Professional Development: Lessons from the Eisenhower Program.

Science.gov (United States)

Porter, Andrew C.; Garet, Michael S.; Desimone, Laura M.; Birman, Beatrice F.

2003-01-01

Reports on two studies evaluating the effectiveness of the federal government's Eisenhower Professional Development Program. Describes high quality professional development of in-service teachers, changes in teaching practice, six key practices identified in literature, and the relationship between district policies and the quality of professional…

IPEP: The integrated performance evaluation program for the Department of Energy's Office of Environmental Management

International Nuclear Information System (INIS)

Lindahl, P.C.; Streets, W.E.; Bass, D.A.

1995-01-01

The quality of the analytical data being provided to DOE's Office of Environmental Management (EM) for environmental restoration activities and the extent to which these data meet the data quality objectives are critical in the decision-making process. One of several quality metrics that can be used in evaluating a laboratory is its performance in performance evaluation (PE) programs. In support of DOE's environmental restoration and waste management efforts, EM has been charged with developing and implementing a program to assess the performance of participating laboratories. Argonne National Laboratory (ANL) and DOE's Environmental Measurements Laboratory (EML) and Radiological and Environmental Sciences Laboratory (RESL) have been collaborating on the development and implementation of a comprehensive Integrated Performance Evaluation Program (IPEP) for DOE-wide implementation. The IPEP will use results from existing inorganic, organic, and radiological PE programs when these are available and appropriate for the analytes and matrices being determined for DOE's EM activities. Existing programs include the U.S. Environmental Protection Agency's (EPA's) Contract Laboratory Program (CLP), the Water Supply (WS) and Water Pollution (WP) PE studies for inorganic and organic analytes, and DOE's Quality Assessment Program (QAP) for radiological analytes. In addition, DOE has begun the development of the Mixed Analyte Performance Evaluation Program (MAPEP) to address the needs of the DOE Complex. These PE programs provide a spectrum of matrices and analytes covering the various inorganic, organic, and low-level radiologic categories found in routine environmental and waste samples. These PE programs already provide some assessment of laboratory performance; IPEP will expand these assessments by evaluating historical performance, as well as results from multiple PE programs, thereby providing an enhanced usage of the PE program information

A Census of Prison-Based Drug Treatment Programs: Implications for Programming, Policy, and Evaluation

Science.gov (United States)

Welsh, Wayne N.; Zajac, Gary

2004-01-01

Despite a growing realization that unmeasured programmatic differences influence prison-based drug treatment effectiveness, few attempts to systematically measure such differences have been made. To improve program planning and evaluation in this area, we developed a census instrument to collect descriptive information about 118 prison-based drug…

Educational Program Evaluation Model, From the Perspective of the New Theories

Directory of Open Access Journals (Sweden)

Soleiman Ahmady

2014-05-01

Full Text Available Introduction: This study is focused on common theories that influenced the history of program evaluation and introduce the educational program evaluation proposal format based on the updated theory. Methods: Literature searches were carried out in March-December 2010 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface, ERIC (Education Resources Information Center and the main journal of medical education regarding current evaluation models and theories. We included all study designs in our study. We found 810 articles related to our topic, and finally 63 with the full text article included. We compared documents and used expert consensus for selection the best model. Results: We found that the complexity theory using logic model suggests compatible evaluation proposal formats, especially with new medical education programs. Common components of a logic model are: situation, inputs, outputs, and outcomes that our proposal format is based on. Its contents are: title page, cover letter, situation and background, introduction and rationale, project description, evaluation design, evaluation methodology, reporting, program evaluation management, timeline, evaluation budget based on the best evidences, and supporting documents. Conclusion: We found that the logic model is used for evaluation program planning in many places, but more research is needed to see if it is suitable for our context.

Preparing for terrorism: tools for evaluating the Metropolitan Medical Response System Program

National Research Council Canada - National Science Library

Manning, Frederick J; Goldfrank, Lewis R

2002-01-01

.... DHHS asked the Institute of Medicine (IOM) to assist in assessing the effectiveness of the MMRS program by developing appropriate evaluation methods, tools, and processes to assess both its own management of the program and local preparedness...

Laboratory Directed Research and Development Program FY 2006 Annual Report

Energy Technology Data Exchange (ETDEWEB)

Sjoreen, Terrence P [ORNL

2007-04-01

The Oak Ridge National Laboratory (ORNL) Laboratory Directed Research and Development (LDRD) Program reports its status to the US Departmental of Energy (DOE) in March of each year. The program operates under the authority of DOE Order 413.2B, 'Laboratory Directed Research and Development' (April 19, 2006), which establishes DOE's requirements for the program while providing the Laboratory Director broad flexibility for program implementation. LDRD funds are obtained through a charge to all Laboratory programs. This report includes summaries all ORNL LDRD research activities supported during FY 2006. The associated FY 2006 ORNL LDRD Self-Assessment (ORNL/PPA-2007/2) provides financial data about the FY 2006 projects and an internal evaluation of the program's management process.

Applying lessons in evaluation | IDRC - International Development ...

International Development Research Centre (IDRC) Digital Library (Canada)

2011-02-01

Feb 1, 2011 ... Hosted by the World Bank's Operations Evaluation Department and Carleton University's Faculty of Public Affairs and Management, IPDET ... and 2003 believed that the program helped develop knowledge and skills that they ...

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

Conceptual Soundness, Metric Development, Benchmarking, and Targeting for PATH Subprogram Evaluation

Energy Technology Data Exchange (ETDEWEB)

Mosey. G.; Doris, E.; Coggeshall, C.; Antes, M.; Ruch, J.; Mortensen, J.

2009-01-01

The objective of this study is to evaluate the conceptual soundness of the U.S. Department of Housing and Urban Development (HUD) Partnership for Advancing Technology in Housing (PATH) program's revised goals and establish and apply a framework to identify and recommend metrics that are the most useful for measuring PATH's progress. This report provides an evaluative review of PATH's revised goals, outlines a structured method for identifying and selecting metrics, proposes metrics and benchmarks for a sampling of individual PATH programs, and discusses other metrics that potentially could be developed that may add value to the evaluation process. The framework and individual program metrics can be used for ongoing management improvement efforts and to inform broader program-level metrics for government reporting requirements.

Intervention mapping protocol for developing a theory-based diabetes self-management education program.

Science.gov (United States)

Song, Misoon; Choi, Suyoung; Kim, Se-An; Seo, Kyoungsan; Lee, Soo Jin

2015-01-01

Development of behavior theory-based health promotion programs is encouraged with the paradigm shift from contents to behavior outcomes. This article describes the development process of the diabetes self-management program for older Koreans (DSME-OK) using intervention mapping (IM) protocol. The IM protocol includes needs assessment, defining goals and objectives, identifying theory and determinants, developing a matrix to form change objectives, selecting strategies and methods, structuring the program, and planning for evaluation and pilot testing. The DSME-OK adopted seven behavior objectives developed by the American Association of Diabetes Educators as behavioral outcomes. The program applied an information-motivation-behavioral skills model, and interventions were targeted to 3 determinants to change health behaviors. Specific methods were selected to achieve each objective guided by IM protocol. As the final step, program evaluation was planned including a pilot test. The DSME-OK was structured as the 3 determinants of the IMB model were intervened to achieve behavior objectives in each session. The program has 12 weekly 90-min sessions tailored for older adults. Using the IM protocol in developing a theory-based self-management program was beneficial in terms of providing a systematic guide to developing theory-based and behavior outcome-focused health education programs.

A Professional Development Program for Dental Medical Educators in Kuwait: Needs Assessment, Program Design and Formative Evaluation

Science.gov (United States)

Alyaseen, Haneen

2017-01-01

New innovative methods of teaching and learning adopted from mainstream research and development in educational theory and practice are being adapted to serve the unique needs of the medical professions. The success of these methods requires careful planning and establishment of faculty development programs. The purpose of this study is to perform…

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Career Development Programs in Fortune 500 Firms.

Science.gov (United States)

Keller, Jack; Piotrowski, Chris

Career development programs (CDPs) are a rather recent area of study in organizational and industrial psychology. The present study investigated the nature and evaluation of CDPs in Fortune 500 firms. Data were obtained by a mailed questionnaire completed by the firms' human resources directors. Of the 500 companies surveyed, only those 50 that…

A Process and Outcome Evaluation of Police Working with Youth Programs

Directory of Open Access Journals (Sweden)

Stephen A. Anderson

2008-09-01

Full Text Available A process and outcome evaluation of 10 Police Working with Youth Programs was conducted. Process results indicated that the core components of the programs were consistent with those identified in previous literature as characteristic of quality youth development programs. Outcome results indicated that youth participants reported significantly improved attitudes toward police and social support received from significant, non-familial adults. Two subgroups of youth, most notably minority youth and younger participants in lower grade levels, reported positive changes in their capacity to resist peer pressures. Minority youth reported positive changes in their sense of mastery over stressful life situations. Relationships between core program components and youth outcomes also were examined. Implications of the findings and future process and outcome evaluations of youth programs are discussed.

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

Science.gov (United States)

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper

Scenario development and evaluation for the NPP Krsko revised decommissioning program

International Nuclear Information System (INIS)

Levanat, I.; Lokner, V.; Subasic, D.

2004-01-01

In this first revision, several integrated scenarios of the NPP Krsko dismantling and waste management were developed and analyzed in order to estimate the decommissioning program (DP) costs and to propose an appropriate funding plan. Most dismantling technologies and cost estimates were derived from the original decommissioning plan adopted in 1996. The LILW disposal cost estimates, however, rely on the tunnel type facility design which was developed in Slovenia a few years ago, whereas the SF repository design for this DP was adapted from the Swedish deep disposal concept. The starting assumptions for this DP were that the LILW repository would be licensed by 2013, the NPP would be permanently shut down in 2023, and the SF repository would become available in 2030. The boundary conditions also specified that DP should first re-evaluate the SID strategy from the original plan (Strategy Immediate Dismantling with immediate SF disposal, but also with a long period of on-site decay storage for the activated components, so that it actually terminates only after 96 years), and then modify it to achieve truly prompt decommissioning in which all planned activities should be completed within about 15 years after the NPP shut-down. In addition, the option of SF export to a third country should be introduced in all DP scenarios, as a realistic alternative to SF disposal into the local repository (in Slovenia or in Croatia). And finally, dry storage of SF for some 30 years before disposal or export, in an independent installation on unspecified location, should be evaluated within the DP sensitivity analysis. After a thorough analysis of the original SID strategy, it became clear that substantial modifications would be necessary in order to meet the boundary conditions while complying with the specified design and technologies of the assumed LILW and SF disposal facilities. Therefore, a systematic procedure for development and financial evaluation of feasible scenarios was

A methodology for evaluating social impact of Environmental Education Master Training Program

Directory of Open Access Journals (Sweden)

Loret de Mola, E.

2014-01-01

Full Text Available The paper is intended to describe a methodology for evaluating social impact of Environmental Education master training program by presenting its main stages. The framework serving as starting point and other empirical methods lead to systematized and define the terms of environmental professional training, professional performance of the environmental educator, evaluation, evaluation of professional performance of environmental educators and impact evaluation; as well as distinguishing the functions of impact evaluation in the postgraduate program favoring professor, tutors and trainees development. Previously appraised by consulting experts who gave it high ranks, this methodology is currently being used in evaluating second and third editions.

A Multi-Institutional Longitudinal Faculty Development Program in Humanism Supports the Professional Development of Faculty Teachers.

Science.gov (United States)

Branch, William T; Frankel, Richard M; Hafler, Janet P; Weil, Amy B; Gilligan, MaryAnn C; Litzelman, Debra K; Plews-Ogan, Margaret; Rider, Elizabeth A; Osterberg, Lars G; Dunne, Dana; May, Natalie B; Derse, Arthur R

2017-12-01

The authors describe the first 11 academic years (2005-2006 through 2016-2017) of a longitudinal, small-group faculty development program for strengthening humanistic teaching and role modeling at 30 U.S. and Canadian medical schools that continues today. During the yearlong program, small groups of participating faculty met twice monthly with a local facilitator for exercises in humanistic teaching, role modeling, and related topics that combined narrative reflection with skills training using experiential learning techniques. The program focused on the professional development of its participants. Thirty schools participated; 993 faculty, including some residents, completed the program.In evaluations, participating faculty at 13 of the schools scored significantly more positively as rated by learners on all dimensions of medical humanism than did matched controls. Qualitative analyses from several cohorts suggest many participants had progressed to more advanced stages of professional identity formation after completing the program. Strong engagement and attendance by faculty participants as well as the multimodal evaluation suggest that the program may serve as a model for others. Recently, most schools adopting the program have offered the curriculum annually to two or more groups of faculty participants to create sufficient numbers of trained faculty to positively influence humanistic teaching at the institution.The authors discuss the program's learning theory, outline its curriculum, reflect on the program's accomplishments and plans for the future, and state how faculty trained in such programs could lead institutional initiatives and foster positive change in humanistic professional development at all levels of medical education.

Summative Evaluation Findings from the Interstellar Boundary Explorer (IBEX) Education and Public Outreach Program

Science.gov (United States)

Bartolone, L.; Nichols-Yehling, M.; Davis, H. B.; Davey, B.

2014-07-01

The Interstellar Boundary Explorer mission includes a comprehensive Education and Public Outreach (EPO) program in heliophysics that is overseen and implemented by the Adler Planetarium and evaluated by Technology for Learning Consortium, Inc. Several components of the IBEX EPO program were developed during the prime phase of the mission that were specifically designed for use in informal institutions, especially museums and planetaria. The program included a widely distributed planetarium show with accompanying informal education activities, printed posters, lithographs and other resources, funding for the development of the GEMS Space Science Sequence for Grades 6-8 curriculum materials, development of the IBEX mission website, development of materials for people with special needs, participation in the Heliophysics Educator Ambassador program, and support for the Space Explorers Afterschool Science Club for Chicago Public Schools. In this paper, we present an overview of the IBEX EPO program summative evaluation techniques and results for 2008 through 2012.

Automatic Program Development

DEFF Research Database (Denmark)

Automatic Program Development is a tribute to Robert Paige (1947-1999), our accomplished and respected colleague, and moreover our good friend, whose untimely passing was a loss to our academic and research community. We have collected the revised, updated versions of the papers published in his...... honor in the Higher-Order and Symbolic Computation Journal in the years 2003 and 2005. Among them there are two papers by Bob: (i) a retrospective view of his research lines, and (ii) a proposal for future studies in the area of the automatic program derivation. The book also includes some papers...... by members of the IFIP Working Group 2.1 of which Bob was an active member. All papers are related to some of the research interests of Bob and, in particular, to the transformational development of programs and their algorithmic derivation from formal specifications. Automatic Program Development offers...

Developing and Using a Logic Model for Evaluation and Assessment of University Student Affairs Programming: A Case Study

Science.gov (United States)

Cooper, Jeff

2009-01-01

This dissertation addresses theory and practice of evaluation and assessment in university student affairs, by applying logic modeling/program theory to a case study. I intend to add knowledge to ongoing dialogue among evaluation scholars and practitioners on student affairs program planning and improvement as integral considerations that serve…

Developing a Stakeholder-Driven Anticipated Timeline of Impact for Evaluation of Social Programs

Science.gov (United States)

Sridharan, Sanjeev; Campbell, Bernadette; Zinzow, Heidi

2006-01-01

The authors present a stakeholder-driven method, the earliest anticipated timeline of impact, which is designed to assess stakeholder expectations for the earliest time frame in which social programs are likely to affect outcomes. The utility of the anticipated timeline of impact is illustrated using an example from an evaluation of a…

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Lessons from a Train-the-Trainer Professional Development Program: The Sustainable Trainer Engagement Program (STEP)

Science.gov (United States)

Shupla, Christine; Gladney, Alicia; Dalton, Heather; LaConte, Keliann; Truxillo, Jeannette; Shipp, Stephanie

2015-11-01

The Sustainable Trainer Engagement Program (STEP) is a modified train-the-trainer professional development program being conducted by the Lunar and Planetary Institute (LPI). STEP has provided two cohorts of 6-8th grade science specialists and lead teachers in the Houston region with in-depth Earth and Space Science (ESS) content, activities, and pedagogy over 15 days each, aligned with Texas science standards. This project has two over-arching goals: to improve middle school ESS instruction, and to create and test an innovative model for Train-the-Trainer.This poster will share details regarding STEP’s activities and resources, program achievements, and its main findings to date. STEP is being evaluated by external evaluators at the Research Institute of Texas, part of the Harris County Department of Education. External evaluation shows an increase after one year in STEP participants’ knowledge (cohort 1 showed a 10% increase; cohort 2 showed a 20% increase), confidence in teaching Earth and Space Science effectively (cohort 1 demonstrated a 10% increase; cohort 2 showed a 20% increase), and confidence in preparing other teachers (cohort 1 demonstrated a 12% increase; cohort 2 showed a 20% increase). By September 2015, STEP participants led (or assisted in leading) approximately 40 workshops for about 1800 science teachers in Texas. Surveys of teachers attending professional development conducted by STEP participants show very positive responses, with averages for conference workshop evaluations ranging from 3.6 on a 4 point scale, and other evaluations averaging from 4.1 to 5.0 on a 5 point scale.Main lessons for the team on the train-the-trainer model include: a lack of confidence by leaders in K-12 science education in presenting ESS professional development, difficulties in arranging for school or district content-specific professional development, the minimal duration of most school and district professional development sessions, and uncertainties in

Environmental restoration and waste management: Robotics technology development program: Robotics 5-year program plan

International Nuclear Information System (INIS)

1991-01-01

This plan covers robotics Research, Development, Demonstration, Testing and Evaluation activities in the Program for the next five years. These activities range from bench-scale R ampersand D to full-scale hot demonstrations at DOE sites. This plan outlines applications of existing technology to near-term needs, the development and application of enhanced technology for longer-term needs, and initiation of advanced technology development to meet those needs beyond the five-year plan. The objective of the Robotic Technology Development Program (RTDP) is to develop and apply robotics technologies that will enable Environmental Restoration and Waste Management (ER ampersand WM) operations at DOE sites to be safer, faster and cheaper. Five priority DOE sites were visited in March 1990 to identify needs for robotics technology in ER ampersand WM operations. This 5-Year Program Plan for the RTDP detailed annual plans for robotics technology development based on identified needs. In July 1990 a forum was held announcing the robotics program. Over 60 organizations (industrial, university, and federal laboratory) made presentations on their robotics capabilities. To stimulate early interactions with the ER ampersand WM activities at DOE sites, as well as with the robotics community, the RTDP sponsored four technology demonstrations related to ER ampersand WM needs. These demonstrations integrated commercial technology with robotics technology developed by DOE in support of areas such as nuclear reactor maintenance and the civilian reactor waste program. 2 figs

Supporting mothers to breastfeed: the development and process evaluation of a father inclusive perinatal education support program in Perth, Western Australia.

Science.gov (United States)

Tohotoa, Jenny; Maycock, Bruce; Hauck, Yvonne; Howat, Peter; Burns, Sharyn; Binns, Colin

2011-09-01

Entry into fatherhood is a challenging period with new responsibilities and changes in family dynamics. Hegemonic imagery of men portray them as capable, confident and able which can disadvantage expectant fathers who often struggle to make sense of the changes occurring around and within their own parenting journey. Although fathers historically have not been included in breastfeeding classes, antenatal education programs can be an opportunity to inform and support them in their new role. Forty-five antenatal sessions for fathers (n = 342) of 1h duration were conducted by five male educators between May 2008 and June 2009 in Perth, Western Australia. A theoretical framework from health promotion literature was used as a guide in the program's development. Fathers in the intervention group gained information about their role, the importance of communication and the benefits of breastfeeding to both mother and baby. An evaluation was obtained from fathers immediately after the session and again at 6 week post-birth, whilst mothers reported on the perception of their partners' support for breastfeeding in the 6 week survey. The aim of this paper is to describe the development and process evaluation of a perinatal education and support program for fathers to assist their partners to breastfeed.

NIST biometric evaluations and developments

Science.gov (United States)

Garris, Michael D.; Wilson, Charles L.

2005-05-01

This paper presents an R&D framework used by the National Institute of Standards and Technology (NIST) for biometric technology testing and evaluation. The focus of this paper is on fingerprint-based verification and identification. Since 9-11 the NIST Image Group has been mandated by Congress to run a program for biometric technology assessment and biometric systems certification. Four essential areas of activity are discussed: 1) developing test datasets, 2) conducting performance assessment; 3) technology development; and 4) standards participation. A description of activities and accomplishments are provided for each of these areas. In the process, methods of performance testing are described and results from specific biometric technology evaluations are presented. This framework is anticipated to have broad applicability to other technology and application domains.

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Developments of integrity evaluation technology for pressurized components in nuclear power plant and IT based integrity evaluation system

Energy Technology Data Exchange (ETDEWEB)

Kim, Young Jin; Choi, Jae Boong; Shim, Do Jun [Sungkyunkwan Univ., Seoul (Korea, Republic of)] (and others)

2003-03-15

The objective of this research is to develop an efficient evaluation technology and to investigate applicability of newly-developed technology, such as internet-based cyber platform, to operating power plants. Development of efficient evaluation systems for Nuclear Power Plant components, based on structural integrity assessment techniques, are increasingly demanded for safe operation with the increasing operating period of Nuclear Power Plants. The following five topics are covered in this project: development of assessment method for wall-thinned nuclear piping based on pipe test; development of structural integrity program for steam generator tubes with cracks of various shape; development of fatigue life evaluation system for mam components of NPP; development of internet-based cyber platform and integrity program for primary components of NPP; effect of aging on strength of dissimilar welds.

Short-term evaluation of a skill-development sexual education program for Spanish adolescents compared with a well-established program.

Science.gov (United States)

Espada, José P; Morales, Alexandra; Orgilés, Mireia; Jemmott, John B; Jemmott, Loretta S

2015-01-01

The Centers for Disease Control and Prevention highlights the importance of evaluating interventions rigorously and recommends evaluating new interventions against interventions with established efficacy. Competencias para adolescentes con una sexualidad saludable (COMPAS) is a school-based HIV prevention program that has been shown to be effective in reducing sexual risk behaviors among adolescents in Spain. This study evaluates the efficacy of COMPAS program compared with a Spanish-culture adapted version of ¡Cuídate! (Take Care of Yourself), an evidence-based HIV prevention curriculum designed for Latino adolescents in the US. This cluster randomized controlled trial involved 1,563 adolescents attending 18 public high schools located in 5 provinces of Spain. The schools invited to participate were enrolled and randomly assigned to the three experimental conditions: COMPAS, ¡Cuídate!, and control group (CG; no intervention). Generalized estimating equation analyses revealed that both interventions improved attitudes toward people living with human immunodeficiency syndrome (HIV)/AIDS and the HIV test and increased HIV/sexually transmitted infection knowledge and intention to engage in safer sex behaviors compared with the CG. Although only COMPAS increased participants' sexual risk perception and attitude toward condom use compared with the CG, the two interventions did not significantly differ on any outcome. When compared with an established program, COMPAS was at least as effective at increasing the intention to engage in safer sex behaviors as the evidence-based intervention. Copyright © 2015 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

IPEP: Laboratory performance evaluation reports for management of DOE EM programs

International Nuclear Information System (INIS)

Hensley, J.E.; Lindahl, P.C.; Streets, W.E.

1995-01-01

Environmental restoration program/project managers at DOE's Office of Environmental Management (EM) are making important decisions based on analytical data generated by contracted laboratories. The Analytical Services Division, EM-263, is developing the Integrated Performance Evaluation Program (IPEP) to assess the performance of those laboratories, based on results from Performance Evaluation (PE) programs. The IPEP reports will be used by the laboratories to foster self-assessment and improvement. In addition, IPEP will produce PE reports for three levels of EM management (Operations/Project Offices, Area Program Offices, and Deputy Assistant Secretary Office). These reports will be used to assess whether contracted analytical laboratories have the capability to produce environmental data of the quality necessary for making environmental restoration and waste management decisions

[Resident evaluation of general surgery training programs].

Science.gov (United States)

Espinoza G, Ricardo; Danilla E, Stefan; Valdés G, Fabio; San Francisco R, Ignacio; Llanos L, Osvaldo

2009-07-01

The profile of the general surgeon has changed, aiming to incorporate new skills and to develop new specialties. To assess the quality of postgraduate General Surgery training programs given by Chilean universities, the satisfaction of students and their preferences after finishing the training period. A survey with multiple choice and Likert type questions was designed and applied to 77 surgery residents, corresponding to 59% of all residents of general surgery specialization programs of Chilean universities. Fifty five per cent of residents financed with their own resources the specialization program. Thirty nine percent disagreed partially or totally with the objectives and rotations of programs. The opportunity to perform surgical interventions and the support by teachers was well evaluated. However, 23% revealed teacher maltreatment. Fifty six percent performed research activities, 73% expected to continue training in a derived specialty and 69% was satisfied with the training program. Residents considered that the quality and dedication of professors and financing of programs are issues that must be improved. The opportunity to perform surgical interventions, obtaining a salary for their work and teacher support is considered of utmost importance.

Evaluating a community-based early childhood education and development program in Indonesia: study protocol for a pragmatic cluster randomized controlled trial with supplementary matched control group

NARCIS (Netherlands)

Pradhan, M.; Brinkman, S.A.; Beatty, A.; Maika, A.; Satriawan, E.; de Ree, J.; Hasan, A.

2013-01-01

Background This paper presents the study protocol for a pragmatic cluster randomized controlled trial (RCT) with a supplementary matched control group. The aim of the trial is to evaluate a community-based early education and development program launched by the Government of Indonesia. The program

Evaluating a community-based early childhood education and development program in Indonesia: study protocol for a pragmatic cluster randomized controlled trial with supplementary matched control group

NARCIS (Netherlands)

Pradhan, M.P.; Brinkman, S.A.; Beatty, A.; Maika, A.; Satriawan, E.; de Ree, J.; Hasan, A.

2013-01-01

Background: This paper presents the study protocol for a pragmatic cluster randomized controlled trial (RCT) with a supplementary matched control group. The aim of the trial is to evaluate a community-based early education and development program launched by the Government of Indonesia. The program

Using online program development to foster curricular change and innovation.

Science.gov (United States)

Gwozdek, Anne E; Springfield, Emily C; Peet, Melissa R; Kerschbaum, Wendy E

2011-03-01

Distance education offers an opportunity to catalyze sweeping curricular change. Faculty members of the University of Michigan Dental Hygiene Program spent eighteen months researching best practices, planning outcomes and courses, and implementing an e-learning (online) dental hygiene degree completion program. The result is a collaborative and portfolio-integrated program that focuses on the development of reflective practitioners and leaders in the profession. A team-based, systems-oriented model for production, implementation, and evaluation has been critical to the program's success. The models and best practices on which this program was founded are described. Also provided is a framework of strategies for development, including the utilization of backward course design, which can be used in many areas of professional education.

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

WANO. Development, programs, challenges

International Nuclear Information System (INIS)

Haferburg, Manfred

2011-01-01

In the wake of the accident at the Soviet RBMK reactor unit 4 in Chernobyl the nuclear industry founded the World Association of Nuclear Operators (WANO). To this day, the purpose of the organization has been to enhance worldwide cooperation of nuclear industry and, in this way, strengthen the safety and availability of nuclear power plants. Following some first steps after 1986, the charter of the organization was signed at the WANO constituent assembly in Moscow on May 15 and 16, 1989. The member companies thus committed themselves to support WANO's mission. WANO was established for these purposes: ''The mission of WANO is to maximize the safety and reliability of nuclear power plants worldwide by working together to assess, benchmark and improve performance through mutual support, exchange of information, and emulation of best practices.'' The WANO programs developed speedily thereafter. The focus was on peer reviews. In 2000, the first interim objective had been reached: Fifty percent of all member nuclear power plants had undergone peer reviews. In addition, plant-related peer reviews were extended throughout all operator organizations, and corporate peer reviews were developed. The other WANO programs as well, i.e. exchanges of experience, technical support, and performance indicators, exerted more and more influence on industry. Peer reviews covered entire operator organizations, and corporate peer reviews were developed. The worldwide paradigm shift in evaluating the use of nuclear power, and the associated construction programs for new nuclear power plants already in their implementation phase, assigned a new quality to the work of WANO. The organization is preparing a long-term strategy in the face of the challenges to be expected. The ultimate objective of these efforts is to support member organizations from the first preparations of a nuclear power plant project to the end of commercial operation. (orig.)

Wilderness educators' evaluation of the Impact Monster Program

Science.gov (United States)

William W. Hendricks; Alan E. Watson

1999-01-01

Since its development by Jim Bradley in the late 1970s, the Impact Monster, a wilderness education skit designed to teach minimum impact techniques, has been used as a wilderness education tool by federal land management agencies. This paper reports on an evaluation of the perceived effectiveness of the Impact Monster program and its content. Results indicate that the...

Curriculum Evaluation and Employers Opinions: the case study of Educational Technology Program in Bachelor Degree (Continuing Program

Directory of Open Access Journals (Sweden)

Nakhon Lalognam

2016-09-01

uncertain level, process aspect was at the high level and product aspect was at the high level. 2. The opinions of employers to the ideal characteristics were at the highest level and actual characteristics were at the high level. 3. The opinions to the requirements of the Educational Technology Program in Bachelor Degree (Continuing Program and knowledge implementation in work of graduate were: 3.1 The opinions of graduates, the curriculum committee and instructors to the Educational Technology Program in Bachelor Degree (Continuing Program were at the highest level. 3.2 The opinions of graduates to knowledge implementation in work at the high level. 4. The suggestions and guidelines for improving of the Educational Technology Program in Bachelor Degree (Continuing Program were as follows: 4.1 Context Evaluation Aspect: The results indicated that should improve philosophy, course outline, course description and course content of the curriculum appropriate to the current economic, social and technological and meet with requirements of learners and graduate – employers and specific psychomotor aspect which are used for existing of life in society. 4.2 Input Evaluation Aspect: Instructor should have knowledge which are the curriculum, specific specialization in subject, continually developing of new task and should make academic position for subjects which they teach that is promoting of strength of the curriculum. Department of Educational Technology manage training or seminar about techniques of pedagogy and learning process, the enhanced project about development of knowledge, attitude and basic psychomotor for learners, allocate budget and provide textbooks, hardware and software media and set up laboratory be adequate and appropriate for learner. 4.3 Process Evaluation Aspect: Instructional management requires both of theory and practice that instructors should explicitly determine and must use a variety of measurement, should get evaluation for every 4 years according

Roadmap for Nondestructive Evaluation of Reactor Pressure Vessel Research and Development by the Light Water Reactor Sustainability Program

Energy Technology Data Exchange (ETDEWEB)

Smith, Cyrus M [ORNL; Nanstad, Randy K [ORNL; Clayton, Dwight A [ORNL; Matlack, Katie [Georgia Institute of Technology; Ramuhalli, Pradeep [Pacific Northwest National Laboratory (PNNL); Light, Glenn [Southwest Research Institute, San Antonio

2012-09-01

The Department of Energy s (DOE) Light Water Reactor Sustainability (LWRS) Program is a five year effort which works to develop the fundamental scientific basis to understand, predict, and measure changes in materials and systems, structure, and components as they age in environments associated with continued long-term operations of existing commercial nuclear power reactors. This year, the Materials Aging and Degradation (MAaD) Pathway of this program has placed emphasis on emerging Non-Destructive Evaluation (NDE) methods which support these objectives. DOE funded Research and Development (R&D) on emerging NDE techniques to support commercial nuclear reactor sustainability is expected to begin next year. This summer, the MAaD Pathway invited subject matter experts to participate in a series of workshops which developed the basis for the research plan of these DOE R&D NDE activities. This document presents the results of one of these workshops which are the DOE LWRS NDE R&D Roadmap for Reactor Pressure Vessels (RPV). These workshops made a substantial effort to coordinate the DOE NDE R&D with that already underway or planned by the Electric Power Research Institute (EPRI) and the Nuclear Regulatory Commission (NRC) through their representation at these workshops.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

Energy Technology Data Exchange (ETDEWEB)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il [Korea Atomic Energy Research Institute, Daejeon (Korea, Republic of)

2015-10-15

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit.

A Study on Evaluation of Training Program for MCR Operators of SMART Simulator

International Nuclear Information System (INIS)

Park, Hyun Jun; Lee, Joon Ku; Jeong, Kwang Il

2015-01-01

It is important to develop a training program by simulators in main control room of nuclear power plants because there is no an operation expert and no operating experience in the pre-construction phase of nuclear power plants. It is also necessary to develop a training program and its evaluation method taking human error into account. The purpose of this study is developing evaluation model of simulators. In a training program, once training requirements are selected, evaluation of training is as important as its implementation. Training effectiveness is available value in a simulator-based environment. The main control room of SMART (System-integrated Modular Advanced ReacTor) is consist of workstation, visual display units such as LDP and FPD based on digital systems. Cognitive behaviors of a high level are required to operators in these man-machine interface system (MMIS). Therefore, it is essential to identify training requirements and to develop its evaluation model. Virtual Environments such as a simulator have utilized by a lot of industries and companies for training and accident prevention. Simulators have three primary benefits. The first is that training by simulators is less expensive than those in real environment. The second is that simulators enable safety enhancement using systematic training program. The third is that simulators provide a preliminary to prevent human error. It is significant to apply TER, TCR, TCE in evaluation of training effect. It is expected that these could be applied to revise training criteria and enable to consider efficiency in terms of cost and benefit

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.