Process evaluation of a Toolbox-training program for construction foremen in Denmark

DEFF Research Database (Denmark)

Jeschke, Katharina Christiane; Kines, Pete; Rasmussen, Liselotte

2017-01-01

foremen’s knowledge and communication skills in daily planning of work tasks and their related OSH risks on construction sites. The program builds on the popular 'toolbox meeting' concept, however there is very little research evaluating these types of meetings. This article describes the development...... and revised until the final version after the fifth group. The evaluation utilized an action research strategy with a mixed–methods approach of triangulating questionnaire, interview, and observation data. Process evaluation results showed that the eight Toolbox-training topics were relevant and useful...

Evaluation of Respiratory Protection Program in Petrochemical Industries: Application of Analytic Hierarchy Process

Directory of Open Access Journals (Sweden)

Hadi Kolahi

2018-03-01

Full Text Available Background: Respiratory protection equipment (RPE is the last resort to control exposure to workplace air pollutants. A comprehensive respiratory protection program (RPP ensures that RPE is selected, used, and cared properly. Therefore, RPP must be well integrated into the occupational health and safety requirements. In this study, we evaluated the implementation of RPP in Iranian petrochemical industries to identify the required solutions to improve the current status of respiratory protection. Methods: This cross-sectional study was conducted among 24 petrochemical industries in Iran. The survey instrument was a checklist extracted from the Occupational Safety and Health Administration respiratory protection standard. An index, Respiratory Protection Program Index (RPPI, was developed and weighted by analytic hierarchy process to determine the compliance rate (CR of provided respiratory protection measures with the RPP standard. Data analysis was performed using Excel 2010. Results: The most important element of RPP, according to experts, was respiratory hazard evaluation. The average value of RPPI in the petrochemical plants was 49 ± 15%. The highest and lowest of CR among RPP elements were RPE selection and medical evaluation, respectively. Conclusion: None of studied petrochemical industries implemented RPP completely. This can lead to employees' overexposure to hazardous workplace air contaminants. Increasing awareness of employees and employers through training is suggested by this study to improve such conditions. Keywords: analytic hierarchy process, petrochemical industries, respiratory protection program

Using the Nine Common Themes of Good Practice checklist as a tool for evaluating the research priority setting process of a provincial research and program evaluation program.

Science.gov (United States)

Mador, Rebecca L; Kornas, Kathy; Simard, Anne; Haroun, Vinita

2016-03-23

Given the context-specific nature of health research prioritization and the obligation to effectively allocate resources to initiatives that will achieve the greatest impact, evaluation of priority setting processes can refine and strengthen such exercises and their outcomes. However, guidance is needed on evaluation tools that can be applied to research priority setting. This paper describes the adaption and application of a conceptual framework to evaluate a research priority setting exercise operating within the public health sector in Ontario, Canada. The Nine Common Themes of Good Practice checklist, described by Viergever et al. (Health Res Policy Syst 8:36, 2010) was used as the conceptual framework to evaluate the research priority setting process developed for the Locally Driven Collaborative Projects (LDCP) program in Ontario, Canada. Multiple data sources were used to inform the evaluation, including a review of selected priority setting approaches, surveys with priority setting participants, document review, and consultation with the program advisory committee. The evaluation assisted in identifying improvements to six elements of the LDCP priority setting process. The modifications were aimed at improving inclusiveness, information gathering practices, planning for project implementation, and evaluation. In addition, the findings identified that the timing of priority setting activities and level of control over the process were key factors that influenced the ability to effectively implement changes. The findings demonstrate the novel adaptation and application of the 'Nine Common Themes of Good Practice checklist' as a tool for evaluating a research priority setting exercise. The tool can guide the development of evaluation questions and enables the assessment of key constructs related to the design and delivery of a research priority setting process.

Demand-side management process evaluations - the management perspective

International Nuclear Information System (INIS)

Perrault, G.A.; Barrett, L.B.

1993-01-01

A demand-side management (DSM) process evaluation is a qualitative, expert assessment of how a utility marketing program is being conducted. It reviews the efficiency and effectiveness in which a utility plans, manages, executes, and monitors the delivery of DSM programs to its marketplace. Process evaluations,which includes load impact, customer satisfaction and cost-effectiveness analysis, are becoming an increasingly significant component. The process evaluation focus is on the program planning and delivery process as opposed to the energy impacts resulting from the specific measures or products of the program. Because of this process-oriented focus, such evaluations can identify important opportunities for improving the cost-effectiveness of a program without significantly changing product lines. The evaluation may identify administrative or delivery process improvements. In addition, the evaluation may identify ways of improving the degree to which the customer is satisfied with the program or the utility. Since process evaluations are usually conducted as part of a utility's mandated DSM measurement and evaluation plan, they tend to focus mainly on the stated needs of the regulator as opposed to company management. This can be a problem. Although the regulatory perspective is important, in an increasingly competitive business environment, utilities must not overlook management's business and operational needs for specific information regarding DSM program planning, control, execution, and evaluation. This paper discusses some of the conflicts that exist between the regulator's and management's needs for DSM program evaluation results and presents some approaches for assuring that both needs are met. It is organized to first discuss the scope of a process evaluation, then the evaluation issues, the management concerns, and finally reporting of results

Process Evaluation of a Parenting Program for Low-Income Families in South Africa

Science.gov (United States)

Lachman, Jamie M.; Kelly, Jane; Cluver, Lucie; Ward, Catherine L.; Hutchings, Judy; Gardner, Frances

2018-01-01

Objective: This mixed-methods process evaluation examined the feasibility of a parenting program delivered by community facilitators to reduce the risk of child maltreatment in low-income families with children aged 3-8 years in Cape Town, South Africa (N = 68). Method: Quantitative measures included attendance registers, fidelity checklists,…

15 CFR 286.7 - Evaluation process.

Science.gov (United States)

2010-01-01

... 15 Commerce and Foreign Trade 1 2010-01-01 2010-01-01 false Evaluation process. 286.7 Section 286... VOLUNTARY CONFORMITY ASSESSMENT SYSTEM EVALUATION (NVCASE) PROGRAM § 286.7 Evaluation process. (a) Each applicant requesting to be evaluated under NVCASE is expected to initiate the process and assume designated...

Process evaluation of a multifaceted health program aiming to improve physical activity levels and dietary patterns among construction workers

NARCIS (Netherlands)

Viester, L.; Verhagen, E.A.L.M.; Bongers, P.M.; Beek, A.J. van der

2014-01-01

Objective: To evaluate the process of a health promotion program, aiming to improve physical activity levels and diet among construction workers. Methods: The process evaluation was conducted after the RE-AIM framework for the evaluation of the public health impact of health promotion interventions.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Process evaluation to explore internal and external validity of the "Act in Case of Depression" care program in nursing homes.

Science.gov (United States)

Leontjevas, Ruslan; Gerritsen, Debby L; Koopmans, Raymond T C M; Smalbrugge, Martin; Vernooij-Dassen, Myrra J F J

2012-06-01

A multidisciplinary, evidence-based care program to improve the management of depression in nursing home residents was implemented and tested using a stepped-wedge design in 23 nursing homes (NHs): "Act in case of Depression" (AiD). Before effect analyses, to evaluate AiD process data on sampling quality (recruitment and randomization, reach) and intervention quality (relevance and feasibility, extent to which AiD was performed), which can be used for understanding internal and external validity. In this article, a model is presented that divides process evaluation data into first- and second-order process data. Qualitative and quantitative data based on personal files of residents, interviews of nursing home professionals, and a research database were analyzed according to the following process evaluation components: sampling quality and intervention quality. Nursing home. The pattern of residents' informed consent rates differed for dementia special care units and somatic units during the study. The nursing home staff was satisfied with the AiD program and reported that the program was feasible and relevant. With the exception of the first screening step (nursing staff members using a short observer-based depression scale), AiD components were not performed fully by NH staff as prescribed in the AiD protocol. Although NH staff found the program relevant and feasible and was satisfied with the program content, individual AiD components may have different feasibility. The results on sampling quality implied that statistical analyses of AiD effectiveness should account for the type of unit, whereas the findings on intervention quality implied that, next to the type of unit, analyses should account for the extent to which individual AiD program components were performed. In general, our first-order process data evaluation confirmed internal and external validity of the AiD trial, and this evaluation enabled further statistical fine tuning. The importance of

Girls Just Wanna Have Fun: a process evaluation of a female youth-driven physical activity-based life skills program.

Science.gov (United States)

Bean, Corliss N; Forneris, Tanya; Halsall, Tanya

2014-01-01

Integrating a positive youth development framework into physical activity programming has become popular as it is believed that this integration can create the development of both physical and psychosocial skills. However, there has been a lack of intervention fidelity research within the field of positive youth development. The Girls Just Wanna Have Fun program was designed in response to increased calls for physical activity programs for female youth and is a theoretically-grounded physical activity-based life skills program that aims to empower female youth. The purpose of this paper was to provide a detailed description of the program and a process evaluation of the first year of program implementation. From interviews with youth and leaders, as well as documentation from the leaders' weekly online log of each implemented session, themes emerged regarding the successes. Findings from this study indicated that program goals were attained and it appears that the program was implemented, for the most part, as designed. The themes related to successes included using activities to facilitate relational time, providing intentional opportunities for leadership, having communicative program leaders who supported one another, and engaging youth in different types of physical activity. The themes related to challenges included difficulties with facility and transportation, some activities being too much like schoolwork, and social distractions and cliques. Included in the paper is a discussion of practical implications and recommendations for community programmers, as well as future directions for the program. Overall, this process evaluation represents an important step in responding to calls for increased evaluation in community-based programs and aids in understanding the process in which positive youth development programs can be effectively implemented.

A process evaluation of a social cognitive theory-based childhood obesity prevention intervention: the Comics for Health program.

Science.gov (United States)

Branscum, Paul; Sharma, Manoj; Wang, Lihshing Leigh; Wilson, Bradley; Rojas-Guyler, Liliana

2013-03-01

Process evaluations are an often overlooked yet essential component of health promotion interventions. This study reports the results of a comprehensive process evaluation for the "Comics for Health" program, a childhood obesity prevention intervention implemented at 12 after-school programs. Qualitative and quantitative process data were collected using surveys, field notes, and open-item questionnaires, which assessed program fidelity, dose delivered, dose received, reach, recruitment, and context. Triangulation of methods was also employed to better understand how the program was implemented and received by the facilitator, staff members, and children in the program. Results indicated that program implementation had an almost perfect rate of fidelity with most lessons recording 100% tasks completed. Lessons were implemented in their intended order and lasted approximately 30 minutes as planned. After-school staff members reported that the program was well received by children, and this program should be replicated in the future. Attendance records showed that a majority of the children attended each lesson on the initial day of delivery (70.4%) and informal make-up lessons were implemented to compensate for the other children. Finally, several known sources of contamination were found such as past and concurrent exposure to similar health promotion interventions, which could potentially influence study outcomes. These findings will be used to help explain the results of this intervention and make recommendations for future intervention efforts.

Process Evaluation of a School-Based Education Program about Organ Donation and Registration, and the Intention for Continuance

Science.gov (United States)

Reubsaet, A.; Reinaerts, E. B. M.; Brug, J.; van Hooff, J. P.; van den Borne, H. W.

2004-01-01

This paper describes the process evaluation of an organ donation education program for high school students aged 15-18 years of which the effectiveness was established. The program consisted of three components: a video with group discussion, an interactive computer-tailored program and a registration training session. A cross-sectional survey was…

An Evaluation of the Employee Training and Development Process for Nicolet Area Technical College's Basic Education Program.

Science.gov (United States)

Karl, Luis C.

The adult basic education (ABE) program at Nicolet Area Technical College (NATC) evaluated its training and development (T&D) process for new basic education instructors. The study gathered monitoring and screening criteria that addressed valuable components for use in an instrument for validating effectiveness of the ABE program (T&D)…

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Process evaluation of the project P.A.T.H.S. (secondary 2 program): findings based on the co-walker scheme.

Science.gov (United States)

Shek, Daniel T L; Tam, Suet-yan

2009-01-01

To understand the implementation quality of the Tier 1 Program (Secondary 2 Curriculum) of the P.A.T.H.S. Project, process evaluation was carried out by co-walkers through classroom observation of 195 units in 131 schools. Results showed that the overall level of program adherence was generally high with an average of 84.55%, and different factors of the implementation process were evaluated as positive. Quality of program implementation and achievement of program objectives were predicted by students' participation and involvement, strategies to enhance students' motivation, opportunity for reflection, time management, and class preparation. Success in program implementation was predicted by students' participation and involvement, classroom control, interactive delivery method, strategies to enhance students' motivation, opportunity for reflection, and lesson preparation.

Implementation of the Danish return-to-work program : process evaluation of a trial in 21 Danish municipalities

NARCIS (Netherlands)

Aust, Birgit; Nielsen, Maj Britt D.; Grundtvig, Gry; Buchardt, Helle L.; Ferm, Linnea; Andersen, Irene; Lund, Trine L.; Jelle, Martin Ohmann Claudio; Andersen, Malene F.; Hansen, Jorgen V.; Tverborgvik, Torill; Helverskov, Trine; Bjorner, Jakob Bue; Rugulies, Reiner; Orbaek, Palle; Winzor, Glen; Bultmann, Ute; Poulsen, Otto M.

Objectives The aim of this study was to evaluate the implementation of the Danish national return-to-work (RTW) program in 21 Danish municipalities. Methods We conducted a structured process evaluation on (i) reach and recruitment, (ii) fidelity, (iii) dose-delivered, (iv) dose-received, and (v)

Implementation of the Danish return-to-work program : process evaluation of a trial in 21 Danish municipalities

NARCIS (Netherlands)

Aust, Birgit; Nielsen, Maj Britt D.; Grundtvig, Gry; Buchardt, Helle L.; Ferm, Linnea; Andersen, Irene; Lund, Trine L.; Jelle, Martin Ohmann Claudio; Andersen, Malene F.; Hansen, Jorgen V.; Tverborgvik, Torill; Helverskov, Trine; Bjorner, Jakob Bue; Rugulies, Reiner; Orbaek, Palle; Winzor, Glen; Bultmann, Ute; Poulsen, Otto M.

2015-01-01

Objectives The aim of this study was to evaluate the implementation of the Danish national return-to-work (RTW) program in 21 Danish municipalities. Methods We conducted a structured process evaluation on (i) reach and recruitment, (ii) fidelity, (iii) dose-delivered, (iv) dose-received, and (v)

Spreading the word: A process evaluation of a voluntary AOD prevention program.

Science.gov (United States)

Edelen, Maria Orlando; Tucker, Joan; D'Amico, Elizabeth

2015-06-01

Research on voluntary after-school alcohol and other drug (AOD) prevention programs is limited. It is important to increase understanding of students' motivation to attend these types of programs and their tendency to transfer program information to peers. This paper summarizes efforts to evaluate process information for CHOICE, a voluntary after-school AOD prevention program for middle-school youth. A survey administered to 1899 students aged 10-16 in seven schools assessed: (1) why students choose to attend CHOICE (2) barriers to attendance; and (3) how program information is disseminated to non-participants. Frequencies of responses from participants and non-participants were compared. Participants were motivated by several features, most notably, the demeanor of the group leaders and enjoyable curriculum content. Barriers to attendance were primarily logistic, but results also suggest that the promotion message should more effectively emphasize that CHOICE is appropriate for everyone. The majority of students knew about CHOICE, both through advertising and conversations with friends. Non-participants' detailed reports of what they heard from friends corresponded closely with what participants reported sharing. The use of dynamic group leaders is critical to engaging students in voluntary programs. Offering the program on different days of the week or at different times (e.g., before school) may improve attendance rates. Peer networks represent a critical pathway for prevention information that can help increase program impact. These results can be used to inform modifications to existing voluntary after-school AOD prevention programs to obtain higher attendance rates and more widespread dissemination of the intervention message. © American Academy of Addiction Psychiatry.

Seismic re-evaluation process in Medzamor-2 NPP

International Nuclear Information System (INIS)

Zadoyan, P.

2000-01-01

Seismic re-evaluation process for Medzamor-2 NPP describes the following topics: program implementation status; re-evaluation program structure; regulatory procedure and review plan; current tasks and practice; and regulatory assessment and research programs

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs

Directory of Open Access Journals (Sweden)

Chloe S. Gordon

2017-02-01

Full Text Available Abstract Background Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children’s drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Methods Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews, program evaluation questionnaires completed by children (n = 166, lesson observations completed by teachers (n = 35 observations, and reflective journal entries completed by the researcher (n = 44 entries. A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Results Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students’ life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs.

Science.gov (United States)

Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J

2017-02-02

Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Development and process evaluation of a Web-based responsible beverage service training program.

Science.gov (United States)

Danaher, Brian G; Dresser, Jack; Shaw, Tracy; Severson, Herbert H; Tyler, Milagra S; Maxwell, Elisabeth D; Christiansen, Steve M

2012-09-22

Responsible beverage service (RBS) training designed to improve the appropriate service of alcohol in commercial establishments is typically delivered in workshops. Recently, Web-based RBS training programs have emerged. This report describes the formative development and subsequent design of an innovative Web-delivered RBS program, and evaluation of the impact of the program on servers' knowledge, attitudes, and self-efficacy. Formative procedures using focus groups and usability testing were used to develop a Web-based RBS training program. Professional alcohol servers (N = 112) who worked as servers and/or mangers in alcohol service settings were recruited to participate. A pre-post assessment design was used to assess changes associated with using the program. Participants who used the program showed significant improvements in their RBS knowledge, attitudes, and self-efficacy. Although the current study did not directly observe and determine impact of the intervention on server behaviors, it demonstrated that the development process incorporating input from a multidisciplinary team in conjunction with feedback from end-users resulted in creation of a Web-based RBS program that was well-received by servers and that changed relevant knowledge, attitudes, and self-efficacy. The results also help to establish a needed evidence base in support of the use of online RBS training, which has been afforded little research attention.

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

Process evaluation of a national school-based iron supplementation program for adolescent girls in Iran.

Science.gov (United States)

Kheirouri, Sorayya; Alizadeh, Mohammad

2014-09-16

Iron deficiency anemia remains as one of the most common nutritional problems in Iran, especially in women and girls. A process evaluation study of the national iron supplementation program targeting girls attending high schools was conducted to examine degree of exposure and satisfaction of the targets with the intervention components, and to assess the delivery (quantity), fidelity (quality), and environmental mediators of the intervention. Three assessment tools were developed and used for the process evaluation. A total of 8 schools were selected using a simple randomization method. Data were collected from students (n = 658 of 661 participants), teachers (n = 80), and school principals (n = 7 of 8). For the qualitative measures semi-structured interviews were conducted with the three study groups. Mean continuous compliance was 62.3%. Intolerance to pills and no water supply in classrooms accounted for 47.72% and 36.21% of the refusals, respectively. The refusal rate was significantly correlated (p knowledge of iron deficiency issues (p < 0.05). The odds of refusal in the absence of a classroom water supply were 2.02 (95% CI 1 · 044 to 3 · 900) times greater than for those classrooms with a water supply. Student exposure to the program's goal was satisfactory; however, delivery and fidelity of educational materials and training sessions were inadequate. The findings suggest that the methods of delivery and the fidelity of the program components, education materials and training sessions were insufficient and need to be improved. Additionally, specific attention has to be given to contextual factors to ensure the success of the program.

TEXACO GASIFICATION PROCESS - INNOVATIVE TECHNOLOGY EVALUATION REPORT

Science.gov (United States)

This report summarizes the evaluation of the Texaco Gasification Process (TGP) conducted under the U.S. Environmental Protection Agency (EPA) Superfund Innovative Technology Evaluation (SITE) Program. The Texaco Gasification Process was developed by Texaco Inc. The TGP is a comm...

H Scan/AHP decision process planning for evaluating and ranking of proposals submitted to the DOE hydrogen program

Energy Technology Data Exchange (ETDEWEB)

Szoka de Valladares, M.R. [National Renwable Energy Lab., Washington, DC (United States); Mack, S. [Energtics, Washington, DC (United States)

1995-09-01

The DOE Hydrogen Program needs to develop criteria as part of a systematic evaluation process for proposal identification, evaluation and selection. The H Scan component of this process provides a framework in which a project proposer can fully describe their candidate technology system and its components. The H Scan complements traditional methods of capturing cost and technical information. It consists of a special set of survey forms designed to elicit information so expert reviewers can assess the proposal relative to DOE specified selection criteria. The Analytic Hierarchy Process (AHP) component of the decision process assembles the management defined evaluation and selection criteria into a coherent multi-level decision construct by which projects can be evaluated in pair-wise comparisons. The AHP model will reflect management`s objectives and it will assist in the ranking of individual projects based on the extent to which each contributes to management`s objectives. This paper contains a detailed description of the products and activities associated with the planning and evaluation process: The objectives or criteria; the H Scan; and The Analytic Hierarchy Process (AHP).

SITE PROGRAM DEMONSTRATION ECO LOGIC INTERNATIONAL GAS-PHASE CHEMICAL REDUCTION PROCESS, BAY CITY, MICHIGAN TECHNOLOGY EVALUATION REPORT

Science.gov (United States)

The SITE Program funded a field demonstration to evaluate the Eco Logic Gas-Phase Chemical Reduction Process developed by ELI Eco Logic International Inc. (ELI), Ontario, Canada. The Demonstration took place at the Middleground Landfill in Bay City, Michigan using landfill wa...

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

Science.gov (United States)

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

Issues evaluation process at Rocky Flats Plant

International Nuclear Information System (INIS)

Smith, L.C.

1992-01-01

This report describes the issues evaluation process for Rocky Flats Plant as established in July 1990. The issues evaluation process was initiated February 27, 1990 with a Charter and Process Overview for short-term implementation. The purpose of the process was to determine the projects required for completion before the Phased Resumption of Plutonium Operations. To determine which projects were required, the issues evaluation process and emphasized risk mitigation, based on a ranking system. The purpose of this report is to document the early design of the issues evaluation process to record the methodologies used that continue as the basis for the ongoing Issues Management Program at Rocky Flats Plant

Evaluation Program initiative

International Nuclear Information System (INIS)

Rich, B.L.

1987-01-01

The purpose of this paper is to provide the Department of Energy's (DOE) safeguards and security community with some insights on an important management initiative by the Office of Security Evaluations (OSE). The paper will present the ''what, where, who, when, and why'' of a new Evaluation Program. The Evaluation Program will be comprised of a continuing series of regular and special evaluations of DOE safeguards and security programs and policies. The evaluations will be integrative and ''crosscutting,'' i.e. will extend across DOE organizational lines. Evaluations will be offered as positive advisories to DOE managers with safeguards and security responsibilities and will not be rated. They will complement the ongoing OSE Inspection Program of inspections conducted by OSE's Inspection Division. The purpose for the evaluations is to establish an accurate and current assessment of the effectiveness and status of safeguards and security programs and policies and to provide DOE managers with required information on program and policy effectiveness

Coal liquefaction process streams characterization and evaluation

Energy Technology Data Exchange (ETDEWEB)

Robbins, G.A.; Brandes, S.D.; Winschel, R.A.; Burke, F.P.

1992-03-01

CONSOL R D is conducting a three-year program to characterize process and product streams from direct coal liquefaction process development projects. The program objectives are two-fold: (1) to obtain and provide appropriate samples of coal liquids for the evaluation of analytical methodology, and (2) to support ongoing DOE-sponsored coal liquefaction process development efforts. The two broad objectives have considerable overlap and together serve to provide a bridge between process development and analytical chemistry.

Process-aware web programming with Jolie

DEFF Research Database (Denmark)

Montesi, F.

2016-01-01

We extend the Jolie programming language to capture the native modelling of process-aware web information systems, i.e., web information systems based upon the execution of business processes. Our main contribution is to offer a unifying approach for the programming of distributed architectures...... on the web, which can capture web servers, stateful process execution, and the composition of services via mediation. We discuss applications of this approach through a series of examples that cover, e.g., static content serving, multiparty sessions, and the evolution of web systems. Finally, we present...... a performance evaluation that includes a comparison of Jolie-based web systems to other frameworks and a measurement of its scalability. © 2016 Elsevier B.V....

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

Evaluation of empowerment program to increase production capacity of fishery processing business in Semarang City, Indonesia

Science.gov (United States)

Swastawati, F.; Roessali, W.; Wijayanti, I.; Anggo, A. D.

2018-01-01

This study aims to evaluate the empowerment program to increase the production capacity of fishery product processing. Empowerment program was the implementation and utilization of science and technology in the area (IPTEKDA) LIPI Indonesia for Higher Education. Activity carried out in 2016 on fish processing industry “Lumintu Group”. Implementation of activities includes the transfer of technology to increase production capacity, business capital assistance in the form of production equipment, production assistance, and business management. This study uses qualitative, descriptive analysis, data collection with observation, interviews, and questionnaires. The results showed that the total number of active members was 24 people, 50% of the members specially cultivated the smoked fish that is the type of Catfish (Arius thalassinus) and Stingray (Dasyatis sp), while 45.83% of members processed boneless milkfish, and 4,17% produce salted fish. Increased average production scale of 31.82% in smoked fish business, 12.4% in boneless milkfish and 38.89% in salted fish business. Willingness to return capital in the good category, meaning that all members were able to carry out the schedule of relative payback on time. Approximately 83.3% of the group members felt that the program that followed had greatly assisted in increasing the scale of business but hoped to improve skills in terms of processing and marketing.

Suitability of a structured Fundamental Movement Skills program for long day care centres: a process evaluation.

Science.gov (United States)

Petrunoff, Nick; Lloyd, Beverley; Watson, Natalie; Morrisey, David

2009-04-01

Early childhood presents an opportunity to encourage development of Fundamental Movement Skills (FMS). Implementation of a structured program in the Long Day Care (LDC) setting presents challenges. Implementation of a structured FMS program FunMoves was assessed in LDC in metropolitan New South Wales. LDC staff attended a training session conducted by trained Health Promotion Officers (HPOs) and completed an evaluation. During implementation HPOs completed lesson observations. De-identified attendance data was collected and director and staff feedback on the program including barriers to implementation was obtained via questionnaire. Qualitative information relevant to process evaluation was obtained via open questions on questionnaires, and a de-brief diary recording feedback from directors and staff. Knowledge of FMS and FunMoves and staff confidence to deliver the program were high after training. On average, staff stated they ran lessons more than the suggested twice weekly and the majority of children attended 1-3 lessons per week. However, lesson delivery was not as designed, and staff found FunMoves disruptive and time consuming. Six directors and the majority of staff thought that FunMoves could be improved. Structured program delivery was hampered by contextual issues including significant staff turnover and program length and structure being at odds with the setting. Implementation could be enhanced by guidelines for more flexible delivery options including less structured approaches, shorter and simpler lessons, ongoing conversations with the early childhood sector, in-centre engagement of staff and post-training support.

Improving Adherence to Mediterranean-Style Diet With a Community Culinary Coaching Program: Methodology Development and Process Evaluation.

Science.gov (United States)

Polak, Rani; Pober, David; Morris, Avigail; Arieli, Rakefet; Moore, Margaret; Berry, Elliot; Ziv, Mati

The Community Culinary Coaching Program is a community-based participatory program aimed at improving communal settlement residents' nutrition. The residents, central kitchens, preschools, and communal dining rooms were identified as areas for intervention. Evaluation included goals accomplishment assessed by food purchases by the central kitchens, and residents' feedback through focus groups. Purchasing included more vegetables (mean (standard error) percent change), (+7% (4); P = .32), fish (+115% (11); P < .001), whole grains, and legumes (+77% (9); P < .001); and less soup powders (-40% (9); P < .05), processed beef (-55% (8); P < .001), and margarine (-100% (4); P < .001). Residents recommended continuing the program beyond the project duration. This model might be useful in organizations with communal dining facilities.

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

RELABEL2007, Labels FORTRAN Statements in ENDF Format Processing Programs

International Nuclear Information System (INIS)

2007-01-01

1 - Description of program or function: RELABEL labels a ENDF/B pre-processing program so that statement labels are in increasing order in increments of 10 within each routine, and cards are identified in columns 73-80 by three alphanumeric characters in columns 73-75 and sequence numbers in columns 76-80 in increments of 10. IAEA1314/10: This version include the updates up to January 30, 2007. Changes in ENDF/B-VII Format and procedures, as well as the evaluations themselves, make it impossible for versions of the ENDF/B pre-processing codes earlier than PREPRO 2007 (2007 Version) to accurately process current ENDF/B-VII evaluations. The present code can handle all existing ENDF/B-VI evaluations through release 8, which will be the last release of ENDF/B-VI. Modifications from previous versions: Relabel VERS. 2007-1 (JAN. 2007): No change since March 2004 version 2 - Method of solution: 3 - Restrictions on the complexity of the problem: RELABEL is designed to maintain ENDF/B processing programs which use a restricted set of FORTRAN statements. As such, this program is not completely general

Effectiveness and Cost-benefit Evaluation of a Comprehensive Workers' Health Surveillance Program for Sustainable Employability of Meat Processing Workers

NARCIS (Netherlands)

Holland, van Berry J.; Reneman, Michiel F; Soer, Remko; Brouwer, Sandra; de Boer, Michiel R

Objective To evaluate the effectiveness of a comprehensive workers' health surveillance (WHS) program on aspects of sustainable employability and cost-benefit. Methods A cluster randomized stepped wedge trial was performed in a Dutch meat processing company from february 2012 until march 2015. In

Effectiveness and Cost-benefit Evaluation of a Comprehensive Workers' Health Surveillance Program for Sustainable Employability of Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry J; Reneman, Michiel F; Soer, Remko; Brouwer, Sandra; de Boer, Michiel R

2017-01-01

Objective To evaluate the effectiveness of a comprehensive workers' health surveillance (WHS) program on aspects of sustainable employability and cost-benefit. Methods A cluster randomized stepped wedge trial was performed in a Dutch meat processing company from february 2012 until march 2015. In

Revealing the programming process

DEFF Research Database (Denmark)

Bennedsen, Jens; Caspersen, Michael Edelgaard

2005-01-01

One of the most important goals of an introductory programming course is that the students learn a systematic approach to the development of computer programs. Revealing the programming process is an important part of this; however, textbooks do not address the issue -- probably because...... the textbook medium is static and therefore ill-suited to expose the process of programming. We have found that process recordings in the form of captured narrated programming sessions are a simple, cheap, and efficient way of providing the revelation.We identify seven different elements of the programming...

Methods for evaluating a mature substance abuse prevention/early intervention program.

Science.gov (United States)

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Defense Waste Processing Facility (DWPF), Modular CSSX Unit (CSSX), and Waste Transfer Line System of Salt Processing Program (U)

International Nuclear Information System (INIS)

CHANG, ROBERT

2006-01-01

All of the waste streams from ARP, MCU, and SWPF processes will be sent to DWPF for vitrification. The impact these new waste streams will have on DWPF's ability to meet its canister production goal and its ability to support the Salt Processing Program (ARP, MCU, and SWPF) throughput needed to be evaluated. DWPF Engineering and Operations requested OBU Systems Engineering to evaluate DWPF operations and determine how the process could be optimized. The ultimate goal will be to evaluate all of the Liquid Radioactive Waste (LRW) System by developing process modules to cover all facilities/projects which are relevant to the LRW Program and to link the modules together to: (1) study the interfaces issues, (2) identify bottlenecks, and (3) determine the most cost effective way to eliminate them. The results from the evaluation can be used to assist DWPF in identifying improvement opportunities, to assist CBU in LRW strategic planning/tank space management, and to determine the project completion date for the Salt Processing Program

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Clinical evaluation of automated processing of electrocardiograms by the Veterans Administration program (AVA 3.4).

Science.gov (United States)

Brohet, C R; Richman, H G

1979-06-01

Automated processing of electrocardiograms by the Veterans Administration program was evaluated for both agreement with physician interpretation and interpretative accuracy as assessed with nonelectrocardiographic criteria. One thousand unselected electrocardiograms were analyzed by two reviewer groups, one familiar and the other unfamiliar with the computer program. A significant number of measurement errors involving repolarization changes and left axis deviation occurred; however, interpretative disagreements related to statistical decision were largely language-related. Use of a printout with a more traditional format resulted in agreement with physician interpretation by both reviewer groups in more than 80 percent of cases. Overall sensitivity based on agreement with nonelectrocardiographic criteria was significantly greater with use of the computer program than with use of the conventional criteria utilized by the reviewers. This difference was particularly evident in the subgroup analysis of myocardial infarction and left ventricular hypertrophy. The degree of overdiagnosis of left ventricular hypertrophy and posteroinferior infarction was initially unacceptable, but this difficulty was corrected by adjustment of probabilities. Clinical acceptability of the Veterans Administration program appears to require greater physician education than that needed for other computer programs of electrocardiographic analysis; the flexibility of interpretation by statistical decision offers the potential for better diagnostic accuracy.

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

The management of evaluating the European programs and policies implemented in Romania

Directory of Open Access Journals (Sweden)

Doctoral student ROMAN MIHAELA

2011-12-01

Full Text Available Starting with the reform and modernization of the public administration in Romania in the mid 1990s, an important element of this process being the development of the management process, respectively of planning and managing public policies, the Romanian government started also a process of developing the capacity for evaluating public programs and policies, both the ones with European or foreign financing and the ones with domestic financing. Up-to-date analyses and studies have showed, however, that at the level of the national public sector there is a major discrepancy between the progress made in the evaluation of European programs or the ones with foreign financing and the programs financed from public funds, namely that there is a consolidated evaluation practice as regards the first types of programs, which is virtually inexistent as regards programs financed from the public budget.This paper intends to identify the progress made at the level of the Romanian public administration as regards the management of evaluating programs with European financing, to see the characteristics of building the evaluation capacity within the national system of these programs and the motivation stimulating such approaches. The first part of this paper shall contain a presentation of the background of the current evaluation system, including both the legislative framework and the institutional framework with duties of management and evaluation of European programs; further, I shall analyze the evolution of this system in order to be able to draw conclusions regarding the evaluation capacity of Romania.

Effects of a Community-Based, Post-Rehabilitation Exercise Program in COPD: Protocol for a Randomized Controlled Trial With Embedded Process Evaluation.

Science.gov (United States)

Desveaux, Laura; Beauchamp, Marla K; Lee, Annemarie; Ivers, Noah; Goldstein, Roger; Brooks, Dina

2016-05-11

This manuscript (1) outlines the intervention, (2) describes how its effectiveness is being evaluated in a pragmatic randomized controlled trial, and (3) summarizes the embedded process evaluation aiming to understand key barriers and facilitators for implementation in new environments. Participating centers refer eligible individuals with COPD following discharge from their local PR program. Consenting patients are assigned to a year-long community exercise program or usual care using block randomization and stratifying for supplemental oxygen use. Patients in the intervention arm are asked to attend an exercise session at least twice per week at their local community facility where their progress is supervised by a case manager. Each exercise session includes a component of aerobic exercise, and activities designed to optimize balance, flexibility, and strength. All study participants will have access to routine follow-up appointments with their respiratory physician, and additional health care providers as part of their usual care. Assessments will be completed at baseline (post-PR), 6, and 12 months, and include measures of functional exercise capacity, quality of life, self-efficacy, and health care usage. Intervention effectiveness will be assessed by comparing functional exercise capacity between intervention and control groups. A mixed-methods process evaluation will be conducted to better understand intervention implementation, guided by Normalization Process Theory and the Consolidated Framework for Implementation Research. Based on results from our pilot work, we anticipate a maintenance of exercise capacity and improved health-related quality of life in the intervention group, compared with a decline in exercise capacity in the usual care group. Findings from this study will improve our understanding of the effectiveness of community-based exercise programs for maintaining benefits following PR in patients with COPD and provide information on how best

Objective Evaluation in an Online Geographic Information System Certificate Program

OpenAIRE

Scott L. WALKER

2005-01-01

Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program....

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

Science.gov (United States)

Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

2014-06-01

Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

Science.gov (United States)

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

H Scan/AHP advanced technology proposal evaluation process

Energy Technology Data Exchange (ETDEWEB)

Mack, S. [Energetics, Inc., Columbia, MD (United States); Valladares, M.R.S. de [National Renewable Energy Lab., Washington, DC (United States)

1996-10-01

It is anticipated that a family of high value/impact projects will be funded by the Hydrogen Program to field test hydrogen technologies that are at advanced stages of development. These projects will add substantial value to the Program in several ways, by: demonstrating successful integration of multiple advanced technologies, providing critical insight on issues of larger scale equipment design, construction and operations management, yielding cost and performance data for competitive analysis, refining and deploying enhanced safety measures. These projects will be selected through a competitive proposal evaluation process. Because of the significant scope and funding levels of projects at these development phases, Program management has indicated the need for an augmented proposal evaluation strategy to ensure that supported projects are implemented by capable investigative teams and that their successful completion will optimally advance programmatic objectives. These objectives comprise a complex set of both quantitative and qualitative factors, many of which can only be estimated using expert judgment and opinion. To meet the above need, the National Renewable Energy Laboratory (NREL) and Energetics Inc. have jointly developed a proposal evaluation methodology called H Scan/AHP. The H Scan component of the process was developed by NREL. It is a two-part survey instrument that substantially augments the type and scope of information collected in a traditional proposal package. The AHP (Analytic Hierarchy Process) component was developed by Energetics. The AHP is an established decision support methodology that allows the Program decision makers to evaluate proposals relatively based on a unique set of weighted criteria that they have determined.

An evolving approach to delirium: A mixed-methods process evaluation of a hospital-wide delirium program in New Zealand.

Science.gov (United States)

Alhaidari, Abdullah Ao; Allen-Narker, Rosalind Ac

2017-06-01

A process evaluation was carried out to assess and potentially improve the design and implementation of a hospital-wide delirium program. A mixed-methods sequential-explanatory design was used; retrospective chart reviews for 100 older (75+) medical inpatients were conducted to measure nurses', doctors' and coders' adherence to key program processes following which interviews were conducted to identify potential barriers to implementation. Delirium occurred in 49% of patients. Chart reviews revealed suboptimal adherence to the delirium risk assessment (66%), the Short Confusion Assessment Method (50% on admission, 58% during admission), documentation of delirium in clinical records (80%) and discharge letters (38%) and coding for delirium (49%). The major barriers to implementation identified were failure to recruit non-nursing staff, unclear goals and instructions, difficulties using the Short-CAM, time constraints with competing priorities and lack of outcome expectancy. A new delirium program was needed based on these findings. © 2017 AJA Inc.

Evaluation procedure for radioactive waste treatment processes

International Nuclear Information System (INIS)

Whitty, W.J.

1979-11-01

An aspect of the Los Alamos Scientific Laboratory's nuclear waste management R and D programs has been to develop an evaluation procedure for radioactive waste treatment processes. This report describes the process evaluation method. Process worth is expressed as a numerical index called the Figure-of-Merit (FOM), which is computed using a hierarchial, linear, additive, scoring model with constant criteria weights and nonlinear value functions. A numerical example is used to demonstrate the procedure and to point out some of its strengths and weaknesses. Potential modifications and extensions are discussed, and an extensive reference list is included

Process evaluation of the human reliability data bank

International Nuclear Information System (INIS)

Miller, D.P.; Comer, K.

1985-01-01

The US Nuclear Regulatory Commission and Sandia National Laboratories have been developing a plan for a human reliability data bank since August 1981. This research is in response to the data need of the nuclear power industry's probabilistic risk assessment community. The three phases of the program are to: (a) develop the data bank concept, (b) develop an implementation plan and conduct a process evaluation, and (c) assist a sponsor in implementing the data bank. The program is now in Phase B. This paper describes the methods used and the results of the process evaluation. Decisions to be made in the future regarding full-scale implementation will be based, in part, on the outcome of this study

Process evaluation of the human reliability data bank

International Nuclear Information System (INIS)

Miller, D.P.; Comer, K.

1984-01-01

The US Nuclear Regulatory Commission and Sandia National Laboratories have been developing a plan for a human reliability data bank since August 1981. This research is in response to the data needs of the nuclear power industry's probabilistic risk assessment community. The three phases of the program are to: (A) develop the data bank concept, (B) develop an implementation plan and conduct a process evaluation, and (C) assist a sponsor in implementing the data bank. The program is now in Phase B. This paper describes the methods used and the results of the process evaluation. Decisions to be made in the future regarding full-scale implementation will be based in part on the outcome of this study

Process evaluation of the Living Green, Healthy and Thrifty (LiGHT) web-based child obesity management program: combining health promotion with ecology and economy.

Science.gov (United States)

Jogova, Maria; Song, Joshua Eun-Soo; Campbell, Audrey Clare; Warbuton, Darren; Warshawski, Tom; Chanoine, Jean-Pierre

2013-04-01

To conduct a process evaluation of the Living Green, Healthy and Thrifty (LiGHT) program, a novel virtual child obesity management program that combines health promotion with ecology and economy (Phase 1). We carried out a mixed methods process evaluation involving qualitative and quantitative data collection in 3 phases: among 3 child-parent units, (group 1) that informed program development; 9 child-parent units (group 2) that tested the draft program and further aided program refinement; and 17 child-parent units (group 3) for a 4-week pilot of the program. In the program pilot, we assessed participants' knowledge and readiness to change pre- and postintervention and explored perceptions of the program. Participants generally felt that the online format for program delivery was convenient and accessible, the content was practical, and the integration of health-environment-economy was well received. Many parents also appreciated the involvement of the family. However, the lack of visual appeal and overabundance of text was identified as a challenge, and children/youth in particular requested assurance that their personal information (e.g. weight) was not seen by their parents. The online method of program delivery holds the unique challenge of requiring special efforts to create a sense of personal connection and community. The presence of a "Way-finder" to assist participants and discussion boards/forums are potential solutions. The LiGHT online weight management program offers an accessible, convenient weight management resource that children and families appreciate for its availability, broader educational scope, and practicality. Outcome evaluation of LiGHT will be carried out in Phase 2 of the project. Copyright © 2013 Canadian Diabetes Association. Published by Elsevier Inc. All rights reserved.

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Evidence of the Adoption and Implementation of a Statewide Childhood Obesity Prevention Initiative in the New York State WIC Program: The "NY Fit WIC" Process Evaluation

Science.gov (United States)

Sekhobo, Jackson P.; Egglefield, Katherine; Edmunds, Lynn S.; Shackman, Gene

2012-01-01

Process evaluations are critical in determining whether outcome evaluations are warranted. This study assessed the extent to which a childhood obesity prevention initiative, "NY Fit WIC", was adopted and implemented by the New York State Supplemental Nutrition Program for Women, Infants and Children (WIC). Process data came from…

National Security Technology Incubator Evaluation Process

Energy Technology Data Exchange (ETDEWEB)

None, None

2007-12-31

This report describes the process by which the National Security Technology Incubator (NSTI) will be evaluated. The technology incubator is being developed as part of the National Security Preparedness Project (NSPP), funded by a Department of Energy (DOE)/National Nuclear Security Administration (NNSA) grant. This report includes a brief description of the components, steps, and measures of the proposed evaluation process. The purpose of the NSPP is to promote national security technologies through business incubation, technology demonstration and validation, and workforce development. The NSTI will focus on serving businesses with national security technology applications by nurturing them through critical stages of early development. An effective evaluation process of the NSTI is an important step as it can provide qualitative and quantitative information on incubator performance over a given period. The vision of the NSTI is to be a successful incubator of technologies and private enterprise that assist the NNSA in meeting new challenges in national safety and security. The mission of the NSTI is to identify, incubate, and accelerate technologies with national security applications at various stages of development by providing hands-on mentoring and business assistance to small businesses and emerging or growing companies. To achieve success for both incubator businesses and the NSTI program, an evaluation process is essential to effectively measure results and implement corrective processes in the incubation design if needed. The evaluation process design will collect and analyze qualitative and quantitative data through performance evaluation system.

Summary of the planning, management, and evaluation process for the Geothermal Program Review VI conference

Energy Technology Data Exchange (ETDEWEB)

1988-10-01

The purpose of this document is to present an overview of the planning, facilitation, and evaluation process used to conduct the Geothermal Program Review VI (PR VI) conference. This document was also prepared to highlight lessons learned from PR VI and, by utilizing the evaluation summaries and recommendations, be used as a planning tool for PR VII. The conference, entitled Beyond Goals and Objectives,'' was sponsored by the US Department of Energy's (DOE) Geothermal Technology Division (GTD), PR VI was held in San Francisco, California on April 19--21, 1988 and was attended by 127 participants. PR VI was held in conjunction with the National Geothermal Association's (NGA) Industry Round Table. This document presents a brief summary of the activities, responsibilities, and resources for implementing the PR VI meeting and provides recommendations, checklists, and a proposed schedule for assisting in planning PR VII.

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

Directory of Open Access Journals (Sweden)

Burgers Jako S

2007-11-01

Full Text Available Abstract Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes

Evaluation of a case-based urology learning program.

Science.gov (United States)

Mishra, Kirtishri; Snow-Lisy, Devon C; Ross, Jonathan; Goldfarb, David A; Goldman, Howard; Campbell, Steven C

2013-12-01

To address the challenges that today's trainees encounter, such as information overload and reduced immersion in the field, and recognizing their preference for novel educational resources, an electronic case-based urology learning program was developed. Each case was designed to illustrate the basic principles of the disease process and the fundamentals of evaluation and management using the Socratic method, recapitulating a prototypical patient encounter. A 21-question survey was developed after review of published reports of classroom and clinical learning environment surveys. The target group was 2 pilot urology training programs (the Cleveland Clinic and University Hospitals-Case Medical Center). The responses were entirely anonymous. A total of 32 trainees participated (8 fellows and 24 residents), representing a 53% response rate. Most trainees (79%) were able to process cases within an average of ≤ 10 minutes. Of the trainees, 91% reported referring back to particular cases for patient care, to review for examinations, or for studying. Most trainees believed a case-based urology learning program would be a potentially important resource for clinical practice (69%) and for preparing for the in-service (63%) or board (69%) examinations. Most trainees believed the program met its goals of illustrating the basics principles of the disease process (88%), outlining the fundamentals of evaluation and management (94%), and improving the trainees' knowledge base (91%). An electronic case-based urology learning program is feasible and useful and stimulates learning at all trainee levels. Copyright © 2013 Elsevier Inc. All rights reserved.

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

The Role of Evaluation in the School Improvement Process

Science.gov (United States)

Lindahl, Ronald A.; Beach, Robert H.

2013-01-01

Although evaluation serves many purposes in education, there is virtually unanimous agreement that evaluation is a critical component of all school improvement processes. Hamilton et al. (2003) asserted that "assessment and evaluation should be built into reform programs from the outset" (p. 26). Kimball, Lander, and Thorn (2010)…

[The intervention mapping protocol: A structured process to develop, implement and evaluate health promotion programs].

Science.gov (United States)

Fassier, J-B; Lamort-Bouché, M; Sarnin, P; Durif-Bruckert, C; Péron, J; Letrilliart, L; Durand, M-J

2016-02-01

Health promotion programs are expected to improve population health and reduce social inequalities in health. However, their theoretical foundations are frequently ill-defined, and their implementation faces many obstacles. The aim of this article is to describe the intervention mapping protocol in health promotion programs planning, used recently in several countries. The challenges of planning health promotion programs are presented, and the six steps of the intervention mapping protocol are described with an example. Based on a literature review, the use of this protocol, its requirements and potential limitations are discussed. The intervention mapping protocol has four essential characteristics: an ecological perspective (person-environment), a participative approach, the use of theoretical models in human and social sciences and the use of scientific evidence. It comprises six steps: conduct a health needs assessment, define change objectives, select theory-based change techniques and practical applications, organize techniques and applications into an intervention program (logic model), plan for program adoption, implementation, and sustainability, and generate an evaluation plan. This protocol was used in different countries and domains such as obesity, tobacco, physical activity, cancer and occupational health. Although its utilization requires resources and a critical stance, this protocol was used to develop interventions which efficacy was demonstrated. The intervention mapping protocol is an integrated process that fits the scientific and practical challenges of health promotion. It could be tested in France as it was used in other countries, in particular to reduce social inequalities in health. Copyright © 2016. Published by Elsevier Masson SAS.

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Process control program development

International Nuclear Information System (INIS)

Dameron, H.J.

1985-01-01

This paper details the development and implementation of a ''Process Control Program'' at Duke Power's three nuclear stations - Oconee, McGuire, and Catawba. Each station is required by Technical Specification to have a ''Process Control Program'' (PCP) to control all dewatering and/or solidification activities for radioactive wastes

Super-Efficient Refrigerator Program (SERP) evaluation volume 2: Preliminary impact and market transformation assessment

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-08-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. It is one of the first examples of a large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the preliminary impact and market transformation evaluation of SERP ({open_quotes}the Program{close_quotes}). Pacific Northwest National Laboratory (PNNL) conducted this evaluation for the U.S. Department of Energy. This study focuses on the preliminary impact evaluation and market transformation assessment, but also presents limited process evaluation information. It is based on interviews with refrigerator dealers and manufacturers, interviews with utility participants, industry data, and information from the Program administrators. Results from this study complement those from prior process evaluation also conducted by PNNL. 42 refs., 5 figs., 4 tabs.

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Learning Under the Tree : Evaluating Skillful Parenting Program in West Kenya ICS Full Evaluation Report

NARCIS (Netherlands)

van Esch, R.P.|info:eu-repo/dai/nl/371571502; de Haan, M.J.|info:eu-repo/dai/nl/074405624

2016-01-01

Summary The central purpose of this evaluation is to determine if and how the Skillful Parenting Program (SPP) effects the parenting of its participants. In addition, it aims to determine how the parenting program was adapted to the West Kenyan setting, and how the specific content and processes of

Development of a program logic model and evaluation plan for a participatory ergonomics intervention in construction.

Science.gov (United States)

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2014-03-01

Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. © 2013 Wiley Periodicals, Inc.

Development of a Program Logic Model and Evaluation Plan for a Participatory Ergonomics Intervention in Construction

Science.gov (United States)

Jaegers, Lisa; Dale, Ann Marie; Weaver, Nancy; Buchholz, Bryan; Welch, Laura; Evanoff, Bradley

2013-01-01

Background Intervention studies in participatory ergonomics (PE) are often difficult to interpret due to limited descriptions of program planning and evaluation. Methods In an ongoing PE program with floor layers, we developed a logic model to describe our program plan, and process and summative evaluations designed to describe the efficacy of the program. Results The logic model was a useful tool for describing the program elements and subsequent modifications. The process evaluation measured how well the program was delivered as intended, and revealed the need for program modifications. The summative evaluation provided early measures of the efficacy of the program as delivered. Conclusions Inadequate information on program delivery may lead to erroneous conclusions about intervention efficacy due to Type III error. A logic model guided the delivery and evaluation of our intervention and provides useful information to aid interpretation of results. PMID:24006097

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

Science.gov (United States)

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

An Evaluation System for the Online Training Programs in Meteorology and Hydrology

Science.gov (United States)

Wang, Yong; Zhi, Xiefei

2009-01-01

This paper studies the current evaluation system for the online training program in meteorology and hydrology. CIPP model that includes context evaluation, input evaluation, process evaluation and product evaluation differs from Kirkpatrick model including reactions evaluation, learning evaluation, transfer evaluation and results evaluation in…

Clean Technology Evaluation & Workforce Development Program

Energy Technology Data Exchange (ETDEWEB)

Patricia Glaza

2012-12-01

The overall objective of the Clean Technology Evaluation portion of the award was to design a process to speed up the identification of new clean energy technologies and match organizations to testing and early adoption partners. The project was successful in identifying new technologies targeted to utilities and utility technology integrators, in developing a process to review and rank the new technologies, and in facilitating new partnerships for technology testing and adoption. The purpose of the Workforce Development portion of the award was to create an education outreach program for middle & high-school students focused on clean technology science and engineering. While originally targeting San Diego, California and Cambridge, Massachusetts, the scope of the program was expanded to include a major clean technology speaking series and expo as part of the USA Science & Engineering Festival on the National Mall in Washington, D.C.

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

Science.gov (United States)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

Situated Research Design and Methodological Choices in Formative Program Evaluation

Science.gov (United States)

Supovitz, Jonathan

2013-01-01

Design-based implementation research offers the opportunity to rethink the relationships between intervention, research, and situation to better attune research and evaluation to the program development process. Using a heuristic called the intervention development curve, I describe the rough trajectory that programs typically follow as they…

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. (eds.); Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

Curriculum Evaluation and Employers Opinions: the case study of Educational Technology Program in Bachelor Degree (Continuing Program

Directory of Open Access Journals (Sweden)

Nakhon Lalognam

2016-09-01

Full Text Available The purposes of this research were: 1 to evaluate the Educational Technology Program (Continuing Program in Bachelor Degree curriculum which is revised in 2007 by applying CIPP model for evaluation. 2 to study the opinions of the employers about the ideal characteristics and actual characteristics of graduates. 3 to study the opinions for the requirements of the Educational Technology Program in Bachelor Degree (Continuing Program and knowledge implementation in work of graduates. 4 to make the suggestions and guidelines to improve the Educational Technology Program in Bachelor Degree (Continuing Program to achieve potentiality and responsive for the requirements of learners and employers. The sample of this research were 310 persons ; consisted of graduates in the Educational Technology Program in Bachelor Degree (Continuing Program in academic year 2006 - 2010, the committee of the Educational Technology Program in Bachelor Degree (Continuing Program , instructors and employers by using Multi-stage Random Sampling and Simple Random Sampling. The instruments of this research were the 5 levels rating scale questionnaire and the structured interview type. They consisted of 3 sets: 1 for graduates, 2 for the committee of the Educational Technology Program in Bachelor Degree (Continuing Program and 3 for instructors and employers. The research found that: 1. The results of evaluation on the Educational Technology Program in Bachelor Degree (Continuing Program which is revised in 2007 were: 1.1 The opinions of graduates to curriculum in all of aspects were average at the uncertain level which the context aspect was at the high level, input aspect was at the uncertain level, process aspect was at the uncertain level and product aspect was at the high level. 1.2 The opinions of the curriculum committee and instructors to curriculum in all of aspects were average at the high level which the context aspect was at the high level, input aspect was at the

Processing of evaluated neutron data files in ENDF format on personal computers

International Nuclear Information System (INIS)

Vertes, P.

1991-11-01

A computer code package - FDMXPC - has been developed for processing evaluated data files in ENDF format. The earlier version of this package is supplemented with modules performing calculations using Reich-Moore and Adler-Adler resonance parameters. The processing of evaluated neutron data files by personal computers requires special programming considerations outlined in this report. The scope of the FDMXPC program system is demonstrated by means of numerical examples. (author). 5 refs, 4 figs, 4 tabs

Evolution of a multilevel framework for health program evaluation.

Science.gov (United States)

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Potential Benefits and Downsides of External Healthcare Performance Evaluation Systems: Real-Life Perspectives on Iranian Hospital Evaluation and Accreditation Program

Directory of Open Access Journals (Sweden)

Ebrahim Jaafaripooyan

2014-09-01

Full Text Available Background Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. Methods A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs and professionals were approached for two-stage process of data collection. Results Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs’ over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Conclusion Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Semi-Automated Processing of Trajectory Simulator Output Files for Model Evaluation

Science.gov (United States)

2018-01-01

ARL-TR-8284 ● JAN 2018 US Army Research Laboratory Semi-Automated Processing of Trajectory Simulator Output Files for Model...Semi-Automated Processing of Trajectory Simulator Output Files for Model Evaluation 5a. CONTRACT NUMBER 5b. GRANT NUMBER 5c. PROGRAM ELEMENT...although some minor changes may be needed. The program processes a GTRAJ output text file that contains results from 2 or more simulations , where each

Using RUFDATA to guide a logic model for a quality assurance process in an undergraduate university program.

Science.gov (United States)

Sherman, Paul David

2016-04-01

This article presents a framework to identify key mechanisms for developing a logic model blueprint that can be used for an impending comprehensive evaluation of an undergraduate degree program in a Canadian university. The evaluation is a requirement of a comprehensive quality assurance process mandated by the university. A modified RUFDATA (Saunders, 2000) evaluation model is applied as an initiating framework to assist in decision making to provide a guide for conceptualizing a logic model for the quality assurance process. This article will show how an educational evaluation is strengthened by employing a RUFDATA reflective process in exploring key elements of the evaluation process, and then translating this information into a logic model format that could serve to offer a more focussed pathway for the quality assurance activities. Using preliminary program evaluation data from two key stakeholders of the undergraduate program as well as an audit of the curriculum's course syllabi, a case is made for, (1) the importance of inclusivity of key stakeholders participation in the design of the evaluation process to enrich the authenticity and accuracy of program participants' feedback, and (2) the diversification of data collection methods to ensure that stakeholders' narrative feedback is given ample exposure. It is suggested that the modified RUFDATA/logic model framework be applied to all academic programs at the university undergoing the quality assurance process at the same time so that economies of scale may be realized. Copyright © 2015 Elsevier Ltd. All rights reserved.

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Health Care Merged With Senior Housing: Description and Evaluation of a Successful Program

Directory of Open Access Journals (Sweden)

Theresa “Teta” Barry PhD

2017-06-01

Full Text Available Objective: This article describes and evaluates a successful partnership between a large health care organization and housing for seniors. The program provides on-site, primary care visits by a physician and a nurse in addition to intensive social services to residents in an affordable senior housing apartment building located in Pennsylvania. Per Donabedian’s “Structure–Process–Outcome” model, the program demonstrated positive health care outcomes for its participants via a prescribed structure. To provide guidance for replication in similar settings, we qualitatively evaluated the processes by which successful outcomes were obtained. Methods: With program structures in place and outcomes measured, this case study collected and analyzed qualitative information taken from key informant interviews on care processes involved in the program. Themes were extracted from semistructured interviews and used to describe the processes that helped and hindered the program. Results and Discussion: Common processes were identified across respondents; however, the nuanced processes that lead to successful outcomes suggest that defined structures and processes may not be sufficient to produce similar outcomes in other settings. Further research is needed to determine the program’s replicability and policy implications.

Development program for the high-temperature nuclear process heat system

International Nuclear Information System (INIS)

Jiacoletti, R.J.

1975-09-01

A comprehensive development program plan for a high-temperature nuclear process heat system with a very high temperature gas-cooled reactor heat source is presented. The system would provide an interim substitute for fossil-fired sources and ultimately the vehicle for the production of substitute and synthetic fuels to replace petroleum and natural gas. The dwindling domestic reserves of petroleum and natural gas dictate major increases in the utilization of coal and nuclear sources to meet the national energy demand. The nuclear process heat system has significant potential in a unique combination of the two sources that is environmentally and economically attractive and technically sound: the production of synthetic fuels from coal. In the longer term, it could be the key component in hydrogen production from water processes that offer a substitute fuel and chemical feedstock free of dependence on fossil-fuel reserves. The proposed development program is threefold: a process studies program, a demonstration plant program, and a supportive research and development program. Optional development scenarios are presented and evaluated, and a selection is proposed and qualified. The interdependence of the three major program elements is examined, but particular emphasis is placed on the supportive research and development activities. A detailed description of proposed activities in the supportive research and development program with tentative costs and schedules is presented as an appendix with an assessment of current status and planning

Implemented or not implemented? Process evaluation of the school-based obesity prevention program DOiT and associations with program effectiveness

NARCIS (Netherlands)

van Nassau, F.; Singh, A.S.; Hoekstra, T.; van Mechelen, W.; Brug, J.; Chinapaw, M.J.M.

This study investigates if and to what extent the Dutch Obesity Intervention in Teenagers (DOiT) program was implemented as intended and how this affected program effectiveness. We collected data at 20 prevocational education schools in the Netherlands. We assessed seven process indicators:

Implemented or not implemented? : Process evaluation of the school-based obesity prevention program DOiT and associations with program effectiveness

NARCIS (Netherlands)

van Nassau, Femke; Singh, Amika S; Hoekstra, T.; van Mechelen, Willem; Brug, Johannes; Chinapaw, Mai J M

This study investigates if and to what extent the Dutch Obesity Intervention in Teenagers (DOiT) program was implemented as intended and how this affected program effectiveness. We collected data at 20 prevocational education schools in the Netherlands. We assessed seven process indicators:

Interim reliability evaluation program, Browns Ferry fault trees

International Nuclear Information System (INIS)

Stewart, M.E.

1981-01-01

An abbreviated fault tree method is used to evaluate and model Browns Ferry systems in the Interim Reliability Evaluation programs, simplifying the recording and displaying of events, yet maintaining the system of identifying faults. The level of investigation is not changed. The analytical thought process inherent in the conventional method is not compromised. But the abbreviated method takes less time, and the fault modes are much more visible

Special Education Program Evaluation: A Planning Guide. An Overview. CASE Commissioned Series.

Science.gov (United States)

McLaughlin, John A.

This resource guide is intended to help in planning special education program evaluations. It focuses on: basic evaluation concepts, identification of special education decision makers and their information needs, specific evaluation questions, procedures for gathering relevant information, and evaluation of the evaluation process itself.…

Process evaluation of a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus.

Science.gov (United States)

Odgers-Jewell, Kate; Isenring, Elisabeth; Thomas, Rae; Reidlinger, Dianne P

2017-07-01

The present study developed and evaluated a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus. Two frameworks, the Medical Research Council (MRC) framework for developing and evaluating complex interventions and the RE-AIM framework were followed. Data to develop the intervention were sourced from scoping of the literature and formative evaluation. Program evaluation comprised analysis of primary recruitment of participants through general practitioners, baseline and end-point measures of anthropometry, four validated questionnaires, contemporaneous facilitator notes and telephone interviews with participants. A total of 16 participants enrolled in the intervention. Post-intervention results were obtained from 13 participants, with an estimated mean change from baseline in weight of -0.72 kg (95%CI -1.44 to -0.01), body mass index of -0.25 kg/m 2 (95%CI -0.49 to -0.01) and waist circumference of -1.04 cm (95%CI -4.52 to 2.44). The group education program was acceptable to participants. The results suggest that recruitment through general practitioners is ineffective, and alternative recruitment strategies are required. This patient-centred, patient-directed, group-based intervention for the management of type 2 diabetes mellitus was both feasible and acceptable to patients. Health professionals should consider the combined use of the MRC and RE-AIM frameworks in the development of interventions to ensure a rigorous design process and to enable the evaluation of all phases of the intervention, which will facilitate translation to other settings. Further research with a larger sample trialling additional recruitment strategies, evaluating further measures of effectiveness and utilising lengthier follow-up periods is required. © 2016 Dietitians Association of Australia.

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

Advanced gas cooled nuclear reactor materials evaluation and development program

International Nuclear Information System (INIS)

1977-01-01

Results of work performed from January 1, 1977 through March 31, 1977 on the Advanced Gas Cooled Nuclear Reactor Materials Evaluation and Development Program are presented. The objectives of this program are to evaluate candidate alloys for Very High Temperature Reactor (VHTR) Process Heat and Direct Cycle Helium Turbine (DCHT) applications, in terms of the effect of simulated reactor primary coolant (impure Helium), high temperatures, and long time exposures, on the mechanical properties and structural and surface stability of selected candidate alloys. A second objective is to select and recommend materials for future test facilities and more extensive qualification programs. Work covered in this report includes progress to date on alloy selection for VHTR Nuclear Process Heat (NPH) applications and for DCHT applications. The present status on the simulated reactor helium loop design and on designs for the testing and analysis facilities and equipment is discussed

Sustainability of donor programs: evaluating and informing the transition of a large HIV prevention program in India to local ownership

Directory of Open Access Journals (Sweden)

Sara Bennett

2011-12-01

Full Text Available Sustainability is the holy grail of many development projects, yet there is limited evidence about strategies that effectively support transition of programs from donor funding to national governments. The first phase of Avahan, the India AIDS Initiative supported by the Bill and Melinda Gates Foundation (2003–2009, aimed to demonstrate an HIV/AIDS prevention program at scale, primarily targeted at high-risk groups. During the second phase (2009–2013, this large-scale program will be transitioned to its natural owners: the Government of India and local communities. This paper describes the evaluation design for the Avahan transition strategy.A detailed logic model for the transition was developed. The Avahan transition strategy focuses on three activities: 1 enhancing capacities among communities, non-governmental organizations (NGOs, and government entities, in line with India's national AIDS control strategy; 2 aligning technical and managerial aspects of Avahan programs with government norms and standards; and 3 promoting and sustaining commitment to services for most-at-risk populations. It is anticipated that programs will then transfer smoothly to government and community ownership, become institutionalized within the government system, and support a sustained HIV/AIDS response.The research design evaluates the implementation and effectiveness of 1 activities undertaken by the program; 2 intermediate effects including the process of institutionalization and the extent to which key Avahan organizational procedures and behaviors are integrated into government systems; and 3 overarching effects namely the impact of the transition process on the sustained delivery of HIV/AIDS prevention services to high-risk groups. Both qualitative and quantitative research approaches are employed so that the evaluation will both assess outcomes and explain why they have occurred.It is unusual for donor-supported projects in low- and middle

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Research, Monitoring, and Evaluation for the Federal Columbia River Estuary Program

Energy Technology Data Exchange (ETDEWEB)

Johnson, Gary E.; Diefenderfer, Heida L.; Ebberts, Blaine D.; Tortorici, Cathy; Yerxa, Tracey; Leary, J.; Skalski, John R.

2008-02-05

The purpose ofthis document is to describe research, monitoring, and evaluation (RME) for the Federal Columbia River Estuary Program. The intent of this RME effort is to provide data and information to evaluate progress toward meeting program goals and objectives and support decision-making in the Estuary Program. The goal of the Estuary Program is to understand, conserve, and restore the estuary ecosystem to improve the performance of listed salmonid populations. The Estuary Program has five general objectives, designed to fulfill the program goal, as follows. 1. Understand the primary stressors affecting ecosystem controlling factors, such as ocean conditions and invasive species. 2. Conserve and restore factors controlling ecosystem structures and processes, such as hydrodynamics and water quality. 3. Increase the quantity and quality of ecosystem structures, i.e., habitats, juvenile salmonids use during migration through the estuary. 4. Maintain the food web to benefit salmonid performance. 5. Improve salmonid performance in terms of life history diversity, foraging success, growth, and survival. The goal of estuary RME is to provide pertinent and timely research and monitoring information to planners, implementers, and managers of the Estuary Program. In conclusion, the estuary RME effort is designed to meet the research and monitoring needs of the estuary Program using an adaptive management process. Estuary RME's success and usefulness will depend on the actual conduct of adaptive management, as embodied in the objectives, implrementation, data, reporting, and synthesis, evaluation, and decision-making described herein.

STREAM: A First Programming Process

DEFF Research Database (Denmark)

Caspersen, Michael Edelgaard; Kölling, Michael

2009-01-01

to derive a programming process, STREAM, designed specifically for novices. STREAM is a carefully down-scaled version of a full and rich agile software engineering process particularly suited for novices learning object-oriented programming. In using it we hope to achieve two things: to help novice......Programming is recognized as one of seven grand challenges in computing education. Decades of research have shown that the major problems novices experience are composition-based—they may know what the individual programming language constructs are, but they do not know how to put them together....... Despite this fact, textbooks, educational practice, and programming education research hardly address the issue of teaching the skills needed for systematic development of programs. We provide a conceptual framework for incremental program development, called Stepwise Improvement, which unifies best...

Towards Bridging the Gap Programming Language and Partial Evaluation

DEFF Research Database (Denmark)

Le Meur, Anne-Francoise; Lawall, Julia Laetitia; Consel, Charles

2002-01-01

Partial evaluation is a program-transformation technique that automatically specializes a program with respect to user-supplied invariants. Despite successful applications in areas such as graphics, operating systems, and software engineering, partial evaluators have yet to achieve widespread use....... One reason is the difficulty of adequately describing specialization opportunities. Indeed, under-specialization or over-specialization often occurs, without any direct feedback to the user as to the source of the problem.We have developed a high-level, module-based language allowing the programmer...... to guide the choice of both the code to specialize and the invariants to exploit during the specialization process. To ease the use of partial evaluation, the syntax of this language is similar to the declaration syntax of the target language of the partial evaluator. To provide feedback to the programmer...

Objective Evaluation in an Online Geographic Information System Certificate Program

Directory of Open Access Journals (Sweden)

Scott L. WALKER

2005-01-01

Full Text Available Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program. The evaluation utilized several methods that strived to inject objectivity in evaluation and subsequent decision-making. A rapid multi-modal approach included evaluation methods of (1 considering the online psychosocial learning environment, (2 content analyses comparing the online version of classes to face-to-face versions, (3 cost comparisons in online vs. face-to-face classes, (4 student outcomes, (5 student retention, and (6 benchmarking. These approaches offer opportunities for departmental administrators and decision-making committees to make judgments informed by facts rather than being influenced by the emotions, beliefs, or opinions of organizational dynamics.

Evaluation of thermal network correction program using test temperature data

Science.gov (United States)

Ishimoto, T.; Fink, L. C.

1972-01-01

An evaluation process to determine the accuracy of a computer program for thermal network correction is discussed. The evaluation is required since factors such as inaccuracies of temperatures, insufficient number of temperature points over a specified time period, lack of one-to-one correlation between temperature sensor and nodal locations, and incomplete temperature measurements are not present in the computer-generated information. The mathematical models used in the evaluation are those that describe a physical system composed of both a conventional and a heat pipe platform. A description of the models used, the results of the evaluation of the thermal network correction, and input instructions for the thermal network correction program are presented.

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Preparing for terrorism: tools for evaluating the Metropolitan Medical Response System Program

National Research Council Canada - National Science Library

Manning, Frederick J; Goldfrank, Lewis R

2002-01-01

.... DHHS asked the Institute of Medicine (IOM) to assist in assessing the effectiveness of the MMRS program by developing appropriate evaluation methods, tools, and processes to assess both its own management of the program and local preparedness...

Evaluation of DOE's Partnership in Low-Income Residential Retrofit (PILIRR) Program

Energy Technology Data Exchange (ETDEWEB)

Callaway, J.W.; Lee, A.D.

1989-05-01

In July 1986, the US Department of Energy (DOE) awarded competitive grants to five states to conduct pilot projects to establish partnerships and use resource leveraging to stimulate support for low-income residential energy retrofits. The projects were conducted under DOE's Partnerships in Low-Income Residential Retrofit (PILIRR) Program. These projects have been monitored and analyzed through a concurrent process evaluation conducted by the Pacific Northwest Laboratory (PNL). This study reports the findings of that evaluation. The overriding goal of the PILIRR Program was to determine whether the states could stimulate support for low-income residential energy improvements from non-federal sources. The goal for the process evaluation was to conduct an assessment of the processes used by the states and the extent to which they successfully established partnerships and leveraged resources. Five states were selected to participate in the program: Florida, Iowa, Kentucky, Oklahoma and Washington. Each state proposed a different approach to promote non-federal support for low-income residential weatherization. Three of the five states--Florida, Iowa, and Washington--established partnerships that led to retrofits during the monitoring period (October 1986--October 1988). Kentucky established its partnership during the monitoring period, but did not accomplish its retrofits until after monitoring was complete. Oklahoma completed development of its marketing program and had begun marketing efforts by the end of the monitoring period. 16 refs., 7 figs., 1 tab.

Evaluating public involvement in the National Low-Level Radioactive Waste Management Program

International Nuclear Information System (INIS)

1982-09-01

The Department of Energy contracted with the Keystone Center to evaluate the effectiveness of the National Low-Level Radioactive Waste Management Program's public-involvement efforts. The Center chose six evaluators with diverse training and experience related to low-level waste management and public-participation programs. Keystone's evaluation was based on (a) observations by the evaluators who attended the National Program-sponsored strategy review meetings and fairs; (b) interviews with low-level waste generators, local government officials, state legislators, public-interest groups, and members of the general public; and (c) observations of the final National Program strategy task force meeting. The evaluators concluded that, overall, the public-participation processes yielded some very positive results - for policy development and for DOE and the EG and G staff. They judged the strategy document to be complete, concise, and helpful to public dialogue on low-level waste issues. They also made specific recommendations for improvements to the public-participation program

Evaluating Teen Pregnancy Prevention Programs: Decades of Evolving Strategies and Practices

Directory of Open Access Journals (Sweden)

Susan Philliber

2015-09-01

Full Text Available This paper reviews the changing strategies for both process and outcome evaluations of teen pregnancy prevention programs over the past few decades. Implementation evaluations have emphasized discovery of what program attributes are most effective in reducing teen pregnancy and its antecedents. Outcome evaluations have moved from collecting data to measure knowledge, attitudes, and program satisfaction to measuring behavior change including postponement of sexual involvement, increased used of contraception, or reduction in teen pregnancy. High quality randomized control trials or quasi-experimental designs are being increasingly emphasized, as are sophisticated analysis techniques using multi-variate analyses, controls for cluster sampling, and other strategies designed to build a more solid knowledge base about how to prevent early pregnancy.

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

A novice's process of object-oriented programming

DEFF Research Database (Denmark)

Caspersen, Michael Edelgaard; Kölling, Michael

2006-01-01

Exposing students to the process of programming is merely implied but not explicitly addressed in texts on programming which appear to deal with 'program' as a noun rather than as a verb.We present a set of principles and techniques as well as an informal but systematic process of decomposing...... a programming problem. Two examples are used to demonstrate the application of process and techniques.The process is a carefully down-scaled version of a full and rich software engineering process particularly suited for novices learning object-oriented programming. In using it, we hope to achieve two things...

Effectiveness and Evaluation of Crime Prevention Programs in Minas Gerais

Directory of Open Access Journals (Sweden)

Claudio Beato

2014-05-01

Full Text Available This essay analyzes previous studies evaluating the effectiveness of the crime prevention policies adopted by the Government of Minas Gerais (Brazil. In this work, greater emphasis is placed on studies evaluating outcomes than on studies dealing with the process of setting up and implementing programs and projects. In order to allow a more systematic discussion, the Maryland Scale, which categorizes research and evaluations according to the methodological strengths and weaknesses in five levels, is employed. Subsequently, the authors draw a parallel between Brazil and other settings. Finally, this essay lays out the implications of this discussion regarding the prevention programs. 

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Dig into Learning: A Program Evaluation of an Agricultural Literacy Innovation

Science.gov (United States)

Edwards, Erica Brown

2016-01-01

This study is a mixed-methods program evaluation of an agricultural literacy innovation in a local school district in rural eastern North Carolina. This evaluation describes the use of a theory-based framework, the Concerns-Based Adoption Model (CBAM), in accordance with Stufflebeam's Context, Input, Process, Product (CIPP) model by evaluating the…

Chemical-cleaning process evaluation: Westinghouse steam generators. Final report

International Nuclear Information System (INIS)

Cleary, W.F.; Gockley, G.B.

1983-04-01

The Steam Generator Owners Group (SGOG)/Electric Power Research Institute (EPRI) Steam Generator Secondary Side Chemical Cleaning Program, under develpment since 1978, has resulted in a generic process for the removal of accumulated corrosion products and tube deposits in the tube support plate crevices. The SGOG/EPRI Project S150-3 was established to obtain an evaluation of the generic process in regard to its applicability to Westinghouse steam generators. The results of the evaluation form the basis for recommendations for transferring the generic process to a plant specific application and identify chemical cleaning corrosion guidelines for the materials in Westinghouse Steam Generators. The results of the evaluation, recommendations for plant-specific applications and corrosion guidelines for chemical cleaning are presented in this report

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

A framework for monitoring social process and outcomes in environmental programs.

Science.gov (United States)

Chapman, Sarah

2014-12-01

When environmental programs frame their activities as being in the service of human wellbeing, social variables need to be integrated into monitoring and evaluation (M&E) frameworks. This article draws upon ecosystem services theory to develop a framework to guide the M&E of collaborative environmental programs with anticipated social benefits. The framework has six components: program need, program activities, pathway process variables, moderating process variables, outcomes, and program value. Needs are defined in terms of ecosystem services, as well as other human needs that must be addressed to achieve outcomes. The pathway variable relates to the development of natural resource governance capacity in the target community. Moderating processes can be externalities such as the inherent capacity of the natural system to service ecosystem needs, local demand for natural resources, policy or socio-economic drivers. Internal program-specific processes relate to program service delivery, targeting and participant responsiveness. Ecological outcomes are expressed in terms of changes in landscape structure and function, which in turn influence ecosystem service provision. Social benefits derived from the program are expressed in terms of the value of the eco-social service to user-specified goals. The article provides suggestions from the literature for identifying indicators and measures for components and component variables, and concludes with an example of how the framework was used to inform the M&E of an adaptive co-management program in western Kenya. Copyright © 2014 Elsevier Ltd. All rights reserved.

Intervention mapping: a process for developing theory- and evidence-based health education programs.

Science.gov (United States)

Bartholomew, L K; Parcel, G S; Kok, G

1998-10-01

The practice of health education involves three major program-planning activities: needs assessment, program development, and evaluation. Over the past 20 years, significant enhancements have been made to the conceptual base and practice of health education. Models that outline explicit procedures and detailed conceptualization of community assessment and evaluation have been developed. Other advancements include the application of theory to health education and promotion program development and implementation. However, there remains a need for more explicit specification of the processes by which one uses theory and empirical findings to develop interventions. This article presents the origins, purpose, and description of Intervention Mapping, a framework for health education intervention development. Intervention Mapping is composed of five steps: (1) creating a matrix of proximal program objectives, (2) selecting theory-based intervention methods and practical strategies, (3) designing and organizing a program, (4) specifying adoption and implementation plans, and (5) generating program evaluation plans.

The Danish national return-to-work program - aims, content, and design of the process and effect evaluation

NARCIS (Netherlands)

Aust, Birgit; Helverskov, Trine; Nielsen, Maj Britt D.; Bjorner, Jakob Bue; Rugulies, Reiner; Nielsen, Karina; Sorensen, Ole H.; Grundtvig, Gry; Andersen, Malene F.; Hansen, Jorgen V.; Buchardt, Helle L.; Nielsen, Lisbeth; Lund, Trine L.; Andersen, Irene; Andersen, Mogens H.; Clausen, Aksel S.; Heinesen, Eskil; Mortensen, Ole S.; Ektor-Andersen, John; Orbaek, Palle; Winzor, Glen; Bultmann, Ute; Poulsen, Otto M.

The Danish national return-to-work (RTW) program aims to improve the management of municipal sickness benefit in Denmark. A study is currently ongoing to evaluate the RTW program. The purpose of this article is to describe the study protocol. The program includes 21 municipalities encompassing

Process of pulmonary rehabilitation and program organization.

Science.gov (United States)

Wouters, E F M; Augustin, I M L

2011-09-01

Pulmonary rehabilitation programs are highly directed to return patients suffering from chronic lung diseases to a state of self-help. These programs are largely organized as temporary interventions in a highly fragmented delivery care system for patients with chronic respiratory conditions. In an optimal health care organizational structure, pulmonary rehabilitation needs to be considered as an essential part of an individualized, integrated care process, organized from the vantage point of the patient and the patients'health continuum. Pulmonary rehabilitation programs need to become organized as patient-centered care, respectful of and responsive to individual patient preferences, needs and values. Partnering and communication skills are considered as drivers for successful rehabilitation. Assessment is considered as the cornerstone to evaluate the individual needs and problems in order to develop an individualized intervention. Pulmonary rehabilitation programs need to move away from a supply-driven functional organizational structure towards integrated structures, including the full range of medical expertise, technical skills and specialized facilities needed to compete on added value in the management of patients with chronic respiratory diseases.

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Pyrochemical and Dry Processing Methods Program. A selected bibliography

Energy Technology Data Exchange (ETDEWEB)

McDuffie, H.F.; Smith, D.H.; Owen, P.T.

1979-03-01

This selected bibliography with abstracts was compiled to provide information support to the Pyrochemical and Dry Processing Methods (PDPM) Program sponsored by DOE and administered by the Argonne National Laboratory. Objectives of the PDPM Program are to evaluate nonaqueous methods of reprocessing spent fuel as a route to the development of proliferation-resistant and diversion-resistant methods for widespread use in the nuclear industry. Emphasis was placed on the literature indexed in the ERDA--DOE Energy Data Base (EDB). The bibliography includes indexes to authors, subject descriptors, EDB subject categories, and titles.

Pyrochemical and Dry Processing Methods Program. A selected bibliography

International Nuclear Information System (INIS)

McDuffie, H.F.; Smith, D.H.; Owen, P.T.

1979-03-01

This selected bibliography with abstracts was compiled to provide information support to the Pyrochemical and Dry Processing Methods (PDPM) Program sponsored by DOE and administered by the Argonne National Laboratory. Objectives of the PDPM Program are to evaluate nonaqueous methods of reprocessing spent fuel as a route to the development of proliferation-resistant and diversion-resistant methods for widespread use in the nuclear industry. Emphasis was placed on the literature indexed in the ERDA--DOE Energy Data Base (EDB). The bibliography includes indexes to authors, subject descriptors, EDB subject categories, and titles

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

Developing a hazmat incident evaluation program

International Nuclear Information System (INIS)

Williams, D.L.; Kaikumba, F.

1991-01-01

This paper reports that all communities are at risk of experiencing a hazardous materials incident, whether in transportation or at a fixed facility (such as petroleum refineries, oil fields, processing plants, etc.). However, many communities are unprepared to cope with this emergency. Administrators of state agencies and local response organizations often face fierce competition for tax dollars in support of their hazardous materials emergency response programs. Historically, little statistical information has been available to support their call for additional budget dollars in the areas of personnel, training, and equipment. It is difficult to plan for an emergency when you have little understanding of the risks, the frequency of incidents, the type of chemicals generally involved, and other vital information. The Illinois Hazardous Materials Incident Evaluation Program was designed to address the state and local needs, and position government and industry in a more responsive and proactive mode. The result is a program that works

Buckle up safely (shoalhaven): a process and impact evaluation of a pragmatic, multifaceted preschool-based pilot program to increase correct use of age-appropriate child restraints.

Science.gov (United States)

Hunter, Kate; Keay, Lisa; Clapham, Kathleen; Lyford, Marilyn; Brown, Julie; Bilston, Lynne; Simpson, Judy M; Stevenson, Mark; Ivers, Rebecca Q

2014-01-01

To conduct a process and impact evaluation of a multifaceted education-based pilot program targeting correct use of age-appropriate restraints in a regional setting with a high proportion of Aboriginal and Torres Strait Islander families. The program was delivered in 2010 in 3 early learning centers where 31 percent of the children were of Aboriginal and Torres Strait Islander descent. Each component of the program was assessed for message consistency and uptake. To measure program effectiveness, participating children were matched 1:1 by age, language spoken at home, and annual household income with 71 children from the control arm of a contemporaneous trial. The outcome measure in the control and program centers (a 4-category ordinal scale of restraint use) was compared using ordinal logistic regression accounting for age of the parent. Process evaluation found that though program components were delivered with a consistency of message, uptake was affected by turnover of all staff at one center and by parents experiencing difficulty in paying for subsidized restraints at each of the centers. Impact evaluation found that children from the centers receiving the program had nearly twice the odds of being in a better restraint category than children matched from the control group (adjusted odds ratio [ORadj] = 2.06, 95% confidence interval [CI], 1.09-3.90). This was a pragmatic study reflecting the real-life issues of implementing a program in preschools where 57 percent of families had a low income and turnover of staff was high. Despite these issues, impact evaluation showed that the integrated educational program showed promise in increasing correct use of age-appropriate restraints. The findings from this pilot study support the use of an integrated educational program that includes access to subsidized restraints to promote best practice child restraint use among communities that include a high proportion of Aboriginal and Torres Strait Islander families in New

Systematic evaluation program status summary report: November 1-30, 1981

International Nuclear Information System (INIS)

1981-12-01

The Systematic Evaluation Program is intended to examine many safety related aspects of eleven of the older light water reactors. This document provides the existing status of the review process including individual topic and overall completion status

Process Evaluation of the Type 2 Diabetes Mellitus PULSE Program Randomized Controlled Trial: Recruitment, Engagement, and Overall Satisfaction.

Science.gov (United States)

Aguiar, Elroy J; Morgan, Philip J; Collins, Clare E; Plotnikoff, Ronald C; Young, Myles D; Callister, Robin

2017-07-01

Men are underrepresented in weight loss and type 2 diabetes mellitus (T2DM) prevention studies. To determine the effectiveness of recruitment, and acceptability of the T2DM Prevention Using LifeStyle Education (PULSE) Program-a gender-targeted, self-administered intervention for men. Men (18-65 years, high risk for T2DM) were randomized to intervention ( n = 53) or wait-list control groups ( n = 48). The 6-month PULSE Program intervention focused on weight loss, diet, and exercise for T2DM prevention. A process evaluation questionnaire was administered at 6 months to examine recruitment and selection processes, and acceptability of the intervention's delivery and content. Associations between self-monitoring and selected outcomes were assessed using Spearman's rank correlation. A pragmatic recruitment and online screening process was effective in identifying men at high risk of T2DM (prediabetes prevalence 70%). Men reported the trial was appealing because it targeted weight loss, T2DM prevention, and getting fit, and because it was perceived as "doable" and tailored for men. The intervention was considered acceptable, with men reporting high overall satisfaction (83%) and engagement with the various components. Adherence to self-monitoring was poor, with only 13% meeting requisite criteria. However, significant associations were observed between weekly self-monitoring of weight and change in weight ( r s = -.47, p = .004) and waist circumference ( r s = -.38, p = .026). Men reported they would have preferred more intervention contact, for example, by phone or email. Gender-targeted, self-administered lifestyle interventions are feasible, appealing, and satisfying for men. Future studies should explore the effects of additional non-face-to-face contact on motivation, accountability, self-monitoring adherence, and program efficacy.

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

Science.gov (United States)

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across

Aerobic Exercise Training in Post-Polio Syndrome: Process Evaluation of a Randomized Controlled Trial

NARCIS (Netherlands)

Voorn, Eric L.; Koopman, Fieke S.; Brehm, Merel A.; Beelen, Anita; de Haan, Arnold; Gerrits, Karin H. L.; Nollet, Frans

2016-01-01

To explore reasons for the lack of efficacy of a high intensity aerobic exercise program in post-polio syndrome (PPS) on cardiorespiratory fitness by evaluating adherence to the training program and effects on muscle function. A process evaluation using data from an RCT. Forty-four severely fatigued

Evaluation of otolaryngology residency program websites.

Science.gov (United States)

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42

Evaluation model applied to TRANSPETRO's Marine Terminals Standardization Program

Energy Technology Data Exchange (ETDEWEB)

Almeida, Maria Fatima Ludovico de; Mueller, Gabriela [Pontificia Universidade Catolica do Rio de Janeiro (PUC-Rio), Rio de Janeiro, RJ (Brazil). Instituto Tecnologico; Garcia, Luciano Maldonado [TRANSPETRO - PETROBRAS Transporte S.A., Rio de Janeiro, RJ (Brazil)

2009-07-01

This paper describes an innovative evaluation model applied to TRANSPETRO's 'Marine Terminals Standardization Program' based on updating approaches of programs evaluation and organizational learning. Since the program was launched in 2004, the need for having an evaluation model able to evaluate its implementation progress, to measure the degree of standards compliance and its potential economic, social and environmental impacts has become evident. Within a vision of safe and environmentally responsible operations of marine terminals, this evaluation model was jointly designed by TRANSPETRO and PUC-Rio to promote continuous improvement and learning in operational practices and in the standardization process itself. TRANSPETRO believes that standardization supports its services and management innovation capability by creating objective and internationally recognized parameters, targets and metrology for its business activities. The conceptual model and application guidelines for this important tool are presented in this paper, as well as the next steps towards its implementation. (author)

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Computer programs for evaluation of turbulence characteristics from hot-wire measurements

International Nuclear Information System (INIS)

Vosahlo, L.

1984-06-01

This report describes the set of the computer programs for evaluation of the turbulent flow characteristics from hot-wire experimental data. Three different methods and, in addition, some variants are solved in these programs. This enables a comparison of the results obtained by these methods and the analysis of the influence of individual calculation parameters and calibration coefficients on the evaluated results. The results are printed in lucid numerical tables and written into files for further processing into graphs by plotting routines. (orig.) [de

Empowerment evaluation with programs designed to prevent first-time male perpetration of sexual violence.

Science.gov (United States)

Noonan, Rita K; Gibbs, Deborah

2009-01-01

This special issue captures several threads in the ongoing evolution of sexual violence prevention. The articles that follow examine an empowerment evaluation process with four promising programs dedicated to preventing first-time male perpetration of sexual violence, as well as evaluation findings. Both the evaluation approach and the programs examined shed light on how sexual violence prevention can continue to be improved in the future.

Evaluation of Medical Education virtual Program: P3 model.

Science.gov (United States)

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Measurement and evaluation of energy efficiency programs: California and South Korea

International Nuclear Information System (INIS)

Vine, E.; Rhee, C.H.; Lee, K.D.

2006-01-01

One of the key challenges for countries facing electric utility restructuring is to ensure that key public goods, such as energy efficiency programs, do not lose support but are maintained and enhanced via regulatory policy and government action. Moreover, an infrastructure and process also needs to be designed and implemented for conducting the measurement and evaluation of energy efficiency programs. This paper describes the experiences of California and the Republic of Korea (Korea) in addressing these issues. These case studies confirm that the active involvement of regulatory bodies is needed to ensure that energy efficiency investments continue. The case studies also show that the development of an infrastructure and process for conducting rigorous measurement and evaluation takes time and needs the active participation of many stakeholders

An Implementation Research Approach to Evaluating Health Insurance Programs: Insights from India

Directory of Open Access Journals (Sweden)

Krishna D. Rao

2016-05-01

Full Text Available One of the distinguishing features of implementation research is the importance given to involve implementers in all aspects of research, and as users of research. We report on a recent implementation research effort in India, in which researchers worked together with program implementers from one of the longest serving government funded insurance schemes in India, the Rajiv Aarogyasri Scheme (RAS in the state of undivided Andhra Pradesh, that covers around 70 million people. This paper aims to both inform on the process of the collaborative research, as well as, how the nature of questions that emerged out of the collaborative exercise differed in scope from those typically asked of insurance program evaluations. Starting in 2012, and over the course of a year, staff from the Aarogyasri Health Care Trust (AHCT, and researchers held a series of meetings to identify research questions that could serve as a guide for an evaluation of the RAS. The research questions were derived from the application of a Logical Framework Approach (“log frame” to the RAS. The types of questions that emerged from this collaborative effort were compared with those seen in the published literature on evaluations of insurance programs in low- and middle-income countries (LMICs. In the published literature, 60% of the questions pertained to output/outcome of the program and the remaining 40%, relate to processes and inputs. In contrast, questions generated from the RAS participatory research process between implementers and researchers had a remarkably different distribution – 81% of questions looked at program input/processes, and 19% on outputs and outcomes. An implementation research approach can lead to a substantively different emphasis of research questions. While there are several challenges in collaborative research between implementers and researchers, an implementation research approach can lead to incorporating tacit knowledge of program implementers

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

The Burden of the Fellowship Interview Process on General Surgery Residents and Programs.

Science.gov (United States)

Watson, Shawna L; Hollis, Robert H; Oladeji, Lasun; Xu, Shin; Porterfield, John R; Ponce, Brent A

This study evaluated the effect of the fellowship interview process in a cohort of general surgery residents. We hypothesized that the interview process would be associated with significant clinical time lost, monetary expenses, and increased need for shift coverage. An online anonymous survey link was sent via e-mail to general surgery program directors in June 2014. Program directors distributed an additional survey link to current residents in their program who had completed the fellowship interview process. United States allopathic general surgery programs. Overall, 50 general surgery program directors; 72 general surgery residents. Program directors reported a fellowship application rate of 74.4%. Residents most frequently attended 8 to 12 interviews (35.2%). Most (57.7%) of residents reported missing 7 or more days of clinical training to attend interviews; these shifts were largely covered by other residents. Most residents (62.3%) spent over $4000 on the interview process. Program directors rated fellowship burden as an average of 6.7 on a 1 to 10 scale of disruption, with 10 being a significant disruption. Most of the residents (57.3%) were in favor of change in the interview process. We identified potential areas for improvement including options for coordinated interviews and improved content on program websites. The surgical fellowship match is relatively burdensome to residents and programs alike, and merits critical assessment for potential improvement. Published by Elsevier Inc.

Hanford high level waste: Sample Exchange/Evaluation (SEE) Program

International Nuclear Information System (INIS)

King, A.G.

1994-08-01

The Pacific Northwest Laboratory (PNL)/Analytical Chemistry Laboratory (ACL) and the Westinghouse Hanford Company (WHC)/Process Analytical Laboratory (PAL) provide analytical support services to various environmental restoration and waste management projects/programs at Hanford. In response to a US Department of Energy -- Richland Field Office (DOE-RL) audit, which questioned the comparability of analytical methods employed at each laboratory, the Sample Exchange/Exchange (SEE) program was initiated. The SEE Program is a selfassessment program designed to compare analytical methods of the PAL and ACL laboratories using sitespecific waste material. The SEE program is managed by a collaborative, the Quality Assurance Triad (Triad). Triad membership is made up of representatives from the WHC/PAL, PNL/ACL, and WHC Hanford Analytical Services Management (HASM) organizations. The Triad works together to design/evaluate/implement each phase of the SEE Program

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

ANA - a program for evaluation of gamma spectra from environmental samples

International Nuclear Information System (INIS)

Mishev, P.

1993-01-01

The program aims at for evaluation of gamma spectra, collected in different multichannel analyzers. It provides file format conversion from most popular file spectra formats. The program includes: spectra visualization; energy and shape calibration; efficiency calibration; automatic peak search; resolving of multiplets and peak calculations, based on program KATOK; isotope library; isotope identification and activity calculations. Three types of efficiency calibrations are possible: spline approximation; two branches logarithmic approximation; and polynomial approximation based on orthonormal polynomials. The suggestions of the International Atomic Energy Agency were taken into account in development of the algorithms. The program allows batch spectra processing appropriate for routine tasks and user controlled evaluations. Calculations of lower detection limits of some user defined isotopes are also possible. The program calculates precisely the statistical uncertainties of the final results. The error sources taken into account are: standard source activity errors, efficiency approximation errors and current measurement errors. (author)

Shifting the evaluative gaze: Community-based program evaluation in the homeless sector

Directory of Open Access Journals (Sweden)

Bruce Wallace

2015-09-01

Full Text Available Homelessness is a growing social issue that is a consequence of structural inequities and contributor to the development of health inequities. Community-based research (CBR has been proposed as an effective research strategy for addressing health equities and promoting social justice through participatory processes. The purpose of this article is to examine the application of CBR principles and practices in the homeless sector and the implications for the production of knowledge and social change to address homelessness. Drawing on our experiences as researchers and service providers, we reflect on the significant successes and challenges associated with using CBR in the homelessness sector. In our discussion we emphasise insights, challenges and lessons learned from a community-university partnership that focused on an evaluation of a transitional shelter program in a large urban centre where housing is expensive and often unavailable. Keywords: Homelessness, housing, transitional housing, transitional shelter, program evaluation, community-based research

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

Process evaluation of the Enabling Mothers toPrevent Pediatric Obesity Through Web-Based Learning and Reciprocal Determinism (EMPOWER) randomized control trial.

Science.gov (United States)

Knowlden, Adam P; Sharma, Manoj

2014-09-01

Family-and-home-based interventions are an important vehicle for preventing childhood obesity. Systematic process evaluations have not been routinely conducted in assessment of these interventions. The purpose of this study was to plan and conduct a process evaluation of the Enabling Mothers to Prevent Pediatric Obesity Through Web-Based Learning and Reciprocal Determinism (EMPOWER) randomized control trial. The trial was composed of two web-based, mother-centered interventions for prevention of obesity in children between 4 and 6 years of age. Process evaluation used the components of program fidelity, dose delivered, dose received, context, reach, and recruitment. Categorical process evaluation data (program fidelity, dose delivered, dose exposure, and context) were assessed using Program Implementation Index (PII) values. Continuous process evaluation variables (dose satisfaction and recruitment) were assessed using ANOVA tests to evaluate mean differences between groups (experimental and control) and sessions (sessions 1 through 5). Process evaluation results found that both groups (experimental and control) were equivalent, and interventions were administered as planned. Analysis of web-based intervention process objectives requires tailoring of process evaluation models for online delivery. Dissemination of process evaluation results can advance best practices for implementing effective online health promotion programs. © 2014 Society for Public Health Education.

Program Evaluation: Roles and Responsibilities of Boards of Education Relative to Thorough and Efficient Legislation.

Science.gov (United States)

Research for Better Schools, Inc., Philadelphia, PA.

The process for providing a "thorough and efficient" (T & E) education according to New Jersey statutes and regulations involves six basic steps. This document suggests procedures for handling the fifth step, educational program evaluation. Processes discussed include committee formation, evaluation planning, action plan…

Reactor materials program process water component failure probability

International Nuclear Information System (INIS)

Daugherty, W. L.

1988-01-01

The maximum rate loss of coolant accident for the Savannah River Production Reactors is presently specified as the abrupt double-ended guillotine break (DEGB) of a large process water pipe. This accident is not considered credible in light of the low applied stresses and the inherent ductility of the piping materials. The Reactor Materials Program was initiated to provide the technical basis for an alternate, credible maximum rate LOCA. The major thrust of this program is to develop an alternate worst case accident scenario by deterministic means. In addition, the probability of a DEGB is also being determined; to show that in addition to being mechanistically incredible, it is also highly improbable. The probability of a DEGB of the process water piping is evaluated in two parts: failure by direct means, and indirectly-induced failure. These two areas have been discussed in other reports. In addition, the frequency of a large bread (equivalent to a DEGB) in other process water system components is assessed. This report reviews the large break frequency for each component as well as the overall large break frequency for the reactor system

Preparing Youth for College and Career: A Process Evaluation of Urban Alliance

Science.gov (United States)

Theodos, Brett; Pergamit, Michael R.; Edelstein, Sara; George, Taz; Freiman, Lesley

2014-01-01

This report presents baseline and process study findings of an evaluation of the Urban Alliance high school internship program, which provides training, mentoring, and work experience to high school seniors from distressed communities in Washington, DC, Baltimore, Northern Virginia, and Chicago. The report, which focuses on the program's…

Evaluation of the Super Efficient Refrigerator Program (SERP) in the Bonneville Power Administration service territory

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-06-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. it is one of the first examples of large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the evaluation of SERP ({open_quotes}the Program{close_quotes}) in the Bonneville Power Administration`s (Bonneville`s) service territory. Pacific Northwest National Laboratory (PNNL) conducted this evaluation for Bonneville. This study includes the process evaluation, preliminary impact evaluation, and market transformation assessment. It is based on site visits and interviews with refrigerator dealers and manufacturers, industry data, and Bonneville information. Results from this study are compared with those from a parallel study that examines the Program across the 24 participating utilities.

Supporting mothers to breastfeed: the development and process evaluation of a father inclusive perinatal education support program in Perth, Western Australia.

Science.gov (United States)

Tohotoa, Jenny; Maycock, Bruce; Hauck, Yvonne; Howat, Peter; Burns, Sharyn; Binns, Colin

2011-09-01

Entry into fatherhood is a challenging period with new responsibilities and changes in family dynamics. Hegemonic imagery of men portray them as capable, confident and able which can disadvantage expectant fathers who often struggle to make sense of the changes occurring around and within their own parenting journey. Although fathers historically have not been included in breastfeeding classes, antenatal education programs can be an opportunity to inform and support them in their new role. Forty-five antenatal sessions for fathers (n = 342) of 1h duration were conducted by five male educators between May 2008 and June 2009 in Perth, Western Australia. A theoretical framework from health promotion literature was used as a guide in the program's development. Fathers in the intervention group gained information about their role, the importance of communication and the benefits of breastfeeding to both mother and baby. An evaluation was obtained from fathers immediately after the session and again at 6 week post-birth, whilst mothers reported on the perception of their partners' support for breastfeeding in the 6 week survey. The aim of this paper is to describe the development and process evaluation of a perinatal education and support program for fathers to assist their partners to breastfeed.

Evaluation of medical education virtual program: P3 model

Directory of Open Access Journals (Sweden)

RITA REZAEE

2016-10-01

Full Text Available Introduction: In e-learning, people get involved in a process and create the content (product and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76, but they declared technical support as the less desirable part (1.17±1.23. Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Public Relations for Brazilian Libraries: Process, Principles, Program Planning, Planning Techniques and Suggestions.

Science.gov (United States)

Kies, Cosette N.

A brief overview of the functions of public relations in libraries introduces this manual, which provides an explanation of the public relations (PR) process, including fact-finding, planning, communicating, evaluating, and marketing; some PR principles; a 10-step program that could serve as a model for planning a PR program; a discussion of PR…

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations.

Science.gov (United States)

Wasserman, Deborah L

2010-05-01

This paper offers a framework for using a systems orientation and "foundational theory" to enhance theory-driven evaluations and logic models. The framework guides the process of identifying and explaining operative relationships and perspectives within human service program systems. Self-Determination Theory exemplifies how a foundational theory can be used to support the framework in a wide range of program evaluations. Two examples illustrate how applications of the framework have improved the evaluators' abilities to observe and explain program effect. In both exemplars improvements involved addressing and organizing into a single logic model heretofore seemingly disparate evaluation issues regarding valuing (by whose values); the role of organizational and program context; and evaluation anxiety and utilization. Copyright 2009 Elsevier Ltd. All rights reserved.

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Effectiveness and Cost-benefit Evaluation of a Comprehensive Workers' Health Surveillance Program for Sustainable Employability of Meat Processing Workers.

Science.gov (United States)

van Holland, Berry J; Reneman, Michiel F; Soer, Remko; Brouwer, Sandra; de Boer, Michiel R

2018-03-01

Objective To evaluate the effectiveness of a comprehensive workers' health surveillance (WHS) program on aspects of sustainable employability and cost-benefit. Methods A cluster randomized stepped wedge trial was performed in a Dutch meat processing company from february 2012 until march 2015. In total 305 workers participated in the trial. Outcomes were retrieved during a WHS program, by multiple questionnaires, and from company registries. Primary outcomes were sickness absence, work ability, and productivity. Secondary outcomes were health, vitality, and psychosocial workload. Data were analyzed with linear and logistic multilevel models. Cost-benefit analyses from the employer's perspective were performed as well. Results Primary outcomes sickness absence (OR = 1.40), work ability (B = -0.63) and productivity (OR = 0.71) were better in the control condition. Secondary outcomes did not or minimally differ between conditions. Of the 12 secondary outcomes, the only outcome that scored better in the experimental condition was meaning of work (B = 0.18). Controlling for confounders did not or minimally change the results. However, our stepped wedge design did not enable adjustment for confounding in the last two periods of the trial. The WHS program resulted in higher costs for the employer on the short and middle term. Conclusions Primary outcomes did not improve after program implementation and secondary outcomes remained equal after implementation. The program was not cost-beneficial after 1-3 year follow-up. Main limitation that may have contributed to absence of positive effects may be program failure, because interventions were not deployed as intended.

Evaluation of a cognitive-behavioral program for chronically psychotic forensic inpatients.

NARCIS (Netherlands)

Hornsveld, R.H.J.; Nijman, H.L.I.

2005-01-01

The present study evaluated the progress of four groups of chronically psychotic patients in treatment at De Kijvelanden Forensic Psychiatric Hospital. The psychotic patients were offered a cognitive-behavioral program, including psycho education, grief processing, stress management, functional

Engaging partners to initiate evaluation efforts: tactics used and lessons learned from the prevention research centers program.

Science.gov (United States)

Wright, Demia Sundra; Anderson, Lynda A; Brownson, Ross C; Gwaltney, Margaret K; Scherer, Jennifer; Cross, Alan W; Goodman, Robert M; Schwartz, Randy; Sims, Tom; White, Carol R

2008-01-01

The Centers for Disease Control and Prevention's (CDC's) Prevention Research Centers (PRC) Program underwent a 2-year evaluation planning project using a participatory process that allowed perspectives from the national community of PRC partners to be expressed and reflected in a national logic model. The PRC Program recognized the challenge in developing a feasible, useable, and relevant evaluation process for a large, diverse program. To address the challenge, participatory and utilization-focused evaluation models were used. Four tactics guided the evaluation planning process: 1) assessing stakeholders' communication needs and existing communication mechanisms and infrastructure; 2) using existing mechanisms and establishing others as needed to inform, educate, and request feedback; 3) listening to and using feedback received; and 4) obtaining adequate resources and building flexibility into the project plan to support multifaceted mechanisms for data collection. Participatory methods resulted in buy-in from stakeholders and the development of a national logic model. Benefits included CDC's use of the logic model for program planning and development of a national evaluation protocol and increased expectations among PRC partners for involvement. Challenges included the time, effort, and investment of program resources required for the participatory approach and the identification of whom to engage and when to engage them for feedback on project decisions. By using a participatory and utilization-focused model, program partners positively influenced how CDC developed an evaluation plan. The tactics we used can guide the involvement of program stakeholders and help with decisions on appropriate methods and approaches for engaging partners.

Using a profiling process to insure program quality: Volume I - a self-instructional manual

Energy Technology Data Exchange (ETDEWEB)

Kaser, J.S.; Roody, D.S.; Raizen, S.A.

1996-11-01

Between 1990 and 1995 the U.S. Department of Energy (DOE) and the National Center for Improving Science Education (National Center) developed a system for ongoing evaluation of K-12 educational programs in the DOE-supported national energy Laboratories. As part of the formative evaluation component of this collaborative endeavor, field staff in the Laboratories began creating profiles of their programs. However, many individuals within DOE Headquarters were not familiar with this profiling process and were unprepared to use the valuable information that the profiles generated. This manual was produced to orient Headquarters staff to profiling. It focuses on how Headquarters staff can use the profiling process to help their funded programs establish and/or maintain high quality. Its purpose, then, is not to train Headquarters staff to become proficient in profiling, but to show them how to draw on the Laboratories` use of profiling to bring about program improvement. Profiling is the process of systematically examining and describing a program`s elements against a set of components that define Effective Practice. The instrument used to capture the data for analysis is called a template, and most of this manual focuses on the templates and how to read and interpret them. However, since it is important to understand these data in context, the authors also describe what should accompany each template in a complete profiling packet and offer guidelines for reviewing complete packets and providing feedback to program managers.

The Danish national return-to-work program - aims, content, and design of the process and effect evaluation

DEFF Research Database (Denmark)

Aust, Birgit; Helverskov, Trine; Nielsen, Maj Britt D.

2012-01-01

approximately 19 500 working-age adults on long-term sickness absence, regardless of reason for sickness absence or employment status. It consists of three core elements: (i) establishment of multidisciplinary RTW teams, (ii) introduction of standardized workability assessments and sickness absence management......The Danish national return-to-work (RTW) program aims to improve the management of municipal sickness benefit in Denmark. A study is currently ongoing to evaluate the RTW program. The purpose of this article is to describe the study protocol. The program includes 21 municipalities encompassing...... procedures, and (iii) a comprehensive training course for the RTW teams. The effect evaluation is based on a parallel group randomized trial and a stratified cluster controlled trial and focuses on register-based primary outcomes - duration of sickness absence and RTW - and questionnaire-based secondary...

ENDF/B-V processing programs

International Nuclear Information System (INIS)

DayDay, N.

1980-07-01

A description and operating instructions are supplied for the following ENDF/B-V Processing Programs: CHECKER, CRECT, STNDRD, FIZCON, PSYCHE, RESEND, INTER, INTEND, SUMRIZ, PLOTEF, LSTFCV, RIGEL. These programs can be obtained on magnetic tape, free of charge, from the IAEA Nuclear Data Section. (author)

Software Engineering Program: Software Process Improvement Guidebook

Science.gov (United States)

1996-01-01

The purpose of this document is to provide experience-based guidance in implementing a software process improvement program in any NASA software development or maintenance community. This guidebook details how to define, operate, and implement a working software process improvement program. It describes the concept of the software process improvement program and its basic organizational components. It then describes the structure, organization, and operation of the software process improvement program, illustrating all these concepts with specific NASA examples. The information presented in the document is derived from the experiences of several NASA software organizations, including the SEL, the SEAL, and the SORCE. Their experiences reflect many of the elements of software process improvement within NASA. This guidebook presents lessons learned in a form usable by anyone considering establishing a software process improvement program within his or her own environment. This guidebook attempts to balance general and detailed information. It provides material general enough to be usable by NASA organizations whose characteristics do not directly match those of the sources of the information and models presented herein. It also keeps the ideas sufficiently close to the sources of the practical experiences that have generated the models and information.

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Rainfall Product Evaluation for the TRMM Ground Validation Program

Science.gov (United States)

Amitai, E.; Wolff, D. B.; Robinson, M.; Silberstein, D. S.; Marks, D. A.; Kulie, M. S.; Fisher, B.; Einaudi, Franco (Technical Monitor)

2000-01-01

Evaluation of the Tropical Rainfall Measuring Mission (TRMM) satellite observations is conducted through a comprehensive Ground Validation (GV) Program. Standardized instantaneous and monthly rainfall products are routinely generated using quality-controlled ground based radar data from four primary GV sites. As part of the TRMM GV program, effort is being made to evaluate these GV products and to determine the uncertainties of the rainfall estimates. The evaluation effort is based on comparison to rain gauge data. The variance between the gauge measurement and the true averaged rain amount within the radar pixel is a limiting factor in the evaluation process. While monthly estimates are relatively simple to evaluate, the evaluation of the instantaneous products are much more of a challenge. Scattegrams of point comparisons between radar and rain gauges are extremely noisy for several reasons (e.g. sample volume discrepancies, timing and navigation mismatches, variability of Z(sub e)-R relationships), and therefore useless for evaluating the estimates. Several alternative methods, such as the analysis of the distribution of rain volume by rain rate as derived from gauge intensities and from reflectivities above the gauge network will be presented. Alternative procedures to increase the accuracy of the estimates and to reduce their uncertainties also will be discussed.

Development and Evaluation of Science and Technology Education Program Using Interferometric SAR

Science.gov (United States)

Ito, Y.; Ikemitsu, H.; Nango, K.

2016-06-01

This paper proposes a science and technology education program to teach junior high school students to measure terrain changes by using interferometric synthetic aperture radar (SAR). The objectives of the proposed program are to evaluate and use information technology by performing SAR data processing in order to measure ground deformation, and to incorporate an understanding of Earth sciences by analyzing interferometric SAR processing results. To draft the teaching guidance plan for the developed education program, this study considers both science and technology education. The education program was used in a Japanese junior high school. An educational SAR processor developed by the authors and the customized Delft object-oriented radar interferometric software package were employed. Earthquakes as diastrophism events were chosen as practical teaching materials. The selected events indicate clear ground deformation in differential interferograms with high coherence levels. The learners were able to investigate the ground deformations and disasters caused by the events. They interactively used computers and became skilled at recognizing the knowledge and techniques of information technology, and then they evaluated the technology. Based on the results of pre- and post-questionnaire surveys and self-evaluation by the learners, it was clarified that the proposed program was applicable for junior high school education, and the learners recognized the usefulness of Earth observation technology by using interferometric SAR. The usefulness of the teaching materials in the learning activities was also shown through the practical teaching experience.

Evaluation Program on the Implementation of Industrial Apprenticeship (Prakerin) in Electrical Engineering

Science.gov (United States)

Maulana, I.; Sumarto; Nurafiati, P.; Puspita, R. H.

2018-02-01

This research aims to find out the evaluation program of the Industrial apprenticeship (Prakerin) in electrical engineering. This research includes on four variables of CIPP. (1). Context (a). programme planning (b). design. (2). Input (a). readiness of students (b). performance of vocational education teachers (c). Facilities and infrastructure, (3). process (a). performance students (b). performance mentors, (4). Product (a). readiness of student work. This research is a type of program evaluation research with Stake model approach. Data collection methods used are questionnaires with closed questions and frequently asked questions.

Implementation and process evaluation of a workplace colorectal cancer screening program in eastern Washington.

Science.gov (United States)

Hannon, Peggy A; Vu, Thuy; Ogdon, Sara; Fleury, Emily M; Yette, Emily; Wittenberg, Reva; Celedonia, Megan; Bowen, Deborah J

2013-03-01

Colorectal cancer screening is a life-saving intervention, but screening rates are low. The authors implemented and evaluated the Spokane Colorectal Cancer Screening Program-a novel worksite intervention to promote colorectal cancer screening that used a combination of evidence-based strategies recommended by the Guide to Community Preventive Services, as well as additional strategies. Over a period of approximately 3 months, participating worksites held one or more physician-led seminars about colorectal cancer screening for employees. They also distributed free fecal immunochemical tests at the worksite to employees 50 years and older, and they provided test results to employees and their primary care physician. The authors measured attendance at seminars, test kits taken and returned, employee awareness of the program, and colorectal cancer screening rates in participating and comparison worksites. It is estimated that 9% of eligible employees received kits at the worksite, and 4% were screened with these kits. The Spokane Colorectal Cancer Screening Program was a promising pilot test of an innovative worksite screening program that successfully translated evidence-based strategies into practical use in a brief period of time, and it merits a larger study to be able to test its effects more rigorously.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies.

Science.gov (United States)

Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F

2016-06-01

Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Intersectorality in the 'Health in Schools' Program: an evaluation of the political-management process and working practices.

Science.gov (United States)

Sousa, Marta Caires de; Esperidião, Monique Azevedo; Medina, Maria Guadalupe

2017-06-01

This study analyzed inter-sectoral activities between the health and education sectors in implementing the Health in Schools program in a city within a metropolitan region in northeast Brazil. Analysis of the political-management process looked at the following dimensions: professional practices and subject understanding of intersectorality. The results show that subjects define intersectorality as partnership and joint efforts. Regarding decision making and resource mobilization, during program implementation we noticed that healthcare leads, and education tends to play a more peripheral role. Health activities in the schools use a biomedical approach and primarily consist of lectures. We believe that the program strengthened the relationship between these two sectors. However, intersectoral coordination in the political-management process and practices show weaknesses and limitations.

Process evaluation distributed system

Science.gov (United States)

Moffatt, Christopher L. (Inventor)

2006-01-01

The distributed system includes a database server, an administration module, a process evaluation module, and a data display module. The administration module is in communication with the database server for providing observation criteria information to the database server. The process evaluation module is in communication with the database server for obtaining the observation criteria information from the database server and collecting process data based on the observation criteria information. The process evaluation module utilizes a personal digital assistant (PDA). A data display module in communication with the database server, including a website for viewing collected process data in a desired metrics form, the data display module also for providing desired editing and modification of the collected process data. The connectivity established by the database server to the administration module, the process evaluation module, and the data display module, minimizes the requirement for manual input of the collected process data.

Quantitative Evaluation of the Community Research Fellows Training Program

Directory of Open Access Journals (Sweden)

Lucy eD'Agostino McGowan

2015-07-01

Full Text Available Context: The Community Research Fellows Training (CRFT program is a community-based participatory research (CBPR initiative for the St. Louis area. This fifteen week program, based on a Master in Public Health curriculum, was implemented by the Division of Public Health Sciences at Washington University School of Medicine in partnership with the Siteman Cancer Center. Objectives: We measure the knowledge gained by participants and evaluate participant and faculty satisfaction of the CRFT program both in terms of meeting learning objectives and actively engaging the community in the research process.Participants: We conducted analyses on 44 community members who participated in the CRFT program and completed the baseline and follow-up knowledge assessments.Main Outcome Measures: Knowledge gain is measured by a baseline and follow-up assessment given at the first and final session. Additionally, pre- and post-tests are given after the first 12 sessions. To measure satisfaction, program evaluations are completed by both the participants and faculty after each topic. Mid-way through the program, a mid-term assessment was administered to assess the program’s community engagement. We analyzed the results from the assessments, pre- and post-tests, and evaluations.Results: The CRFT participants’ knowledge increased at follow-up as compared with baseline on average by a 16.5 point difference (p<0.0001. Post-test scores were higher than pre-test scores for 11 of the 12 sessions. Both participants and faculty enjoyed the training and rated all session well.Conclusions: The CRFT program was successful in increasing community knowledge, in participant satisfaction, and in faculty satisfaction. This success has enhanced the infrastructure for CBPR as well as led to CBPR pilot projects that address health disparities in the St. Louis Greater Metropolitan Area.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Evaluation as a critical factor of success in local public health accreditation programs.

Science.gov (United States)

Tremain, Beverly; Davis, Mary; Joly, Brenda; Edgar, Mark; Kushion, Mary L; Schmidt, Rita

2007-01-01

This article presents the variety of approaches used to conduct evaluations of performance improvement or accreditation systems, while illustrating the complexity of conducting evaluations to inform local public health practice. We, in addition, hope to inform the Exploring Accreditation Program about relevant experiences involving accreditation and performance assessment processes, specifically evaluation, as it debates and discusses a national voluntary model. A background of each state is given. To further explore these issues, interviews were conducted with each state's evaluator to gain more in-depth information on the many different evaluation strategies and approaches used. On the basis of the interviews, the authors provide several overall themes, which suggest that evaluation is a critical tool and success factor for performance assessment or accreditation programs.

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Object-oriented fault tree evaluation program for quantitative analyses

Science.gov (United States)

Patterson-Hine, F. A.; Koen, B. V.

1988-01-01

Object-oriented programming can be combined with fault free techniques to give a significantly improved environment for evaluating the safety and reliability of large complex systems for space missions. Deep knowledge about system components and interactions, available from reliability studies and other sources, can be described using objects that make up a knowledge base. This knowledge base can be interrogated throughout the design process, during system testing, and during operation, and can be easily modified to reflect design changes in order to maintain a consistent information source. An object-oriented environment for reliability assessment has been developed on a Texas Instrument (TI) Explorer LISP workstation. The program, which directly evaluates system fault trees, utilizes the object-oriented extension to LISP called Flavors that is available on the Explorer. The object representation of a fault tree facilitates the storage and retrieval of information associated with each event in the tree, including tree structural information and intermediate results obtained during the tree reduction process. Reliability data associated with each basic event are stored in the fault tree objects. The object-oriented environment on the Explorer also includes a graphical tree editor which was modified to display and edit the fault trees.

Implementing and evaluating a program to facilitate chronic disease prevention and screening in primary care: a mixed methods program evaluation.

Science.gov (United States)

Manca, Donna Patricia; Aubrey-Bassler, Kris; Kandola, Kami; Aguilar, Carolina; Campbell-Scherer, Denise; Sopcak, Nicolette; O'Brien, Mary Ann; Meaney, Christopher; Faria, Vee; Baxter, Julia; Moineddin, Rahim; Salvalaggio, Ginetta; Green, Lee; Cave, Andrew; Grunfeld, Eva

2014-10-08

comprising the composite index include the following: process measures, referral/treatment measures, and target/change outcome measures related to cardiovascular disease, diabetes, cancer and associated lifestyle factors. The BETTER 2 program is a collaborative approach grounded in practice and built from existing work (i.e., integration not creation). The program evaluation is designed to provide an understanding of issues impacting the implementation of an effective approach for CDPS within primary care that may be adapted to become sustainable in the non-research setting.

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

Science.gov (United States)

Ewell, Bob

1998-01-01

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs

A theory-informed, process-oriented Resident Scholarship Program.

Science.gov (United States)

Thammasitboon, Satid; Darby, John B; Hair, Amy B; Rose, Karen M; Ward, Mark A; Turner, Teri L; Balmer, Dorene F

2016-01-01

The Accreditation Council for Graduate Medical Education requires residency programs to provide curricula for residents to engage in scholarly activities but does not specify particular guidelines for instruction. We propose a Resident Scholarship Program that is framed by the self-determination theory (SDT) and emphasize the process of scholarly activity versus a scholarly product. The authors report on their longitudinal Resident Scholarship Program, which aimed to support psychological needs central to SDT: autonomy, competence, and relatedness. By addressing those needs in program aims and program components, the program may foster residents' intrinsic motivation to learn and to engage in scholarly activity. To this end, residents' engagement in scholarly processes, and changes in perceived autonomy, competence, and relatedness were assessed. Residents engaged in a range of scholarly projects and expressed positive regard for the program. Compared to before residency, residents felt more confident in the process of scholarly activity, as determined by changes in increased perceived autonomy, competence, and relatedness. Scholarly products were accomplished in return for a focus on scholarly process. Based on our experience, and in line with the SDT, supporting residents' autonomy, competence, and relatedness through a process-oriented scholarship program may foster the curiosity, inquisitiveness, and internal motivation to learn that drives scholarly activity and ultimately the production of scholarly products.

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.

An experimental evaluation of alarm processing and display characteristics

International Nuclear Information System (INIS)

O'Hara, J.; Brown, W.; Hallbert, B.; Skraaning, G.Jr.; Persensky, J.; Wachtel, J.

1998-01-01

This paper describes a research program sponsored by the U.S. Nuclear Regulatory Commission to address the human factors engineering (HFE) aspects of nuclear power plant alarm systems. The overall objective of the program is to develop HFE review guidance for advanced alarm systems. As part of this program, guidance has been developed based on a broad base of technical and research literature. In the course of guidance development, aspects of alarm system design for which the technical basis was insufficient to support complete guidance development were identified. The primary purpose of the research reported in this paper was to evaluate the effects of three of these alarm system design characteristics on operator performance in order to contribute to the understanding of potential safety issues and to provide data to support the development of design review guidance in these areas. Three alarm system design characteristics studied were (1) alarm processing (degree of alarm reduction), (2) alarm availability (dynamic prioritization and suppression), and (3) alarm display (a dedicated tile format, a mixed tile and message list format, and a format in which alarm information is integrated into the process displays). A secondary purpose was to provide confirmatory evidence of selected alarm system guidance developed in an earlier phase of the project. The alarm characteristics were combined into eight separate experimental conditions. Six, two-person crews of professional nuclear power plant operators participated in the study. Following training, each crew completed 16 test trials which consisted of two trials in each of the eight experimental conditions (one with a low-complexity scenario and one with a high-complexity scenario). Measures of process performance. operator task performance, situation awareness, and workload were obtained. In addition. operator opinions and evaluations of the alarm processing and display conditions were collected. Numerous strengths

Energy-Related Inventions Program: an overview of the evaluation

Energy Technology Data Exchange (ETDEWEB)

Soderstrom, E.J.; Bronfman, L.M.; Rorke, M.G.

1983-09-01

The Energy-Related Inventions Program (ERIP) is jointly administered by the US Departments of Energy and Commerce. Grants were awarded for 165 of 208 inventions recommended by the National Bureau of Standards (NBS). Of the 165 inventions, 46 have been able to acquire follow-on financing from a variety of sources. Further, 35 of the inventions have reached the marketplace, and their cumulative sales to date total $178 million. An additional 10 inventions are now starting into production. Jobs that have been created directly by production related to the inventions total 756; additional spin-off jobs attributable to the inventions include component and material suppliers, jobbers, franchisees, and distributors. The program was recently evaluated at Oak Ridge National Laboratory, with the following conclusions: (1) the evaluation process at NBS has been successful in identifying technically and economically feasible inventions, (2) the success rate for the program is about equivalent to the reported success rates of private venture capital firms, (3) the program is supporting inventions at a point in their development where they are supported by neither the venture capital community nor industry, and (4) the one-time DOE grants and the associated ERIP support to inventors have been successful in readying inventors for follow-on financing from the private sector.

Early Evolution of the Toxicity Identification Evaluation Process: Contributions from the USEPA Effluent Testing Program

Science.gov (United States)

As part of its whole effluent testing program, the USEPA developed an effects-directed analysis (EDA) approach to identifying the cause of toxicity in toxic effluents or ambient waters, an EDA process termed a “Toxicity Identification Evaluation” (TIE), which is the focus of this...

Preliminary evaluation of alternative waste form solidification processes. Volume II. Evaluation of the processes

International Nuclear Information System (INIS)

1980-08-01

This Volume II presents engineering feasibility evaluations of the eleven processes for solidification of nuclear high-level liquid wastes (HHLW) described in Volume I of this report. Each evaluation was based in a systematic assessment of the process in respect to six principal evaluation criteria: complexity of process; state of development; safety; process requirements; development work required; and facility requirements. The principal criteria were further subdivided into a total of 22 subcriteria, each of which was assigned a weight. Each process was then assigned a figure of merit, on a scale of 1 to 10, for each of the subcriteria. A total rating was obtained for each process by summing the products of the subcriteria ratings and the subcriteria weights. The evaluations were based on the process descriptions presented in Volume I of this report, supplemented by information obtained from the literature, including publications by the originators of the various processes. Waste form properties were, in general, not evaluated. This document describes the approach which was taken, the developent and application of the rating criteria and subcriteria, and the evaluation results. A series of appendices set forth summary descriptions of the processes and the ratings, together with the complete numerical ratings assigned; two appendices present further technical details on the rating process

Flowchart evaluations of irradiated fuel treatment process of low burnup thorium

International Nuclear Information System (INIS)

Linardi, M.

1987-01-01

A literature survey has been carried out, on some versions of the acid-thorex process. Flowsheets of the different parts of the process were evaluated with mixer-settlers experiments. A low burnup thorium fuel (mass ratio Th/U∼100/1), proposed for Brazilian fast breeder reactor initial program, was considered. The behaviour of some fission products was studied by irradiated tracers techniques. Modifications in some of the process parameters were necessary to achieve low losses of 233 U and 232 U and 232 Th. A modified acid-thorex process flowsheet, evaluated in a complete operational cycle, for the treatment of low burnup thorium fuels, is presented. High decontamination factors of thorium in uranium, with reasonable decontamination of uranium in thorium, were achieved. (author) [pt

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

A theory-informed, process-oriented Resident Scholarship Program

Science.gov (United States)

Thammasitboon, Satid; Darby, John B.; Hair, Amy B.; Rose, Karen M.; Ward, Mark A.; Turner, Teri L.; Balmer, Dorene F.

2016-01-01

Background The Accreditation Council for Graduate Medical Education requires residency programs to provide curricula for residents to engage in scholarly activities but does not specify particular guidelines for instruction. We propose a Resident Scholarship Program that is framed by the self-determination theory (SDT) and emphasize the process of scholarly activity versus a scholarly product. Methods The authors report on their longitudinal Resident Scholarship Program, which aimed to support psychological needs central to SDT: autonomy, competence, and relatedness. By addressing those needs in program aims and program components, the program may foster residents’ intrinsic motivation to learn and to engage in scholarly activity. To this end, residents’ engagement in scholarly processes, and changes in perceived autonomy, competence, and relatedness were assessed. Results Residents engaged in a range of scholarly projects and expressed positive regard for the program. Compared to before residency, residents felt more confident in the process of scholarly activity, as determined by changes in increased perceived autonomy, competence, and relatedness. Scholarly products were accomplished in return for a focus on scholarly process. Conclusions Based on our experience, and in line with the SDT, supporting residents’ autonomy, competence, and relatedness through a process-oriented scholarship program may foster the curiosity, inquisitiveness, and internal motivation to learn that drives scholarly activity and ultimately the production of scholarly products. PMID:27306995

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

NRC-BNL Benchmark Program on Evaluation of Methods for Seismic Analysis of Coupled Systems

International Nuclear Information System (INIS)

Chokshi, N.; DeGrassi, G.; Xu, J.

1999-01-01

A NRC-BNL benchmark program for evaluation of state-of-the-art analysis methods and computer programs for seismic analysis of coupled structures with non-classical damping is described. The program includes a series of benchmarking problems designed to investigate various aspects of complexities, applications and limitations associated with methods for analysis of non-classically damped structures. Discussions are provided on the benchmarking process, benchmark structural models, and the evaluation approach, as well as benchmarking ground rules. It is expected that the findings and insights, as well as recommendations from this program will be useful in developing new acceptance criteria and providing guidance for future regulatory activities involving licensing applications of these alternate methods to coupled systems

The RESTORE program of restorative justice for sex crimes: vision, process, and outcomes.

Science.gov (United States)

Koss, Mary P

2014-06-01

The article reports empirical evaluation of RESTORE, a restorative justice (RJ) conferencing program adapted to prosecutor-referred adult misdemeanor and felony sexual assaults. RESTORE conferences included voluntary enrollment, preparation, and a face-to-face meeting where primary and secondary victims voice impacts, and responsible persons acknowledge their acts and together develop a re-dress plan that is supervised for 1 year. Process data included referral and consent rates, participant characteristics, observational ratings of conferences compared with program design, services delivered, and safety monitoring. Outcome evaluation used 22 cases to assess (a) pre-post reasons for choosing RESTORE, (b) preparation and conference experiences, (c) overall program and justice satisfaction, and (d) completion rates. This is the first peer-reviewed quantitative evaluation of RJ conferencing for adult sexual assault. Although the data have limitations, the results support cautious optimism regarding feasibility, safety, and satisfactory outcomes. They help envision how conferencing could expand and individualize justice options for sexual assault.

Studying the teaching of kindness: A conceptual model for evaluating kindness education programs in schools.

Science.gov (United States)

Kaplan, Deanna M; deBlois, Madeleine; Dominguez, Violeta; Walsh, Michele E

2016-10-01

Recent research suggests that school-based kindness education programs may benefit the learning and social-emotional development of youth and may improve school climate and school safety outcomes. However, how and to what extent kindness education programming influences positive outcomes in schools is poorly understood, and such programs are difficult to evaluate in the absence of a conceptual model for studying their effectiveness. In partnership with Kind Campus, a widely adopted school-based kindness education program that uses a bottom-up program framework, a methodology called concept mapping was used to develop a conceptual model for evaluating school-based kindness education programs from the input of 123 middle school students and approximately 150 educators, school professionals, and academic scholars. From the basis of this model, recommendations for processes and outcomes that would be useful to assess in evaluations of kindness education programs are made, and areas where additional instrument development may be necessary are highlighted. The utility of the concept mapping method as an initial step in evaluating other grassroots or non-traditional educational programming is also discussed. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and Implementation of a Telecommuting Evaluation Framework, and Modeling the Executive Telecommuting Adoption Process

Science.gov (United States)

Vora, V. P.; Mahmassani, H. S.

2002-02-01

This work proposes and implements a comprehensive evaluation framework to document the telecommuter, organizational, and societal impacts of telecommuting through telecommuting programs. Evaluation processes and materials within the outlined framework are also proposed and implemented. As the first component of the evaluation process, the executive survey is administered within a public sector agency. The survey data is examined through exploratory analysis and is compared to a previous survey of private sector executives. The ordinal probit, dynamic probit, and dynamic generalized ordinal probit (DGOP) models of telecommuting adoption are calibrated to identify factors which significantly influence executive adoption preferences and to test the robustness of such factors. The public sector DGOP model of executive willingness to support telecommuting under different program scenarios is compared with an equivalent private sector DGOP model. Through the telecommuting program, a case study of telecommuting travel impacts is performed to further substantiate research.

Use of computer programs to evaluate effectiveness of security systems

International Nuclear Information System (INIS)

Harris, L. Jr.; Goldman, L.A.; Mc Daniel, T.L.

1987-01-01

Thirty or more computer programs for security vulnerability analysis were developed from 1975 through 1980. Most of these programs are intended for evaluating security system effectiveness against outsider threats, but at least six programs are primarily oriented to insider threats. Some strengths and weaknesses of these programs are described. Six of these programs, four for outsider threats and two for insider threats, have been revised and adapted for use with IBM personal computers. The vulnerability analysis process is discussed with emphasis on data collection. The difference between design data and operational data is described. For performance-type operational data, such as detection probabilities and barrier delay times, the difference between unstressed and stressed performance data is discussed. Stressed performance data correspond to situations where an adversary attempts to weaken a security system by mitigating certain security measures. Suggestions are made on the combined use of manual analysis and computer analysis

[Uses and influence of health evaluation in two studies on the Brazilian National Dengue Fever Control Program].

Science.gov (United States)

Figueiró, Ana Cláudia; Hartz, Zulmira; Samico, Isabella; Cesse, Eduarda Angela Pessoa

2012-11-01

Evaluation aims to provide information, promote improvement in programs, and determine the merit and value of the object of evaluation. However, the challenge for evaluators is not only to promote, but also to document the usefulness of studies. Given this challenge, the article aimed to systematize the uses and influence of the process and findings in two evaluations on Brazilian National Dengue Fever Control Program, for decision-making by the respective public health administrators and professionals. Based on a theoretical analytical model, an exploratory study was performed with documental analysis for identification of events and registrations in the evaluations and their circulation in terms of possible uses and influence, from 2007 to 2010. Favorable factors for the use of evaluations were the mode of production of contextual knowledge and definition of evaluations with a focus on utility. The results, indicating greater instrumental use and immediate process and collective use may indicate the studies' pertinence to stakeholders and their usefulness to program management at different levels in the health system.

Physical activity across the curriculum: year one process evaluation results

Directory of Open Access Journals (Sweden)

Sullivan Debra K

2008-07-01

Full Text Available Abstract Background Physical Activity Across the Curriculum (PAAC is a 3-year elementary school-based intervention to determine if increased amounts of moderate intensity physical activity performed in the classroom will diminish gains in body mass index (BMI. It is a cluster-randomized, controlled trial, involving 4905 children (2505 intervention, 2400 control. Methods We collected both qualitative and quantitative process evaluation data from 24 schools (14 intervention and 10 control, which included tracking teacher training issues, challenges and barriers to effective implementation of PAAC lessons, initial and continual use of program specified activities, and potential competing factors, which might contaminate or lessen program effects. Results Overall teacher attendance at training sessions showed exceptional reach. Teachers incorporated active lessons on most days, resulting in significantly greater student physical activity levels compared to controls (p Conclusion In the first year of the PAAC intervention, process evaluation results were instrumental in identifying successes and challenges faced by teachers when trying to modify existing academic lessons to incorporate physical activity.

A program for calculating group constants on the basis of libraries of evaluated neutron data

International Nuclear Information System (INIS)

Sinitsa, V.V.

1987-01-01

The GRUKON program is designed for processing libraries of evaluated neutron data into group and fine-group (having some 300 groups) microscopic constants. In structure it is a package of applications programs with three basic components: a monitor, a command language and a library of functional modules. The first operative version of the package was restricted to obtaining mid-group non-block cross-sections from evaluated neutron data libraries in the ENDF/B format. This was then used to process other libraries. In the next two versions, cross-section table conversion modules and self-shielding factor calculation modules, respectively, were added to the functions already in the package. Currently, a fourth version of the GRUKON applications program package, for calculation of sub-group parameters, is under preparation. (author)

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

Protocol for the process evaluation of a complex intervention designed to increase the use of research in health policy and program organisations (the SPIRIT study).

Science.gov (United States)

Haynes, Abby; Brennan, Sue; Carter, Stacy; O'Connor, Denise; Schneider, Carmen Huckel; Turner, Tari; Gallego, Gisselle

2014-09-27

Process evaluation is vital for understanding how interventions function in different settings, including if and why they have different effects or do not work at all. This is particularly important in trials of complex interventions in 'real world' organisational settings where causality is difficult to determine. Complexity presents challenges for process evaluation, and process evaluations that tackle complexity are rarely reported. This paper presents the detailed protocol for a process evaluation embedded in a randomised trial of a complex intervention known as SPIRIT (Supporting Policy In health with Research: an Intervention Trial). SPIRIT aims to build capacity for using research in health policy and program agencies. We describe the flexible and pragmatic methods used for capturing, managing and analysing data across three domains: (a) the intervention as it was implemented; (b) how people participated in and responded to the intervention; and (c) the contextual characteristics that mediated this relationship and may influence outcomes. Qualitative and quantitative data collection methods include purposively sampled semi-structured interviews at two time points, direct observation and coding of intervention activities, and participant feedback forms. We provide examples of the data collection and data management tools developed. This protocol provides a worked example of how to embed process evaluation in the design and evaluation of a complex intervention trial. It tackles complexity in the intervention and its implementation settings. To our knowledge, it is the only detailed example of the methods for a process evaluation of an intervention conducted as part of a randomised trial in policy organisations. We identify strengths and weaknesses, and discuss how the methods are functioning during early implementation. Using 'insider' consultation to develop methods is enabling us to optimise data collection while minimising discomfort and burden for

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Coal liquefaction process streams characterization and evaluation. Quarterly technical progress report, October 1--December 31, 1991

Energy Technology Data Exchange (ETDEWEB)

Robbins, G.A.; Brandes, S.D.; Winschel, R.A.; Burke, F.P.

1992-03-01

CONSOL R&D is conducting a three-year program to characterize process and product streams from direct coal liquefaction process development projects. The program objectives are two-fold: (1) to obtain and provide appropriate samples of coal liquids for the evaluation of analytical methodology, and (2) to support ongoing DOE-sponsored coal liquefaction process development efforts. The two broad objectives have considerable overlap and together serve to provide a bridge between process development and analytical chemistry.

Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience.

Science.gov (United States)

Bennett, Sara; Ozawa, Sachiko; Rodriguez, Daniela; Paul, Amy; Singh, Kriti; Singh, Suneeta

2015-10-01

In low and middle-income countries, programs funded and implemented by international donors frequently transition to local funding and management, yet such processes are rarely evaluated. We reflect upon experience evaluating the transition of a large scale HIV/AIDS prevention program in India, known as Avahan, in order to draw lessons about transition evaluation approaches and implementation challenges. In terms of conceptualizing the transition theory, the evaluation team identified tensions between the idea of institutionalizing key features of the Avahan program, and ensuring program flexibility to promote sustainability. The transition was planned in three rounds allowing for adaptations to transition intervention and program design during the transition period. The assessment team found it important to track these changes in order to understand which strategies and contextual features supported transition. A mixed methods evaluation was employed, combining semi-structured surveys of transitioning entities (conducted pre and post transition), with longitudinal case studies. Qualitative data helped explain quantitative findings. Measures of transition readiness appeared robust, but we were uncertain of the robustness of institutionalization measures. Finally, challenges to the implementation of such an evaluation are discussed. Given the scarceness of transition evaluations, the lessons from this evaluation may have widespread relevance. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

A multi-stakeholder evaluation of the Baltimore City virtual supermarket program.

Science.gov (United States)

Lagisetty, Pooja; Flamm, Laura; Rak, Summer; Landgraf, Jessica; Heisler, Michele; Forman, Jane

2017-10-23

Increasing access to healthy foods and beverages in disadvantaged communities is a public health priority due to alarmingly high rates of obesity. The Virtual Supermarket Program (VSP) is a Baltimore City Health Department program that uses online grocery ordering to deliver food to low-income neighborhoods. This study evaluates stakeholder preferences and barriers of program implementation. This study assessed the feasibility, sustainability and efficacy of the VSP by surveying 93 customers and interviewing 14 programmatic stakeholders who had recently used the VSP or been involved with program design and implementation. We identified the following themes: The VSP addressed transportation barriers and food availability. The VSP impacted customers and the city by including improving food purchasing behavior, creating a food justice "brand for the city", and fostering a sense of community. Customers appreciated using Supplemental Nutrition Assistance Program (SNAP) benefits to pay for groceries, but policy changes are needed allow online processing of SNAP benefits. This evaluation summarizes lessons learned and serves as a guide to other public health leaders interested in developing similar programs. Provisions in the U.S. Department of Agriculture (USDA) Farm Bill 2014 allow for select grocers to pilot online transactions with SNAP benefits. If these pilots are efficacious, the VSP model could be easily disseminated.

25 CFR 36.50 - Standard XVII-School program evaluation and needs assessment.

Science.gov (United States)

2010-04-01

... MINIMUM ACADEMIC STANDARDS FOR THE BASIC EDUCATION OF INDIAN CHILDREN AND NATIONAL CRITERIA FOR DORMITORY... process evaluation methods. The areas to be reviewed will include, but not be limited to, the following... planning and implementation. (4) Curriculum development and instruction. (5) Primary education. (6) Program...

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

48 CFR 1019.202-70-10 - Application process for mentor firms to participate in the program.

Science.gov (United States)

2010-10-01

... mentor firms to participate in the program. 1019.202-70-10 Section 1019.202-70-10 Federal Acquisition...-70-10 Application process for mentor firms to participate in the program. (a) Firm interested in becoming a mentor firm may apply in writing to Treasury's OSBD. The application will be evaluated based...

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

Formative process evaluation for implementing a social marketing intervention to increase walking among African Americans in the Positive Action for Today's Health trial.

Science.gov (United States)

Coulon, Sandra M; Wilson, Dawn K; Griffin, Sarah; St George, Sara M; Alia, Kassandra A; Trumpeter, Nevelyn N; Wandersman, Abraham K; Forthofer, Melinda; Robinson, Shamika; Gadson, Barney

2012-12-01

Evaluating programs targeting physical activity may help to reduce disparate rates of obesity among African Americans. We report formative process evaluation methods and implementation dose, fidelity, and reach in the Positive Action for Today's Health trial. We applied evaluation methods based on an ecological framework in 2 community-based police-patrolled walking programs targeting access and safety in underserved African American communities. One program also targeted social connectedness and motivation to walk using a social marketing approach. Process data were systematically collected from baseline to 12 months. Adequate implementation dose was achieved, with fidelity achieved but less stable in both programs. Monthly walkers increased to 424 in the walking-plus-social marketing program, indicating expanding program reach, in contrast to no increase in the walking-only program. Increased reach was correlated with peer-led Pride Strides (r = .92; P social marketing component, and program social interaction was the primary reason for which walkers reported participating. Formative process evaluation demonstrated that the walking programs were effectively implemented and that social marketing increased walking and perceived social connectedness in African American communities.

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Design and implementation of an integrated, continuous evaluation, and quality improvement system for a state-based home-visiting program.

Science.gov (United States)

McCabe, Bridget K; Potash, Dru; Omohundro, Ellen; Taylor, Cathy R

2012-10-01

To describe the design and implementation of an evaluation system to facilitate continuous quality improvement (CQI) and scientific evaluation in a statewide home visiting program, and to provide a summary of the system's progress in meeting intended outputs and short-term outcomes. Help Us Grow Successfully (HUGS) is a statewide home visiting program that provides services to at-risk pregnant/post-partum women, children (0-5 years), and their families. The program goals are to improve parenting skills and connect families to needed services and thus improve the health of the service population. The evaluation system is designed to: (1) integrate evaluation into daily workflow; (2) utilize standardized screening and evaluation tools; (3) facilitate a culture of CQI in program management; and, (4) facilitate scientifically rigorous evaluations. The review of the system's design and implementation occurred through a formative evaluation process (reach, dose, and fidelity). Data was collected through electronic and paper surveys, administrative data, and notes from management meetings, and medical chart review. In the design phase, four process and forty outcome measures were selected and are tracked using standardized screening and monitoring tools. During implementation, the reach and dose of training were adequate to successfully launch the evaluation/CQI system. All staff (n = 165) use the system for management of families; the supervisors (n = 18) use the system to track routine program activities. Data quality and availability is sufficient to support periodic program reviews at the region and state level. In the first 7 months, the HUGS evaluation system tracked 3,794 families (7,937 individuals). System use and acceptance is high. A successful implementation of a structured evaluation system with a strong CQI component is feasible in an existing, large statewide program. The evaluation/CQI system is an effective mechanism to drive modest change in management

Program Evaluation - Automotive Lightweighting Materials Program Research and Development Projects Assessment of Benefits - Case Studies No. 2

Energy Technology Data Exchange (ETDEWEB)

Das, S.

2003-01-23

This report is the second of a series of studies to evaluate research and development (R&D) projects funded by the Automotive Lightweighting Materials (ALM) Program of the Office of Advanced Automotive Technologies (OAAT) of the U.S. Department of Energy (DOE). The objectives of the program evaluation are to assess short-run outputs and long-run outcomes that may be attributable to the ALM R&D projects. The ALM program focuses on the development and validation of advanced technologies that significantly reduce automotive vehicle body and chassis weight without compromising other attributes such as safety, performance, recyclability, and cost. Funded projects range from fundamental materials science research to applied research in production environments. Collaborators on these projects include national laboratories, universities, and private sector firms, such as leading automobile manufacturers and their suppliers. Three ALM R&D projects were chosen for this evaluation: Design and Product Optimization for Cast Light Metals, Durability of Lightweight Composite Structures, and Rapid Tooling for Functional Prototyping of Metal Mold Processes. These projects were chosen because they have already been completed. The first project resulted in development of a comprehensive cast light metal property database, an automotive application design guide, computerized predictive models, process monitoring sensors, and quality assurance methods. The second project, the durability of lightweight composite structures, produced durability-based design criteria documents, predictive models for creep deformation, and minimum test requirements and suggested test methods for establishing durability properties and characteristics of random glass-fiber composites for automotive structural composites. The durability project supported Focal Project II, a validation activity that demonstrates ALM program goals and reduces the lead time for bringing new technology into the marketplace. Focal

The portfolio as an evaluation tool: an analysis of its use in an undergraduate nursing program.

Science.gov (United States)

Friedrich, Denise Barbosa de Castro; Gonçalves, Angela Maria Corrêa; de Sá, Tatiana Santos; Sanglard, Leticia Ribeiro; Duque, Débora Ribeiro; de Oliveira, Gabriela Mota Antunes

2010-01-01

This qualitative study was carried out between April and August 2007. It analyzed the use of portfolios in the academic community. A total of nine full-time professors and 119 students enrolled in their third semester were interviewed through a semi-structured interview. Content analysis was used to analyze data. Learning evaluations are seen as a verification of knowledge and efficacy of pedagogical method, and also as an incentive to study. Evaluations are procedural, that is, evaluation is continuous, or one-time, e.g. semester end tests. The portfolio is defined as a gradual and continuous evaluation tool. The faculty members and students need to accept the use of portfolios and evaluate the possibilities of this resource. This study is a first attempt to appraise the evaluation process of an undergraduate program, and the use of portfolios and other strategies needs to be consolidated in order to improve the educational process in undergraduate nursing programs.

Process Evaluation of the Tier 1 Program (Secondary 1 Curriculum of the Project P.A.T.H.S.: Findings Based on the Full Implementation Phase

Directory of Open Access Journals (Sweden)

Daniel T. L. Shek

2008-01-01

Full Text Available To understand the implementation quality of the Tier 1 Program (Secondary 1 Curriculum of the Project P.A.T.H.S. (Positive Adolescent Training through Holistic Social Programmes, observers carried out process evaluation in the form of systematic observations of 22 units in 14 randomly selected schools. Results showed that the overall level of program adherence was generally high (range: 45–100%, with an average of 86.3%. High implementation quality of the program in the areas of student interest, student participation and involvement, classroom control, use of interactive delivery method, use of strategies to enhance student motivation, use of positive and supportive feedbacks, instructors’ familiarity with the students, degree of achievement of the objectives, time management, lesson preparation, overall implementation quality, and success of implementation was also found. The present findings are consistent with those observations based on the experimental implementation phase, suggesting that the implementation quality of the Tier 1 Program (Secondary 1 Curriculum was generally high.

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Waste minimization/pollution prevention at R ampersand D facilities: Implementing the SNL/NM Process Waste Assessment Program

International Nuclear Information System (INIS)

Kjeldgaard, E.A.; Stermer, D.L.; Saloio, J.H. Jr.; Lorton, G.A.

1993-01-01

The Sandia National Laboratories, New Mexico (SNL/NM) Process Waste Assessment (PWA) program began formally on November 2, 1992. This program represents the first laboratory-wide attempt to explicitly identify and characterize SNL/NM's waste generating processes for waste minimization purposes. This paper describes the major elements of the SNL/NM PWA program, the underlying philosophy for designing a PWA program at a highly diverse laboratory setting such as SNL/NM, and the experiences and insights gained from five months of implementing this living program. Specifically, the SNL/NM PWA program consists of four major, interrelated phases: (1) Process Definition, (2) Process Characterization, (3) Waste Minimization Opportunity Assessment, and (4) Project Evaluation, Selection, Implementation, and Tracking. This phased approach was developed to Provide a flexible, yet appropriate, level of detail to the multitude of different ''processes'' at SNL/NM. Using a staff infrastructure of approximately 60 Waste Minimization Network Representatives (MinNet Reps) and consulting support, the SNL/NM PWA program has become the linchpin of even more progressive and proactive environmental, safety, and health (ES ampersand H) initiatives such as: (1) cradle-to-grove material/waste tracking, (2) centralized ES ampersand H reporting, and (3) detailed baselining and tracking for measuring multi-media waste reduction goals. Specific examples from the SNL/NM PWA program are provided, including the results from Process Definition, Process Characterization, and Waste Minimization Opportunity Assessments performed for a typical SNL/NM process

Evaluating a Graduate Professional Development Program for Informal Science Educators

Science.gov (United States)

Lake, Jeremy Paul

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the Informal Science Institutions Environmental Education Graduate Certificate Program truly provided the long term professional development needed to enhance the skills of the formal and informal educators participating so that they could contribute meaningfully to the improvement of science literacy in their respective communities. My role as an internal evaluator provided an extraordinary opportunity to know the intent of the learning opportunities and why they were constructed in a particular fashion. Through the combination of my skills, personal experiences both within the certificate's predecessor and as an educator, I was uniquely qualified to explore the outcomes of this program and evaluate its effectiveness in providing a long-term professional development for participants. After conducting a literature review that emphasized a need for greater scientific literacy in communities across America, it was evident that the formal education enterprise needs the support of informal educators working on the ground in myriad different settings in ways that provide science as both content and process, learning science facts and doing real science. Through a bridging of informal science educators with formal teachers, it was thought each could learn the culture of the other, making each more fluent in accessing community resources to help make these educators more collaborative and able to bridge the classroom with the outside world. This bridge promotes ongoing, lifelong learning, which in turn can help the national goal of greater scientific literacy. This study provided insight into the thinking involved in the learners' growth as they converted theory presented in course materials into practice. Through an iterative process of reviewing the course

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Planning an integrated agriculture and health program and designing its evaluation: Experience from Western Kenya.

Science.gov (United States)

Cole, Donald C; Levin, Carol; Loechl, Cornelia; Thiele, Graham; Grant, Frederick; Girard, Aimee Webb; Sindi, Kirimi; Low, Jan

2016-06-01

Multi-sectoral programs that involve stakeholders in agriculture, nutrition and health care are essential for responding to nutrition problems such as vitamin A deficiency among pregnant and lactating women and their infants in many poor areas of lower income countries. Yet planning such multi-sectoral programs and designing appropriate evaluations, to respond to different disciplinary cultures of evidence, remain a challenge. We describe the context, program development process, and evaluation design of the Mama SASHA project (Sweetpotato Action for Security and Health in Africa) which promoted production and consumption of a bio-fortified, orange-fleshed sweetpotato (OFSP). In planning the program we drew upon information from needs assessments, stakeholder consultations, and a first round of the implementation evaluation of a pilot project. The multi-disciplinary team worked with partner organizations to develop a program theory of change and an impact pathway which identified aspects of the program that would be monitored and established evaluation methods. Responding to the growing demand for greater rigour in impact evaluations, we carried out quasi-experimental allocation by health facility catchment area, repeat village surveys for assessment of change in intervention and control areas, and longitudinal tracking of individual mother-child pairs. Mid-course corrections in program implementation were informed by program monitoring, regular feedback from implementers and partners' meetings. To assess economic efficiency and provide evidence for scaling we collected data on resources used and project expenses. Managing the multi-sectoral program and the mixed methods evaluation involved bargaining and trade-offs that were deemed essential to respond to the array of stakeholders, program funders and disciplines involved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Rain: A New Concurrent Process-Oriented Programming Language

OpenAIRE

Brown, Neil C.C.

2006-01-01

This paper details the design of a new concurrent process-oriented programming language, Rain. The language borrows heavily from occam-p and C++ to create a new language based on process-oriented programming, marrying channel-based communication, a clear division between statement and expression, and elements of functional programming. An expressive yet simple type system, coupled with templates, underpins the language. Modern features such as Unicode support and 64-bit integers are included ...

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Mark of the reconstitution process of the surveillance program of the CLV

International Nuclear Information System (INIS)

Romero, J.; Hernandez, R.; Fernandez, F.

2006-01-01

The surveillance program of the reactor vessel of the nucleo electric central of Mexico it evaluates the mechanical state of the vessel, for it are had surveillance capsules with a series of witness test tubes, subjected to a similar or major neutron flux to that of the vessel. The objective is to evaluate in advance the embrittlement grade of the vessel in its design life. However the number of capsules with the witness test tubes it is only for the design life of the plant and at the moment the nucleo electric plants negotiate an extension of life of these, until for 20 years or more, of there the importance of this witness material that stores the information of the damage accumulated by irradiation. This material requires to be taken advantage after being rehearsed and the normative one settles down as obligatory to qualify the rebuilding process to obtain other 'new' Charpy test tubes that are again introduced in the reactor, reusing this material, as much for the surveillance program as for the extension of the plant life. In this work the qualification of the welding process by 'Stud Welding' for the rebuilding of Charpy test tubes of the surveillance program of the BWR reactor Unit 2 of the Laguna Verde Nucleo electric plant, Veracruz, Mexico is described. (Author)

IPEP: The integrated performance evaluation program for the Department of Energy's Office of Environmental Management

International Nuclear Information System (INIS)

Lindahl, P.C.; Streets, W.E.; Bass, D.A.

1995-01-01

The quality of the analytical data being provided to DOE's Office of Environmental Management (EM) for environmental restoration activities and the extent to which these data meet the data quality objectives are critical in the decision-making process. One of several quality metrics that can be used in evaluating a laboratory is its performance in performance evaluation (PE) programs. In support of DOE's environmental restoration and waste management efforts, EM has been charged with developing and implementing a program to assess the performance of participating laboratories. Argonne National Laboratory (ANL) and DOE's Environmental Measurements Laboratory (EML) and Radiological and Environmental Sciences Laboratory (RESL) have been collaborating on the development and implementation of a comprehensive Integrated Performance Evaluation Program (IPEP) for DOE-wide implementation. The IPEP will use results from existing inorganic, organic, and radiological PE programs when these are available and appropriate for the analytes and matrices being determined for DOE's EM activities. Existing programs include the U.S. Environmental Protection Agency's (EPA's) Contract Laboratory Program (CLP), the Water Supply (WS) and Water Pollution (WP) PE studies for inorganic and organic analytes, and DOE's Quality Assessment Program (QAP) for radiological analytes. In addition, DOE has begun the development of the Mixed Analyte Performance Evaluation Program (MAPEP) to address the needs of the DOE Complex. These PE programs provide a spectrum of matrices and analytes covering the various inorganic, organic, and low-level radiologic categories found in routine environmental and waste samples. These PE programs already provide some assessment of laboratory performance; IPEP will expand these assessments by evaluating historical performance, as well as results from multiple PE programs, thereby providing an enhanced usage of the PE program information

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Methodology for the evaluation process in the director´s preparation from education.

Directory of Open Access Journals (Sweden)

Humberto Clemente Calderón Echevarría

2014-03-01

Full Text Available The presented work proposes a methodology oriented to the evaluation of the process of director´s preparation which may contribute to the improvement of the program. It explains the need of the evaluation, activity as such, indicators to evaluate, methods and techniques to be used and the steps in which have to be done. Until now doesn´t exist a methodology which can evaluate the process of directors’ preparation in the educational sector. The development of this methodology has as a background the result obtained by means of different investigations made in the Provincial Post Office and that later were applied in the Provincial Department of Education. Nowadays is perfected in the Pedagogical University "Capitán Silverio Blanco Núñez", thus, the employment opportunities in similar processes of other entities. In the proposed methodology is conceived that the process evaluation of the director’s preparation flows out in a cyclical manner, continuous, flexible, and interactive, away from the traditional linear formula, rigid and schematic. From the above idea it can be identify four stages, and the relevant procedures, the evaluation of the process of directors’ preparation in education.

A multi-stakeholder evaluation of the Baltimore City virtual supermarket program

Directory of Open Access Journals (Sweden)

Pooja Lagisetty

2017-10-01

Full Text Available Abstract Background Increasing access to healthy foods and beverages in disadvantaged communities is a public health priority due to alarmingly high rates of obesity. The Virtual Supermarket Program (VSP is a Baltimore City Health Department program that uses online grocery ordering to deliver food to low-income neighborhoods. This study evaluates stakeholder preferences and barriers of program implementation. Methods This study assessed the feasibility, sustainability and efficacy of the VSP by surveying 93 customers and interviewing 14 programmatic stakeholders who had recently used the VSP or been involved with program design and implementation. Results We identified the following themes: The VSP addressed transportation barriers and food availability. The VSP impacted customers and the city by including improving food purchasing behavior, creating a food justice “brand for the city”, and fostering a sense of community. Customers appreciated using Supplemental Nutrition Assistance Program (SNAP benefits to pay for groceries, but policy changes are needed allow online processing of SNAP benefits. Conclusions This evaluation summarizes lessons learned and serves as a guide to other public health leaders interested in developing similar programs. Provisions in the U.S. Department of Agriculture (USDA Farm Bill 2014 allow for select grocers to pilot online transactions with SNAP benefits. If these pilots are efficacious, the VSP model could be easily disseminated.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

SOLTECH 92 proceedings: Solar Process Heat Program

Energy Technology Data Exchange (ETDEWEB)

1992-03-01

This document is a limited Proceedings, documenting the presentations given at the symposia conducted by the US Department of Energy's (DOE) Solar Industrial Program and Solar Thermal Electrical Program at SOLTECH92. The SOLTECH92 national solar energy conference was held in Albuquerque, New Mexico during the period February 17--20, 1992. The National Renewable Energy Laboratory manages the Solar Industrial Program; Sandia National Laboratories (Albuquerque) manages the Solar Thermal Electric Program. The symposia sessions were as follows: (1) Solar Industrial Program and Solar Thermal Electric Program Overviews, (2) Solar Process Heat Applications, (3) Solar Decontamination of Water and Soil; (4) Solar Building Technologies, (5) Solar Thermal Electric Systems, (6) PV Applications and Technologies. For each presentation given in these symposia, these Proceedings provide a one- to two-page abstract and copies of the viewgraphs and/or 35mm slides utilized by the speaker. Some speakers provided additional materials in the interest of completeness. The materials presented in this document were not subjected to a peer review process.

Use of qualitative analysis to supplement program evaluation of a faculty development program

Directory of Open Access Journals (Sweden)

Thomas V Chacko

2013-01-01

Full Text Available Introduction: Generally for Program Evaluation of workshops, a structured questionnaire is used to measure learner satisfaction and learning and it yields results in quantitative terms and if there are open-ended questions, it yields a long list of responses which the evaluator finds it difficult to use. Hence, we used qualitative research methods to supplement it for a holistic understanding of the quality and extent of their learning. Materials and Methods: A faculty development program was used opportunistically to gather data using open-ended questions designed to elicit "thick descriptions" about their learning. Using the Grounded Theory approach where the data drives further analysis, data analysis was done by faculty in three groups using inductive reasoning leading to emergence of themes and categories of responses. The commonalities in the themes that emerged independently in the three groups as well as member checking to seek their agreement with the group′s observation of the primary data were used to ensure validity of the findings. Results: Themes and categories of new learning in terms of knowledge, skills, attitudes and processes emerged which gives a better understanding of the extent of the learning and its applicability to future professional tasks. The open-ended questions encouraging participants to give "thick description" of their learning yielded many quotable quotes which indicate the quality of their learning. Conclusion: The use of open-ended questions and qualitative research method of data analysis using the Grounded Theory approach helps in holistic understanding of the focus and quality of learning that is not usually possible through quantitative research methods. Hence, it is recommended that when understanding of the extent and quality of learning is important, traditional method of program evaluation should be supplemented with qualitative research methods as they are more effective in convincing decision

76 FR 30696 - Technology Evaluation Process

Science.gov (United States)

2011-05-26

...-NOA-0039] Technology Evaluation Process AGENCY: Office of Energy Efficiency and Renewable Energy... (DOE) seeks comments and information related to a commercial buildings technology evaluation process... evaluation efforts. The goal of creating this standard process is to evaluate energy-saving technologies in a...

Evaluation of effects of program for improving skills and motivation for employment

Directory of Open Access Journals (Sweden)

Marić Zorica

2011-01-01

Full Text Available Contemporary programs that have been implemented in order to help unemployed reduce time for finding a job are based on clear theoretical background and empirical evidence. In addition to providing opportunities to learn necessary skills, these programs also incorporate important psychological components which will be addressed in this paper. The goal of these interventions is to reduce time for finding a job, prevent long-term unemployment and negative effects of unemployment on individuals“ mental health. The paper presents evaluation of the effects of these psychological interventions. The program was based on Ajzen’s theory of planned behavior (2005, Bandura’s social-cognitive theory (1997 and cognitive-behavior theory of behavioral change (Meichenbaum, 1993. The goal of this program was to help unemployed individuals take an active role in finding a job, reduce time for finding a job and prevent negative effects of unemployment on their mental health. The target group of the program were young unemployed individuals ages 19 - 30, with at least high school level of education. Evaluation study was conducted on a sample of 92 male and female individuals who attended 3-day psychological program. Participants filled out five short scales specifically designed to assess variables that were targeted for change, such as, active approach to finding a job, attitudes toward process of employment, self-efficacy and resilience to frustrations and obstacles. Scales were administered before and after the training. Evaluation results, based on these pre and post measures, showed significant positive effects of this program on all five variables.

Comparison and Analysis of Evaluation System of Child Care Program in Primary Health Care System in the East Azerbaijan Province Based on Comprehensive Evaluation Model (CIPP

Directory of Open Access Journals (Sweden)

Yalda Mousa Zadeh

2015-08-01

Full Text Available Background and objectives: Planning plays an important role in improving children's health and an evaluation system is necessary to planning. The purpose of this study was comparing and analyzing evaluation system of child care program in primary health care system in the Eastern Azerbaijan province based on Comprehensive Evaluation Model (CIPP. Material and Methods : This is a cross sectional study. The process includes a review of current evaluation system, comparison and analysis of the system based on a comprehensive model and to assess and identify the strengths and weaknesses of the current systems. The quantitative methods (such as brainstorming, observation and interview and consensus of study group about the results of the study were used for analyzing and interpreting results. Results: It showed that not enough attention was paid to the context and performance and the content of evaluation just includes inputs and processes based on the finding. Specific criteria and impact were considered in four areas (context, input, process and outcome and all levels which were according to the proposal and based on the CIPP model. Conclusion: Evaluation is a control process tool by higher levels and self-assessment by service provider is not considered in the current system. Evaluation includes quantitative aspects and not the quality of process. So, it is recommended that forecasting system that utilizes evaluation will result in improving future planning and a scientific model to be used in designing evaluation program. ​

Process-Oriented Parallel Programming with an Application to Data-Intensive Computing

OpenAIRE

Givelberg, Edward

2014-01-01

We introduce process-oriented programming as a natural extension of object-oriented programming for parallel computing. It is based on the observation that every class of an object-oriented language can be instantiated as a process, accessible via a remote pointer. The introduction of process pointers requires no syntax extension, identifies processes with programming objects, and enables processes to exchange information simply by executing remote methods. Process-oriented programming is a h...

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

Science.gov (United States)

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

The intervention process in the European Fans in Training (EuroFIT) trial: a mixed method protocol for evaluation.

Science.gov (United States)

van de Glind, I; Bunn, C; Gray, C M; Hunt, K; Andersen, E; Jelsma, J; Morgan, H; Pereira, H; Roberts, G; Rooksby, J; Røynesdal, Ø; Silva, M; Sorensen, M; Treweek, S; van Achterberg, T; van der Ploeg, H; van Nassau, F; Nijhuis-van der Sanden, M; Wyke, S

2017-07-27

EuroFIT is a gender-sensitised, health and lifestyle program targeting physical activity, sedentary time and dietary behaviours in men. The delivery of the program in football clubs, led by the clubs' community coaches, is designed to both attract and engage men in lifestyle change through an interest in football or loyalty to the club they support. The EuroFIT program will be evaluated in a multicentre pragmatic randomised controlled trial (RCT), for which ~1000 overweight men, aged 30-65 years, will be recruited in 15 top professional football clubs in the Netherlands, Norway, Portugal and the UK. The process evaluation is designed to investigate how implementation within the RCT is achieved in the various football clubs and countries and the processes through which EuroFIT affects outcomes. This mixed methods evaluation is guided by the Medical Research Council (MRC) guidance for conducting process evaluations of complex interventions. Data will be collected in the intervention arm of the EuroFIT trial through: participant questionnaires (n = 500); attendance sheets and coach logs (n = 360); observations of sessions (n = 30); coach questionnaires (n = 30); usage logs from a novel device for self-monitoring physical activity and non-sedentary behaviour (SitFIT); an app-based game to promote social support for physical activity outside program sessions (MatchFIT); interviews with coaches (n = 15); football club representatives (n = 15); and focus groups with participants (n = 30). Written standard operating procedures are used to ensure quality and consistency in data collection and analysis across the participating countries. Data will be analysed thematically within datasets and overall synthesis of findings will address the processes through which the program is implemented in various countries and clubs and through which it affects outcomes, with careful attention to the context of the football club. The process evaluation will

Introduction of blended learning in a master program: Developing an integrative mixed method evaluation framework.

Science.gov (United States)

Chmiel, Aviva S; Shaha, Maya; Schneider, Daniel K

2017-01-01

The aim of this research is to develop a comprehensive evaluation framework involving all actors in a higher education blended learning (BL) program. BL evaluation usually either focuses on students, faculty, technological or institutional aspects. Currently, no validated comprehensive monitoring tool exists that can support introduction and further implementation of BL in a higher education context. Starting from established evaluation principles and standards, concepts that were to be evaluated were firstly identified and grouped. In a second step, related BL evaluation tools referring to students, faculty and institutional level were selected. This allowed setting up and implementing an evaluation framework to monitor the introduction of BL during two succeeding recurrences of the program. The results of the evaluation allowed documenting strengths and weaknesses of the BL format in a comprehensive way, involving all actors. It has led to improvements at program, faculty and course level. The evaluation process and the reporting of the results proved to be demanding in time and personal resources. The evaluation framework allows measuring the most significant dimensions influencing the success of a BL implementation at program level. However, this comprehensive evaluation is resource intensive. Further steps will be to refine the framework towards a sustainable and transferable BL monitoring tool that finds a balance between comprehensiveness and efficiency. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating Knowledge, Attitudinal, and Behavioral Change Effects from a Multinational HIV/AIDS Education Program for Youth

Science.gov (United States)

Hardre, Patricia L.; Garcia, Fe; Apamo, Peter; Mutheu, Lucy; Ndege, Monica; Bois, Iderle

2010-01-01

This project tracked the mid-term evaluation processes, practices, and products of a multinational program to reduce at-risk behaviors for HIV/AIDS among children in Kenya, Tanzania, and Haiti. It focused on participant and community perceptions; program effectiveness in promoting abstinence and monogamy decisions; and factors supporting ongoing…

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

Thinking processes used by high-performing students in a computer programming task

Directory of Open Access Journals (Sweden)

Marietjie Havenga

2011-07-01

Full Text Available Computer programmers must be able to understand programming source code and write programs that execute complex tasks to solve real-world problems. This article is a trans- disciplinary study at the intersection of computer programming, education and psychology. It outlines the role of mental processes in the process of programming and indicates how successful thinking processes can support computer science students in writing correct and well-defined programs. A mixed methods approach was used to better understand the thinking activities and programming processes of participating students. Data collection involved both computer programs and students’ reflective thinking processes recorded in their journals. This enabled analysis of psychological dimensions of participants’ thinking processes and their problem-solving activities as they considered a programming problem. Findings indicate that the cognitive, reflective and psychological processes used by high-performing programmers contributed to their success in solving a complex programming problem. Based on the thinking processes of high performers, we propose a model of integrated thinking processes, which can support computer programming students. Keywords: Computer programming, education, mixed methods research, thinking processes.  Disciplines: Computer programming, education, psychology

Programs for low-energy nuclear physics data processing

International Nuclear Information System (INIS)

Antuf'ev, Yu.P.; Dejneko, A.S.; Ekhichev, O.I.; Kuz'menko, V.A.; Mashkarov, Yu.G.; Nemashkalo, B.A.; Skakun, E.A.; Storizhko, V.E.; Shlyakhov, N.A.

1978-01-01

Purpose of six computer programs developed in KhPTI of AN USSR for the processing of the experimental data on low energy nuclear physics ia friendly described. The programs are written in Algol-60 language. They are applied to some types of nuclear reactions and permit to process differential cross sections and γ spectra, to compute statistical tensors and excitation functions as well as to analyze some processes by means of theoretical models

NMRFx Processor: a cross-platform NMR data processing program

International Nuclear Information System (INIS)

Norris, Michael; Fetler, Bayard; Marchant, Jan; Johnson, Bruce A.

2016-01-01

NMRFx Processor is a new program for the processing of NMR data. Written in the Java programming language, NMRFx Processor is a cross-platform application and runs on Linux, Mac OS X and Windows operating systems. The application can be run in both a graphical user interface (GUI) mode and from the command line. Processing scripts are written in the Python programming language and executed so that the low-level Java commands are automatically run in parallel on computers with multiple cores or CPUs. Processing scripts can be generated automatically from the parameters of NMR experiments or interactively constructed in the GUI. A wide variety of processing operations are provided, including methods for processing of non-uniformly sampled datasets using iterative soft thresholding. The interactive GUI also enables the use of the program as an educational tool for teaching basic and advanced techniques in NMR data analysis.

NMRFx Processor: a cross-platform NMR data processing program

Energy Technology Data Exchange (ETDEWEB)

Norris, Michael; Fetler, Bayard [One Moon Scientific, Inc. (United States); Marchant, Jan [University of Maryland Baltimore County, Howard Hughes Medical Institute (United States); Johnson, Bruce A., E-mail: bruce.johnson@asrc.cuny.edu [One Moon Scientific, Inc. (United States)

2016-08-15

NMRFx Processor is a new program for the processing of NMR data. Written in the Java programming language, NMRFx Processor is a cross-platform application and runs on Linux, Mac OS X and Windows operating systems. The application can be run in both a graphical user interface (GUI) mode and from the command line. Processing scripts are written in the Python programming language and executed so that the low-level Java commands are automatically run in parallel on computers with multiple cores or CPUs. Processing scripts can be generated automatically from the parameters of NMR experiments or interactively constructed in the GUI. A wide variety of processing operations are provided, including methods for processing of non-uniformly sampled datasets using iterative soft thresholding. The interactive GUI also enables the use of the program as an educational tool for teaching basic and advanced techniques in NMR data analysis.

Laboratory quality assurance and its role in the safeguards analytical laboratory evaluation (SALE) program

International Nuclear Information System (INIS)

Delvin, W.L.; Pietri, C.E.

1981-07-01

Since the late 1960's, strong emphasis has been given to quality assurance in the nuclear industry, particularly to that part involved in nuclear reactors. This emphasis has had impact on the analytical chemistry laboratory because of the importance of analytical measurements in the certification and acceptance of materials used in the fabrication and construction of reactor components. Laboratory quality assurance, in which the principles of quality assurance are applied to laboratory operations, has a significant role to play in processing, fabrication, and construction programs of the nuclear industry. That role impacts not only process control and material certification, but also safeguards and nuclear materials accountability. The implementation of laboratory quality assurance is done through a program plan that specifies how the principles of quality assurance are to be applied. Laboratory quality assurance identifies weaknesses and deficiencies in laboratory operations and provides confidence in the reliability of laboratory results. Such confidence in laboratory measurements is essential to the proper evaluation of laboratories participating in the Safeguards Analytical Laboratory Evaluation (SALE) Program

Improving NASA's technology transfer process through increased screening and evaluation in the information dissemination program

Science.gov (United States)

Laepple, H.

1979-01-01

The current status of NASA's technology transfer system can be improved if the technology transfer process is better understood. This understanding will only be gained if a detailed knowledge about factors generally influencing technology transfer is developed, and particularly those factors affecting technology transfer from government R and D agencies to industry. Secondary utilization of aerospace technology is made more difficult because it depends on a transfer process which crosses established organizational lines of authority and which is outside well understood patterns of technical applications. In the absence of a sound theory about technology transfer and because of the limited capability of government agencies to explore industry's needs, a team approach to screening and evaluation of NASA generated technologies is proposed which calls for NASA, and other organizations of the private and public sectors which influence the transfer of NASA generated technology, to participate in a screening and evaluation process to determine the commercial feasibility of a wide range of technical applications.

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Ontario's emergency department process improvement program: the experience of implementation.

Science.gov (United States)

Rotteau, Leahora; Webster, Fiona; Salkeld, Erin; Hellings, Chelsea; Guttmann, Astrid; Vermeulen, Marian J; Bell, Robert S; Zwarenstein, Merrick; Rowe, Brian H; Nigam, Amit; Schull, Michael J

2015-06-01

In recent years, Lean manufacturing principles have been applied to health care quality improvement efforts to improve wait times. In Ontario, an emergency department (ED) process improvement program based on Lean principles was introduced by the Ministry of Health and Long-Term Care as part of a strategy to reduce ED length of stay (LOS) and to improve patient flow. This article aims to describe the hospital-based teams' experiences during the ED process improvement program implementation and the teams' perceptions of the key factors that influenced the program's success or failure. A qualitative evaluation was conducted based on semistructured interviews with hospital implementation team members, such as team leads, medical leads, and executive sponsors, at 10 purposively selected hospitals in Ontario, Canada. Sites were selected based, in part, on their changes in median ED LOS following the implementation period. A thematic framework approach as used for interviews, and a standard thematic coding framework was developed. Twenty-four interviews were coded and analyzed. The results are organized according to participants' experience and are grouped into four themes that were identified as significantly affecting the implementation experience: local contextual factors, relationship between improvement team and support players, staff engagement, and success and sustainability. The results demonstrate the importance of the context of implementation, establishing strong relationships and communication strategies, and preparing for implementation and sustainability prior to the start of the project. Several key factors were identified as important to the success of the program, such as preparing for implementation, ensuring strong executive support, creation of implementation teams based on the tasks and outcomes of the initiative, and using multiple communication strategies throughout the implementation process. Explicit incorporation of these factors into the

76 FR 37344 - Technology Evaluation Process

Science.gov (United States)

2011-06-27

...-NOA-0039] Technology Evaluation Process AGENCY: Office of Energy Efficiency and Renewable Energy... seeks comments and information related to a commercial buildings technology evaluation process. DOE is seeking to create a process for evaluating emerging and underutilized energy efficient technologies for...

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Process Evaluation of a Community Garden at an Urban Outpatient Clinic.

Science.gov (United States)

Milliron, Brandy-Joe; Vitolins, Mara Z; Gamble, Elizabeth; Jones, Robert; Chenault, Margaret C; Tooze, Janet A

2017-08-01

In addition to expediting patient recovery, community gardens that are associated with medical facilities can provide fresh produce to patients and their families, serve as a platform for clinic-based nutrition education, and help patients develop new skills and insights that can lead to positive health behavior change. While community gardening is undergoing resurgence, there is a strong need for evaluation studies that employ valid and reliable measures. The objective of this study was to conduct a process evaluation of a community garden program at an urban medical clinic to estimate the prevalence of patient awareness and participation, food security, barriers to participation, and personal characteristics; garden volunteer satisfaction; and clinic staff perspectives in using the garden for patient education/treatment. Clinic patients (n = 411) completed a community garden participation screener and a random sample completed a longer evaluation survey (n = 152); garden volunteers and medical staff completed additional surveys. Among patients, 39% had heard of and 18% had received vegetables from the garden; the greatest barrier for participation was lack of awareness. Volunteers reported learning about gardening, feeling more involved in the neighborhood, and environmental concern; and medical staff endorsed the garden for patient education/treatment. Comprehensive process evaluations can be utilized to quantify benefits of community gardens in medical centers as well as to point out areas for further development, such as increasing patient awareness. As garden programming at medical centers is formalized, future research should include systematic evaluations to determine whether this unique component of the healthcare environment helps improve patient outcomes.

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Reflections of Bologna Process on Websites of Undergraduate Nursing Programs in Turkey

Directory of Open Access Journals (Sweden)

Tuğçe TÜRTEN KAYMAZ

2017-04-01

Full Text Available This study was conducted to investigate the data about the Bologna Process on the websites of universities’ undergraduate nursing programs in Turkey. In this descriptive study, all state and private universities which have BSc Nursing Programs and are within the scope of the Council of Higher Education of Turkey were included. Data were collected between May 1st and June 1st, 2015 by searching the websites of universities that were included in this study. An Evaluation Form that was developed by the researchers was used to collect data. Data were analyzed by using frequencies and percentages. We found that 77.2% of the universities included in the study were state universities and information about the Bologna Process could be found by using the website link on the main page in 65.3% of these universities. The majority of the universities (87.1% had general information about their program but 44% did not take the European Credit Transfer System into consideration on compulsory lessons and 41% of them on elective lessons. It was found that the majority of essential nursing lessons held by eight departments in BSc of Nursing programs had an Information Package of Lessons (68.1%-77.6% and that this package contained information on the European Credit Transfer System Credits in 72.3%-82.7% and calculations of student workload in 54.2%-65.6%. In conclusion, the universities with BSc Nursing Program did not have full information about the Bologna Process on their websites. We recommend making the necessary updates on these websites according to the standard format of the Council of Higher Education of Turkey to avoid giving inadequate and false information about the Bologna Process.

Understanding Leisure-related Program Effects by Using Process Data in the HealthWise South Africa Project.

Science.gov (United States)

Caldwell, Linda L; Younker, Anita S; Wegner, Lisa; Patrick, Megan E; Vergnani, Tania; Smith, Edward A; Flisher, Alan J

2008-01-01

As the push for evidence-based programming gathers momentum, many human services programs and interventions are under increased scrutiny to justify their effectiveness across different conditions and populations. Government agencies and the public want to be assured that their resources are being put to good use on programs that are effective and efficient (Guskey, 2000). Thus, programs are increasingly based on theory and evaluated through randomized control trials using longitudinal data. Despite this progress, hypothesized outcomes are often not detected and/or their effect sizes are small (Gingiss, Roberts-Gray, Boerm, 2006). Moreover, findings may go against intuition or "gut feelings" on the part of project staff. Given the need to understand how program implementation issues relate to outcomes, this study focuses on whether process measures that focus on program implementation and fidelity can shed light on associated outcomes. In particular, we linked the process evaluation of the HealthWise motivation lesson with outcomes across four waves of data collection. We hypothesized that HealthWise would increase learners' intrinsic and identified forms of motivation, and decrease amotivation and extrinsic motivation. We did not hypothesize a direction of effects on introjected motivation due to its conceptual ambiguity. Data came from youth in four intervention schools (n = 902, 41.1%) and five control schools (n = 1291, 58.9%) who were participating in a multi-cohort, longitudinal study. The schools were in a township near Cape Town, South Africa. For each cohort, baseline data are collected on learners as they begin Grade 8. We currently have four waves of data collected on the first cohort, which is the focus of this paper. The mean age of the sample at Wave 3 was 15.0 years (SD = .86) and 51% of students were female. Results suggested that there was evidence of an overall program effect of the curriculum on amotivation regardless of fidelity of implementation

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Risk-based analysis for prioritization and processing in the Los Alamos National Laboratory 94-1 program

International Nuclear Information System (INIS)

Boerigter, S.T.; DeMuth, N.S.; Tietjen, G.

1996-10-01

A previous report, open-quotes Analysis of LANL Options for Processing Plutonium Legacy Materials,close quotes LA-UR-95-4301, summarized the development of a risk-based prioritization methodology for the Los Alamos National Laboratory (LANL) Plutonium Facility at Technical Area-55 (TA-55). The methodology described in that report was developed not only to assist processing personnel in prioritizing the remediation of legacy materials but also to evaluate the risk impacts of schedule modifications and changes. Several key activities were undertaken in the development of that methodology. The most notable was that the risk assessments were based on statistically developed data from sampling containers in the vault and evaluating their condition; the data from the vault sampling programs were used as the basis for risk estimates. Also, the time-dependent behavior of the legacy materials was explicitly modeled and included in the risk analysis. The results indicated that significant reductions in program risk can be achieved by proper prioritization of the materials for processing

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.

2000-01-01

The action program Energy 2000 has been continually reviewed by independent experts in view of its effects. This resulted in around 50 scientific studies between 1991 and 1999, dealing with different aspects of the program. In the book 'Energy 2000: effects of the program and conclusions from its evaluation', the results of these evaluations are summarised, and conclusions for the design of the follow-up program are drawn. The organisational frame of the program is presented and the question answered whether the determining principles of the program proved practical. Besides, the effects of state intervention, of the conflict solving groups and the voluntary actions of Energy 2000 are appraised. A separate chapter is dedicated to the evaluation strategy of the program, its implementation and the benefits of the evaluations. Propositions for the evaluation of the follow-up program are formulated as well. Dr. Andreas Balthasar is President of the Swiss Evaluation Society. (author)

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

A report on evaluation of research and development subjects in fiscal year 2001. Evaluation subject on the 'Middle- and long-term business program'

International Nuclear Information System (INIS)

2001-09-01

The middle- and long-term business program determined by the Japan Nuclear Cycle Development Institute (JNC) is for elucidation of middle- and long-term targets to be expanded by JNC and is a base to promote individual R and D. This program is to be revised at a chance established on new long-term plan on research, development and application of nuclear energy on November, 2000 by the Committee of Atomic Energy under consideration of condition change after March, 1999. This report is a summary of evaluation results on the present middle- and long-term business program established by JNC, especially at a center of its revised portion, as a form of opinion. The evaluated results are described on two forms of the subject evaluation committees on the fast reactor and fuel cycle and on the wastes processing and disposal. (G.K.)

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

SIP: A Web-Based Astronomical Image Processing Program

Science.gov (United States)

Simonetti, J. H.

1999-12-01

I have written an astronomical image processing and analysis program designed to run over the internet in a Java-compatible web browser. The program, Sky Image Processor (SIP), is accessible at the SIP webpage (http://www.phys.vt.edu/SIP). Since nothing is installed on the user's machine, there is no need to download upgrades; the latest version of the program is always instantly available. Furthermore, the Java programming language is designed to work on any computer platform (any machine and operating system). The program could be used with students in web-based instruction or in a computer laboratory setting; it may also be of use in some research or outreach applications. While SIP is similar to other image processing programs, it is unique in some important respects. For example, SIP can load images from the user's machine or from the Web. An instructor can put images on a web server for students to load and analyze on their own personal computer. Or, the instructor can inform the students of images to load from any other web server. Furthermore, since SIP was written with students in mind, the philosophy is to present the user with the most basic tools necessary to process and analyze astronomical images. Images can be combined (by addition, subtraction, multiplication, or division), multiplied by a constant, smoothed, cropped, flipped, rotated, and so on. Statistics can be gathered for pixels within a box drawn by the user. Basic tools are available for gathering data from an image which can be used for performing simple differential photometry, or astrometry. Therefore, students can learn how astronomical image processing works. Since SIP is not part of a commercial CCD camera package, the program is written to handle the most common denominator image file, the FITS format.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

Oak Ridge National Laboratory Embrittlement Data Base (EDB) and Dosimetry Evaluation (DE) program

International Nuclear Information System (INIS)

Pace, J.V. III; Remec, I.; Wang, J.A.; White, J.E.

1996-01-01

The objective of this program is to develop, maintain, and upgrade computerized data bases, calculational procedures, and standards relating to reactor pressure vessel fluence spectra determinations and embrittlement assessments. As part of this program, the information from radiation embrittlement research on nuclear reactor pressure vessel steels and from power reactor surveillance reports is maintained in a data base published on a periodic basis. The Embrittlement Data Base (EDB) effort consists of verifying the quality of the EDB, providing user-friendly software to access and process the data, and exploring and assessing embrittlement prediction models. The Dosimetry Evaluation effort consists of maintaining and upgrading validated neutron and gamma radiation transport procedures, maintaining cross-section libraries with the latest evaluated nuclear data, and maintaining and updating validated dosimetry procedures and data bases. The information available from this program provides data for assisting the Office of Nuclear Reactor Regulation, with support from the Office of Nuclear Regulatory Research, to effectively monitor current procedures and data bases used by vendors, utilities, and service laboratories in the pressure vessel irradiation surveillance program

Design and evaluation of the computer-based training program Calcularis for enhancing numerical cognition

Directory of Open Access Journals (Sweden)

Tanja eKäser

2013-08-01

Full Text Available This article presents the design and a first pilot evaluation of the computer-based training program Calcularis for children with developmental dyscalculia (DD or difficulties in learning mathematics. The program has been designed according to insights on the typical and atypical development of mathematical abilities. The learning process is supported through multimodal cues, which encode different properties of numbers. To offer optimal learning conditions, a user model completes the program and allows flexible adaptation to a child’s individual learning and knowledge profile. 32 children with difficulties in learning mathematics completed the 6 to 12-weeks computer training. The children played the game for 20 minutes per day for 5 days a week. The training effects were evaluated using neuropsychological tests. Generally, children benefited significantly from the training regarding number representation and arithmetic operations. Furthermore, children liked to play with the program and reported that the training improved their mathematical abilities.

Program evaluation: Weatherization Residential Assistance Partnership (WRAP) Program

Energy Technology Data Exchange (ETDEWEB)

1991-12-01

The Connecticut low income weatherization program was developed in response to a 1987 rate docket order from the Connecticut Department of Public Utility Control (DPUC) to Connecticut Light Power Co., an operating subsidiary of Northeast Utilities (NU). (Throughout this report, NU is referred to as the operator of the program.) This program, known as the Weatherization Residential Assistance Partnership, or WRAP, was configured utilizing input from a collaborative group of interested parties to the docket. It was agreed that this program would be put forth by the electric utility, but would not ignore oil and gas savings (thus, it was to be fuel- blind''). The allocated cost of conservation services for each fuel source, however, should be cost effective. It was to be offered to those utility customers at or below 200 percent of the federal poverty levels, and provide a wide array of energy saving measures directed toward heating, water heating and lighting. It was felt by the collaborative group that this program would raise the level of expenditures per participant for weatherization services provided by the state, and by linking to and revising the auditing process for weatherization, would lower the audit unit cost. The program plans ranged from the offering of low-cost heating, water heating and infiltration measures, increased insulation levels, carpentry and plumbing services, to furnace or burner replacement. The program was configured to allow for very comprehensive weatherization and heating system servicing.

Evaluating the Fabreville Heart Health Program in Laval, Canada: a dialogue between two paradigms, positivism and constructivism.

Science.gov (United States)

Nguyen, Minh Nguyet; Otis, Joanne

2003-06-01

As part of the Canadian Federal-Provincial Initiative in Heart Health, the goal of the Fabreville Heart Health Program was to sensitize a district of Laval, Quebec's second most populous city, to heart-healthy behaviours. The program was planned and implemented by a committee composed of Fabreville community leaders and professionals from the Public Health Department. Between 1992 and 1994, intervention objectives were defined by the department in terms of changing individual behaviours associated with cardiovascular risk factors, namely diet, sedentariness and smoking, as well as adapting physical and social environments to facilitate these changes. However, from 1994 to its conclusion in 1997, the program was re-oriented to engage the population in mobilizing their own community and taking charge of interventions themselves. Actions then became dependent on the interests and motivation of Fabreville residents to transform their lifestyles and aspects of their physical environment. The initial evaluation process, based on the positivist paradigm, was designed to measure changes in individual behaviours and certain physical environments, such as an increase in designated non-smoking areas. However, following the re-orientation towards community mobilization, it was decided that evaluation should go beyond the professional production of data to include a process of the collective construction of knowledge. Evaluation methodology then became based on the constructivist paradigm. Yet field constraints such as lack of community involvement in both leadership and process evaluation, and the need to ensure evaluation standards and fulfil sponsor obligations, compelled the Public Health Department to return to using a certain number of positivist methods. The ensuing inter-paradigm dialogue helped broaden the scope of evaluation and contributed to gaining a more in-depth understanding of the processes and outcomes of community mobilization.

Evaluation of a child sexual abuse prevention program.

Science.gov (United States)

Chasan-Taber, L; Tabachnick, J

1999-10-01

A half-million children are believed to be sexually abused each year in the United States. In 1995, the American Medical Association declared sexual assault "a silent violent epidemic." The majority of efforts to stop child sexual abuse have focused on punishing abusers and treating victims and their families; prevention programs are uncommon and rely on educating children to report sexual abuse. This case study describes the evaluation of the first public health campaign designed to target adults for prevention. A baseline assessment of attitudes, awareness, knowledge, and policies was conducted in Vermont to identify facilitators and barriers to adult prevention of child sexual abuse. These included predisposing factors (50% of Vermont residents did not know the characteristics of an abuser), enabling factors (60% of Vermont residents did not know where to refer someone who may have sexual behavior problems), and reinforcing factors (when focus group participants knew an abuser, they were less likely to take action). This process guided the intervention, which included a broad-based media campaign targeting adults; a one-to-one communications strategy that provided information to agencies working with families at risk and a toll-free helpline for adults in an abuse situation; and a systems change strategy designed to educate decision-makers and leaders. Program evaluation measures included a random-digit dial survey, focus groups, a survey of Vermont decision-makers, and other data sets. The successes and limitations of these interventions, both as strategies in themselves and as data sources for evaluation, are discussed.

Efficient separations & processing crosscutting program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-08-01

The Efficient Separations and Processing Crosscutting Program (ESP) was created in 1991 to identify, develop, and perfect chemical and physical separations technologies and chemical processes which treat wastes and address environmental problems throughout the DOE complex. The ESP funds several multiyear tasks that address high-priority waste remediation problems involving high-level, low-level, transuranic, hazardous, and mixed (radioactive and hazardous) wastes. The ESP supports applied research and development (R & D) leading to the demonstration or use of these separations technologies by other organizations within the Department of Energy (DOE), Office of Environmental Management.

Adaptation of Lean Six Sigma Methodologies for the Evaluation of Veterans Choice Program at 3 Urban Veterans Affairs Medical Centers.

Science.gov (United States)

Ball, Sherry L; Stevenson, Lauren D; Ladebue, Amy C; McCreight, Marina S; Lawrence, Emily C; Oestreich, Taryn; Lambert-Kerzner, Anne C

2017-07-01

The Veterans Health Administration (VHA) is adapting to meet the changing needs of our Veterans. VHA leaders are promoting quality improvement strategies including Lean Six Sigma (LSS). This study used LSS tools to evaluate the Veterans Choice Program (VCP), a program that aims to improve access to health care services for eligible Veterans by expanding health care options to non-VHA providers. LSS was utilized to assess the current process and efficiency patterns of the VCP at 3 VHA Medical Centers. LSS techniques were used to assess data obtained through semistructured interviews with Veterans, staff, and providers to describe and evaluate the VCP process by identifying wastes and defects. The LSS methodology facilitated the process of targeting priorities for improvement and constructing suggestions to close identified gaps and inefficiencies. Identified key process wastes included inefficient exchange of clinical information between stakeholders in and outside of the VHA; poor dissemination of VCP programmatic information; shortages of VCP-participating providers; duplication of appointments; declines in care coordination; and lack of program adaptability to local processes. Recommendations for improvement were formulated using LSS. This evaluation illustrates how LSS can be utilized to assess a nationally mandated health care program. By focusing on stakeholder, staff, and Veteran perspectives, process defects in the VCP were identified and improvement recommendations were made. However, the current LSS language used is not intuitive in health care and similar applications of LSS may consider using new language and goals adapted specifically for health care.

Programmatic environmental assessment of the DOE Solar Agricultural and Industrial Process Heat Program

Energy Technology Data Exchange (ETDEWEB)

1979-06-01

The program's potential environmental impacts are evaluated to ensure that environmental issues are considered at the earliest meaningful point in the decision-making process. The existing environment is studied for the following: grain drying; crop drying; livestock shelter heating; food processing; textile products; lumber and wood products; paper products; chemicals; petroleum refining; stone, clay, and glass products; and primary metals industries. Environmental impacts of the proposed action on the following are studied: air quality, water quality, ecosystems, health and safety, land use, esthetics, and social and institutional impacts. (MHR)

Integrating critical Web skills and content knowledge: Development and evaluation of a 5th grade educational program

NARCIS (Netherlands)

Kuiper, E.; Volman, M.L.L.; Terwel, J.

2008-01-01

Although the Web is almost omnipresent in many children's lives, most children lack adequate Web searching skills as well as skills to process and critically evaluate Web information. In this article, we describe and evaluate an educational program that aimed at acquiring Web skills in the context

[Evaluation of prerequisites programs for a HACCP plan for frozen sardine plant].

Science.gov (United States)

Rosas, Patricia; Reyes, Genara

2008-06-01

Good manufacturing practices (GMP) and sanitation standard operating procedures (SSOP) are prerequisites programs for the application of the Hazard Analysis and Critical Control Point (HACCP) system as a food safety approach during processing. The aim of this study was to evaluate GMP/SSOP prerequisites in processing line of frozen whole sardine (Sardinella aurita). The GMP compliance was verified according to a standard procedure of the Ministry for the Health of Venezuela, and the SSOP were assessed according to a checklist proposed by the FDA. GMP and SSOP were evaluated following a demerit-based approach. A percentage value was calculated and referred to as sanitary effectiveness. Results indicated that the plant had a good level of compliance with GMP from assessment of buildings and facilities, equipment and tools, hygienic requisites of the production, assurance of the hygiene quality, storage and transportation, and the percentage of sanitary effectiveness was 84%. The level of compliance for SSOP was 53,12% with demerits found in all assessed aspects consisting of inexistent guidelines, lack of control in the sanitary plan and lack of leadership in applying corrective actions. Thus, an improvement in the plant sanitation program was designed targeting SSOP.

An Evaluation Methodology Development and Application Process for Severe Accident Safety Issue Resolution

Directory of Open Access Journals (Sweden)

Robert P. Martin

2012-01-01

Full Text Available A general evaluation methodology development and application process (EMDAP paradigm is described for the resolution of severe accident safety issues. For the broader objective of complete and comprehensive design validation, severe accident safety issues are resolved by demonstrating comprehensive severe-accident-related engineering through applicable testing programs, process studies demonstrating certain deterministic elements, probabilistic risk assessment, and severe accident management guidelines. The basic framework described in this paper extends the top-down, bottom-up strategy described in the U.S Nuclear Regulatory Commission Regulatory Guide 1.203 to severe accident evaluations addressing U.S. NRC expectation for plant design certification applications.

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

Multi-criteria group decision making for evaluating the performance of e-waste recycling programs under uncertainty.

Science.gov (United States)

Wibowo, Santoso; Deng, Hepu

2015-06-01

This paper presents a multi-criteria group decision making approach for effectively evaluating the performance of e-waste recycling programs under uncertainty in an organization. Intuitionistic fuzzy numbers are used for adequately representing the subjective and imprecise assessments of the decision makers in evaluating the relative importance of evaluation criteria and the performance of individual e-waste recycling programs with respect to individual criteria in a given situation. An interactive fuzzy multi-criteria decision making algorithm is developed for facilitating consensus building in a group decision making environment to ensure that all the interest of individual decision makers have been appropriately considered in evaluating alternative e-waste recycling programs with respect to their corporate sustainability performance. The developed algorithm is then incorporated into a multi-criteria decision support system for making the overall performance evaluation process effectively and simple to use. Such a multi-criteria decision making system adequately provides organizations with a proactive mechanism for incorporating the concept of corporate sustainability into their regular planning decisions and business practices. An example is presented for demonstrating the applicability of the proposed approach in evaluating the performance of e-waste recycling programs in organizations. Copyright © 2015 Elsevier Ltd. All rights reserved.

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

Science.gov (United States)

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

Approximately 474 000 Indigenous people live in 617 First Nations communities across Canada; 125 of those communities are located in Ontario, primarily in rural and remote areas. Common rural health challenges, including for palliative care, involve quality and access. The need for culturally relevant palliative care programs in First Nations communities is urgent because the population is aging with a high burden of chronic and terminal disease. Because local palliative care is lacking, most First Nations people now leave their culture, family and community to receive care in distant hospitals or long-term care homes. Due to jurisdictional issues, a policy gap exists where neither federal nor provincial governments takes responsibility for funding palliative care in First Nations communities. Further, no Canadian program models existed for how different levels of government can collaborate to fund and deliver palliative care in First Nations communities. This article describes an innovative, community-based palliative care program (Wiisokotaatiwin) developed in rural Naotkamegwanning, and presents the results of a process evaluation of its pilot implementation. The evaluation aimed to (i) document the program's pilot implementation, (ii) assess progress toward intended program outcomes and (iii) assess the perceived value of the program. The Wiisokotaatiwin Program was developed and implemented over 5 years using participatory action research (http://www.eolfn.lakeheadu.ca). A mixed-method evaluation approach was adopted. Descriptive data were extracted from program documents (eg client registration forms). Client tracking forms documented service provision data for a 4-month sample period. Quantitative and qualitative data were collected through client and family member questionnaires (n=7) and healthcare provider questionnaires (n=22). A focus group was conducted with the program leadership team responsible for program development. Quantitative data were

Improving the Process of Student Evaluation

Directory of Open Access Journals (Sweden)

Gabriela Neacşu

2013-12-01

Full Text Available In this paper we analyzed the process of student evaluation from “Spiru Haret” University. The process under consideration occurs according to a specific Procedure – Process of student evaluation from the Manual of Quality Assurance Procedures, “Spiru Haret” University, Edition 1, 2012. The goal of this procedure, mentioned in the Manual, is to present the student evaluation procedure by using the Blackboard educational platform and other evaluation techniques of quality learning, based on materials developed by teachers of “Spiru Haret” University, as well as corresponding responsibilities, in order to increase the learning process quality and the exigency degree in the examination process, as well as students’ satisfaction measured by accumulated competences. We appreciate that the purpose of this procedure is first and foremost to ensure transparency and objectivity in exam passing decision. After identifying the weaknesses with the “cause - effect” chart, we have sought to improve student evaluation process using PDCA (Plan-Do-Check-Act method, resulting in the design of a new assessment flowchart.

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

EPA [Environmental Protection Agency] SITE [Superfund Innovative Technology Evaluation] program seeks technology proposals

International Nuclear Information System (INIS)

Anon.

1989-01-01

EPA will issue an RFP to initiate the SITE-005 solicitation for demonstration of technologies under the Superfund Innovative Technology Evaluation (SITE) Program. This portion of the SITE program offers a mechanism for conducting a joint technology demonstration between EPA and the private sector. The goal of the demonstration program is to provide an opportunity for developers to demonstrate the performance of their technologies on actual hazardous wastes at Superfund sites, and to provide accurate and reliable data on that performance. Technologies selected must be of commercial scale and provide solutions to problems encountered at Superfund Sites. Primary emphasis in the RFP is on technologies that address: treatment of mixed, low level radioactive wastes in soils and groundwater; treatment of soils and sludges contaminated with organics and/or inorganics, materials handling as a preliminary step to treatment or further processing, treatment trains designed to handle specific wastes, are in situ technologies, especially those processes providing alternatives to conventional groundwater pump and treat techniques

Qualification of Daiichi Units 1, 2, and 3 Data for Severe Accident Evaluations - Process and Illustrative Examples from Prior TMI-2 Evaluations

Energy Technology Data Exchange (ETDEWEB)

Rempe, Joy Lynn [Idaho National Lab. (INL), Idaho Falls, ID (United States); Knudson, Darrell Lee [Idaho National Lab. (INL), Idaho Falls, ID (United States)

2014-09-01

The accidents at the Three Mile Island Unit 2 (TMI-2) Pressurized Water Reactor (PWR) and the Daiichi Units 1, 2, and 3 Boiling Water Reactors (BWRs) provide unique opportunities to evaluate instrumentation exposed to severe accident conditions. Conditions associated with the release of coolant and the hydrogen burn that occurred during the TMI-2 accident exposed instrumentation to harsh conditions, including direct radiation, radioactive contamination, and high humidity with elevated temperatures and pressures. As part of a program initiated in 2012 by the Department of Energy Office of Nuclear Energy (DOE-NE), a review was completed to gain insights from prior TMI-2 sensor survivability and data qualification efforts. This initial review focused on the set of sensors deemed most important by post-TMI-2 instrumentation evaluation programs. Instrumentation evaluation programs focused on data required by TMI-2 operators to assess the condition of the reactor and containment and the effect of mitigating actions taken by these operators. In addition, prior efforts focused on sensors providing data required for subsequent forensic evaluations and accident simulations. To encourage the potential for similar activities to be completed for qualifying data from Daiichi Units 1, 2, and 3, this report provides additional details related to the formal process used to develop a qualified TMI-2 data base and presents data qualification details for three parameters: primary system pressure; containment building temperature; and containment pressure. As described within this report, sensor evaluations and data qualification required implementation of various processes, including comparisons with data from other sensors, analytical calculations, laboratory testing, and comparisons with sensors subjected to similar conditions in large-scale integral tests and with sensors that were similar in design to instruments easily removed from the TMI-2 plant for evaluations. As documented

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Course in Terms of Parlett's Illuminative Program Evaluation Model

Science.gov (United States)

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Identfying the Needs of Pre-Service Classroom Teachers about Science Teaching Methodology Courses in Terms of Parlett's Illuminative Program Evaluation Model

Science.gov (United States)

Çaliskan, Ilke

2014-01-01

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

7 CFR 4284.512 - Evaluation process.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation process. 4284.512 Section 4284.512 Agriculture Regulations of the Department of Agriculture (Continued) RURAL BUSINESS-COOPERATIVE SERVICE AND....512 Evaluation process. (a) Applications will be evaluated by qualified reviewers appointed by the...

7 CFR 4284.912 - Evaluation process.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation process. 4284.912 Section 4284.912 Agriculture Regulations of the Department of Agriculture (Continued) RURAL BUSINESS-COOPERATIVE SERVICE AND... Evaluation process. (a) Applications will be evaluated by agricultural economists or other technical experts...

Recruitment processes in Baltic sprat - A re-evaluation of GLOBEC Germany hypotheses

DEFF Research Database (Denmark)

Voss, Rudiger; Peck, M.A.; Hinrichsen, H.-H.

2012-01-01

The GLOBEC Germany program (2002–2007) had the ambitious goal to resolve the processes impacting the recruitment dynamics ofBalticsprat (Sprattus sprattus L.) by examining various factors affecting early life history stages. At the start of the research program, a number of general recruitmenthyp......The GLOBEC Germany program (2002–2007) had the ambitious goal to resolve the processes impacting the recruitment dynamics ofBalticsprat (Sprattus sprattus L.) by examining various factors affecting early life history stages. At the start of the research program, a number of general......, and modeling studies to re-evaluate these hypotheses for the Balticsprat stock. Recruitment success was quite different in the 2 years investigated. Despite a lower spawning stock biomass in 2003, the total number of recruits was almost 2-fold higher that year compared to 2002. The higher recruitment success...... in 2003 could be attributed to enhanced survival success during the post-larval/juvenile stage, a life phase that appears to be critical for recruitment dynamics. In the state of the Baltic ecosystem during the period of investigation, we consider bottom-up control (e.g. temperature, prey abundance...

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

Consideration of a Learning Programming Process based on Software Design for Beginners

OpenAIRE

大村, 基将; 紅林, 秀治

2016-01-01

We considered a learning programming process based on software design for technology education. Lessons of computer program-aided measurement and control are for beginners to learn programming. These lessons are efficient to learn the step of programming, but the main of the lessons are works of typing the sample programming and debugging. Therefore, these lessons have a fundamental lack of the concept of design. Then we considered learning processes of programming and applied the process of ...

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding