The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Process Evaluation for a Prison-based Substance Abuse Program.

Science.gov (United States)

Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

2000-01-01

Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

Taiwan Teacher Preparation Program Evaluation: Some Critical Perspectives

Science.gov (United States)

Liu, Tze-Chang

2015-01-01

This paper focuses on the influences and changes of recent Taiwan teacher preparation program evaluation (TTPPE) as one of the national evaluation projects conducted by the Higher Education Evaluation and Accreditation Council of Taiwan. The main concerns are what kind of ideology is transformed through the policy by means of evaluation, and what…

Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emeral Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2007-03-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others.

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

Science.gov (United States)

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

Science.gov (United States)

This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

The US Department of Energy Personnel Dosimetry Evaluation and Upgrade Program

International Nuclear Information System (INIS)

Faust, L.G.; Stroud, C.M.; Swinth, K.L.; Vallario, E.J.

1987-11-01

The US Department of Energy (DOE) Personnel Dosimetry Evaluation and Upgrade Program is designed to identify and evaluate dosimetry deficiencies and to conduct innovative research and development programs that will improve overall capabilities, thus ensuring that DOE can comply with applicable standards and regulations for dose measurement. To achieve these goals, two programs were initiated to evaluate and upgrade beta measurement and neutron dosimetry. 3 refs

Traffic Control Device Evaluation Program : FY 2017

Science.gov (United States)

2018-03-01

This report presents findings on the activities conducted in the Traffic Control Device Evaluation Program during the 2017 fiscal year. The research on sponsored changeable message signs (continued from the previous year) was terminated by the Federa...

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Evaluation of the Navy Master Planning Program

Science.gov (United States)

1976-05-01

Navy planning directives, interviews with Navy planning personnel, researc " of applicable literature on planning and program evaluation, and the...master planning has absorbed the additional roles of program management and public relations marketing . The Navy planner is now deeply involved in...master planning 62conducted by NAVFAC headquarters in 1972, various Navy planning directives, a " Market Survey" of NAVFAC services and customer 63

Strategies and policies for improving energy efficiency programs: Closing the loop between evaluation and implementation

International Nuclear Information System (INIS)

Vine, Edward

2008-01-01

Program implementers often use evaluation results to improve the performance of their programs, but, as described in this paper, this is not always the case. Based on a review of the literature, participation in workshops, and interviews with over 50 program implementers, evaluators, and regulators in the United States and Canada, the utilization of evaluation results is investigated by asking the following questions: (1) How are program evaluation results used by program implementers and other stakeholders? (2) How are program evaluation results communicated to program implementers and other stakeholders? (3) Are the needs of program implementers being met by program evaluation? (4) What is the role of the utility regulator in facilitating the use of program evaluation results? (5) What other mechanisms can facilitate the use of program evaluation results? While there is some consensus on the answers to these questions, the type of interest in and use of evaluation varies by functional role (e.g., evaluator versus implementer), maturity of the energy efficiency market, institutional context (e.g., evaluation and implementation conducted inside the same organization, or evaluation and implementation conducted by separate entities), and by regulatory demands and evaluation interests

FHWA research and technology evaluation program summary report spring 2016

Science.gov (United States)

2016-08-01

This report summarizes the 16 evaluations being conducted by the Volpe National Transportation Systems Center on behalf of FHWAs Research and Technology Program. The FHWA R&T Program furthers the Turner-Fairbank Highway Research Centers goal of...

Evaluation as a critical factor of success in local public health accreditation programs.

Science.gov (United States)

Tremain, Beverly; Davis, Mary; Joly, Brenda; Edgar, Mark; Kushion, Mary L; Schmidt, Rita

2007-01-01

This article presents the variety of approaches used to conduct evaluations of performance improvement or accreditation systems, while illustrating the complexity of conducting evaluations to inform local public health practice. We, in addition, hope to inform the Exploring Accreditation Program about relevant experiences involving accreditation and performance assessment processes, specifically evaluation, as it debates and discusses a national voluntary model. A background of each state is given. To further explore these issues, interviews were conducted with each state's evaluator to gain more in-depth information on the many different evaluation strategies and approaches used. On the basis of the interviews, the authors provide several overall themes, which suggest that evaluation is a critical tool and success factor for performance assessment or accreditation programs.

Super-Efficient Refrigerator Program (SERP) evaluation volume 2: Preliminary impact and market transformation assessment

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-08-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. It is one of the first examples of a large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the preliminary impact and market transformation evaluation of SERP ({open_quotes}the Program{close_quotes}). Pacific Northwest National Laboratory (PNNL) conducted this evaluation for the U.S. Department of Energy. This study focuses on the preliminary impact evaluation and market transformation assessment, but also presents limited process evaluation information. It is based on interviews with refrigerator dealers and manufacturers, interviews with utility participants, industry data, and information from the Program administrators. Results from this study complement those from prior process evaluation also conducted by PNNL. 42 refs., 5 figs., 4 tabs.

Using an Evaluability Assessment To Select Methods for Evaluating State Technology Development Programs: The Case of the Georgia Research Alliance.

Science.gov (United States)

Youtie, Jan; Bozeman, Barry; Shapira, Philip

1999-01-01

Describes an evaluability assessment of the Georgia Research Alliance (GRA), a technology development program. Presents the steps involved in conducting an evaluability assessment, including development of an understanding of the program and its stakeholders. Analyzes and compares different methods by which the GRA could be evaluated. (SLD)

Evaluation of DOE's Partnership in Low-Income Residential Retrofit (PILIRR) Program

Energy Technology Data Exchange (ETDEWEB)

Callaway, J.W.; Lee, A.D.

1989-05-01

In July 1986, the US Department of Energy (DOE) awarded competitive grants to five states to conduct pilot projects to establish partnerships and use resource leveraging to stimulate support for low-income residential energy retrofits. The projects were conducted under DOE's Partnerships in Low-Income Residential Retrofit (PILIRR) Program. These projects have been monitored and analyzed through a concurrent process evaluation conducted by the Pacific Northwest Laboratory (PNL). This study reports the findings of that evaluation. The overriding goal of the PILIRR Program was to determine whether the states could stimulate support for low-income residential energy improvements from non-federal sources. The goal for the process evaluation was to conduct an assessment of the processes used by the states and the extent to which they successfully established partnerships and leveraged resources. Five states were selected to participate in the program: Florida, Iowa, Kentucky, Oklahoma and Washington. Each state proposed a different approach to promote non-federal support for low-income residential weatherization. Three of the five states--Florida, Iowa, and Washington--established partnerships that led to retrofits during the monitoring period (October 1986--October 1988). Kentucky established its partnership during the monitoring period, but did not accomplish its retrofits until after monitoring was complete. Oklahoma completed development of its marketing program and had begun marketing efforts by the end of the monitoring period. 16 refs., 7 figs., 1 tab.

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Evaluation of the Radiography Program at Caldwell Community College and Technical Institute--Summer, 1982.

Science.gov (United States)

Pipes, V. David

As part of a periodic evaluation of the occupational programs at Caldwell Community College and Technical Institute (CCC&TI), a study of the radiography program was conducted to collect information to facilitate planning, aid in program improvement, and meet accountability demands. The specific objectives of the program evaluation were to…

Conduct of a meta review of programme evaluations : a case study of the SEARCH Program

OpenAIRE

Dickson, Rumona; Tight, Malcolm; Saunders, Murray

2012-01-01

This thesis presents a retrospective case study that critically examines the evaluations that were undertaken as part of a continuing professional development (CPD) programme for health care professionals. The case is the SEARCH Program, an innovative CPD programme, which was designed to promote the implementation of evidence based practice (EBP) within the existing health care system in Alberta, Canada. Two approaches from the ‘using’ branch of Alkin and Chrisite’s evaluation theory tree are...

An Evaluation of an Alternative Teacher Certification Program: A Matter of Trust

Science.gov (United States)

Grubbs, Scott T.

2009-01-01

For the internal evaluator, the issue of trust can be one of the more difficult ethical matters to manage. An organization might choose to conduct an internal program evaluation for a variety of reasons, including capitalizing on the abilities of invested stakeholders to assess aspects of a program, building an institutional culture oriented…

Data Availability in Appliance Standards and Labeling Program Development and Evaluation

Energy Technology Data Exchange (ETDEWEB)

Romankiewicz, John [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Khanna, Nina [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Vine, Edward [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Zhou, Nan [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

2013-05-01

In this report, we describe the necessary data inputs for both standards development and program evaluation and perform an initial assessment of the availability and uncertainty of those data inputs in China. For standards development, we find that China and its standards and labeling program administrators currently has access to the basic market and technical data needed for conducting market and technology assessment and technological and economic analyses. Some data, such as shipments data, is readily available from the China Energy Label product registration database while the availability of other data, including average unit energy consumption, prices and design options, needs improvement. Unlike some other countries such as the United States, most of the necessary data for conducting standards development analyses are not publicly available or compiled in a consolidated data source. In addition, improved data on design and efficiency options as well as cost data (e.g., manufacturing costs, mark-ups, production and product use-phase costs) – key inputs to several technoeconomic analyses – are particularly in need given China’s unconsolidated manufacturing industry. For program evaluation, we find that while China can conduct simple savings evaluations on its incentive programs with the data it currently has available from the Ministry of Finance – the program administrator, the savings estimates produced by such an evaluation will carry high uncertainty. As such, China could benefit from an increase in surveying and metering in the next one to three years to decrease the uncertainty surrounding key data points such as unit energy savings and free ridership.

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Process evaluation of the Regional Biomass Energy Program

Energy Technology Data Exchange (ETDEWEB)

Wilson, C.R.; Brown, M.A.; Perlack, R.D.

1994-03-01

The U.S. Department of Energy (DOE) established the Regional Biomass Energy Program (RBEP) in 1983 to increase the production and use of biomass energy resources. Through the creation of five regional program (the Great Lakes, Northeast, Pacific Northwest, Southeast, and West), the RBEP focuses on regionally specific needs and opportunities. In 1992, Oak Ridge National (ORNL) conducted a process evaluation of the RBEP Program designed to document and explain the development of the goals and strategies of the five regional programs; describe the economic and market context surrounding commercialization of bioenergy systems; assess the criteria used to select projects; describe experiences with cost sharing; identify program accomplishments in the transfer of information and technology; and offer recommendations for program improvement.

Self–Evaluation of Distance Learning Study Program as a Part of Internal Quality Assurance

Directory of Open Access Journals (Sweden)

Radojka Krneta

2012-02-01

Full Text Available This paper features quality assurance of specific distance learning master study program through self-evaluation. This unique program involving e-learning as the program content, as well as delivery method, is presented in the paper from the aspects of its quality assurance. Student evaluation of this study program as a part of the internal quality assurance is performed at the end of every school year in the aim of its quality assurance. Results and conclusions of self-evaluation conducted in this school year by known SEVAQ+ evaluation tool are presented here.

In Situ Remediation Integrated Program, Evaluation and assessment of containment technology

International Nuclear Information System (INIS)

Gerber, M.A.; Fayer, M.J.

1994-04-01

The In Situ Remediation Integrated Program (ISRIP) was established by the US Department of Energy (DOE) to advance the state-of-the art of innovative in situ remediation technologies to the point of demonstration and to broaden the applicability of these technologies to the widely varying site remediation requirements throughout the DOE complex. This program complements similar ongoing integrated demonstration programs being conducted at several DOE sites. The ISRIP has been conducting baseline assessments on in situ technologies to support program planning. Pacific Northwest Laboratory conducted an assessment and evaluation of subsurface containment barrier technology in support of ISRIP's Containment Technology Subprogram. This report summarizes the results of that activity and provides a recommendation for priortizing areas in which additional research and development is needed to advance the technology to the point of demonstration in support of DOE's site restoration activities

Wind resource assessment handbook: Fundamentals for conducting a successful monitoring program

International Nuclear Information System (INIS)

Bailey, B.H.; McDonald, S.L.; Bernadett, D.W.; Markus, M.J.; Elsholz, K.V.

1997-01-01

This handbook presents industry-accepted guidelines for planning and conducting a wind resource measurement program to support a wind energy feasibility initiative. These guidelines, which are detailed and highly technical, emphasize the tasks of selecting, installing, and operating wind measurement equipment, as well as collecting and analyzing the associated data, once one or more measurement sites are located. The handbook's scope encompasses state-of-the-art measurement and analysis techniques at multiple heights on tall towers (e.g., 40 m) for a measurement duration of at least one year. These guidelines do not represent every possible method of conducting a quality wind measurement program, but they address the most important elements based on field-proven experience. The intended audience for this handbook is any organization or individual who desires the planning framework and detailed procedures for conducting a formally structured wind measurement program. Personnel from the management level to field technicians will find this material applicable. The organizational aspects of a measurement program, including the setting of clear program objectives and designing commensurate measurement and quality assurance plans, all of which are essential to ensuring the program's successful outcome, are emphasized. Considerable attention is also given to the details of actually conducting the measurement program in its many aspects, from selecting instrumentation that meets minimum performance standards to analyzing and reporting on the collected data. 5 figs., 15 tabs

Evaluating Realized Impacts of DOE/EERE R&D Programs. Standard impact evaluation method

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc. (United States); O' Connor, Alan C. [RTI International, Research Triangle Park, NC (United States); Loomis, Ross J. [RTI International, Research Triangle Park, NC (United States)

2014-08-01

This document provides guidance for evaluators who conduct impact assessments of research and development (R&D) programs for the U.S. Department of Energy’s (DOE) Office of Energy Efficiency and Renewable Energy (EERE). It is also targeted at EERE program staff responsible for initiating and managing commissioned impact studies. The guide specifies how to estimate economic benefits and costs, energy saved and installed or generated, environmental impacts, energy security impacts, and knowledge impacts of R&D investments in advanced energy technologies.

Operating experience review for nuclear power plants in the Systematic Evaluation Program

International Nuclear Information System (INIS)

Mays, G.T.; Harrington, K.H.

1982-01-01

The Systematic Evaluation Program Branch (SEPB) of the Nuclear Regulatory Commission (NRC) is conducting the Systematic Evaluation Program (SEP) whose purpose is to determine the safety margins of the design and operation of the eleven oldest operating commercial nuclear power plants in the United States. This paper describes the methodology and results of the operational experience review portion of the SEP evaluation. SEPB will combine the results from these operational reviews with other safety topic evaluations to perform an integrated assessment of the SEP plants

Process evaluation of two environmental nutrition programmes and an educational nutrition programme conducted at supermarkets and worksite cafeterias in the Netherlands

NARCIS (Netherlands)

I.H.M. Steenhuis; P. van Assema (Patricia); A. Reubsaet; G.J. Kok (Gerjo)

2004-01-01

textabstractThis article describes the process evaluation of two environmental programs and a educational nutrition program, implemented at supermarkets and worksite cafeterias. Studies conducted earlier, indicated that the programs had no effect on consumers’ eating behavior. Consequently, the more

EVALUATION OF BASIC COURSE WORKSHOP CONDUCTED IN A MEDICAL COLLEGE

Directory of Open Access Journals (Sweden)

Manasee Panda

2017-08-01

Full Text Available BACKGROUND Faculty development is perhaps one of the foremost issues among the factors influencing the quality of medical education. It was planned to evaluate Basic course workshop (BCW on Medical education Technologies (MET conducted in the institution with following objectives 1. To assess the effectiveness of the B CW in MET conducted in the Medical College. 2. To study the changes in teaching practices and assessment methods of faculties after the workshop. MATERIALS AND METHODS Present Evaluation study was conducted at the RTC (SCB Medical College, Odisha of MCI in MET from February 2012 to December 2012. Kirkpatrick’s model with four levels of program outcomes (reaction, learning, behaviour, and result was used to evaluate the effectiveness of workshop. Convenient sampling method was used. All the faculties in the first 4 batches of the workshop were the study participants. Data was collected from the record of the RTC from the filled in Feedback form, PrePst test forms, filled semi structured questionnaire from the participants, in-depth interview of facilitators and focus group discussion of students. Descriptive statistics like percentage, Proportions and Chi-square test used. RESULTS A total of 67 faculties responded to the questionnaire. There was gain in knowledge for majority of faculties in different teaching learning process and assessment methods due to the workshop. More than 90% of faculties had the attitude to practice interactive teaching, PBL and preparing MCQs and structured oral questions. Self-reported change in teaching behavior and assessment method was reported by more than 80% of the faculties. Reasons for non- implementation were given as the lack of support from the institution (64%, from other faculties (34%,lack of self-motivation(13%.Facilitators were satisfied with the quality of training. But FGD conducted for the students revealed that they failed to recognize noticeable change in the teaching and

Measurement and evaluation of energy efficiency programs: California and South Korea

International Nuclear Information System (INIS)

Vine, E.; Rhee, C.H.; Lee, K.D.

2006-01-01

One of the key challenges for countries facing electric utility restructuring is to ensure that key public goods, such as energy efficiency programs, do not lose support but are maintained and enhanced via regulatory policy and government action. Moreover, an infrastructure and process also needs to be designed and implemented for conducting the measurement and evaluation of energy efficiency programs. This paper describes the experiences of California and the Republic of Korea (Korea) in addressing these issues. These case studies confirm that the active involvement of regulatory bodies is needed to ensure that energy efficiency investments continue. The case studies also show that the development of an infrastructure and process for conducting rigorous measurement and evaluation takes time and needs the active participation of many stakeholders

An approach for evaluating the market effects of energy efficiency programs

International Nuclear Information System (INIS)

Vine, E.; Prahl, R.; Meyers, S.; Turiel, I.

2010-01-01

This paper presents work currently being carried out in California on evaluating market effects. We first outline an approach for conducting market effect studies that includes the six key steps that were developed in study plans: (1) a scoping study that characterizes a particular market, reviews relevant market effects studies, develops integrated market and program theories, and identifies market indicators; (2) analysis of market evolution, using existing data sources; (3) analysis of market effects, based on sales data and interviews with key market actors; (4) analysis of attribution; (5) estimation of energy savings; and (6) assessment of sustainability (i.e., the extent to which any observed market effects are likely to persist in the absence or reduction of public intervention, and thus has helped to transform the market). We describe the challenges in conducting this type of analysis (1) selecting a comparison state(s) to California for a baseline, (2) availability and quality of data (limiting analyses), (3) inconsistent patterns of results, and (4) conducting market effects evaluations at one point in time, without the benefit of years of accumulated research findings, and then provide some suggestions for future research on the evaluation of market effects. With the promulgation of market transformation programs, the evaluation of market effects will be critical. We envision that these market effects studies will help lay the foundation for the refinement of techniques for measuring the impacts of programs that seek to transform markets for energy efficiency products and practices.

Evaluation of long-term patient satisfaction and experience with the Baha(®) bone conduction implant

DEFF Research Database (Denmark)

Rasmussen, Jacob; Olsen, Steen Østergaard; Nielsen, Lars Holme

2012-01-01

Objective: Evaluate long-term patient satisfaction with bone-anchored hearing aids (the Baha(R), now referred to by Cochlear as a 'bone conduction implant') in our hospital clinic spanning the eighteen-year period from the inception of our Baha program. The researchers further wished to analyse t...

CASKETSS-HEAT: a finite difference computer program for nonlinear heat conduction problems

International Nuclear Information System (INIS)

Ikushima, Takeshi

1988-12-01

A heat conduction program CASKETSS-HEAT has been developed. CASKETSS-HEAT is a finite difference computer program used for the solution of multi-dimensional nonlinear heat conduction problems. Main features of CASKETSS-HEAT are as follows. (1) One, two and three-dimensional geometries for heat conduction calculation are available. (2) Convection and radiation heat transfer of boundry can be specified. (3) Phase change and chemical change can be treated. (4) Finned surface heat transfer can be treated easily. (5) Data memory allocation in the program is variable according to problem size. (6) The program is a compatible heat transfer analysis program to the stress analysis program SAP4 and SAP5. (7) Pre- and post-processing for input data generation and graphic representation of calculation results are available. In the paper, brief illustration of calculation method, input data and sample calculation are presented. (author)

Evaluation of the Science, Technology, and Engineering Leadership Program, Year Two

Science.gov (United States)

Wolanin, Natalie L.; Wade, Julie H.

2013-01-01

The Office of Shared Accountability (OSA) conducted an evaluation of the implementation of the second year (2011-2012) of the Science, Technology, and Engineering Leadership Program (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard Hughes Medical…

Evaluation of the Science, Technology, and Engineering Leadership Program, Year Three

Science.gov (United States)

Wolanin, Natalie; Wade, Julie

2014-01-01

The Office of Shared Accountability conducted an evaluation of the implementation of the third and final year (2012-2013) of the "Science, Technology, and Engineering Leadership Program" (STELP) in Montgomery County (Maryland) Public Schools (MCPS). Funding for STELP, including the evaluation study, is provided by a grant from the Howard…

A leadership development program for surgeons: First-year participant evaluation.

Science.gov (United States)

Pradarelli, Jason C; Jaffe, Gregory A; Lemak, Christy Harris; Mulholland, Michael W; Dimick, Justin B

2016-08-01

In a dynamic health care system, strong leadership has never been more important for surgeons. Little is known about how to design and conduct effectively a leadership program specifically for surgeons. We sought to evaluate critically a Leadership Development Program for practicing surgeons by exploring how the program's strengths and weaknesses affected the surgeons' development as physician-leaders. At a large academic institution, we conducted semistructured interviews with 21 surgical faculty members who applied voluntarily, were selected, and completed a newly created Leadership Development Program in December 2012. Interview transcripts underwent qualitative descriptive analysis with thematic coding based on grounded theory. Themes were extracted regarding surgeons' evaluations of the program on their development as physician-leaders. After completing the program, surgeons reported personal improvements in the following 4 areas: self-empowerment to lead, self-awareness, team-building skills, and knowledge in business and leadership. Surgeons felt "more confident about stepping up as a leader" and more aware of "how others view me and my interactions." They described a stronger grasp on "giving feedback" as well as a better understanding of "business/organizational issues." Overall, surgeon-participants reported positive impacts of the program on their day-to-day work activities and general career perspective as well as on their long-term career development plans. Surgeons also recommended areas where the program could potentially be improved. These interviews detailed self-reported improvements in leadership knowledge and capabilities for practicing surgeons who completed a Leadership Development Program. A curriculum designed specifically for surgeons may enable future programs to equip surgeons better for important leadership roles in a complex health care environment. Copyright © 2016 Elsevier Inc. All rights reserved.

A Process and Outcome Evaluation of Police Working with Youth Programs

Directory of Open Access Journals (Sweden)

Stephen A. Anderson

2008-09-01

Full Text Available A process and outcome evaluation of 10 Police Working with Youth Programs was conducted. Process results indicated that the core components of the programs were consistent with those identified in previous literature as characteristic of quality youth development programs. Outcome results indicated that youth participants reported significantly improved attitudes toward police and social support received from significant, non-familial adults. Two subgroups of youth, most notably minority youth and younger participants in lower grade levels, reported positive changes in their capacity to resist peer pressures. Minority youth reported positive changes in their sense of mastery over stressful life situations. Relationships between core program components and youth outcomes also were examined. Implications of the findings and future process and outcome evaluations of youth programs are discussed.

Evaluating Additionality of an Innovation Subsidy Program Targeted at SMEs: An Exploratory Study

Directory of Open Access Journals (Sweden)

Sonja Radas

2013-04-01

Full Text Available This paper explores the effectiveness of a recently introduced innovation subsidy program targeted at SMEs in Croatia. Three aspects of program additionality were evaluated: input, output and behavioral aspects. Both qualitative and survey research was employed, and four case studies with selected recipient companies were conducted. This study is a response to the policy-makers’ need for early program assessment. It attempts to show that even with early evaluation and small population of recipients it is possible to gain insight into program effectiveness. The analysis suggests that the effects of programs targeted at innovative SMEs might need to be evaluated differently than general subsidies. This is especially evident in the evaluation of input additionality. The analysis indicates that SMEs which started with a higher R&D capability tend to increase R&D intensity while participating in the program. The program raised R&D and innovation capability of the participating SMEs, but commercialization of project results remains a concern.

Findings from the Evaluation of OJJDP's Gang Reduction Program. Juvenile Justice Bulletin

Science.gov (United States)

Cahill, Meagan; Hayeslip, David

2010-01-01

This bulletin draws on findings from an independent evaluation, conducted by the Urban Institute, of the Gang Reduction Program's (GRP) Impact in Los Angeles, California; Milwaukee, Wisconsin; North Miami Beach, Florida; and Richmond, Virginia, to examine how effectively these sites implemented the program. Following are some of the authors' key…

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

Science.gov (United States)

Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

2014-01-01

Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

An Evaluation of the Antibullying Program at a Public Suburban High School

Science.gov (United States)

Drury, Brian

2014-01-01

This project study addressed the problem of harassment, intimidation, and bullying (HIB) at a public suburban high school in the Northeast United States. The study school implemented the Anti-bullying Program in September 2011, yet no evaluation had been conducted on whether the program was meeting its goals. Two conceptual frameworks that drove…

REITP3-Hazard evaluation program for heat release based on thermochemical calculation

Energy Technology Data Exchange (ETDEWEB)

Akutsu, Yoshiaki.; Tamura, Masamitsu. [The University of Tokyo, Tokyo (Japan). School of Engineering; Kawakatsu, Yuichi. [Oji Paper Corp., Tokyo (Japan); Wada, Yuji. [National Institute for Resources and Environment, Tsukuba (Japan); Yoshida, Tadao. [Hosei University, Tokyo (Japan). College of Engineering

1999-06-30

REITP3-A hazard evaluation program for heat release besed on thermochemical calculation has been developed by modifying REITP2 (Revised Estimation of Incompatibility from Thermochemical Properties{sup 2)}. The main modifications are as follows. (1) Reactants are retrieved from the database by chemical formula. (2) As products are listed in an external file, the addition of products and change in order of production can be easily conducted. (3) Part of the program has been changed by considering its use on a personal computer or workstation. These modifications will promote the usefulness of the program for energy hazard evaluation. (author)

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

EVALUATION OF THE IMPLEMENTATION OF OPERATIONS AND MAINTENANCE PROGRAMS IN NEW JERSEY SCHOOLS

Science.gov (United States)

The Asbestos Hazard Emergency Response Act (AHERA) required all schools to develop and implement an asbestos management plan (AMP). The key component of the AMP is the operations and maintenance (O&M) program. A study was conducted to evaluate the implementation of O&M programs a...

ERATO - a computer program for the calculation of induced eddy-currents in three-dimensional conductive structures

International Nuclear Information System (INIS)

Benner, J.

1985-10-01

The computer code ERATO is used for the calculation of eddy-currents in three-dimensional conductive structures and their secondary magnetic field. ERATO is a revised version of the code FEDIFF, developed at IPP Garching. For the calculation the Finite-Element-Network (FEN) method is used, where the structure is simulated by an equivalent electric network. In the ERATO-code, the calculation of the finite-element discretization, the eddy-current analysis, and the final evaluation of the results are done in separate programs. So the eddy-current analysis as the central step is perfectly independent of a special geometry. For the finite-element discretization there are two so called preprocessors, which treat a torus-segment and a rectangular, flat plate. For the final evaluation postprocessors are used, by which the current-distributions can be printed and plotted. In the report, the theoretical foundation of the FEN-Method is discussed, the structure and the application of the programs (preprocessors, analysis-program, postprocessors, supporting programs) are shown, and two examples for calculations are presented. (orig.) [de

Process evaluation of a school-based weight gain prevention program: the Dutch Obesity Intervention in Teenagers (DOiT)

NARCIS (Netherlands)

Singh, A.S.; Chin A Paw, J.M.M.; Brug, J.; Mechelen, van W.

2009-01-01

Health promotion programs benefit from an accompanying process evaluation since it can provide more insight in the strengths and weaknesses of a program. A process evaluation was conducted to assess the reach, implementation, satisfaction and maintenance of a school-based program aimed at the

Peer Evaluation of Master Programs: Closing the Quality Circle of the CDIO Approach?

DEFF Research Database (Denmark)

Hussmann, Peter Munkebo; Bisi, Anita; Malmqvist, Johan

2012-01-01

programs within their field at another N5T institution. The article describes the quality enhancement tool in detail, its contribution to the development of the involved programs, and how international peer evaluation can contribute to closing the quality circle. Finally, it assesses the value......A quality assurance project was conducted within the framework of the Nordic Five Tech Alliance (N5T), a strategic alliance of the five leading technical universities in Denmark, Finland, Norway, and Sweden. The project concerned the development of a common quality enhancement tool for conducting...... peer evaluations of educational programs to enable their further development and close the quality circle. In addition, the project will contribute to the consolidation of the N5T alliance by facilitating contacts between faculty members and providing them with an in-depth knowledge of the study...

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Preparation, Conduct and Evaluation of Exercises to Test Preparedness for a Nuclear or Radiological Emergency - Training Materials

International Nuclear Information System (INIS)

2010-01-01

Emergency response exercises are a key component of a good program of preparation in emergencies. They can provide a unique insight on the State of preparation of emergency response organizations. They can also be the basis for continuous improvement programs of the infrastructure of response in emergencies. However, to be more useful, the exercises in emergency response need to be well organized, professionally conducted and its assessment should focus on the potential for constructive improvement. The course of the IAEA on preparedness, conduction and evaluation exercises to test the preparation before a nuclear emergency or radiation designed for people and organizations that want to increase their ability to carry out effective and significant emergency exercises. The objectives of this course are: To familiarize participants with concepts, terminology, process of preparation, conduction and evaluation of the exercise to test the preparation before a nuclear emergency or radiation; Provide participants with knowledge practical and the ability to organize, lead and evaluate an exercise to test the preparation for a nuclear emergency or radiation in their own countries; Submit an exercise response model in emergency prepared by the IAEA; and give participants the skill to adapt the proposal of model exercise and organize and lead this exercise model right in your own country. [es

Radioactive waste isolation in salt: rationale and methodology for Argonne-conducted reviews of site characterization programs

International Nuclear Information System (INIS)

Harrison, W.; Ditmars, J.D.; Tisue, M.W.; Hambley, D.F.; Fenster, D.F.; Rote, D.M.

1985-07-01

Both regulatory and technical concerns must be addressed in Argonne-conducted peer reviews of site characterization programs for individual sites for a high-level radioactive waste repository in salt. This report describes the regulatory framework within which reviews must be conducted and presents background information on the structure and purpose of site characterization programs as found in US Nuclear Regulatory Commission (NRC) Regulatory Guide 4.17 and Title 10, Part 60, of the Code of Federal Regulations. It also presents a methodology to assist reviewers in addressing technical concerns relating to their respective areas of expertise. The methodology concentrates on elements of prime importance to the US Department of Energy's advocacy of a given salt repository system during the NRC licensing process. Instructions are given for reviewing 12 site characterization program elements, starting with performance objectives, performance issues, and levels of performance of repository subsystem components; progressing through performance assessment; and ending with plans for data acquisition and evaluation. The success of a site characterization program in resolving repository performance issues will be determined by judging the likelihood that the proposed data acquisition activities will reduce uncertainties in the performance predictions. 8 refs., 3 figs., 5 tabs

COYOTE: a finite element computer program for nonlinear heat conduction problems

International Nuclear Information System (INIS)

Gartling, D.K.

1978-06-01

COYOTE is a finite element computer program designed for the solution of two-dimensional, nonlinear heat conduction problems. The theoretical and mathematical basis used to develop the code is described. Program capabilities and complete user instructions are presented. Several example problems are described in detail to demonstrate the use of the program

Evaluation of the Super Efficient Refrigerator Program (SERP) in the Bonneville Power Administration service territory

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Conger, R.L.

1996-06-01

The Super Efficient Refrigerator Program (SERP) is a collaborative utility program intended to transform the market for energy-efficient and environmentally friendly refrigerators. it is one of the first examples of large-scale {open_quotes}market transformation{close_quotes} energy efficiency program. This report documents the evaluation of SERP ({open_quotes}the Program{close_quotes}) in the Bonneville Power Administration`s (Bonneville`s) service territory. Pacific Northwest National Laboratory (PNNL) conducted this evaluation for Bonneville. This study includes the process evaluation, preliminary impact evaluation, and market transformation assessment. It is based on site visits and interviews with refrigerator dealers and manufacturers, industry data, and Bonneville information. Results from this study are compared with those from a parallel study that examines the Program across the 24 participating utilities.

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

Using program logic model analysis to evaluate and better deliver what works

International Nuclear Information System (INIS)

Megdal, Lori; Engle, Victoria; Pakenas, Larry; Albert, Scott; Peters, Jane; Jordan, Gretchen

2005-01-01

There is a rich history in using program theories and logic models (PT/LM) for evaluation, monitoring, and program refinement in a variety of fields, such as health care, social and education programs. The use of these tools to evaluate and improve energy efficiency programs has been growing over the last 5-7 years. This paper provides an overview of the state-of-the-art methods of logic model development, with analysis that significantly contributed to: Assessing the logic behind how the program expects to be able to meets its ultimate goals, including the 'who', the 'how', and through what mechanism. In doing so, gaps and questions that still need to be addressed can be identified. Identifying and prioritize the indicators that should be measured to evaluate the program and program theory. Determining key researchable questions that need to be answered by evaluation/research, to assess whether the mechanism assumed to cause the changes in actions, attitudes, behaviours, and business practices is workable and efficient. Also will assess the validity in the program logic and the likelihood that the program can accomplish its ultimate goals. Incorporating analysis of prior like programs and social science theories in a framework to identify opportunities for potential program refinements. The paper provides an overview of the tools, techniques and references, and uses as example the energy efficiency program analysis conducted for the New York State Energy Research and Development Authority's (NYSERDA) New York ENERGY $MART SM programs

Evaluation of a Health Professionals' Training Program to Conduct Research in New York City's Asian American Community

Science.gov (United States)

Zhang, Pao San Lucy; Sim, Shao-Chee; Pong, Perry; Islam, Nadia; Trinh-Shevrin, Chau; Li, Shijian; Tsang, Thomas; Rey, Mariano

2014-01-01

Background: Because health disparities among Asian Americans are understudied, a partnership program between the Charles B. Wang Community Health Center and the Center for the Study of Asian American Health was created to increase awareness and interest in Asian American research. Purpose: To evaluate the process, outcome, and impact of a health…

Gasbuggy, New Mexico Long-Term Hydrologic Monitoring Program Evaluation Report

Energy Technology Data Exchange (ETDEWEB)

None

2009-06-01

This report summarizes an evaluation of the Long-Term Hydrologic Monitoring Program (LTHMP) that has been conducted since 1972 at the Gasbuggy, New Mexico underground nuclear detonation site. The nuclear testing was conducted by the U.S. Atomic Energy Commission under the Plowshare program, which is discussed in greater detail in Appendix A. The detonation at Gasbuggy took place in 1967, 4,240 feet below ground surface, and was designed to fracture the host rock of a low-permeability natural gas-bearing formation in an effort to improve gas production. The site has historically been managed under the Nevada Offsites Project. These underground nuclear detonation sites are within the United States but outside of the Nevada Test Site where most of the experimental nuclear detonations conducted by the U.S. Government took place. Gasbuggy is managed by the U.S. Department of Energy (DOE) Office of Legacy Management (LM ).

Evaluations of Sexual Assault Prevention Programs in Military Settings: A Synthesis of the Research Literature.

Science.gov (United States)

Orchowski, Lindsay M; Berry-Cabán, Cristóbal S; Prisock, Kara; Borsari, Brian; Kazemi, Donna M

2018-03-01

The prevention of sexual assault (SA) in the U.S. military is a significant priority. This study applied the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines to a literature search that identified research evaluating SA prevention programs conducted within military settings. Only six studies published between 2005 and 2016 met criteria for inclusion in the review. Studies demonstrated high heterogeneity in the: (1) conceptual framework of the prevention approach; (2) target population and timing of administration; (3) study recruitment methods; (4) methodological design; (5) method of delivery, program dosage and theory of change; and (6) outcome administration and efficacy. Scientific rigor according to the Oxford Center for Evidence-based Medicine was also variable. Several gaps in the research base were identified. Specifically, research evaluating SA prevention programs have only been conducted among U.S. Army and U.S. Navy samples. Most studies did not examine whether program participation was associated with reductions in rates of sexual violence. Studies also lacked utilization of a long-term follow-up period. Additionally, studies did not reflect the types of SA prevention programs currently being implemented in military settings. Taken together, further research is needed to enhance the evidence base for SA prevention in the military, and to evaluate the effectiveness of the approaches currently being conducted with service members.

40 CFR 63.2354 - What performance tests, design evaluations, and performance evaluations must I conduct?

Science.gov (United States)

2010-07-01

... evaluations, and performance evaluations must I conduct? 63.2354 Section 63.2354 Protection of Environment... tests, design evaluations, and performance evaluations must I conduct? (a)(1) For each performance test... procedures specified in subpart SS of this part. (3) For each performance evaluation of a continuous emission...

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Reliability-based maintenance evaluations and standard preventive maintenance programs

International Nuclear Information System (INIS)

Varno, M.; McKinley, M.

1993-01-01

Due to recent issuance of 10CFR50.65, the U.S. Nuclear Regulatory Commission maintenance rule (Rule), and the open-quotes Industry Guideline for Monitoring the Effectiveness of Maintenance at Nuclear Power Plantsclose quotes prepared by the Nuclear Management and Resources Council, many utilities are undertaking review or evaluation of current preventive maintenance (PM) programs. Although PM optimization and documentation are not specifically required by the Rule, an appropriate and effective PM program (PMP) will be the cornerstone of the successful and cost-effective implementation of the Rule. Currently, a project is being conducted at the Vermont Yankee Nuclear Power Station (VYNPS) in conjunction with Quadrex Energy Services to evaluate, optimize, and document the PMP. The project began in March 1993 and is scheduled for completion in mid-1995. The initial scope for the project is the evaluation of those structures, systems, and components that are within the scope of the Rule. Because of the number of systems to be evaluated (∼50), the desired completion schedule, and cost considerations, a streamlined approach to PM optimization and documentation is being utilized

Evaluating employee assistance programs. A review of methods, outcomes, and future directions.

Science.gov (United States)

Jerrell, J M; Rightmyer, J F

1982-01-01

Renewed interest in assisting troubled employees has led to an upsurge in the development of employee assistance programs, coupled with demands for demonstrable effectiveness. This review examines the nature and scope of these programs, their administrative and methodological context, and the types and outcomes of evaluation studies conducted thus far. Proposals for improving future investigations through a number of different approaches and strategies are then made.

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Physiotherapists supporting self-management through health coaching: a mixed methods program evaluation.

Science.gov (United States)

Dufour, Sinéad Patricia; Graham, Shane; Friesen, Josh; Rosenblat, Michael; Rous, Colin; Richardson, Julie

2015-01-01

To evaluate a program in support of chronic disease self-management (CDSM) that is founded on a health coaching (HC) approach, includes supervised exercise and mindfulness-based stress reduction components and is delivered within a private practice physiotherapy setting. An explanatory mixed method design, framed by theory-based program evaluation, was employed to evaluate an eight-week group-based program. Standardized self-rated and performance measures were evaluated pre- and post intervention. Additionally, participant focus groups were conducted following the intervention period. An inductive thematic approach was undertaken to analyze the qualitative data. Seventeen participants (N = 17) completed the study. Improvements were seen in both self-report and performance outcomes. Participants explained how and why they felt the program was beneficial. Six themes were generated: (1) group dynamic; (2) learning versus doing; (3) holism and comprehensive care; (4) self-efficacy and empowerment; (5) previous solutions versus new management strategies; and (6) healthcare provider support. This study established that a group program in support of CDSM founded on a HC approach demonstrated potential value from participants as well as favorable outcomes. A pragmatic randomized control trial is required to determine efficacy of this intervention.

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Interim Reliability Evaluation Program procedures guide

International Nuclear Information System (INIS)

Carlson, D.D.; Gallup, D.R.; Kolaczkowski, A.M.; Kolb, G.J.; Stack, D.W.; Lofgren, E.; Horton, W.H.; Lobner, P.R.

1983-01-01

This document presents procedures for conducting analyses of a scope similar to those performed in Phase II of the Interim Reliability Evaluation Program (IREP). It documents the current state of the art in performing the plant systems analysis portion of a probabilistic risk assessment. Insights gained into managing such an analysis are discussed. Step-by-step procedures and methodological guidance constitute the major portion of the document. While not to be viewed as a cookbook, the procedures set forth the principal steps in performing an IREP analysis. Guidance for resolving the problems encountered in previous analyses is offered. Numerous examples and representative products from previous analyses clarify the discussion

Rainfall Product Evaluation for the TRMM Ground Validation Program

Science.gov (United States)

Amitai, E.; Wolff, D. B.; Robinson, M.; Silberstein, D. S.; Marks, D. A.; Kulie, M. S.; Fisher, B.; Einaudi, Franco (Technical Monitor)

2000-01-01

Evaluation of the Tropical Rainfall Measuring Mission (TRMM) satellite observations is conducted through a comprehensive Ground Validation (GV) Program. Standardized instantaneous and monthly rainfall products are routinely generated using quality-controlled ground based radar data from four primary GV sites. As part of the TRMM GV program, effort is being made to evaluate these GV products and to determine the uncertainties of the rainfall estimates. The evaluation effort is based on comparison to rain gauge data. The variance between the gauge measurement and the true averaged rain amount within the radar pixel is a limiting factor in the evaluation process. While monthly estimates are relatively simple to evaluate, the evaluation of the instantaneous products are much more of a challenge. Scattegrams of point comparisons between radar and rain gauges are extremely noisy for several reasons (e.g. sample volume discrepancies, timing and navigation mismatches, variability of Z(sub e)-R relationships), and therefore useless for evaluating the estimates. Several alternative methods, such as the analysis of the distribution of rain volume by rain rate as derived from gauge intensities and from reflectivities above the gauge network will be presented. Alternative procedures to increase the accuracy of the estimates and to reduce their uncertainties also will be discussed.

Materials balance area Custodian Performance Evaluation Program at PNL

International Nuclear Information System (INIS)

Dickman, D.A.

1991-07-01

The material balance area (MBA) custodian has primary responsibility for control and accountability of nuclear material within an MBA. In this role, the custodian operates as an extension of the facility material control and accountability (MC ampersand A) organization. To effectively meet administrative requirements and protection needs, the custodian must be fully trained in all aspects of MC ampersand A related to the MBA, and custodian performance must be periodically evaluated. DOE Policy requires that each facility provide for a program which assures that each facility provide for a program which assures that personnel performing MC ampersand A functions are (1) trained and/or qualified to perform their duties and responsibilities and (2) knowledgeable of requirements and procedures related to their functions. The MBA Custodian Performance Evaluation Program at PNL uses a variety of assessment techniques to meet this goal, including internal and independent MBA audits, periodic custodian testing, conduct of limited scope performance tests, daily monitoring of MC ampersand A documentation, and reviewing custodian performance during physical inventories. The data collected from these sources is analyzed and incorporated into an annual custodian performance evaluation document, given to each custodian and line management. Development of this program has resulted in significantly improved custodian performance and a marked decrease in finding and observations identified during MBA audits

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Let's get technical: Enhancing program evaluation through the use and integration of internet and mobile technologies.

Science.gov (United States)

Materia, Frank T; Miller, Elizabeth A; Runion, Megan C; Chesnut, Ryan P; Irvin, Jamie B; Richardson, Cameron B; Perkins, Daniel F

2016-06-01

Program evaluation has become increasingly important, and information on program performance often drives funding decisions. Technology use and integration can help ease the burdens associated with program evaluation by reducing the resources needed (e.g., time, money, staff) and increasing evaluation efficiency. This paper reviews how program evaluators, across disciplines, can apply internet and mobile technologies to key aspects of program evaluation, which consist of participant registration, participant tracking and retention, process evaluation (e.g., fidelity, assignment completion), and outcome evaluation (e.g., behavior change, knowledge gain). In addition, the paper focuses on the ease of use, relative cost, and fit with populations. An examination on how these tools can be integrated to enhance data collection and program evaluation is discussed. Important limitations of and considerations for technology integration, including the level of technical skill, cost needed to integrate various technologies, data management strategies, and ethical considerations, are highlighted. Lastly, a case study of technology use in an evaluation conducted by the Clearinghouse for Military Family Readiness at Penn State is presented and illustrates how technology integration can enhance program evaluation. Copyright © 2016 Elsevier Ltd. All rights reserved.

Youth Can! Grow Healthy: A Formative Evaluation of a Positive Youth Development Program

Directory of Open Access Journals (Sweden)

Andrew Carberry

2013-06-01

Full Text Available This paper presents a formative evaluation of an afterschool program that combined positive youth development and school garden curricula. Novel approaches were used to teach elementary school children about gardening and nutrition, and to engage them in advocacy for healthy community physical activity and nutrition environments. The youth development curriculum included sessions on team building, community pride, healthy eating, physical activity, and advocacy. Photovoice methods were used to allow participants to assess their community and communicate findings with community leaders. The school garden curriculum included nutrition and gardening lessons. Formative evaluation was conducted for each session. Themes of the evaluation were: successful methods for engaging youth, issues in the social environment, and implications for program management. Evaluation results are discussed in relationship to relevant youth development literature to provide recommendations that will strengthen future programs.

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Formative Evaluation of the Behavior Change Components within a Colorado Weatherization Assistance Program

Science.gov (United States)

Sandoval, Perla K.

A formative evaluation of behavior change elements of an ongoing Weatherization Assistance Program (WAP) offered by the Energy Resource Center (E.R.C.) in Denver, CO was conducted. The WAP as administered by the E.R.C. in Colorado saves residents an average 15% of energy consumption (E.R.C., 2015). However, research suggests that adding behavioral components to WAPs could increase energy savings to 21-26% (Gregory, 1992; APPRAISE, 2002). The goal of this evaluation is to provide recommendations to E.R.C. for program changes using Community Based Social Marketing (CBSM) and Theory of Planned Behavior. The CBSM Step 1- Step 3 is the focus of this formative evaluation. This program evaluation has four components: 1) review of written materials, 2) interviews with staff, 3) surveys mailed to E.R.C. clients and 4) in-home observations conducted with E.R.C. clients. Results of this formative evaluation has 3 sections of behaviors recommended for future intervention high priority, mid priority, and low priority recommendations based on CBSM penetration, probability, and impact factors. Behaviors that are listed as high priority for E.R.C. Behavioral intervention are cold water washing, hang drying, setting back thermostats, and window coverings. Overall increase in staff engagement is also recommended to be pursued. Each staff level is also given recommendations on how to engage in behavior change interventions.

Treating conduct disorder: An effectiveness and natural language analysis study of a new family-centred intervention program.

Science.gov (United States)

Stevens, Kimberly A; Ronan, Prof Kevin; Davies, Gene

2017-05-01

This paper reports on a new family-centred, feedback-informed intervention focused on evaluating therapeutic outcomes and language changes across treatment for conduct disorder (CD). The study included 26 youth and families from a larger randomised, controlled trial (Ronan et al., in preparation). Outcome measures reflected family functioning/youth compliance, delinquency, and family goal attainment. First- and last-treatment session audio files were transcribed into more than 286,000 words and evaluated through the Linguistic Inquiry and Word Count Analysis program (Pennebaker et al., 2007). Significant outcomes across family functioning/youth compliance, delinquency, goal attainment and word usage reflected moderate-strong effect sizes. Benchmarking findings also revealed reduced time of treatment delivery compared to a gold standard approach. Linguistic analysis revealed specific language changes across treatment. For caregivers, increased first person, action-oriented, present tense, and assent type words and decreased sadness words were found; for youth, significant reduction in use of leisure words. This study is the first using lexical analyses of natural language to assess change across treatment for conduct disordered youth and families. Such findings provided strong support for program tenets; others, more speculative support. Copyright © 2016. Published by Elsevier B.V.

Leading Change and Advancing Health by Enhancing Nurses' and Midwives' Knowledge, Ability and Confidence to Conduct Research through a Clinical Scholar Program in Western Australia.

Science.gov (United States)

Chapman, Rose; Duggan, Ravani; Combs, Shane

2011-01-01

This paper reports on an evaluation of a Clinical Scholar Program initiated at a hospital in Western Australia. The aim of the program was to build the capacity of nurses and midwives to conduct research and evidence-based practice within the hospital. The program was based on a previous program and consisted of six teaching days and four hours per month release for proposal preparation. At the end of the program participants were asked to complete a short anonymous questionnaire. The answers were analysed using standard processes of qualitative analysis. Themes emerging from the data included program strengths, individual gains, ability to conduct research, and areas for improvement. The findings highlighted that, while the participants considered that they were more knowledgeable and confident to conduct research, they still required support. The Clinical Scholar Program has provided a way to increase the capacity of clinicians to participate in research activities.

SKB's program for societal research 2004-2011. An evaluation

International Nuclear Information System (INIS)

Soederberg, Olof

2012-04-01

This evaluation of the program of societal research that SKB conducted the years 2004-2011 has been performed on behalf of Swedish Nuclear Fuel and Waste Management Company (SKB). The review has focused on answers to a series of questions as follows: General questions - Why was a program started? - What was SKB's purpose with the program? - Does the result mean that the objective has been achieved? - Has the program had effects (positive or negative) that were not anticipated when the purpose was formulated? - Strengths and weaknesses of the program? Questions about the implementation - How did announcement and selection procedures work? - Which forms were used for reporting results from the research projects? Questions about the continued investment in societal research - Are there such needs? - In that case, is it in SKB's interest to contribute financially to such research? - What forms might be appropriate if SKB sees interest to contribute financially to such research?

Evaluation of the MIND Research Institute's Spatial-Temporal Math (ST Math) Program in California

Science.gov (United States)

Wendt, Staci; Rice, John; Nakamoto, Jonathan

2014-01-01

The MIND Research Institute contracted with the Evaluation Research Program at WestEd to conduct an independent assessment of mathematics outcomes in elementary school grades across California that were provided with the ST Math program. Spatial-Temporal (ST) Math is a game-based instructional software designed to boost K-5 and secondary-level…

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

An evaluation of the Australian Rotavirus Surveillance Program.

Science.gov (United States)

Roberts-Witteveen, April R; Patel, Mahomed S; Roche, Paul W

2008-09-01

The Australian Rotavirus Serotyping Program (ARSP) serotypes rotavirus isolates obtained from stool samples sent from Australian laboratories. In collaboration with ARSP the Australian Government Department of Health and Ageing evaluated the program for its utility and capacity to monitor effectiveness of the rotavirus vaccines recently introduced into the Australian National Immunisation Program. The system was described using ARSP annual reports and staff interviews. The attributes of the system were assessed by adapting standard guidelines for evaluating a surveillance system. Email surveys or face to face interviews were conducted with staff of ARSP, participating laboratories, rotavirus vaccine manufacturing companies and representatives of the Communicable Diseases Network Australia. The ability of the ARSP to monitor changes in rotavirus serotype epidemiology was assessed. ARSP serotypes rotavirus isolates received from participating laboratories at least bi-annually, with results being reported at least as often. Serotype analyses have informed formulation of rotavirus vaccines and contributed to forecasting the extent of outbreaks caused by novel serotypes. The ARSP will be able to monitor changes in rotavirus serotype epidemiology and identify probable vaccination failures. Enhancement of the representativeness and sensitivity of the system are needed for the data to remain useful in the public health context. Methods for transferring data between the program and state and territory health departments need to be developed.

Research, Monitoring, and Evaluation for the Federal Columbia River Estuary Program

Energy Technology Data Exchange (ETDEWEB)

Johnson, Gary E.; Diefenderfer, Heida L.; Ebberts, Blaine D.; Tortorici, Cathy; Yerxa, Tracey; Leary, J.; Skalski, John R.

2008-02-05

The purpose ofthis document is to describe research, monitoring, and evaluation (RME) for the Federal Columbia River Estuary Program. The intent of this RME effort is to provide data and information to evaluate progress toward meeting program goals and objectives and support decision-making in the Estuary Program. The goal of the Estuary Program is to understand, conserve, and restore the estuary ecosystem to improve the performance of listed salmonid populations. The Estuary Program has five general objectives, designed to fulfill the program goal, as follows. 1. Understand the primary stressors affecting ecosystem controlling factors, such as ocean conditions and invasive species. 2. Conserve and restore factors controlling ecosystem structures and processes, such as hydrodynamics and water quality. 3. Increase the quantity and quality of ecosystem structures, i.e., habitats, juvenile salmonids use during migration through the estuary. 4. Maintain the food web to benefit salmonid performance. 5. Improve salmonid performance in terms of life history diversity, foraging success, growth, and survival. The goal of estuary RME is to provide pertinent and timely research and monitoring information to planners, implementers, and managers of the Estuary Program. In conclusion, the estuary RME effort is designed to meet the research and monitoring needs of the estuary Program using an adaptive management process. Estuary RME's success and usefulness will depend on the actual conduct of adaptive management, as embodied in the objectives, implrementation, data, reporting, and synthesis, evaluation, and decision-making described herein.

Quantitative Evaluation of the Community Research Fellows Training Program

Directory of Open Access Journals (Sweden)

Lucy eD'Agostino McGowan

2015-07-01

Full Text Available Context: The Community Research Fellows Training (CRFT program is a community-based participatory research (CBPR initiative for the St. Louis area. This fifteen week program, based on a Master in Public Health curriculum, was implemented by the Division of Public Health Sciences at Washington University School of Medicine in partnership with the Siteman Cancer Center. Objectives: We measure the knowledge gained by participants and evaluate participant and faculty satisfaction of the CRFT program both in terms of meeting learning objectives and actively engaging the community in the research process.Participants: We conducted analyses on 44 community members who participated in the CRFT program and completed the baseline and follow-up knowledge assessments.Main Outcome Measures: Knowledge gain is measured by a baseline and follow-up assessment given at the first and final session. Additionally, pre- and post-tests are given after the first 12 sessions. To measure satisfaction, program evaluations are completed by both the participants and faculty after each topic. Mid-way through the program, a mid-term assessment was administered to assess the program’s community engagement. We analyzed the results from the assessments, pre- and post-tests, and evaluations.Results: The CRFT participants’ knowledge increased at follow-up as compared with baseline on average by a 16.5 point difference (p<0.0001. Post-test scores were higher than pre-test scores for 11 of the 12 sessions. Both participants and faculty enjoyed the training and rated all session well.Conclusions: The CRFT program was successful in increasing community knowledge, in participant satisfaction, and in faculty satisfaction. This success has enhanced the infrastructure for CBPR as well as led to CBPR pilot projects that address health disparities in the St. Louis Greater Metropolitan Area.

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

Economic Evaluation of a Comprehensive Teenage Pregnancy Prevention Program: Pilot Program

Science.gov (United States)

Rosenthal, Marjorie S.; Ross, Joseph S.; Bilodeau, RoseAnne; Richter, Rosemary S.; Palley, Jane E.; Bradley, Elizabeth H.

2011-01-01

Background Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic are effective in reducing births among enrolled teenagers. However, there have been limited data on costs and cost-effectiveness of such programs. Objectives To use a community-based participatory research approach, to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Methods Using data from 1997-2003, we conducted an in-time intervention analysis to determine program cost-benefit while teenagers were enrolled and then used an extrapolation analysis to estimate accyrred economibc benefits and cost-benefit up to age 30. Results The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage females, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1,599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 on average, with social benefits outweighing total social costs by age 20.1. Conclusions We estimate that this comprehensive teenage pregnancy prevention program would provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost-effectiveness of similarly comprehensive programs when implemented more widely in high-risk neighborhoods. PMID:19896030

Economic evaluation of a comprehensive teenage pregnancy prevention program: pilot program.

Science.gov (United States)

Rosenthal, Marjorie S; Ross, Joseph S; Bilodeau, Roseanne; Richter, Rosemary S; Palley, Jane E; Bradley, Elizabeth H

2009-12-01

Previous research has suggested that comprehensive teenage pregnancy prevention programs that address sexual education and life skills development and provide academic support are effective in reducing births among enrolled teenagers. However, there have been limited data on the costs and cost effectiveness of such programs. The study used a community-based participatory research approach to develop estimates of the cost-benefit of the Pathways/Senderos Center, a comprehensive neighborhood-based program to prevent unintended pregnancies and promote positive development for adolescents. Using data from 1997-2003, an in-time intervention analysis was conducted to determine program cost-benefit while teenagers were enrolled; an extrapolation analysis was then used to estimate accrued economic benefits and cost-benefit up to age 30 years. The program operating costs totaled $3,228,152.59 and reduced the teenage childbearing rate from 94.10 to 40.00 per 1000 teenage girls, averting $52,297.84 in total societal costs, with an economic benefit to society from program participation of $2,673,153.11. Therefore, total costs to society exceeded economic benefits by $559,677.05, or $1599.08 per adolescent per year. In an extrapolation analysis, benefits to society exceed costs by $10,474.77 per adolescent per year by age 30 years on average, with social benefits outweighing total social costs by age 20.1 years. This comprehensive teenage pregnancy prevention program is estimated to provide societal economic benefits once participants are young adults, suggesting the need to expand beyond pilot demonstrations and evaluate the long-range cost effectiveness of similarly comprehensive programs when they are implemented more widely in high-risk neighborhoods.

Evaluating the market transformation impacts of a DSM program in the Province of Quebec

Energy Technology Data Exchange (ETDEWEB)

Baillargeon, P.; Michaud, N. [Econoler, 160 St-Paul Street, Quebec, QC, G1K 3W1 (Canada); Schmitt, B. [Hydro-Quebec, Complexe Desjardins, East Tower, C.P. 10000, Place Desjardins, Montreal, QC, H5B 1H7 (Canada); Megdal, L. [Megdal and Associates, 198 High Street, Acton, MA 01720 (United States)

2012-01-15

In 2006, Hydro-Quebec introduced a large DSM program on the market to promote the adoption of compact fluorescent lamps in Quebec households. After 3 years of program implementation, there was significant indication on the part of market actors that the promotional campaign component was quite effective in transforming the Quebec market. Hydro-Quebec therefore decided to modify its approach to program evaluation to include the quantification of market effects. Econoler led a team including American partners, Opinion Dynamics Inc. and Megdal and Associates to conduct an evaluation of program impacts on market transformation. An evaluation strategy was designed where different research tools would be integrated to determine market evolution over the two previous years. Each research method was used to determine an estimate of program impacts, then triangulated with other approaches to determine the most appropriate impact evaluation method regarding the Hydro-Quebec program. Research efforts included a non-participant survey, interviews at manufacturer headquarters across Canada, interviews with banner distributor representatives across Canada, the collection of sales and market share data from manufacturers and retailers as well as secondary research to identify other players that could influence the market. The evaluation revealed that savings of 168 GWh could be attributed to direct and indirect impacts of the program for the 2006-2007 period.

The Three-Year (1995-1997) Workplace Literacy Program at Chinatown Manpower Project, Inc. Final Evaluation.

Science.gov (United States)

Friedenberg, Joan E.

An external evaluation was conducted of the Workplace Literacy Program at Chinatown Manpower Project, Inc., which provided oral and written job-specific instruction in English as a second language to Chinese garment workers. The program was designed for underemployed garment industry workers with low English proficiency, including seamstresses,…

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Program management plan for the conduct of a research, development, and demonstration program for improving the safety of nuclear powerplants

International Nuclear Information System (INIS)

1981-12-01

Congress passed Public Law 96-567, Nuclear Safety Research, Development, and Demonstration Act of 1980, (hereafter referred to as the Act) to provide for an accelerated and coordinated program of light water reactor safety research, development, and demonstration to be carried out by the Department of Energy. In order to assure that this program would be compatible with the needs of Nuclear Regulatory Commission (NRC) and industry, the Department of Energy (DOE) initiated its response to Section 4 of the Act by conducting individual information gathering meetings with NRC and a wide cross section of the nuclear industry. The Department received recommendations on needs of what type of activities would and would not be appropriate for the Department to assist in satisfying these needs. Based on the evaluation of these inputs, it is concluded that the Department's ongoing Light Water Reactor (LWR) safety program is responsive to the Act. Specifically, the Department's ongoing program includes tasks in the areas of regulatory assessment, risk assessment, fission product source term, and emergency preparedness as well as providing technical assistance to the Institute of Nuclear Power Operations (INPO) to improve training of nuclear power personnel. These were among the very high priority efforts that were identified as necessary and appropriate for support by the Department

Implementation and evaluation of an incentivized Internet-mediated walking program for obese adults.

Science.gov (United States)

Zulman, Donna M; Damschroder, Laura J; Smith, Ryan G; Resnick, Paul J; Sen, Ananda; Krupka, Erin L; Richardson, Caroline R

2013-12-01

In response to rising health care costs associated with obesity rates, some health care insurers are adopting incentivized technology-enhanced wellness programs. The purpose of this study is to evaluate the large-scale implementation of an incentivized Internet-mediated walking program for obese adults and to examine program acceptance, adherence, and impact. A mixed-methods evaluation was conducted to investigate program implementation, acceptance, and adherence rates, and physical activity rates among program participants. Program implementation was shaped by national and state policies, data security concerns, and challenges related to incentivizing participation. Among 15,397 eligible individuals, 6,548 (43 %) elected to participate in the walking program, achieving an average of 6,523 steps/day (SD 2,610 steps). Participants who uploaded step counts for 75 % of days for a full year (n = 2,885) achieved an average of 7,500 steps (SD 3,093). Acceptance and participation rates in this incentivized Internet-mediated walking program suggest that such interventions hold promise for engaging obese adults in physical activity.

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Evaluation of the US Department of Energy Weatherization Innovation Pilot Program (2010-2014)

Energy Technology Data Exchange (ETDEWEB)

Tonn, Bruce Edward [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Rose, Erin M. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Hawkins, Beth A. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-05-01

This report contains results from analysis conducted on each of the Weatherization Innovation Pilot Program (WIPP) grants awarded to 16 organizations by the US Department of Energy (DOE) in 2010. The purpose of WIPP was to explore the potential adoptability or replicability of innovative processes or technologies for the enhancement of DOE’s Weatherization Assistance Program (WAP). DOE initiated the WIPP grant to accelerate effective innovations in home energy efficiency and other WAP mission-related goals for income-qualifying households of low socioeconomic status. This study was performed alongside a broader, national evaluation of WAP conducted by Oak Ridge National Laboratory (ORNL) for DOE.

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

Science.gov (United States)

Ewell, Bob

1998-01-01

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Initial Evaluation of a Mobile Scaffolding Application That Seeks to Support Novice Learners of Programming

Science.gov (United States)

Mbogo, Chao; Blake, Edwin; Suleman, Hussein

2014-01-01

The aim of this paper is to explore the use of an application that scaffolds the constructions of programs on a mobile device. The application was developed to support novice learners of programming outside the classroom. This paper reports on results of a first experiment conducted to evaluate the mobile application. The main research questions…

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Monitoring and evaluating transition and sustainability of donor-funded programs: Reflections on the Avahan experience.

Science.gov (United States)

Bennett, Sara; Ozawa, Sachiko; Rodriguez, Daniela; Paul, Amy; Singh, Kriti; Singh, Suneeta

2015-10-01

In low and middle-income countries, programs funded and implemented by international donors frequently transition to local funding and management, yet such processes are rarely evaluated. We reflect upon experience evaluating the transition of a large scale HIV/AIDS prevention program in India, known as Avahan, in order to draw lessons about transition evaluation approaches and implementation challenges. In terms of conceptualizing the transition theory, the evaluation team identified tensions between the idea of institutionalizing key features of the Avahan program, and ensuring program flexibility to promote sustainability. The transition was planned in three rounds allowing for adaptations to transition intervention and program design during the transition period. The assessment team found it important to track these changes in order to understand which strategies and contextual features supported transition. A mixed methods evaluation was employed, combining semi-structured surveys of transitioning entities (conducted pre and post transition), with longitudinal case studies. Qualitative data helped explain quantitative findings. Measures of transition readiness appeared robust, but we were uncertain of the robustness of institutionalization measures. Finally, challenges to the implementation of such an evaluation are discussed. Given the scarceness of transition evaluations, the lessons from this evaluation may have widespread relevance. Copyright © 2015 The Authors. Published by Elsevier Ltd.. All rights reserved.

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

Direct Integration: Training Software Developers to Conduct Usability Evaluations

DEFF Research Database (Denmark)

Skov, Mikael B.; Stage, Jan

2008-01-01

is based on an empirical study where 36 teams with a total of 234 first-year university students on software development and design educations were trained in a simple approach for user-based website usability testing that was taught in a 40 hour course. This approach supported them in planning, conducting......Many improvements of the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both approaches involve...... a complete division of work between developers and evaluators, which is an undesirable complexity for many software development projects. This paper takes a different approach by exploring to what extent software developers and designers can be trained to carry out their own usability evaluations. The paper...

Methodological and Design Considerations in Evaluating the Impact of Prevention Programs on Violence and Related Health Outcomes.

Science.gov (United States)

Massetti, Greta M; Simon, Thomas R; Smith, Deborah Gorman

2016-10-01

Drawing on research that has identified specific predictors and trajectories of risk for violence and related negative outcomes, a multitude of small- and large-scale preventive interventions for specific risk behaviors have been developed, implemented, and evaluated. One of the principal challenges of these approaches is that a number of separate problem-specific programs targeting different risk areas have emerged. However, as many negative health behaviors such as substance abuse and violence share a multitude of risk factors, many programs target identical risk factors. There are opportunities to understand whether evidence-based programs can be leveraged for potential effects across a spectrum of outcomes and over time. Some recent work has documented longitudinal effects of evidence-based interventions on generalized outcomes. This work has potential for advancing our understanding of the effectiveness of promising and evidence-based prevention strategies. However, conducting longitudinal follow-up of established interventions presents a number of methodological and design challenges. To answer some of these questions, the Centers for Disease Control and Prevention convened a panel of multidisciplinary experts to discuss opportunities to take advantage of evaluations of early prevention programs and evaluating multiple long-term outcomes. This special section of the journal Prevention Science includes a series of papers that begin to address the relevant considerations for conducting longitudinal follow-up evaluation research. This collection of papers is intended to inform our understanding of the challenges and strategies for conducting longitudinal follow-up evaluation research that could be used to drive future research endeavors.

Conducting systematic reviews of economic evaluations.

Science.gov (United States)

Gomersall, Judith Streak; Jadotte, Yuri Tertilus; Xue, Yifan; Lockwood, Suzi; Riddle, Dru; Preda, Alin

2015-09-01

In 2012, a working group was established to review and enhance the Joanna Briggs Institute (JBI) guidance for conducting systematic review of evidence from economic evaluations addressing a question(s) about health intervention cost-effectiveness. The objective is to present the outcomes of the working group. The group conducted three activities to inform the new guidance: review of literature on the utility/futility of systematic reviews of economic evaluations and consideration of its implications for updating the existing methodology; assessment of the critical appraisal tool in the existing guidance against criteria that promotes validity in economic evaluation research and two other commonly used tools; and a workshop. The debate in the literature on the limitations/value of systematic review of economic evidence cautions that systematic reviews of economic evaluation evidence are unlikely to generate one size fits all answers to questions about the cost-effectiveness of interventions and their comparators. Informed by this finding, the working group adjusted the framing of the objectives definition in the existing JBI methodology. The shift is away from defining the objective as to determine one cost-effectiveness measure toward summarizing study estimates of cost-effectiveness and informed by consideration of the included study characteristics (patient, setting, intervention component, etc.), identifying conditions conducive to lowering costs and maximizing health benefits. The existing critical appraisal tool was included in the new guidance. The new guidance includes the recommendation that a tool designed specifically for the purpose of appraising model-based studies be used together with the generic appraisal tool for economic evaluations assessment to evaluate model-based evaluations. The guidance produced by the group offers reviewers guidance for each step of the systematic review process, which are the same steps followed in JBI reviews of other

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Mark I containment, short term program. Safety evaluation report

International Nuclear Information System (INIS)

1977-12-01

Presented is a Safety Evaluation Report (SER) prepared by the Office of Nuclear Reactor Regulation addressing the Short Term Program (STP) reassessment of the containment systems of operating Boiler Water Reactor (BWR) facilities with the Mark I containment system design. The information presented in this SER establishes the basis for the NRC staff's conclusion that licensed Mark I BWR facilities can continue to operate safely, without undue risk to the health and safety of the public, during an interim period of approximately two years while a methodical, comprehensive Long Term Program (LTP) is conducted. This SER also provides one of the basic foundations for the NRC staff review of the Mark I containment systems for facilities not yet licensed for operation

Teaching Environmental Education through PBL: Evaluation of a Teaching Intervention Program

Science.gov (United States)

Vasconcelos, Clara

2012-04-01

If our chosen aim in science education is to be inclusive and to improve students' learning achievements, then we must identify teaching methodologies that are appropriate for teaching and learning specific knowledge. Karagiorgi and Symeo 2005) remind us that instructional designers are thus challenged to translate the philosophy of constructivism into current practice. Thus, research in science education must focus on evaluating intervention programs which ensure the effective construction of knowledge and development of competencies. The present study reports the elaboration, application and evaluation of a problem-based learning (PBL) program with the aim of examining its effectiveness with students learning Environmental Education. Prior research on both PBL and Environmental Education (EE) was conducted within the context of science education so as to elaborate and construct the intervention program. Findings from these studies indicated both the PBL methodology and EE as helpful for teachers and students. PBL methodology has been adopted in this study since it is logically incorporated in a constructivism philosophy application (Hendry et al. 1999) and it was expected that this approach would assist students towards achieving a specific set of competencies (Engel 1997). On the other hand, EE has evolved at a rapid pace within many countries in the new millennium (Hart 2007), unlike any other educational area. However, many authors still appear to believe that schools are failing to prepare students adequately in EE (Walsche 2008; Winter 2007). The following section describes the research that was conducted in both areas so as to devise the intervention program.

Programmatic Environmental Scans: A Survey Based on Program Planning and Evaluation Concepts

Directory of Open Access Journals (Sweden)

Donna J. Peterson

2015-10-01

Full Text Available Within Extension, environmental scans are most commonly used to assess community or organizational issues or for strategic planning purposes. However, Extension has expanded the use of environmental scans to systematically identify “what programs exist” on a given topic or focus area. Yet, despite recent attention to the topic of environmental scanning in Extension, survey instruments used to conduct environmental scans have not been published. Given the emphasis on implementation of evidence-based practices and programs, having a ready-made survey that can be used to identify programs on a specific topic and that could subsequently lead to an evaluability assessment of those programs would be a useful resource. To encourage the use of environmental scans to identify existing evidence-based programs, this article describes a survey instrument developed for the purpose of scanning for 4-H Healthy Living programs ready for rigorous outcome evaluation and/or national replication. It focuses on the rationale for survey items, as well as provides a summary and definition of those items. The survey tool can be easily adapted for future programmatic environmental scans both within and outside Extension.

Preliminary Evaluation of a Practice-Based EBVM Skills Development Program

Directory of Open Access Journals (Sweden)

Ava Firth

2016-12-01

Full Text Available Whilst there is a small body of research that investigates the development of EBVM skills in veterinary undergraduates there is a paucity of research that aims to understand the development of EBVM skills in practice-based post-graduate veterinary surgeons. This paper is a small step in remedying that shortfall. In particular, the paper provides a progress report on an RCVS Knowledge funded study that is evaluating a practice-based EBVM development program. The program is being conducted with a cohort of 20 veterinary surgeons and veterinary nurses employed in a private practice veterinary company across multiple sites. The facilitated instruction approach incorporates multiple supports including; group based and one-to-one, synchronous and asynchronous, and, face-to-face and online strategies. This paper will provide details of both the facilitation and evaluation approaches that have been adopted. The paper will also report on preliminary results of the evaluation which focuses on barriers and facilitators to EBVM development.This is a podcast of Ava and Ian's talk at the Veterinary Evidence Today conference, Edinburgh November 2, 2016.

Training Software Developers and Designers to Conduct Usability Evaluations

Science.gov (United States)

Skov, Mikael Brasholt; Stage, Jan

2012-01-01

Many efforts to improve the interplay between usability evaluation and software development rely either on better methods for conducting usability evaluations or on better formats for presenting evaluation results in ways that are useful for software designers and developers. Both of these approaches depend on a complete division of work between…

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Efficacy evaluation of the school program Unplugged for drug use prevention among Brazilian adolescents

Directory of Open Access Journals (Sweden)

Zila M. Sanchez

2016-11-01

Full Text Available Abstract Background Most Brazilian schools do not have a continuous program for drug use prevention and do not conduct culturally adapted activities for that purpose. This study evaluated the impact of the Unplugged program on drug use prevention among children and adolescents in public middle schools of Brazil. Methods A non-randomized controlled trial was conducted in 2013 with 2185 students in 16 public schools from 3 Brazilian cities. The intervention group attended 12 weekly classes of the Unplugged program for drug use prevention, and the control group did not attend to any school prevention programs in the same year. Multilevel analyses were used to evaluate temporal and between group changes in the consumption of each drug. Results The study suggested that there was no evidence that Unplugged effected 11- to 12-year-old students. However, the program seemed to stimulate a decrease in recent marijuana use (transition from use to non-use in 85.7% of intervention cases and 28.6% of control cases, OR = 17.5, p = 0.039 among 13- to 15-year-old students. In addition, students in this age range who received the Unplugged program had similar drug consumption levels to those observed before the program began. However, students in the control group presented a significant tendency to increase marijuana use and binge drinking. Conclusions This study adds to the evidence of program efficacy among Brazilian middle school students by presenting marginal effects on binge drinking and marijuana use. An 18-month randomized controlled trial is recommended for a future study.

EMAT Evaluation of Thin Conductive Sheets

Directory of Open Access Journals (Sweden)

Ivo Cap

2006-01-01

Full Text Available At present a non-destructive testing of conducting materials becomes very important one in connection with monitoring and control of strategic technical facilities, e.g. nuclear power plants. There are more methods of material testing and evaluation and every of them has its advantages and disadvantages. Recently the electromagnetic methods are in increasing interest. There are many ways of conducting material testing. One of them often used utilises investigation of eddy currents induced in the surface layer by means of a proper coil. The arrangement is very simple and inexpensive but it offers only local information on cracks and other inhomogeneities in the thin surface layer. On the other hand there exist a method based on an electromagnetic – acoustic transducer (EMAT, which is able to generate and detect acoustic wave in a conducting body in a contact-less way. The present paper deals with a survey of EMATs for investigation of thin metalliclayers by means of Lamb waves. The new design of generation coil is presented.

An evaluation of a coal mining company's return to work program

International Nuclear Information System (INIS)

Allen, R.G.

1990-01-01

This study consolidates and evaluates information and data obtained from a coal mining company's return to work program called the Work Therapy Program. Organizational information and economic and statistical data were available for the study based on the company's records. Analysis of the data included descriptive statistics such as total injuries, the frequency rate of injuries, total days away from work due to injury, average days away per employee, and severity rates. A cost-benefit analysis was conducted to determine if the Program was economically beneficial to the company. Data from an opinion survey of the management at the mine where the Program was first instituted was used to determine the perceptions of mine management with respect to the Work Therapy Program. Conclusions were that the Work Therapy Program was economically beneficial to the Company and that the Program resulted in a significant reduction in compensable injuries. The Program did not significantly reduce days away from work due to mine injury. Perceptions of mine management were mostly positive

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

TRUMP3-JR: a finite difference computer program for nonlinear heat conduction problems

International Nuclear Information System (INIS)

Ikushima, Takeshi

1984-02-01

Computer program TRUMP3-JR is a revised version of TRUMP3 which is a finite difference computer program used for the solution of multi-dimensional nonlinear heat conduction problems. Pre- and post-processings for input data generation and graphical representations of calculation results of TRUMP3 are avaiable in TRUMP3-JR. The calculation equations, program descriptions and user's instruction are presented. A sample problem is described to demonstrate the use of the program. (author)

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

[Development and evaluation of the Empowering A Self-Efficacy (EASE) program for children with epilepsy].

Science.gov (United States)

Yoo, Hana; Kim, Hee-Soon

2015-02-01

The purpose of this study was to verify effects of the Empowering A Self-Efficacy (EASE) program on self-efficacy, self-management, and child attitude toward illness in children with epilepsy. This was a quasi-experimental study with a non-equivalent control group pre-post test design. Participants were 10 to 15 year old children with epilepsy (11 in the experimental group and 10 in the control group) who were registered at one hospital in S city. The experimental group received the EASE program for 3 weeks. In the first week, a group meeting lasting 570 minutes was conducted on a single day. Over the next two weeks, telephone counselling was conducted twice a week. Data were analyzed using SPSS 18.0. There was a significant difference of pre-post evaluation of the epilepsy self-management scores in the experimental group. However, differences between the experimental group and the control group for seizure self-efficacy and child attitude toward illness were not significant. This is the first study in Korea to develop and evaluate an intervention program for children with epilepsy. Further studies are needed to confirm the effects of the EASE program.

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Evaluating Outcomes of High Fidelity Simulation Curriculum in a Community College Nursing Program

Science.gov (United States)

Denlea, Gregory Richard

2017-01-01

This study took place at a Wake Technical Community College, a multi-campus institution in Raleigh, North Carolina. An evaluation of the return on investment in high fidelity simulation used by an associate degree of nursing program was conducted with valid and reliable instruments. The study demonstrated that comparable student outcomes are…

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Evaluation of effects of program for improving skills and motivation for employment

Directory of Open Access Journals (Sweden)

Marić Zorica

2011-01-01

Full Text Available Contemporary programs that have been implemented in order to help unemployed reduce time for finding a job are based on clear theoretical background and empirical evidence. In addition to providing opportunities to learn necessary skills, these programs also incorporate important psychological components which will be addressed in this paper. The goal of these interventions is to reduce time for finding a job, prevent long-term unemployment and negative effects of unemployment on individuals“ mental health. The paper presents evaluation of the effects of these psychological interventions. The program was based on Ajzen’s theory of planned behavior (2005, Bandura’s social-cognitive theory (1997 and cognitive-behavior theory of behavioral change (Meichenbaum, 1993. The goal of this program was to help unemployed individuals take an active role in finding a job, reduce time for finding a job and prevent negative effects of unemployment on their mental health. The target group of the program were young unemployed individuals ages 19 - 30, with at least high school level of education. Evaluation study was conducted on a sample of 92 male and female individuals who attended 3-day psychological program. Participants filled out five short scales specifically designed to assess variables that were targeted for change, such as, active approach to finding a job, attitudes toward process of employment, self-efficacy and resilience to frustrations and obstacles. Scales were administered before and after the training. Evaluation results, based on these pre and post measures, showed significant positive effects of this program on all five variables.

EVALUATION OF CORPORATE SOCIAL RESPONSIBILITY PROGRAM IMPLEMENTATION IN BOGOR PDAM TIRTA PAKUAN, WEST JAVA PROVINCE

Directory of Open Access Journals (Sweden)

Ismartaya Ismartaya

2017-07-01

Full Text Available The purpose of this research is to determine whether the evaluation corporate social responsibility program implementation in Bogor PDAM Tirta Pakuan has been implemented in accordance with the vision, mission, and objectives of the company. PDAM Tirta Pakuan has a vision of CSR as a pioneer in the implementation of social responsibility in Bogor city especially and Indonesia in general. Through this vision, PDAM Tirta Pakuan Bogor city, would really seriously on the implementation of the CSR programs. Based on these purposes, this research is done by evaluating the CSR programs which implemented by PDAM Tirta Pakuan Bogor city and use CIPP evaluation model to conduct an evaluation of the program. The type which used on this research is evaluation research with using a qualitative approach. The source of information used is the Chief Executive of CSR PDAM Tirta Pakuan Bogor. Data collected by the observation, interview and documentation. Test validity of this research by using triangulation technique, while data analysis is done by reducing the data, presenting and concluding. The result shows that the program Tirta Pakuan care as the company’s strategy goes according to the purposes and plans that have been made by the company.

Implementation of the Danish return-to-work program : process evaluation of a trial in 21 Danish municipalities

NARCIS (Netherlands)

Aust, Birgit; Nielsen, Maj Britt D.; Grundtvig, Gry; Buchardt, Helle L.; Ferm, Linnea; Andersen, Irene; Lund, Trine L.; Jelle, Martin Ohmann Claudio; Andersen, Malene F.; Hansen, Jorgen V.; Tverborgvik, Torill; Helverskov, Trine; Bjorner, Jakob Bue; Rugulies, Reiner; Orbaek, Palle; Winzor, Glen; Bultmann, Ute; Poulsen, Otto M.

Objectives The aim of this study was to evaluate the implementation of the Danish national return-to-work (RTW) program in 21 Danish municipalities. Methods We conducted a structured process evaluation on (i) reach and recruitment, (ii) fidelity, (iii) dose-delivered, (iv) dose-received, and (v)

Implementation of the Danish return-to-work program : process evaluation of a trial in 21 Danish municipalities

NARCIS (Netherlands)

Aust, Birgit; Nielsen, Maj Britt D.; Grundtvig, Gry; Buchardt, Helle L.; Ferm, Linnea; Andersen, Irene; Lund, Trine L.; Jelle, Martin Ohmann Claudio; Andersen, Malene F.; Hansen, Jorgen V.; Tverborgvik, Torill; Helverskov, Trine; Bjorner, Jakob Bue; Rugulies, Reiner; Orbaek, Palle; Winzor, Glen; Bultmann, Ute; Poulsen, Otto M.

2015-01-01

Objectives The aim of this study was to evaluate the implementation of the Danish national return-to-work (RTW) program in 21 Danish municipalities. Methods We conducted a structured process evaluation on (i) reach and recruitment, (ii) fidelity, (iii) dose-delivered, (iv) dose-received, and (v)

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

National logging program for the National Uranium Resource Evaluation. Final report

International Nuclear Information System (INIS)

The Mineral Engineering Division (MED) of High Life Helicopters, Inc., operated from May, 1979, through August, 1981, as a subcontractor to the Department of Energy (DOE) to acquire downhole geophysical log information in support of the National Uranium Resource Evaluation program (NURE). MED acquired downhole geophysical log information in 26 1 0 x 2 0 NTMS quadrangles in Colorado, Montana, Nebraska, North Dakota, South Dakota, and Wyoming. MED obtained the log information by gaining permission to log oil and gas wells, water wells, and coal exploration holes. Actual geophysical logging was subcontracted to Century Geophysical Corporation. After logging of each well and completed, MED submitted the log information and other pertinent data to Bendix Field Engineering Corporation (BFEC) for evaluation. MED collected over 700,000 feet of geophysical logs. Additionally, MED conducted a search of log libraries for existing log data for twelve of the quadrangles included in the program. It should be noted that ERTEC, Inc. conducted geophysical logging and a log library search to five quadrangles in Wyoming. These areas were later assigned to MED. The location of all wells logged by MED and ERTEC and the location of other log data is shown on the enclosed maps. Detailed information that pertains to each well is provided following each map

Quality Assurance of Non-Local Accounting Programs Conducted in Hong Kong

Science.gov (United States)

Cheng, Mei-Ai; Leung, Noel W.

2014-01-01

This study examines the current government policy and institutional practice on quality assurance of non-local accounting programs conducted in Hong Kong. Both international guidelines, national regulations and institutional frameworks in higher education and transnational higher education, and professional practice in accounting education are…

Process evaluation of a multifaceted health program aiming to improve physical activity levels and dietary patterns among construction workers

NARCIS (Netherlands)

Viester, L.; Verhagen, E.A.L.M.; Bongers, P.M.; Beek, A.J. van der

2014-01-01

Objective: To evaluate the process of a health promotion program, aiming to improve physical activity levels and diet among construction workers. Methods: The process evaluation was conducted after the RE-AIM framework for the evaluation of the public health impact of health promotion interventions.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Evaluation of a Secure Laptop-Based Testing Program in an Undergraduate Nursing Program: Students' Perspective.

Science.gov (United States)

Tao, Jinyuan; Gunter, Glenda; Tsai, Ming-Hsiu; Lim, Dan

2016-01-01

Recently, the many robust learning management systems, and the availability of affordable laptops, have made secure laptop-based testing a reality on many campuses. The undergraduate nursing program at the authors' university began to implement a secure laptop-based testing program in 2009, which allowed students to use their newly purchased laptops to take quizzes and tests securely in classrooms. After nearly 5 years' secure laptop-based testing program implementation, a formative evaluation, using a mixed method that has both descriptive and correlational data elements, was conducted to seek constructive feedback from students to improve the program. Evaluation data show that, overall, students (n = 166) believed the secure laptop-based testing program helps them get hands-on experience of taking examinations on the computer and gets them prepared for their computerized NCLEX-RN. Students, however, had a lot of concerns about laptop glitches and campus wireless network glitches they experienced during testing. At the same time, NCLEX-RN first-time passing rate data were analyzed using the χ2 test, and revealed no significant association between the two testing methods (paper-and-pencil testing and the secure laptop-based testing) and students' first-time NCLEX-RN passing rate. Based on the odds ratio, however, the odds of students passing NCLEX-RN the first time was 1.37 times higher if they were taught with the secure laptop-based testing method than if taught with the traditional paper-and-pencil testing method in nursing school. It was recommended to the institution that better quality of laptops needs to be provided to future students, measures needed to be taken to further stabilize the campus wireless Internet network, and there was a need to reevaluate the Laptop Initiative Program.

Using the Wisconsin-Ohio Reference Evaluation Program (WOREP) to Improve Training and Reference Services

Science.gov (United States)

Novotny, Eric; Rimland, Emily

2007-01-01

This article discusses a service quality study conducted in the Pennsylvania State University Libraries. The Wisconsin-Ohio Reference Evaluation Program survey was selected as a valid, standardized instrument. We present our results, highlighting the impact on reference training. A second survey a year later demonstrated that focusing on…

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Environmental, economic, and energy impacts of material recovery facilities. A MITE Program evaluation

Energy Technology Data Exchange (ETDEWEB)

NONE

1995-10-01

This report documents an evaluation of the environmental, economic, and energy impacts of material recovery facilities (MRFs) conducted under the Municipal Solid Waste Innovative Technology Evaluation (MITE) Program. The MITE Program is sponsored by the US Environmental Protection Agency to foster the demonstration and development of innovative technologies for the management of municipal solid waste (MSW). This project was also funded by the National Renewable Energy Laboratory (NREL). Material recovery facilities are increasingly being used as one option for managing a significant portion of municipal solid waste (MSW). The owners and operators of these facilities employ a combination of manual and mechanical techniques to separate and sort the recyclable fraction of MSW and to transport the separated materials to recycling facilities.

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Evaluation of Cow Milk Electrical Conductivity Measurements

Directory of Open Access Journals (Sweden)

Constantin Gavan

2017-11-01

Full Text Available The efficiency of subclinical mastitis diagnosis using an electrical conductivity (EC meter was evaluated in the dairy farm of Agricultural Research and Development Station ( ARDS Simnic Craiova. The results were compared with those obtained by using the California Mastitis Test (CMT and the Somatic Cell Count (SCC.The milk quarter samples ( 1176 from Holstein Friesian cows were analyzed between September and December 2015. The EC evaluation with  the EC meter  ,showed a high proportion of results differing from SCC and CMT results. The CMT still shows to be the most accessible and efficient test in comparison to the EC meter tested.

Overview of the National Uranium Resource Evaluation Hydrogeochemical and Stream Sediment Reconnaissance Program

International Nuclear Information System (INIS)

Bolivar, S.L.

1980-01-01

A Hydrogeochemical and Stream Sediment Reconnaissance (HSSR) for uranium is currently being conducted throughout the conterminous United States and Alaska. The HSSR is part of the National Uranium Resource Evaluation sponsored by the US Department of Energy. This ambitious geochemical reconnaissance program is conducted by four Department of Energy laboratories: Los Alamos Scientific Laboratory, Lawrence Livermore Laboratory, Oak Ridge Gaseous Diffusion Plant, and Savannah River Laboratory. The program is based on an extensive review of world literature, reconnaissance work done in other countries, and pilot studies conducted by each laboratory. Sample-collection methods and sample density are determined to optimize the probability of detecting potential uranium mineralization. To achieve this aim, each laboratory has developed independent standardized field collection procedures that are designed for its section of the country. Field parameters such as pH, conductivity, climate, geography, and geology are recorded at each site. Most areas are sampled at densities of one sample site per 10 to 23 km 2 . The HSSR program has helped to improve existing hydrogeochemical reconnaissance exploration techniques. In addition to providing industry with data that may help to identify potential uranium districts and to extend known uranium provinces, the HSSR also provides multielement analytical data that can be used in water quality, soil, sediment, environmental, and base-metal exploration studies

Overview of the National Uranium Resource Evaluation Hydrogeochemical and Stream Sediment Reconnaissance Program

International Nuclear Information System (INIS)

Bolivar, S.L.

1980-07-01

A Hydrogeochemical and Stream Sediment Reconnaissance (HSSR) for uranium is currently being conducted throughout the conterminous United States and Alaska. The HSSR is part of the National Uranium Resource Evaluation sponsored by the US Department of Energy. This ambitious geochemical reconnasissance program is conducted by four Department of Energy Laboratories: Los Alamos Scientific Laboratory, Lawrence Livermore Laboratory, Oak Ridge Gaseous Diffusion Plant, and Savannah River Laboratory. Each laboratory was assigned a geographic region of the United States. The program is based on an extensive review of world literature, reconnaissance work done in other countries, and pilot studies conducted by each laboratory. Sample-collection methods and sample density are determined to optimize the probability of detecting potential uranium mineralization. To achieve this aim, each laboratory has developed independent standardized field collection procedures that are designed for its section of the country. Field parameters such as pH, conductivity, climate, geography, and geology are recorded at each site. Most areas are sampled at densities of one sample site per 10 to 23 km 2 . The HSSR program has helped to improve existing hydrogeochemical reconnaissance exploration techniques. In addition to providing industry with data that may help to identify potential uranium districts and to extend known uranium provinces, the HSSR also provides multielement analytical data that can be used in water quality, soil, sediment, environmental, and base-metal exploration studies

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

Nuclear thermal rocket nozzle testing and evaluation program

International Nuclear Information System (INIS)

Davidian, K.O.; Kacynski, K.J.

1993-01-01

Performance characteristics of the Nuclear Thermal Rocket can be enhanced through the use of unconventional nozzles as part of the propulsion system. In this report, the Nuclear Thermal Rocket nozzle testing and evaluation program being conducted at the NASA Lewis Research Center is outlined and the advantages of a plug nozzle are described. A facility description, experimental designs and schematics are given. Results of pretest performance analyses show that high nozzle performance can be attained despite substantial nozzle length reduction through the use of plug nozzles as compared to a convergent-divergent nozzle. Pretest measurement uncertainty analyses indicate that specific impulse values are expected to be within plus or minus 1.17%

Conductive hearing loss and middle ear pathology in young infants referred through a newborn universal hearing screening program in Australia.

Science.gov (United States)

Aithal, Sreedevi; Aithal, Venkatesh; Kei, Joseph; Driscoll, Carlie

2012-10-01

Although newborn hearing screening programs have been introduced in most states in Australia, the prevalence of conductive hearing loss and middle ear pathology in the infants referred through these programs is not known. This study was designed to (1) evaluate the prevalence of conductive hearing loss and middle ear pathology in infants referred by a newborn hearing screening program in north Queensland, (2) compare prevalence rates of conductive hearing loss and middle ear pathology in indigenous and nonindigenous infants, and (3) review the outcomes of those infants diagnosed with conductive hearing loss and middle ear pathology. Retrospective chart review of infants referred to the Audiology Department of The Townsville Hospital was conducted. Chart review of 234 infants referred for one or both ears from a newborn hearing screening program in north Queensland was conducted. A total of 211 infants attended the diagnostic appointment. Review appointments to monitor hearing status were completed for 46 infants with middle ear pathology or conductive hearing loss. Diagnosis of hearing impairment was made using an age-appropriate battery of audiological tests. Results were analyzed for both initial and review appointments. Mean age at initial diagnostic assessment was 47.5 days (SD = 31.3). Of the 69 infants with middle ear pathology during initial diagnostic assessment, 18 had middle ear pathology with normal hearing, 47 had conductive hearing loss, and 4 had mixed hearing loss. Prevalence of conductive hearing loss in the newborns was 2.97 per 1,000 while prevalence of middle ear pathology (with or without conductive hearing loss) was 4.36 per 1,000. Indigenous Australians or Aboriginal and Torres Strait Islander (ATSI) infants had a significantly higher prevalence of conductive hearing loss and middle ear pathology than non-ATSI infants (35.19 and 44.45% vs 17.83 and 28.66%, respectively). ATSI infants also showed poor resolution of conductive hearing loss

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

Science.gov (United States)

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across

Evaluation of low-level radioactive waste characterization and classification programs of the West Valley Demonstration Project

International Nuclear Information System (INIS)

Taie, K.R.

1994-01-01

The West Valley Demonstration Project (WVDP) is preparing to upgrade their low-level radioactive waste (LLW) characterization and classification program. This thesis describes a survey study of three other DOE sites conducted in support of this effort. The LLW characterization/classification programs of Oak Ridge National Laboratory, Savannah River Site, and Idaho National Engineering Laboratory were critically evaluated. The evaluation was accomplished through tours of each site facility and personnel interviews. Comparative evaluation of the individual characterization/classification programs suggests the WVDP should purchase a real-time radiography unit and a passive/active neutron detection system, make additional mechanical modifications to the segmented gamma spectroscopy assay system, provide a separate building to house characterization equipment and perform assays away from waste storage, develop and document a new LLW characterization/classification methodology, and make use of the supercompactor owned by WVDP

Evaluation of a workplace bullying cognitive rehearsal program in a hospital setting.

Science.gov (United States)

Stagg, Sharon J; Sheridan, Daniel; Jones, Ruth Ann; Speroni, Karen Gabel

2011-09-01

Workplace bullying is a serious problem faced by nurses nationally. This study was conducted to determine the frequency of workplace bullying and evaluate the effectiveness of a training program on cognitive rehearsal of responses to common bullying behaviors. This program to increase staff nurses' knowledge of management of workplace bullying consisted of three components: pilot survey testing, a piloted Internet-based survey administered to the medical and surgical nurses, and a 2-hour cognitive rehearsal training program on management of workplace bullying. The results showed that 80% of the nurses surveyed had experienced workplace bullying over the previous year. After the training program, nurses' knowledge of workplace bullying management significantly increased. Additionally, nurses were significantly more likely to report that they had observed bullying and had bullied others. Further, nurses felt more adequately prepared to handle workplace bullying. Results of the research support the provision of a workplace bullying management program for nurses and the need for a specific policy on workplace bullying. Copyright 2011, SLACK Incorporated.

Evaluating soil moisture and hydraulic conductivity in semi-arid rangeland soils

International Nuclear Information System (INIS)

Whitaker, M.P.L.

1993-01-01

The US DOE's Office of Civilian Radioactive Waste Management (DOE-OCRWM) Fellowship Program supports various disciplines of academic research related to the isolation of radionuclides from the biosphere. The purpose of this paper is to provide an example of a university research application in the specific discipline of hydrology and water resources (a multi-disciplinary field encompassing engineering and the earth sciences), and to discuss how this research pertains to the objectives of the DOE-OCRWM Fellowship Program. The university research application is twofold: One portion focuses on the spatial variability of soil moisture (θ) and the other section compares point measurements with small watershed estimates of hydraulic conductivity (K) in a semi-arid rangeland soil in Arizona. For soil moisture measurements collected over a range of horizontal sampling intervals, no spatial correlation was evident. This outcome is reassuring to computer modelers who have assumed no spatial correlation for soil moisture over smaller scales. In regard to hydraulic conductivity, point measurements differed significantly from small watershed estimates of hydraulic conductivity which were derived from a calibrated and verified rainfall-runoff computer model. The estimates of saturated hydraulic conductivity (Ks) were obtained from previous computer simulations in which measured data was collected in the same research location as the present study

The Development and Evaluation of a Peer-Training Program for Elementary School Students Teaching Secure Internet Use

Science.gov (United States)

Korkmaz, Murat; Esen, Binnaz Kiran

2013-01-01

The aim of this study is to design and evaluate a peer-training program about changing students' internet use habits. This study was conducted with students from two different elementary schools in Mersin, Turkey, who were enrolled in 7th or 8th grade in the 2009-2010 academic year. A total of 24 students participated in the program, 12 of whom…

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

An Evaluation of the Getz - Roanoke County School Division's School Counselor Peer Group Clinical Supervision Program

OpenAIRE

Agnew, David T.

1998-01-01

(G-PGCS) was designed and implemented for K-6 school counselors. G-PGCS began in the fall of 1994 and has continued to the present; however, there have been no studies on the effects of the program. Therefore, the purpose of this study was to conduct a qualitative evaluation of G-PGCS. The evaluation participants included current Roanoke County K-5 school counselors, and selected administrators. The sources of data for the evalu...

Conducting Simulation Studies in the R Programming Environment.

Science.gov (United States)

Hallgren, Kevin A

2013-10-12

Simulation studies allow researchers to answer specific questions about data analysis, statistical power, and best-practices for obtaining accurate results in empirical research. Despite the benefits that simulation research can provide, many researchers are unfamiliar with available tools for conducting their own simulation studies. The use of simulation studies need not be restricted to researchers with advanced skills in statistics and computer programming, and such methods can be implemented by researchers with a variety of abilities and interests. The present paper provides an introduction to methods used for running simulation studies using the R statistical programming environment and is written for individuals with minimal experience running simulation studies or using R. The paper describes the rationale and benefits of using simulations and introduces R functions relevant for many simulation studies. Three examples illustrate different applications for simulation studies, including (a) the use of simulations to answer a novel question about statistical analysis, (b) the use of simulations to estimate statistical power, and (c) the use of simulations to obtain confidence intervals of parameter estimates through bootstrapping. Results and fully annotated syntax from these examples are provided.

Conducting Simulation Studies in the R Programming Environment

Directory of Open Access Journals (Sweden)

Kevin A. Hallgren

2013-10-01

Full Text Available Simulation studies allow researchers to answer specific questions about data analysis, statistical power, and best-practices for obtainingaccurate results in empirical research. Despite the benefits that simulation research can provide, many researchers are unfamiliar with available tools for conducting their own simulation studies. The use of simulation studies need not be restricted toresearchers with advanced skills in statistics and computer programming, and such methods can be implemented by researchers with a variety of abilities and interests. The present paper provides an introduction to methods used for running simulationstudies using the R statistical programming environment and is written for individuals with minimal experience running simulation studies or using R. The paper describes the rationale and benefits of using simulations and introduces R functions relevant for many simulation studies. Three examples illustrate different applications for simulation studies, including (a the use of simulations to answer a novel question about statistical analysis, (b the use of simulations to estimate statistical power, and (c the use of simulations to obtain confidence intervals of parameter estimates throughbootstrapping. Results and fully annotated syntax from these examples are provided.

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Evaluation of a child sexual abuse prevention program.

Science.gov (United States)

Chasan-Taber, L; Tabachnick, J

1999-10-01

A half-million children are believed to be sexually abused each year in the United States. In 1995, the American Medical Association declared sexual assault "a silent violent epidemic." The majority of efforts to stop child sexual abuse have focused on punishing abusers and treating victims and their families; prevention programs are uncommon and rely on educating children to report sexual abuse. This case study describes the evaluation of the first public health campaign designed to target adults for prevention. A baseline assessment of attitudes, awareness, knowledge, and policies was conducted in Vermont to identify facilitators and barriers to adult prevention of child sexual abuse. These included predisposing factors (50% of Vermont residents did not know the characteristics of an abuser), enabling factors (60% of Vermont residents did not know where to refer someone who may have sexual behavior problems), and reinforcing factors (when focus group participants knew an abuser, they were less likely to take action). This process guided the intervention, which included a broad-based media campaign targeting adults; a one-to-one communications strategy that provided information to agencies working with families at risk and a toll-free helpline for adults in an abuse situation; and a systems change strategy designed to educate decision-makers and leaders. Program evaluation measures included a random-digit dial survey, focus groups, a survey of Vermont decision-makers, and other data sets. The successes and limitations of these interventions, both as strategies in themselves and as data sources for evaluation, are discussed.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

UNAVCO's Education and Community Engagement Program: Evaluating Five years of Geoscience Education and Community Outreach

Science.gov (United States)

Charlevoix, D. J.; Dutilly, E.

2017-12-01

In 2013, UNAVCO, a facility co-sponsored by the NSF and NASA, received a five-year award from the NSF: Geodesy Advancing Geosciences and EarthScope (GAGE). Under GAGE, UNAVCO's Education and Community Engagement (ECE) program conducts outreach and education activities, in essence broader impacts for the scientific community and public. One major challenge of this evaluation was the breadth and depth of the dozens of projects conducted by the ECE program under the GAGE award. To efficiently solve this problem of a large-scale program evaluation, we adopted a deliberative democratic (DD) approach that afforded UNAVCO ECE staff a prominent voice in the process. The evaluator directed staff members to chose the projects they wished to highlight as case studies of their finest broader impacts work. The DD approach prizes inclusion, dialogue, and deliberation. The evaluator invited ECE staff to articulate qualities of great programs and develop a case study of their most valuable broader impacts work. To anchor the staff's opinion in more objectivity than opinion, the evaluator asked each staff member to articulate exemplary qualities of their chosen project, discuss how these qualities fit their case study, and helped staff to develop data collection systems that lead to an evidence-based argument in support of their project's unique value. The results of this evaluation show that the individual ECE work areas specialized in certain kinds of projects. However, when viewed at the aggregate level, ECE projects spanned almost the entire gamut of NSF broader impacts categories. Longitudinal analyses show that since the beginning of the GAGE award, many projects grew in impact from year 1 to year 5. While roughly half of the ECE projects were prior work projects, by year five at least 33% of projects were newly developed under GAGE. All selected case studies exemplified how education and outreach work can be productively tied to UNAVCO's core mission of promoting geodesy.

SKB's program for societal research 2004-2011. An evaluation; SKB:s program foer samhaellsforskning 2004-2011. En utvaerdering

Energy Technology Data Exchange (ETDEWEB)

Soederberg, Olof [Energi- och miljoestrategi O. Soederberg, Solna (Sweden)

2012-04-15

This evaluation of the program of societal research that SKB conducted the years 2004-2011 has been performed on behalf of Swedish Nuclear Fuel and Waste Management Company (SKB). The review has focused on answers to a series of questions as follows: General questions - Why was a program started? - What was SKB's purpose with the program? - Does the result mean that the objective has been achieved? - Has the program had effects (positive or negative) that were not anticipated when the purpose was formulated? - Strengths and weaknesses of the program? Questions about the implementation - How did announcement and selection procedures work? - Which forms were used for reporting results from the research projects? Questions about the continued investment in societal research - Are there such needs? - In that case, is it in SKB's interest to contribute financially to such research? - What forms might be appropriate if SKB sees interest to contribute financially to such research?.

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol.

Science.gov (United States)

Ware, Patrick; Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-05-03

Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. The telemonitoring program was launched in

Building capacity for change: evaluation of an organisation-wide leadership development program.

Science.gov (United States)

Schultz, Tim; Shoobridge, Jodie; Harvey, Gill; Carter, Libby; Kitson, Alison

2018-05-23

Objective. This study evaluated Leading 4 Change, a change leadership development program designed to support healthcare middle managers through a period of significant organisational change and enhance workplace resilience. Methods. A mixed methods evaluation was conducted within the program's framework of a quality improvement activity. Quantitative measures were participant responses (n=160) to online questionnaires, which were compared before and after the program, using an uncontrolled pre-post study design. Four questionnaires were used: Resilience @ Work, General Self-Efficacy, the 11-item Learning Organization Survey and organisational climate. Differences between the pre- and post-program periods were compared using linear mixed-effects models, incorporating repeated measures between 'pre' and 'post' periods. Qualitative data were obtained by interviewing four participants on three occasions during the program, and through text responses provided by participants during a presentation session after the program finished. Both interview data and textual data were subjected to thematic analysis. Results. Integration of data from quantitative and qualitative analyses generated three main findings: (1) participants were satisfied and engaged with the program, which met their learning objectives; (2) the program led to increased workplace resilience, in particular the ability to manage stress and self-efficacy for individuals; and (3) organisational learning perceptions were unchanged. Conclusion. Although conducted during a period of intense internal and external pressure, Leading 4 Change led to demonstrable effects. It effectively engaged middle managers across a health system. However, there was no evidence that the effect of the program extended beyond individual participants to their perceptions of their work environment as a learning organisation. What is known about the topic? Although much has been written about change management and change leadership

Misprescribing controlled substances: An evaluation of a professional development program.

Science.gov (United States)

Dewey, Charlene M; Ghulyan, Marine V; Swiggart, William H

2016-01-01

Controlled prescription drug (CPD) abuse has reached epidemic proportions in the United States. Most physicians attending a 3-day continuing medical education (CME) professional development program (PDP) lack training in identifying risk and in managing patients who misuse CPDs. To address this issue, the authors conducted an evaluation of a PDP that trains physicians on proper prescribing, identifying substance abuse, utilizing screening, brief intervention, and referral to treatment (SBIRT), and implementing motivational interviewing (MI). The authors conducted a program evaluation to assess the efficacy and impact of the PDP on physicians' knowledge and prescribing behaviors. Participants (N = 174) were typically middle-aged (average age of 53 years), male (89%), and physicians (82%) and other health care professionals (18%). Many physicians practice in solo primary care settings (46%). Course evaluations were completed by n = 155 (89%) participants who rated the course and presenters highly (mean 4.8/5 respectively). Physicians' knowledge scores on pre/post assessments increased significantly: pretest (M = 58.7, SD = 13.12) and posttest (M = 78.28, SD = 9.83) (t(173) = 20.06, P ≤ .0001, 95% confidence interval, CI: [-21.51, -17.65]). Almost half of the participants, n = 83/174 (48%), completed the follow-up survey, and 93% agreed/strongly agreed (A/SA) they made professional practice changes. Of participants practicing with an active DEA (Drug Enforcement Administration) registration (n = 57), most agreed/strongly agreed they implemented changes to align their practices with current guidelines (89%), used CPD more appropriately (87%), implemented office policies on prescribing (81%), identified and referred more substance abuse patients to treatment (80%), shared new information/experience from course with other 25 health professionals (93%), and felt the course positively impacted their behaviors personally and professionally (90% and 96%, respectively

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Jamaica National Net-Billing Pilot Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Doris, Elizabeth [National Renewable Energy Lab. (NREL), Golden, CO (United States); Stout, Sherry [National Renewable Energy Lab. (NREL), Golden, CO (United States); Peterson, Kimberly [National Renewable Energy Lab. (NREL), Golden, CO (United States)

2015-12-18

This technical report discusses the effectiveness of the Jamaica Public Service Company Limited Net-Billing Pilot Program. The National Renewable Energy Laboratory (NREL) collected and analyzed data from a wide range of stakeholders, conducted in-country research, and compared program elements to common interconnection practices to form programmatic recommendations for the Jamaica context. NREL finds that the net-billing pilot program has successfully contributed to the support of the emerging solar market in Jamaica with the interconnection of 80 systems under the program for a total of 1.38 megawatts (MW) at the time of original analysis.

Building an evidence base for community health: a review of the quality of program evaluations.

Science.gov (United States)

Jolley, Gwyn M; Lawless, Angela P; Baum, Fran E; Hurley, Catherine J; Fry, Denise

2007-11-01

An assessment of the quality of program evaluations conducted in South Australian community health services investigated how effective evaluation reporting is in producing an evidence base for community health. Evaluation reports were assessed by a team of reviewers. Practitioner workshops allowed an understanding of the uses of evaluation and what promotes or acts as a barrier to undertaking evaluations. Community health services do undertake a good deal of evaluation. However, reports were not generally explicit in dealing with the principles that underpin community health. Few engaged with program theory or rationale. Typically, reports were of short-term projects with uncertain futures so there may seem little point in considering issues of long-term health outcomes and transferability to other settings. The most important issue from our study is the lack of investment in applied health services research of the sort that will be required to produce the evidence for practice that policy makers desire. The current lack of evidence for community health reflects failure of the system to invest in research and evaluation that is adequately resourced and designed for complex community settings.

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Uranium resource evaluation project quality assurance evaluation

International Nuclear Information System (INIS)

Grimes, J.G.

1981-01-01

This evaluation was conducted over an eight-month period from February 4 through October 1, 1980. During this time, field sampling was suspended for an indefinite time period while the National Uranium Resource Evaluation (NURE) Program underwent restructuring. In addition, the Uranium Resource Evaluation (URE) Project archives are being restructured. Since it is difficult to evaluate quality assurance needs of a program that is undergoing drastic change and because sections of the evaluation were well along before these changes were announced, this evaluation reflects the situation as it was during February 1980. The following quality assurance related programs are continuing to date: (1) periodic checks of field sampling procedures by the Supervising Field Geologist and the Director of Field Operations; (2) verification of field form information and laboratory analytical data verification for all geochemical surveys; (3) URE Project laboratory quality control program (all elements routinely analyzed); and (4) Ames interlaboratory quality control program (uranium only). UCC-ND was given the responsibility of conducting a Hydrogeochemical and Stream Sediment Reconnaissance (HSSR) survey in the Central United States (Illinois, Indiana, Iowa, Kansas, Michigan, Minnesota, Nebraska, North Dakota, Oklahoma, Texas, South Dakota, and Wisconsin). During 1979 and 1980, 13 detailed surveys were conducted by the URE Project in the Central and Western United States to characterize the hydrogeochemistry, stream sediment geochemistry, and/or radiometric patterns of known or potential uranium occurrences. Beginning in 1980, the HSSR surveys were modified to the Regional Hydrogeochemical and Stream Sediment (RHSS) surveys

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

Evaluation of capacity-building program of district health managers in India: a contextualized theoretical framework.

Science.gov (United States)

Prashanth, N S; Marchal, Bruno; Kegels, Guy; Criel, Bart

2014-01-01

Performance of local health services managers at district level is crucial to ensure that health services are of good quality and cater to the health needs of the population in the area. In many low- and middle-income countries, health services managers are poorly equipped with public health management capacities needed for planning and managing their local health system. In the south Indian Tumkur district, a consortium of five non-governmental organizations partnered with the state government to organize a capacity-building program for health managers. The program consisted of a mix of periodic contact classes, mentoring and assignments and was spread over 30 months. In this paper, we develop a theoretical framework in the form of a refined program theory to understand how such a capacity-building program could bring about organizational change. A well-formulated program theory enables an understanding of how interventions could bring about improvements and an evaluation of the intervention. In the refined program theory of the intervention, we identified various factors at individual, institutional, and environmental levels that could interact with the hypothesized mechanisms of organizational change, such as staff's perceived self-efficacy and commitment to their organizations. Based on this program theory, we formulated context-mechanism-outcome configurations that can be used to evaluate the intervention and, more specifically, to understand what worked, for whom and under what conditions. We discuss the application of program theory development in conducting a realist evaluation. Realist evaluation embraces principles of systems thinking by providing a method for understanding how elements of the system interact with one another in producing a given outcome.

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Evaluating the online platform of a blended-learning pharmacist continuing education degree program

OpenAIRE

Wilbur, Kerry

2016-01-01

Background: Distance-based continuing education opportunities are increasingly embraced by health professionals worldwide. Methods: To evaluate the online component of a blended-learning degree program for pharmacists, we conducted a structured self-assessment and peer review using an instrument systematically devised according to Moore’s principles of transactional distance. The web-based platform for 14 courses was reviewed by both local and external faculty, followed by shared reflecti...

Evaluation of a Worksite Diabetes Education Program at a Large Urban Medical Center.

Science.gov (United States)

Renda, Susan; Baernholdt, Marianne; Becker, Kathleen

2016-01-01

Evidence suggests that diabetes education can be delivered at the worksite to better support employees' diabetes self-management and improve productivity and health care costs. This study was conducted to address the feasibility of a diabetes worksite education program for employees at a large urban academic health care institution. The diabetes education program was delivered in the diabetes center at the institution, a resource that was previously underutilized by employees. Through collaboration with groups in the institution, 20 employees of diverse ethnicity participated in the worksite diabetes education program with positive outcomes: improved glycemic control measured (HbA1c), attainment of self-management goals, and satisfaction with the program. Work absences trended downward, but numbers of hospitalizations and emergency department visits were unchanged in the 3 months following education. Recommendations include replication of the study with more employee participation and program evaluation over a longer period of time to continue assessment of employees' educational needs. © 2015 The Author(s).

An Evaluation of "Reach Out Central": An Online Gaming Program for Supporting the Mental Health of Young People

Science.gov (United States)

Shandley, Kerrie; Austin, David; Klein, Britt; Kyrios, Michael

2010-01-01

The objective of this study was to conduct an evaluation of Reach Out Central (ROC), an online gaming program designed to support the mental health of people aged 16-25. The evaluation sought to determine the benefit of playing ROC on alcohol use, use of coping strategies, psychological distress, resilience and satisfaction with life. Changes in…

Employment Assistance Planning Programs for Welfare Recipients: An Evaluation and the Development of a Screening Measure.

Science.gov (United States)

Peterson, Gary W.; And Others

A project was conducted to develop an assessment instrument for use in identifying welfare recipients who are potentially employable and to evaluate the effectiveness of Florida's three existing pilot employment assistance planning programs (termed PAPAs after the Public Assistance Productivity Act). Data on the employment status of 98 individuals…

["Active in rehab": development and formative evaluation of a patient education program to increase health literacy of patients with chronic illness].

Science.gov (United States)

Ullrich, A; Schöpf, A C; Nagl, M; Farin, E

2015-04-01

The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.

The development of a taste education program for preschoolers and evaluation of a program by parents and childcare personnel.

Science.gov (United States)

Shon, Choengmin; Park, Young; Ryou, Hyunjoo; Na, Woori; Choi, Kyungsuk

2012-10-01

The change in people's dietary life has led to an increase in an intake of processed foods and food chemicals, raising awareness about taste education for preschoolers whose dietary habits start to grow. This study aims to evaluate the effectiveness and satisfaction of parents and childcare personnel after developing a taste education program and demonstrating it in class. A part of the curriculum developed by Piusais and Pierre was referred for the program. After educating 524 preschoolers in child care facilities in Seoul, a satisfaction survey was conducted on the program. The data in this study were analyzed using SPSS 14.0. Statistical analysis was conducted based on the frequency after collecting the data. Mean ± SD used to determine satisfaction with taste education, with preferences marked on a five-point scale and the alpha was set at 0.05. The program includes five teachers' guides with subjects of sweetness, saltiness, sourness, bitterness and harmony of flavor, and ten kinds of teaching tools. For the change in parents' recognition of the need for taste education based on five-point scale, the average of 4.06 ± 0.62 before the program has significantly increased to 4.32 ± 0.52 (P facilities, the average scores for education method, education effect, education contents and nutritionists, and teaching tools were at 4.15 ± 0.63, 3.91 ± 0.50, 4.18 ± 0.50, and 3.80 ± 0.56 respectively. In addition, the need for a continuous taste education scored 4.42 ± 0.67. This program has created a positive change in preschoolers' dietary life, therefore the continuation and propagation of the taste education program should be considered.

Evaluation of the support schemes of The District Heating Program during the period 2008 to 2011; Evaluering av stoetteprogrammene for fjernvarme i perioden 2008 til 2011

Energy Technology Data Exchange (ETDEWEB)

Lindland, Odd Ivar; Johansen, Staale; Holstad, Jon; Vennes, Wenche; Kallset, Eirik

2012-11-01

The District Heating Program as they are designed today, are evaluated after four years of operation, to see if the program works as intended and meet the goals that were set up at the start of 2008. It is also seen in the evaluation of the development of district heating market in the period, to see if there are trends and changes in the regulatory framework that makes it appropriate to make changes to the programs. Users 'perception of the program and the programs' direct and indirect influence on the development of district heating market is also considered. The PricewaterhouseCoopers AS (PwC) has carried out the evaluation, commissioned by Enova. PwC has conducted Internet-based surveys and interviewed actors in various roles within the district. PwC concluded that the goals that were set at the input of the program period is reached. Energy results were higher than expected, while there is a trend that Enova have to pay more and more for the projects. The number of applications and projects has remained fairly stable, while projects have been smaller in size and extent. (eb)

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

Antimicrobial resistance programs in canada 1995-2010: a critical evaluation

Directory of Open Access Journals (Sweden)

Conly John M

2012-02-01

Full Text Available Abstract Background In Canada, systematic efforts for controlling antibiotic resistance began in 1997 following a national Consensus Conference. The Canadian strategy produced 27 recommendations, one of which was the formation of the Canadian Committee on Antibiotic Resistance (CCAR. In addition several other organizations began working on a national or provincial basis over the ensuing years on one or more of the 3 identified core areas of the strategy. Critical evaluation of the major programs within Canada which focused on antimicrobial resistance and the identified core components has not been previously conducted. Findings Data was collected from multiple sources to determine the components of four major AMR programs that were considered national based on their scope or in the delivery of their mandates. Assessment of program components was adapted from the report from the International Forum on Antibiotic Resistance colloquium. Most of the programs used similar tools but only the Do Bugs Need Drugs Program (DBND had components directed towards day cares and schools. Surveillance programs for antimicrobial resistant pathogens have limitations and/or significant sources of bias. Overall, there has been a 25.3% decrease in oral antimicrobial prescriptions in Canada since 1995, mainly due to decreases in β lactams, sulphonamides and tetracyclines in temporal association with multiple programs with the most comprehensive and sustained national programs being CCAR and DBND. Conclusions Although there has been a substantial decrease in oral antimicrobial prescriptions in Canada since 1995, there remains a lack of leadership and co-ordination of antimicrobial resistance activities.

Development of a program for evaluating the temperature of SMART-P fuel rod

Energy Technology Data Exchange (ETDEWEB)

Cheon, Jin Sik; Lee, Byung Ho; Koo, Yang Hyun; Oh, Je Yong; Yim, Jeong Sik; Sohn, Dong Seong

2003-11-01

A code for evaluating the temperature of SMART-P fuel rod has been developed. Finite Element (FE) method is adopted for the developed code sharing the user subroutines which has been prepared for the ABAQUS commercial FE code. The developed program for SMART-P fuel rod corresponds to a nonlinear transient heat transfer problem, and uses a sparse matrix solver for FE equations during iterations at every time step. The verifications of the developed program were conducted using the ABAQUS code. Steady state and transient problems were analyzed for 1/8 rod model due to the symmetry of the fuel rod and full model. From the evaluation of temperature for the 1/8 rod model at steady state, maximal error of 0.18 % was present relative to the ABAQUS result. Analysis for the transient problem using the fuel rod model resulted in the same as the variation of centerline temperature from the ABAQUS code during a hypothetical power transient. Also, given a power depression in fuel meat as a function of burnup, its effect on the centerline temperature was more precisely evaluated by the developed program compared to the ABAQUS code. The distribution of heat flux for the entire cross section and surface was almost identical for the two codes.

A quantitative and qualitative evaluation of the British Columbia Take Home Naloxone program.

Science.gov (United States)

Tzemis, Despina; Al-Qutub, Diana; Amlani, Ashraf; Kesselring, Sarah; Buxton, Jane A

2014-07-01

In August 2012, the British Columbia Take Home Naloxone (BCTHN) program was introduced to help to reduce opioid overdose and its consequences. This study evaluates the BCTHN program, identifying the successes and challenges of implementing a provincial program in Canada. In this cross-sectional study, we reviewed the records of the BCTHN administrative program to report on program outcomes (participation and overdose reversals). Focus groups and individual interviews were conducted with 40 clients in Vancouver; 12 individual interviews were completed with service providers, police officers and parents of people who use opioids from both the Vancouver and Interior regions of British Columbia. Qualitative data were analyzed using content analysis and a qualitative descriptive approach. As of March 13, 2014, the BCTHN program had been implemented at 40 sites, trained 1318 participants in overdose prevention, recognition and response, distributed 836 kits to clients and received reports of 85 overdose reversals. Stakeholders were supportive of the program, and clients reported greater confidence in response to overdose. Service providers found the program training materials easy to use and that training increased client engagement. Some of the challenges included difficulty in identifying physician willing to prescribe, recruitment of some at-risk populations (e.g., long-term opioid users and patients with chronic pain), and clients' reluctance to call 911. We also found that the police had some misconceptions about BCTHN. The BCTHN program was easy to implement, empowering for clients and was responsible for reversing 85 overdoses in its first 20 months. We suggest communities across Canada should consider implementing take-home naloxone programs and evaluate their findings.

Evaluation of a class wide teaching program for developing preschool life skills.

Science.gov (United States)

Hanley, Gregory P; Heal, Nicole A; Tiger, Jeffrey H; Ingvarsson, Einar T

2007-01-01

Recently, nonmaternal center-based child care has been linked to problem behavior in young children (National Institute of Child Health and Human Development, 2003). In response, a comprehensive program to promote prosocial skills was evaluated in a classroom of 16 children between the ages of 3 and 5 years. Classroom observations were conducted during evocative situations to determine the likelihood of problem behavior (noncompliance, vocal or motor disruptions, aggression) and preschool life skills. A classwide teaching program was then implemented in a staggered manner across instruction following, functional communication, delay tolerance, and friendship skills. These four categories of preschool life skills, which included two to four related skills, were selected for classwide teaching because they were either identified by educators as important for early school success, have often been taught following functional assessments of more severe problem behavior, or both. Skills were taught on a classwide basis during typically scheduled activities (circle, free play, transitions, meals) via instructions, modeling, role play, and feedback. A multiple probe design showed that the program resulted in an 74% reduction in problem behavior and a more than four-fold increase in preschool life skills. Similar beneficial effects of the program were evident in questionnaire data gathered prior to and at the close of the evaluation. Finally, the teachers who implemented the program reported overall high levels of satisfaction with the classwide teaching program, the target skills, and the results. Implications for the design of early childhood experiences for preempting the development of serious problem behavior are discussed.

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

CONSORT to community: translation of an RCT to a large-scale community intervention and learnings from evaluation of the upscaled program.

Science.gov (United States)

Moores, Carly Jane; Miller, Jacqueline; Perry, Rebecca Anne; Chan, Lily Lai Hang; Daniels, Lynne Allison; Vidgen, Helen Anna; Magarey, Anthea Margaret

2017-11-29

Translation encompasses the continuum from clinical efficacy to widespread adoption within the healthcare service and ultimately routine clinical practice. The Parenting, Eating and Activity for Child Health (PEACH™) program has previously demonstrated clinical effectiveness in the management of child obesity, and has been recently implemented as a large-scale community intervention in Queensland, Australia. This paper aims to describe the translation of the evaluation framework from a randomised controlled trial (RCT) to large-scale community intervention (PEACH™ QLD). Tensions between RCT paradigm and implementation research will be discussed along with lived evaluation challenges, responses to overcome these, and key learnings for future evaluation conducted at scale. The translation of evaluation from PEACH™ RCT to the large-scale community intervention PEACH™ QLD is described. While the CONSORT Statement was used to report findings from two previous RCTs, the REAIM framework was more suitable for the evaluation of upscaled delivery of the PEACH™ program. Evaluation of PEACH™ QLD was undertaken during the project delivery period from 2013 to 2016. Experiential learnings from conducting the evaluation of PEACH™ QLD to the described evaluation framework are presented for the purposes of informing the future evaluation of upscaled programs. Evaluation changes in response to real-time changes in the delivery of the PEACH™ QLD Project were necessary at stages during the project term. Key evaluation challenges encountered included the collection of complete evaluation data from a diverse and geographically dispersed workforce and the systematic collection of process evaluation data in real time to support program changes during the project. Evaluation of large-scale community interventions in the real world is challenging and divergent from RCTs which are rigourously evaluated within a more tightly-controlled clinical research setting. Constructs

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.

2000-01-01

The action program Energy 2000 has been continually reviewed by independent experts in view of its effects. This resulted in around 50 scientific studies between 1991 and 1999, dealing with different aspects of the program. In the book 'Energy 2000: effects of the program and conclusions from its evaluation', the results of these evaluations are summarised, and conclusions for the design of the follow-up program are drawn. The organisational frame of the program is presented and the question answered whether the determining principles of the program proved practical. Besides, the effects of state intervention, of the conflict solving groups and the voluntary actions of Energy 2000 are appraised. A separate chapter is dedicated to the evaluation strategy of the program, its implementation and the benefits of the evaluations. Propositions for the evaluation of the follow-up program are formulated as well. Dr. Andreas Balthasar is President of the Swiss Evaluation Society. (author)

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

Evaluation of an employment program for people with mental illness using the Supported Employment Fidelity Scale.

Science.gov (United States)

Cocks, Errol; Boaden, Ross

2009-10-01

The Individual Placement and Support (IPS) model aims to achieve open employment for people with mental illness. The Supported Employment Fidelity Scale (SEFS) is a 15-item instrument that evaluates the extent to which a service follows the IPS principles of best practice. This paper describes the IPS model and an evaluation of a specialist employment program for people with mental illness using the SEFS. The SEFS enabled a quantitative assessment of service provision against the criteria of evidence-based practice principles. Data were collected from multiple sources. In addition, a literature review was conducted, and personnel engaged in implementation of the IPS model at other Australian employment programs were consulted. The program achieved a score of 59 of a possible 75 on the SEFS, which is described as fair supported employment. Analysis of the 15-scale items resulted in the identification of strengths, areas for further development, and a set of recommendations. The program was operating substantially in line with evidence-based practice principles and had considerable scope for further development. Issues arising from the evaluation, areas of applicability of the SEFS and the underlying literature, and implications for occupational therapy are highlighted.

Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review.

Science.gov (United States)

Nicoll, Pam; MacRury, Sandra; van Woerden, Hugo C; Smyth, Keith

2018-04-11

Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner

EVALUATION OF BASIC COURSE WORKSHOP CONDUCTED IN A MEDICAL COLLEGE

OpenAIRE

Manasee Panda; Krishna Kar; Kaushik Mishra

2017-01-01

BACKGROUND Faculty development is perhaps one of the foremost issues among the factors influencing the quality of medical education. It was planned to evaluate Basic course workshop (BCW) on Medical education Technologies (MET) conducted in the institution with following objectives 1. To assess the effectiveness of the B CW in MET conducted in the Medical College. 2. To study the changes in teaching practices and assessment methods of faculties after the workshop. MATERIALS ...

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

Evaluating a Graduate Professional Development Program for Informal Science Educators

Science.gov (United States)

Lake, Jeremy Paul

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the Informal Science Institutions Environmental Education Graduate Certificate Program truly provided the long term professional development needed to enhance the skills of the formal and informal educators participating so that they could contribute meaningfully to the improvement of science literacy in their respective communities. My role as an internal evaluator provided an extraordinary opportunity to know the intent of the learning opportunities and why they were constructed in a particular fashion. Through the combination of my skills, personal experiences both within the certificate's predecessor and as an educator, I was uniquely qualified to explore the outcomes of this program and evaluate its effectiveness in providing a long-term professional development for participants. After conducting a literature review that emphasized a need for greater scientific literacy in communities across America, it was evident that the formal education enterprise needs the support of informal educators working on the ground in myriad different settings in ways that provide science as both content and process, learning science facts and doing real science. Through a bridging of informal science educators with formal teachers, it was thought each could learn the culture of the other, making each more fluent in accessing community resources to help make these educators more collaborative and able to bridge the classroom with the outside world. This bridge promotes ongoing, lifelong learning, which in turn can help the national goal of greater scientific literacy. This study provided insight into the thinking involved in the learners' growth as they converted theory presented in course materials into practice. Through an iterative process of reviewing the course

An evaluation of vocational high schools in Indonesia: A comparison between four-year and three-year programs

Directory of Open Access Journals (Sweden)

Soenarto Soenarto

2017-12-01

Full Text Available The research aimed to gain insights into the quality of four-year program vocational high school (VHS in Indonesia compared to four-year program VHS. This research was conducted based on the school graduate standard, business sector and industrial sector (or Dunia Usaha dan Dunia Industri (DUDI – or the performance of the graduates and alumni (the graduates’ satisfaction. The research was conducted using Discrepancy Evaluation Model using 16 VHSs (eight four-year program VHSs and eight three-year program VHSs. The result shows that from the standpoint of the school, the graduates of the four-year program VHS are higher in quality than those of the three-year program VHS. The four-year program VHS graduates are more qualified in seven aspects: teamwork, discipline, tenacity, theoretical knowledge, confidence, creativity, and leadership. Meanwhile, using DUDI standpoint, the four-year program VHS graduates are also higher in quality than the three-year program VHS graduates. In addition, the four-year program VHS graduates are better in the quality of their discipline, tenacity, theoretical knowledge, practical skills, confidence, carefulness, creativity, and leadership. The four-year program VHS graduates have a higher level of satisfaction in terms of income than the three-year program VHS graduates. The higher quality of the four-year program VHS graduates has resulted from longer duration of the internship program (PKL that provides them with reliable experience and skills concerning work-related problem-solving activities.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

HEALS Hypertension Control Program: Training Church Members as Program Leaders.

Science.gov (United States)

Dodani, Sunita; Beayler, Irmatine; Lewis, Jennifer; Sowders, Lindsey A

2014-01-01

Health disparities related to cardiovascular diseases (CVDs) including stroke have remained higher in the African-Americans (AAs) than in other populations. HEALS is a faith-based hypertension (HTN) control program modified according to AA community needs, and delivered by the church-lay members called church health advisors (CHAs). This study examined the feasibility and acceptability of training CHAs as HEALS program leaders. Four CHAs completed a 10-hour HEALS program training workshop at the Church, conducted by the nutrition experts. Workshop was evaluated by CHAs on their level of satisfaction, clarity of contents covered and comfort in delivery the program to the church congregation. The overall six main HEALS curriculum components were completed. Workshop was highly evaluated by CHAs on length of training, balance between content and skills development, and level of satisfaction with program delivery. Church-based culturally modified health promotion interventions conducted by the community lay members may be a way to reduce health disparities in ethnic minorities.

Process evaluation of a national school-based iron supplementation program for adolescent girls in Iran.

Science.gov (United States)

Kheirouri, Sorayya; Alizadeh, Mohammad

2014-09-16

Iron deficiency anemia remains as one of the most common nutritional problems in Iran, especially in women and girls. A process evaluation study of the national iron supplementation program targeting girls attending high schools was conducted to examine degree of exposure and satisfaction of the targets with the intervention components, and to assess the delivery (quantity), fidelity (quality), and environmental mediators of the intervention. Three assessment tools were developed and used for the process evaluation. A total of 8 schools were selected using a simple randomization method. Data were collected from students (n = 658 of 661 participants), teachers (n = 80), and school principals (n = 7 of 8). For the qualitative measures semi-structured interviews were conducted with the three study groups. Mean continuous compliance was 62.3%. Intolerance to pills and no water supply in classrooms accounted for 47.72% and 36.21% of the refusals, respectively. The refusal rate was significantly correlated (p knowledge of iron deficiency issues (p < 0.05). The odds of refusal in the absence of a classroom water supply were 2.02 (95% CI 1 · 044 to 3 · 900) times greater than for those classrooms with a water supply. Student exposure to the program's goal was satisfactory; however, delivery and fidelity of educational materials and training sessions were inadequate. The findings suggest that the methods of delivery and the fidelity of the program components, education materials and training sessions were insufficient and need to be improved. Additionally, specific attention has to be given to contextual factors to ensure the success of the program.

Fatality Assessment and Control Evaluation (FACE) Program

Data.gov (United States)

U.S. Department of Health & Human Services — Each day, between 12 to 13 U.S. workers die as a result of a traumatic injury on the job. Investigations conducted through the FACE program allow the identification...

Applying national survey results for strategic planning and program improvement: the National Diabetes Education Program.

Science.gov (United States)

Griffey, Susan; Piccinino, Linda; Gallivan, Joanne; Lotenberg, Lynne Doner; Tuncer, Diane

2015-02-01

Since the 1970s, the federal government has spearheaded major national education programs to reduce the burden of chronic diseases in the United States. These prevention and disease management programs communicate critical information to the public, those affected by the disease, and health care providers. The National Diabetes Education Program (NDEP), the leading federal program on diabetes sponsored by the National Institutes of Health (NIH) and the Centers for Disease Control and Prevention (CDC), uses primary and secondary quantitative data and qualitative audience research to guide program planning and evaluation. Since 2006, the NDEP has filled the gaps in existing quantitative data sources by conducting its own population-based survey, the NDEP National Diabetes Survey (NNDS). The NNDS is conducted every 2–3 years and tracks changes in knowledge, attitudes and practice indicators in key target audiences. This article describes how the NDEP has used the NNDS as a key component of its evaluation framework and how it applies the survey results for strategic planning and program improvement. The NDEP's use of the NNDS illustrates how a program evaluation framework that includes periodic population-based surveys can serve as an evaluation model for similar national health education programs.

Evaluation of 8-week body weight control program including sea tangle (Laminaria japonica) supplementation in Korean female college students

OpenAIRE

You, Jeong Soon; Sung, Min Jung; Chang, Kyung Ja

2009-01-01

This study was conducted to evaluate the effects of a body weight control program with supplementation of sea tangle (20 g/day) on 22 female college students. The contents of the program for 8 weeks contained diet therapy, exercise and behavioral modification through nutrition education. Body composition, dietary habit scores, serum lipid profiles, daily nutrient intakes and the quality of life were assessed at the beginning and at the end of the program. Average age of subjects and height we...

Computer-Assisted, Programmed Text, and Lecture Modes of Instruction in Three Medical Training Courses: Comparative Evaluation. Final Report.

Science.gov (United States)

Deignan, Gerard M.; And Others

This report contains a comparative analysis of the differential effectiveness of computer-assisted instruction (CAI), programmed instructional text (PIT), and lecture methods of instruction in three medical courses--Medical Laboratory, Radiology, and Dental. The summative evaluation includes (1) multiple regression analyses conducted to predict…

Evaluation of Respiratory Protection Program in Petrochemical Industries: Application of Analytic Hierarchy Process

Directory of Open Access Journals (Sweden)

Hadi Kolahi

2018-03-01

Full Text Available Background: Respiratory protection equipment (RPE is the last resort to control exposure to workplace air pollutants. A comprehensive respiratory protection program (RPP ensures that RPE is selected, used, and cared properly. Therefore, RPP must be well integrated into the occupational health and safety requirements. In this study, we evaluated the implementation of RPP in Iranian petrochemical industries to identify the required solutions to improve the current status of respiratory protection. Methods: This cross-sectional study was conducted among 24 petrochemical industries in Iran. The survey instrument was a checklist extracted from the Occupational Safety and Health Administration respiratory protection standard. An index, Respiratory Protection Program Index (RPPI, was developed and weighted by analytic hierarchy process to determine the compliance rate (CR of provided respiratory protection measures with the RPP standard. Data analysis was performed using Excel 2010. Results: The most important element of RPP, according to experts, was respiratory hazard evaluation. The average value of RPPI in the petrochemical plants was 49 ± 15%. The highest and lowest of CR among RPP elements were RPE selection and medical evaluation, respectively. Conclusion: None of studied petrochemical industries implemented RPP completely. This can lead to employees' overexposure to hazardous workplace air contaminants. Increasing awareness of employees and employers through training is suggested by this study to improve such conditions. Keywords: analytic hierarchy process, petrochemical industries, respiratory protection program

A mixed-methods evaluation of a multidisciplinary point of care ultrasound program.

Science.gov (United States)

Smith, Andrew; Parsons, Michael; Renouf, Tia; Boyd, Sarah; Rogers, Peter

2018-04-24

Point of Care Ultrasound (PoCUS) is well established within emergency medicine, however, the availability of formal training for other clinical disciplines is limited. Memorial University has established a cost-efficient, multidisciplinary PoCUS training program focusing on training residents' discipline-specific ultrasound skills. This study evaluates the skills, knowledge, and attitudes of residents who participated in the program. Analysis was conducted using a mixed-methods, sequential exploratory approach. Initially, a focus group of seven first year residents was conducted to generate themes that were used to guide development of a survey administered to residents over a two-year period. Thirty residents responded to the survey (response rate 63.8%) with 53.3% meeting the training requirements for focused assessment using sonography in trauma, 43.3% for pleural effusion, 40.0% for aortic aneurysms, and 40.0% for cardiac scans. Early pregnancy assessment was the skill of least interest with 46.6% not interested. Over half the residents (53.6%) agreed or strongly agreed that a multidisciplinary program met their needs while 21.4% disagreed. The focus group found the multidisciplinary approach adequate. A single PoCUS curriculum has been shown to meet the needs and expectations of a majority of residents from multiple disciplines. It can enhance collaboration and bridge gaps between increasingly compartmentalized practices of medicine.

Study on Exploding Wire Compression for Evaluating Electrical Conductivity in Warm-Dense Diamond-Like-Carbon

International Nuclear Information System (INIS)

Sasaki, Toru; Takahashi, Kazumasa; Kudo, Takahiro; Kikuchi, Takashi; Aso, Tsukasa; Harada, Nob.; Fujioka, Shinsuke; Horioka, Kazuhiko

2016-01-01

To improve a coupling efficiency for the fast ignition scheme of the inertial confinement fusion, fast electron behaviors as a function of an electrical conductivity are required. To evaluate the electrical conductivity for low-Z materials as a diamond-like-carbon (DLC), we have proposed a concept to investigate the properties of warm dense matter (WDM) by using pulsed-power discharges. The concept of the evaluation of DLC for WDM is a shock compression driven by an exploding wire discharge with confined by a rigid capillary. The qualitatively evaluation of the electrical conductivity for the WDM DLC requires a small electrical conductivity of the exploding wire. To analyze the electrical conductivity of exploding wire, we have demonstrated an exploding wire discharge in water for gold. The results indicated that the electrical conductivity of WDM gold for 5000 K of temperature has an insulator regime. It means that the shock compression driven by the exploding wire discharge with confined by the rigid capillary is applied for the evaluation of electrical conductivity for WDM DLC. (paper)

Evaluating Educational Programs. ETS R&D Scientific and Policy Contributions Series. ETS SPC-11-01. ETS Research Report No. RR-11-15

Science.gov (United States)

Ball, Samuel

2011-01-01

Since its founding in 1947, ETS has conducted a significant and wide-ranging research program that has focused on, among other things, psychometric and statistical methodology; educational evaluation; performance assessment and scoring; large-scale assessment and evaluation; cognitive, developmental, personality, and social psychology; and…

Using Mixed Methods and Collaboration to Evaluate an Education and Public Outreach Program (Invited)

Science.gov (United States)

Shebby, S.; Shipp, S. S.

2013-12-01

Traditional indicators (such as the number of participants or Likert-type ratings of participant perceptions) are often used to provide stakeholders with basic information about program outputs and to justify funding decisions. However, use of qualitative methods can strengthen the reliability of these data and provide stakeholders with more meaningful information about program challenges, successes, and ultimate impacts (Stern, Stame, Mayne, Forss, David & Befani, 2012). In this session, presenters will discuss how they used a mixed methods evaluation to determine the impact of an education and public outreach (EPO) program. EPO efforts were intended to foster more effective, sustainable, and efficient utilization of science discoveries and learning experiences through three main goals 1) increase engagement and support by leveraging of resources, expertise, and best practices; 2) organize a portfolio of resources for accessibility, connectivity, and strategic growth; and 3) develop an infrastructure to support coordination. The evaluation team used a mixed methods design to conduct the evaluation. Presenters will first discuss five potential benefits of mixed methods designs: triangulation of findings, development, complementarity, initiation, and value diversity (Greene, Caracelli & Graham, 2005). They will next demonstrate how a 'mix' of methods, including artifact collection, surveys, interviews, focus groups, and vignettes, was included in the EPO project's evaluation design, providing specific examples of how alignment between the program theory and the evaluation plan was best achieved with a mixed methods approach. The presentation will also include an overview of different mixed methods approaches and information about important considerations when using a mixed methods design, such as selection of data collection methods and sources, and the timing and weighting of quantitative and qualitative methods (Creswell, 2003). Ultimately, this presentation will

Full-scale Mark II CRT program: dynamic response evaluation test of pressure transducers

International Nuclear Information System (INIS)

Kukita, Yutaka; Namatame, Ken; Takeshita, Isao; Shiba, Masayoshi

1982-12-01

A dynamic response evaluation test of pressure transducers was conducted in support of the JAERI Full-Scale Mark II CRT (Containment Response Test) Program. The test results indicated that certain of the cavity-type transducers used in the early blowdown test had undesirable response characteristics. The transducer mounting scheme was modified to avoid trapping of air bubbles in the pressure transmission tubing attached to the transducers. The dynamic response of the modified transducers was acceptable within the frequency range of 200 Hz. (author)

Development and Implementation of a Mental Health Work Rehabilitation Program: Results of a Developmental Evaluation.

Science.gov (United States)

Sylvain, Chantal; Durand, Marie-José; Velasquez Sanchez, Astrid; Lessard, Nathalie; Maillette, Pascale

2018-05-23

Purpose Long-term work disability due to common mental disorders (CMDs) is a growing problem. Yet optimal interventions remain unclear and little is known about implementation challenges in everyday practice. This study aimed to support and evaluate, in real time, the development and implementation of a work rehabilitation program (WRP) designed to promote post-CMD return-to-work (RTW). Methods A 2-year developmental evaluation was performed using a participatory approach. At program outset, the researchers held five work meetings to revise the program's logic model and discuss its underlying change theory with clinicians. Data collection tools used throughout the study period were structured charts of activities conducted with workers (n = 41); in-depth interviews with program clinicians and managers (n = 9); and participant observation during work meetings. Quantitative data were analyzed using descriptive statistics. Qualitative data underwent thematic analysis using a processual approach. Results Three types of activity were developed and implemented: individual and group interventions targeting workers, and joint activities targeting partners (physicians, employers, others). While worker-targeted activities were generally implemented as planned, joint activities were sporadic. Analysis of the implementation process revealed five challenges faced by clinicians. Determinants included clinicians, host organization, sociopolitical context and resources provided by the evaluation. Conclusion The program studied is original in that it is based on the best available scientific knowledge, yet adapted to contextual particularities. The identified implementation challenges highlight the need for greater importance to be placed on the external, non-program context to ensure sustainable implementation in everyday practice.

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

A Formative Evaluation of Healthy Heroes: A Photo Comic Book-Social Cognitive Theory Based Obesity Prevention Program

Science.gov (United States)

Branscum, Paul; Housley, Alexandra; Bhochhibhoya, Amir; Hayes, Logan

2016-01-01

Purpose: Low consumption of fruits and vegetables is often associated with poor diet quality, and childhood obesity. The purpose of this study was to assess the feasibility, and conduct a formative evaluation, of Healthy Heroes, an innovative, social cognitive theory-based program that uses child created photo-comic books to promote fruit and…

Evaluating conducting network based transparent electrodes from geometrical considerations

Energy Technology Data Exchange (ETDEWEB)

Kumar, Ankush [Chemistry and Physics of Materials Unit, Jawaharlal Nehru Centre for Advanced Scientific Research, 560064 Bangalore (India); Kulkarni, G. U., E-mail: guk@cens.res.in [Centre for Nano and Soft Matter Sciences, 560013 Bangalore (India)

2016-01-07

Conducting nanowire networks have been developed as viable alternative to existing indium tin oxide based transparent electrode (TE). The nature of electrical conduction and process optimization for electrodes have gained much from the theoretical models based on percolation transport using Monte Carlo approach and applying Kirchhoff's law on individual junctions and loops. While most of the literature work pertaining to theoretical analysis is focussed on networks obtained from conducting rods (mostly considering only junction resistance), hardly any attention has been paid to those made using template based methods, wherein the structure of network is neither similar to network obtained from conducting rods nor similar to well periodic geometry. Here, we have attempted an analytical treatment based on geometrical arguments and applied image analysis on practical networks to gain deeper insight into conducting networked structure particularly in relation to sheet resistance and transmittance. Many literature examples reporting networks with straight or curvilinear wires with distributions in wire width and length have been analysed by treating the networks as two dimensional graphs and evaluating the sheet resistance based on wire density and wire width. The sheet resistance values from our analysis compare well with the experimental values. Our analysis on various examples has revealed that low sheet resistance is achieved with high wire density and compactness with straight rather than curvilinear wires and with narrower wire width distribution. Similarly, higher transmittance for given sheet resistance is possible with narrower wire width but of higher thickness, minimal curvilinearity, and maximum connectivity. For the purpose of evaluating active fraction of the network, the algorithm was made to distinguish and quantify current carrying backbone regions as against regions containing only dangling or isolated wires. The treatment can be helpful in

Evaluating conducting network based transparent electrodes from geometrical considerations

International Nuclear Information System (INIS)

Kumar, Ankush; Kulkarni, G. U.

2016-01-01

Conducting nanowire networks have been developed as viable alternative to existing indium tin oxide based transparent electrode (TE). The nature of electrical conduction and process optimization for electrodes have gained much from the theoretical models based on percolation transport using Monte Carlo approach and applying Kirchhoff's law on individual junctions and loops. While most of the literature work pertaining to theoretical analysis is focussed on networks obtained from conducting rods (mostly considering only junction resistance), hardly any attention has been paid to those made using template based methods, wherein the structure of network is neither similar to network obtained from conducting rods nor similar to well periodic geometry. Here, we have attempted an analytical treatment based on geometrical arguments and applied image analysis on practical networks to gain deeper insight into conducting networked structure particularly in relation to sheet resistance and transmittance. Many literature examples reporting networks with straight or curvilinear wires with distributions in wire width and length have been analysed by treating the networks as two dimensional graphs and evaluating the sheet resistance based on wire density and wire width. The sheet resistance values from our analysis compare well with the experimental values. Our analysis on various examples has revealed that low sheet resistance is achieved with high wire density and compactness with straight rather than curvilinear wires and with narrower wire width distribution. Similarly, higher transmittance for given sheet resistance is possible with narrower wire width but of higher thickness, minimal curvilinearity, and maximum connectivity. For the purpose of evaluating active fraction of the network, the algorithm was made to distinguish and quantify current carrying backbone regions as against regions containing only dangling or isolated wires. The treatment can be helpful in

Test and evaluation about damping characteristics of hanger supports for nuclear power plant piping systems (Seismic Damping Ratio Evaluation Program)

International Nuclear Information System (INIS)

Shibata, H.; Ito, A.; Tanaka, K.; Niino, T.; Gotoh, N.

1981-01-01

Generally, damping phenomena of structures and equipments is caused by very complex energy dissipation. Especially, as piping systems are composed of many components, it is very difficult to evaluate damping characteristics of its system theoretically. On the other hand, the damping value for aseismic design of nuclear power plants is very important design factor to decide seismic response loads of structures, equipments and piping systems. The very extensive studies titled SDREP (Seismic Damping Ratio Evaluation Program) were performed to establish proper damping values for seismic design of piping as a joint work among a university, electric companies and plant makers. In SDREP, various systematic vibration tests were conducted to investigate factors which may contribute to damping characteristics of piping systems and to supplement the data of the pre-operating tests. This study is related to the component damping characteristics tests of that program. The object of this study is to clarify damping characteristics and mechanism of hanger supports used in piping systems, and to establish the evaluation technique of dispersing energy at hanger support points and its effect to the total damping ability of piping system. (orig./WL)

Evaluation of a Community-Based Program That Integrates Joyful Movement Into Fall Prevention for Older Adults

Science.gov (United States)

Carlucci, Celeste; Kardachi, Julie; Bradley, Sara M.; Prager, Jason; Wyka, Katarzyna

2018-01-01

Background: Despite the development of evidence-based fall-prevention programs, there remains a need for programming that will engage older adults in real-world settings. Objective: This study aimed to evaluate a community-based group program that integrates joyful movement into fall prevention. The curriculum emphasizes a positive experience of movement, cultivating a healthy body image, and retraining of biomechanics. Design: Program evaluation was conducted using a one-group pre–post test study design. Key outcomes were functional balance and confidence. Qualitative feedback was gathered at the final class sessions. Results: Two hundred fifteen older adults enrolled at four sites over the period from 2010 to 2014. Among 86 participants who provided feedback, most credited the program for an increased sense of optimism and/or confidence (70%), and better walking ability (50%). Among 102 participants who completed both initial and final assessments, there was evidence of significant improvements on the Functional Reach Test (d = .60, p Falls Efficacy Scale (d = .17, p balance and confidence. Future research should examine whether the positive changes encouraged by joyful movement lead to lasting reductions in fall risk and additional health benefits. PMID:29796405

Conducting a SWOT Analysis for Program Improvement

Science.gov (United States)

Orr, Betsy

2013-01-01

A SWOT (strengths, weaknesses, opportunities, and threats) analysis of a teacher education program, or any program, can be the driving force for implementing change. A SWOT analysis is used to assist faculty in initiating meaningful change in a program and to use the data for program improvement. This tool is useful in any undergraduate or degree…

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Satellite power system concept development and evaluation program system definition technical assessment report

Energy Technology Data Exchange (ETDEWEB)

1980-12-01

The results of the system definition studies conducted by NASA as a part of the Department of Energy/National Aeronautics and Space Administration SPS Concept Development and Evaluation Program are summarized. The purpose of the system definition efforts was to identify and define candidate SPS concepts and to evaluate the concepts in terms of technical and cost factors. Although the system definition efforts consisted primarily of evaluation and assessment of alternative technical approaches, a reference system was also defined to facilitate economic, environmental, and societal assessments by the Department of Energy. This reference system was designed to deliver 5 GW of electrical power to the utility grid. Topics covered include system definition; energy conversion and power management; power transmission and reception; structures, controls, and materials; construction and operations; and space transportation.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Thermal conductivity evaluation of high burnup mixed-oxide (MOX) fuel pellet

International Nuclear Information System (INIS)

Amaya, Masaki; Nakamura, Jinichi; Nagase, Fumihisa; Fuketa, Toyoshi

2011-01-01

The thermal conductivity formula of fuel pellet which contains the effects of burnup and plutonium (Pu) addition was proposed based on the Klemens' theory and reported thermal conductivities of unirradiated (U, Pu) O 2 and irradiated UO 2 pellets. The thermal conductivity of high burnup MOX pellet was formulated by applying a summation rule between phonon scattering parameters which show the effects of plutonium addition and burnup. Temperature of high burnup MOX fuel was evaluated based on the thermal conductivity integral which was calculated from the above-mentioned thermal conductivity formula. Calculated fuel temperatures were plotted against the linear heat rates of the fuel rods, and were compared with the fuel temperatures measured in a test reactor. Since both values agreed well, it was confirmed that the proposed thermal conductivity formula of MOX pellets is adequate.

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

Evaluation of the effectiveness of the sealed double-ringed infiltrometers and the effects of changes in atmospheric pressure on hydraulic conductivity

International Nuclear Information System (INIS)

McMullin, S.R.

1994-01-01

The Savannah River Site (SRS) is currently evaluating some 40 hazardous and radioactive-waste sites for remediation. A remedial alternative under consideration is the closing of a waste site with a RCRA-style closure cap. The closure cap is a moisture barrier designed to inhibit the free flow of water downward into the buried wastes. When a remedial design is prepared, it is often necessary to test the cap materials to verify compliance with this recommended limit. Among the EPA-recommended test instruments is the sealed double-ring infiltrometer (SDRI). During recent testing at the Savannah River Site (SRS), six SDRI were installed and tested on a single kaolin clay cap. The purpose of this testing was to obtain a measure of the distribution of hydraulic conductivity across a model kaolin clay cap. The test results provide an evaluation of instrument performance and a measure of the repeatability of results. In addition, the testing identified variations in the unsaturated hydraulic conductivity. This paper presents an overview of the SDRI, the testing program at SRS, and an evaluation of the observations and test results

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Using Interprofessional Learning for Continuing Education: Development and Evaluation of the Graduate Certificate Program in Health Professional Education for Clinicians.

Science.gov (United States)

Henderson, Saras; Dalton, Megan; Cartmel, Jennifer

2016-01-01

Health professionals may be expert clinicians but do not automatically make effective teachers and need educational development. In response, a team of health academics at an Australian university developed and evaluated the continuing education Graduate Certificate in Health Professional Education Program using an interprofessional learning model. The model was informed by Collins interactional expertise and Knowles adult learning theories. The team collaboratively developed and taught four courses in the program. Blended learning methods such as web-based learning, face-to-face workshops, and online discussion forums were used. Twenty-seven multidisciplinary participants enrolled in the inaugural program. Focus group interview, self-report questionnaires, and teacher observations were used to evaluate the program. Online learning motivated participants to learn in a collaborative virtual environment. The workshops conducted in an interprofessional environment promoted knowledge sharing and helped participants to better understand other discipline roles, so they could conduct clinical education within a broader health care team context. Work-integrated assessments supported learning relevance. The teachers, however, observed that some participants struggled because of lack of computer skills. Although the interprofessional learning model promoted collaboration and flexibility, it is important to note that consideration be given to participants who are not computer literate. We therefore conducted a library and computer literacy workshop in orientation week which helped. An interprofessional learning environment can assist health professionals to operate outside their "traditional silos" leading to a more collaborative approach to the provision of care. Our experience may assist other organizations in developing similar programs.

Evaluation of long-term patient satisfaction and experience with the Baha(®) bone conduction implant

DEFF Research Database (Denmark)

Rasmussen, Jacob; Olsen, Steen Østergaard; Nielsen, Lars Holme

2012-01-01

Objective: Evaluate long-term patient satisfaction with bone-anchored hearing aids (the Baha(R), now referred to by Cochlear as a 'bone conduction implant') in our hospital clinic spanning the eighteen-year period from the inception of our Baha program. The researchers further wished to analyse...... the various factors leading to patient satisfaction/dissatisfaction with their Baha. We developed a new questionnaire to obtain a comprehensive impression of individual patient practices, general satisfaction, and experiences with their Baha in respect to time spent using Baha, sound quality, annoyance from...... noise disturbance, ease of communication, cosmetic appearance, and satisfaction with the Baha amongst patient relatives, an aspect not previously investigated. Design: The study design was retrospective and executed as a postal questionnaire. The questionnaire was developed by the authors of this paper...

The Examination of Views of Parents about the Web-Based Performance Evaluation Program in the Science Teaching Process

OpenAIRE

Bakırcı, Hasan; KARA, YILMAZ; ÇEPNİ, Salih

2018-01-01

The research was aimed to reveal the views of parents on web-based performance evaluation program. The case study method adopted for this study. The research was conducted in the central district of Trabzon province during the fall semester of 2012-2013 academic years. A questionnaire was administered to three hundred parents and face-to-face interviews were conducted with 10 of those parents. The obtained data was analyzed through descriptive and content analysis. Majority of the parents wer...

Manipulator system man-machine interface evaluation program. [technology assessment

Science.gov (United States)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Evaluation of otolaryngology residency program websites.

Science.gov (United States)

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42

Strengthening Incarcerated Families: Evaluating a Pilot Program for Children of Incarcerated Parents and Their Caregivers

OpenAIRE

Miller, Alison L.; Perryman, Jamie; Markovitz, Lara; Franzen, Susan; Cochran, Shirley; Brown, Shavonnea

2013-01-01

Parental incarceration can be devastating for families. Children may experience difficulties, and the stress on caregivers who take on unexpected childrearing is high. We implemented and evaluated a family-level intervention with caregivers and children experiencing parental (typically maternal) incarceration, in a community setting. We partnered with a community-based organization serving families with an incarcerated parent to conduct a pilot trial of the Strengthening Families Program (SFP...

A School-Based Dental Program Evaluation: Comparison to the Massachusetts Statewide Survey.

Science.gov (United States)

Culler, Corinna S; Kotelchuck, Milton; Declercq, Eugene; Kuhlthau, Karen; Jones, Kari; Yoder, Karen M

2017-10-01

School-based dental programs target high-risk communities and reduce barriers to obtaining dental services by delivering care to students in their schools. We describe the evaluation of a school-based dental program operating in Chelsea, a city north of Boston, with a low-income and largely minority population, by comparing participants' oral health to a Massachusetts oral health assessment. Standardized dental screenings were conducted for students in kindergarten, third, and sixth grades. Outcomes were compared in bivariate analysis, stratified by grade and income levels. A greater percentage of Chelsea students had untreated decay and severe treatment need than students statewide. Yet, fewer Chelsea third graders had severe treatment need, and more had dental sealants. There was no significant difference in the percentage of Chelsea students having severe treatment need or dental sealants by income level. Students participating in our program do not have lower decay levels than students statewide. However, they do have lower levels of severe treatment need, likely due to treatment referrals. Our results confirm that school-based prevention programs can lead to increased prevalence of dental sealants among high-risk populations. Results provide support for the establishment of full-service school-based programs in similar communities. © 2017, American School Health Association.

Clemson University Science Master's Program in Sustainable and Resilient Infrastructure: A program evaluation

Science.gov (United States)

O'Sell, Elizabeth Eberhart

The Clemson University Science Master's Program (SMP) in Sustainable and Resilient Infrastructure is a program which aims to link engineering, materials, construction, environment, architecture, business, and public policy to produce graduates with unique holistic perspective and expertise to immediately contribute to the workforce in the area of sustainable and resilient infrastructure. A program evaluation of the SMP has been performed to study the effectiveness of the SMP and identify areas where the goals and vision of the SMP are achieved and areas where improvements can be made. This was completed by analysis of trends within survey responses, review of Master's thesis reports, and review of courses taken. It was found that the SMP has facilitated new interdisciplinary research collaborations of faculty in different concentration areas within the Glenn Department of Civil Engineering, as well as collaboration with faculty in other departments. It is recommended that a course which provides instruction in all eight competency areas be required for all SMP students to provide a comprehensive overview and ensure all students are exposed to concepts of all competency areas. While all stakeholders are satisfied with the program and believe it has been successful thus far, efforts do need to be made as the program moves forward to address and improve some items that have been mentioned as needing improvement. The concerns about concentration courses, internship planning, and advising should be addressed. This evaluation provides benefits to prospective students, current SMP participants, and outside program supporters. The goal of this evaluation is to provide support that the SMP is an effective and worthwhile program for participating students, while attempting to identify any necessary program improvements and provide recommendations for achieving these improvements. This goal has been accomplished.

Relevance Evaluation of Engineering Master's Program in Peru

OpenAIRE

Miñán, Erick; Lavalle, Carlos; Díaz-Puente, José M.

2012-01-01

In a context of mass higher education, it is necessary to ensure not only quality but also the relevance of engineering master's programs, namely the appropriateness of the objectives and outcomes to the needs and interests of the program beneficiaries. After a literature review we analyzed the evaluation models of three organizations in Peru: the Board of Evaluation, Accreditation and Certification of the University Education Quality CONEAU, the Institute of Quality and Accreditation of Comp...

Challenges to Evaluating Physical Activity Programs in American Indian/Alaska Native Communities

Science.gov (United States)

Roberts, Erica Blue; Butler, James; Green, Kerry M.

2018-01-01

Despite the importance of evaluation to successful programming, a lack of physical activity program (PAP) evaluation for American Indian/Alaska Native (AI/AN) programs exists, which is significant given the high rates of obesity and diabetes in this population. While evaluation barriers have been identified broadly among AI/AN programs, challenges…

Standard guide for conducting and evaluating galvanic corrosion tests in electrolytes

CERN Document Server

American Society for Testing and Materials. Philadelphia

1981-01-01

1.1 This guide covers conducting and evaluating galvanic corrosion tests to characterize the behavior of two dissimilar metals in electrical contact in an electrolyte under low-flow conditions. It can be adapted to wrought or cast metals and alloys. 1.2 This guide covers the selection of materials, specimen preparation, test environment, method of exposure, and method for evaluating the results to characterize the behavior of galvanic couples in an electrolyte. Note 1—Additional information on galvanic corrosion testing and examples of the conduct and evaluation of galvanic corrosion tests in electrolytes are given in Refs (1) through (7). 1.3 The values stated in SI units are to be regarded as standard. No other units of measurement are included in this standard. 1.4 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and determine the applicabil...

Sustained Effects of Incredible Years as a Preventive Intervention in Preschool Children with Conduct Problems

Science.gov (United States)

Posthumus, Jocelyne A.; Raaijmakers, Maartje A. J.; Maassen, Gerard H.; van Engeland, Herman; Matthys, Walter

2012-01-01

The present study evaluated preventive effects of the Incredible Years program for parents of preschool children who were at risk for a chronic pattern of conduct problems, in the Netherlands. In a matched control design, 72 parents of children with conduct problems received the Incredible Years program. These families (intervention group) were…

Case study of the United States Marine Corps Advanced Amphibious Assault Vehicle (AAAV) program test and evaluation strategy

OpenAIRE

Buckles, Brian K.

1999-01-01

This thesis examined the evolution of the Direct Reporting Program Manager- Advanced Amphibious Assault's test and evaluation strategy from Milestone 0 to the present. The research effort involved reviewing the evolution of amphibious doctrine and amphibious vehicles, reviewing the DoD Acquisition Process and the role of T&E in that Acquisition Process, and analyzing three DRPM-AAA Test and Evaluation Master Plans. Interviews were conducted with personnel from the DRPM-AAA office and General ...

Transitioning a Large Scale HIV/AIDS Prevention Program to Local Stakeholders: Findings from the Avahan Transition Evaluation.

Directory of Open Access Journals (Sweden)

Sara Bennett

Full Text Available Between 2009-2013 the Bill and Melinda Gates Foundation transitioned its HIV/AIDS prevention initiative in India from being a stand-alone program outside of government, to being fully government funded and implemented. We present an independent prospective evaluation of the transition.The evaluation drew upon (1 a structured survey of transition readiness in a sample of 80 targeted HIV prevention programs prior to transition; (2 a structured survey assessing institutionalization of program features in a sample of 70 targeted intervention (TI programs, one year post-transition; and (3 case studies of 15 TI programs.Transition was conducted in 3 rounds. While the 2009 transition round was problematic, subsequent rounds were implemented more smoothly. In the 2011 and 2012 transition rounds, Avahan programs were well prepared for transition with the large majority of TI program staff trained for transition, high alignment with government clinical, financial and managerial norms, and strong government commitment to the program. One year post transition there were significant program changes, but these were largely perceived positively. Notable negative changes were: limited flexibility in program management, delays in funding, commodity stock outs, and community member perceptions of a narrowing in program focus. Service coverage outcomes were sustained at least six months post-transition.The study suggests that significant investments in transition preparation contributed to a smooth transition and sustained service coverage. Notwithstanding, there were substantive program changes post-transition. Five key lessons for transition design and implementation are identified.

Evaluating the impacts of the clean cities program.

Science.gov (United States)

Qiu, Shiyong; Kaza, Nikhil

2017-02-01

The Department of Energy's Clean Cities program was created in 1993 to reduce petroleum usage in the transportation sector. The program promotes alternative fuels such as biofuels and fuel-saving strategies such as idle reduction and fleet management through coalitions of local government, non-profit, and private actors. Few studies have evaluated the impact of the program because of its complexity that include interrelated strategies of grants, education and training and diversity of participants. This paper uses a Difference-in-Differences (DiD) approach to evaluate the effectiveness of the program between 1990 and 2010. We quantify the effectiveness of the Clean Cities program by focusing on performance measures such as air quality, number of alternative fueling stations, private vehicle occupancy and transit ridership. We find that counties that participate in the program perform better on all these measures compared to counties that did not participate. Compared to the control group, counties in the Clean Cities program experienced a reduction in days with bad air quality (3.7%), a decrease in automobile commuters (2.9%), an overall increase in transit commuters (2.1%) and had greater numbers of new alternative fueling stations (12.9). The results suggest that the program is a qualified success. Copyright © 2016 Elsevier B.V. All rights reserved.

EPA [Environmental Protection Agency] SITE [Superfund Innovative Technology Evaluation] program seeks technology proposals

International Nuclear Information System (INIS)

Anon.

1989-01-01

EPA will issue an RFP to initiate the SITE-005 solicitation for demonstration of technologies under the Superfund Innovative Technology Evaluation (SITE) Program. This portion of the SITE program offers a mechanism for conducting a joint technology demonstration between EPA and the private sector. The goal of the demonstration program is to provide an opportunity for developers to demonstrate the performance of their technologies on actual hazardous wastes at Superfund sites, and to provide accurate and reliable data on that performance. Technologies selected must be of commercial scale and provide solutions to problems encountered at Superfund Sites. Primary emphasis in the RFP is on technologies that address: treatment of mixed, low level radioactive wastes in soils and groundwater; treatment of soils and sludges contaminated with organics and/or inorganics, materials handling as a preliminary step to treatment or further processing, treatment trains designed to handle specific wastes, are in situ technologies, especially those processes providing alternatives to conventional groundwater pump and treat techniques

Development of program for evaluating the temperature of Zr-U metallic fuel rod

International Nuclear Information System (INIS)

Chun, J. S.; Lee, B. H.; Ku, Y. H.; Oh, J. Y.; Im, J. S.; Sohn, D. S.

2003-01-01

A code for evaluating the temperature of Zr-U metallic rod has been developed. Finite element (FE) method is adopted for the developed code sharing the user subroutines which has been prepared for the ABAQUS commercial FE code. The developed program for the Zr-U metallic fuel rod corresponds to a nonlinear transient heat transfer problem, and uses a sparse matrix solver for FE equations during iterations at every time step. The verifications of the developed program were conducted using the ABAQUS code. Steady state and transient problems were analyzed for 1/8 rod model due to the symmetry of the fuel rod and full model. From the evaluation of temperature for the 1/8 rod model at steady state, maximal error of 0.18 % was present relative to the ABAQUS result. Analysis for the transient problem using the fuel rod model resulted in the same as the variation of centerline temperature from the ABAQUS code during a hypothetical power transient. The distribution of heat flux for the entire cross section and surface was almost identical for the two codes

School Libraries and Language Skills in Indian Primary Schools: A Randomized Evaluation of the Akshara Library Program. NBER Working Paper No. 18183

Science.gov (United States)

Borkum, Evan; He, Fang; Linden, Leigh L.

2012-01-01

We conduct a randomized evaluation of a school library program on children's language skills. We find that the program had little impact on students' scores on a language test administered 16 months after implementation. The estimates are sufficiently precise to rule out effects larger than 0.13 and 0.11 standard deviations based on the 95 and 90…

Team teaching fire prevention program: evaluation of an education technique

Science.gov (United States)

Frank L. Ryan; Frank H. Gladen; William S. Folkman

1978-01-01

The California Department of Forestry's Team Teaching Fire Prevention Program consists of small-group discussions, slides or films, and a visit by Smokey Bear to school classrooms. In a survey, teachers and principals who had experienced the program responded favorably to it. The conduct by team members also received approval. The limited criticisms of the Program...

The program success story: a valuable tool for program evaluation.

Science.gov (United States)

Lavinghouze, Rene; Price, Ann Webb; Smith, Kisha-Ann

2007-10-01

Success stories are evaluation tools that have been used by professionals across disciplines for quite some time. They are also proving to be useful in promoting health programs and their accomplishments. The increasing popularity of success stories is due to the innovative and effective way that they increase a program's visibility, while engaging potential participants, partners, and funders in public health efforts. From the community level to the federal level, program administrators are using success stories as vehicles for celebrating achievements, sharing challenges, and communicating lessons learned. Success stories are an effective means to move beyond the numbers and connect to readers-with a cause they can relate to and want to join. This article defines success stories and provides an overview of several types of story formats, how success stories can be systematically collected, and how they are used to communicate program success.

An evaluation of a positive youth development program for adolescents with chronic illness.

Science.gov (United States)

Maslow, Gary; Adams, Cathleen; Willis, Matthew; Neukirch, Jodie; Herts, Kate; Froehlich, Wendy; Calleson, Diane; Rickerby, Michelle

2013-02-01

Youth with chronic illness often struggle transitioning to adulthood and adult medical care. This article examines the outcomes of a group mentoring program called The Adolescent Leadership Council (TALC) that brings together high school participants and college mentors, all with chronic illness. TALC uses a positive youth development (PYD) approach, emphasizing strong relationships between youth and adults in an environment where youth can learn important life skills and take a leadership role. A pre-/postprogram participant survey was conducted for high school participants using a loneliness scale and a transition readiness survey. An alumni survey was conducted with all high school and college mentor graduates to assess educational-, vocational-, and health care-related outcomes. Program records review and the alumni survey indicated that TALC was consistent with the PYD program model. Twenty high school students participated in the pre-/postprogram outcomes evaluation, which demonstrated a decrease in loneliness from 46 to 38.5 (p < .001) and an increase in health care self-advocacy from 3.8 to 4.2 (p < .001). Thirty-four alumni participated in the alumni survey. All high school and college mentor alumni had graduated from high school and college, respectively, and all were either currently in school or working. The majority of alumni were seeing adult providers for medical care. The TALC program applies the principles of PYD to support positive educational, vocational, and health care outcomes for youth with chronic illness. Program development using the PYD perspective is an important new approach for supporting adult development of youth with chronic illness. Copyright © 2013 Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

Quasi-Experimental Evaluation of a Student Mentoring Program

OpenAIRE

Sandner, Malte

2013-01-01

This paper presents evidence from a natural-experiment which evaluates the effectiveness of a student mentoring program. The mentoring includes several compulsory, scheduled, faceto- face appointments between a mentor and a student in the first study year. All mentors are graduated and employed by the institution. For the evaluation, I use the fact that the mentoring is only offered to students in an economics and management program, whereas it is not offered to students in an industrial engi...

Content and retention evaluation of an audiovisual patient-education program on bronchodilators.

Science.gov (United States)

Darr, M S; Self, T H; Ryan, M R; Vanderbush, R E; Boswell, R L

1981-05-01

A study was conducted to: (1) evaluate the effect of a slide-tape program on patients' short-term and long-term knowledge about their bronchodilator medications; and (2) determine it any differences exist in learning or retention patterns for different content areas of drug information. The knowledge of 30 patients was measured using a randomized sequence of three comparable 15-question tests. The first test was given before the slide-tape program was presented, the second test within 24 hours, and the last test one to six months (mean = 2.8 months) later. Scores attained on the first posttest were significantly higher (p less than 0.001) than pretest scores. Learning differences among drug-information-content areas were not evidenced on the first posttest. No significant difference was demonstrated between scores on pretest and last posttest (p = 0.100). However, retention patterns among content areas were found to differ significantly (p less than 0.05). Carefully designed audiovisual programs can impart drug information to patients. Medication counseling should be repeated at appropriate opportunities because patients lose drug knowledge over time.

Independent auto evaluation of an operative radiological protection program

International Nuclear Information System (INIS)

Medrano L, M.A.; Rodriguez C, C.C.; Linares R, D.; Zarate M, N.; Zempoalteca B, R.

2006-01-01

The program of operative radiological protection of a nuclear power plant consists of multiple procedures and associate tasks that have as purpose the radiological protection of the workers of the power station. It is for this reason that the constant evaluation of the one it programs it is an important tool in the identification of their weaknesses (and strengths), so they can be assisted appropriately. In this work the main elements of the program of independent auto evaluation of the program of operative radiological protection of the Laguna Verde Central that has been developed and implemented by the National Institute of Nuclear Research are described. (Author)

76 FR 30064 - Enforcement of Nondiscrimination on the Basis of Handicap in Programs or Activities Conducted by...

Science.gov (United States)

2011-05-24

..., which effectuates section 504, to also incorporate the requirements set forth in section 508. Exercising... benefits of, programs or activities conducted by the agency. For example, auxiliary aids useful for persons... eligibility requirements for participation in, or receipt of benefits from, that program or activity; and (3...

The Lassen Astrobiology Intern Program - Concept, Implementation and Evaluation

Science.gov (United States)

Des Marais, D. J.; Dueck, S. L.; Davis, H. B.; Parenteau, M. N.; Kubo, M. D.

2014-12-01

The program goal was to provide a hands-on astrobiology learning experience to high school students by introducing astrobiology and providing opportunities to conduct field and lab research with NASA scientists. The program sought to increase interest in interdisciplinary science, technology, engineering, math and related careers. Lassen Volcanic National Park (LVNP), Red Bluff High School and the Ames Team of the NASA Astrobiology Institute led the program. LVNP was selected because it shares aspects of volcanism with Mars and it hosts thermal springs with microbial mat communities. Students documented volcanic deposits, springs and microbial mats. They analyzed waters and sampled rocks, water and microorganisms. They cultured microorganisms and studied chemical reactions between rocks and simulated spring waters. Each student prepared a report to present data and discuss relationships between volcanic rocks and gases, spring waters and microbial mats. At a "graduation" event the students presented their findings to the Red Bluff community. They visited Ames Research Center to tour the facilities and learn about science and technology careers. To evaluate program impact, surveys were given to students after lectures, labs, fieldwork and discussions with Ames scientists. Students' work was scored using rubrics (labs, progress reports, final report, presentation). Students took pre/post tests on core astrobiology concepts. Parents, teachers, rangers, Ames staff and students completed end-of-year surveys on program impact. Several outcomes were documented. Students had a unique and highly valued learning experience with NASA scientists. They understood what scientists do through authentic scientific work, and what scientists are like as individuals. Students became knowledgeable about astrobiology and how it can be pursued in the lab and in the field. The students' interest increased markedly in astrobiology, interdisciplinary studies and science generally.

Pilot evaluation of the text4baby mobile health program

Directory of Open Access Journals (Sweden)

Evans William Douglas

2012-11-01

Full Text Available Abstract Background Mobile phone technologies for health promotion and disease prevention have evolved rapidly, but few studies have tested the efficacy of mobile health in full-fledged programs. Text4baby is an example of mobile health based on behavioral theory, and it delivers text messages to traditionally underserved pregnant women and new mothers to change their health, health care beliefs, practices, and behaviors in order to improve clinical outcomes. The purpose of this pilot evaluation study is to assess the efficacy of this text messaging campaign. Methods We conducted a randomized pilot evaluation study. All participants were pregnant women first presenting for care at the Fairfax County, Virginia Health Department. We randomized participants to enroll in text4baby and receive usual health care (intervention, or continue simply to receive usual care (control. We then conducted a 24-item survey by telephone of attitudes and behaviors related to text4baby. We surveyed participants at baseline, before text4baby was delivered to the intervention group, and at follow-up at approximately 28 weeks of baby’s gestational age. Results We completed 123 baseline interviews in English and in Spanish. Overall, the sample was predominantly of Hispanic origin (79.7% with an average age of 27.6 years. We completed 90 follow-up interviews, and achieved a 73% retention rate. We used a logistic generalized estimating equation model to evaluate intervention effects on measured outcomes. We found a significant effect of text4baby intervention exposure on increased agreement with the attitude statement “I am prepared to be a new mother” (OR = 2.73, CI = 1.04, 7.18, p = 0.042 between baseline and follow-up. For those who had attained a high school education or greater, we observed a significantly higher overall agreement to attitudes against alcohol consumption during pregnancy (OR = 2.80, CI = 1.13, 6.90, p = 0.026. We also observed a

An initial evaluation of a mindful parenting program.

Science.gov (United States)

Maloney, Raelynn; Altmaier, Elizabeth

2007-12-01

A growing number of children are experiencing marital transition. The effects of divorce on children have typically been considered deleterious, although factors can buffer the difficulty of postdivorce adjustment. One of these factors is a positive relationship with a parental figure. Unfortunately, divorce often overwhelms parents with a series of changes that compromise their parenting skills. One new approach to improving parenting after divorce is mindful parenting, which aims to enhance interpersonal and emotional connection in the parent-child relationship. This program is intended to facilitate parents' self-awareness, their mindfulness, and their intentionality in responding to their child's needs. The present study reports on the implementation of the Mindful Parenting Program, delivered in two groups to 12 recently divorced parents with preschool-aged children. Program effectiveness was conducted on two levels. First, mindfulness measured by the Toronto Mindfulness Scale revealed significant increases over the intervention and posttest period. Second, in-home behavioral observations conducted pre- and postintervention revealed no changes in parent-child relationships. These findings are discussed within the larger context of facilitating effective parenting postdivorce.

Evolution of a multilevel framework for health program evaluation.

Science.gov (United States)

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

Economic Evaluation of Community-Based HIV Prevention Programs in Ontario: Evidence of Effectiveness in Reducing HIV Infections and Health Care Costs.

Science.gov (United States)

Choi, Stephanie K Y; Holtgrave, David R; Bacon, Jean; Kennedy, Rick; Lush, Joanne; McGee, Frank; Tomlinson, George A; Rourke, Sean B

2016-06-01

Investments in community-based HIV prevention programs in Ontario over the past two and a half decades are assumed to have had an impact on the HIV epidemic, but they have never been systematically evaluated. To help close this knowledge gap, we conducted a macro-level evaluation of investment in Ontario HIV prevention programs from the payer perspective. Our results showed that, from 1987 to 2011, province-wide community-based programs helped to avert a total of 16,672 HIV infections, saving Ontario's health care system approximately $6.5 billion Canadian dollars (range 4.8-7.5B). We also showed that these community-based HIV programs were cost-saving: from 2005 to 2011, every dollar invested in these programs saved about $5. This study is an important first step in understanding the impact of investing in community-based HIV prevention programs in Ontario and recognizing the impact that these programs have had in reducing HIV infections and health care costs.

Organizational Structures that Support Internal Program Evaluation

Science.gov (United States)

Lambur, Michael T.

2008-01-01

This chapter explores how the structure of large complex organizations such as Cooperative Extension affects their ability to support internal evaluation of their programs and activities. Following a literature review of organizational structure and its relation to internal evaluation capacity, the chapter presents the results of interviews with…

Evaluation Study of VTAE Wood Technics Programs.

Science.gov (United States)

Wisconsin State Board of Vocational, Technical, and Adult Education, Madison.

A survey of former students of the Wisconsin Vocational, Technical, and Adult Education (VTAE) wood technics programs and employers in woodworking industries was conducted during spring of 1985. General objectives were to determine job classifications, types of businesses, and relative importance of tasks or duties in various woodworking-related…

Methods for evaluating a mature substance abuse prevention/early intervention program.

Science.gov (United States)

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

Child Development Program Evaluation Scale.

Science.gov (United States)

Fiene, Richard J.

The Child Development Program Evaluation Scale (CDPES) is actually two scales in one, a licensing scale and a quality scale. Licensing predictor items have been found to predict overall compliance of child day care centers with state regulations in four states. Quality scale items have been found to predict the overall quality of child day care…

2012 Wind Program Peer Review Report

Energy Technology Data Exchange (ETDEWEB)

Zayas, Jose [Energy Efficiencey and Renewable Energy (EERE), Washington, DC (United States); Higgins, Mark [Energy Efficiencey and Renewable Energy (EERE), Washington, DC (United States)

2012-06-01

This report summarizes the proceedings of the 2012 Wind Program Peer Review, the goals of which were to review and evaluate the strategy and goals of the Wind Program; review and evaluate the progress and accomplishments of the program's projects funded in fiscal year (FY) 2010 and FY 2011; and foster interactions among the national laboratories, industry, and academic institutions conducting research and development on behalf of the program.

Objective Evaluation in an Online Geographic Information System Certificate Program

OpenAIRE

Scott L. WALKER

2005-01-01

Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program....

Nondestructive Evaluation Program: Progress in 1986

International Nuclear Information System (INIS)

1987-07-01

The increasing cost of equipment for power generating plants and the potential increases in productivity and safety available through rapidly developing Nondestructive Evaluation (NDE) technology led EPRI to initiate a Nondestructive Evaluation Program in 1974. To date, the major focus has been on light water reactor inspection problems; however, increased application to other systems is now under way. This report presents a comprehensive review of the EPRI effort in the NDE area. Most of the report consists of contractor-supplied progress reports on each current project. An organizational plan of the program is presented in overview. In addition, organization from several viewpoints is presented, e.g., in-service inspection operators, R and D personnel, and utility representatives. The report summarizes significant progress made since the previous EPRI Special Report NP-4315-SR was issued in May 1986. Section 1 contains information about the program organization, and the sections that follow contain contractor-supplied progress reports of each current project. The progress reports are grouped by plant components - pipe, pressure vessel, steam generator and boiler tubes, and turbine. In addition, Part 6 is devoted to discussions of technology transfer

Using insects for STEM outreach: Development and evaluation of the UA Insect Discovery Program

Science.gov (United States)

Beal, Benjamin D.

Science and technology impact most aspects of modern daily life. It is therefore important to create a scientifically literate society. Since the majority of Americans do not take college-level science courses, strong K-12 science education is essential. At the K-5 level, however, many teachers lack the time, resources and background for effective science teaching. Elementary teachers and students may benefit from scientist-led outreach programs created by Cooperative Extension or other institutions. One example is the University of Arizona Insect Discovery Program, which provides short-duration programing that uses insects to support science content learning, teach critical thinking and spark interest in science. We conducted evaluations of the Insect Discovery programming to determine whether the activities offered were accomplishing program goals. Pre-post tests, post program questionnaires for teachers, and novel assessments of children's drawings were used as assessment tools. Assessments were complicated by the short duration of the program interactions with the children as well as their limited literacy. In spite of these difficulties, results of the pre-post tests indicated a significant impact on content knowledge and critical thinking skills. Based on post-program teacher questionnaires, positive impacts on interest in science learning were noted as much as a month after the children participated in the program. New programming and resources developed to widen the potential for impact are also described.

Evaluation of the RATU2 and RETU research programs

International Nuclear Information System (INIS)

Faidy, C.; Hayns, M.R.

1998-05-01

The report is an evaluation of the Finnish RATU2 (Structural Integrity of Nuclear Power Plants) and RETU (Reactor Safety) programs. The first generation of nuclear safety research programs were started in 1988-1990. Mid-term reviews were carried out and published in 1992. Many of the recommendations from those reviews have been implemented and they are referred to in this evaluation report

Program Evaluation - Automotive Lightweighting Materials Program Research and Development Projects Assessment of Benefits - Case Studies No. 2

Energy Technology Data Exchange (ETDEWEB)

Das, S.

2003-01-23

This report is the second of a series of studies to evaluate research and development (R&D) projects funded by the Automotive Lightweighting Materials (ALM) Program of the Office of Advanced Automotive Technologies (OAAT) of the U.S. Department of Energy (DOE). The objectives of the program evaluation are to assess short-run outputs and long-run outcomes that may be attributable to the ALM R&D projects. The ALM program focuses on the development and validation of advanced technologies that significantly reduce automotive vehicle body and chassis weight without compromising other attributes such as safety, performance, recyclability, and cost. Funded projects range from fundamental materials science research to applied research in production environments. Collaborators on these projects include national laboratories, universities, and private sector firms, such as leading automobile manufacturers and their suppliers. Three ALM R&D projects were chosen for this evaluation: Design and Product Optimization for Cast Light Metals, Durability of Lightweight Composite Structures, and Rapid Tooling for Functional Prototyping of Metal Mold Processes. These projects were chosen because they have already been completed. The first project resulted in development of a comprehensive cast light metal property database, an automotive application design guide, computerized predictive models, process monitoring sensors, and quality assurance methods. The second project, the durability of lightweight composite structures, produced durability-based design criteria documents, predictive models for creep deformation, and minimum test requirements and suggested test methods for establishing durability properties and characteristics of random glass-fiber composites for automotive structural composites. The durability project supported Focal Project II, a validation activity that demonstrates ALM program goals and reduces the lead time for bringing new technology into the marketplace. Focal

Monitoring and evaluation of mental health and psychosocial support programs in humanitarian settings: a scoping review of terminology and focus.

Science.gov (United States)

Augustinavicius, Jura L; Greene, M Claire; Lakin, Daniel P; Tol, Wietse A

2018-01-01

Monitoring and evaluation of mental health and psychosocial support (MHPSS) programs is critical to facilitating learning and providing accountability to stakeholders. As part of an inter-agency effort to develop recommendations on MHPSS monitoring and evaluation, this scoping review aimed to identify the terminology and focus of monitoring and evaluation frameworks in this field. We collected program documents (logical frameworks (logframes) and theories of change) from members of the Inter-Agency Standing Committee Reference Group on MHPSS, and systematically searched the peer-reviewed literature across five databases. We included program documents and academic articles that reported on monitoring and evaluation of MHPSS in low- and middle-income countries describing original data. Inclusion and data extraction were conducted in parallel by independent reviewers. Thematic analysis was used to identify common language in the description of practices and the focus of each monitoring and evaluation framework. Logframe outcomes were mapped to MHPSS activity categories. We identified 38 program documents and 89 peer-reviewed articles, describing monitoring and evaluation of a wide range of MHPSS activities. In both program documents and peer-reviewed literature there was a lack of specificity and overlap in language used for goals and outcomes. Well-validated, reliable instruments were reported in the academic literature, but rarely used in monitoring and evaluation practices. We identified six themes in the terminology used to describe goals and outcomes. Logframe outcomes were more commonly mapped to generic program implementation activities (e.g. "capacity building") and those related to family and community support, while outcomes from academic articles were most frequently mapped to specialized psychological treatments. Inconsistencies between the language used in research and practice and discrepancies in measurement have broader implications for monitoring and

24 CFR 266.115 - Program monitoring and evaluation.

Science.gov (United States)

2010-04-01

... AUTHORITIES HOUSING FINANCE AGENCY RISK-SHARING PROGRAM FOR INSURED AFFORDABLE MULTIFAMILY PROJECT LOANS Housing Finance Agency Requirements § 266.115 Program monitoring and evaluation. (a) HFA certifications... under this part, basic underwriting and closing information must be submitted in a format specified by...

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

Science.gov (United States)

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper

Evaluation of a National E-Mentoring Program for Ethnically Diverse Student Nurse-Midwives and Student Midwives.

Science.gov (United States)

Valentin-Welch, Maria

2016-11-01

The US racial profile is changing rapidly, yet the nursing and midwifery professions are not evolving accordingly. The lack of racial and ethnic diversity within these health professions negatively affects efforts to eliminate persistent health disparities. To address this issue, the Midwives of Color Committee (MOCC) of the American College of Nurse-Midwives (ACNM) created a national online mentoring program in 2011 to support midwifery students of color. An evaluation of the program is reported here. This was a descriptive study conducted via online surveys mailed to 44 mentors and 42 mentees who participated in the program during 2012. Categorical survey responses were compared between groups, and open-ended responses were evaluated for common themes. Response rates differed across groups. Half of the mentors responded (50%), while only 38.1% of the mentees responded. The majority of mentors and mentees rated the program as either excellent or good and felt the program should continue. Both mentors and mentees shared similar positive ratings about the effectiveness of the application, speed with which matching occurred, and satisfaction with mentee-mentor match; they also share less favorable ratings regarding frequency of communication, impact of geographic proximity, and academic support need and response. Both groups desired to live closer to one another and communicate more. This study suggests that the online mentoring program for student midwives of color currently being offered should continue but with enhancements to improve the face-to-face mentoring experience, including the use of computer-based technology. Other program improvements are also recommended. To be truly effective, mentoring programs must meet the needs of mentors and mentees; future evaluations should clarify their potential as an important tool for increasing diversity. © 2016 by the American College of Nurse-Midwives.

Cost-Effectiveness of Four Parenting Programs and Bibliotherapy for Parents of Children with Conduct Problems.

Science.gov (United States)

Sampaio, Filipa; Enebrink, Pia; Mihalopoulos, Cathrine; Feldman, Inna

2016-12-01

Parenting programs and self-help parenting interventions employing written materials are effective in reducing child conduct problems (CP) in the short-term compared to control groups, however evidence on the cost-effectiveness of such interventions is insufficient. Few studies have looked at the differences in effects between interventions in the same study design. This study aimed to determine the cost-effectiveness of four parenting programs: Comet, Incredible Years (IY), Cope and Connect, and bibliotherapy, compared to a waitlist control (WC), with a time horizon of 4 months, targeting CP in children aged 3-12 years. This economic evaluation was conducted alongside an RCT of the four parenting interventions and bibliotherapy compared to a WC. The study sample consisted of 961 parents of 3-12 year-old children with CP. CP was measured by the Eyberg Child Behavior Inventory. Effectiveness was expressed as the proportion of "recovered" cases of CP. The time horizon of the study was four months with a limited health sector perspective, including parents' time costs. We performed an initial comparative cost analysis for interventions whose outcomes differed significantly from the WC, and later a cost-effectiveness analysis of interventions whose outcomes differed significantly from both the WC and each other. Secondary analyses were performed: (i) joint outcome "recovered and improved", (ii) intervention completers, (iii) exclusion of parents' time costs, (iv) exclusion of training costs. All interventions apart from Connect significantly reduced CP compared to the WC. Of the other interventions Comet resulted in a significantly higher proportion of recovered cases compared to bibliotherapy. A comparative cost analysis of the effective interventions rendered an average cost per recovered case for bibliotherapy of USD 483, Cope USD 1972, Comet USD 3741, and IY USD 6668. Furthermore, Comet had an ICER of USD 8375 compared to bibliotherapy. Secondary analyses of

Using GIS to evaluate a fire safety program in North Carolina.

Science.gov (United States)

Dudley, Thomas; Creppage, Kathleen; Shanahan, Meghan; Proescholdbell, Scott

2013-10-01

Evaluating program impact is a critical aspect of public health. Utilizing Geographic Information Systems (GIS) is a novel way to evaluate programs which try to reduce residential fire injuries and deaths. The purpose of this study is to demonstrate the application of GIS within the evaluation of a smoke alarm installation program in North Carolina. This approach incorporates national fire incident data which, when linked with program data, provides a clear depiction of the 10 years impact of the Get Alarmed, NC! program and estimates the number of potential lives saved. We overlapped Get Alarmed, NC! program installation data with national information on fires using GIS to identify homes that experienced a fire after an alarm was installed and calculated potential lives saved based on program documentation and average housing occupancy. We found that using GIS was an efficient and quick way to match addresses from two distinct sources. From this approach we estimated that between 221 and 384 residents were potentially saved due to alarms installed in their homes by Get Alarmed, NC!. Compared with other program evaluations that require intensive and costly participant telephone surveys and/or in-person interviews, the GIS approach is inexpensive, quick, and can easily analyze large disparate datasets. In addition, it can be used to help target the areas most at risk from the onset. These benefits suggest that by incorporating previously unutilized data, the GIS approach has the potential for broader applications within public health program evaluation.

Evaluation of a Soft Skills Training Program

Science.gov (United States)

Charoensap-Kelly, Piyawan; Broussard, Lauren; Lindsly, Mallory; Troy, Megan

2016-01-01

This study was conducted to determine the effectiveness of a soft skills employee training program. We examined willingness to learn and delivery methods (face-to-face vs. online) and their associations with the training outcomes in terms of learning and behavioral change. Results showed that neither participants' willingness to learn nor delivery…

Non-Formal Educator Use of Evaluation Results

Science.gov (United States)

Baughman, Sarah; Boyd, Heather H.; Franz, Nancy K.

2012-01-01

Increasing demands for accountability in educational programming have resulted in increasing calls for program evaluation in educational organizations. Many organizations include conducting program evaluations as part of the job responsibilities of program staff. Cooperative Extension is a complex organization offering non-formal educational…

28 CFR 90.58 - Evaluation.

Science.gov (United States)

2010-07-01

... 28 Judicial Administration 2 2010-07-01 2010-07-01 false Evaluation. 90.58 Section 90.58 Judicial Administration DEPARTMENT OF JUSTICE (CONTINUED) VIOLENCE AGAINST WOMEN Indian Tribal Governments Discretionary Program § 90.58 Evaluation. The National Institute of Justice will conduct an evaluation of these programs. ...

Evaluation of a marketing program designed to increase consumer consideration of energy-efficient products in Denver, Colorado

Energy Technology Data Exchange (ETDEWEB)

1978-08-01

A demonstration marketing program to sensitize Denver homeowners to incorporate the energy cost of ownership orientation in their decision process regarding purchase of energy-efficient products is described. Personal interviews with Denver homeowners were conducted. A first survey established a baseline for consumer awareness and acceptance of energy conservation and conservation-related products and provided information which could be utilized in developing marketing strategies related to energy conservation and the concept of energy cost of ownership. A second survey measured shifts in awareness and attitudes which might have occurred as a result of the marketing demonstration program. The methodology and results of the evaluation are discussed in detail. The Denver Test Market Media Campaign conducted through multi-media advertising and public relations campaigns to sensitize the residents to the positive consideraton of energy-efficient products is described. (MCW)

The cost-effectiveness of training US primary care physicians to conduct colorectal cancer screening in family medicine residency programs.

Science.gov (United States)

Edwardson, Nicholas; Bolin, Jane N; McClellan, David A; Nash, Philip P; Helduser, Janet W

2016-04-01

Demand for a wide array of colorectal cancer screening strategies continues to outpace supply. One strategy to reduce this deficit is to dramatically increase the number of primary care physicians who are trained and supportive of performing office-based colonoscopies or flexible sigmoidoscopies. This study evaluates the clinical and economic implications of training primary care physicians via family medicine residency programs to offer colorectal cancer screening services as an in-office procedure. Using previously established clinical and economic assumptions from existing literature and budget data from a local grant (2013), incremental cost-effectiveness ratios are calculated that incorporate the costs of a proposed national training program and subsequent improvements in patient compliance. Sensitivity analyses are also conducted. Baseline assumptions suggest that the intervention would produce 2394 newly trained residents who could perform 71,820 additional colonoscopies or 119,700 additional flexible sigmoidoscopies after ten years. Despite high costs associated with the national training program, incremental cost-effectiveness ratios remain well below standard willingness-to-pay thresholds under base case assumptions. Interestingly, the status quo hierarchy of preferred screening strategies is disrupted by the proposed intervention. A national overhaul of family medicine residency programs offering training for colorectal cancer screening yields satisfactory incremental cost-effectiveness ratios. However, the model places high expectations on primary care physicians to improve current compliance levels in the US. Copyright © 2016 Elsevier Inc. All rights reserved.

Comparison of two shoreline assessment programs conducted for the Exxon Valdez oil spill

International Nuclear Information System (INIS)

Harner, E.J.; Gilfillan, E.S.

1995-01-01

Two large shoreline assessment studies conducted in 1990 in Prince William Sound, Alaska, after the Exxon Valdez oil spill used different design strategies to determine the impact of oiling on shoreline biota. One of the studies, the Coastal Habitat Injury Assessment (CHIA) conducted for the Exxon Valdez Oil Spill Council, used matched pairs of sites, normal population distributions for biota, and meta-analysis. The power of the CHIA study to detect oiling impacts depends on being able to identify and select appropriate pairs of sites for comparison. The CHIA study also increased the oiling signal by focusing on moderate to heavily oiled sites. The Shoreline Ecology Program (SEP), conducted for Exxon, used a stratified-random-sampling study design, normal and non-normal population distributions and covariates. The SEP study was able to detect oiling impacts by using a sufficient number of sites and widely spaced transects

Strengthening Incarcerated Families: Evaluating a Pilot Program for Children of Incarcerated Parents and Their Caregivers.

Science.gov (United States)

Miller, Alison L; Perryman, Jamie; Markovitz, Lara; Franzen, Susan; Cochran, Shirley; Brown, Shavonnea

2013-10-01

Parental incarceration can be devastating for families. Children may experience difficulties, and the stress on caregivers who take on unexpected childrearing is high. We implemented and evaluated a family-level intervention with caregivers and children experiencing parental (typically maternal) incarceration, in a community setting. We partnered with a community-based organization serving families with an incarcerated parent to conduct a pilot trial of the Strengthening Families Program (SFP). Process evaluation indicated high implementation fidelity, satisfaction, engagement, and attendance. Outcome evaluation results indicated positive changes in family-level functioning, caregivers' positive parenting, and caregiver depression symptoms from pre- to post-intervention, with some changes retained at follow-up 4 months later. Implications for preventive interventions with children of incarcerated parents, and their caregivers, are discussed.

Big Bang! An Evaluation of NASA's Space School Musical Program for Elementary and Middle School Learners

Science.gov (United States)

Haden, C.; Styers, M.; Asplund, S.

2015-12-01

Music and the performing arts can be a powerful way to engage students in learning about science. Research suggests that content-rich songs enhance student understanding of science concepts by helping students develop content-based vocabulary, by providing examples and explanations of concepts, and connecting to personal and situational interest in a topic. Building on the role of music in engaging students in learning, and on best practices in out-of-school time learning, the NASA Discovery and New Frontiers program in association with Jet Propulsion Laboratory, Marshall Space Flight Center, and KidTribe developed Space School Musical. Space School Musical consists of a set of nine songs and 36 educational activities to teach elementary and middle school learners about the solar system and space science through an engaging storyline and the opportunity for active learning. In 2014, NASA's Jet Propulsion Laboratory contracted with Magnolia Consulting, LLC to conduct an evaluation of Space School Musical. Evaluators used a mixed methods approach to address evaluation questions related to educator professional development experiences, program implementation and perceptions, and impacts on participating students. Measures included a professional development feedback survey, facilitator follow-up survey, facilitator interviews, and a student survey. Evaluation results showed that educators were able to use the program in a variety of contexts and in different ways to best meet their instructional needs. They noted that the program worked well for diverse learners and helped to build excitement for science through engaging all learners in the musical. Students and educators reported positive personal and academic benefits to participating students. We present findings from the evaluation and lessons learned about integration of the arts into STEM education.

Evaluation of Pre-Departure English Training Program

Directory of Open Access Journals (Sweden)

Ali Saukah

2016-02-01

Full Text Available The program evaluation reported in this article covers three batches of participants, from 1996 through 1997, sponsored by the Directorate General of Higher Education projects to prepare faculty members of teacher training institutions for overseas studies. The result outcomes could be achieved when the initial English competence requirred for participating in the program was at least at the Pre-Advanced level. The criterion validity of the TOEFL-Equivalent test developed by the program was assured, and the test could, therefore, be used as a good predictor of the International TOEFL. Other recommendations are also given for the improvement of the planning and implementation of the program in the future

Curriculum Evaluation and Employers Opinions: the case study of Educational Technology Program in Bachelor Degree (Continuing Program

Directory of Open Access Journals (Sweden)

Nakhon Lalognam

2016-09-01

Full Text Available The purposes of this research were: 1 to evaluate the Educational Technology Program (Continuing Program in Bachelor Degree curriculum which is revised in 2007 by applying CIPP model for evaluation. 2 to study the opinions of the employers about the ideal characteristics and actual characteristics of graduates. 3 to study the opinions for the requirements of the Educational Technology Program in Bachelor Degree (Continuing Program and knowledge implementation in work of graduates. 4 to make the suggestions and guidelines to improve the Educational Technology Program in Bachelor Degree (Continuing Program to achieve potentiality and responsive for the requirements of learners and employers. The sample of this research were 310 persons ; consisted of graduates in the Educational Technology Program in Bachelor Degree (Continuing Program in academic year 2006 - 2010, the committee of the Educational Technology Program in Bachelor Degree (Continuing Program , instructors and employers by using Multi-stage Random Sampling and Simple Random Sampling. The instruments of this research were the 5 levels rating scale questionnaire and the structured interview type. They consisted of 3 sets: 1 for graduates, 2 for the committee of the Educational Technology Program in Bachelor Degree (Continuing Program and 3 for instructors and employers. The research found that: 1. The results of evaluation on the Educational Technology Program in Bachelor Degree (Continuing Program which is revised in 2007 were: 1.1 The opinions of graduates to curriculum in all of aspects were average at the uncertain level which the context aspect was at the high level, input aspect was at the uncertain level, process aspect was at the uncertain level and product aspect was at the high level. 1.2 The opinions of the curriculum committee and instructors to curriculum in all of aspects were average at the high level which the context aspect was at the high level, input aspect was at the

38 CFR 1.15 - Standards for program evaluation.

Science.gov (United States)

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... intent, contain a method to measure fulfillment of the objectives, ascertain the degree to which goals... the data. (f) Each program evaluation requires a systematic research design to collect the data...

Computer programs for TRIGA calibration, burnup evaluation, and bookkeeping

International Nuclear Information System (INIS)

Nelson, George W.

1978-01-01

Several computer programs have been developed at the University of Arizona to assist the direction and operation of the TRIGA Reactor Laboratory. The programs fall into the following three categories: 1. Programs for calculation of burnup of each fuel element in the reactor core, for maintaining an inventory of fuel element location and fissile content at any time, and for evaluation of the reactivity effects of burnup or proposed fuel element rearrangement in the core. 2. Programs for evaluation, function fitting, and tabulation of control rod measurements. 3. Bookkeeping programs to summarize and tabulate reactor runs and irradiations according to time, energy release, purpose, responsible party, etc. These summarized data are reported in an annual operating report for the facility. The use of these programs has saved innumerable hours of repetitious work, assuring more accurate, objective results, and requiring a minimum of effort to repeat calculations when input data are modified. The programs are written in FORTRAN-IV, and have been used on a CDC-6400 computer. (author)

Review and evaluation of online tobacco dependence treatment training programs for health care practitioners.

Science.gov (United States)

Selby, Peter; Goncharenko, Karina; Barker, Megan; Fahim, Myra; Timothy, Valerie; Dragonetti, Rosa; Kemper, Katherine; Herie, Marilyn; Hays, J Taylor

2015-04-17

Training health care professionals is associated with increased capacity to deliver evidence-based smoking cessation interventions and increased quit rates among their patients. Online training programs hold promise to provide training but questions remain regarding the quality and usability of available programs. The aim was to assess the quality of English-language online courses in tobacco dependence treatment using a validated instrument. An environmental scan was conducted using the Google search engine to identify available online tobacco dependence treatment courses. The identified courses were then evaluated using the Peer Review Rubric for Online Learning, which was selected based on its ability to evaluate instructional design. It also has clear and concise criteria descriptions to ensure uniformity of evaluations by trained experts. A total of 39 courses were identified, of which 24 unique courses were assessed based on their accessibility and functionality during the period of evaluation. Overall, the course ratings indicated that 17 of 24 courses evaluated failed to meet minimal quality standards and none of the courses evaluated could be ranked as superior. However, many excelled in providing effective navigation, course rationale, and content. Many were weak in the use of instructional design elements, such as teaching effectiveness, learning strategies, instructor's role, and assessment and evaluation. Evaluation results and suggestions for improvement were shared with course administrators. Based on the courses evaluated in this review, course developers are encouraged to employ best practices in instructional design, such as cohesiveness of material, linearity of design, practice exercises, problem solving, and ongoing evaluation to improve existing courses and in the design of new online learning opportunities.

Senior Program Specialist, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

The SPS recommends appropriate methods for and facilitates the design, conduct and use ... represents the Division with other teams in the elaboration of evaluation .... manages the design and maintenance of information systems for storing, ...

Experiential Education and Empowerment Evaluation: Mars Rover Educational Program Case Example.

Science.gov (United States)

Fetterman, David; Bowman, Cassie

2002-01-01

Empowerment evaluation helps people improve their programs using self-evaluation. Empowerment evaluation has three steps: establishing a mission; taking stock of the most significant activities; and planning for the future by establishing goals, strategies, and criteria for evidence. A NASA experiential program for small, distributed groups of…

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

Science.gov (United States)

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

Approximately 474 000 Indigenous people live in 617 First Nations communities across Canada; 125 of those communities are located in Ontario, primarily in rural and remote areas. Common rural health challenges, including for palliative care, involve quality and access. The need for culturally relevant palliative care programs in First Nations communities is urgent because the population is aging with a high burden of chronic and terminal disease. Because local palliative care is lacking, most First Nations people now leave their culture, family and community to receive care in distant hospitals or long-term care homes. Due to jurisdictional issues, a policy gap exists where neither federal nor provincial governments takes responsibility for funding palliative care in First Nations communities. Further, no Canadian program models existed for how different levels of government can collaborate to fund and deliver palliative care in First Nations communities. This article describes an innovative, community-based palliative care program (Wiisokotaatiwin) developed in rural Naotkamegwanning, and presents the results of a process evaluation of its pilot implementation. The evaluation aimed to (i) document the program's pilot implementation, (ii) assess progress toward intended program outcomes and (iii) assess the perceived value of the program. The Wiisokotaatiwin Program was developed and implemented over 5 years using participatory action research (http://www.eolfn.lakeheadu.ca). A mixed-method evaluation approach was adopted. Descriptive data were extracted from program documents (eg client registration forms). Client tracking forms documented service provision data for a 4-month sample period. Quantitative and qualitative data were collected through client and family member questionnaires (n=7) and healthcare provider questionnaires (n=22). A focus group was conducted with the program leadership team responsible for program development. Quantitative data were

Implementing a Comprehensive Program for the Prevention of Conduct Problems in Rural Communities: The Fast Track Experience1

Science.gov (United States)

Bierman, Karen L.

2012-01-01

Childhood conduct problems are predictive of a number of serious long-term difficulties (e.g., school failure, delinquent behavior, and mental health problems), making the design of effective prevention programs a priority. The Fast Track Program is a demonstration project currently underway in four demographically diverse areas of the United States, testing the feasibility and effectiveness of a comprehensive, multicomponent prevention program targeting children at risk for conduct disorders. This paper describes some lessons learned about the implementation of this program in a rural area. Although there are many areas of commonality in terms of program needs, program design, and implementation issues in rural and urban sites, rural areas differ from urban areas along the dimensions of geographical dispersion and regionalism, and community stability and insularity. Rural programs must cover a broad geographical area and must be sensitive to the multiple, small and regional communities that constitute their service area. Small schools, homogeneous populations, traditional values, limited recreational, educational and mental health services, and politically conservative climates are all more likely to emerge as characteristics of rural rather than urban sites (Sherman, 1992). These characteristics may both pose particular challenges to the implementation of prevention programs in rural areas, as well as offer particular benefits. Three aspects of program implementation are described in detail: (a) community entry and program initiation in rural areas, (b) the adaptation of program components and service delivery to meet the needs of rural families and schools, and (c) issues in administrative organization of a broadly dispersed tricounty rural prevention program. PMID:9338956

Evaluating a Psychology Graduate Student Peer Mentoring Program

Science.gov (United States)

Fleck, Christina; Mullins, Morell E.

2012-01-01

Research on mentoring outcomes and characteristics of various types of mentoring programs in different settings is limited. The present study sampled 39 graduate students at a small Midwestern university to evaluate peer mentoring in a graduate school setting. Mentoring function and outcome relationships as well as program characteristics were…

Evaluation of a patient navigation program to promote colorectal cancer screening in rural Georgia, USA.

Science.gov (United States)

Honeycutt, Sally; Green, Rhonda; Ballard, Denise; Hermstad, April; Brueder, Alex; Haardörfer, Regine; Yam, Jennifer; Arriola, Kimberly J

2013-08-15

Colorectal cancer (CRC) is a leading cause of cancer death in the United States. Early detection through recommended screening has been shown to have favorable treatment outcomes, yet screening rates among the medically underserved and uninsured are low, particularly for rural and minority populations. This study evaluated the effectiveness of a patient navigation program that addresses individual and systemic barriers to CRC screening for patients at rural, federally qualified community health centers. This quasi-experimental evaluation compared low-income patients at average risk for CRC (n = 809) from 4 intervention clinics and 9 comparison clinics. We abstracted medical chart data on patient demographics, CRC history and risk factors, and CRC screening referrals and examinations. Outcomes of interest were colonoscopy referral and examination during the study period and being compliant with recommended screening guidelines at the end of the study period. We conducted multilevel logistic analyses to evaluate the program's effectiveness. Patients at intervention clinics were significantly more likely than patients at comparison clinics to undergo colonoscopy screening (35% versus 7%, odds ratio = 7.9, P screening test (43% versus 11%, odds ratio = 5.9, P Screening Program, can be an effective approach to ensure that lifesaving, preventive health screenings are provided to low-income adults in a rural setting. Copyright © 2013 American Cancer Society.

Development and evaluation of a self care program on breastfeeding in Japan: A quasi-experimental study

Directory of Open Access Journals (Sweden)

Awano Masayo

2010-08-01

Full Text Available Abstract Background Although the importance of breastfeeding is well known in Japan, in recent years less than 50% of mothers were fully breastfeeding at one month after birth. The purpose of this study was to develop a self-care program for breastfeeding aimed at increasing mothers' breastfeeding confidence and to evaluate its effectiveness. Methods A quasi-experimental pretest-posttest design was conducted in Japan. The intervention, a breastfeeding self-care program, was created to improve mothers' self-efficacy for breastfeeding. This Breastfeeding Self-Care Program included: information on the advantages and basics of breastfeeding, a breastfeeding checklist to evaluate breastfeeding by mothers and midwives, and a pamphlet and audiovisual materials on breastfeeding. Mothers received this program during their postpartum hospital stay. A convenience sample of 117 primiparous women was recruited at two clinical sites from October 2007 to March 2008. The intervention group (n = 55, who gave birth in three odd-numbered months, received standard care and the Breastfeeding Self-Care Program while the control group (n = 62 gave birth in three even numbered months and received standard breastfeeding care. To evaluate the effectiveness of the Breastfeeding Self-Care Program, breastfeeding self-efficacy and breastfeeding rate were measured early postpartum, before the intervention, and after the intervention at one month postpartum. The study used the Japanese version of The Breastfeeding Self-Efficacy Scale Short Form (BSES-SF to measure self-efficacy. Results The BSES-SF score of the intervention group rose significantly from 34.8 at early postpartum to 49.9 at one month after birth (p Conclusion Results indicate that the Breastfeeding Self-Care Program increased mothers' self-efficacy for breastfeeding and had a positive effect on the continuation of breastfeeding. Trial Registration Number UMIN000003517

The management of evaluating the European programs and policies implemented in Romania

Directory of Open Access Journals (Sweden)

Doctoral student ROMAN MIHAELA

2011-12-01

Full Text Available Starting with the reform and modernization of the public administration in Romania in the mid 1990s, an important element of this process being the development of the management process, respectively of planning and managing public policies, the Romanian government started also a process of developing the capacity for evaluating public programs and policies, both the ones with European or foreign financing and the ones with domestic financing. Up-to-date analyses and studies have showed, however, that at the level of the national public sector there is a major discrepancy between the progress made in the evaluation of European programs or the ones with foreign financing and the programs financed from public funds, namely that there is a consolidated evaluation practice as regards the first types of programs, which is virtually inexistent as regards programs financed from the public budget.This paper intends to identify the progress made at the level of the Romanian public administration as regards the management of evaluating programs with European financing, to see the characteristics of building the evaluation capacity within the national system of these programs and the motivation stimulating such approaches. The first part of this paper shall contain a presentation of the background of the current evaluation system, including both the legislative framework and the institutional framework with duties of management and evaluation of European programs; further, I shall analyze the evolution of this system in order to be able to draw conclusions regarding the evaluation capacity of Romania.

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

Science.gov (United States)

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Evaluation of a Hospital-Based Pneumonia Nurse Navigator Program.

Science.gov (United States)

Seldon, Lisa E; McDonough, Kelly; Turner, Barbara; Simmons, Leigh Ann

2016-12-01

The aim of this study is to evaluate the effectiveness of a hospital-based pneumonia nurse navigator program. This study used a retrospective, formative evaluation. Data of patients admitted from January 2012 through December 2014 to a large community hospital with a primary or secondary diagnosis of pneumonia, excluding aspiration pneumonia, were used. Data included patient demographics, diagnoses, insurance coverage, core measures, average length of stay (ALOS), disposition, readmission rate, financial outcomes, and patient barriers to care were collected. Descriptive statistics and parametric testing were used to analyze data. Core measure performance was sustained at the 90th percentile 2 years after the implementation of the navigator program. The ALOS did not decrease to established benchmarks; however, the SD for ALOS decreased by nearly half after implementation of the navigator program, suggesting the program decreased the number and length of extended stays. Charges per case decreased by 21% from 2012 to 2014. Variable costs decreased by 4% over a 2-year period, which increased net profit per case by 5%. Average readmission payments increased by 8% from 2012 to 2014, and the net revenue per case increased by 8.3%. The pneumonia nurse navigator program may improve core measures, reduce ALOS, and increase net revenue. Future evaluations are necessary to substantiate these findings and optimize the cost and quality performance of navigator programs.

Evaluating a food bank recipe-tasting program.

Science.gov (United States)

Keller-Olaman, Susan J; Edwards, Vicki; Elliott, Susan J

2005-01-01

Food banks mitigate immediate food insecurity, but their ability to promote healthy nutrition is constrained by how often recipients may visit and the range of foods available. In a descriptive study, a formative evaluation was completed of a combined heart-healthy recipe-tasting and education program that aims to promote healthy eating knowledge and skills in a group of food bank recipients in Hamilton, Ontario. Fifty-five adults were surveyed about food bank attendance, program awareness, perceived enhancement of knowledge and skills, and suggestions for program improvement. Most participants (73%) were positive about the program, and 91% wanted the program to continue. In addition, 78% would prepare the recipes sampled. In contrast, program awareness and planning food bank visits to coincide with the program were generally low. Food banks are potential sites for effective nutrition promotion programs. To reach more recipients, more frequent implementation and seeking the use of a designated room are suggested for the current program. The findings also suggest that the sampling approach to promoting healthy eating to food bank recipients deserves further study. For example, monitoring the selection of featured recipe ingredients would be a useful indicator of behaviour.

Evaluation Methodologies for Estimating the Likelihood of Program Implementation Failure

Science.gov (United States)

Durand, Roger; Decker, Phillip J.; Kirkman, Dorothy M.

2014-01-01

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

Educational Program Evaluation Model, From the Perspective of the New Theories

Directory of Open Access Journals (Sweden)

Soleiman Ahmady

2014-05-01

Full Text Available Introduction: This study is focused on common theories that influenced the history of program evaluation and introduce the educational program evaluation proposal format based on the updated theory. Methods: Literature searches were carried out in March-December 2010 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface, ERIC (Education Resources Information Center and the main journal of medical education regarding current evaluation models and theories. We included all study designs in our study. We found 810 articles related to our topic, and finally 63 with the full text article included. We compared documents and used expert consensus for selection the best model. Results: We found that the complexity theory using logic model suggests compatible evaluation proposal formats, especially with new medical education programs. Common components of a logic model are: situation, inputs, outputs, and outcomes that our proposal format is based on. Its contents are: title page, cover letter, situation and background, introduction and rationale, project description, evaluation design, evaluation methodology, reporting, program evaluation management, timeline, evaluation budget based on the best evidences, and supporting documents. Conclusion: We found that the logic model is used for evaluation program planning in many places, but more research is needed to see if it is suitable for our context.

Secondary Education Programs in Kuwait: An Evaluation Study

Science.gov (United States)

Eid, Ghada K.; Koushki, Parviz A.

2005-01-01

This paper evaluates the effectiveness of the semester and the credit programs of high school education in Kuwait in terms of their graduating students' preparedness for continued and successful academic performance in programs of higher education. Students' percentile graduation rank from high school and their performances in the English, math…

Using Program Theory-Driven Evaluation Science to Crack the Da Vinci Code

Science.gov (United States)

Donaldson, Stewart I.

2005-01-01

Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

Systematic evaluation program, status summary report

International Nuclear Information System (INIS)

1983-01-01

Status reports are presented on the systematic evaluation program for the Big Rock Point reactor, Dresden-1 reactor, Dresden-2 reactor, Ginna-1 reactor, Connecticut Yankee reactor, LACBWR reactor, Millstone-1 reactor, Oyster Creek-1 reactor, Palisades-1 reactor, San Onofre-1 reactor, and Rowe Yankee reactor

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

Defence Health Service Mentoring Program Evaluation 2001

National Research Council Canada - National Science Library

Highfield, Jane

2002-01-01

...). DHS commissioned the Directorate of Strategic Personnel Planning and Research (DSPPR) to evaluate a recent Mentoring Program trial in order to assess the effectiveness and organizational value of Mentoring within DHS...

National Uranium Resource Evaluation Program: the Hydrogeochemical Stream Sediment Reconnaissance Program at LLNL

International Nuclear Information System (INIS)

Higgins, G.H.

1980-08-01

From early 1975 to mid 1979, Lawrence Livermore National Laboratory (LLNL) participated in the Hydrogeochemical Stream Sediment Reconnaissance (HSSR), part of the National Uranium Resource Evaluation (NURE) program sponsored by the Department of Energy (DOE). The Laboratory was initially responsible for collecting, analyzing, and evaluating sediment and water samples from approximately 200,000 sites in seven western states. Eventually, however, the NURE program redefined its sampling priorities, objectives, schedules, and budgets, with the increasingly obvious result that LLNL objectives and methodologies were not compatible with those of the NURE program office, and the LLNL geochemical studies were not relevant to the program goal. The LLNL portion of the HSSR program was consequently terminated, and all work was suspended by June 1979. Of the 38,000 sites sampled, 30,000 were analyzed by instrumental neutron activation analyses (INAA), delayed neutron counting (DNC), optical emission spectroscopy (OES), and automated chloride-sulfate analyses (SC). Data from about 13,000 sites have been formally reported. From each site, analyses were published of about 30 of the 60 elements observed. Uranium mineralization has been identified at several places which were previously not recognized as potential uranium source areas, and a number of other geochemical anomalies were discovered

[Evaluation of needle exchange program at Pereiro de Aguiar prison (Ourense, Spain): ten years of experience].

Science.gov (United States)

Ferrer-Castro, V; Crespo-Leiro, M R; García-Marcos, L S; Pérez-Rivas, M; Alonso-Conde, A; García-Fernández, I; Lorenzo-Guisado, A; Sánchez-Fernández, J L; Seara-Selas, M; Sanjosé-Vallejo, R

2012-01-01

To evaluate the effectiveness of NEPs in prison to reduce the prevalence of infections associated with intravenous drug use and to know more about acceptance of the program by inmates and staff. cross-sectional observational study at baseline, 6 and 12 months and 10 years of program development. Interviews were conducted with program users, as well as random sample surveys of officials at the various cuts, and a random sample of inmates from the centre after10 years. Activity indicators of the program were recorded continuously, and the prevalence of HIV, HBV and HCV at baseline and after 10 years was evaluated. For the statistical analysis, the chi-square test was used with the Yates correction when necessary. In ten years we have supplied a total of 15,962 syringes to 429 users, (average 20.2 users/month), and 11,327 (70.9%) were returned. The prevalence of HIV infection decreased from 21% in 1999 to 8.5% in 2009, HCV prevalence from 40% to 26.1% (p living conditions in prison. After ten years of development of the NEP, there was a significant decrease in the prevalence of HIV and HCV in the prison population at the centre, and the program is accepted as beneficial by most of the inmates and staff participating in the survey.

Critical evaluation of the nonradiological environmental technical specifications. Program description, summary, and recommendations. Vol. 1

International Nuclear Information System (INIS)

Adams, S.M.; Cunningham, P.A.; Gray, D.D.; Kumar, K.D.; Witten, A.J.

1976-01-01

A comprehensive study of the data collected as part of the environmental Technical Specifications program for eight nuclear power plants was conducted for the Office of Nuclear Regulatory Research of the U.S. Nuclear Regulatory commission. This report includes a summary of the screening phase in which the adequacy of the hydrothermal and ecological monitoring data for each plant were evaluated, and the summary and recommendations resulting from a detailed examination of the three nuclear power plants selected in the initial screening

Evaluating disease management program effectiveness: an introduction to time-series analysis.

Science.gov (United States)

Linden, Ariel; Adams, John L; Roberts, Nancy

2003-01-01

Currently, the most widely used method in the disease management (DM) industry for evaluating program effectiveness is referred to as the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer a plausible rationale explaining the change from baseline. Furthermore, with the current inclination of DM programs to use financial indicators rather than program-specific utilization indicators as the principal measure of program success, additional biases are introduced that may cloud evaluation results. This paper presents a non-technical introduction to time-series analysis (using disease-specific utilization measures) as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

28 CFR 90.21 - Evaluation.

Science.gov (United States)

2010-07-01

... 28 Judicial Administration 2 2010-07-01 2010-07-01 false Evaluation. 90.21 Section 90.21 Judicial...¢ Officers ⢠Prosecutors) Violence Against Women Formula Grant Program § 90.21 Evaluation. (a) The National Institute of Justice will conduct an evaluation of these programs. A portion of the overall funds authorized...

An evolving approach to delirium: A mixed-methods process evaluation of a hospital-wide delirium program in New Zealand.

Science.gov (United States)

Alhaidari, Abdullah Ao; Allen-Narker, Rosalind Ac

2017-06-01

A process evaluation was carried out to assess and potentially improve the design and implementation of a hospital-wide delirium program. A mixed-methods sequential-explanatory design was used; retrospective chart reviews for 100 older (75+) medical inpatients were conducted to measure nurses', doctors' and coders' adherence to key program processes following which interviews were conducted to identify potential barriers to implementation. Delirium occurred in 49% of patients. Chart reviews revealed suboptimal adherence to the delirium risk assessment (66%), the Short Confusion Assessment Method (50% on admission, 58% during admission), documentation of delirium in clinical records (80%) and discharge letters (38%) and coding for delirium (49%). The major barriers to implementation identified were failure to recruit non-nursing staff, unclear goals and instructions, difficulties using the Short-CAM, time constraints with competing priorities and lack of outcome expectancy. A new delirium program was needed based on these findings. © 2017 AJA Inc.

29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

Science.gov (United States)

2010-07-01

... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

Suitability of a structured Fundamental Movement Skills program for long day care centres: a process evaluation.

Science.gov (United States)

Petrunoff, Nick; Lloyd, Beverley; Watson, Natalie; Morrisey, David

2009-04-01

Early childhood presents an opportunity to encourage development of Fundamental Movement Skills (FMS). Implementation of a structured program in the Long Day Care (LDC) setting presents challenges. Implementation of a structured FMS program FunMoves was assessed in LDC in metropolitan New South Wales. LDC staff attended a training session conducted by trained Health Promotion Officers (HPOs) and completed an evaluation. During implementation HPOs completed lesson observations. De-identified attendance data was collected and director and staff feedback on the program including barriers to implementation was obtained via questionnaire. Qualitative information relevant to process evaluation was obtained via open questions on questionnaires, and a de-brief diary recording feedback from directors and staff. Knowledge of FMS and FunMoves and staff confidence to deliver the program were high after training. On average, staff stated they ran lessons more than the suggested twice weekly and the majority of children attended 1-3 lessons per week. However, lesson delivery was not as designed, and staff found FunMoves disruptive and time consuming. Six directors and the majority of staff thought that FunMoves could be improved. Structured program delivery was hampered by contextual issues including significant staff turnover and program length and structure being at odds with the setting. Implementation could be enhanced by guidelines for more flexible delivery options including less structured approaches, shorter and simpler lessons, ongoing conversations with the early childhood sector, in-centre engagement of staff and post-training support.

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. (eds.); Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-01-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Objective Evaluation in an Online Geographic Information System Certificate Program

Directory of Open Access Journals (Sweden)

Scott L. WALKER

2005-01-01

Full Text Available Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program. The evaluation utilized several methods that strived to inject objectivity in evaluation and subsequent decision-making. A rapid multi-modal approach included evaluation methods of (1 considering the online psychosocial learning environment, (2 content analyses comparing the online version of classes to face-to-face versions, (3 cost comparisons in online vs. face-to-face classes, (4 student outcomes, (5 student retention, and (6 benchmarking. These approaches offer opportunities for departmental administrators and decision-making committees to make judgments informed by facts rather than being influenced by the emotions, beliefs, or opinions of organizational dynamics.

In Vitro Evaluation of Dentin Hydraulic Conductance After 980 nm Diode Laser Irradiation.

Science.gov (United States)

Rizzante, Fabio A P; Maenosono, Rafael M; Duarte, Marco A H; Furuse, Adilson Y; Palma-Dibb, Regina G; Ishikiriama, Sérgio K

2016-03-01

Dentin hypersensitivity treatments are based on the physical obliteration of the dentinal tubules to reduce hydraulic conductance. The aim of the present study is to evaluate the hydraulic conductance of bovine root dentin after irradiation with a 980-nm diode laser, with or without associated fluoride varnish. Sixty bovine root dentin specimens were divided into six groups (n = 10 in each group): G1, G3, and G5 (0.5 W, 0.7 W, and 1 W diode laser, respectively); G2, G4, and G6 (fluoride varnish application + 0.5 W, 0.7 W, and 1 W diode laser, respectively). The dentin hydraulic conductance was evaluated at four time periods with a fluxmeter: 1) with smear layer, 2) after 37% phosphoric acid etching, 3) after the treatments, and 4) after 6% citric acid challenge. After the dentinal fluid flow measurements, specimens were also evaluated for mineral composition using energy dispersive X-ray spectroscopy (EDS). Analysis demonstrated a better result with increased irradiation power (P diode laser irradiation was associated with the application of fluoride varnish (P laser irradiation, the 1 W group was superior when compared with the 0.5 W and 0.7 W irradiated groups immediately after treatment (P laser treatments. Laser irradiation of exposed dentin promoted significant reduction in the dentin hydraulic conductance, mainly with higher energy densities and association with fluoride varnish.

Quality standards for bone conduction implants.

Science.gov (United States)

Gavilan, Javier; Adunka, Oliver; Agrawal, Sumit; Atlas, Marcus; Baumgartner, Wolf-Dieter; Brill, Stefan; Bruce, Iain; Buchman, Craig; Caversaccio, Marco; De Bodt, Marc T; Dillon, Meg; Godey, Benoit; Green, Kevin; Gstoettner, Wolfgang; Hagen, Rudolf; Hagr, Abdulrahman; Han, Demin; Kameswaran, Mohan; Karltorp, Eva; Kompis, Martin; Kuzovkov, Vlad; Lassaletta, Luis; Li, Yongxin; Lorens, Artur; Martin, Jane; Manoj, Manikoth; Mertens, Griet; Mlynski, Robert; Mueller, Joachim; O'Driscoll, Martin; Parnes, Lorne; Pulibalathingal, Sasidharan; Radeloff, Andreas; Raine, Christopher H; Rajan, Gunesh; Rajeswaran, Ranjith; Schmutzhard, Joachim; Skarzynski, Henryk; Skarzynski, Piotr; Sprinzl, Georg; Staecker, Hinrich; Stephan, Kurt; Sugarova, Serafima; Tavora, Dayse; Usami, Shin-Ichi; Yanov, Yuri; Zernotti, Mario; Zorowka, Patrick; de Heyning, Paul Van

2015-01-01

Bone conduction implants are useful in patients with conductive and mixed hearing loss for whom conventional surgery or hearing aids are no longer an option. They may also be used in patients affected by single-sided deafness. To establish a consensus on the quality standards required for centers willing to create a bone conduction implant program. To ensure a consistently high level of service and to provide patients with the best possible solution the members of the HEARRING network have established a set of quality standards for bone conduction implants. These standards constitute a realistic minimum attainable by all implant clinics and should be employed alongside current best practice guidelines. Fifteen items are thoroughly analyzed. They include team structure, accommodation and clinical facilities, selection criteria, evaluation process, complete preoperative and surgical information, postoperative fitting and assessment, follow-up, device failure, clinical management, transfer of care and patient complaints.

Intervention on early-onset conduct problems as indicated prevention for substance use: A seven-year follow up.

Science.gov (United States)

Romero, Estrella; Rodríguez, Concepción; Villar, Paula; Gómez-Fraguela, X Antón

2017-06-28

The aim of this study is to evaluate the long-term effects of a manualised program which intervenes on children with early-onset conduct problems, their families and teachers. The program evaluation involved 14 primary schools which were randomly assigned to the intervention (45 participating families) and control (30 families) conditions during 2007-2008. After a screening process which identified children with significant conduct problems both at home with their family and at school, the program was implemented in eight schools. Seven years later, 58 families (37 from the intervention group and 21 from the control group), with characteristics equivalent to those of the study's entire initial group, were contacted again. With measures administered to the children and their parents, comparisons through multivariate analyses of variance between intervention and control groups supported the program's efficacy in reducing both conduct problems and relations with antisocial peers. Furthermore, the program fostered social and communication skills. As regards drug use, the intervention group showed less favourable attitudes towards drugs, lower intention of drug use, lower frequency of tobacco use and lower intensity of alcohol use. These results support the usefulness of multicomponent programs for conduct problems as a way to prevent, in the long term, unfavourable developmental trajectories, where drug use is a key element.

Program Evaluation in Cost Benefit Terms.

Science.gov (United States)

Tanner, C. Kenneth

This paper advances a model, called the expected opportunity loss model, for curriculum evaluation. This decision-making technique utilizes subjective data by ranking courses according to their expected contributions to the primary objective of the total program. The model also utilizes objective data in the form of component costs, and differs…

Evaluation of the parents as primary sexuality educators program.

Science.gov (United States)

Klein, Jonathan D; Sabaratnam, Premini; Pazos, Beatriz; Auerbach, Melissa Matos; Havens, Caryn Graff; Brach, Mary Jo

2005-09-01

To determine the effectiveness of a sexuality education program designed to help parents become more confident and competent in communicating with their children about sex and sexuality. Parents attending a four- to five-part workshop series between February 2001 and April 2002 were recruited to participate. A total of 27 workshop series were conducted at various sites in neighborhoods with high teen pregnancy and STD rates. For each series, program staff administered written pre- and post-workshop surveys to parents and parent surrogates. A follow-up telephone survey was conducted with participants 10 weeks after the last workshop. Matched pre-workshop and follow-up surveys were obtained from 174 participants. Comparison of follow-up to pre-workshop responses revealed that more participants thought discussing sexuality with their children was very important (83% vs. 75%; p Parents as Primary Sexuality Educators program may be an effective way to increase parent-child communication about health, sexuality, and values. Enhancing parents' ability to communicate expectations and values about sexuality may help support children in making healthy decisions about sexual behavior as adolescents.

Evaluation of the impact of a nutritional program for undernourished children in Brazil

NARCIS (Netherlands)

Santos, Iná S; Gigante, Denise P; Coitinho, Denise C; Haisma, Hinke; Valle, Neiva C J; Valente, Gicele

2005-01-01

To assess the effectiveness on child growth and body composition of a supplementary feeding program (Milk Supplement Program), a prospective, controlled study was conducted in Northeast Brazil. When entering the Program, children from 10 municipalities with the highest coverage rates in the Program

Status of beta measurement evaluation and upgrade program