Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

Critical Analysis of the Supportive and Suppressive Factors for the Children’s Literature Program in Malaysia

Directory of Open Access Journals (Sweden)

Siti Salina Mustakim

2015-02-01

Full Text Available Literature in Education (LIE is aimed at enhancing the pupils’ linguistic competence by providing an early beginning to a foundation in literature and literary works.  In 2006, the literature component was introduced to pupils in Malaysian primary schools through two programs: Contemporary Children’s Literature (CCL and Extensive Reading Program.  The literature program is viewed as a vehicle to provide an early exposure to pupils on literary genres to enhance their understanding and appreciation of people’s cultures, values, and traditions.  The primary aim of this study was to evaluate the provision of support, resources, training, and time allocation in the implementation of children’s literature among upper primary school teachers in Malaysia via the utilization of survey questionnaires, classroom observations and interviews.  This study was conducted in a district in the state of Selangor.  A sample of 56 upper primary school teachers from 19 schools were selected to answer the survey questionnaires.  Interviews were conducted in one selected school in the District.   The school was chosen based on the highest academic performance in the Malaysia Standard Examination for Primary Schools.   Data were analyzed using SPSS version 19, and coded manually.  Findings from survey indicated that 75% of the school management understand the objectives and goals of CCL in order to provide effective support to the program.  Majority of the respondents (82% agreed that the school management has allowed the English Language Department to manage its own expenses or resources for the program.   Almost three-fourths (71.4% of the respondents agreed that the provision of training and resources has produced capable and knowledgeable teachers to teach literature. However, the majority of the respondents (76.8% disagreed that the time allocation provides sufficient time for them to fulfil the requirements of teaching two textbooks in a year

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

Potential Transferability of Economic Evaluations of Programs Encouraging Physical Activity in Children and Adolescents across Different Countries—A Systematic Review of the Literature

Directory of Open Access Journals (Sweden)

Katharina Korber

2014-10-01

Full Text Available Physical inactivity is an increasing problem. Owing to limited financial resources, one method of getting information on the cost-effectiveness of different types of prevention programs is to examine existing programs and their results. The aim of this paper is to give an overview of the transferability of cost-effectiveness results of physical activity programs for children and adolescents to other contexts. Based on a systematic review of the literature, the transferability of the studies found was assessed using a sub-checklist of the European Network of Health Economic Evaluation Databases (EURONHEED. Thirteen studies of different physical activity interventions were found and analyzed. The results for transferability ranged from “low” to “very high”. A number of different factors influence a program’s cost-effectiveness (i.e., discount rate, time horizon, etc.. Therefore, transparency with regard to these factors is one fundamental element in the transferability of the results. A major point of criticism is that transferability is often limited because of lack of transparency. This paper is the first to provide both an overview and an assessment of transferability of economic evaluations of existing programs encouraging physical activity in children and adolescents. This allows decision makers to gain an impression on whether the findings are transferable to their decision contexts, which may lead to time and cost savings.

Evolution of a multilevel framework for health program evaluation.

Science.gov (United States)

Masso, Malcolm; Quinsey, Karen; Fildes, Dave

2017-07-01

A well-conceived evaluation framework increases understanding of a program's goals and objectives, facilitates the identification of outcomes and can be used as a planning tool during program development. Herein we describe the origins and development of an evaluation framework that recognises that implementation is influenced by the setting in which it takes place, the individuals involved and the processes by which implementation is accomplished. The framework includes an evaluation hierarchy that focuses on outcomes for consumers, providers and the care delivery system, and is structured according to six domains: program delivery, impact, sustainability, capacity building, generalisability and dissemination. These components of the evaluation framework fit into a matrix structure, and cells within the matrix are supported by relevant evaluation tools. The development of the framework has been influenced by feedback from various stakeholders, existing knowledge of the evaluators and the literature on health promotion and implementation science. Over the years, the framework has matured and is generic enough to be useful in a wide variety of circumstances, yet specific enough to focus data collection, data analysis and the presentation of findings.

School-based internet obesity prevention programs for adolescents: a systematic literature review.

Science.gov (United States)

Whittemore, Robin; Chao, Ariana; Popick, Rachel; Grey, Margaret

2013-03-01

In response to the childhood obesity epidemic, numerous studies on school-based Internet obesity prevention interventions have been conducted. The purpose of this systematic review is to describe, synthesize, and evaluate the research on school-based Internet obesity prevention programs for adolescents. Medline, CINAHL, and PsycInfo were searched from January 1995 to August 2012 to locate relevant studies. Ninety-one reports were initially identified, with 12 meeting the inclusion criteria. Studies had variable control groups, program content, and sample characteristics. Though few authors reported on implementation processes or body mass index (BMI) outcomes, the majority of studies were effective in improving health behaviors in the short term. Most studies were judged to have a high or unclear risk of bias in at least two domains, thus the quality of evidence for this body of literature is moderate. Further research is needed to examine programs of longer duration, optimal dose and timing of programs, cost-effectiveness, and mediators and moderators of intervention outcomes.

Economic evaluation of screening programs for hepatitis C virus infection: evidence from literature

Directory of Open Access Journals (Sweden)

Coretti S

2015-04-01

Full Text Available Silvia Coretti,1 Federica Romano,1 Valentina Orlando,2 Paola Codella,1 Sabrina Prete,1 Eugenio Di Brino,1 Matteo Ruggeri1 1Post-Graduate School of Economics and Management (ALTEMS, Università Cattolica del Sacro Cuore, Rome, Italy; 2Center of Pharmacoeconomics (CIRFF, Department of Pharmacy, Federico II University, Naples, Italy Background: Hepatitis C is a liver infection caused by hepatitis C virus. Its main complications are cirrhosis and liver cancer. According to the World Health Organization (WHO, more than 185 million people worldwide are infected with hepatitis C virus and, of these, 350,000 die every year. Due to the high disease prevalence and the existence of effective (and expensive medical treatments able to dramatically change the prognosis, early detection programs can potentially prevent the development of serious chronic conditions, improve health, and save resources. Objective: To summarize the available evidence on the cost-effectiveness of screening programs for hepatitis C. Methods: A literature search was performed on PubMed and Scopus search engines. Trip database was queried to identify reports produced by the major Health Technology Assessment (HTA agencies. Three reviewers dealt with study selection and data extraction blindly. Results: Ten papers eventually met the inclusion criteria. In studies focusing on asymptomatic cohorts of individuals at general risk the cost/quality adjusted life year of screening programs ranged between US $4,200 and $50,000/quality adjusted life year gained, while in those focusing on specific risk factors the incremental cost-effectiveness ratio ranged between $848 and $128,424/quality adjusted life year gained. Age of the target population and disease prevalence were the main cost-effectiveness drivers. Conclusion: Our results suggest that, especially in the long run, screening programs represent a cost-effective strategy for the management of hepatitis C. Keywords: hepatitis C, screening

Examining Guidelines for School-Based Breakfast Programs in Canada: A Systematic Review of the Grey Literature.

Science.gov (United States)

Godin, Katelyn M; Kirkpatrick, Sharon I; Hanning, Rhona M; Stapleton, Jackie; Leatherdale, Scott T

2017-06-01

School breakfast programs are widespread and serve varying objectives regarding youth health promotion. Evidence-based guidelines for breakfast programs may be important in maximizing their effectiveness related to student outcomes, yet it is unclear what is available in Canada. A systematic review was conducted to identify and compare Canadian guidelines related to breakfast programs. Data sources included grey literature databases, customized search engines, targeted websites, and content expert consultations. Eligible guidelines met the following criteria: government and nongovernment sources at the federal and provincial/territorial levels, current version, and intended for program coordinators. Recommendations for program delivery were extracted, categorized, and mapped onto the 4 environments outlined in the ANGELO framework, and they were classified as "common" or "inconsistent" across guidelines. Fifteen sets of guidelines were included. No guidelines were available from federal or territorial governments and 4 provincial governments. There were few references to peer-reviewed literature within the guidelines and despite many common recommendations for program delivery, conflicting recommendations were also identified. Potential barriers to program participation, including a lack of consideration of allergies and other dietary restrictions, were identified. Future research should identify how guidelines are implemented and evaluate what effect their implementation has on program delivery and student outcomes.

Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

Science.gov (United States)

Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

2014-01-01

Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

Evaluating trauma nursing education: An integrative literature review.

Science.gov (United States)

Ding, Min; Metcalfe, Helene; Gallagher, Olivia; Hamdorf, Jeffrey M

2016-09-01

A review of the current literature evaluating trauma nursing education. A variety of trauma nursing courses exist, to educate nurses working in trauma settings, and to maintain their continuing professional development. Despite an increase in the number of courses delivered, there appears to be a lack of evidence to demonstrate the effectiveness of trauma nursing education and in particular the justification for this resource allocation. Integrative literature review. A search of international literature on trauma nursing education evaluation published in English from 1985 to 2015 was conducted through electronic databases CINAHL Plus, Google Scholar, PubMed, Austhealth, Science Citation Index Expanded (Web of Science), Sciverse Science Direct (Elsevier) & One file (Gale). Only peer reviewed journal articles identifying trauma course and trauma nursing course evaluation have been included in the selection criteria. An integrative review of both quantitative and qualitative literature guided by Whittemore and Knafl's theoretical framework using Bowling's and Pearson's validated appraisal checklists, has been conducted for three months. Only 17 studies met the inclusion criteria, including 14 on trauma course evaluation and 3 on trauma nursing course evaluation. Study findings are presented as two main themes: the historical evolution of trauma nursing education and evaluation of trauma nursing education outcomes. Trauma nursing remains in its infancy and education in this specialty is mainly led by continuing professional development courses. The shortage of evaluation studies on trauma nursing courses reflects the similar status in continuing professional development course evaluation. A trauma nursing course evaluation study will address the gap in this under researched area. Copyright © 2016 Elsevier Ltd. All rights reserved.

Self care programs and multiple sclerosis: physical therapeutics treatment - literature review.

Science.gov (United States)

Demaille-Wlodyka, S; Donze, C; Givron, P; Gallien, P

2011-03-01

To clarify the therapeutic education program impact with multiple sclerosis patients, literature review. Highlight contents and efficacy. A non-systematic review on Medline, PubMed and Cochrane library databases from 1966 to 2010 using the following keywords: "multiple sclerosis", "self-care", "self-management" and specific symptoms keywords. Clinical trials and randomized clinical trials, as well as literature reviews published in English, French and German will be analyzed. Counseling is a part of the non-pharmacological management of chronic illnesses such as multiple sclerosis. Symptoms' diversity and the different clinical forms limit standardized programs of self-care management, applicable to patients. In the literature review, counseling programs have often low metrology. A behavior change with patients and medical staff could exist. To empower the patient, to reduce symptoms' impact and to improve treatment access are the aims of educational therapy. Therapeutic education program for multiple sclerosis patients could progress with their standardization and assessment, for each sign. To promote the educational therapy of multiple sclerosis patients, a specific training for medical staff, as specific financing are necessary. 2011 Elsevier Masson SAS. All rights reserved.

Evaluation Program initiative

International Nuclear Information System (INIS)

Rich, B.L.

1987-01-01

The purpose of this paper is to provide the Department of Energy's (DOE) safeguards and security community with some insights on an important management initiative by the Office of Security Evaluations (OSE). The paper will present the ''what, where, who, when, and why'' of a new Evaluation Program. The Evaluation Program will be comprised of a continuing series of regular and special evaluations of DOE safeguards and security programs and policies. The evaluations will be integrative and ''crosscutting,'' i.e. will extend across DOE organizational lines. Evaluations will be offered as positive advisories to DOE managers with safeguards and security responsibilities and will not be rated. They will complement the ongoing OSE Inspection Program of inspections conducted by OSE's Inspection Division. The purpose for the evaluations is to establish an accurate and current assessment of the effectiveness and status of safeguards and security programs and policies and to provide DOE managers with required information on program and policy effectiveness

A Process and Outcome Evaluation of Police Working with Youth Programs

Directory of Open Access Journals (Sweden)

Stephen A. Anderson

2008-09-01

Full Text Available A process and outcome evaluation of 10 Police Working with Youth Programs was conducted. Process results indicated that the core components of the programs were consistent with those identified in previous literature as characteristic of quality youth development programs. Outcome results indicated that youth participants reported significantly improved attitudes toward police and social support received from significant, non-familial adults. Two subgroups of youth, most notably minority youth and younger participants in lower grade levels, reported positive changes in their capacity to resist peer pressures. Minority youth reported positive changes in their sense of mastery over stressful life situations. Relationships between core program components and youth outcomes also were examined. Implications of the findings and future process and outcome evaluations of youth programs are discussed.

Strategies and policies for improving energy efficiency programs: Closing the loop between evaluation and implementation

International Nuclear Information System (INIS)

Vine, Edward

2008-01-01

Program implementers often use evaluation results to improve the performance of their programs, but, as described in this paper, this is not always the case. Based on a review of the literature, participation in workshops, and interviews with over 50 program implementers, evaluators, and regulators in the United States and Canada, the utilization of evaluation results is investigated by asking the following questions: (1) How are program evaluation results used by program implementers and other stakeholders? (2) How are program evaluation results communicated to program implementers and other stakeholders? (3) Are the needs of program implementers being met by program evaluation? (4) What is the role of the utility regulator in facilitating the use of program evaluation results? (5) What other mechanisms can facilitate the use of program evaluation results? While there is some consensus on the answers to these questions, the type of interest in and use of evaluation varies by functional role (e.g., evaluator versus implementer), maturity of the energy efficiency market, institutional context (e.g., evaluation and implementation conducted inside the same organization, or evaluation and implementation conducted by separate entities), and by regulatory demands and evaluation interests

Automated Literature Searches for Longitudinal Tracking of Cancer Research Training Program Graduates.

Science.gov (United States)

Padilla, Luz A; Desmond, Renee A; Brooks, C Michael; Waterbor, John W

2018-06-01

A key outcome measure of cancer research training programs is the number of cancer-related peer-reviewed publications after training. Because program graduates do not routinely report their publications, staff must periodically conduct electronic literature searches on each graduate. The purpose of this study is to compare findings of an innovative computer-based automated search program versus repeated manual literature searches to identify post-training peer-reviewed publications. In late 2014, manual searches for publications by former R25 students identified 232 cancer-related articles published by 112 of 543 program graduates. In 2016, a research assistant was instructed in performing Scopus literature searches for comparison with individual PubMed searches on our 543 program graduates. Through 2014, Scopus found 304 cancer publications, 220 of that had been retrieved manually plus an additional 84 papers. However, Scopus missed 12 publications found manually. Together, both methods found 316 publications. The automated method found 96.2 % of the 316 publications while individual searches found only 73.4 %. An automated search method such as using the Scopus database is a key tool for conducting comprehensive literature searches, but it must be supplemented with periodic manual searches to find the initial publications of program graduates. A time-saving feature of Scopus is the periodic automatic alerts of new publications. Although a training period is needed and initial costs can be high, an automated search method is worthwhile due to its high sensitivity and efficiency in the long term.

Public programming in the archival literature: revelations from a ...

African Journals Online (AJOL)

Public programming in the archival literature: revelations from a content ... of archivists, outreach programmes, publicity, social media, and public relations. Information and communication technologies (ICTs) may play a greater role in public ...

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

Evaluation of a cross-sector community initiative partnership: delivering a local sport program.

Science.gov (United States)

Kihl, Lisa A; Tainsky, Scott; Babiak, Kathy; Bang, Hyejin

2014-06-01

Corporate community initiatives (CCI) are often established via cross-sector partnerships with nonprofit agencies to address critical social problems. While there is a growing body of literature exploring the effectiveness and social impact of these partnerships, there is a limited evaluative research on the implementation and execution processes of CCIs. In this paper, we examined the implementation and operational processes in the delivery of a professional sport organization's CCI initiative using program theory evaluation. The findings showed discrepancies between the associate organization and the implementers regarding understanding and fulfilling responsibilities with performing certain aspects (maintaining accurate records and program marketing) of the service delivery protocol. Despite program stakeholders being satisfied overall with the program delivery, contradictions between program stakeholders' satisfaction in the quality of program delivery was found in critical components (marketing and communications) of the service delivery. We conclude that ongoing evaluations are necessary to pinpoint the catalyst of the discrepancies along with all partners valuing process evaluation in addition to outcome evaluation. Copyright © 2014 Elsevier Ltd. All rights reserved.

Evaluation of Technology-Enhanced Learning Programs for Health Care Professionals: Systematic Review.

Science.gov (United States)

Nicoll, Pam; MacRury, Sandra; van Woerden, Hugo C; Smyth, Keith

2018-04-11

Technology-enhanced learning (TEL) programs are increasingly seen as the way in which education for health care professionals can be transformed, giving access to effective ongoing learning and training even where time or geographical barriers exist. Given the increasing emphasis on this mode of educational support for health care practitioners, it is vital that we can effectively evaluate and measure impact to ensure that TEL programs are effective and fit for purpose. This paper examines the current evidence base for the first time, in relation to the evaluation of TEL programs for health care professionals. We conducted a systematic review of the current literature relating to the evaluation of TEL programs for health care professionals and critically appraised the quality of the studies. This review employed specific search criteria to identify research studies that included evaluation of TEL for health care professionals. The databases searched included Medline Ovid, Cumulative Index of Nursing and Allied Health Literature Plus Advanced, Applied Social Sciences Index and Abstracts, ZETOC, Institute of Electrical and Electronics Engineers Explore Digital Library, Allied and Complementary Medicine, and Education Resources Information Center between January 2006 and January 2017. An additional hand search for relevant articles from reference lists was undertaken. Each of the studies identified was critically appraised for quality using the Crowe Critical Appraisal Tool. This approach produced a percentage total score for each study across specified categories. A proportion of the studies were independently assessed by an additional two reviewers. The review identified 21 studies that met the inclusion criteria. The studies included scored totals across eight categories within a range of 37%-95% and an average score of 68%. Studies that measured TEL using learner satisfaction surveys, or combined pretest and posttest knowledge score testing with learner

An intensive primary-literature-based teaching program directly benefits undergraduate science majors and facilitates their transition to doctoral programs.

Science.gov (United States)

Kozeracki, Carol A; Carey, Michael F; Colicelli, John; Levis-Fitzgerald, Marc; Grossel, Martha

2006-01-01

UCLA's Howard Hughes Undergraduate Research Program (HHURP), a collaboration between the College of Letters and Science and the School of Medicine, trains a group of highly motivated undergraduates through mentored research enhanced by a rigorous seminar course. The course is centered on the presentation and critical analysis of scientific journal articles as well as the students' own research. This article describes the components and objectives of the HHURP and discusses the results of three program assessments: annual student evaluations, interviews with UCLA professors who served as research advisors for HHURP scholars, and a survey of program alumni. Students indicate that the program increased their ability to read and present primary scientific research and to present their own research and enhanced their research experience at UCLA. After graduating, they find their involvement in the HHURP helped them in securing admission to the graduate program of their choice and provided them with an advantage over their peers in the interactive seminars that are the foundation of graduate education. On the basis of the assessment of the program from 1998-1999 to 2004-2005, we conclude that an intensive literature-based training program increases student confidence and scientific literacy during their undergraduate years and facilitates their transition to postgraduate study.

Educational Program Evaluation Model, From the Perspective of the New Theories

Directory of Open Access Journals (Sweden)

Soleiman Ahmady

2014-05-01

Full Text Available Introduction: This study is focused on common theories that influenced the history of program evaluation and introduce the educational program evaluation proposal format based on the updated theory. Methods: Literature searches were carried out in March-December 2010 with a combination of key words, MeSH terms and other free text terms as suitable for the purpose. A comprehensive search strategy was developed to search Medline by the PubMed interface, ERIC (Education Resources Information Center and the main journal of medical education regarding current evaluation models and theories. We included all study designs in our study. We found 810 articles related to our topic, and finally 63 with the full text article included. We compared documents and used expert consensus for selection the best model. Results: We found that the complexity theory using logic model suggests compatible evaluation proposal formats, especially with new medical education programs. Common components of a logic model are: situation, inputs, outputs, and outcomes that our proposal format is based on. Its contents are: title page, cover letter, situation and background, introduction and rationale, project description, evaluation design, evaluation methodology, reporting, program evaluation management, timeline, evaluation budget based on the best evidences, and supporting documents. Conclusion: We found that the logic model is used for evaluation program planning in many places, but more research is needed to see if it is suitable for our context.

Assessment of the quality of pharmacoeconomic evaluation literature in China.

Science.gov (United States)

Zhang, Fang; He, Xu; Xiang, Wei; Li, Shu Chuen

2017-05-01

To evaluate the quality of Chinese pharmacoeconomic-evaluation literature published between 2012-2014 retrieved from the Chinese National Knowledge Infrastructure (CNKI) in order to assess their adherence to recommendations of the Chinese Pharmacoeconomic Guidelines. Identified literature was screened according to pre-specified criteria to access legibility for inclusion. Each included piece of literature was systematically compared against the recommendations proposed by the relevant Chinese guidelines. After culling, 259 studies were included in the comparative analysis. When compared to a previous study evaluating the quality of similar literature published between 1997-2007, the results showed improvements in certain technical aspects over the years. Particularly, an improvement was observed in more diverse evaluation methods being used, increased use of cost-utility analysis (2.43% in 2012-2014 vs 0.26% in 1997-2007) and use of discounting (45% in 2012-2014 vs 4.35% in 1997- 2007). In addition, a small number of studies were starting to apply modeling. The quality of economic evaluation literature has improved in recent years, with more researchers realizing the importance and necessity of using discounting, sensitivity analysis, and modeling when conducting economic evaluation. This study also highlights certain important areas needing further attention when conducting economic evaluations in China. These include the ICER threshold of economic analysis, more detailed guidance in performing sensitivity analysis and modeling, as well as transferability of cost data across different regions. Overall, the results would support the positive contribution of the Chinese Economic Guideline in promoting economic evaluations in China.

Literature Review on Modeling Cyber Networks and Evaluating Cyber Risks.

Energy Technology Data Exchange (ETDEWEB)

Kelic, Andjelka; Campbell, Philip L

2018-04-01

The National Infrastructure Simulations and Analysis Center (NISAC) conducted a literature review on modeling cyber networks and evaluating cyber risks. The literature review explores where modeling is used in the cyber regime and ways that consequence and risk are evaluated. The relevant literature clusters in three different spaces: network security, cyber-physical, and mission assurance. In all approaches, some form of modeling is utilized at varying levels of detail, while the ability to understand consequence varies, as do interpretations of risk. This document summarizes the different literature viewpoints and explores their applicability to securing enterprise networks.

[Process and key points of clinical literature evaluation of post-marketing traditional Chinese medicine].

Science.gov (United States)

Liu, Huan; Xie, Yanming

2011-10-01

The clinical literature evaluation of the post-marketing traditional Chinese medicine is a comprehensive evaluation by the comprehensive gain, analysis of the drug, literature of drug efficacy, safety, economy, based on the literature evidence and is part of the evaluation of evidence-based medicine. The literature evaluation in the post-marketing Chinese medicine clinical evaluation is in the foundation and the key position. Through the literature evaluation, it can fully grasp the information, grasp listed drug variety of traditional Chinese medicines second development orientation, make clear further clinical indications, perfect the medicines, etc. This paper discusses the main steps and emphasis of the clinical literature evaluation. Emphasizing security literature evaluation should attach importance to the security of a comprehensive collection drug information. Safety assessment should notice traditional Chinese medicine validity evaluation in improving syndrome, improveing the living quality of patients with special advantage. The economics literature evaluation should pay attention to reliability, sensitivity and practicability of the conclusion.

Evaluation of Millstone Nuclear Power Plant, Environmental Impact prediction, based on monitoring programs

International Nuclear Information System (INIS)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1977-02-01

This report evaluates the nonradiological monitoring program at Millstone Nuclear Power Plant. Both operational as well as preoperational monitoring programs were analyzed to produce long-term (5 yr or longer) data sets, where possible. In order to determine the effectiveness of these monitoring programs, the appropriate data sets have to be analyzed by the appropriate statistical analysis. Thus, both open literature and current statistical analysis being developed at Pacific Northwest Laboratories (PNL) were employed in data analysis

Evaluation of Millstone Nuclear Power Plant, Environmental Impact prediction, based on monitoring programs

Energy Technology Data Exchange (ETDEWEB)

Gore, K.L.; Thomas, J.M.; Kannberg, L.D.; Watson, D.G.

1977-02-01

This report evaluates the nonradiological monitoring program at Millstone Nuclear Power Plant. Both operational as well as preoperational monitoring programs were analyzed to produce long-term (5 yr or longer) data sets, where possible. In order to determine the effectiveness of these monitoring programs, the appropriate data sets have to be analyzed by the appropriate statistical analysis. Thus, both open literature and current statistical analysis being developed at Pacific Northwest Laboratories (PNL) were employed in data analysis.

Youth Can! Grow Healthy: A Formative Evaluation of a Positive Youth Development Program

Directory of Open Access Journals (Sweden)

Andrew Carberry

2013-06-01

Full Text Available This paper presents a formative evaluation of an afterschool program that combined positive youth development and school garden curricula. Novel approaches were used to teach elementary school children about gardening and nutrition, and to engage them in advocacy for healthy community physical activity and nutrition environments. The youth development curriculum included sessions on team building, community pride, healthy eating, physical activity, and advocacy. Photovoice methods were used to allow participants to assess their community and communicate findings with community leaders. The school garden curriculum included nutrition and gardening lessons. Formative evaluation was conducted for each session. Themes of the evaluation were: successful methods for engaging youth, issues in the social environment, and implications for program management. Evaluation results are discussed in relationship to relevant youth development literature to provide recommendations that will strengthen future programs.

Usability evaluation of complex systems. A literature review

International Nuclear Information System (INIS)

Norros, L.; Savioja, P.

2004-04-01

In this literature study the task of usability evaluation is approached through recent publications and known practises. The scope of the reviewed literature and the overall problematic of evaluating complex systems are first defined. Then existing evaluation methods and tools and a set of design guidelines and standards is introduced. In there view the distinction between the evaluation of the design process and evaluation of the outcome of the design process is made. Also the existing criteria for usability is provided. These criteria can be used as measures in the evaluation procedures described in the previous chapter. Then, the problem of validity in the evaluation and validation procedures of complex cognitive systems is shortly discusses. The final chapter covers the conclusions of the literature review. There is a need for deepening the relationship between usage and design. Usage must be the driver also in the design of process technology, plant's safety, and instrumentation and control as well as that of the design of man-machine interface. The collaborative activity is called activity-oriented design. In order to enable activity-oriented design we need to create design methods that drive the design activity into this direction. Criteria for evaluating what is good design are not available in present standards. Criteria for good tools and practices must consider human in a favourable role in the various tasks of operating an industrial plant as opposed to the view of human as a source of error. This is the way to create an optimal system, which takes advantage of the unique capabilities of both the human operators and the automation systems. (orig.)

Monitoring and evaluation of mental health and psychosocial support programs in humanitarian settings: a scoping review of terminology and focus.

Science.gov (United States)

Augustinavicius, Jura L; Greene, M Claire; Lakin, Daniel P; Tol, Wietse A

2018-01-01

Monitoring and evaluation of mental health and psychosocial support (MHPSS) programs is critical to facilitating learning and providing accountability to stakeholders. As part of an inter-agency effort to develop recommendations on MHPSS monitoring and evaluation, this scoping review aimed to identify the terminology and focus of monitoring and evaluation frameworks in this field. We collected program documents (logical frameworks (logframes) and theories of change) from members of the Inter-Agency Standing Committee Reference Group on MHPSS, and systematically searched the peer-reviewed literature across five databases. We included program documents and academic articles that reported on monitoring and evaluation of MHPSS in low- and middle-income countries describing original data. Inclusion and data extraction were conducted in parallel by independent reviewers. Thematic analysis was used to identify common language in the description of practices and the focus of each monitoring and evaluation framework. Logframe outcomes were mapped to MHPSS activity categories. We identified 38 program documents and 89 peer-reviewed articles, describing monitoring and evaluation of a wide range of MHPSS activities. In both program documents and peer-reviewed literature there was a lack of specificity and overlap in language used for goals and outcomes. Well-validated, reliable instruments were reported in the academic literature, but rarely used in monitoring and evaluation practices. We identified six themes in the terminology used to describe goals and outcomes. Logframe outcomes were more commonly mapped to generic program implementation activities (e.g. "capacity building") and those related to family and community support, while outcomes from academic articles were most frequently mapped to specialized psychological treatments. Inconsistencies between the language used in research and practice and discrepancies in measurement have broader implications for monitoring and

Literature in Foreign Language Education Programs: A New Perspective

Directory of Open Access Journals (Sweden)

Ibrahim Abukhattala

2014-12-01

Full Text Available Many of the studies on the subject of literature as an essential part of the English  education programs in Arab universities  has concentrated on only professors’ views and attitudes to these courses. By contrast, the following article describes a qualitative investigation on how former students and presently in-service English teachers felt about studying English literature during their university years. Data were collected through semi-structured interviews with six English-major graduates who teach EFL at high and secondary schools in Misurata. Libya. The study has revealed that participants were not positive about literature courses as they maintain that these courses have contributed little to their language development and teaching careers. They have narrated several factors which limited benefiting from these courses. Some of these factors are the teaching and learning practices in the language classroom, the   difficulty and oddness of  vocabulary and structures of literature texts and the lack of skills in English. Based on the interviews, reflections and implications of these barriers are made.

Evaluation of an employment program for people with mental illness using the Supported Employment Fidelity Scale.

Science.gov (United States)

Cocks, Errol; Boaden, Ross

2009-10-01

The Individual Placement and Support (IPS) model aims to achieve open employment for people with mental illness. The Supported Employment Fidelity Scale (SEFS) is a 15-item instrument that evaluates the extent to which a service follows the IPS principles of best practice. This paper describes the IPS model and an evaluation of a specialist employment program for people with mental illness using the SEFS. The SEFS enabled a quantitative assessment of service provision against the criteria of evidence-based practice principles. Data were collected from multiple sources. In addition, a literature review was conducted, and personnel engaged in implementation of the IPS model at other Australian employment programs were consulted. The program achieved a score of 59 of a possible 75 on the SEFS, which is described as fair supported employment. Analysis of the 15-scale items resulted in the identification of strengths, areas for further development, and a set of recommendations. The program was operating substantially in line with evidence-based practice principles and had considerable scope for further development. Issues arising from the evaluation, areas of applicability of the SEFS and the underlying literature, and implications for occupational therapy are highlighted.

Visualizing context through theory deconstruction: a content analysis of three bodies of evaluation theory literature.

Science.gov (United States)

Vo, Anne T

2013-06-01

While the evaluation field collectively agrees that contextual factors bear on evaluation practice and related scholarly endeavors, the discipline does not yet have an explicit framework for understanding evaluation context. To address this gap in the knowledge base, this paper explores the ways in which evaluation context has been addressed in the practical-participatory, values-engaged, and emergent realist evaluation literatures. Five primary dimensions that constitute evaluation context were identified for this purpose: (1) stakeholder; (2) program; (3) organization; (4) historical/political; and (5) evaluator. Journal articles, book chapters, and conference papers rooted in the selected evaluation approaches were compared along these dimensions in order to explore points of convergence and divergence in the theories. Study results suggest that the selected prescriptive theories most clearly explicate stakeholder and evaluator contexts. Programmatic, organizational, and historical/political contexts, on the other hand, require further clarification. Copyright © 2012 Elsevier Ltd. All rights reserved.

Methods for evaluating educational programs: does Writing Center participation affect student achievement?

Science.gov (United States)

Bredtmann, Julia; Crede, Carsten J; Otten, Sebastian

2013-02-01

This paper evaluates the effectiveness of the introduction of a Writing Center at a university, which aims at improving students' scientific writing abilities. In order to deal with the presumed limited utility of student feedback surveys for evaluating the effectiveness of educational programs, we use students' actual learning outcomes as our quality measure. Based on this objective measure, different statistical evaluation methods established in the labor market treatment literature are applied. We present and discuss the validity of these methods to evaluate educational programs and compare the results of these approaches to implications obtained using corresponding student surveys. Although almost all students reported the writing courses to be helpful, we find no significant effect of course participation on students' grades. This result highlights the need for institutions not to rely solely on student course evaluations for evidence-based policy decisions. Copyright © 2012 Elsevier Ltd. All rights reserved.

THE ROLE OF SERVANT LEADERSHIP IN FACULTY DEVELOPMENT PROGRAMS: A Review of The Literature

Directory of Open Access Journals (Sweden)

Eric James RUSSELL

2012-01-01

Full Text Available The following note is that a review of existing literature pertaining to servant leadership and faculty development. Specifically, this work discussed delivering servant leadership to online faculty through the utilization of a faculty development program. The idea for this literature review stemmed from the author asking how an online academic administrator could utilize the practice of servant leadership in order to improve the overall online academic experience. The intent of the review involved discovering, through a review of the literature, a way of opening up a dialogue that can possibly drive future research studies regarding the practice of servant leadership to improve of the overall online academic teaching experience. In this work, the author conducted a literature review that identified strengths in both faculty development as well as practicing servant leadership within the online education modality. The literature identified the issue of faculty isolation as challenge for academic administrators and offered up faculty development as a possible solution to overcoming it. The findings of the work showed a benefit to bringing servant leadership practices into faculty development programs in order to improve the overall online teaching environment. The work generates future empirical research ideas regarding building community, the use of servant leadership, and faculty development programs.

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

An Analysis of Literature Searching Anxiety in Evidence-Based Medicine Education

Directory of Open Access Journals (Sweden)

Hui-Chin Chang

2014-01-01

Full Text Available Introduction. Evidence-Based Medicine (EBM is hurtling towards a cornerstone in lifelong learning for healthcare personnel worldwide. This study aims to evaluate the literature searching anxiety in graduate students in practicing EBM. Method The study participants were 48 graduate students who enrolled the EBM course at aMedical Universityin central Taiwan. Student’s t-test, Pearson correlation and multivariate regression, interviewing are used to evaluate the students’ literature searching anxiety of EBM course. The questionnaire is Literature Searching Anxiety Rating Scale -LSARS. Results The sources of anxiety are uncertainty of database selection, literatures evaluation and selection, technical assistance request, computer programs use, English and EBM education programs were disclosed. The class performance is negatively related to LSARS score, however, the correlation is statistically insignificant with the adjustment of gender, degree program, age category and experience of publication. Conclusion This study helps in understanding the causes and the extent of anxiety in order to work on a better teaching program planning to improve user’s searching skills and the capability of utilization the information; At the same time, provide friendly-user facilities of evidence searching. In short, we need to upgrade the learner’s searching 45 skills and reduce theanxiety. We also need to stress on the auxiliary teaching program for those with the prevalent and profoundanxiety during literature searching.

A review of the literature: evaluating dietary intake of Filipino Americans at risk for type 2 diabetes.

Science.gov (United States)

Brooks, Mirella Vasquez; Leake, Anne; Parsons, Charlotte; Pham, Valynn

2012-01-01

The purpose of this literature review is to investigate the research on the dietary intake of Filipino Americans. Evaluating the dietary practices of Filipino Americans may have an effect on the development of type 2 diabetes. Data collection was obtained, and four databases were included: Pub Medical, Cumulative Index of Nursing and Allied Health Literature, Journals at OVID, and Medline. The key words used in the search were "diet,"type 2 diabetes," and "Filipinos." A total of nine articles were relevant and met the inclusion criteria. The following articles were excluded: studies in a foreign language, letters to the editor, and program descriptions. © 2012 Wiley Periodicals, Inc.

Predonation psychosocial evaluation of living kidney and liver donor candidates: a systematic literature review.

Science.gov (United States)

Duerinckx, Nathalie; Timmerman, Lotte; Van Gogh, Johan; van Busschbach, Jan; Ismail, Sohal Y; Massey, Emma K; Dobbels, Fabienne

2014-01-01

Evaluating a person's suitability for living organ donation is crucial, consisting not only of a medical but also of a thorough psychosocial screening. We performed a systematic literature review of guidelines, consensus statements, and protocols on the content and process of psychosocial screening of living kidney and liver donor candidates. We searched PubMed, Embase, CINAHL, and PsycINFO until June 22, 2011, following the PRISMA guidelines, complemented by scrutinizing guidelines databases and references of identified publications. Thirty-four publications were identified, including seven guidelines, six consensus statements, and 21 protocols or programs. Guidelines and consensus statements were inconsistent and lacked concreteness for both their content and process, possibly explaining the observed variability in center-specific evaluation protocols and programs. Overall, recommended screening criteria are not evidence-based and an operational definition of the concept "psychosocial" is missing, causing heterogeneity in terminology. Variation also exists on methods used to psychosocially evaluate potential donors. The scientific basis of predonation psychosocial evaluation needs to be strengthened. There is a need for high-quality prospective psychosocial outcome studies in living donors, a uniform terminology to label psychosocial screening criteria, and validated instruments to identify risk factors. © 2013 Steunstichting ESOT. Published by John Wiley & Sons Ltd.

Comprehensive care programs for patients with multiple chronic conditions: a systematic literature review.

Science.gov (United States)

de Bruin, Simone R; Versnel, Nathalie; Lemmens, Lidwien C; Molema, Claudia C M; Schellevis, François G; Nijpels, Giel; Baan, Caroline A

2012-10-01

To provide insight into the characteristics of comprehensive care programs for patients with multiple chronic conditions and their impact on patients, informal caregivers, and professional caregivers. Systematic literature search in multiple electronic databases for English language papers published between January 1995 and January 2011, supplemented by reference tracking and a manual search on the internet. Wagner's chronic care model (CCM) was used to define comprehensive care. After inclusion, the methodological quality of each study was assessed. A best-evidence synthesis was applied to draw conclusions. Forty-two publications were selected describing thirty-three studies evaluating twenty-eight comprehensive care programs for multimorbid patients. Programs varied in the target patient groups, implementation settings, number of included interventions, and number of CCM components to which these interventions related. Moderate evidence was found for a beneficial effect of comprehensive care on inpatient healthcare utilization and healthcare costs, health behavior of patients, perceived quality of care, and satisfaction of patients and caregivers. Insufficient evidence was found for a beneficial effect of comprehensive care on health-related quality of life in terms of mental functioning, medication use, and outpatient healthcare utilization and healthcare costs. No evidence was found for a beneficial effect of comprehensive care on cognitive functioning, depressive symptoms, functional status, mortality, quality of life in terms of physical functioning, and caregiver burden. Because of the heterogeneity of comprehensive care programs, it is as yet too early to draw firm conclusions regarding their effectiveness. More rigorous evaluation studies are necessary to determine what constitutes best care for the increasing number of people with multiple chronic conditions. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Employing Popular Children's Literature to Teach Elementary School Chemistry: An Engaging Outreach Program

Science.gov (United States)

Wally, Laura M.; Levinger, Nancy E.; Grainger, David W.

2005-01-01

A chemistry outreach program to enthuse students of elementary school levels through employing popular children's literature Harry Potter is presented. The outreach activity performance found the students discovering new skills, learning more about science, and participating enthusiastically in the program without any added incentive from their…

An Implementation Research Approach to Evaluating Health Insurance Programs: Insights from India

Directory of Open Access Journals (Sweden)

Krishna D. Rao

2016-05-01

Full Text Available One of the distinguishing features of implementation research is the importance given to involve implementers in all aspects of research, and as users of research. We report on a recent implementation research effort in India, in which researchers worked together with program implementers from one of the longest serving government funded insurance schemes in India, the Rajiv Aarogyasri Scheme (RAS in the state of undivided Andhra Pradesh, that covers around 70 million people. This paper aims to both inform on the process of the collaborative research, as well as, how the nature of questions that emerged out of the collaborative exercise differed in scope from those typically asked of insurance program evaluations. Starting in 2012, and over the course of a year, staff from the Aarogyasri Health Care Trust (AHCT, and researchers held a series of meetings to identify research questions that could serve as a guide for an evaluation of the RAS. The research questions were derived from the application of a Logical Framework Approach (“log frame” to the RAS. The types of questions that emerged from this collaborative effort were compared with those seen in the published literature on evaluations of insurance programs in low- and middle-income countries (LMICs. In the published literature, 60% of the questions pertained to output/outcome of the program and the remaining 40%, relate to processes and inputs. In contrast, questions generated from the RAS participatory research process between implementers and researchers had a remarkably different distribution – 81% of questions looked at program input/processes, and 19% on outputs and outcomes. An implementation research approach can lead to a substantively different emphasis of research questions. While there are several challenges in collaborative research between implementers and researchers, an implementation research approach can lead to incorporating tacit knowledge of program implementers

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy.

Science.gov (United States)

Van der Wees, Philip J; Hendriks, Erik J M; Custers, Jan W H; Burgers, Jako S; Dekker, Joost; de Bie, Rob A

2007-11-23

Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF) produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. As a result of international developments and consensus, the described processes for developing clinical practice guidelines have much in common

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review.

Science.gov (United States)

Gotovac, Sandra; Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

2018-04-01

The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families.

Evaluating Training Programs for Primary Care Providers in Child/Adolescent Mental Health in Canada: A Systematic Review

Science.gov (United States)

Espinet, Stacey; Naqvi, Reza; Lingard, Lorelei; Steele, Margaret

2018-01-01

Introduction The need for child/adolescent mental health care in Canada is growing. Primary care can play a key role in filling this gap, yet most providers feel they do not have adequate training. This paper reviews the Canadian literature on capacity building programs in child and adolescent psychiatry for primary care providers, to examine how these programs are being implemented and evaluated to contribute to evidence-based initiatives. Methods A systematic literature review of peer-reviewed published articles of capacity building initiatives in child/adolescent mental health care for primary care practitioners that have been implemented in Canada. Results Sixteen articles were identified that met inclusion criteria. Analysis revealed that capacity building initiatives in Canada are varied but rigorous evaluation methodology is lacking. Primary care providers welcome efforts to increase mental health care capacity and were satisfied with the implementation of most programs. Discussion Objective conclusions regarding the effectiveness of these programs to increase mental health care capacity is challenging given the evaluation methodology of these studies. Conclusion Rigorous evaluation methods are needed to make evidence-based decisions on ways forward to be able to build child/adolescent mental health care capacity in primary care. Outcome measures need to move beyond self-report to more objective measures, and should expand the measurement of patient outcomes to ensure that these initiative are indeed leading to improved care for families. PMID:29662521

Evaluation in Moves: An Integrated Analysis of Chinese MA Thesis Literature Reviews

Science.gov (United States)

Xie, Jianping

2017-01-01

The ultimate communicative purpose of literature reviews is to convince the reader of the worthiness of the writer's research, which is realized stage by stage and evaluation plays an important role in achieving this end. However, concerns about evaluation demonstration in novice academic writers' literature reviews have been repeatedly voiced in…

The Role of Servant Leadership in Faculty Development Programs: A Review of the Literature

Science.gov (United States)

Russell, Eric James

2012-01-01

The following note is that a review of existing literature pertaining to servant leadership and faculty development. Specifically, this work discussed delivering servant leadership to online faculty through the utilization of a faculty development program. The idea for this literature review stemmed from the author asking how an online academic…

Debate as an alternative method for medical literature evaluation.

Science.gov (United States)

Toor, Rebecca; Samai, Kathryn; Wargo, Ryan

2017-05-01

To determine the student impression of utilizing a debate style journal club as an alternative approach for preceptors to teach medical literature evaluation skills to pharmacy students undergoing Advance Pharmacy Practice Experiences (APPE) in both acute care and ambulatory care. Students were asked to debate on a controversial topic or two drugs with similar indications. Each side had to research supporting evidence based medicine and use literature appraisal skills to incorporate the information logically into an oral debate style format. Approximately fifteen minutes were allotted for each debate, allowing five minutes for each opening argument, three minutes for each rebuttal, and two minutes for each closing argument. Students were then asked to complete a post-debate survey using a Likert Scale to evaluate their perception of the debate style journal club. Following implementation of the debate style journal club, students reported being more confident with their ability to find, compare, and retain information from primary literature with a mean of 4.1, 4.2, and 4.4 respectively on a Likert Scale. Students also reported overall enjoyment and satisfaction with a mean of 4.0. Debate style journal clubs have the capability to teach pharmacy students vital literature appraisal skills, and are a well-liked alternative to the traditional style journal club. Incorporating this method improved student interest as well as increased their ability to find, compare, and retain the information gathered from primary literature. Copyright © 2017 Elsevier Inc. All rights reserved.

Evaluation of Hose in Hose Transfer Line Service Life for Hanford's Interim Stabilization Program

International Nuclear Information System (INIS)

TORRES, T.D.

2000-01-01

RPP-6153, Engineering Task Plan for Hose-in-Hose Transfer System for the Interim Stabilization Program, defines the programmatic goals, functional requirements, and technical criteria for the development and subsequent installation of transfer line equipment to support Hanford's Interim Stabilization Program. RPP-6028, Specification for Hose in Hose Transfer Lines for Hanford's Interim Stabilization Program, has been issued to define the specific requirements for the design, manufacture, and verification of transfer line assemblies for specific waste transfer applications. Included in RPP-6028 are tables defining the chemical constituents of concern to which transfer lines will be exposed. Current Interim Stabilization Program planning forecasts that the at-grade transfer lines will be required to convey pumpable waste for as much as three years after commissioning. Prudent engineering dictates that the equipment placed in service have a working life in excess of this forecasted time period, with some margin to allow for future adjustments to the planned schedule. This document evaluates the effective service life of the Hose-in-Hose Transfer Lines, based on information submitted by the manufacturer and published literature. The effective service life of transfer line assemblies is a function of several factors. Foremost among these are process fluid characteristics, ambient environmental conditions, and the manufacturer's stated shelf life. This evaluation examines the manufacturer's certification of shelf life, the manufacturer's certifications of chemical compatibility with waste, and published literature on the effects of exposure to ionizing radiation on the mechanical properties of elastomeric materials to evaluate transfer line service life

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

Benefits of Campus Outdoor Recreation Programs: A Review of the Literature

Science.gov (United States)

Andre, Elizabeth K.; Williams, Nathan; Schwartz, Forrest; Bullard, Chris

2016-01-01

Campus outdoor recreation programs and facilities have faced a number of public attacks questioning their value for students. Climbing walls in particular have become, to some, emblematic of waste and financial excess in higher education. Despite these claims, this literature review uncovers numerous benefits for participants and schools provided…

Evaluating the Effects of Virtual Pair Programming on Students’ Achievement and Satisfaction

Directory of Open Access Journals (Sweden)

Nick Zacharis

2009-09-01

Full Text Available Pair programming is a lightweight software development technique in which two programmers work together at one computer. In literature, many benefits of pair programming have been proposed, such as increased productivity, improved code quality, enhanced job satisfaction and confidence. Although pair programming provides clear pedagogical benefits, its collocation requirement and the limited time during a lab session are serious barriers in the full deployment and evaluation of this programming technique. This paper reports on a study that investigated the effectiveness of Virtual Pair Programming (VPP on student performance and satisfaction in an introductory Java course where students worked collaboratively in pairs on homework programming assignments, using online tools that integrated desktop sharing and real time communication. The results of this study support previous research findings and suggest that VPP is an effective pedagogical tool for flexible collaboration and an acceptable alternative to individual/solo programming experience, regarding productivity, code quality, academic performance and student satisfaction.

Comparison of international guideline programs to evaluate and update the Dutch program for clinical guideline development in physical therapy

Directory of Open Access Journals (Sweden)

Burgers Jako S

2007-11-01

Full Text Available Abstract Background Clinical guidelines are considered important instruments to improve quality in health care. Since 1998 the Royal Dutch Society for Physical Therapy (KNGF produced evidence-based clinical guidelines, based on a standardized program. New developments in the field of guideline research raised the need to evaluate and update the KNGF guideline program. Purpose of this study is to compare different guideline development programs and review the KNGF guideline program for physical therapy in the Netherlands, in order to update the program. Method Six international guideline development programs were selected, and the 23 criteria of the AGREE Instrument were used to evaluate the guideline programs. Information about the programs was retrieved from published handbooks of the organizations. Also, the Dutch program for guideline development in physical therapy was evaluated using the AGREE criteria. Further comparison the six guideline programs was carried out using the following elements of the guideline development processes: Structure and organization; Preparation and initiation; Development; Validation; Dissemination and implementation; Evaluation and update. Results Compliance with the AGREE criteria of the guideline programs was high. Four programs addressed 22 AGREE criteria, and two programs addressed 20 AGREE criteria. The previous Dutch program for guideline development in physical therapy lacked in compliance with the AGREE criteria, meeting only 13 criteria. Further comparison showed that all guideline programs perform systematic literature searches to identify the available evidence. Recommendations are formulated and graded, based on evidence and other relevant factors. It is not clear how decisions in the development process are made. In particular, the process of translating evidence into practice recommendations can be improved. Conclusion As a result of international developments and consensus, the described processes

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Knowledge construction about port performance evaluation: An international literature analysis

Directory of Open Access Journals (Sweden)

Karine Somensi

2017-10-01

Full Text Available Purpose: This study aims at identifying and analyzing the characteristics of international scientific research that address the literature fragment referring to the Port Performance Evaluation to identify the existence of theoretical alignment of Performance Evaluation notion, as an area of knowledge, with practical area stage, the Port Performance Evaluation. Design/Methodology/Approach: The approach the problem, this paper makes use of qualitative research, since it analyzes the Bibliographical Portfolio characteristics related to the Performance Evaluation Port. The strategy adopted was action research where the authors through their analysis and interpretation made the selection of the  Bibliographical Portfolio. Findings: From the analyzed literature fragment it was possible to identify some misalignment between what has been pointed out in the literature regarding the management practices in the port sector. This discrepancy refers to the management practices that are ignored by port managers, which implies the loss of opportunities and may even come to jeopardize the organization's performance. Research limitations/implications: The literature search was restricted to articles written in the English language, published in indexed scientific journals in the selected databases (ii the restriction by the time limit of articles published after the year 2000; (iii the generation of knowledge based on the characteristics selected by the researchers and (iv the analysis of BP articles regarding the  by the judgment and interpretation of this research authors. It is suggested for future work the expanding this research to other databases, other languages, other features, and continuity of this investigation with the development of "systemic analysis' and 'identifying research opportunities' stages through ProKnow-C. Originality/value: Although two similar works have been developed in the same area of research in 2015, the results achieved have

The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research

Directory of Open Access Journals (Sweden)

Wiltsey Stirman Shannon

2012-03-01

sustainability or elements that influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity. Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves. Conclusions Clearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues such as fidelity, modification, and changes in implementation over time. While prospective and experimental designs are needed, there is also an important role for qualitative research in efforts to understand the phenomenon, refine hypotheses, and develop strategies to promote sustainment.

The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research

Science.gov (United States)

2012-01-01

influence sustainability. Approximately half employed quantitative methodologies, and the remainder employed qualitative or mixed methodologies. Few studies that investigated sustainability outcomes employed rigorous methods of evaluation (e.g., objective evaluation, judgement of implementation quality or fidelity). Among those that did, a small number reported full sustainment or high fidelity. Very little research has examined the extent, nature, or impact of adaptations to the interventions or programs once implemented. Influences on sustainability included organizational context, capacity, processes, and factors related to the new program or practice themselves. Conclusions Clearer definitions and research that is guided by the conceptual literature on sustainability are critical to the development of the research in the area. Further efforts to characterize the phenomenon and the factors that influence it will enhance the quality of future research. Careful consideration must also be given to interactions among influences at multiple levels, as well as issues such as fidelity, modification, and changes in implementation over time. While prospective and experimental designs are needed, there is also an important role for qualitative research in efforts to understand the phenomenon, refine hypotheses, and develop strategies to promote sustainment. PMID:22417162

Teaching Literature Written in English in Undergraduate Language Teacher Education Programs: A Dialogic-Pragmatic Approach

Directory of Open Access Journals (Sweden)

Orison Marden Bandeira de Melo Júnior

2015-04-01

Full Text Available This article aims to be part of the ongoing discussion on the teaching of literature written in English (LWE in literature classes in undergraduate language programs. In order to do that, it shows the challenges posed by the Letras DCN (National Curriculum Guidelines for the undergraduate Language Teacher Education programs as well as the reality literature teachers face due to the reduced number of hours of literature classes assigned in course curricula and to students' limited knowledge of English. Based on the dialogical concept of language and on the possibility of cooperation between scientific trends, we present a cooperative work between DDA (Dialogical Discourse Analysis and Pragmatics, showing how consonant and dissonant they are. Besides, we present part of the analysis of Alice Walker's short story Her Sweet Jerome done by students, which, in this context of teaching LWE to students with limited knowledge of English, pointed to the possibility of Pragmatics being the first step towards a dialogical analysis of literary texts.

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Metrics to assess injury prevention programs for young workers in high-risk occupations: a scoping review of the literature

Directory of Open Access Journals (Sweden)

Jennifer Smith

2018-05-01

Full Text Available Introduction: Despite legal protections for young workers in Canada, youth aged 15–24 are at high risk of traumatic occupational injury. While many injury prevention initiatives targeting young workers exist, the challenge faced by youth advocates and employers is deciding what aspect(s of prevention will be the most effective focus for their efforts. A review of the academic and grey literatures was undertaken to compile the metrics—both the indicators being evaluated and the methods of measurement—commonly used to assess injury prevention programs for young workers. Metrics are standards of measurement through which efficiency, performance, progress, or quality of a plan, process, or product can be assessed. Methods: A PICO framework was used to develop search terms. Medline, PubMed, OVID, EMBASE, CCOHS, PsychINFO, CINAHL, NIOSHTIC, Google Scholar and the grey literature were searched for articles in English, published between 1975-2015. Two independent reviewers screened the resulting list and categorized the metrics in three domains of injury prevention: Education, Environment and Enforcement. Results: Of 174 acquired articles meeting the inclusion criteria, 21 both described and assessed an intervention. Half were educational in nature (N=11. Commonly assessed metrics included: knowledge, perceptions, self-reported behaviours or intentions, hazardous exposures, injury claims, and injury counts. One study outlined a method for developing metrics to predict injury rates. Conclusion: Metrics specific to the evaluation of young worker injury prevention programs are needed, as current metrics are insufficient to predict reduced injuries following program implementation. One study, which the review brought to light, could be an appropriate model for future research to develop valid leading metrics specific to young workers, and then apply these metrics to injury prevention programs for youth.

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Medical Literature Evaluation Education at US Schools of Pharmacy.

Science.gov (United States)

O'Sullivan, Teresa A; Phillips, Jennifer; Demaris, Kendra

2016-02-25

To determine how medical literature evaluation (MLE) is being taught across the United States and to summarize methods for teaching and assessing MLE. An 18-question survey was administered to faculty members whose primary responsibility was teaching MLE at schools and colleges of pharmacy. Responses were received from 90 (71%) US schools of pharmacy. The most common method of integrating MLE into the curriculum was as a stand-alone course (49%). The most common placement was during the second professional year (43%) or integrated throughout the curriculum (25%). The majority (77%) of schools used a team-based approach. The use of active-learning strategies was common as was the use of multiple methods of evaluation. Responses varied regarding what role the course director played in incorporating MLE into advanced pharmacy practice experiences (APPEs). There is a trend toward incorporating MLE education components throughout the pre-APPE curriculum and placement of literature review/evaluation exercises into therapeutics practice skills laboratories to help students see how this skill integrates into other patient care skills. Several pre-APPE educational standards for MLE education exist, including journal club activities, a team-based approach to teaching and evaluation, and use of active-learning techniques.

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Preparing Teachers for Technology Integration: Programs, Competencies, and Factors from the Literature

Science.gov (United States)

Oliver, Kevin; Townsend, Latricia

2013-01-01

This article presents a review of recent literature about preparing teachers for technology integration. The review found six types of training programs are commonly implemented: pre-service training, long-term courses, short-term workshops and institutes, coaching/mentoring, learning communities, and product/assessment approaches. The review…

Curricular Space Allocated for Dance Content in Physical Education Teacher Education Programs: A Literature Review

Science.gov (United States)

Marquis, Jenée Marie; Metzler, Mike

2017-01-01

This literature review examines curricular space allocated to activity based/movement content courses in Physical Education Teacher Education (PETE) pre-service programs, specifically focusing on how dance content knowledge and pedagogical content knowledge are addressed within those programs. This review includes original empirical research…

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

A review of Grey and academic literature of evaluation guidance relevant to public health interventions.

Science.gov (United States)

Denford, Sarah; Abraham, Charles; Callaghan, Margaret; Aighton, Peter; De Vocht, Frank; Arris, Steven

2017-09-12

Public Health evaluation is essential to understanding what does and does not work, and robust demonstration of effectiveness may be crucial to securing future funding. Despite this, programs are often implemented with poor, incomplete or no evaluation. Public health practitioners are frequently required to provide evidence for the effectiveness of their services; thus, there is a growing need for evaluation guidance on how to evaluate public health programs. The aim of this study is to identify accessible high-quality, evaluation guidance, available to researchers and practitioners and to catalogue, summarise and categorise the content of a subset of accessible, quality guides to evaluation. We systematically reviewed grey and academic literature for documents providing support for evaluation of complex health interventions. Searches were conducted January to March 2015, and included academic databases, internet search engines, and consultations with academic and practicing public health experts. Data were extracted by two authors and sent to the authors of the guidance documents for comments. Our initial search identified 402 unique documents that were screened to identify those that were (1) developed by or for a national or international organization (2) freely available to all (3) published during or after 2000 (4) specific to public health. This yielded 98 documents from 43 organisations. Of these, 48 were reviewed in detail. This generated a detailed catalogue of quality evaluation guidance. The content included in documents covers 37 facets of evaluation. A wide range of guidance on evaluation of public health initiatives is available. Time and knowledge constraints may mean that busy practitioners find it challenging to access the most, up-to-date, relevant and useful guidance. This review presents links to and reviews of 48 quality guides to evaluation as well as categorising their content. This facilitates quick and each access to multiple selected

Instructional scaffolding to improve students' skills in evaluating clinical literature.

Science.gov (United States)

Dawn, Stefani; Dominguez, Karen D; Troutman, William G; Bond, Rucha; Cone, Catherine

2011-05-10

To implement and assess the effectiveness of an activity to teach pharmacy students to critically evaluate clinical literature using instructional scaffolding and a Clinical Trial Evaluation Rubric. The literature evaluation activity centered on a single clinical research article and involved individual, small group, and large group instruction, with carefully structured, evidence-based scaffolds and support materials centered around 3 educational themes: (1) the reader's awareness of text organization, (2) contextual/background information and vocabulary, and (3) questioning, prompting, and self-monitoring (metacognition). Students initially read the article, scored it using the rubric, and wrote an evaluation. Students then worked individually using a worksheet to identify and define 4 to 5 vocabulary/concept knowledge gaps. They then worked in small groups and as a class to further improve their skills. Finally, they assessed the same article using the rubric and writing a second evaluation. Students' rubric scores for the article decreased significantly from a mean pre-activity score of 76.7% to a post-activity score of 61.7%, indicating that their skills in identifying weaknesses in the article's study design had improved. Use of instructional scaffolding in the form of vocabulary supports and the Clinical Trial Evaluation Rubric improved students' ability to critically evaluate a clinical study compared to lecture-based coursework alone.

The Evaluation of World Literature Courses in Turkish Language Teaching Departments Based on Conceptual Field

Science.gov (United States)

Uysal, Basak

2016-01-01

In this study, World Literature course that are given in Turkish Language Teaching Departments of the universities in Turkey have been evaluated within the scope of "World Literature" that was used by Goethe in the 1820s and developed afterwards. With the purpose of conducting this evaluation, course contents of World Literature of…

Evaluation of Hose in Hose Transfer Line Service Life for Hanford's Interim Stabilization Program

Energy Technology Data Exchange (ETDEWEB)

TORRES, T.D.

2000-08-24

RPP-6153, Engineering Task Plan for Hose-in-Hose Transfer System for the Interim Stabilization Program, defines the programmatic goals, functional requirements, and technical criteria for the development and subsequent installation of transfer line equipment to support Hanford's Interim Stabilization Program. RPP-6028, Specification for Hose in Hose Transfer Lines for Hanford's Interim Stabilization Program, has been issued to define the specific requirements for the design, manufacture, and verification of transfer line assemblies for specific waste transfer applications. Included in RPP-6028 are tables defining the chemical constituents of concern to which transfer lines will be exposed. Current Interim Stabilization Program planning forecasts that the at-grade transfer lines will be required to convey pumpable waste for as much as three years after commissioning. Prudent engineering dictates that the equipment placed in service have a working life in excess of this forecasted time period, with some margin to allow for future adjustments to the planned schedule. This document evaluates the effective service life of the Hose-in-Hose Transfer Lines, based on information submitted by the manufacturer and published literature. The effective service life of transfer line assemblies is a function of several factors. Foremost among these are process fluid characteristics, ambient environmental conditions, and the manufacturer's stated shelf life. This evaluation examines the manufacturer's certification of shelf life, the manufacturer's certifications of chemical compatibility with waste, and published literature on the effects of exposure to ionizing radiation on the mechanical properties of elastomeric materials to evaluate transfer line service life.

A standardized motor imagery introduction program (MIIP) for neuro-rehabilitation: development and evaluation

OpenAIRE

Wondrusch, C.; Schuster-Amft, C.

2013-01-01

Background: For patients with central nervous system (CNS) lesions and sensorimotor impairments a solid motor imagery (MI) introduction is crucial to understand and use MI to improve motor performance. The study's aim was to develop and evaluate a standardized MI group introduction program (MIIP) for patients after stroke, multiple sclerosis (MS), Parkinson's disease (PD), and traumatic brain injury (TBI). Methods: Phase 1: Based on literature a MIIP was developed comprising MI theory (def...

A standardized motor imagery introduction program (MIIP) for neuro-rehabilitation: development and evaluation

OpenAIRE

Christine eWondrusch; Corina eSchuster; Corina eSchuster

2013-01-01

Background: For patients with central nervous system lesions and sensorimotor impairments a solid motor imagery (MI) introduction is crucial to understand and use MI to improve motor performance. The study’s aim was to develop and evaluate a standardized MI group introduction program (MIIP) for patients after stroke, multiple sclerosis, Parkinson’s disease, and traumatic brain injury. Methods:Phase 1: Based on literature a MIIP was developed comprising MI theory (definition, type, mode, persp...

Economic evaluation studies in nuclear medicine. A methodological review of the literature

International Nuclear Information System (INIS)

Gambhir, S.S.; Schwimmer, J.

2000-01-01

The growing need for evaluation of the utility of new nuclear medicine technologies has spawned a few economic studies ranging from preliminary indications of cost savings to complete decision analysis models incorporating costs and quality of life. The objective of the current study was to evaluate the methodological quality of economic analyses of nuclear medicine procedures which targeted cost-effectiveness or cost-utility issues published in the medical literature during the years 1985-1999. A computerized literature search was used to identify original investigations from the medical literature which included an economic analysis of a nuclear medicine procedure. Each economic analysis article was evaluated by two independent reviewers for adherence to ten accepted methodological criteria. Of the 29 articles meeting the search criteria, only six (21%) conformed to all ten methodological criteria. Published economic analyses of nuclear medicine procedures usually do not meet accepted methodological standards and could be significantly improved to achieve overall better quality relative to similar analyses in the literature from other medical fields. Continued improvement in the number and quality of economic studies is critically needed for the future competitiveness of nuclear medicine studies

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

76 FR 71045 - Center for Biologics Evaluation and Research Report of Scientific and Medical Literature and...

Science.gov (United States)

2011-11-16

...] Center for Biologics Evaluation and Research Report of Scientific and Medical Literature and Information... period for the notice on its report of scientific and medical literature and information concerning the... ``Center for Biologics Evaluation and Research Report of Scientific and Medical Literature and Information...

Human factors evaluation of teletherapy: Literature review. Volume 5

Energy Technology Data Exchange (ETDEWEB)

Henriksen, K.; Kaye, R.D.; Jones, R. [Hughes Training, Inc., Falls Church, VA (United States); Morisseau, D.S.; Serig, D.L. [Nuclear Regulatory Commission, Washington, DC (United States). Div. of Systems Technology

1995-07-01

A series of human factors evaluations were undertaken to better understand the contributing factors to human error in the teletherapy environment. Teletherapy is a multidisciplinary methodology for treating cancerous tissue through selective exposure to an external beam of ionizing radiation. A team of human factors specialists, assisted by a panel of radiation oncologists, medical physicists, and radiation therapists, conducted site visits to radiation oncology departments at community hospitals, university centers, and free-standing clinics. A function and task analysis was performed initially to guide subsequent evaluations in the areas of workplace environment, system-user interfaces, procedures, training, and organizational practices. To further acquire an in-depth and up-to-date understanding of the practice of teletherapy in support of these evaluations, a systematic literature review was conducted. Factors that have a potential impact on the accuracy of treatment delivery were of primary concern. The present volume is the literature review. The volume starts with an overview of the multiphased nature of teletherapy, and then examines the requirement for precision, the increasing role of quality assurance, current conceptualizations of human error, and the role of system factors such as the workplace environment, user-system interfaces, procedures, training, and organizational practices.

Human factors evaluation of teletherapy: Literature review. Volume 5

International Nuclear Information System (INIS)

Henriksen, K.; Kaye, R.D.; Jones, R.; Morisseau, D.S.; Serig, D.L.

1995-07-01

A series of human factors evaluations were undertaken to better understand the contributing factors to human error in the teletherapy environment. Teletherapy is a multidisciplinary methodology for treating cancerous tissue through selective exposure to an external beam of ionizing radiation. A team of human factors specialists, assisted by a panel of radiation oncologists, medical physicists, and radiation therapists, conducted site visits to radiation oncology departments at community hospitals, university centers, and free-standing clinics. A function and task analysis was performed initially to guide subsequent evaluations in the areas of workplace environment, system-user interfaces, procedures, training, and organizational practices. To further acquire an in-depth and up-to-date understanding of the practice of teletherapy in support of these evaluations, a systematic literature review was conducted. Factors that have a potential impact on the accuracy of treatment delivery were of primary concern. The present volume is the literature review. The volume starts with an overview of the multiphased nature of teletherapy, and then examines the requirement for precision, the increasing role of quality assurance, current conceptualizations of human error, and the role of system factors such as the workplace environment, user-system interfaces, procedures, training, and organizational practices

Evaluating efforts to diversify the biomedical workforce: the role and function of the Coordination and Evaluation Center of the Diversity Program Consortium.

Science.gov (United States)

McCreath, Heather E; Norris, Keith C; Calderόn, Nancy E; Purnell, Dawn L; Maccalla, Nicole M G; Seeman, Teresa E

2017-01-01

The National Institutes of Health (NIH)-funded Diversity Program Consortium (DPC) includes a Coordination and Evaluation Center (CEC) to conduct a longitudinal evaluation of the two signature, national NIH initiatives - the Building Infrastructure Leading to Diversity (BUILD) and the National Research Mentoring Network (NRMN) programs - designed to promote diversity in the NIH-funded biomedical, behavioral, clinical, and social sciences research workforce. Evaluation is central to understanding the impact of the consortium activities. This article reviews the role and function of the CEC and the collaborative processes and achievements critical to establishing empirical evidence regarding the efficacy of federally-funded, quasi-experimental interventions across multiple sites. The integrated DPC evaluation is particularly significant because it is a collaboratively developed Consortium Wide Evaluation Plan and the first hypothesis-driven, large-scale systemic national longitudinal evaluation of training programs in the history of NIH/National Institute of General Medical Sciences. To guide the longitudinal evaluation, the CEC-led literature review defined key indicators at critical training and career transition points - or Hallmarks of Success. The multidimensional, comprehensive evaluation of the impact of the DPC framed by these Hallmarks is described. This evaluation uses both established and newly developed common measures across sites, and rigorous quasi-experimental designs within novel multi-methods (qualitative and quantitative). The CEC also promotes shared learning among Consortium partners through working groups and provides technical assistance to support high-quality process and outcome evaluation internally of each program. Finally, the CEC is responsible for developing high-impact dissemination channels for best practices to inform peer institutions, NIH, and other key national and international stakeholders. A strong longitudinal evaluation across

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Evaluating clinical ethics support in mental healthcare: a systematic literature review.

NARCIS (Netherlands)

Hem, M.H.; Pedersen, R.; Norvoll, R.; Molewijk, A.C.

2015-01-01

A systematic literature review on evaluation of clinical ethics support services in mental healthcare is presented and discussed. The focus was on (a) forms of clinical ethics support services, (b) evaluation of clinical ethics support services, (c) contexts and participants and (d) results. Five

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

Implementing managed alcohol programs in hospital settings: A review of academic and grey literature.

Science.gov (United States)

Brooks, Hannah L; Kassam, Shehzad; Salvalaggio, Ginetta; Hyshka, Elaine

2018-04-01

People with severe alcohol use disorders are at increased risk of poor acute-care outcomes, in part due to difficulties maintaining abstinence from alcohol while hospitalised. Managed alcohol programs (MAP), which administer controlled doses of beverage alcohol to prevent withdrawal and stabilise drinking patterns, are one strategy for increasing adherence to treatment, and improving health outcomes for hospital inpatients with severe alcohol use disorders. Minimal research has examined the implementation of MAPs in hospital settings. We conducted a scoping review to describe extant literature on MAPs in community settings, as well as the therapeutic provision of alcohol to hospital inpatients, to assess the feasibility of implementing formal MAPs in hospital settings and identify knowledge gaps requiring further study. Four academic and 10 grey literature databases were searched. Evidence was synthesised using quantitative and qualitative approaches. Forty-two studies met review inclusion criteria. Twenty-eight examined the administration of alcohol to hospital inpatients, with most reporting positive outcomes related to prevention or treatment of alcohol withdrawal. Fourteen studies examined MAPs in the community and reported that they help stabilise drinking patterns, reduce alcohol-related harms and facilitate non-judgemental health and social care. MAPs in the community have been well described and research has documented effective provision of alcohol in hospital settings for addressing withdrawal. Implementing MAPs as a harm reduction approach in hospital settings is potentially feasible. However, there remains a need to build off extant literature and develop and evaluate standardised MAP protocols tailored to acute-care settings. © 2018 Australasian Professional Society on Alcohol and other Drugs.

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

PERFORMANCE EVALUATION: LITERATURE REVIEW AND TIME EVOLUTION.

Directory of Open Access Journals (Sweden)

Pintea Mirela-Oana

2012-07-01

Full Text Available Performance evaluation of an economic entity requires approaching several criteria, such as industry and economic entity type, managerial and entrepreneurial strategy, competitive environment, human and material resources available, using a system of appropriate performance indicators for this purpose.The exigencies of communication occurred on the growing number of phenomena that marked the global economy in recent decades (internationalization and relocation of business crises and turmoil in financial markets, demand performance measurement to be made in a comprehensive way by financial and non-financial criteria. Indicators are measures of performance used by management to measure, report and improve performance of the economic entity. The relationship between indicators and management is ensured by the existence of performance measurement systems. Studies to date indicate that economic entities using balanced performance measurement systems as a key management tool registered superior performance compared to entities not using such systems. This study attempts to address the issue of performance evaluation by presenting opinions of different authors concerning the process of performance measurement and to present, after revising the literature, the evolution of the performance evaluation systems. We tried to do this literature review because sustainable development and, therefore, globalization require new standards of performance that exceeds the economic field, both for domestic companies as well as international ones. So, these standards should be integrated into corporate strategy development to ensure sustainability of activities undertaken by harmonizing the economic, social and environmental objectives. To assess the performance of economic entities it is required that performance evaluation to be done with a balanced multidimensional system, including both financial ratios and non-financial indicators in order to reduce the limits of

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

Renaissance and Italian Literature in World Literature Program

Science.gov (United States)

Paolucci, Anne

1977-01-01

Shows how the giants of the Renaissance, from Dante to Shakespeare and Cervantes, can be taught so that they illustrate the dialectic of the cultural experience that produced them, and how the masterpieces of Italian literature can be used to suggest both national and universal qualities. (Editor/RK)

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Building leadership capacity to drive sustainable water management: the evaluation of a customised program.

Science.gov (United States)

Taylor, A C

2010-01-01

This paper describes a customised, six-month, leadership development program (LDP) that was designed for emerging leaders in the Australian water industry who were promoting sustainable urban water management (SUWM). It also presents results from an evaluation of the program's benefits, costs and overall 'return on investment' (ROI). The program was designed to help build emergent leadership capacity in the water industry, given strong evidence that this form of leadership plays an important role in advancing SUWM. It involved '360-degree feedback' processes, training, individual leadership development plans, and coaching sessions. Its design was informed by a review of the literature, and its content was informed by local empirical research involving effective SUWM leaders. The evaluation used a seven-tier assessment framework that examined different dimensions of the program's performance using source and methodological triangulation. The results indicate that such LDPs can produce a range of positive outcomes, such as promoting desired leadership behaviours and generating a positive ROI estimate. Specifically, the program's estimated ROI was approximately 190% after only one year. The primary conclusion is that evidence-based LDPs which are highly customised for specific types of leaders in the water industry represent a promising type of intervention to build forms of leadership capacity which are needed to successfully promote SUWM.

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

Program for the evaluation of TL-brick dating: 'ADAM-1-EVA'

International Nuclear Information System (INIS)

Novotna, V.; Kubelik, M.; Musilek, L.

2000-01-01

Although the evaluation of the TL-mean date has presented very little diversity since first published, the error evaluation has prompted a lot of discussion. Particularly the physical, chemical, statistical and mathematical differences as reflected in the specifics of the evaluation of the individual random and systematic errors in ceramic and brick dating are undervalued in literature. The construction of an automated TL-Reader (ADAM-1) at the Czech Technical University in Prague was taken as an opportunity to create a whole new software package for the evaluation ('EVA') of TL-dates. ADAM-1 is designed primarily for brick dating, using the fine-grain technique. The philosophy of data processing is similar to that applied by the Berlin group in their research of Venetian Villas. The program was developed using Delphi, as it is user-friendlier than pure Pascal, offers a strong graphic platform and allows flexibility in data management. This was important, as the program was conceived to either interact directly with ADAM-1, or to be operated independently for data evaluation and management. The software package consists of two discrete yet combinable components: one for the calculation of the TL mean date, using all raw data obtained from ADAM-1 and peripheral measurements; the other for the evaluation of systematic, random and context errors of individual samples and sample groups. All steps in the calculations are also graphically available, e.g. glow curves, plateau test, TL vs. dose dependence and charts summarising the results of all calculations for an individual sample and a given context. (author)

HEALTH PROMOTION PROGRAMS AT WORKERS AND THEIR INFLUENCES: A LITERATURE REVIEW

Directory of Open Access Journals (Sweden)

Paulo Sérgio Cardoso da Silva

2014-05-01

Full Text Available Objectives: Checking the studies on the Health Promotion Programs at Workers (HPPW, identifying their influences on organizations and on quality of life of workers, according to the literature. Methods: A systematic review in PUBMED and in Scientific Electronic Library Online, in Portuguese, English and Spanish languages, from January 2000 to January 2012, containing two search steps. At the first, was used as descriptors "Occupational Health and health promotion", resulting in 406 articles. In the second, were used as descriptors the intersection of keywords found in the previous step. After careful analysis and inclusion of articles suggested by experts in the field, 27 studies were selected. Results: 59.3% of the studies have been published 2008 until 2012, with 63% in Brazil. The designs most found were the literature reviews and the "HPPW" more recurring were campaigns/programs. In the workers were found, among other gains, a improving health and the quality of life, and in the organizations was verified the improvement at productivity and absenteeism. Few disadvantages were found. Conclusion: There was an increase in the number of publications on the subject, even though the “HPPW” are still presented on a segmented basis. Few studies have shown about disadvantages of the implementation of the PPSTs, suggesting a publication bias. However, further studies are recommended to addressing this subject.

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Material compatibility evaluation for DWPF nitric-glycolic acid-literature review

Energy Technology Data Exchange (ETDEWEB)

Mickalonis, J. [Savannah River Site (SRS), Aiken, SC (United States). Savannah River National Lab. (SRNL); Skidmore, E. [Savannah River Site (SRS), Aiken, SC (United States). Savannah River National Lab. (SRNL)

2013-06-01

Glycolic acid is being evaluated as an alternative for formic and nitric acid in the DWPF flowsheet. Demonstration testing and modeling for this new flowsheet has shown that glycolic acid and glycolate has a potential to remain in certain streams generated during the production of the nuclear waste glass. A literature review was conducted to assess the impact of glycolic acid on the corrosion of the materials of construction for the DWPF facility as well as facilities downstream which may have residual glycolic acid and glycolates present. The literature data was limited to solutions containing principally glycolic acid.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

[Development of a program theory as a basis for the evaluation of a dementia special care unit].

Science.gov (United States)

Adlbrecht, Laura; Bartholomeyczik, Sabine; Mayer, Hanna

2018-06-01

Background: An existing dementia special care unit should be evaluated. In order to build a sound foundation of the evaluation a deep theoretical understanding of the implemented intervention is needed, which has not been explicated yet. One possibility to achieve this is the development of a program theory. Aim: The aim is to present a method to develop a program theory for the existing living and care concept of the dementia special care unit, which is used in a larger project to evaluate the concept theory-drivenly. Method: The evaluation is embedded in the framework of van Belle et al. (2010) and an action model and a change model (Chen, 2015) is created. For the specification of the change model the contribution analysis (Mayne, 2011) is applied. Data were collected in workshops with the developers and the nurses of the dementia special care unit and a literature research concerning interventions and outcomes was carried out. The results were synthesized in a consens workshop. Results: The action model describes the interventions of the dementia special care unit, the implementers, the organization and the context. The change model compromises the mechanisms through which interventions achieve outcomes. Conclusions: The results of the program theory can be employed to choose data collection methods and instruments for the evaluation. On the basis of the results of the evaluation the program theory can be refined and adapted.

An Evaluation Study of an Executive Master of Business Administration (EMBA) Program in an Urban City: Examining the Transfer of Knowledge and Leadership Practices

Science.gov (United States)

Choi, Hye Lim

2011-01-01

This study examined the effectiveness of the Executive Master of Business Administration (EMBA) degree program in terms of transfer of knowledge and leadership practices. Based on a review of literature related to adult learning theories, EMBA programs, the importance of evaluation practices, and leadership practices, this study was designed to…

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Anger Management - Evaluation of a Cognitive-Behavioral Training Program for Table Tennis Players

Directory of Open Access Journals (Sweden)

Steffgen Georges

2017-01-01

Full Text Available Based on a systematic review of the literature on anger and anger management in sport, there is evidence that anger might be dysfunctional, especially in sports requiring selective attention and fine-tuned motor skills. The research literature suggests that cognitive-behavioral intervention programs can be fruitful in helping athletes to understand and control dysfunctional anger. Therefore, the main goal of the present study was to evaluate the effectiveness of a brief training program for table tennis players in cognitive-behavioral anger management that aimed at changing their noneffective anger reactions. The sample comprised 18 young competitive table tennis players (age range from 16 to 22 years divided randomly into a treatment (n = 10 and a control group (n = 8. A trained group leader instructed the treatment group. Six sessions were held over a period of two months. Cognitive-relaxation coping skills associated with social skills of subjects from the treatment group were compared to no-treatment controls. Psychological measurements (i.e., self-reports on anger were applied before, during and after treatment as well as in a follow-up session. The one-year follow-up session revealed that, in contrast to the control group, the treatment group showed a significant reduction in outwardly negative anger expression as well as anger reactions specific to table tennis. Despite limitations inherent in the research design, the training program was deemed effective.

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Facilitating student retention in online graduate nursing education programs: a review of the literature.

Science.gov (United States)

Gazza, Elizabeth A; Hunker, Diane F

2014-07-01

Online education, a form of distance education, provides students with opportunities to engage in lifelong learning without the restrictions of time and space. However, while this approach meets the needs of employed nursing professionals, it poses some challenges for educators. Student retention is one such challenge. Student retention rates serve as measures of program quality and are reported to accrediting bodies. Therefore, it is imperative that administrators and program faculty implement comprehensive programs to ensure student retention. This review of the literature was designed to identify strategies to improve student retention in online graduate nursing education programs. The review includes 23 articles that address models, research, and best practices supported in nursing and higher education. The findings indicate that student retention in online programs is a multidimensional problem requiring a multifaceted approach. Recommendations for facilitating retention in online nursing programs include ensuring social presence and program and course quality, and attentiveness to individual student characteristics. Copyright © 2014 Elsevier Ltd. All rights reserved.

Key ingredients for implementing intensive outpatient programs within patient-centered medical homes: A literature review and qualitative analysis.

Science.gov (United States)

Breland, Jessica Y; Asch, Steven M; Slightam, Cindie; Wong, Ava; Zulman, Donna M

2016-03-01

Intensive outpatient programs aim to transform care while conserving resources for high-need, high-cost patients, but little is known about factors that influence their implementation within patient-centered medical homes (PCMHs). In this mixed-methods study, we reviewed the literature to identify factors affecting intensive outpatient program implementation, then used semi-structured interviews to determine how these factors influenced the implementation of an intensive outpatient program within the Veterans Affairs' (VA) PCMH. Interviewees included facility leadership and clinical staff who were involved in a pilot Intensive Management Patient Aligned Care Team (ImPACT) intervention for high-need, high-cost VA PCMH patents. We classified implementation factors in the literature review and qualitative analysis using the Consolidated Framework for Implementation Research (CFIR). The literature review (n=9 studies) and analyses of interviews (n=15) revealed key implementation factors in three CFIR domains. First, the Inner Setting (i.e., the organizational and PCMH environment), mostly enabled implementation through a culture of innovation, good networks and communication, and positive tension for change. Second, Characteristics of Individuals, including creativity, flexibility, and interpersonal skills, allowed program staff to augment existing PCMH services. Finally, certain Intervention Characteristics (e.g., adaptability) enabled implementation, while others (e.g., complexity) generated implementation barriers. Resources and structural features common to PCMHs can facilitate implementation of intensive outpatient programs, but program success is also dependent on staff creativity and flexibility, and intervention adaptations to meet patient and organizational needs. Established PCMHs likely provide resources and environments that permit accelerated implementation of intensive outpatient programs. V. Published by Elsevier Inc.

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Using Case Studies to Promote Student Engagement in Primary Literature Data Analysis and Evaluation

Science.gov (United States)

Cook-Snyder, Denise R.

2017-01-01

Analyzing and evaluating primary literature data is a common learning objective in undergraduate neuroscience courses. However, students with more clinically focused career goals often dismiss the relevance of evaluating basic neuroscience literature. Here, we describe using case studies to promote student engagement in primary literature in a cellular and molecular neuroscience course. Two example literature-based case studies are provided: Untwisting Pretzel Syndrome, a neurodevelopment case exploring synapse formation in a pretzel syndrome patient, and The Trials of ALS, a neurodegeneration case exploring axon degeneration and repair in an amyotrophic lateral sclerosis patient. These cases were assigned after neurodevelopment and neurodegeneration lectures covering key concepts. Both cases begin by introducing the patient and hypothesizing symptoms and diagnoses, followed by scenes incorporating primary data to illustrate disease pathogenesis and treatments. Students complete questions embedded in these cases as homework, and class time is used to discuss their answers. Discussion emphasizes that there can be multiple “correct” answers, and the best answers are accurate and well-supported. Accordingly, students edit their answers in class, and these annotations are factored into a pass/fail grade on the case. Additional scenes and questions from the same case studies are used on the course’s take-home exams, thereby allowing students to practice primary data analysis and evaluation before a graded assignment. Student evaluations support literature-based case studies as an effective learning tool, with students identifying cases as the most valuable aspect of the course, and reporting increased confidence in understanding cellular and molecular neuroscience. PMID:29371850

Using Case Studies to Promote Student Engagement in Primary Literature Data Analysis and Evaluation.

Science.gov (United States)

Cook-Snyder, Denise R

2017-01-01

Analyzing and evaluating primary literature data is a common learning objective in undergraduate neuroscience courses. However, students with more clinically focused career goals often dismiss the relevance of evaluating basic neuroscience literature. Here, we describe using case studies to promote student engagement in primary literature in a cellular and molecular neuroscience course. Two example literature-based case studies are provided: Untwisting Pretzel Syndrome, a neurodevelopment case exploring synapse formation in a pretzel syndrome patient, and The Trials of ALS, a neurodegeneration case exploring axon degeneration and repair in an amyotrophic lateral sclerosis patient. These cases were assigned after neurodevelopment and neurodegeneration lectures covering key concepts. Both cases begin by introducing the patient and hypothesizing symptoms and diagnoses, followed by scenes incorporating primary data to illustrate disease pathogenesis and treatments. Students complete questions embedded in these cases as homework, and class time is used to discuss their answers. Discussion emphasizes that there can be multiple "correct" answers, and the best answers are accurate and well-supported. Accordingly, students edit their answers in class, and these annotations are factored into a pass/fail grade on the case. Additional scenes and questions from the same case studies are used on the course's take-home exams, thereby allowing students to practice primary data analysis and evaluation before a graded assignment. Student evaluations support literature-based case studies as an effective learning tool, with students identifying cases as the most valuable aspect of the course, and reporting increased confidence in understanding cellular and molecular neuroscience.

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Development of Foot Massage Program on Nausea and Vomiting for Cancer Patients: A Literature Review

Directory of Open Access Journals (Sweden)

Ni Ketut Guru Prapti

2012-08-01

Full Text Available Objective: This study aims to develop a foot massage program to support care activity in reducing nausea and vomiting for cancer patients undergoing chemotherapy. Two phases, a literature review and the development of a foot massage program were conducted. The literature review was to analyze state of the art massage techniques by reviewing problems, related theories and supporting evidence. Method: Eight published studies in the English language were reviewed. A massage can be performed for different durations, from 10 minutes up to 60 minutes for three to six weeks and can be applied on various body areas. We found that the soft stroke/effleurage seems to be the best method and is most suitable for patients with cancer. It is also evident that foot massaging can be applied as a modality to reduce nausea and vomiting for cancer patients undergoing chemotherapy. Result: We developed a foot massage program specifically for patients with cancer. The foot massage program comprised of three sessions, including 1 education session, 2 preparation session, and 3 foot massage session. In the education session, patients obtain brief information about the definition of a foot massage, the benefits and contraindication of foot massaging. During the preparation phase, foot soaking and warming up are performed. Subsequently, the foot massage is applied and should last for 30 minutes. Further research is recommended to test the effectiveness of the proposed foot massage program for nausea and vomiting in cancer patients across countries including Indonesia. Key Words: Foot massage program, chemotherapy, nausea and vomiting

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Health leadership education programs, best practices, and impact on learners' knowledge, skills, attitudes, and behaviors and system change: a literature review

Directory of Open Access Journals (Sweden)

Careau E

2014-05-01

Full Text Available Emmanuelle Careau,1 Gjin Biba,1 Rosemary Brander,2 Janice P Van Dijk,2 Sarita Verma,3 Margo Paterson,2 Maria Tassone31Center for Interdisciplinary Research in Rehabilitation and Social Integration, Université Laval, Québec, QC, 2Office of Interprofessional Education and Practice, Queen's University, Kingston, ON, 3Centre for Interprofessional Education, University of Toronto, Toronto, ON, CanadaBackground: A review of the literature was undertaken by the Canadian Interprofessional Health Leadership Collaborative to investigate the content and competencies of health education programs that teach collaborative leadership and to inform the development of an international collaborative leadership curriculum.Methods: A PubMed and Google Scholar search identified the frequency of key leadership education program terms and was adjusted for six major databases. From the 2,119 references, 250 were selected in a double-blinded manner. A descriptive statistical analysis was performed to determine the patterns, types, learners, models, and competencies addressed. Cross-tabulation and analysis of correlation identified best practices and impacts on learners' knowledge, skills, attitudes/behaviors, and on health system change.Results: Four types of leadership models were formally identified, ie, traditional leadership, transformational leadership, clinical leadership, and collaborative leadership. The most identified competencies were interprofessional communication, knowledge on how to work in teams and across disciplines, and financial knowledge. The least addressed topics were social accountability and community engagement. Only 6.8% of the articles reviewed assessed the effectiveness of their program based on patient-centered outcomes and 3.6% on system change.Conclusion: This literature review focused on 250 health leadership education programs reported in peer-reviewed journals to address important questions about the competencies, best practices

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

Material Compatibility Evaluation for DWPF Nitric-Glycolic Acid - Literature Review

Energy Technology Data Exchange (ETDEWEB)

Mickalonis, J. I. [Savannah River Site (SRS), Aiken, SC (United States). Savannah River National Lab. (SRNL); Skidmore, T. E. [Savannah River Site (SRS), Aiken, SC (United States). Savannah River National Lab. (SRNL)

2015-09-30

Glycolic acid is being evaluated as an alternative for formic and nitric acid in the DWPF flowsheet. Demonstration testing and modeling for this new flowsheet has shown that glycolic acid and glycolate has a potential to remain in certain streams generated during the production of the nuclear waste glass. A literature review was conducted to assess the impact of glycolic acid on the corrosion of the materials of construction for the DWPF facility as well as facilities downstream which may have residual glycolic acid and glycolates present. The literature data was limited to solutions containing principally glycolic acid. The reported corrosion rates and degradation characteristics have shown the following for the materials of construction.

76 FR 59407 - Center for Biologics Evaluation and Research Report of Scientific and Medical Literature and...

Science.gov (United States)

2011-09-26

...] Center for Biologics Evaluation and Research Report of Scientific and Medical Literature and Information... Administration (FDA) is announcing the availability of its report of scientific and medical literature and... Research Report of Scientific and Medical Literature and Information on Non-Standardized Allergenic...

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Sustainability performance evaluation: Literature review and future directions.

Science.gov (United States)

Büyüközkan, Gülçin; Karabulut, Yağmur

2018-07-01

Current global economic activities are increasingly being perceived as unsustainable. Despite the high number of publications, sustainability science remains highly dispersed over diverse approaches and topics. This article aims to provide a structured overview of sustainability performance evaluation related publications and to document the current state of literature, categorize publications, analyze and link trends, as well as highlight gaps and provide research recommendations. 128 articles between 2007 and 2018 are identified. The results suggest that sustainability performance evaluation models shall be more balanced, suitable criteria and their interrelations shall be well defined and subjectivity of qualitative criteria inherent to sustainability indicators shall be considered. To address this subjectivity, group decision-making techniques and other analytical methods that can deal with uncertainty, conflicting indicators, and linguistic evaluations can be used in future works. By presenting research gaps, this review stimulates researchers to establish practically applicable sustainability performance evaluation frameworks to help assess and compare the degree of sustainability, leading to more sustainable business practices. The review is unique in defining corporate sustainability performance evaluation for the first time, exploring the gap between sustainability accounting and sustainability assessment, and coming up with a structured overview of innovative research recommendations about integrating analytical assessment methods into conceptual sustainability frameworks. Copyright © 2018 Elsevier Ltd. All rights reserved.

Online and Paper Evaluations of Courses: A Literature Review and Case Study

Science.gov (United States)

Morrison, Keith

2013-01-01

This paper reviews the literature on comparing online and paper course evaluations in higher education and provides a case study of a very large randomised trial on the topic. It presents a mixed but generally optimistic picture of online course evaluations with respect to response rates, what they indicate, and how to increase them. The paper…

Rules of Thumb from the Literature on Research and Evaluation.

Science.gov (United States)

Lai, Morris K.

Practical advice on frequently asked questions dealing with research and evaluation methodology is presented as rules of thumb, with citations to the author's sources. A statement in the literature is considered a rule of thumb if it meets one of the following criteria: (1) it is specifically called a rule of thumb; (2) it contains numbers in…

Evaluating a Graduate Professional Development Program for Informal Science Educators

Science.gov (United States)

Lake, Jeremy Paul

This study is an examination and evaluation of the outcomes of a series of courses that I helped build to create a graduate certificate. Specifically, I wanted to evaluate whether or not the online iteration of the Informal Science Institutions Environmental Education Graduate Certificate Program truly provided the long term professional development needed to enhance the skills of the formal and informal educators participating so that they could contribute meaningfully to the improvement of science literacy in their respective communities. My role as an internal evaluator provided an extraordinary opportunity to know the intent of the learning opportunities and why they were constructed in a particular fashion. Through the combination of my skills, personal experiences both within the certificate's predecessor and as an educator, I was uniquely qualified to explore the outcomes of this program and evaluate its effectiveness in providing a long-term professional development for participants. After conducting a literature review that emphasized a need for greater scientific literacy in communities across America, it was evident that the formal education enterprise needs the support of informal educators working on the ground in myriad different settings in ways that provide science as both content and process, learning science facts and doing real science. Through a bridging of informal science educators with formal teachers, it was thought each could learn the culture of the other, making each more fluent in accessing community resources to help make these educators more collaborative and able to bridge the classroom with the outside world. This bridge promotes ongoing, lifelong learning, which in turn can help the national goal of greater scientific literacy. This study provided insight into the thinking involved in the learners' growth as they converted theory presented in course materials into practice. Through an iterative process of reviewing the course

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Measurement of participant experience and satisfaction of exercise programs for low back pain: a structured literature review.

Science.gov (United States)

Slade, Susan C; Keating, Jennifer L

2010-10-01

The objective of this review was to identify measuring instruments that might be suitable for assessment of satisfaction and experience of exercise programs designed to help people with persistent, recurrent low back pain. The review was designed as a structured literature review adapted from the Cochrane Collaboration Systematic Review and the Quality of Reporting of Meta-analyses and Preferred Reporting Items for Systematic Reviews and Meta-analyses Guidelines. A priori inclusion and exclusion criteria were established and electronic databases were searched without limits until February 2009. Data extraction guidelines were developed to extract the same information from each included article. Thematic analysis, conducted by two independent reviewers, was applied to identify emergent codes and themes from the questionnaires. The relevant questions were then evaluated for applicability to the back pain population. Ten potentially useful instruments were described in the 11 included articles. The following domains of experience were common to the included instruments: care-provider qualities, support staff, governance, access, and facilities. The answers to questions based on these themes may give valuable insights into the experience of exercise programs in general and for low back pain. Important information that would inform researchers and clinicians regarding the components of successful exercise programs may be gained from the development of an instrument that assesses experience of exercise program participation. Research into the experience of people who have participated in exercise programs may be a key to understanding their motivation, engagement, compliance or noncompliance and success or failure. Wiley Periodicals, Inc.

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

Some tendencies of the radioanalytical literature statistical games for trend evaluation. Pt. 1

International Nuclear Information System (INIS)

Braun, T.

1975-01-01

The distribution of the radioanalytical information sources was statistically evaluated by citation counting. Using some review and progress reports as object of the study, it seems that in the period 1956-1973 one witnesses a significant concentration of the radioanalytical information sources. Fundamental assumptions were that the information bank of each particular field is its published literature and that the most important and most characteristic information sources of a given field are surveyed in reviews and progress reports evaluating the published literature critically. The present study therefore analyses the references appended to some of such reviews and progress reports. The percentage distribution of the references of four reviews published between 1970 and 1975 was calculated with respects to their appearing in journals or nonjournals including books, conference proceedings, reports and patents. Statistic taken from 1.4 million references, which appeared in the 1961 literature, disclosed that 84% of these references are to journal articles. (F.Gy.)

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Cancer Control Programs in East Asia: Evidence From the International Literature

Directory of Open Access Journals (Sweden)

Malcolm A. Moore

2014-07-01

Full Text Available Cancer is a major cause of mortality and morbidity throughout the world, including the countries of North-East and South-East Asia. Assessment of burden through cancer registration, determination of risk and protective factors, early detection and screening, clinical practice, interventions for example in vaccination, tobacco cessation efforts and palliative care all should be included in comprehensive cancer control programs. The degree to which this is possible naturally depends on the resources available at local, national and international levels. The present review concerns elements of cancer control programs established in China, Taiwan, Korea, and Japan in North-East Asia, Viet Nam, Thailand, Malaysia, and Indonesia as representative larger countries of South-East Asia for comparison, using the published literature as a guide. While major advances have been made, there are still areas which need more attention, especially in South-East Asia, and international cooperation is essential if standard guidelines are to be generated to allow effective cancer control efforts throughout the Far East.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

Building capacity for water, sanitation, and hygiene programming: Training evaluation theory applied to CLTS management training in Kenya.

Science.gov (United States)

Crocker, Jonny; Shields, Katherine F; Venkataramanan, Vidya; Saywell, Darren; Bartram, Jamie

2016-10-01

Training and capacity building are long established critical components of global water, sanitation, and hygiene (WaSH) policies, strategies, and programs. Expanding capacity building support for WaSH in developing countries is one of the targets of the Sustainable Development Goals. There are many training evaluation methods and tools available. However, training evaluations in WaSH have been infrequent, have often not utilized these methods and tools, and have lacked rigor. We developed a conceptual framework for evaluating training in WaSH by reviewing and adapting concepts from literature. Our framework includes three target outcomes: learning, individual performance, and improved programming; and two sets of influences: trainee and context factors. We applied the framework to evaluate a seven-month community-led total sanitation (CLTS) management training program delivered to 42 government officials in Kenya from September 2013 to May 2014. Trainees were given a pre-training questionnaire and were interviewed at two weeks and seven months after initial training. We qualitatively analyzed the data using our conceptual framework. The training program resulted in trainees learning the CLTS process and new skills, and improving their individual performance through application of advocacy, partnership, and supervision soft skills. The link from trainees' performance to improved programming was constrained by resource limitations and pre-existing rigidity of trainees' organizations. Training-over-time enhanced outcomes and enabled trainees to overcome constraints in their work. Training in soft skills is relevant to managing public health programs beyond WaSH. We make recommendations on how training programs can be targeted and adapted to improve outcomes. Our conceptual framework can be used as a tool both for planning and evaluating training programs in WaSH. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Teacher's Approaches in Teaching Literature: Observations of ESL Classroom

Science.gov (United States)

Mustakim, Siti Salina; Mustapha, Ramlee; Lebar, Othman

2014-01-01

This study aimed to identify the approaches employed by teachers in teaching Contemporary Children's Literature Program to upper primary school. Using classroom observations and interview as research instruments, this paper evaluates the approaches of five ESL teachers teaching Year 5 students and examines the various challenges faced by them in…

Children Literature Based Program for Developing EFL Primary Pupils' Life Skills and Language Learning Strategies

Science.gov (United States)

Abdelhalim, Safaa M.

2015-01-01

This study examines the effectiveness of a proposed English language program based on integrating two forms of children literature, mainly short stories and songs, in developing the needed life skills and language learning strategies of primary school students. Besides, it emphasized the importance of providing EFL fifth year primary students with…

Program Officer, Monitoring and Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

S/he manages a quality assessment process for evaluation reports and track ... and budget information in order to contribute to an effective internal control of project ... documentary and literature reviews, and statistical and content analyses to ...

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Plenty of activity but little outcome data: a review of the "grey literature" on primary care anxiety and depression programs in Australia.

Science.gov (United States)

Christensen, Helen; Griffiths, Kathleen M; Gulliver, Amelia

2008-06-16

To identify reports in the "grey literature" of programs conducted in Australian primary care to improve depression and anxiety outcomes, and to examine these reports for evidence of effectiveness. A systematic search was undertaken for grey literature reports using primary health care research databases, community and professional websites, clearinghouse sources, government reports, and reports from the Australian General Practice Network. Reports were included if they related to programs targeting depression or anxiety, contained qualitative or quantitative effectiveness data, and were published during 1995-2006. In total, 642 reports were identified, of which 43 met inclusion criteria. Of the 43 programs described, 30 were delivered in general practice, five in the community or residential care, three in schools, and five were Internet or computer based. Nine programs were also reported in the formal "black" literature, but most, including the Better Outcomes in Mental Health Care initiative, were not. Limited data on effectiveness or patient outcomes were available in the grey literature. There is currently no single service that identifies, describes and catalogues the range and effectiveness of mental health initiatives in Australia. There may be a role for a mental health information "clearinghouse" to facilitate dissemination and education, and to promote collaboration among researchers, practitioners, consumers and policymakers. Innovative schemes to disseminate evidence-based models and to encourage the collection of data on patient outcomes in such programs are needed.

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Research on Evaluation Use: A Review of the Empirical Literature from 1986 to 2005

Science.gov (United States)

Johnson, Kelli; Greenseid, Lija O.; Toal, Stacie A.; King, Jean A.; Lawrenz, Frances; Volkov, Boris

2009-01-01

This paper reviews empirical research on the use of evaluation from 1986 to 2005 using Cousins and Leithwood's 1986 framework for categorizing empirical studies of evaluation use conducted since that time. The literature review located 41 empirical studies of evaluation use conducted between 1986 and 2005 that met minimum quality standards. The…

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

Reconsidering the Hypothetical Adolescent in Evaluating and Teaching Young Adult Literature

Science.gov (United States)

Sulzer, Mark A.; Thein, Amanda Haertling

2016-01-01

Courses on teaching young adult literature (YAL) often encourage preservice English language arts teachers to consider their future students as they evaluate texts for classroom use. In this study, Sulzer and Thein analyzed preservice teachers' responses to familiar questions used to frame discussions of YAL--questions that ask them to read on…

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

International experiences in nursing education: a review of the literature.

Science.gov (United States)

Kulbok, Pamela A; Mitchell, Emma M; Glick, Doris F; Greiner, Doris

2012-04-24

Service learning and study abroad opportunities have become increasingly popular in nursing education in the past decade. The purpose of this systematic review was to explore existing literature concerning global health experiences in nursing education. Twenty-three empirical articles from 2003 to 2010 were reviewed, building upon existing reviews of international nursing education literature. Research on two-way exchange experiences and models for best practice were found to be lacking. While an array of countries were represented as the visiting or hosting side of the experience, few co-authors from host countries were found, particularly in literature originating from the U.S. The authors recommend that two-way exchange programs be evaluated to identify successful strategies and barriers to success. Ongoing evaluation of exchanges is necessary to ensure continued sustainable partnership and exchange in immersion experiences for nursing students.

Systematic literature reviews and meta-analyses: part 6 of a series on evaluation of scientific publications.

Science.gov (United States)

Ressing, Meike; Blettner, Maria; Klug, Stefanie J

2009-07-01

Because of the rising number of scientific publications, it is important to have a means of jointly summarizing and assessing different studies on a single topic. Systematic literature reviews, meta-analyses of published data, and meta-analyses of individual data (pooled reanalyses) are now being published with increasing frequency. We here describe the essential features of these methods and discuss their strengths and weaknesses. This article is based on a selective literature search. The different types of review and meta-analysis are described, the methods used in each are outlined so that they can be evaluated, and a checklist is given for the assessment of reviews and meta-analyses of scientific articles. Systematic literature reviews provide an overview of the state of research on a given topic and enable an assessment of the quality of individual studies. They also allow the results of different studies to be evaluated together when these are inconsistent. Meta-analyses additionally allow calculation of pooled estimates of an effect. The different types of review and meta-analysis are discussed with examples from the literature on one particular topic. Systematic literature reviews and meta-analyses enable the research findings and treatment effects obtained in different individual studies to be summed up and evaluated.

Wetlands Research Program. Wetland Evaluation Technique (WET). Volume 1. Literature Review and Evaluation Rationale.

Science.gov (United States)

1991-10-01

activities (Shahane 1982). Models for quan- tifying the transport of nutrients to water bodies are widely available (see review by Westerdahl et al... Westerdahl , H. E., W. B. Ford III, J. Harris, Weller, M. W. 1979. Density and habitat and C. R. Lee. 1981. Evaluation of tech- relationship of blue

The health economic impact of disease management programs for COPD: a systematic literature review and meta-analysis.

Science.gov (United States)

Boland, Melinde R S; Tsiachristas, Apostolos; Kruis, Annemarije L; Chavannes, Niels H; Rutten-van Mölken, Maureen P M H

2013-07-03

There is insufficient evidence of the cost-effectiveness of Chronic Obstructive Pulmonary Disease (COPD) Disease Management (COPD-DM) programs. The aim of this review is to evaluate the economic impact of COPD-DM programs and investigate the relation between the impact on healthcare costs and health outcomes. We also investigated the impact of patient-, intervention, and study-characteristics. We conducted a systematic literature review to identify cost-effectiveness studies of COPD-DM. Where feasible, results were pooled using random-effects meta-analysis and explorative subgroup analyses were performed. Sixteen papers describing 11 studies were included (7 randomized control trials (RCT), 2 pre-post, 2 case-control). Meta-analysis showed that COPD-DM led to hospitalization savings of €1060 (95% CI: €2040 to €80) per patient per year and savings in total healthcare utilization of €898 (95% CI: €1566 to €231) (excl. operating costs). In these health economic studies small but positive results on health outcomes were found, such as the St Georges Respiratory Questionnaire (SGRQ) score, which decreased with 1.7 points (95% CI: 0.5-2.9). There was great variability in DM interventions-, study- and patient-characteristics. There were indications that DM showed greater savings in studies with: severe COPD patients, patients with a history of exacerbations, RCT study design, high methodological quality, few different professions involved in the program, and study setting outside Europe. COPD-DM programs were found to have favourable effects on both health outcomes and costs, but there is considerable heterogeneity depending on patient-, intervention-, and study-characteristics.

Exploring Poetry through Interactive Computer Programs.

Science.gov (United States)

Nimchinsky, Howard; Camp, Jocelyn

The goal of a project was to design, test, and evaluate several computer programs that allow students in introductory literature and poetry courses to explore a poem in detail and, through a dialogue with the program, to develop their own interpretation of it. Computer programs were completed on poems by Robert Frost and W.H. Auden. Both programs…

Development of a numerical simulation method for melting/solidification and dissolution/precipitation phenomena. 1. Literature survey for computer program design

International Nuclear Information System (INIS)

Uchibori, Akihiro; Ohshima, Hiroyuki

2004-04-01

Survey research of numerical methods for melting/solidification and dissolution/precipitation phenomena was performed to determine the policy for a simulation program development. Melting/solidification and dissolution/ precipitation have been key issues for feasibility evaluation of several techniques applied in the nuclear fuel cycle processes. Physical models for single-component melting/solidification, two-component solution solidification or precipitation by cooling and precipitation by electrolysis, which are moving boundary problems, were made clear from the literature survey. The transport equations are used for thermal hydraulic analysis in the solid and the liquid regions. Behavior of the solid-liquid interface is described by the heat and mass transfer model. These physical models need to be introduced into the simulation program. The numerical methods for the moving boundary problems are categorized into two types: interface tracking method and interface capturing method. Based on the classification, performance of each numerical method was evaluated. The interface tracking method using the Lagrangian moving mesh requires relatively complicated algorithm. The algorithm has high accuracy for predicting the moving interface. On the other hand, the interface capturing method uses the Eulerian fixing mesh, leading to simple algorithm. Prediction accuracy of the method is relatively low. The extended finite element method classified as the interface capturing method can predict the interface behavior accurately even though the Eulerian fixing mesh is used. We decided to apply the extended finite element method to the simulation program. (author)

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

Evaluation of an Evidence-Based Tobacco Treatment Curriculum for Psychiatry Residency Training Programs

Science.gov (United States)

Prochaska, Judith J.; Fromont, Sebastien C.; Leek, Desiree; Hudmon, Karen Suchanek; Louie, Alan K.; Jacobs, Marc H.; Hall, Sharon M.

2009-01-01

Objective Smokers with mental illness and addictive disorders account for nearly one in two cigarettes sold in the United States and are at high risk for smoking-related deaths and disability. Psychiatry residency programs provide a unique arena for disseminating tobacco treatment guidelines, influencing professional norms, and increasing access to tobacco cessation services among smokers with mental illness. The current study evaluated the Rx for Change in Psychiatry curriculum, developed for psychiatry residency programs and focused on identifying and treating tobacco dependence among individuals with mental illness. Methods The 4-hour curriculum emphasized evidence-based, patient-oriented cessation treatments relevant for all tobacco users, including those not yet ready to quit. The curriculum was informed by comprehensive literature review, consultation with an expert advisory group, faculty interviews, and a focus group with psychiatry residents. This study reports on evaluation of the curriculum in 2005–2006, using a quasi-experimental design, with 55 residents in three psychiatry residency training programs in Northern California. Results The curriculum was associated with improvements in psychiatry residents’ knowledge, attitudes, confidence, and counseling behaviors for treating tobacco use among their patients, with initial changes from pre- to posttraining sustained at 3-months’ follow-up. Residents’ self-reported changes in treating patients’ tobacco use were substantiated through systematic chart review. Conclusion The evidence-based Rx for Change in Psychiatry curriculum is offered as a model tobacco treatment curriculum that can be implemented in psychiatry residency training programs and disseminated widely, thereby effectively reaching a vulnerable and costly population of smokers. PMID:19190293

Alternate ways for automation of evaluating nuclear physical data reliability from primary literature

International Nuclear Information System (INIS)

Golashvili, T.V.; Tsvetaev, S.M.

1983-01-01

Methods, possible ways, criteria and algorithms for organizing an automated system for evaluating nuclear physical data reliability from primary literature are discussed. It is noted that automation of data reliability evaluation does not substitute for a scientist dealing with data evaluation. It only releases him from hard, monotonous and tedious work not requiring erudition or profound knowledge. Computers will facilitate and accelerate the work of the expert and, hence, leat to a sharp increase of a bulk of works on evaluation of data reliability

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

Promises to keep. An evaluator's perspective on employee assistance programs.

Science.gov (United States)

Albert, W C; Smythe, P C; Brook, R C

1985-01-01

This paper presents a critical review of the rapidly expanding literature concerning employee assistance programs (EAPs). Several essential features of EAPs are identified and the assumptions underlying these components are examined. The latter section of this report offers some tentative suggestions for correcting this situation so that the EAP movement will no longer suffer from the lack of a firm database upon which to build more coherent and defensible theories and programs.

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

Working Together To Become Proficient Readers. Early Impact of the Talent Development Middle School's Student Team Literature Program. Report No. 15.

Science.gov (United States)

Mac Iver, Douglas J.; Plank, Stephen B.; Balfanz, Robert

The Talent Development Model of Middle School Reform includes a "Student Team Literature" (STL) program that relies on: (1) curricular materials designed to assist students to study great literature; (2) recommended instructional practices, peer assistance processes, and assessments; and (3) staff development, mentoring, and advising to…

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.

2000-01-01

The action program Energy 2000 has been continually reviewed by independent experts in view of its effects. This resulted in around 50 scientific studies between 1991 and 1999, dealing with different aspects of the program. In the book 'Energy 2000: effects of the program and conclusions from its evaluation', the results of these evaluations are summarised, and conclusions for the design of the follow-up program are drawn. The organisational frame of the program is presented and the question answered whether the determining principles of the program proved practical. Besides, the effects of state intervention, of the conflict solving groups and the voluntary actions of Energy 2000 are appraised. A separate chapter is dedicated to the evaluation strategy of the program, its implementation and the benefits of the evaluations. Propositions for the evaluation of the follow-up program are formulated as well. Dr. Andreas Balthasar is President of the Swiss Evaluation Society. (author)

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

Public health program capacity for sustainability: a new framework.

Science.gov (United States)

Schell, Sarah F; Luke, Douglas A; Schooley, Michael W; Elliott, Michael B; Herbers, Stephanie H; Mueller, Nancy B; Bunger, Alicia C

2013-02-01

Public health programs can only deliver benefits if they are able to sustain activities over time. There is a broad literature on program sustainability in public health, but it is fragmented and there is a lack of consensus on core constructs. The purpose of this paper is to present a new conceptual framework for program sustainability in public health. This developmental study uses a comprehensive literature review, input from an expert panel, and the results of concept-mapping to identify the core domains of a conceptual framework for public health program capacity for sustainability. The concept-mapping process included three types of participants (scientists, funders, and practitioners) from several public health areas (e.g., tobacco control, heart disease and stroke, physical activity and nutrition, and injury prevention). The literature review identified 85 relevant studies focusing on program sustainability in public health. Most of the papers described empirical studies of prevention-oriented programs aimed at the community level. The concept-mapping process identified nine core domains that affect a program's capacity for sustainability: Political Support, Funding Stability, Partnerships, Organizational Capacity, Program Evaluation, Program Adaptation, Communications, Public Health Impacts, and Strategic Planning. Concept-mapping participants further identified 93 items across these domains that have strong face validity-89% of the individual items composing the framework had specific support in the sustainability literature. The sustainability framework presented here suggests that a number of selected factors may be related to a program's ability to sustain its activities and benefits over time. These factors have been discussed in the literature, but this framework synthesizes and combines the factors and suggests how they may be interrelated with one another. The framework presents domains for public health decision makers to consider when developing

Pilot evaluation of a group therapy program for children bereaved by suicide.

Science.gov (United States)

Daigle, Marc S; Labelle, Réal J

2012-01-01

Thousands of children are bereaved each year by suicide, yet there exists very little literature specifically on the psychological care, programs, and interventions available to help them. (1) To build and validate theoretical models for the Group Therapy Program for Children Bereaved by Suicide (PCBS); (2) to test these models in a preliminary evaluation. In the first part, we built theoretical models, which were then validated by scientists and clinicians. In the second part, the sessions of the PCBS were observed and rated. The participating children were tested pre- and postprogram. Positive changes were observed in the participating children in terms of basic safety, realistic understanding and useful knowledge, inappropriate behaviors, physical and psychological symptoms, child-parent and child-child communication, capacity for social and affective reinvestment, actualization of new models of self and the world, self-esteem, awareness and use of tools, cognitive, verbal, written and drawing abilities, cognitive dissonance, ambivalence, antagonism, and isolation. The changes reported in the bereaved children show that the PCBS has some efficacy.

A scoping review of the literature on benefits and challenges of participating in patient education programs aimed at promoting self-management for people living with chronic illness.

Science.gov (United States)

Stenberg, Una; Haaland-Øverby, Mette; Fredriksen, Kari; Westermann, Karl Fredrik; Kvisvik, Toril

2016-11-01

To give a comprehensive overview of benefits and challenges from participating in group based patient education programs that are carried out by health care professionals and lay participants, aimed at promoting self-management for people living with chronic illness. We searched 8 literature databases. Full text articles meeting the inclusion criteria were retrieved and reviewed. Arksey and O'Malley's framework for scoping studies guided the review process and thematic analysis was undertaken to synthesize extracted data. Of the 5935 titles identified, 47 articles were included in this review. The participants experienced the programs as beneficial according to less symptom distress and greater awareness of their own health, improved self-management strategies, peer support, learning and hope. A substantial evidence base supports the conclusion that group based self-management patient education programs in different ways have been experienced as beneficial, but more research is needed. The insights gained from this review can enable researchers, health care professionals, and participants to understand the complexity in evaluating self-management patient education programs, and constitute a basis for a more standardized and systematic evaluation. The results may also encourage health care professionals in planning and carrying out programs in cooperation with lay participants. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Local literature bias in genetic epidemiology: an empirical evaluation of the Chinese literature.

Directory of Open Access Journals (Sweden)

Zhenglun Pan

2005-12-01

Full Text Available BACKGROUND: Postulated epidemiological associations are subject to several biases. We evaluated whether the Chinese literature on human genome epidemiology may offer insights on the operation of selective reporting and language biases. METHODS AND FINDINGS: We targeted 13 gene-disease associations, each already assessed by meta-analyses, including at least 15 non-Chinese studies. We searched the Chinese Journal Full-Text Database for additional Chinese studies on the same topics. We identified 161 Chinese studies on 12 of these gene-disease associations; only 20 were PubMed-indexed (seven English full-text. Many studies (14-35 per topic were available for six topics, covering diseases common in China. With one exception, the first Chinese study appeared with a time lag (2-21 y after the first non-Chinese study on the topic. Chinese studies showed significantly more prominent genetic effects than non-Chinese studies, and 48% were statistically significant per se, despite their smaller sample size (median sample size 146 versus 268, p < 0.001. The largest genetic effects were often seen in PubMed-indexed Chinese studies (65% statistically significant per se. Non-Chinese studies of Asian-descent populations (27% significant per se also tended to show somewhat more prominent genetic effects than studies of non-Asian descent (17% significant per se. CONCLUSION: Our data provide evidence for the interplay of selective reporting and language biases in human genome epidemiology. These biases may not be limited to the Chinese literature and point to the need for a global, transparent, comprehensive outlook in molecular population genetics and epidemiologic studies in general.

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

Neurology Didactic Curricula for Psychiatry Residents: A Review of the Literature and a Survey of Program Directors

Science.gov (United States)

Reardon, Claudia L.; Walaszek, Art

2012-01-01

Objective: Minimal literature exists on neurology didactic instruction offered to psychiatry residents, and there is no model neurology didactic curriculum offered for psychiatry residency programs. The authors sought to describe the current state of neurology didactic training in psychiatry residencies. Methods: The authors electronically…

Evaluation of imaging methods in the diagnosis of urolithiasis: review of the literature

International Nuclear Information System (INIS)

Freitas, Ricardo Miguel Costa de; Silva, Luciana Costa; Santos, Jovita Lane Soares; Tavares Junior, Wilson Campos

2004-01-01

The aim of this study is to compare helical computed tomography with imaging studies currently used to evaluate patients with acute low back pain. In addition, we briefly review the pathophysiology of urolithiasis. The literature published in the last 30 years was reviewed, and the following methods were discussed: plain abdominal radiographs, intravenous pyelography, ultrasound of the urinary tract, and helical computed tomography. Helical computed tomography showed high sensitivity and specificity for detecting urolithiasis, virtually showing all stones, except in patients receiving indinavir. The accuracy of plain abdominal radiographs associated with ultrasound was similar to helical computed tomography, although the latter showed superiority as an isolated method. Data from literature suggest that whenever helical computed tomography is available, it is helpful in the evaluation of low back pain and also allows differential diagnosis between conditions that mimic the symptoms of urolithiasis.(author)

Review of literature and practices for incident management programs : technical report.

Science.gov (United States)

2016-06-01

The project team examined project evaluations, best practice summaries, and synthesis documents, and derived a summary of key elements of programs to speed the time to find and clear stalled vehicles and crashes from freeway shoulders and main lanes....

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

Mental health interventions in Myanmar: a review of the academic and gray literature.

Science.gov (United States)

Nguyen, A J; Lee, C; Schojan, M; Bolton, P

2018-01-01

Recent political changes in Myanmar provide opportunities to expand mental health (MH) services. Given Myanmar's unique situation, we felt a need to assemble and interpret available local information on MH in Myanmar to inform service design, rather than simply drawing lessons from other countries. We reviewed academic and gray literature on the experience of MH problems in Myanmar and the suitability, availability, and effectiveness of MH and psychosocial programming. We searched: (1) Google Scholar; (2) PubMed; (3) PsychInfo; (4) English-language Myanmar journals and databases; (5) the Mental Health and Psychosocial Support (MHPSS) Network resources website; (6) websites and (7) local contacts of organizations identified during 2010 and 2013 mapping exercise of MHPSS providers; (8) the Myanmar Information Management Unit (MIMU) website; (9) University libraries in Yangon and Mandalay; and (10) identified local MH professionals. Qualitative data suggest that MH conditions resulting from stress are similar to those experienced elsewhere. Fourteen intervention evaluations were identified: three on community-level interventions, three on adult religion-based practice (meditation), four adult psychotherapeutic interventions, and four child-focused interventions. Support for the acceptability and effectiveness of interventions is mostly anecdotal. With the exception of two rigorous, randomized control trials, most evaluations had serious methodologic limitations. Few evaluations of psychotherapeutic or psychosocial programs for people from Myanmar have been published in the black or gray literature. Incorporating rigorous evaluations into existing and future programs is imperative for expanding the evidence base for psychotherapeutic and psychosocial programs in this context.

A systematic review of school-based suicide prevention programs.

Science.gov (United States)

Katz, Cara; Bolton, Shay-Lee; Katz, Laurence Y; Isaak, Corinne; Tilston-Jones, Toni; Sareen, Jitender

2013-10-01

Suicide is one of the leading causes of death among youth today. Schools are a cost-effective way to reach youth, yet there is no conclusive evidence regarding the most effective prevention strategy. We conducted a systematic review of the empirical literature on school-based suicide prevention programs. Studies were identified through MEDLINE and Scopus searches, using keywords such as "suicide, education, prevention and program evaluation." Additional studies were identified with a manual search of relevant reference lists. Individual studies were rated for level of evidence, and the programs were given a grade of recommendation. Five reviewers rated all studies independently and disagreements were resolved through discussion. Sixteen programs were identified. Few programs have been evaluated for their effectiveness in reducing suicide attempts. Most studies evaluated the programs' abilities to improve students' and school staffs' knowledge and attitudes toward suicide. Signs of Suicide and the Good Behavior Game were the only programs found to reduce suicide attempts. Several other programs were found to reduce suicidal ideation, improve general life skills, and change gatekeeper behaviors. There are few evidence-based, school-based suicide prevention programs, a combination of which may be effective. It would be useful to evaluate the effectiveness of general mental health promotion programs on the outcome of suicide. The grades assigned in this review are reflective of the available literature, demonstrating a lack of randomized controlled trials. Further evaluation of programs examining suicidal behavior outcomes in randomized controlled trials is warranted. © 2013 Wiley Periodicals, Inc.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

A systematic meta-review of evaluations of youth violence prevention programs: Common and divergent findings from 25 years of meta-analyses and systematic reviews☆

Science.gov (United States)

Matjasko, Jennifer L.; Vivolo-Kantor, Alana M.; Massetti, Greta M.; Holland, Kristin M.; Holt, Melissa K.; Cruz, Jason Dela

2018-01-01

Violence among youth is a pervasive public health problem. In order to make progress in reducing the burden of injury and mortality that result from youth violence, it is imperative to identify evidence-based programs and strategies that have a significant impact on violence. There have been many rigorous evaluations of youth violence prevention programs. However, the literature is large, and it is difficult to draw conclusions about what works across evaluations from different disciplines, contexts, and types of programs. The current study reviews the meta-analyses and systematic reviews published prior to 2009 that synthesize evaluations of youth violence prevention programs. This meta-review reports the findings from 37 meta-analyses and 15 systematic reviews; the included reviews were coded on measures of the social ecology, prevention approach, program type, and study design. A majority of the meta-analyses and systematic reviews were found to demonstrate moderate program effects. Meta-analyses yielded marginally smaller effect sizes compared to systematic reviews, and those that included programs targeting family factors showed marginally larger effects than those that did not. In addition, there are a wide range of individual/family, program, and study moderators of program effect sizes. Implications of these findings and suggestions for future research are discussed. PMID:29503594

Putting program evaluation to work: a framework for creating actionable knowledge for suicide prevention practice.

Science.gov (United States)

Wilkins, Natalie; Thigpen, Sally; Lockman, Jennifer; Mackin, Juliette; Madden, Mary; Perkins, Tamara; Schut, James; Van Regenmorter, Christina; Williams, Lygia; Donovan, John

2013-06-01

The economic and human cost of suicidal behavior to individuals, families, communities, and society makes suicide a serious public health concern, both in the US and around the world. As research and evaluation continue to identify strategies that have the potential to reduce or ultimately prevent suicidal behavior, the need for translating these findings into practice grows. The development of actionable knowledge is an emerging process for translating important research and evaluation findings into action to benefit practice settings. In an effort to apply evaluation findings to strengthen suicide prevention practice, the Centers for Disease Control and Prevention (CDC) and the Substance Abuse and Mental Health Services Administration (SAMHSA) supported the development of three actionable knowledge products that make key findings and lessons learned from youth suicide prevention program evaluations accessible and useable for action. This paper describes the actionable knowledge framework (adapted from the knowledge transfer literature), the three products that resulted, and recommendations for further research into this emerging method for translating research and evaluation findings and bridging the knowledge-action gap.

Three Essays on Policy Evaluation

OpenAIRE

Ingino, Francesco

2016-01-01

2014 - 2015 Over the last two decades there has been a proliferation of literature on program evaluation. Many researches in economics look at the causal effect of exposure of units to programs on some outcomes through econometric and statistical analysis. The units are typically economic agents such as individuals, households, markets, firms, counties, states or countries. The programs can be job search assistance programs, educational programs, vouchers, laws or regulation...

Process Evaluation for a Prison-based Substance Abuse Program.

Science.gov (United States)

Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

2000-01-01

Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

Cardiac Rehabilitation Enhancing Programs in Patients with Myocardial Infarction: A literature Review

Directory of Open Access Journals (Sweden)

Ahyana Ahyana

2013-01-01

Full Text Available Background: Cardiac rehabilitation (CR is a process that involves a multidisciplinary team of health professionals in order to optimize the status of patients’ physical, psychological, social, and vocational well being. The CR program has been proven to influence health outcomes in patients with cardiac diseases, particularly myocardial infarction (MI and stable angina. However, patients’ compliance with cardiac rehabilitation programs remains a challenge.Purpose: The purpose of this study is to review and identify interventions that enhance cardiac rehabilitation behaviors in MI patients.Method: A literature review was conducted by analyzing related research reports published since 2000 to 2012. Only English language articles were included.Result: There were 10 experimental studies and 2 meta-analysis studies. Interventions widely used to enhance cardiac rehabilitation behaviors in MI patients were self-efficacy and self management derived programs. These programs involved interventions that enhance cardiac rehabilitation behaviors, including training exercise, behavioral change, education and psychological support, and lifestyle changing strategies. None have reported the use of culturally tailored intervention. Four phases of cardiac rehabilitation were accepted as each phase represents a different aspect of care: inpatient care, early post discharge period, exercise training, and long term follow up. Critical factors for patients in maintaining an optimum health condition after a cardiac event are, in order, status of patient’s physical, psychological, social, and vocational well being.Conclusion: Cardiac Rehabilitation program has been shown to improve quality of life and decrease mortality in MI patients. The development of culturally specific interventions to increase cardiac rehabilitation behaviors will provide a significant improvement for cardiac patient’s care that ultimately results in better health outcomes. Health care

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

Using Crowdsourcing to Evaluate Published Scientific Literature: Methods and Example

Science.gov (United States)

Brown, Andrew W.; Allison, David B.

2014-01-01

Systematically evaluating scientific literature is a time consuming endeavor that requires hours of coding and rating. Here, we describe a method to distribute these tasks across a large group through online crowdsourcing. Using Amazon's Mechanical Turk, crowdsourced workers (microworkers) completed four groups of tasks to evaluate the question, “Do nutrition-obesity studies with conclusions concordant with popular opinion receive more attention in the scientific community than do those that are discordant?” 1) Microworkers who passed a qualification test (19% passed) evaluated abstracts to determine if they were about human studies investigating nutrition and obesity. Agreement between the first two raters' conclusions was moderate (κ = 0.586), with consensus being reached in 96% of abstracts. 2) Microworkers iteratively synthesized free-text answers describing the studied foods into one coherent term. Approximately 84% of foods were agreed upon, with only 4 and 8% of ratings failing manual review in different steps. 3) Microworkers were asked to rate the perceived obesogenicity of the synthesized food terms. Over 99% of responses were complete and usable, and opinions of the microworkers qualitatively matched the authors' expert expectations (e.g., sugar-sweetened beverages were thought to cause obesity and fruits and vegetables were thought to prevent obesity). 4) Microworkers extracted citation counts for each paper through Google Scholar. Microworkers reached consensus or unanimous agreement for all successful searches. To answer the example question, data were aggregated and analyzed, and showed no significant association between popular opinion and attention the paper received as measured by Scimago Journal Rank and citation counts. Direct microworker costs totaled $221.75, (estimated cost at minimum wage: $312.61). We discuss important points to consider to ensure good quality control and appropriate pay for microworkers. With good reliability and

Using crowdsourcing to evaluate published scientific literature: methods and example.

Directory of Open Access Journals (Sweden)

Andrew W Brown

Full Text Available Systematically evaluating scientific literature is a time consuming endeavor that requires hours of coding and rating. Here, we describe a method to distribute these tasks across a large group through online crowdsourcing. Using Amazon's Mechanical Turk, crowdsourced workers (microworkers completed four groups of tasks to evaluate the question, "Do nutrition-obesity studies with conclusions concordant with popular opinion receive more attention in the scientific community than do those that are discordant?" 1 Microworkers who passed a qualification test (19% passed evaluated abstracts to determine if they were about human studies investigating nutrition and obesity. Agreement between the first two raters' conclusions was moderate (κ = 0.586, with consensus being reached in 96% of abstracts. 2 Microworkers iteratively synthesized free-text answers describing the studied foods into one coherent term. Approximately 84% of foods were agreed upon, with only 4 and 8% of ratings failing manual review in different steps. 3 Microworkers were asked to rate the perceived obesogenicity of the synthesized food terms. Over 99% of responses were complete and usable, and opinions of the microworkers qualitatively matched the authors' expert expectations (e.g., sugar-sweetened beverages were thought to cause obesity and fruits and vegetables were thought to prevent obesity. 4 Microworkers extracted citation counts for each paper through Google Scholar. Microworkers reached consensus or unanimous agreement for all successful searches. To answer the example question, data were aggregated and analyzed, and showed no significant association between popular opinion and attention the paper received as measured by Scimago Journal Rank and citation counts. Direct microworker costs totaled $221.75, (estimated cost at minimum wage: $312.61. We discuss important points to consider to ensure good quality control and appropriate pay for microworkers. With good

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Importance and performance evaluation tools for small and medium companies: critical analysis of national versus international literature

Directory of Open Access Journals (Sweden)

Sandro César Bortoluzzi

2015-12-01

Full Text Available The research aims to map the importance and performance evaluation tools for small and medium companies. This descriptive and qualitative study analyzed 33 national articles and 21 international ones. Regarding the importance of performance evaluation for small and medium companies, the literature highlights: (i it increases the success of the network; (ii it is useful for management; (iii it strengthens competitiveness; (iv it consolidates cooperation; and, (v it increases trust among partners. Comparing the national versus international literature on the importance of performance evaluation for small and medium companies, it can be noticed similar and complementary aspects, that is, there is not disagreement between the authors. The authors use tools consolidated in the literature, such as Balanced Scorecard; Benchmarking; Performance Prism and tools proposed specifically to evaluate small and medium networks. The main dimensions evaluated are: (i exchange of information; (ii value management in networks; (Iii level of network maturity; (iv benefits of collaboration; (v social capital; (vi collective efficiency; (vii network life cycle; (viii efficiency and inefficiency of the networks; and, (ix existence and intensity of the relationship between partners. The critical analysis regarding the performance evaluation concept adopted in the present study shows that the tools proposed or implemented to evaluate small and medium business networks have gaps in the process to identify criteria, measure ordinal and cardinally, integrate and generate actions of improvement.

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

Stakeholders' Perspectives About and Priorities for Economic Evaluation of Health and Safety Programs in Healthcare.

Science.gov (United States)

Tompa, Emile; de Boer, Henriette; Macdonald, Sara; Alamgir, Hasanat; Koehoorn, Mieke; Guzman, Jaime

2016-04-01

This study identified and prioritized resources and outcomes that should be considered in more comprehensive and scientifically rigorous health and safety economic evaluations according to healthcare sector stakeholders. A literature review and stakeholder interviews identified candidate resources and outcomes and then a Delphi panel ranked them. According to the panel, the top five resources were (a) health and safety staff time; (b) training workers; (c) program planning, promotion, and evaluation costs; (d) equipment purchases and upgrades; and (e) administration costs. The top five outcomes were (a) number of injuries, illnesses, and general sickness absences; (b) safety climate; (c) days lost due to injuries, illnesses, and general sickness absences; (d) job satisfaction and engagement; and (e) quality of care and patient safety. These findings emphasize stakeholders' stated priorities and are useful as a benchmark for assessing the quality of health and safety economic evaluations and the comprehensiveness of these findings. © 2016 The Author(s).

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

Science.gov (United States)

Maher, Charles A.

1981-01-01

Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

CONSORT to community: translation of an RCT to a large-scale community intervention and learnings from evaluation of the upscaled program.

Science.gov (United States)

Moores, Carly Jane; Miller, Jacqueline; Perry, Rebecca Anne; Chan, Lily Lai Hang; Daniels, Lynne Allison; Vidgen, Helen Anna; Magarey, Anthea Margaret

2017-11-29

explored in an RCT are inadequate in describing the enablers and barriers of upscaled community program implementation. Methods for data collection, analysis and reporting also require consideration. We present a number of experiential reflections and suggestions for the successful evaluation of future upscaled community programs which are scarcely reported in the literature. PEACH™ QLD was retrospectively registered with the Australian New Zealand Clinical Trials Registry on 28 February 2017 (ACTRN12617000315314).

Manipulator system man-machine interface evaluation program. [technology assessment

Science.gov (United States)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Evaluation of otolaryngology residency program websites.

Science.gov (United States)

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42

Clemson University Science Master's Program in Sustainable and Resilient Infrastructure: A program evaluation

Science.gov (United States)

O'Sell, Elizabeth Eberhart

The Clemson University Science Master's Program (SMP) in Sustainable and Resilient Infrastructure is a program which aims to link engineering, materials, construction, environment, architecture, business, and public policy to produce graduates with unique holistic perspective and expertise to immediately contribute to the workforce in the area of sustainable and resilient infrastructure. A program evaluation of the SMP has been performed to study the effectiveness of the SMP and identify areas where the goals and vision of the SMP are achieved and areas where improvements can be made. This was completed by analysis of trends within survey responses, review of Master's thesis reports, and review of courses taken. It was found that the SMP has facilitated new interdisciplinary research collaborations of faculty in different concentration areas within the Glenn Department of Civil Engineering, as well as collaboration with faculty in other departments. It is recommended that a course which provides instruction in all eight competency areas be required for all SMP students to provide a comprehensive overview and ensure all students are exposed to concepts of all competency areas. While all stakeholders are satisfied with the program and believe it has been successful thus far, efforts do need to be made as the program moves forward to address and improve some items that have been mentioned as needing improvement. The concerns about concentration courses, internship planning, and advising should be addressed. This evaluation provides benefits to prospective students, current SMP participants, and outside program supporters. The goal of this evaluation is to provide support that the SMP is an effective and worthwhile program for participating students, while attempting to identify any necessary program improvements and provide recommendations for achieving these improvements. This goal has been accomplished.

Overview of Evaluation Methods for R&D Programs. A Directory of Evaluation Methods Relevant to Technology Development Programs

Energy Technology Data Exchange (ETDEWEB)

Ruegg, Rosalie [TIA Consulting, Inc., Emeral Isle, NC (United States); Jordan, Gretchen B. [Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)

2007-03-01

This document provides guidance for evaluators who conduct impact assessments to determine the “realized” economic benefits and costs, energy, environmental benefits, and other impacts of the Office of Energy Efficiency and Renewable Energy’s (EERE) R&D programs. The focus of this Guide is on realized outcomes or impacts of R&D programs actually experienced by American citizens, industry, and others.

Challenges to Evaluating Physical Activity Programs in American Indian/Alaska Native Communities

Science.gov (United States)

Roberts, Erica Blue; Butler, James; Green, Kerry M.

2018-01-01

Despite the importance of evaluation to successful programming, a lack of physical activity program (PAP) evaluation for American Indian/Alaska Native (AI/AN) programs exists, which is significant given the high rates of obesity and diabetes in this population. While evaluation barriers have been identified broadly among AI/AN programs, challenges…

An Analysis of Factors Affecting Mature Age Students' Academic Success in Undergraduate Nursing Programs: A Critical Literature Review.

Science.gov (United States)

Hayden, Lisa J; Jeong, Sarah Y; Norton, Carol A

2016-01-01

The population of mature age students entering university nursing programs has steadily increased in both Australia and worldwide. The objective of the literature review was to explore how mature age students perform academically and to analyse the factors associated with their academic performance in nursing programs. A literature search was conducted in the following databases: CINAHL, ProQuest, Medline, Cochrane, Mosby's Index, Joanna Briggs Institute (JBI), and Scopus. Twenty-six (26) research papers published between 2000 and 2014 have met the selection criteria of this review. The key themes identified include; 1) ambiguity in definition of mature age and academic success, 2) age and academic success, 3) intrinsic factors (life experiences, emotional intelligence, and motivation and volition), and 4) extrinsic factors (peer, academic and family support; and learning style, components of the modules and mode of delivery). Current literature provides evidence that mature age nursing students perform at a higher level within the methodological issues discussed in this paper. Future research is warranted to advance the understanding of the complex relationship between extrinsic and intrinsic factors of mature age students and their academic success in higher education. Nursing educators will benefit from novel evidence, ideas and opportunities to explore and implement in nursing education.

Building a patient-centered and interprofessional training program with patients, students and care professionals: study protocol of a participatory design and evaluation study.

Science.gov (United States)

Vijn, Thomas W; Wollersheim, Hub; Faber, Marjan J; Fluit, Cornelia R M G; Kremer, Jan A M

2018-05-30

A common approach to enhance patient-centered care is training care professionals. Additional training of patients has been shown to significantly improve patient-centeredness of care. In this participatory design and evaluation study, patient education and medical education will be combined by co-creating a patient-centered and interprofessional training program, wherein patients, students and care professionals learn together to improve patient-centeredness of care. In the design phase, scientific literature regarding interventions and effects of student-run patient education will be synthesized in a scoping review. In addition, focus group studies will be performed on the preferences of patients, students, care professionals and education professionals regarding the structure and content of the training program. Subsequently, an intervention plan of the training program will be constructed by combining these building blocks. In the evaluation phase, patients with a chronic disease, that is rheumatoid arthritis, diabetes and hypertension, and patients with an oncologic condition, that is colonic cancer and breast cancer, will learn together with medical students, nursing students and care professionals in training program cycles of three months. Process and effect evaluation will be performed using the plan-do-study-act (PDSA) method to evaluate and optimize the training program in care practice and medical education. A modified control design will be used in PDSA-cycles to ensure that students who act as control will also benefit from participating in the program. Our participatory design and evaluation study provides an innovative approach in designing and evaluating an intervention by involving participants in all stages of the design and evaluation process. The approach is expected to enhance the effectiveness of the training program by assessing and meeting participants' needs and preferences. Moreover, by using fast PDSA cycles and a modified control design

Literature Study on Community Participation in Community Based Rural Water Supply and Sanitation Programs

Science.gov (United States)

Nurbaiti, Siti Robiah; Bambang, Azis Nur

2018-02-01

Clean water and proper sanitation are basic human needs, existing procurement in the Law of the Republic of Indonesia Number 7 of 2004 on Water Resources and Government Regulation of the Republic of Indonesia Number 16 of 2005 on Development of Water Supply System, which the state guarantees the right of everyone water for basic daily minimum needs to meet the needs of a healthy, productive, and clean life. Norms every society has the right to get clean air to meet basic daily needs. One of the points in the goal of sustainable development goals (SDGs) in the environment sector is the guarantee of the community to achieve universal access to clean water and sanitation. The SDG High Level Panel held in 2012 calls on countries around the world to do so in 2030. Fulfillment of clean air and sanitation in Indonesia is conducted through two sectoral approaches, the first through agencies, or related agencies and the second through a Society. In accordance with its community-based principles, the role itself is a key factor in the success of the program. Therefore, the purpose of this paper is to find out the forms of community participation and the factors that influence participation in community-based water supply and sanitation programs in the field of literature studies of previous research such as research journals, theses, theses, dissertations and related books This literature study topic.

Literature Study on Community Participation in Community Based Rural Water Supply and Sanitation Programs

Directory of Open Access Journals (Sweden)

Robiah Nurbaiti Siti

2018-01-01

Full Text Available Clean water and proper sanitation are basic human needs, existing procurement in the Law of the Republic of Indonesia Number 7 of 2004 on Water Resources and Government Regulation of the Republic of Indonesia Number 16 of 2005 on Development of Water Supply System, which the state guarantees the right of everyone water for basic daily minimum needs to meet the needs of a healthy, productive, and clean life. Norms every society has the right to get clean air to meet basic daily needs. One of the points in the goal of sustainable development goals (SDGs in the environment sector is the guarantee of the community to achieve universal access to clean water and sanitation. The SDG High Level Panel held in 2012 calls on countries around the world to do so in 2030. Fulfillment of clean air and sanitation in Indonesia is conducted through two sectoral approaches, the first through agencies, or related agencies and the second through a Society. In accordance with its community-based principles, the role itself is a key factor in the success of the program. Therefore, the purpose of this paper is to find out the forms of community participation and the factors that influence participation in community-based water supply and sanitation programs in the field of literature studies of previous research such as research journals, theses, theses, dissertations and related books This literature study topic.

Evaluating the impacts of the clean cities program.

Science.gov (United States)

Qiu, Shiyong; Kaza, Nikhil

2017-02-01

The Department of Energy's Clean Cities program was created in 1993 to reduce petroleum usage in the transportation sector. The program promotes alternative fuels such as biofuels and fuel-saving strategies such as idle reduction and fleet management through coalitions of local government, non-profit, and private actors. Few studies have evaluated the impact of the program because of its complexity that include interrelated strategies of grants, education and training and diversity of participants. This paper uses a Difference-in-Differences (DiD) approach to evaluate the effectiveness of the program between 1990 and 2010. We quantify the effectiveness of the Clean Cities program by focusing on performance measures such as air quality, number of alternative fueling stations, private vehicle occupancy and transit ridership. We find that counties that participate in the program perform better on all these measures compared to counties that did not participate. Compared to the control group, counties in the Clean Cities program experienced a reduction in days with bad air quality (3.7%), a decrease in automobile commuters (2.9%), an overall increase in transit commuters (2.1%) and had greater numbers of new alternative fueling stations (12.9). The results suggest that the program is a qualified success. Copyright © 2016 Elsevier B.V. All rights reserved.

The program success story: a valuable tool for program evaluation.

Science.gov (United States)

Lavinghouze, Rene; Price, Ann Webb; Smith, Kisha-Ann

2007-10-01

Success stories are evaluation tools that have been used by professionals across disciplines for quite some time. They are also proving to be useful in promoting health programs and their accomplishments. The increasing popularity of success stories is due to the innovative and effective way that they increase a program's visibility, while engaging potential participants, partners, and funders in public health efforts. From the community level to the federal level, program administrators are using success stories as vehicles for celebrating achievements, sharing challenges, and communicating lessons learned. Success stories are an effective means to move beyond the numbers and connect to readers-with a cause they can relate to and want to join. This article defines success stories and provides an overview of several types of story formats, how success stories can be systematically collected, and how they are used to communicate program success.

Quasi-Experimental Evaluation of a Student Mentoring Program

OpenAIRE

Sandner, Malte

2013-01-01

This paper presents evidence from a natural-experiment which evaluates the effectiveness of a student mentoring program. The mentoring includes several compulsory, scheduled, faceto- face appointments between a mentor and a student in the first study year. All mentors are graduated and employed by the institution. For the evaluation, I use the fact that the mentoring is only offered to students in an economics and management program, whereas it is not offered to students in an industrial engi...

Independent auto evaluation of an operative radiological protection program

International Nuclear Information System (INIS)

Medrano L, M.A.; Rodriguez C, C.C.; Linares R, D.; Zarate M, N.; Zempoalteca B, R.

2006-01-01

The program of operative radiological protection of a nuclear power plant consists of multiple procedures and associate tasks that have as purpose the radiological protection of the workers of the power station. It is for this reason that the constant evaluation of the one it programs it is an important tool in the identification of their weaknesses (and strengths), so they can be assisted appropriately. In this work the main elements of the program of independent auto evaluation of the program of operative radiological protection of the Laguna Verde Central that has been developed and implemented by the National Institute of Nuclear Research are described. (Author)

Taiwan Teacher Preparation Program Evaluation: Some Critical Perspectives

Science.gov (United States)

Liu, Tze-Chang

2015-01-01

This paper focuses on the influences and changes of recent Taiwan teacher preparation program evaluation (TTPPE) as one of the national evaluation projects conducted by the Higher Education Evaluation and Accreditation Council of Taiwan. The main concerns are what kind of ideology is transformed through the policy by means of evaluation, and what…

Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada.

Science.gov (United States)

Godin, Katelyn; Stapleton, Jackie; Kirkpatrick, Sharon I; Hanning, Rhona M; Leatherdale, Scott T

2015-10-22

Grey literature is an important source of information for large-scale review syntheses. However, there are many characteristics of grey literature that make it difficult to search systematically. Further, there is no 'gold standard' for rigorous systematic grey literature search methods and few resources on how to conduct this type of search. This paper describes systematic review search methods that were developed and applied to complete a case study systematic review of grey literature that examined guidelines for school-based breakfast programs in Canada. A grey literature search plan was developed to incorporate four different searching strategies: (1) grey literature databases, (2) customized Google search engines, (3) targeted websites, and (4) consultation with contact experts. These complementary strategies were used to minimize the risk of omitting relevant sources. Since abstracts are often unavailable in grey literature documents, items' abstracts, executive summaries, or table of contents (whichever was available) were screened. Screening of publications' full-text followed. Data were extracted on the organization, year published, who they were developed by, intended audience, goal/objectives of document, sources of evidence/resources cited, meals mentioned in the guidelines, and recommendations for program delivery. The search strategies for identifying and screening publications for inclusion in the case study review was found to be manageable, comprehensive, and intuitive when applied in practice. The four search strategies of the grey literature search plan yielded 302 potentially relevant items for screening. Following the screening process, 15 publications that met all eligibility criteria remained and were included in the case study systematic review. The high-level findings of the case study systematic review are briefly described. This article demonstrated a feasible and seemingly robust method for applying systematic search strategies to

The Impact of Evaluation Use on Accounting Programs’ Performance: An Exploratory Study

Directory of Open Access Journals (Sweden)

Sheizi Calheira de Freitas

2016-11-01

Full Text Available The Brazilian program of higher education evaluation, broadly known as the National Exam of Students’ Performance (ENADE, represents a governmental effort to gather information on undergraduate educational quality. As a product of that evaluation, reports are made available to each program evaluated. Our present research addresses the impact of ENADE evaluation report utilization on multiple higher education accounting programs’ performance in their subsequent evaluation. Based upon theoretical support from literature about evaluation use, a web-based survey was developed and provided across the country to the coordinators of accounting programs. From a response rate of 62% of the study target population and using multiple regressions, we found that there was a positive correlation between usage of the ENADE evaluation report and the performance of undergraduate accounting programs in their subsequent evaluation. Based upon the reviewed literature and, in accordance with these research results, it is possible to infer that the use of evaluation reports derived from the higher education evaluation system promoted by the Brazilian government can influence the decisions of educational institutions and promote improvement.

Economic evaluation in patient safety: a literature review of methods.

Science.gov (United States)

de Rezende, Bruna Alves; Or, Zeynep; Com-Ruelle, Laure; Michel, Philippe

2012-06-01

Patient safety practices, targeting organisational changes for improving patient safety, are implemented worldwide but their costs are rarely evaluated. This paper provides a review of the methods used in economic evaluation of such practices. International medical and economics databases were searched for peer-reviewed publications on economic evaluations of patient safety between 2000 and 2010 in English and French. This was complemented by a manual search of the reference lists of relevant papers. Grey literature was excluded. Studies were described using a standardised template and assessed independently by two researchers according to six quality criteria. 33 articles were reviewed that were representative of different patient safety domains, data types and evaluation methods. 18 estimated the economic burden of adverse events, 3 measured the costs of patient safety practices and 12 provided complete economic evaluations. Healthcare-associated infections were the most common subject of evaluation, followed by medication-related errors and all types of adverse events. Of these, 10 were selected that had adequately fulfilled one or several key quality criteria for illustration. This review shows that full cost-benefit/utility evaluations are rarely completed as they are resource intensive and often require unavailable data; some overcome these difficulties by performing stochastic modelling and by using secondary sources. Low methodological transparency can be a problem for building evidence from available economic evaluations. Investing in the economic design and reporting of studies with more emphasis on defining study perspectives, data collection and methodological choices could be helpful for strengthening our knowledge base on practices for improving patient safety.

Compulsory Project-Level Involvement and the Use of Program-Level Evaluations: Evaluating the Local Systemic Change for Teacher Enhancement Program

Science.gov (United States)

Johnson, Kelli; Weiss, Iris R.

2011-01-01

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Methods for evaluating a mature substance abuse prevention/early intervention program.

Science.gov (United States)

Becker, L R; Hall, M; Fisher, D A; Miller, T R

2000-05-01

The authors describe methods for work in progress to evaluate four workplace prevention and/or early intervention programs designed to change occupational norms and reduce substance abuse at a major U.S. transportation company. The four programs are an employee assistance program, random drug testing, managed behavioral health care, and a peer-led intervention program. An elaborate mixed-methods evaluation combines data collection and analysis techniques from several traditions. A process-improvement evaluation focuses on the peer-led component to describe its evolution, document the implementation process for those interested in replicating it, and provide information for program improvement. An outcome-assessment evaluation examines impacts of the four programs on job performance measures (e.g., absenteeism, turnover, injury, and disability rates) and includes a cost-offset and employer cost-savings analysis. Issues related to using archival data, combining qualitative and quantitative designs, and working in a corporate environment are discussed.

The US Department of Energy Personnel Dosimetry Evaluation and Upgrade Program

International Nuclear Information System (INIS)

Faust, L.G.; Stroud, C.M.; Swinth, K.L.; Vallario, E.J.

1987-11-01

The US Department of Energy (DOE) Personnel Dosimetry Evaluation and Upgrade Program is designed to identify and evaluate dosimetry deficiencies and to conduct innovative research and development programs that will improve overall capabilities, thus ensuring that DOE can comply with applicable standards and regulations for dose measurement. To achieve these goals, two programs were initiated to evaluate and upgrade beta measurement and neutron dosimetry. 3 refs

Child Development Program Evaluation Scale.

Science.gov (United States)

Fiene, Richard J.

The Child Development Program Evaluation Scale (CDPES) is actually two scales in one, a licensing scale and a quality scale. Licensing predictor items have been found to predict overall compliance of child day care centers with state regulations in four states. Quality scale items have been found to predict the overall quality of child day care…

Objective Evaluation in an Online Geographic Information System Certificate Program

OpenAIRE

Scott L. WALKER

2005-01-01

Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program....

Nondestructive Evaluation Program: Progress in 1986

International Nuclear Information System (INIS)

1987-07-01

The increasing cost of equipment for power generating plants and the potential increases in productivity and safety available through rapidly developing Nondestructive Evaluation (NDE) technology led EPRI to initiate a Nondestructive Evaluation Program in 1974. To date, the major focus has been on light water reactor inspection problems; however, increased application to other systems is now under way. This report presents a comprehensive review of the EPRI effort in the NDE area. Most of the report consists of contractor-supplied progress reports on each current project. An organizational plan of the program is presented in overview. In addition, organization from several viewpoints is presented, e.g., in-service inspection operators, R and D personnel, and utility representatives. The report summarizes significant progress made since the previous EPRI Special Report NP-4315-SR was issued in May 1986. Section 1 contains information about the program organization, and the sections that follow contain contractor-supplied progress reports of each current project. The progress reports are grouped by plant components - pipe, pressure vessel, steam generator and boiler tubes, and turbine. In addition, Part 6 is devoted to discussions of technology transfer

Acknowledging patient heterogeneity in economic evaluation : a systematic literature review.

Science.gov (United States)

Grutters, Janneke P C; Sculpher, Mark; Briggs, Andrew H; Severens, Johan L; Candel, Math J; Stahl, James E; De Ruysscher, Dirk; Boer, Albert; Ramaekers, Bram L T; Joore, Manuela A

2013-02-01

Patient heterogeneity is the part of variability that can be explained by certain patient characteristics (e.g. age, disease stage). Population reimbursement decisions that acknowledge patient heterogeneity could potentially save money and increase population health. To date, however, economic evaluations pay only limited attention to patient heterogeneity. The objective of the present paper is to provide a comprehensive overview of the current knowledge regarding patient heterogeneity within economic evaluation of healthcare programmes. A systematic literature review was performed to identify methodological papers on the topic of patient heterogeneity in economic evaluation. Data were obtained using a keyword search of the PubMed database and manual searches. Handbooks were also included. Relevant data were extracted regarding potential sources of patient heterogeneity, in which of the input parameters of an economic evaluation these occur, methods to acknowledge patient heterogeneity and specific concerns associated with this acknowledgement. A total of 20 articles and five handbooks were included. The relevant sources of patient heterogeneity (demographics, preferences and clinical characteristics) and the input parameters where they occurred (baseline risk, treatment effect, health state utility and resource utilization) were combined in a framework. Methods were derived for the design, analysis and presentation phases of an economic evaluation. Concerns related mainly to the danger of false-positive results and equity issues. By systematically reviewing current knowledge regarding patient heterogeneity within economic evaluations of healthcare programmes, we provide guidance for future economic evaluations. Guidance is provided on which sources of patient heterogeneity to consider, how to acknowledge them in economic evaluation and potential concerns. The improved acknowledgement of patient heterogeneity in future economic evaluations may well improve the

Development and evaluation of a cancer-related fatigue patient education program: protocol of a randomized controlled trial

Directory of Open Access Journals (Sweden)

Görres Stefan

2008-07-01

Full Text Available Abstract Background Cancer-related fatigue (CRF and its impact on patients' quality of life has been an increasing subject of research. However, in Germany there is a lack of evidence-based interventions consistent with the multidimensional character of fatigue. The objective of this study is to develop and evaluate a self-management program for disease-free cancer patients to cope with CRF. Methods Based on evidence extracted from a literature review, a curriculum for the self-management program was elaborated. The curriculum was reviewed and validated by an interdisciplinary expert group and the training-modules will be pretested with a small number of participants and discussed in terms of feasibility and acceptance. To determine the efficacy of the program a randomised controlled trial will be carried out: 300 patients will be recruited from oncological practices in Bremen, Germany, and will be allocated to intervention or control group. The intervention group participates in the program, whereas the control group receives standard care and the opportunity to take part in the program after the end of the follow-up (waiting control group. Primary outcome measure is the level of fatigue, secondary outcome measures are quality of life, depression, anxiety, self-efficacy and physical activity. Data will be collected before randomisation, after intervention, and after a follow-up of 6 months. Discussion Because there are no comparable self-management programs for cancer survivors with fatigue, the development of the curriculum has been complex; therefore, the critical appraisal by the experts was an important step to validate the program and their contributions have been integrated into the curriculum. The experts appreciated the program as filling a gap in outpatient cancer care. If the results of the evaluation prove to be satisfactory, the outpatient care of cancer patients can be broadened and supplemented. Trial Registration Clinical

Evaluation of the RATU2 and RETU research programs

International Nuclear Information System (INIS)

Faidy, C.; Hayns, M.R.

1998-05-01

The report is an evaluation of the Finnish RATU2 (Structural Integrity of Nuclear Power Plants) and RETU (Reactor Safety) programs. The first generation of nuclear safety research programs were started in 1988-1990. Mid-term reviews were carried out and published in 1992. Many of the recommendations from those reviews have been implemented and they are referred to in this evaluation report

24 CFR 266.115 - Program monitoring and evaluation.

Science.gov (United States)

2010-04-01

... AUTHORITIES HOUSING FINANCE AGENCY RISK-SHARING PROGRAM FOR INSURED AFFORDABLE MULTIFAMILY PROJECT LOANS Housing Finance Agency Requirements § 266.115 Program monitoring and evaluation. (a) HFA certifications... under this part, basic underwriting and closing information must be submitted in a format specified by...

Methodology for the evaluation of the Stephanie Alexander Kitchen Garden program.

Science.gov (United States)

Gibbs, L; Staiger, P K; Townsend, M; Macfarlane, S; Gold, L; Block, K; Johnson, B; Kulas, J; Waters, E

2013-04-01

Community and school cooking and gardening programs have recently increased internationally. However, despite promising indications, there is limited evidence of their effectiveness. This paper presents the evaluation framework and methods negotiated and developed to meet the information needs of all stakeholders for the Stephanie Alexander Kitchen Garden (SAKG) program, a combined cooking and gardening program implemented in selectively funded primary schools across Australia. The evaluation used multiple aligned theoretical frameworks and models, including a public health ecological approach, principles of effective health promotion and models of experiential learning. The evaluation is a non-randomised comparison of six schools receiving the program (intervention) and six comparison schools (all government-funded primary schools) in urban and rural areas of Victoria, Australia. A mixed-methods approach was used, relying on qualitative measures to understand changes in school cultures and the experiential impacts on children, families, teachers, parents and volunteers, and quantitative measures at baseline and 1 year follow up to provide supporting information regarding patterns of change. The evaluation study design addressed the limitations of many existing evaluation studies of cooking or garden programs. The multistrand approach to the mixed methodology maintained the rigour of the respective methods and provided an opportunity to explore complexity in the findings. Limited sensitivity of some of the quantitative measures was identified, as well as the potential for bias in the coding of the open-ended questions. The SAKG evaluation methodology will address the need for appropriate evaluation approaches for school-based kitchen garden programs. It demonstrates the feasibility of a meaningful, comprehensive evaluation of school-based programs and also demonstrates the central role qualitative methods can have in a mixed-method evaluation. So what? This paper

Development of a Literature Curriculum for Young Children. CAREL Arts and Humanities Curriculum Development Program for Young Children.

Science.gov (United States)

Amidon, Jeanette; And Others

The purpose of the Central Atlantic Regional Educational Laboratory (CAREL) literature program was to encourage pupils' imaginative and expressive power and to improve their ability to use language effectively. The curriculum was designed for 3- to 8-year-olds who represented a wide socioeconomic background. Specialists trained teachers to relate…

The Impact of School-Located Influenza Vaccination Programs on Student Absenteeism: A Review of the U.S. Literature

Science.gov (United States)

Hull, Harry F.; Ambrose, Christopher S.

2011-01-01

A literature review was conducted to summarize the impact of school-located influenza vaccination (SLIV) programs on school absenteeism. Seven studies were identified: six peer-reviewed articles and one conference presentation. The number of students vaccinated ranged from 185 to 5,315, representing 35-86% of enrolled students. Six studies…

Barriers and Advantages to Student Participation in the School Breakfast Program Based on the Social Ecological Model: A Review of the Literature

Science.gov (United States)

Lopez-Neyman, Stephanie M.; Warren, Cynthia A.

2016-01-01

Participation in school meals is a preventive measure against childhood hunger. Participation in the School Breakfast Program (SBP) continues to lag behind that of the National School Lunch Program. The purpose of this literature review was to investigate the barriers and advantages to student participation in the SBP. Using the adaptable…

The development of a parenting program for incarcerated mothers in Australia: a review of prison-based parenting programs.

Science.gov (United States)

Newman, Claire; Fowler, Cathrine; Cashin, Andrew

2011-08-01

The increasing population of children with an incarcerated parent is a significant public health issue. A literature search highlighted that children of incarcerated parents experience psychological stressors that may potentially impact on health and behavioural outcomes. Parenting programs for prisoners may be of benefit as early parenting experiences during childhood have a significant impact on a child's future experiences as an adolescent and adult. A review of identified evaluation-based studies of parenting programs for prisoners (N = 11), although varied in program delivery approaches and evaluation methods, suggest that such programs have the potential to improve the parenting skills, knowledge and confidence of incarcerated parents. Finally, this paper provides an outline of the development of an Australian based parenting program for incarcerated mothers and their young children.

Review of Evaluation, Measurement and Verification Approaches Used to Estimate the Load Impacts and Effectiveness of Energy Efficiency Programs

Energy Technology Data Exchange (ETDEWEB)

Messenger, Mike; Bharvirkar, Ranjit; Golemboski, Bill; Goldman, Charles A.; Schiller, Steven R.

2010-04-14

Efficiency (2007) presented commonly used definitions for EM&V in the context of energy efficiency programs: (1) Evaluation (E) - The performance of studies and activities aimed at determining the effects and effectiveness of EE programs; (2) Measurement and Verification (M&V) - Data collection, monitoring, and analysis associated with the calculation of gross energy and demand savings from individual measures, sites or projects. M&V can be a subset of program evaluation; and (3) Evaluation, Measurement, and Verification (EM&V) - This term is frequently seen in evaluation literature. EM&V is a catchall acronym for determining both the effectiveness of program designs and estimates of load impacts at the portfolio, program and project level. This report is a scoping study that assesses current practices and methods in the evaluation, measurement and verification (EM&V) of ratepayer-funded energy efficiency programs, with a focus on methods and practices currently used for determining whether projected (ex-ante) energy and demand savings have been achieved (ex-post). M&V practices for privately-funded energy efficiency projects (e.g., ESCO projects) or programs where the primary focus is greenhouse gas reductions were not part of the scope of this study. We identify and discuss key purposes and uses of current evaluations of end-use energy efficiency programs, methods used to evaluate these programs, processes used to determine those methods; and key issues that need to be addressed now and in the future, based on discussions with regulatory agencies, policymakers, program administrators, and evaluation practitioners in 14 states and national experts in the evaluation field. We also explore how EM&V may evolve in a future in which efficiency funding increases significantly, innovative mechanisms for rewarding program performance are adopted, the role of efficiency in greenhouse gas mitigation is more closely linked, and programs are increasingly funded from multiple sources

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

Using Children's Literature to Build Concepts of Teaching about Global Citizenship

Science.gov (United States)

Bradbery, Debbie

2012-01-01

Children's literature can be used to help teachers to build into their teaching programs ways to examine and change personal lifestyles to secure a sustainable future; to identify, investigate, evaluate and undertake appropriate action to maintain, protect and enhance local and global environments; to challenge preconceived ideas, accept…

Using GIS to evaluate a fire safety program in North Carolina.

Science.gov (United States)

Dudley, Thomas; Creppage, Kathleen; Shanahan, Meghan; Proescholdbell, Scott

2013-10-01

Evaluating program impact is a critical aspect of public health. Utilizing Geographic Information Systems (GIS) is a novel way to evaluate programs which try to reduce residential fire injuries and deaths. The purpose of this study is to demonstrate the application of GIS within the evaluation of a smoke alarm installation program in North Carolina. This approach incorporates national fire incident data which, when linked with program data, provides a clear depiction of the 10 years impact of the Get Alarmed, NC! program and estimates the number of potential lives saved. We overlapped Get Alarmed, NC! program installation data with national information on fires using GIS to identify homes that experienced a fire after an alarm was installed and calculated potential lives saved based on program documentation and average housing occupancy. We found that using GIS was an efficient and quick way to match addresses from two distinct sources. From this approach we estimated that between 221 and 384 residents were potentially saved due to alarms installed in their homes by Get Alarmed, NC!. Compared with other program evaluations that require intensive and costly participant telephone surveys and/or in-person interviews, the GIS approach is inexpensive, quick, and can easily analyze large disparate datasets. In addition, it can be used to help target the areas most at risk from the onset. These benefits suggest that by incorporating previously unutilized data, the GIS approach has the potential for broader applications within public health program evaluation.

Understanding mental health through reading selected literature sources: an evaluation.

Science.gov (United States)

McKie, A; Gass, J P

2001-04-01

The increasing use of the humanities in nurse education provides an alternative means of facilitating students' understanding of health issues. In part, this contributes to a critique of rationalist-technological approaches to education where knowledge is reduced to abstract, discernable and measured units. A more communal approach to education recognises the place of interpretation as part of learning and, within this, the significance of dialogue, identity, tradition, attachment and partnership. The reading of works of literature is one way in which the reader interprets texts in a multiplicity of ways in order to more fully understand the 'real' world. Mental health offers particular opportunities for literary descriptions. The evaluation of a learning unit within a mental health nursing branch programme where students read a number of works of literature is outlined. Results indicate a variety of student responses to use of such an approach. The authors assert the usefulness of these approaches in encouraging deeper understanding of complex issues faced in mental health nursing practice. At the same time, however, careful consideration is given to the place of such approaches within the overall philosophy of a curriculum programme. Copyright 2001 Harcourt Publishers Ltd.

Evaluation of the BEAM--BEAM effect in PEP using Myer's simulation program

International Nuclear Information System (INIS)

Hutton, A.

1982-09-01

The program BEAM BEAM written by Steve Myers for the LEP machine at CERN has given encouraging results in the simulation of the beam-beam effect in electron-positron storage rings. It therefore seemed worthwhile to apply the program to PEP with two main intentions. Firstly, to confirm the validity of the program by comparison with experimental data from previous PEP runs and secondly, to search for an improvement in the operating conditions of PEP. Clearly a successful prediction would also enhance the credibility of the program. The program itself has been extensively described in the literature and will not be repeated here, except for some comments of direct relevance to the present simulation. 14 refs., 15 figs., 4 tabs

BODY IMAGE IN CHILDHOOD: AN INTEGRATIVE LITERATURE REVIEW.

Science.gov (United States)

Neves, Clara Mockdece; Cipriani, Flávia Marcelle; Meireles, Juliana Fernandes Filgueiras; Morgado, Fabiane Frota da Rocha; Ferreira, Maria Elisa Caputo

2017-01-01

To analyse the scientific literature regarding the evaluation of body image in children through an integrative literature review. An intersection of the keywords "body image" AND "child" was conducted in Scopus, Medline and Virtual Health Library (BVS - Biblioteca Virtual de Saúde) databases. The electronic search was based on studies published from January 2013 to January 2016, in order to verify the most current investigations on the subject. Exclusion criteria were: articles in duplicate; no available summaries; not empirical; not assessing any component of body image; the sample did not consider the target age of this research (0 to 12 years old) and/or considered clinical populations; besides articles not fully available. 7,681 references were identified, and, after the exclusion criteria were implemented, 33 studies were analysed. Results showed that the perceptual and attitudinal dimensions focusing on body dissatisfaction were explored, mainly evaluated by silhouette scales. Intervention programs were developed internationally to prevent negative body image in children. The studies included in this review evaluated specific aspects of body image in children, especially body perception and body dissatisfaction. The creation of specific tools for children to evaluate body image is recommended to promote the psychosocial well being of individuals throughout human development.

Evaluation of Pre-Departure English Training Program

Directory of Open Access Journals (Sweden)

Ali Saukah

2016-02-01

Full Text Available The program evaluation reported in this article covers three batches of participants, from 1996 through 1997, sponsored by the Directorate General of Higher Education projects to prepare faculty members of teacher training institutions for overseas studies. The result outcomes could be achieved when the initial English competence requirred for participating in the program was at least at the Pre-Advanced level. The criterion validity of the TOEFL-Equivalent test developed by the program was assured, and the test could, therefore, be used as a good predictor of the International TOEFL. Other recommendations are also given for the improvement of the planning and implementation of the program in the future

Curriculum Evaluation and Employers Opinions: the case study of Educational Technology Program in Bachelor Degree (Continuing Program

Directory of Open Access Journals (Sweden)

Nakhon Lalognam

2016-09-01

Full Text Available The purposes of this research were: 1 to evaluate the Educational Technology Program (Continuing Program in Bachelor Degree curriculum which is revised in 2007 by applying CIPP model for evaluation. 2 to study the opinions of the employers about the ideal characteristics and actual characteristics of graduates. 3 to study the opinions for the requirements of the Educational Technology Program in Bachelor Degree (Continuing Program and knowledge implementation in work of graduates. 4 to make the suggestions and guidelines to improve the Educational Technology Program in Bachelor Degree (Continuing Program to achieve potentiality and responsive for the requirements of learners and employers. The sample of this research were 310 persons ; consisted of graduates in the Educational Technology Program in Bachelor Degree (Continuing Program in academic year 2006 - 2010, the committee of the Educational Technology Program in Bachelor Degree (Continuing Program , instructors and employers by using Multi-stage Random Sampling and Simple Random Sampling. The instruments of this research were the 5 levels rating scale questionnaire and the structured interview type. They consisted of 3 sets: 1 for graduates, 2 for the committee of the Educational Technology Program in Bachelor Degree (Continuing Program and 3 for instructors and employers. The research found that: 1. The results of evaluation on the Educational Technology Program in Bachelor Degree (Continuing Program which is revised in 2007 were: 1.1 The opinions of graduates to curriculum in all of aspects were average at the uncertain level which the context aspect was at the high level, input aspect was at the uncertain level, process aspect was at the uncertain level and product aspect was at the high level. 1.2 The opinions of the curriculum committee and instructors to curriculum in all of aspects were average at the high level which the context aspect was at the high level, input aspect was at the

38 CFR 1.15 - Standards for program evaluation.

Science.gov (United States)

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... intent, contain a method to measure fulfillment of the objectives, ascertain the degree to which goals... the data. (f) Each program evaluation requires a systematic research design to collect the data...

Evaluation of ADVANCE: A Nontraditional Adult Diploma Program.

Science.gov (United States)

Deegan, James

An evaluation of Project ADVANCE (Adult Diploma Validating and Accrediting Necessary Competence and Experiences), an adult competency-based high school completion program, was conducted to determine program effectiveness, as viewed subjectively by recent graduates and present students. Personal interviews and/or questionnaires were given to 31 of…

Computer programs for TRIGA calibration, burnup evaluation, and bookkeeping

International Nuclear Information System (INIS)

Nelson, George W.

1978-01-01

Several computer programs have been developed at the University of Arizona to assist the direction and operation of the TRIGA Reactor Laboratory. The programs fall into the following three categories: 1. Programs for calculation of burnup of each fuel element in the reactor core, for maintaining an inventory of fuel element location and fissile content at any time, and for evaluation of the reactivity effects of burnup or proposed fuel element rearrangement in the core. 2. Programs for evaluation, function fitting, and tabulation of control rod measurements. 3. Bookkeeping programs to summarize and tabulate reactor runs and irradiations according to time, energy release, purpose, responsible party, etc. These summarized data are reported in an annual operating report for the facility. The use of these programs has saved innumerable hours of repetitious work, assuring more accurate, objective results, and requiring a minimum of effort to repeat calculations when input data are modified. The programs are written in FORTRAN-IV, and have been used on a CDC-6400 computer. (author)

Experiential Education and Empowerment Evaluation: Mars Rover Educational Program Case Example.

Science.gov (United States)

Fetterman, David; Bowman, Cassie

2002-01-01

Empowerment evaluation helps people improve their programs using self-evaluation. Empowerment evaluation has three steps: establishing a mission; taking stock of the most significant activities; and planning for the future by establishing goals, strategies, and criteria for evidence. A NASA experiential program for small, distributed groups of…

The Role of Ethnographic Interviewing in Climate Change Evaluation Research: Investigating Intended and Unintended program effects

Science.gov (United States)

Lloro-Bidart, T.

2012-12-01

Ethnographic interviewing is an under-utilized tool in climate change evaluation research, even though it has the potential to serve as a powerful method of data collection. The utility of the ethnographic interview lies in its ability to elicit responses from program participants describing what a program is in practice, shedding light on both intended and unintended program impacts. Drawing on evaluation work involving a federally-funded climate change grant at the University of California, Riverside, I will discuss how to design an ethnographic interview protocol in an effort to share "best practices" with other climate change evaluators. Particular attention will be given to applying ethnographic approaches to various program types, even those differing from the one discussed. I will share some of the concrete findings from my work on this grant, to serve as examples of the kinds of data evaluators can collect when employing an ethnographic approach to interviewing. UC Riverside's climate change grant is multi-faceted, however the component studied ethnographically was a science fair mentoring program. About twenty K-12 students from high poverty, ethnically diverse schools who expressed an interest in participating in science fair were paired up with graduate student mentors to simultaneously research climate change and design authentic science fair projects to compete at various levels. Since one of the stated goals of the grant is to "stimulate…students to consider climate science as a career track through experiential education activities" I was particularly interested in how student experiences with the project might differ from school science which has historically "pushed out" ethnically diverse students like those in many of Riverside's schools. (In the program students are able to interact one-on-one with a mentor and in school settings there is typically one teacher for more than thirty students). I also sought to understand student perceptions of

Evaluating a Psychology Graduate Student Peer Mentoring Program

Science.gov (United States)

Fleck, Christina; Mullins, Morell E.

2012-01-01

Research on mentoring outcomes and characteristics of various types of mentoring programs in different settings is limited. The present study sampled 39 graduate students at a small Midwestern university to evaluate peer mentoring in a graduate school setting. Mentoring function and outcome relationships as well as program characteristics were…

Overview of the National Uranium Resource Evaluation Hydrogeochemical and Stream Sediment Reconnaissance Program

International Nuclear Information System (INIS)

Bolivar, S.L.

1980-01-01

A Hydrogeochemical and Stream Sediment Reconnaissance (HSSR) for uranium is currently being conducted throughout the conterminous United States and Alaska. The HSSR is part of the National Uranium Resource Evaluation sponsored by the US Department of Energy. This ambitious geochemical reconnaissance program is conducted by four Department of Energy laboratories: Los Alamos Scientific Laboratory, Lawrence Livermore Laboratory, Oak Ridge Gaseous Diffusion Plant, and Savannah River Laboratory. The program is based on an extensive review of world literature, reconnaissance work done in other countries, and pilot studies conducted by each laboratory. Sample-collection methods and sample density are determined to optimize the probability of detecting potential uranium mineralization. To achieve this aim, each laboratory has developed independent standardized field collection procedures that are designed for its section of the country. Field parameters such as pH, conductivity, climate, geography, and geology are recorded at each site. Most areas are sampled at densities of one sample site per 10 to 23 km 2 . The HSSR program has helped to improve existing hydrogeochemical reconnaissance exploration techniques. In addition to providing industry with data that may help to identify potential uranium districts and to extend known uranium provinces, the HSSR also provides multielement analytical data that can be used in water quality, soil, sediment, environmental, and base-metal exploration studies

Overview of the National Uranium Resource Evaluation Hydrogeochemical and Stream Sediment Reconnaissance Program

International Nuclear Information System (INIS)

Bolivar, S.L.

1980-07-01

A Hydrogeochemical and Stream Sediment Reconnaissance (HSSR) for uranium is currently being conducted throughout the conterminous United States and Alaska. The HSSR is part of the National Uranium Resource Evaluation sponsored by the US Department of Energy. This ambitious geochemical reconnasissance program is conducted by four Department of Energy Laboratories: Los Alamos Scientific Laboratory, Lawrence Livermore Laboratory, Oak Ridge Gaseous Diffusion Plant, and Savannah River Laboratory. Each laboratory was assigned a geographic region of the United States. The program is based on an extensive review of world literature, reconnaissance work done in other countries, and pilot studies conducted by each laboratory. Sample-collection methods and sample density are determined to optimize the probability of detecting potential uranium mineralization. To achieve this aim, each laboratory has developed independent standardized field collection procedures that are designed for its section of the country. Field parameters such as pH, conductivity, climate, geography, and geology are recorded at each site. Most areas are sampled at densities of one sample site per 10 to 23 km 2 . The HSSR program has helped to improve existing hydrogeochemical reconnaissance exploration techniques. In addition to providing industry with data that may help to identify potential uranium districts and to extend known uranium provinces, the HSSR also provides multielement analytical data that can be used in water quality, soil, sediment, environmental, and base-metal exploration studies

The influence of financial incentive programs in promoting sustainable forestry on the nation's family forests

Science.gov (United States)

Michael A. Kilgore; John L. Greene; Michael G. Jacobson; Thomas J. Straka; Steven E. Daniels

2007-01-01

Financial incentive programs were evaluated to assess their contribution to promoting sustainable forestry practices on the nation’s family forests. The evaluation consisted of an extensive review of the literature on financial incentive programs, a mail survey of the lead administrator of financial incentive programs in each state forestry agency, and focus groups...

The management of evaluating the European programs and policies implemented in Romania

Directory of Open Access Journals (Sweden)

Doctoral student ROMAN MIHAELA

2011-12-01

Full Text Available Starting with the reform and modernization of the public administration in Romania in the mid 1990s, an important element of this process being the development of the management process, respectively of planning and managing public policies, the Romanian government started also a process of developing the capacity for evaluating public programs and policies, both the ones with European or foreign financing and the ones with domestic financing. Up-to-date analyses and studies have showed, however, that at the level of the national public sector there is a major discrepancy between the progress made in the evaluation of European programs or the ones with foreign financing and the programs financed from public funds, namely that there is a consolidated evaluation practice as regards the first types of programs, which is virtually inexistent as regards programs financed from the public budget.This paper intends to identify the progress made at the level of the Romanian public administration as regards the management of evaluating programs with European financing, to see the characteristics of building the evaluation capacity within the national system of these programs and the motivation stimulating such approaches. The first part of this paper shall contain a presentation of the background of the current evaluation system, including both the legislative framework and the institutional framework with duties of management and evaluation of European programs; further, I shall analyze the evolution of this system in order to be able to draw conclusions regarding the evaluation capacity of Romania.

Evaluation of a cross-cultural training program for Pakistani educators: Lessons learned and implications for program planning.

Science.gov (United States)

Mazur, Rebecca; Woodland, Rebecca H

2017-06-01

In this paper, we share the results of a summative evaluation of PEILI, a US-based adult professional development/training program for secondary school Pakistani teachers. The evaluation was guided by the theories of cultural competence (American Psychological Association, 2003; Bamberger, 1999; Wadsworth, 2001) and established frameworks for the evaluation of professional development/training and instructional design (Bennett, 1975; Guskey, 2002; King, 2014; Kirkpatrick, 1967). The explicit and implicit stakeholder assumptions about the connections between program resources, activities, outputs, and outcomes are described. Participant knowledge and skills were measured via scores on a pre/posttest of professional knowledge, and a standards-based performance assessment rubric. In addition to measuring short-term program outcomes, we also sought to incorporate theory-driven thinking into the evaluation design. Hence, we examined participant self-efficacy and access to social capital, two evidenced-based determinants or "levers" that theoretically explain the transformative space between an intervention and its outcomes (Chen, 2012). Data about program determinants were collected and analyzed through a pre/posttest of self-efficacy and social network analysis. Key evaluation findings include participant acquisition of new instructional skills, increased self-efficacy, and the formation of a nascent professional support network. Lessons learned and implications for the design and evaluation of cross-cultural teacher professional development programs are discussed. Copyright © 2017 Elsevier Ltd. All rights reserved.

Evaluation of a Hospital-Based Pneumonia Nurse Navigator Program.

Science.gov (United States)

Seldon, Lisa E; McDonough, Kelly; Turner, Barbara; Simmons, Leigh Ann

2016-12-01

The aim of this study is to evaluate the effectiveness of a hospital-based pneumonia nurse navigator program. This study used a retrospective, formative evaluation. Data of patients admitted from January 2012 through December 2014 to a large community hospital with a primary or secondary diagnosis of pneumonia, excluding aspiration pneumonia, were used. Data included patient demographics, diagnoses, insurance coverage, core measures, average length of stay (ALOS), disposition, readmission rate, financial outcomes, and patient barriers to care were collected. Descriptive statistics and parametric testing were used to analyze data. Core measure performance was sustained at the 90th percentile 2 years after the implementation of the navigator program. The ALOS did not decrease to established benchmarks; however, the SD for ALOS decreased by nearly half after implementation of the navigator program, suggesting the program decreased the number and length of extended stays. Charges per case decreased by 21% from 2012 to 2014. Variable costs decreased by 4% over a 2-year period, which increased net profit per case by 5%. Average readmission payments increased by 8% from 2012 to 2014, and the net revenue per case increased by 8.3%. The pneumonia nurse navigator program may improve core measures, reduce ALOS, and increase net revenue. Future evaluations are necessary to substantiate these findings and optimize the cost and quality performance of navigator programs.

Beyond Customer Satisfaction: Reexamining Customer Loyalty to Evaluate Continuing Education Programs

Science.gov (United States)

Hoyt, Jeff E.; Howell, Scott L.

2011-01-01

This article provides questionnaire items and a theoretical model of factors predictive of customer loyalty for use by administrators to determine ways to increase repeat purchasing in their continuing education programs. Prior studies in the literature are discussed followed by results of applying the model at one institution and a discussion of…

Space Discovery: Teaching with Space. Evaluation: Summer, Fall 1998 Programs

Science.gov (United States)

Ewell, Bob

1998-01-01

This is the final report of the 1998 NASA-sponsored evaluation of the effectiveness of the United States Space Foundation's five-day Space Discovery Standard Graduate Course (Living and Working in Space), the five-day Space Discovery Advanced Graduate Course (Advanced Technology and Biomedical Research), the five-day introductory course Aviation and Space Basics all conducted during the summer of 1998, and the Teaching with Space two-day Inservice program. The purpose of the program is to motivate and equip K- 12 teachers to use proven student-attracting space and technology concepts to support standard curriculum. These programs support the America 2000 National Educational Goals, encouraging more students to stay in school, increase in competence, and have a better opportunity to be attracted to math and science. The 1998 research program continues the comprehensive evaluation begun in 1992, this year studying five summer five-day sessions and five Inservice programs offered during the Fall of 1998 in California, Colorado, New York, and Virginia. A comprehensive research design by Dr. Robert Ewell of Creative Solutions and Dr. Darwyn Linder of Arizona State University evaluated the effectiveness of various areas of the program and its applicability on diverse groups. Preliminary research methodology was a set of survey instruments administered after the courses, and another to be sent in April-4-5 months following the last inservice involved in this study. This year, we have departed from this evaluation design in two ways. First, the five-day programs used NASA's new EDCATS on-line system and associated survey rather than the Linder/Ewell instruments. The Inservice programs were evaluated using the previously developed survey adapted for Inservice programs. Second, we did not do a follow-on survey of the teachers after they had been in the field as we have done in the past. Therefore, this evaluation captures only the reactions of the teachers to the programs

Evaluating a food bank recipe-tasting program.

Science.gov (United States)

Keller-Olaman, Susan J; Edwards, Vicki; Elliott, Susan J

2005-01-01

Food banks mitigate immediate food insecurity, but their ability to promote healthy nutrition is constrained by how often recipients may visit and the range of foods available. In a descriptive study, a formative evaluation was completed of a combined heart-healthy recipe-tasting and education program that aims to promote healthy eating knowledge and skills in a group of food bank recipients in Hamilton, Ontario. Fifty-five adults were surveyed about food bank attendance, program awareness, perceived enhancement of knowledge and skills, and suggestions for program improvement. Most participants (73%) were positive about the program, and 91% wanted the program to continue. In addition, 78% would prepare the recipes sampled. In contrast, program awareness and planning food bank visits to coincide with the program were generally low. Food banks are potential sites for effective nutrition promotion programs. To reach more recipients, more frequent implementation and seeking the use of a designated room are suggested for the current program. The findings also suggest that the sampling approach to promoting healthy eating to food bank recipients deserves further study. For example, monitoring the selection of featured recipe ingredients would be a useful indicator of behaviour.

Evaluation Methodologies for Estimating the Likelihood of Program Implementation Failure

Science.gov (United States)

Durand, Roger; Decker, Phillip J.; Kirkman, Dorothy M.

2014-01-01

Despite our best efforts as evaluators, program implementation failures abound. A wide variety of valuable methodologies have been adopted to explain and evaluate the "why" of these failures. Yet, typically these methodologies have been employed concurrently (e.g., project monitoring) or to the post-hoc assessment of program activities.…

A literature review for large-scale health information system project planning, implementation and evaluation.

Science.gov (United States)

Sligo, Judith; Gauld, Robin; Roberts, Vaughan; Villa, Luis

2017-01-01

Information technology is perceived as a potential panacea for healthcare organisations to manage pressure to improve services in the face of increased demand. However, the implementation and evaluation of health information systems (HIS) is plagued with problems and implementation shortcomings and failures are rife. HIS implementation is complex and relies on organisational, structural, technological, and human factors to be successful. It also requires reflective, nuanced, multidimensional evaluation to provide ongoing feedback to ensure success. This article provides a comprehensive review of the literature about evaluating and implementing HIS, detailing the challenges and recommendations for both evaluators and healthcare organisations. The factors that inhibit or promote successful HIS implementation are identified and effective evaluation strategies are described with the goal of informing teams evaluating complex HIS. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Secondary Education Programs in Kuwait: An Evaluation Study

Science.gov (United States)

Eid, Ghada K.; Koushki, Parviz A.

2005-01-01

This paper evaluates the effectiveness of the semester and the credit programs of high school education in Kuwait in terms of their graduating students' preparedness for continued and successful academic performance in programs of higher education. Students' percentile graduation rank from high school and their performances in the English, math…

Using Program Theory-Driven Evaluation Science to Crack the Da Vinci Code

Science.gov (United States)

Donaldson, Stewart I.

2005-01-01

Program theory-driven evaluation science uses substantive knowledge, as opposed to method proclivities, to guide program evaluations. It aspires to update, clarify, simplify, and make more accessible the evolving theory of evaluation practice commonly referred to as theory-driven or theory-based evaluation. The evaluator in this chapter provides a…

Systematic evaluation program, status summary report

International Nuclear Information System (INIS)

1983-01-01

Status reports are presented on the systematic evaluation program for the Big Rock Point reactor, Dresden-1 reactor, Dresden-2 reactor, Ginna-1 reactor, Connecticut Yankee reactor, LACBWR reactor, Millstone-1 reactor, Oyster Creek-1 reactor, Palisades-1 reactor, San Onofre-1 reactor, and Rowe Yankee reactor

The evaluation of a digital information literacy program

Directory of Open Access Journals (Sweden)

Anne Sieberhagen

2012-10-01

Full Text Available The article reports on the evaluation of a digital information literacy program (DILP to determine the program’s effectiveness in enhancing students’ digital information literacy skills. The DILP was originally designed and developed for the South African student, as member of Generation Y, but was adapted after identifying the demographics and characteristics of Generation Z.  This information was incorporated in the existing DILP, therefore making the DILP applicable to and useful for both Generations Y and Z. New learning technologies were identified and incorporated in the DILP to enhance students’ learning experience. An analysis of reported research indicated that there is a lack in the evaluation of programs to determine their effectiveness in enhancing the digital information literacy skills of students by using an outcomes assessment instrument. The development of an outcomes assessment instrument, which is based on internationally benchmarked information literacy competency standards and their outcomes, are presented. Evidence is provided of the effectiveness of the program in order to prove its worth as an instructional program.  Recommendations are made on how digital information literacy programs may be improved to be more effective in enhancing students’ digital information literacy skills

Iterative Evaluation in a Mobile Counseling and Testing Program to Reach People of Color at Risk for HIV--New Strategies Improve Program Acceptability, Effectiveness, and Evaluation Capabilities

Science.gov (United States)

Spielberg, Freya; Kurth, Ann; Reidy, William; McKnight, Teka; Dikobe, Wame; Wilson, Charles

2011-01-01

This article highlights findings from an evaluation that explored the impact of mobile versus clinic-based testing, rapid versus central-lab based testing, incentives for testing, and the use of a computer counseling program to guide counseling and automate evaluation in a mobile program reaching people of color at risk for HIV. The program's…

Defence Health Service Mentoring Program Evaluation 2001

National Research Council Canada - National Science Library

Highfield, Jane

2002-01-01

...). DHS commissioned the Directorate of Strategic Personnel Planning and Research (DSPPR) to evaluate a recent Mentoring Program trial in order to assess the effectiveness and organizational value of Mentoring within DHS...

National Uranium Resource Evaluation Program: the Hydrogeochemical Stream Sediment Reconnaissance Program at LLNL

International Nuclear Information System (INIS)

Higgins, G.H.

1980-08-01

From early 1975 to mid 1979, Lawrence Livermore National Laboratory (LLNL) participated in the Hydrogeochemical Stream Sediment Reconnaissance (HSSR), part of the National Uranium Resource Evaluation (NURE) program sponsored by the Department of Energy (DOE). The Laboratory was initially responsible for collecting, analyzing, and evaluating sediment and water samples from approximately 200,000 sites in seven western states. Eventually, however, the NURE program redefined its sampling priorities, objectives, schedules, and budgets, with the increasingly obvious result that LLNL objectives and methodologies were not compatible with those of the NURE program office, and the LLNL geochemical studies were not relevant to the program goal. The LLNL portion of the HSSR program was consequently terminated, and all work was suspended by June 1979. Of the 38,000 sites sampled, 30,000 were analyzed by instrumental neutron activation analyses (INAA), delayed neutron counting (DNC), optical emission spectroscopy (OES), and automated chloride-sulfate analyses (SC). Data from about 13,000 sites have been formally reported. From each site, analyses were published of about 30 of the 60 elements observed. Uranium mineralization has been identified at several places which were previously not recognized as potential uranium source areas, and a number of other geochemical anomalies were discovered

Development, implementation and evaluation of a clinical research engagement and leadership capacity building program in a large Australian health care service.

Science.gov (United States)

Misso, Marie L; Ilic, Dragan; Haines, Terry P; Hutchinson, Alison M; East, Christine E; Teede, Helena J

2016-01-14

Health professionals need to be integrated more effectively in clinical research to ensure that research addresses clinical needs and provides practical solutions at the coal face of care. In light of limited evidence on how best to achieve this, evaluation of strategies to introduce, adapt and sustain evidence-based practices across different populations and settings is required. This project aims to address this gap through the co-design, development, implementation, evaluation, refinement and ultimately scale-up of a clinical research engagement and leadership capacity building program in a clinical setting with little to no co-ordinated approach to clinical research engagement and education. The protocol is based on principles of research capacity building and on a six-step framework, which have previously led to successful implementation and long-term sustainability. A mixed methods study design will be used. Methods will include: (1) a review of the literature about strategies that engage health professionals in research through capacity building and/or education in research methods; (2) a review of existing local research education and support elements; (3) a needs assessment in the local clinical setting, including an online cross-sectional survey and semi-structured interviews; (4) co-design and development of an educational and support program; (5) implementation of the program in the clinical environment; and (6) pre- and post-implementation evaluation and ultimately program scale-up. The evaluation focuses on research activity and knowledge, attitudes and preferences about clinical research, evidence-based practice and leadership and post implementation, about their satisfaction with the program. The investigators will evaluate the feasibility and effect of the program according to capacity building measures and will revise where appropriate prior to scale-up. It is anticipated that this clinical research engagement and leadership capacity building

Evaluating disease management program effectiveness: an introduction to time-series analysis.

Science.gov (United States)

Linden, Ariel; Adams, John L; Roberts, Nancy

2003-01-01

Currently, the most widely used method in the disease management (DM) industry for evaluating program effectiveness is referred to as the "total population approach." This model is a pretest-posttest design, with the most basic limitation being that without a control group, there may be sources of bias and/or competing extraneous confounding factors that offer a plausible rationale explaining the change from baseline. Furthermore, with the current inclination of DM programs to use financial indicators rather than program-specific utilization indicators as the principal measure of program success, additional biases are introduced that may cloud evaluation results. This paper presents a non-technical introduction to time-series analysis (using disease-specific utilization measures) as an alternative, and more appropriate, approach to evaluating DM program effectiveness than the current total population approach.

Increasing the use of evaluation data collection in an EPO program

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dordevic, M.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D.; Welti, R.; Davis, H. B.

2017-12-01

Over the past two years, the Incorporated Research Institutions for Seismology Education and Public Outreach (EPO) program has sought to increase the evaluation rigor of its programs and products. Specifically we sought to make evaluation an integral part of our work; enabling staff to demonstrate why we do the activities we do, enhancing the impact or our products/programs, and empowering staff to make evidence-based claims. The Collaborative Impact Analysis Method (Davis and Scalice, 2015) was selected as it allowed us to combine staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make improvements to the programs over time. A key part of the initial action plans has been the collection and analysis of new evaluation data. The most frequently used tools were surveys as they were relatively straightforward to implement and analyze, and could be adapted for different situations. Examples include: brand awareness, value of booth interactions, assessing community interest in a data app, and user surveys of social media and specific web pages. Other evaluation activities included beta testing of new software, and interviews with students and faculty involved in summer field experiences. The surveys have allowed us to document increased impact in some areas, to improve the usability of products and activities, and to provide baseline impact data. The direct involvement of staff in the process has helped staff appreciate the value of evaluation, but there are also challenges to this approach. Since many of the surveys are developed and conducted by EPO staff, rather than being primarily handled by the evaluator, the process takes considerably more staff time to implement. We are still determining how to best manage and present the data and analysis; our current approach

Process evaluation of the Regional Biomass Energy Program

Energy Technology Data Exchange (ETDEWEB)

Wilson, C.R.; Brown, M.A.; Perlack, R.D.

1994-03-01

The U.S. Department of Energy (DOE) established the Regional Biomass Energy Program (RBEP) in 1983 to increase the production and use of biomass energy resources. Through the creation of five regional program (the Great Lakes, Northeast, Pacific Northwest, Southeast, and West), the RBEP focuses on regionally specific needs and opportunities. In 1992, Oak Ridge National (ORNL) conducted a process evaluation of the RBEP Program designed to document and explain the development of the goals and strategies of the five regional programs; describe the economic and market context surrounding commercialization of bioenergy systems; assess the criteria used to select projects; describe experiences with cost sharing; identify program accomplishments in the transfer of information and technology; and offer recommendations for program improvement.

29 CFR 1960.80 - Secretary's evaluations of agency occupational safety and health programs.

Science.gov (United States)

2010-07-01

... EMPLOYEE OCCUPATIONAL SAFETY AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs § 1960.80 Secretary's evaluations of agency occupational safety and health... evaluating an agency's occupational safety and health program. To accomplish this, the Secretary shall...

Handbook of evaluation of utility DSM programs. [Demand-Side Management (DSM)

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. (eds.); Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility's portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to triangulate'' an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-01-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers

NARCIS (Netherlands)

van Holland, Berry; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component.

Objective Evaluation in an Online Geographic Information System Certificate Program

Directory of Open Access Journals (Sweden)

Scott L. WALKER

2005-01-01

Full Text Available Objective Evaluation in an Online Geographic Information System Certificate Program Asst. Professor. Dr. Scott L. WALKER Texas State University-San Marcos San Marcos, Texas, USA ABSTRACT Departmental decisions regarding distance education programs can be subject to subjective decision-making processes influenced by external factors such as strong faculty opinions or pressure to increase student enrolment. This paper outlines an evaluation of a departmental distance-education program. The evaluation utilized several methods that strived to inject objectivity in evaluation and subsequent decision-making. A rapid multi-modal approach included evaluation methods of (1 considering the online psychosocial learning environment, (2 content analyses comparing the online version of classes to face-to-face versions, (3 cost comparisons in online vs. face-to-face classes, (4 student outcomes, (5 student retention, and (6 benchmarking. These approaches offer opportunities for departmental administrators and decision-making committees to make judgments informed by facts rather than being influenced by the emotions, beliefs, or opinions of organizational dynamics.

EVALUATION OF OXYGEN-ENRICHED MSW/SEWAGE SLUDGE CO-INCINERATION DEMONSTRATION PROGRAM

Science.gov (United States)

This report provides an evaluation of a two-phased demonstration program conducted for the U.S. Environmental Protection Agency's Municipal Solid Waste Innovative Technology Evaluation Program, and the results thereof, of a recently developed method of sewage sludge managemen...

Mentoring programs for underrepresented minority faculty in academic medical centers: a systematic review of the literature.

Science.gov (United States)

Beech, Bettina M; Calles-Escandon, Jorge; Hairston, Kristen G; Langdon, Sarah E; Latham-Sadler, Brenda A; Bell, Ronny A

2013-04-01

Mentoring is critical for career advancement in academic medicine. However, underrepresented minority (URM) faculty often receive less mentoring than their nonminority peers. The authors conducted a comprehensive review of published mentoring programs designed for URM faculty to identify "promising practices." Databases (PubMed, PsycINFO, ERIC, PsychLit, Google Scholar, Dissertations Abstracts International, CINHAL, Sociological Abstracts) were searched for articles describing URM faculty mentoring programs. The RE-AIM framework (Reach, Effectiveness, Adoption, Implementation, and Maintenance) formed the model for analyzing programs. The search identified 73 citations. Abstract reviews led to retrieval of 38 full-text articles for assessment; 18 articles describing 13 programs were selected for review. The reach of these programs ranged from 7 to 128 participants. Most evaluated programs on the basis of the number of grant applications and manuscripts produced or satisfaction with program content. Programs offered a variety of training experiences, and adoption was relatively high, with minor changes made for implementing the intended content. Barriers included time-restricted funding, inadequate evaluation due to few participants, significant time commitments required from mentors, and difficulty in addressing institutional challenges faced by URM faculty. Program sustainability was a concern because programs were supported through external funds, with minimal institutional support. Mentoring is an important part of academic medicine, particularly for URM faculty who often experience unique career challenges. Despite this need, relatively few publications exist to document mentoring programs for this population. Institutionally supported mentoring programs for URM faculty are needed, along with detailed plans for program sustainability.

Program Evaluation in Cost Benefit Terms.

Science.gov (United States)

Tanner, C. Kenneth

This paper advances a model, called the expected opportunity loss model, for curriculum evaluation. This decision-making technique utilizes subjective data by ranking courses according to their expected contributions to the primary objective of the total program. The model also utilizes objective data in the form of component costs, and differs…

Status of beta measurement evaluation and upgrade program

International Nuclear Information System (INIS)

Swinth, K.L.

1986-01-01

In 1983, the US Department of Energy (DOE) initiated a program to evaluate and upgrade beta dosimetry capabilities at DOE and DOE-contractor facilities. The program has several elements which structure the development of improvements in beta measurement practices. In addition to Pacific Northwest Laboratory (PNL), universities, private corporations, and other DOE facilities are involved in the research efforts

Evaluation of a quality control program in radiodiagnosis

International Nuclear Information System (INIS)

Yacovenco, Alejandro; Infantosi, A.F.C.; Tauhata, L.

1996-01-01

A quality assurance program, implemented at the Radiologic Service of the Hospital of the Military Police in Rio de Janeiro, Brazil, is evaluated. The results show a reduction around of 70% in the number of rejected films and 75% in the costs. A return to the former conditions is reported as after the discontinuation of the program

Using program logic model analysis to evaluate and better deliver what works

International Nuclear Information System (INIS)

Megdal, Lori; Engle, Victoria; Pakenas, Larry; Albert, Scott; Peters, Jane; Jordan, Gretchen

2005-01-01

There is a rich history in using program theories and logic models (PT/LM) for evaluation, monitoring, and program refinement in a variety of fields, such as health care, social and education programs. The use of these tools to evaluate and improve energy efficiency programs has been growing over the last 5-7 years. This paper provides an overview of the state-of-the-art methods of logic model development, with analysis that significantly contributed to: Assessing the logic behind how the program expects to be able to meets its ultimate goals, including the 'who', the 'how', and through what mechanism. In doing so, gaps and questions that still need to be addressed can be identified. Identifying and prioritize the indicators that should be measured to evaluate the program and program theory. Determining key researchable questions that need to be answered by evaluation/research, to assess whether the mechanism assumed to cause the changes in actions, attitudes, behaviours, and business practices is workable and efficient. Also will assess the validity in the program logic and the likelihood that the program can accomplish its ultimate goals. Incorporating analysis of prior like programs and social science theories in a framework to identify opportunities for potential program refinements. The paper provides an overview of the tools, techniques and references, and uses as example the energy efficiency program analysis conducted for the New York State Energy Research and Development Authority's (NYSERDA) New York ENERGY $MART SM programs

46 XX karyotype during male fertility evaluation; case series and literature review

Directory of Open Access Journals (Sweden)

Ahmad Majzoub

2017-01-01

Full Text Available Forty-six XX disorder of sex development is an uncommon medical condition observed at times during the evaluation of a man′s fertility. The following is a case series and literature review of phenotypically normal men diagnosed with this karyotype. Our goal is to comprehend the patients′ clinical presentation as well as their laboratory results aiming to explore options available for their management. A formal literature review through PubMed and MEDLINE databases was performed using "46 XX man" as a word search. A total of 55 patients, including those conveyed in this article were diagnosed with a 46 XX karyotype during their fertility evaluation. The patients′ mean age ± s.d. was 34 ± 10 years and their mean height ± s.d. was 166 ± 6.5 cm. Overall, they presented with hypergonadotropic hypogonadism. Sexual dysfunction, reduced hair distribution, and gynecomastia were reported in 20% (4/20, 25.8% (8/31, and 42% (13/31 of the patients, respectively. The SRY gene was detected in 36 (83.7% and was absent in the remaining seven (16.3% patients. We found that a multidisciplinary approach to management is preferred in 46 XX patients. Screening for remnants of the mullerian ducts and for malignant transformation in dysgenetic gonads is imperative. Hypogonadism should be addressed, while fertility options are in vitro fertilization with donor sperm or adoption.

Evaluating public involvement in the National Low-Level Radioactive Waste Management Program

International Nuclear Information System (INIS)

1982-09-01

The Department of Energy contracted with the Keystone Center to evaluate the effectiveness of the National Low-Level Radioactive Waste Management Program's public-involvement efforts. The Center chose six evaluators with diverse training and experience related to low-level waste management and public-participation programs. Keystone's evaluation was based on (a) observations by the evaluators who attended the National Program-sponsored strategy review meetings and fairs; (b) interviews with low-level waste generators, local government officials, state legislators, public-interest groups, and members of the general public; and (c) observations of the final National Program strategy task force meeting. The evaluators concluded that, overall, the public-participation processes yielded some very positive results - for policy development and for DOE and the EG and G staff. They judged the strategy document to be complete, concise, and helpful to public dialogue on low-level waste issues. They also made specific recommendations for improvements to the public-participation program

29 CFR 1960.79 - Self-evaluations of occupational safety and health programs.

Science.gov (United States)

2010-07-01

... 29 Labor 9 2010-07-01 2010-07-01 false Self-evaluations of occupational safety and health programs. 1960.79 Section 1960.79 Labor Regulations Relating to Labor (Continued) OCCUPATIONAL SAFETY AND HEALTH... AND HEALTH PROGRAMS AND RELATED MATTERS Evaluation of Federal Occupational Safety and Health Programs...

A Review of Financial-Literacy Education Programs for Children and Adolescents

Science.gov (United States)

Amagir, Aisa; Groot, Wim; Maassen van den Brink, Henriëtte; Wilschut, Arie

2018-01-01

In this systematic literature review, we evaluate the effectiveness of financial-literacy education programs and interventions for children and adolescents. Furthermore, the key characteristics of the design of a successful financial-education curriculum are described. The evidence shows that school-based financial-education programs can improve…

The Evaluation Market in Germany: Estimating Market Size for Evaluation of Political Programs

Science.gov (United States)

Lowenbein, Oded

2008-01-01

The United States has a long tradition in evaluation of political programs. In the 1930s and 1940s, programs were initiated to reduce unemployment and improve social security as part of the "New Deal." In the late 1960s, somewhat comparable to the U. S. at that time, Germany's new government started its own "New Deal."…

AAAS Communicating Science Program: Reflections on Evaluation

Science.gov (United States)

Braha, J.

2015-12-01

The AAAS Center for Public Engagement (Center) with science builds capacity for scientists to engage public audiences by fostering collaboration among natural or physical scientists, communication researchers, and public engagement practitioners. The recently launched Leshner Leadership Institute empowers cohorts of mid-career scientists to lead public engagement by supporting their networks of scientists, researchers, and practitioners. The Center works closely with social scientists whose research addresses science communication and public engagement with science to ensure that the Communicating Science training program builds on empirical evidence to inform best practices. Researchers ( Besley, Dudo, & Storkdieck 2015) have helped Center staff and an external evaluator develop pan instrument that measures progress towards goals that are suggested by the researcher, including internal efficacy (increasing scientists' communication skills and confidence in their ability to engage with the public) and external efficacy (scientists' confidence in engagement methods). Evaluation results from one year of the Communicating Science program suggest that the model of training yields positive results that support scientists in the area that should lead to greater engagement. This talk will explore the model for training, which provides a context for strategic communication, as well as the practical factors, such as time, access to public engagement practitioners, and technical skill, that seems to contribute to increased willingness to engage with public audiences. The evaluation program results suggest willingness by training participants to engage directly or to take preliminary steps towards engagement. In the evaluation results, 38% of trained scientists reported time as a barrier to engagement; 35% reported concern that engagement would distract from their work as a barrier. AAAS works to improve practitioner-researcher-scientist networks to overcome such barriers.

Planning for the next generation of public health advocates: evaluation of an online advocacy mentoring program.

Science.gov (United States)

O'Connell, Emily; Stoneham, Melissa; Saunders, Julie

2016-04-01

Issue addressed Despite being viewed as a core competency for public health professionals, public health advocacy lacks a prominent place in the public health literature and receives minimal coverage in university curricula. The Public Health Advocacy Institute of Western Australia (PHAIWA) sought to fill this gap by establishing an online e-mentoring program for public health professionals to gain knowledge through skill-based activities and engaging in a mentoring relationship with an experienced public health advocate. This study is a qualitative evaluation of the online e-mentoring program. Methods Semi-structured interviews were conducted with program participants at the conclusion of the 12-month program to examine program benefits and determine the perceived contribution of individual program components to overall advocacy outcomes. Results Increased mentee knowledge, skills, level of confidence and experience, and expanded public health networks were reported. Outcomes were dependent on participants' level of commitment, time and location barriers, mentoring relationship quality, adaptability to the online format and the relevance of activities for application to participants' workplace context. Program facilitators had an important role through the provision of timely feedback and maintaining contact with participants. Conclusion An online program that combines public health advocacy content via skill-based activities with mentoring from an experienced public health advocate is a potential strategy to build advocacy capacity in the public health workforce. So what? Integrating advocacy as a core component of professional development programs will help counteract current issues surrounding hesitancy by public health professionals to proactively engage in advocacy, and ensure that high quality, innovative and effective advocacy leadership continues in the Australian public health workforce.

Implementing and evaluating a program to facilitate chronic disease prevention and screening in primary care: a mixed methods program evaluation.

Science.gov (United States)

Manca, Donna Patricia; Aubrey-Bassler, Kris; Kandola, Kami; Aguilar, Carolina; Campbell-Scherer, Denise; Sopcak, Nicolette; O'Brien, Mary Ann; Meaney, Christopher; Faria, Vee; Baxter, Julia; Moineddin, Rahim; Salvalaggio, Ginetta; Green, Lee; Cave, Andrew; Grunfeld, Eva

2014-10-08

The objectives of this paper are to describe the planned implementation and evaluation of the Building on Existing Tools to Improve Chronic Disease Prevention and Screening in Primary Care (BETTER 2) program which originated from the BETTER trial. The pragmatic trial, informed by the Chronic Care Model, demonstrated the effectiveness of an approach to Chronic Disease Prevention and Screening (CDPS) involving the use of a new role, the prevention practitioner. The desired goals of the program are improved clinical outcomes, reduction in the burden of chronic disease, and improved sustainability of the health-care system through improved CDPS in primary care. The BETTER 2 program aims to expand the implementation of the intervention used in the original BETTER trial into communities across Canada (Alberta, Ontario, Newfoundland and Labrador, the Northwest Territories and Nova Scotia). This proactive approach provides at-risk patients with an intervention from the prevention practitioner, a health-care professional. Using the BETTER toolkit, the prevention practitioner determines which CDPS actions the patient is eligible to receive, and through shared decision-making and motivational interviewing, develops a unique and individualized 'prevention prescription' with the patient. This intervention is 1) personalized; 2) addressing multiple conditions; 3) integrated through linkages to local, regional, or national resources; and 4) longitudinal by assessing patients over time. The BETTER 2 program brings together primary care providers, policy/decision makers and researchers to work towards improving CDPS in primary care. The target patient population is adults aged 40-65. The reach, effectiveness, adoption, implementation, maintain (RE-AIM) framework will inform the evaluation of the program through qualitative and quantitative methods. A composite index will be used to quantitatively assess the effectiveness of the prevention practitioner intervention. The CDPS actions

The SBIRT program matrix: a conceptual framework for program implementation and evaluation.

Science.gov (United States)

Del Boca, Frances K; McRee, Bonnie; Vendetti, Janice; Damon, Donna

2017-02-01

Screening, Brief Intervention and Referral to Treatment (SBIRT) is a comprehensive, integrated, public health approach to the delivery of services to those at risk for the adverse consequences of alcohol and other drug use, and for those with probable substance use disorders. Research on successful SBIRT implementation has lagged behind studies of efficacy and effectiveness. This paper (1) outlines a conceptual framework, the SBIRT Program Matrix, to guide implementation research and program evaluation and (2) specifies potential implementation outcomes. Overview and narrative description of the SBIRT Program Matrix. The SBIRT Program Matrix has five components, each of which includes multiple elements: SBIRT services; performance sites; provider attributes; patient/client populations; and management structure and activities. Implementation outcomes include program adoption, acceptability, appropriateness, feasibility, fidelity, costs, penetration, sustainability, service provision and grant compliance. The Screening, Brief Intervention and Referral to Treatment Program Matrix provides a template for identifying, classifying and organizing the naturally occurring commonalities and variations within and across SBIRT programs, and for investigating which variables are associated with implementation success and, ultimately, with treatment outcomes and other impacts. © 2017 Society for the Study of Addiction.

Alternative Aviation Jet Fuel Sustainability Evaluation Report Task 1 : Report Evaluating Existing Sustainability Evaluation Programs

Science.gov (United States)

2011-10-25

This report describes how existing biofuel sustainability evaluation programs meet requirements that are under consideration or are in early phases of adoption and implementation in various US and international contexts. Biofuel sustainability evalua...

A user's guide to the disease management literature: recommendations for reporting and assessing program outcomes.

Science.gov (United States)

Linden, Ariel; Roberts, Nancy

2005-02-01

Recently there has been tremendous growth in the number of lay-press articles and peer-reviewed journal articles reporting extraordinary improvements in health status and financial outcomes due to disease management (DM) interventions. However, closer scrutiny of these reports reveals serious flaws in research design and/or analysis, leaving many to question the veracity of the claims. In recent years, there have been numerous contributions to the literature on how to assess the quality of medical research papers. However, these guidelines focus primarily on randomized controlled trials, with little attention given to the observational study designs typically used in DM outcome studies. As such, general guides to evaluating the medical literature are inadequate in their utility to assist authors and readers of DM outcomes research. The purpose of this paper is to provide authors with a clear and comprehensive guide to the reporting of DM outcomes, as well as to educate readers of the DM literature (both lay and peer reviewed) in how to assess the quality of the findings presented.

Hanford performance evaluation program for Hanford site analytical services

International Nuclear Information System (INIS)

Markel, L.P.

1995-09-01

The U.S. Department of Energy (DOE) Order 5700.6C, Quality Assurance, and Title 10 of the Code of Federal Regulations, Part 830.120, Quality Assurance Requirements, states that it is the responsibility of DOE contractors to ensure that ''quality is achieved and maintained by those who have been assigned the responsibility for performing the work.'' Hanford Analytical Services Quality Assurance Plan (HASQAP) is designed to meet the needs of the Richland Operations Office (RL) for maintaining a consistent level of quality for the analytical chemistry services provided by contractor and commmercial analytical laboratory operations. Therefore, services supporting Hanford environmental monitoring, environmental restoration, and waste management analytical services shall meet appropriate quality standards. This performance evaluation program will monitor the quality standards of all analytical laboratories supporting the Hanforad Site including on-site and off-site laboratories. The monitoring and evaluation of laboratory performance can be completed by the use of several tools. This program will discuss the tools that will be utilized for laboratory performance evaluations. Revision 0 will primarily focus on presently available programs using readily available performance evaluation materials provided by DOE, EPA or commercial sources. Discussion of project specific PE materials and evaluations will be described in section 9.0 and Appendix A

Evaluation of Medical Education virtual Program: P3 model.

Science.gov (United States)

Rezaee, Rita; Shokrpour, Nasrin; Boroumand, Maryam

2016-10-01

In e-learning, people get involved in a process and create the content (product) and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76), but they declared technical support as the less desirable part (1.17±1.23). Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

Some relationships between logic programming and multiple-valued logic

International Nuclear Information System (INIS)

Rine, D.C.

1986-01-01

There have been suggestions in the artificial intelligence literature that investigations into relationships between logic programming and multiple-valued logic may be helpful. This paper presents some of these relationships through equivalent algebraic evaluations

Theory-Based Evaluation Meets Ambiguity

DEFF Research Database (Denmark)

Dahler-Larsen, Peter

2017-01-01

As theory-based evaluation (TBE) engages in situations where multiple stakeholders help develop complex program theory about dynamic phenomena in politically contested settings, it becomes difficult to develop and use program theory without ambiguity. The purpose of this article is to explore...... ambiguity as a fruitful perspective that helps TBE face current challenges. Literatures in organization theory and political theory are consulted in order to cultivate the concept of ambiguity. Janus variables (which work in two ways) and other ambiguous aspects of program theories are classified...... and exemplified. Stances towards ambiguity are considered, as are concrete steps that TBE evaluators can take to identify and deal with ambiguity in TBE....

Teaching English Through Literature

Directory of Open Access Journals (Sweden)

Murat Hişmanoğlu

2005-04-01

Full Text Available This paper aims at emphasizing the use of literature as a popular technique for teaching both basiclanguage skills (i.e. reading, writing, listening and speaking and language areas (i.e. vocabulary,grammar and pronunciation in our times. Reasons for using literary texts in foreign language classroomand main criteria for selecting suitable literary texts in foreign language classes are stressed so as tomake the reader familiar with the underlying reasons and criteria for language teachers’ using andselecting literary texts. Moreover, literature and the teaching of language skills, benefits of differentgenres of literature (i.e. poetry, short fiction, drama and novel to language teaching and some problemsencountered by language teachers within the area of teaching English through literature (i.e. lack ofpreparation in the area of literature teaching in TESL / TEFL programs, absence of clear-cut objectivesdefining the role of literature in ESL / EFL, language teachers’ not having the background and trainingin literature, lack of pedagogically-designed appropriate materials that can be used by language teachersin a classroom context are taken into account.

Traffic Control Device Evaluation Program : FY 2017

Science.gov (United States)

2018-03-01

This report presents findings on the activities conducted in the Traffic Control Device Evaluation Program during the 2017 fiscal year. The research on sponsored changeable message signs (continued from the previous year) was terminated by the Federa...

The attitude of health care professionals towards accreditation: A systematic review of the literature

Directory of Open Access Journals (Sweden)

Abdullah Alkhenizan

2012-01-01

Full Text Available Accreditation is usually a voluntary program, in which authorized external peer reviewers evaluate the compliance of a health care organization with pre-established performance standards. The aim of this study was to systematically review the literature of the attitude of health care professionals towards professional accreditation. A systematic search of four databases including Medline, Embase, Healthstar, and Cinhal presented seventeen studies that had evaluated the attitudes of health care professionals towards accreditation. Health care professionals had a skeptical attitude towards accreditation. Owners of hospitals indicated that accreditation had the potential of being used as a marketing tool. Health care professionals viewed accreditation programs as bureaucratic and demanding. There was consistent concern, especially in developing countries, about the cost of accreditation programs and their impact on the quality of health care services.

Evaluating Extension Based Leadership Development Programs in the Southern United States

Science.gov (United States)

Lamm, Kevan W.; Carter, Hannah S.; Lamm, Alexa J.

2016-01-01

The ability to evaluate and accurately articulate the outcomes associated with leadership development programs is critical to their continued financial and administrative support. With calls for outcome-based accountability, the need for rigorous evaluation is particularly relevant for those programs administered through the Cooperative Extension…

Teaching Program Evaluation on Interactive Television.

Science.gov (United States)

McNeil, Keith; Steinhauser, Jim; Newman, Isadore

This paper describes a five-session course entitled "Program Evaluation," which was taught via interactive television in the summer of 2002 to 68 doctoral and master's students in 5 of 6 locations throughout New Mexico. Students received a 4-hour lecture and then participated in off-line activities directed by the instructor. Problems in distance…

Towards Bridging the Gap Programming Language and Partial Evaluation

DEFF Research Database (Denmark)

Le Meur, Anne-Francoise; Lawall, Julia Laetitia; Consel, Charles

2002-01-01

Partial evaluation is a program-transformation technique that automatically specializes a program with respect to user-supplied invariants. Despite successful applications in areas such as graphics, operating systems, and software engineering, partial evaluators have yet to achieve widespread use....... One reason is the difficulty of adequately describing specialization opportunities. Indeed, under-specialization or over-specialization often occurs, without any direct feedback to the user as to the source of the problem.We have developed a high-level, module-based language allowing the programmer...... to guide the choice of both the code to specialize and the invariants to exploit during the specialization process. To ease the use of partial evaluation, the syntax of this language is similar to the declaration syntax of the target language of the partial evaluator. To provide feedback to the programmer...

Evaluation of Clark County School District's Alternative Route to Licensure Program from the Program Participants' Perspectives

Science.gov (United States)

Kenyon, James J., Jr.

2013-01-01

This evaluation assesses the Alternative Route to Licensure (ARL) program of the Clark County School District (CCSD), in Clark County, Nevada from the program participants' perspectives. The program was implemented to reduce teacher shortages in the school district and allow persons with non-education-related Bachelor's Degrees to obtain teaching…

Process evaluation of a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus.

Science.gov (United States)

Odgers-Jewell, Kate; Isenring, Elisabeth; Thomas, Rae; Reidlinger, Dianne P

2017-07-01

The present study developed and evaluated a patient-centred, patient-directed, group-based education program for the management of type 2 diabetes mellitus. Two frameworks, the Medical Research Council (MRC) framework for developing and evaluating complex interventions and the RE-AIM framework were followed. Data to develop the intervention were sourced from scoping of the literature and formative evaluation. Program evaluation comprised analysis of primary recruitment of participants through general practitioners, baseline and end-point measures of anthropometry, four validated questionnaires, contemporaneous facilitator notes and telephone interviews with participants. A total of 16 participants enrolled in the intervention. Post-intervention results were obtained from 13 participants, with an estimated mean change from baseline in weight of -0.72 kg (95%CI -1.44 to -0.01), body mass index of -0.25 kg/m 2 (95%CI -0.49 to -0.01) and waist circumference of -1.04 cm (95%CI -4.52 to 2.44). The group education program was acceptable to participants. The results suggest that recruitment through general practitioners is ineffective, and alternative recruitment strategies are required. This patient-centred, patient-directed, group-based intervention for the management of type 2 diabetes mellitus was both feasible and acceptable to patients. Health professionals should consider the combined use of the MRC and RE-AIM frameworks in the development of interventions to ensure a rigorous design process and to enable the evaluation of all phases of the intervention, which will facilitate translation to other settings. Further research with a larger sample trialling additional recruitment strategies, evaluating further measures of effectiveness and utilising lengthier follow-up periods is required. © 2016 Dietitians Association of Australia.

Evaluation of hospital staff's perceived quality of librarian-mediated literature searching services.

Science.gov (United States)

McKeown, Sandra; Konrad, Shauna-Lee; McTavish, Jill; Boyce, Erin

2017-04-01

The research evaluated the perceived quality of librarian-mediated literature searching services at one of Canada's largest acute care teaching hospitals for the purpose of continuous quality improvement and investigation of relationships between variables that can impact user satisfaction. An online survey was constructed using evidence-based methodologies. A systematic sample of staff and physicians requesting literature searches at London Health Sciences Centre were invited to participate in the study over a one-year period. Data analyses included descriptive statistics of closed-ended questions and coding of open-ended questions. A range of staff including clinicians, researchers, educators, leaders, and analysts submitted a total of 137 surveys, representing a response rate of 71%. Staff requested literature searches for the following "primary" purposes: research or publication (34%), teaching or training (20%), informing a policy or standard practice (16%), patient care (15%), and "other" purposes (15%). While the majority of staff (76%) submitted search requests using methods of written communication, including email and search request forms, staff using methods of verbal communication, including face-to-face and telephone conversations, were significantly more likely to be extremely satisfied with the librarian's interpretation of the search request ( p =0.004) and to rate the perceived quality of the search results as excellent ( p =0.005). In most cases, librarians followed up with staff to clarify the details of their search requests (72%), and these staff were significantly more likely to be extremely satisfied with the librarian's interpretation of the search request ( p =0.002). Our results demonstrate the limitations of written communication in the context of librarian-mediated literature searching and suggest a multifaceted approach to quality improvement efforts.

Electroconvulsive therapy in geriatric patients: A literature review and program report from Virginia Commonwealth University, Richmond, Virginia, USA

Directory of Open Access Journals (Sweden)

Andrew D Snyder

2017-01-01

Full Text Available Electroconvulsive therapy (ECT is an effective therapeutic intervention in the elderly patients with major depression, especially those with psychosis, suicidality, catatonia, nutritional compromise, and resistance to medications. Response rates can be as high as 80%. We present an extensive review of the relevant literature, provide a description of the ECT program at Virginia Commonwealth University in Richmond, Virginia, USA, and present results of our experience with ECT in fifty elderly patients. The treatments were safe, well tolerated, and produced high response rates, variably between 68% and 84%. Patients in the long-term maintenance ECT program continue to show sustained benefits from ECT.

LUDEP: A Lung Dose Evaluation Program

International Nuclear Information System (INIS)

Birchall, A.; Bailey, M.R.; James, A.C.

1990-06-01

A Task Group of the ICRP is currently reviewing its dosimetric model for the respiratory tract with the aim of producing a more comprehensive and realistic model which can be used both for dosimetry and bioassay purposes. This in turn requires deposition, clearance, and dosimetry to be treated in a more detailed manner in than in the current model. In order to examine the practical application and radiological implications of the proposed model, a microcomputer program has been developed in a modular form so that changes can be easily included as the model develops. LUDEP (Lung Dose Evaluation Program) is a user-friendly menu-driven program which can be operated on any IBM-compatible PC. It enables the user to calculate (a) doses to each region of the respiratory tract and all other body organs, and (b) excretion rates and retention curves for bioassay purposes. 11 refs., 4 figs., 6 tabs

A literature review of professionalism in surgical education: suggested components for development of a curriculum.

Science.gov (United States)

Deptula, Peter; Chun, Maria B J

2013-01-01

While it is evident that a surgeon must master medical knowledge and technical skill, there are other "soft skills" that are essential to a successful surgeon. One of these skills is professionalism. The challenge in surgical education lies in developing an effective professionalism curriculum and a related method of evaluation. Our review updates the literature and provides recommendations for improving instruction and evaluation of professionalism. A literature review was conducted using PubMed, Google Scholar, and Web of Knowledge. We restricted our search to documents published from 2009 to 2012 that address methods of teaching and tools for assessing professionalism in surgical education. Sixty-three documents were reviewed, with 14 fitting our search criteria for professionalism in surgical education completely. Other articles focused on the topics of professionalism in surgery, medical professionalism, and professionalism education in medical specialties other than surgery. Development of a professionalism curriculum for surgical residents might begin with defining professionalism in terms of tangible behaviors. The program might also include a precurriculum preparatory course and simulation-based training. Residency programs must also maintain professionalism among its faculty. Assessment in the form of multisource feedback that is consistent with observable behavioral definitions of professionalism should also be considered in evaluating resident professionalism. Copyright © 2013 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

The Content of Literature in the High School.

Science.gov (United States)

Burton, Dwight L.

The content of a literature program defined in terms of the structure of literature is proposed. A three-layer definition of structure is suggested which considers (1) the substance of literature, including man and his gods, man and the natural world, man and other men, and man and himself; (2) mode in literature, including the romantic, comic,…

Employee assistance program evaluation. Employee perceptions, awareness, and utilization.

Science.gov (United States)

Moore, T

1989-12-01

Periodic evaluation is necessary to maintain a quality employee assistance program. This survey was undertaken to determine employee awareness of the existing EAP and their satisfaction with the program. Likewise, the survey allowed for employee input on areas of the program they had concerns with that may have caused hesitancy in further use of the program. The survey not only documents to management that the program is of value to employees and identifies areas where changes may be focused in the future to meet employee needs, but actually serves as a communication tool in itself as a reminder of the availability of the Employee Assistance Program.

NRC systematic evaluation program: seismic review

International Nuclear Information System (INIS)

Levin, H.A.

1980-01-01

The NRC Systematic Evaluation Program is currently making an assessment of the seismic design safety of 11 older nuclear power plant facilities. The general review philosophy and review criteria relative to seismic input, structural response, and equipment functionability are presented, including the rationale for the development of these guidelines considering the significant evolution of seismic design criteria since these plants were originally licensed. Technical approaches thought more realistic in light of current knowledge are utilized. Initial findings for plants designed to early seismic design procedures suggest that with minor exceptions, these plants possess adequate seismic design margins when evaluated against the intent of current criteria. However, seismic qualification of electrical equipment has been identified as a subject which requires more in-depth evaluation

Evaluating program effects on institutional delivery in Peru.

Science.gov (United States)

McQuestion, Michael J; Velasquez, Anibal

2006-07-01

We evaluate the joint effects of two targeted Peruvian health programs on a mother's choice of whether to deliver in a public emergency obstetric care (EmOC) facility. The national maternal and child health insurance, or SMI Program, provided delivery care coverage to Peru's poorest households beginning in 1998. During 1996-2002, Proyecto 2000 sought to improve the quality of EmOC and increase utilization of public EmOC facilities in the districts reporting the highest maternal and neonatal mortality levels. Our data come from the Proyecto 2000 endline evaluation, which sampled 5335 mothers living in the catchment areas of 29 treatment and 29 matched control EmOC facilities. Using propensity scoring and two quality of care indices, we find significantly higher quality of care in Proyecto 2000 treatment facilities. Using variance components logistic models, we find a mother enrolled in the SMI Program was more likely to have delivered her last child in a public EmOC, controlling for household constraints. Residence in a Proyecto 2000 treatment area did not significantly affect the choice. A cross-level interaction term was insignificant, indicating the two program effects were independent.

Positive Mathematical Programming Approaches – Recent Developments in Literature and Applied Modelling

Directory of Open Access Journals (Sweden)

Thomas Heckelei

2012-05-01

Full Text Available This paper reviews and discusses the more recent literature and application of Positive Mathematical Programming in the context of agricultural supply models. Specifically, advances in the empirical foundation of parameter specifications as well as the economic rationalisation of PMP models – both criticized in earlier reviews – are investigated. Moreover, the paper provides an overview on a larger set of models with regular/repeated policy application that apply variants of PMP. Results show that most applications today avoid arbitrary parameter specifications and rely on exogenous information on supply responses to calibrate model parameters. However, only few approaches use multiple observations to estimate parameters, which is likely due to the still considerable technical challenges associated with it. Equally, we found only limited reflection on the behavioral or technological assumptions that could rationalise the PMP model structure while still keeping the model’s advantages.

Remote Infrared Audible Signage (RIAS) Pilot Program : evaluation report

Science.gov (United States)

2009-09-01

This report presents evaluation findings on the Remote Infrared Audible Signage (RIAS) Pilot Program in the Puget Sound Region of Washington. The installation, demonstration and evaluation of RIAS were required by a provision in the Safe, Accountable...

[Process evaluation in relation to effectiveness assessment: experiences with school-based programs].

Science.gov (United States)

Ariza, Carles; Villalbí, Joan R; Sánchez-Martínez, Francesca; Nebot, Manel

2011-06-01

Evaluation of public health interventions usually focus on the quality of design and research methods, and less on the quality of the intervention or process evaluation. In process evaluation of school-based interventions, key issues are how completely the intervention is carried out and adherence to the protocol. In addition, exploration of intermediate variables, such as those that influence (and often predict) preventable behavior, is highly useful. This article describes the basic concepts in this topic, using examples of the effectiveness of some preventive interventions carried out in schools. The interventions discussed were mainly quasi-experimental studies, based on data from programs promoted by public health teams in the city of Barcelona. Data from process evaluation of preventive programs in secondary schools that underwent formal assessment of their effectiveness is provided. The examples are drawn from preventive programs of HIV infection or unprotected sexual intercourse (PRESSEC program) and drug consumption prevention (the PASE, PASE.bcn and x kpts programs). These examples show why the intervention process influences the impact of the programs and their results. Thorough planning of process evaluation is essential to obtain valid indicators that will identify, in the effectiveness evaluation of the intervention, the most efficacious strategies to obtain positive outcomes. Copyright © 2011 Sociedad Española de Salud Pública y Administración Sanitaria. Published by Elsevier Espana. All rights reserved.

Quantitative Evaluation of the Community Research Fellows Training Program

Directory of Open Access Journals (Sweden)

Lucy eD'Agostino McGowan

2015-07-01

Full Text Available Context: The Community Research Fellows Training (CRFT program is a community-based participatory research (CBPR initiative for the St. Louis area. This fifteen week program, based on a Master in Public Health curriculum, was implemented by the Division of Public Health Sciences at Washington University School of Medicine in partnership with the Siteman Cancer Center. Objectives: We measure the knowledge gained by participants and evaluate participant and faculty satisfaction of the CRFT program both in terms of meeting learning objectives and actively engaging the community in the research process.Participants: We conducted analyses on 44 community members who participated in the CRFT program and completed the baseline and follow-up knowledge assessments.Main Outcome Measures: Knowledge gain is measured by a baseline and follow-up assessment given at the first and final session. Additionally, pre- and post-tests are given after the first 12 sessions. To measure satisfaction, program evaluations are completed by both the participants and faculty after each topic. Mid-way through the program, a mid-term assessment was administered to assess the program’s community engagement. We analyzed the results from the assessments, pre- and post-tests, and evaluations.Results: The CRFT participants’ knowledge increased at follow-up as compared with baseline on average by a 16.5 point difference (p<0.0001. Post-test scores were higher than pre-test scores for 11 of the 12 sessions. Both participants and faculty enjoyed the training and rated all session well.Conclusions: The CRFT program was successful in increasing community knowledge, in participant satisfaction, and in faculty satisfaction. This success has enhanced the infrastructure for CBPR as well as led to CBPR pilot projects that address health disparities in the St. Louis Greater Metropolitan Area.

Evaluating Nutrition Education Programming by Using a Dietary Screener

Science.gov (United States)

Schultz, Jennifer; Litchfield, Ruth

2016-01-01

Short dietary assessment instruments known as screeners have potential for use in evaluating nutrition education programming because detecting change in dietary intake can demonstrate movement toward program goals. Using screeners results in objective dietary intake data but involves less administrative time, training, and cost than other…

Wood Programs. Courseware Evaluation for Vocational and Technical Education.

Science.gov (United States)

Kaylor, Robert; And Others

This courseware evaluation rates the Wood Programs software developed by the Iowa Department of Public Instruction. (These programs--not contained in this document--include understanding board feet, wood characteristics, wood safety drill, wood dimensions, wood moisture, operating the table saw, radial arm, measurement drill, fraction drill, and…

Dissemination of Technology to Evaluate Healthy Food Incentive Programs.

Science.gov (United States)

Freedman, Darcy A; Hunt, Alan R; Merritt, Katie; Shon, En-Jung; Pike, Stephanie N

2017-03-01

Federal policy supports increased implementation of monetary incentive interventions for chronic disease prevention among low-income populations. This study describes how a Prevention Research Center, working with a dissemination partner, developed and distributed technology to support nationwide implementation and evaluation of healthy food incentive programming focused on Supplemental Nutrition Assistance Program recipients. FM Tracks, an iOS-based application and website, was developed to standardize evaluation methods for healthy food incentive program implementation at direct-to-consumer markets. This evaluation examined diffusion and adoption of the technology over 9 months (July 2015-March 2016). Data were analyzed in 2016. FM Tracks was disseminated to 273 markets affiliated with 37 regional networks in 18 states and Washington, DC. All markets adopted the sales transaction data collection feature, with nearly all recording at least one Supplemental Nutrition Assistance Program (99.3%) and healthy food incentive (97.1%) transaction. A total of 43,493 sales transactions were recorded. By the ninth month of technology dissemination, markets were entering individual sales transactions using the application (34.5%) and website (29.9%) and aggregated transactions via website (35.6%) at similar rates. Use of optional evaluation features like recording a customer ID with individual transactions increased successively with a low of 22.2% during the first month to a high of 69.2% in the ninth month. Systematic and widely used evaluation technology creates possibilities for pragmatic research embedded within ongoing, real-world implementation of food access interventions. Technology dissemination requires supportive technical assistance and continuous refinement that can be advanced through academic-practitioner partnerships. Copyright © 2016 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.

Evaluation of radiological teaching programs in the Internet

International Nuclear Information System (INIS)

Seitz, J.; Schubert, S.; Voelk, M.; Scheibl, K.; Paetzel, C.; Schreyer, A.; Djavidani, B.; Feuerbach, S.; Strotzer, M.

2003-01-01

Evaluation of web based training programs,which can be contacted from the homepages of radiological departments of German universities.Material and method From june 2000 to january 2002 the 75 web based training programs of 57 providers,which can be contacted from the web pages of the radiological departments of german universities were evaluated in a prospective study.A medical student experienced in using the world wide web examined each training program three times in an interval of six months using the following criteria: availability of the web sites,target group,kind of training program,contents and structure and the technical solution. 51 of the 57 the homepages were fully available at each visit. 64 of the 75 web based training programs which could be connected from these sites were available at all three visitis.One program was only partially available at one spot check. 8 of the 75 programs were designed for physicians and medically trained personal, 23 were made for medical students and 44 addressed both target groups (partially more than once mentioned).The number of the presented cases ranged between one single and 3700. In 31 of 75 training programs links to other teaching files were found.A complete presentation of cases was presented by 48 of the 75 web sites.5 of the 75 web sites offered physiological images for comparison. In 20 training programs the pathological changes were optically marked in the x-ray images.A logical and didactical structure was found in 24 teaching files, 14 gave the possibility to check the learning results.No provider made use of the possibility to pass credits to the students or physicians acount with regard to official training programs. Multimedia techniques were used in 15 training programs.43 sites used data reduced preview images (thumbnails).The latest update of the site is mentioned in 55 of the 75 web sites. 19 of 57 providers had either no possibility of contact or did not answer to an e-mail. From the homepages

Parent Education Programs as a Psychiatric Approach to Children with Conduct Disorder: An Evaluation through Two Samples

Directory of Open Access Journals (Sweden)

Burcu Arkan

2009-08-01

Full Text Available Conduct disorder is a category to describe the behaviors which have an adverse affect on the individual, family or society, violate the basic rights of other people and ignore the age-appropriate social norms and rules. Parental behaviors should be shaped as well as those of the children in order for conduct disorder to be treated. The reason for this is that parental attitudes play a key role in emergence of anti-social behaviors among children. Therefore, parent programs have been undertaken for the last thirty years. It has been proved that parent programs are effective in children with conduct disorder who display highly disruptive behaviors. The two best parent programs implemented on the parents of children diagnosed with conduct disorder are Triple P and Incredible Years which cooperate with families and the society, reduce the risk factors, support the protective factors, have a multi-disciplinary approach (psychiatrist, psychologist, nurse, child development and educationalist, social service specialist, psychological consultant, teacher, etc., having high evidence standards, use randomized controlled studies and yield long-term results. For that reason, this literature review was conducted in order to evaluate the efficacy of these two programs, to determine the differences, what is known about the issue.

Boron neutron capture therapy: Brain Tumor Treatment Evaluation Program

International Nuclear Information System (INIS)

Griebenow, M.L.; Dorn, R.V. III; Gavin, P.R.; Spickard, J.H.

1988-01-01

The United States (US) Department of Energy (DOE) recently initiated a focused, multidisciplined program to evaluate Boron Neutron Capture Therapy (BNCT) for the treatment of brain tumors. The program, centered at the DOE/endash/Idaho National Engineering Laboratory (INEL), will develop the analytical, diagnostic and treatment tools, and the database required for BNCT technical assessment. The integrated technology will be evaluated in a spontaneously-occurring canine brain-tumor model. Successful animal studies are expected to lead to human clinical trials within four to five years. 2 refs., 3 figs

Evaluating public participation in environmental decision-making: EPA's superfund community involvement program.

Science.gov (United States)

Susan Charnley; Bruce. Engelbert

2005-01-01

This article discusses an 8-year, ongoing project that evaluates the Environmental Protection Agency's Superfund community involvement program. The project originated as a response to the Government Performance and Results Act, which requires federal agencies to articulate program goals, and evaluate and report their progress in meeting those goals. The evaluation...

EVALUATION OF MUSCLE STRENGTH IN MEDULLAR INJURY: A LITERATURE REVIEW

Directory of Open Access Journals (Sweden)

Tânia Valdameri Capelari

Full Text Available ABSTRACT Objective: To identify the tools used to evaluate muscle strength in subjects with spinal cord injury in both clinical practice and scientific research. Methods: Initially, the literature review was carried out to identify the tools used in scientific research. The search was conducted in the following databases: Virtual Health Library (VHL, Pedro, and PubMed. Studies published between 1990 and 2016 were considered and selected, depicting an evaluation of muscle strength as an endpoint or for characterization of the sample. Next, a survey was carried out with physiotherapists to identify the instruments used for evaluation in clinical practice, and the degree of satisfaction of professionals with respect to them. Results: 495 studies were found; 93 were included for qualitative evaluation. In the studies, we verified the use of manual muscle test with different graduation systems, isokinetic dynamometer, hand-held dynamometer, and manual dynamometer. In clinical practice, the manual muscle test using the motor score recommended by the American Spinal Cord Injury Association was the most used method, despite the limitations highlighted by the physiotherapists interviewed. Conclusion: In scientific research, there is great variation in the methods and tools used to evaluate muscle strength in individuals with spinal cord injury, differently from clinical practice. The tools available and currently used have important limitations, which were highlighted by the professionals interviewed. No instrument depicts direct relationship of muscle strength and functionality of the subject. There is no consensus as to the best method for assessing muscle strength in spinal cord injury, and new instruments are needed that are specific for use in this population.

Workplace Violence Training Programs for Health Care Workers: An Analysis of Program Elements.

Science.gov (United States)

Arbury, Sheila; Hodgson, Michael; Zankowski, Donna; Lipscomb, Jane

2017-06-01

Commercial workplace violence (WPV) prevention training programs differ in their approach to violence prevention and the content they present. This study reviews 12 such programs using criteria developed from training topics in the Occupational Safety and Health Administration's (OSHA) Guidelines for Preventing Workplace Violence for Healthcare and Social Service Workers and a review of the WPV literature. None of the training programs addressed all the review criteria. The most significant gap in content was the lack of attention to facility-specific risk assessment and policies. To fill this gap, health care facilities should supplement purchased training programs with specific training in organizational policies and procedures, emergency action plans, communication, facility risk assessment, and employee post-incident debriefing and monitoring. Critical to success is a dedicated program manager who understands risk assessment, facility clinical operations, and program management and evaluation.

[A critical evaluation of food programs in Argentina].

Science.gov (United States)

Abeyá Gilardon, Enrique O

2016-01-01

Argentina has an over 60-year history of food programs which have received few to no evaluations, even considering the highly important epidemiological and social changes that have occurred in the target population. In this article, nationwide State-run food programs with the objective of contributing to the food security of the families in greatest need are reviewed, the nutritional situation of the target population is reassessed, and arguments for analyzing current programs using a typology based in the components of food security are proposed. A general review of the conceptions, content and reach of food programs should be carried out, in order for these programs to cease to act as mere social assistance and instead be transformed in bearers of the right to better food and nutrition.

CRECTJ: a computer program for compilation of evaluated nuclear data

Energy Technology Data Exchange (ETDEWEB)

Nakagawa, Tsuneo [Japan Atomic Energy Research Inst., Tokai, Ibaraki (Japan). Tokai Research Establishment

1999-09-01

In order to compile evaluated nuclear data in the ENDF format, the computer program CRECTJ has been developed. CRECTJ has two versions; CRECTJ5 treats the data in the ENDF/B-IV and ENDF/B-V format, and CRECTJ6 the data in the ENDF-6 format. These programs have been frequently used to make Japanese Evaluated Nuclear Data Library (JENDL). This report describes input data and examples of CRECTJ. (author)

Evaluating Additionality of an Innovation Subsidy Program Targeted at SMEs: An Exploratory Study

Directory of Open Access Journals (Sweden)

Sonja Radas

2013-04-01

Full Text Available This paper explores the effectiveness of a recently introduced innovation subsidy program targeted at SMEs in Croatia. Three aspects of program additionality were evaluated: input, output and behavioral aspects. Both qualitative and survey research was employed, and four case studies with selected recipient companies were conducted. This study is a response to the policy-makers’ need for early program assessment. It attempts to show that even with early evaluation and small population of recipients it is possible to gain insight into program effectiveness. The analysis suggests that the effects of programs targeted at innovative SMEs might need to be evaluated differently than general subsidies. This is especially evident in the evaluation of input additionality. The analysis indicates that SMEs which started with a higher R&D capability tend to increase R&D intensity while participating in the program. The program raised R&D and innovation capability of the participating SMEs, but commercialization of project results remains a concern.

Mentoring programs for medical students - a review of the PubMed literature 2000 - 2008

Directory of Open Access Journals (Sweden)

Buddeberg-Fischer Barbara

2010-04-01

Full Text Available Abstract Background Although mentoring is acknowledged as a key to successful and satisfying careers in medicine, formal mentoring programs for medical students are lacking in most countries. Within the framework of planning a mentoring program for medical students at Zurich University, an investigation was carried out into what types of programs exist, what the objectives pursued by such programs are, and what effects are reported. Methods A PubMed literature search was conducted for 2000 - 2008 using the following keywords or their combinations: mentoring, mentoring program, medical student, mentor, mentee, protégé, mentorship. Although a total of 438 publications were identified, only 25 papers met the selection criteria for structured programs and student mentoring surveys. Results The mentoring programs reported in 14 papers aim to provide career counseling, develop professionalism, increase students' interest in research, and support them in their personal growth. There are both one-to-one and group mentorships, established in the first two years of medical school and continuing through graduation. The personal student-faculty relationship is important in that it helps students to feel that they are benefiting from individual advice and encourages them to give more thought to their career choices. Other benefits are an increase in research productivity and improved medical school performance in general. Mentored students also rate their overall well-being as higher. - The 11 surveys address the requirements for being an effective mentor as well as a successful mentee. A mentor should empower and encourage the mentee, be a role model, build a professional network, and assist in the mentee's personal development. A mentee should set agendas, follow through, accept criticism, and be able to assess performance and the benefits derived from the mentoring relationship. Conclusion Mentoring is obviously an important career advancement tool for

Mentoring programs for medical students - a review of the PubMed literature 2000 - 2008

Science.gov (United States)

2010-01-01

Background Although mentoring is acknowledged as a key to successful and satisfying careers in medicine, formal mentoring programs for medical students are lacking in most countries. Within the framework of planning a mentoring program for medical students at Zurich University, an investigation was carried out into what types of programs exist, what the objectives pursued by such programs are, and what effects are reported. Methods A PubMed literature search was conducted for 2000 - 2008 using the following keywords or their combinations: mentoring, mentoring program, medical student, mentor, mentee, protégé, mentorship. Although a total of 438 publications were identified, only 25 papers met the selection criteria for structured programs and student mentoring surveys. Results The mentoring programs reported in 14 papers aim to provide career counseling, develop professionalism, increase students' interest in research, and support them in their personal growth. There are both one-to-one and group mentorships, established in the first two years of medical school and continuing through graduation. The personal student-faculty relationship is important in that it helps students to feel that they are benefiting from individual advice and encourages them to give more thought to their career choices. Other benefits are an increase in research productivity and improved medical school performance in general. Mentored students also rate their overall well-being as higher. - The 11 surveys address the requirements for being an effective mentor as well as a successful mentee. A mentor should empower and encourage the mentee, be a role model, build a professional network, and assist in the mentee's personal development. A mentee should set agendas, follow through, accept criticism, and be able to assess performance and the benefits derived from the mentoring relationship. Conclusion Mentoring is obviously an important career advancement tool for medical students. In Europe

Mentoring programs for medical students--a review of the PubMed literature 2000-2008.

Science.gov (United States)

Frei, Esther; Stamm, Martina; Buddeberg-Fischer, Barbara

2010-04-30

Although mentoring is acknowledged as a key to successful and satisfying careers in medicine, formal mentoring programs for medical students are lacking in most countries. Within the framework of planning a mentoring program for medical students at Zurich University, an investigation was carried out into what types of programs exist, what the objectives pursued by such programs are, and what effects are reported. A PubMed literature search was conducted for 2000 - 2008 using the following keywords or their combinations: mentoring, mentoring program, medical student, mentor, mentee, protégé, mentorship. Although a total of 438 publications were identified, only 25 papers met the selection criteria for structured programs and student mentoring surveys. The mentoring programs reported in 14 papers aim to provide career counseling, develop professionalism, increase students' interest in research, and support them in their personal growth. There are both one-to-one and group mentorships, established in the first two years of medical school and continuing through graduation. The personal student-faculty relationship is important in that it helps students to feel that they are benefiting from individual advice and encourages them to give more thought to their career choices. Other benefits are an increase in research productivity and improved medical school performance in general. Mentored students also rate their overall well-being as higher. - The 11 surveys address the requirements for being an effective mentor as well as a successful mentee. A mentor should empower and encourage the mentee, be a role model, build a professional network, and assist in the mentee's personal development. A mentee should set agendas, follow through, accept criticism, and be able to assess performance and the benefits derived from the mentoring relationship. Mentoring is obviously an important career advancement tool for medical students. In Europe, more mentoring programs should be

Potential pros and cons of external healthcare performance evaluation systems: real-life perspectives on Iranian hospital evaluation and accreditation program.

Science.gov (United States)

Jaafaripooyan, Ebrahim

2014-09-01

Performance evaluation is essential to quality improvement in healthcare. The current study has identified the potential pros and cons of external healthcare evaluation programs, utilizing them subsequently to look into the merits of a similar case in a developing country. A mixed method study employing both qualitative and quantitative data collection and analysis techniques was adopted to achieve the study end. Subject Matter Experts (SMEs) and professionals were approached for two-stage process of data collection. Potential advantages included greater attractiveness of high accreditation rank healthcare organizations to their customers/purchasers and boosted morale of their personnel. Downsides, as such, comprised the programs' over-reliance on value judgment of surveyors, routinization and incurring undue cost on the organizations. In addition, the improved, standardized care processes as well as the judgmental nature of program survey were associated, as pros and cons, to the program investigated by the professionals. Besides rendering a tentative assessment of Iranian hospital evaluation program, the study provides those running external performance evaluations with a lens to scrutinize the virtues of their own evaluation systems through identifying the potential advantages and drawbacks of such programs. Moreover, the approach followed could be utilized for performance assessment of similar evaluation programs.

Evaluation of medical education virtual program: P3 model

Directory of Open Access Journals (Sweden)

RITA REZAEE

2016-10-01

Full Text Available Introduction: In e-learning, people get involved in a process and create the content (product and make it available for virtual learners. The present study was carried out in order to evaluate the first virtual master program in medical education at Shiraz University of Medical Sciences according to P3 Model. Methods: This is an evaluation research study with post single group design used to determine how effective this program was. All students 60 who participated more than one year in this virtual program and 21 experts including teachers and directors participated in this evaluation project. Based on the P3 e-learning model, an evaluation tool with 5-point Likert rating scale was designed and applied to collect the descriptive data. Results: Students reported storyboard and course design as the most desirable element of learning environment (2.30±0.76, but they declared technical support as the less desirable part (1.17±1.23. Conclusion: Presence of such framework in this regard and using it within the format of appropriate tools for evaluation of e-learning in universities and higher education institutes, which present e-learning curricula in the country, may contribute to implementation of the present and future e-learning curricula efficiently and guarantee its implementation in an appropriate way.

[Resident evaluation of general surgery training programs].

Science.gov (United States)

Espinoza G, Ricardo; Danilla E, Stefan; Valdés G, Fabio; San Francisco R, Ignacio; Llanos L, Osvaldo

2009-07-01

The profile of the general surgeon has changed, aiming to incorporate new skills and to develop new specialties. To assess the quality of postgraduate General Surgery training programs given by Chilean universities, the satisfaction of students and their preferences after finishing the training period. A survey with multiple choice and Likert type questions was designed and applied to 77 surgery residents, corresponding to 59% of all residents of general surgery specialization programs of Chilean universities. Fifty five per cent of residents financed with their own resources the specialization program. Thirty nine percent disagreed partially or totally with the objectives and rotations of programs. The opportunity to perform surgical interventions and the support by teachers was well evaluated. However, 23% revealed teacher maltreatment. Fifty six percent performed research activities, 73% expected to continue training in a derived specialty and 69% was satisfied with the training program. Residents considered that the quality and dedication of professors and financing of programs are issues that must be improved. The opportunity to perform surgical interventions, obtaining a salary for their work and teacher support is considered of utmost importance.

Collaborative work as a didactic strategy for teaching/learning programming: a systematic literature review

Directory of Open Access Journals (Sweden)

Oscar Revelo-Sanchez

2018-01-01

Full Text Available The incorporation of Collaborative Work into programming courses has been identified as a potential strategy that could maximize student participation and have a positive impact on learning. In the consulted sources, no study has been found to collect and analyze the results of research on this subject using a systematic method. To try to fill this gap, a systematic literature review was conducted with the aim of summarizing the studies on the use of Collaborative Work as a didactic strategy for teaching/learning programming. Initially, through a search in four (4 databases of scientific publications, 95 studies published in the last five (5 years were obtained. After careful analysis of each one of them, only 40 were found to meet the review requirements. This analysis resulted in the synthesis of eleven (11 Collaborative Learning Techniques (CLT that implement such strategy. Subsequently, they were grouped into 19 common names of strategies found in the documents, i.e. the collaborative strategies or techniques associated with each study. The review also showed a significant amount of contributions from the research community that constitute an important basis for future work. This demonstrates that Collaborative Work is increasingly consolidated as a valid and relevant didactic strategy, not only in programming teaching/learning, but also in other areas of knowledge including computer science.