Questionnaire measuring training's impact

International Nuclear Information System (INIS)

Corfield, R.A.

1987-01-01

A questionnaire has been prepared to evaluate the impact of training of a nuclear power plant. Items covered are the degree to which training is systematic, the influence that should be exerted by INPO, and the costs of an effective training program

Cultural Adaptation of the LINQ (Lung Information Needs Questionnaire Questionnaire in Patients with Chronic Respiratory Disease in a Pulmonary Rehabilitation Program in Cali, Colombia

Directory of Open Access Journals (Sweden)

Esther Cecilia Wilches Luna

2014-01-01

Full Text Available Objective: To perform a cultural adaptation of the LINQ (Lung Information Needs Questionnaire for patients with chronic pulmonary disease. Method: Descriptive study. After the translation of the questionnaire by a certified translator, and after its cultural adaptation, it was applied in eight patients in order to identify the difficulties and doubts related to an understanding of the questions and of its terminology, not only to evaluate the quality of the translation, but to verify practical aspects of its application, as well. Afterward, a second translation was done from Spanish to English, and sent back to the authors to ensure the original content of the questionnaire was maintained, and to obtain endorsement for its use. Results: During the cultural adaptation phase, the sample was constituted by 6 men and 2 women, with an average age of 61 years. The Spa-nish version of the LINQ, as well as the cultural adaptation, was easy to use and did not show any discrepancies with the original version during the re-translation process. Conclusions: The LINQ’s translation to Spanish and the cultural adaptation proved to be adequate, because the patients did not express any difficulties in understanding and answering the questions. This will facilitate future studies that evaluate the educational component in the pulmonary rehabilitation program.

Shaping the esp curriculum of an english for PhD students program: a colombian case study of questionnaire research

Directory of Open Access Journals (Sweden)

Gerriet Janssen

2012-12-01

Full Text Available This report presents the findings from an EAP curriculum development project directed towards PhD students at Colombian university.An analysis of this stakeholder group’s learning needs was conducted through questionnaire research, focusing on (a describing students’situated contexts and interests and (b obtaining data contributing towards future program development. Measures of central tendency,dispersion, and internal consistency for each section of the questionnaire are reported. Key results include these students’ strong interest inEAP programming, their language needs and experience regarding their intellectual production, and their perceived importance of differentlanguage sub-skills in both the local and international contexts. The results highlight the importance of continued evaluation cycles and theimportant role EAP coursework has for PhD students today.

Psychometric evaluation of dietary habits questionnaire for type 2 diabetes mellitus

Science.gov (United States)

Sami, W.; Ansari, T.; Butt, N. S.; Hamid, M. R. Ab

2017-09-01

This research evaluated the psychometric properties of English version of dietary habits questionnaires developed for type 2 diabetic patients. There is scarcity of literature about availability of standardized questionnaires for assessing dietary habits of type 2 diabetics in Saudi Arabia. As dietary habits vary from country to country, therefore, this was an attempt to develop questionnaires that can serve as a baseline. Through intensive literature review, four questionnaires were developed / modified and subsequently tested for psychometric properties. Prior to pilot study, a pre-test was conducted to evaluate the face validity and content validity. The pilot study was conducted from 23 October - 22 November, 2016 to evaluate the questionnaires’ reliability and validity. Systematic random sampling technique was used to collect the data from 132 patients by direct investigation method. Questionnaires assessing diabetes mellitus knowledge (0.891), dietary knowledge (0.869), dietary attitude (0.841) and dietary practices (0.874) had good internal consistency reliability. Factor analysis conducted on dietary attitude questionnaire showed a valid 5 factor solution. Directions of loadings were positive and free from factorial complexity. Relying on the data obtained from type 2 diabetics, these questionnaires can be considered as reliable and valid for the assessment of dietary habits in Saudi Arabia and neighbouring Gulf countries population.

The Mental Vulnerability Questionnaire: a psychometric evaluation

DEFF Research Database (Denmark)

Eplov, Lene Falgaard; Petersen, Janne; Jørgensen, Torben

2010-01-01

The Mental Vulnerability Questionnaire was originally a 22 item scale, later reduced to a 12 item scale. In population studies the 12 item scale has been a significant predictor of health and illness. The scale has not been psychometrically evaluated for more than 30 years, and the aim of the pre......The Mental Vulnerability Questionnaire was originally a 22 item scale, later reduced to a 12 item scale. In population studies the 12 item scale has been a significant predictor of health and illness. The scale has not been psychometrically evaluated for more than 30 years, and the aim...... 0.30 for the 12 and the 22 item scales. All five Mental Vulnerability scales had positively skewed score distributions which were associated significantly with both SCL-90-R symptom scores and NEO-PI-R personality scales (primarily Neuroticism and Extraversion). Coefficient alpha was highest...

Job Evaluation with the Position Analysis Questionnaire

Science.gov (United States)

Harris, Alma F.; Matson, G. Albion

1976-01-01

Assessment of the Position Analysis Questionnaire (PAQ) at a four-year state college with 8,000 students indicates that the PAQ job evaluation method is sufficiently valid and has enough unique advantages to warrant its serious consideration for use by college and university personnel administrators. (LBH)

Evaluation of a complementary cyber education program for a pathophysiology class.

Science.gov (United States)

Yoo, Ji-Soo; Ryue, Sook-Hee; Lee, Jung Eun; Ahn, Jeong-Ah

2009-12-01

The goal of this study was to develop and evaluate a complementary cyber education program for a required pathophysiology class for nursing students. The cyber education program comprised electronic bulletin boards, correspondence material storage, an announcement section, a report submission section, reference sites, and statistics on learning rates. Twelve online lectures complemented five lectures in the classroom. To evaluate the course's educational effectiveness, we performed an online objective questionnaire and an open questionnaire survey anonymously, and compared the complementary cyber education program with traditional classroom education. The complementary cyber education program effected significant improvements in scores for importance with regard to major, clarity of goals and education plans for courses, professor readiness, preciseness and description of lectures, amount and efficiency of assignments, and fairness in appraisal standards compared with the traditional classroom education group. This study indicates that a complementary cyber education program provides nursing students with the flexibility of time and space, the newest information through updated lectures, efficient motivational aids through intimacy between the lecturer and students, and concrete and meaningful tasks. The complementary cyber education course also increased student effort toward studying and student satisfaction with the class.

[Validation of a questionnaire to evaluate patient safety in clinical laboratories].

Science.gov (United States)

Giménez Marín, Ángeles; Rivas-Ruiz, Francisco

2012-01-01

The aim of this study was to prepare, pilot and validate a questionnaire to evaluate patient safety in the specific context of clinical laboratories. A specific questionnaire on patient safety in the laboratory, with 62 items grouped into six areas, was developed, taking into consideration the diverse human and laboratory contextual factors which may contribute to producing errors. A pilot study of 30 interviews was carried out, including validity and reliability analyses using principal components factor analysis and Cronbach's alpha. Subsequently, 240 questionnaires were sent to 21 hospitals, followed by a test-retest of 41 questionnaires with the definitive version. The sample analyzed was composed of 225 questionnaires (an overall response rate of 80%). Of the 62 items initially assessed, 17 were eliminated due to non-compliance with the criteria established before the principal components factor analysis was performed. For the 45 remaining items, 12 components were identified, with an cumulative variance of 69.5%. In seven of the 10 components with two or more items, Cronbach's alpha was higher than 0.7. The questionnaire items assessed in the test-retest were found to be stable. We present the first questionnaire with sufficiently proven validity and reliability for evaluating patient safety in the specific context of clinical laboratories. This questionnaire provides a useful instrument to perform a subsequent macrostudy of hospital clinical laboratories in Spain. The questionnaire can also be used to monitor and promote commitment to patient safety within the search for continuous quality improvement. Copyright © 2011 SESPAS. Published by Elsevier Espana. All rights reserved.

Analysis of Questionnaires Applied in the Evaluation Process of Academicians in Higher Education Institutes

Science.gov (United States)

Kalayci, Nurdan; Cimen, Orhan

2012-01-01

The aim of this study is to examine the questionnaires used to evaluate teaching performance in higher education institutes and called "Instructor and Course Evaluation Questionnaires (ICEQ)" in terms of questionnaire preparation techniques and components of curriculum. Obtaining at least one ICEQ belonging to any state and private…

Pain assessement and management in surgical cancer patients: pilot and evaluation of a continuing education program.

NARCIS (Netherlands)

Francke, A.L.; Huijer-Abu Saad, H.; Grypdonck, M.

1995-01-01

In a pilot study, a continuing education program on pain assessment and management was implemented and evaluated. Questionnaires were completed by the nurse participants at the beginning, the end, and 2 months after the end of the pilot program. After the pilot program, participants reported having

Mapping Out Your Success: Using Mind Maps to Evaluate Youth Development Programs

Directory of Open Access Journals (Sweden)

Mary Sara Wells

2009-06-01

Full Text Available A primary component of any youth program is documenting and promoting the results through evaluation. Frequently, however, administrators in youth development programs struggle to find meaningful ways of evaluating the impacts they have on the lives of youth. It is often difficult to capture the unique benefits these programs offer to participants, especially when traditional methods such as focus groups and interviews may be too time consuming and questionnaires may yield poor response rates. This article presents a creative form of evaluation targeted at demonstrating the success of programs in outcomes that are historically more difficult to measure. A “mind map” is designed to be a pictorial representation of the impact of programs in areas such as connections to community organization and adult role models. Employing this technique can enable administrators in youth development programs to demonstrate to stakeholders the benefits they provide in a non-traditional, but highly effective, way.

Evaluation Program on the Implementation of Industrial Apprenticeship (Prakerin) in Electrical Engineering

Science.gov (United States)

Maulana, I.; Sumarto; Nurafiati, P.; Puspita, R. H.

2018-02-01

This research aims to find out the evaluation program of the Industrial apprenticeship (Prakerin) in electrical engineering. This research includes on four variables of CIPP. (1). Context (a). programme planning (b). design. (2). Input (a). readiness of students (b). performance of vocational education teachers (c). Facilities and infrastructure, (3). process (a). performance students (b). performance mentors, (4). Product (a). readiness of student work. This research is a type of program evaluation research with Stake model approach. Data collection methods used are questionnaires with closed questions and frequently asked questions.

[Design and validation of an oral health questionnaire for preoperative anaesthetic evaluation].

Science.gov (United States)

Ruíz-López Del Prado, Gema; Blaya-Nováková, Vendula; Saz-Parkinson, Zuleika; Álvarez-Montero, Óscar Luis; Ayala, Alba; Muñoz-Moreno, Maria Fe; Forjaz, Maria João

Dental injuries incurred during endotracheal intubation are more frequent in patients with previous oral pathology. The study objectives were to develop an oral health questionnaire for preanaesthesia evaluation, easy to apply for personnel without special dental training; and establish a cut-off value for detecting persons with poor oral health. Validation study of a self-administered questionnaire, designed according to a literature review and an expert group's recommendations. The questionnaire was applied to a sample of patients evaluated in a preanaesthesia consultation. Rasch analysis of the questionnaire psychometric properties included viability, acceptability, content validity and reliability of the scale. The sample included 115 individuals, 50.4% of men, with a median age of 58 years (range: 38-71). The final analysis of 11 items presented a Person Separation Index of 0.861 and good adjustment of data to the Rasch model. The scale was unidimensional and its items were not biased by sex, age or nationality. The oral health linear measure presented good construct validity. The cut-off value was set at 52 points. The questionnaire showed sufficient psychometric properties to be considered a reliable tool, valid for measuring the state of oral health in preoperative anaesthetic evaluations. Copyright © 2016 Sociedade Brasileira de Anestesiologia. Publicado por Elsevier Editora Ltda. All rights reserved.

Design and validation of an oral health questionnaire for preoperative anaesthetic evaluation

Directory of Open Access Journals (Sweden)

Gema Ruíz-López del Prado

Full Text Available Abstract Background and objectives: Dental injuries incurred during endotracheal intubation are more frequent in patients with previous oral pathology. The study objectives were to develop an oral health questionnaire for preanaesthesia evaluation, easy to apply for personnel without special dental training; and establish a cut-off value for detecting persons with poor oral health. Methods: Validation study of a self-administered questionnaire, designed according to a literature review and an expert group's recommendations. The questionnaire was applied to a sample of patients evaluated in a preanaesthesia consultation. Rasch analysis of the questionnaire psychometric properties included viability, acceptability, content validity and reliability of the scale. Results: The sample included 115 individuals, 50.4% of men, with a median age of 58 years (range: 38-71. The final analysis of 11 items presented a Person Separation Index of 0.861 and good adjustment of data to the Rasch model. The scale was unidimensional and its items were not biased by sex, age or nationality. The oral health linear measure presented good construct validity. The cut-off value was set at 52 points. Conclusions: The questionnaire showed sufficient psychometric properties to be considered a reliable tool, valid for measuring the state of oral health in preoperative anaesthetic evaluations.

Design and validation of an oral health questionnaire for preoperative anaesthetic evaluation.

Science.gov (United States)

Ruíz-López Del Prado, Gema; Blaya-Nováková, Vendula; Saz-Parkinson, Zuleika; Álvarez-Montero, Óscar Luis; Ayala, Alba; Muñoz-Moreno, Maria Fe; Forjaz, Maria João

Dental injuries incurred during endotracheal intubation are more frequent in patients with previous oral pathology. The study objectives were to develop an oral health questionnaire for preanaesthesia evaluation, easy to apply for personnel without special dental training; and establish a cut-off value for detecting persons with poor oral health. Validation study of a self-administered questionnaire, designed according to a literature review and an expert group's recommendations. The questionnaire was applied to a sample of patients evaluated in a preanaesthesia consultation. Rasch analysis of the questionnaire psychometric properties included viability, acceptability, content validity and reliability of the scale. The sample included 115 individuals, 50.4% of men, with a median age of 58 years (range: 38-71). The final analysis of 11 items presented a Person Separation Index of 0.861 and good adjustment of data to the Rasch model. The scale was unidimensional and its items were not biased by sex, age or nationality. The oral health linear measure presented good construct validity. The cut-off value was set at 52 points. The questionnaire showed sufficient psychometric properties to be considered a reliable tool, valid for measuring the state of oral health in preoperative anaesthetic evaluations. Copyright © 2016 Sociedade Brasileira de Anestesiologia. Published by Elsevier Editora Ltda. All rights reserved.

Evaluation of Questionnaire, Reagent Strip and Egg Count as ...

African Journals Online (AJOL)

A longitudinal study covering 55 months evaluated the three diagnostic tools used for confirmation of prevalence of urinary schistosomiasis among 1151 consented primary school pupils in 13 communities of Edo State, Nigeria. Questionnaire, reagent strip method and parasitological examination were employed.

Evaluation Program initiative

International Nuclear Information System (INIS)

Rich, B.L.

1987-01-01

The purpose of this paper is to provide the Department of Energy's (DOE) safeguards and security community with some insights on an important management initiative by the Office of Security Evaluations (OSE). The paper will present the ''what, where, who, when, and why'' of a new Evaluation Program. The Evaluation Program will be comprised of a continuing series of regular and special evaluations of DOE safeguards and security programs and policies. The evaluations will be integrative and ''crosscutting,'' i.e. will extend across DOE organizational lines. Evaluations will be offered as positive advisories to DOE managers with safeguards and security responsibilities and will not be rated. They will complement the ongoing OSE Inspection Program of inspections conducted by OSE's Inspection Division. The purpose for the evaluations is to establish an accurate and current assessment of the effectiveness and status of safeguards and security programs and policies and to provide DOE managers with required information on program and policy effectiveness

Evaluation of the clinical implementation of a large-scale online e-learning program on venous blood specimen collection guideline practices.

Science.gov (United States)

Willman, Britta; Grankvist, Kjell; Bölenius, Karin

2018-05-11

When performed erroneously, the venous blood specimen collection (VBSC) practice steps patient identification, test request management and test tube labeling are at high risk to jeopardize patient safety. VBSC educational programs with the intention to minimize risk of harm to patients are therefore needed. In this study, we evaluate the efficiency of a large-scale online e-learning program on personnel's adherence to VBSC practices and their experience of the e-learning program. An interprofessional team transformed an implemented traditional VBSC education program to an online e-learning program developed to stimulate reflection with focus on the high-risk practice steps. We used questionnaires to evaluate the effect of the e-learning program on personnel's self-reported adherence to VBSC practices compared to questionnaire surveys before and after introduction of the traditional education program. We used content analysis to evaluate the participants free text experience of the VBSC e-learning program. Adherence to the VBSC guideline high-risk practice steps generally increased following the implementation of a traditional educational program followed by an e-learning program. We however found a negative trend over years regarding participation rates and the practice to always send/sign the request form following the introduction of an electronic request system. The participants were in general content with the VBSC e-learning program. Properly designed e-learning programs on VBSC practices supersedes traditional educational programs in usefulness and functionality. Inclusion of questionnaires in the e-learning program is necessary for follow-up of VBSC participant's practices and educational program efficiency.

Evaluation of an Australian Alcohol Media Literacy Program.

Science.gov (United States)

Gordon, Chloe S; Howard, Steven J; Jones, Sandra C; Kervin, Lisa K

2016-11-01

A 10-lesson alcohol media literacy program was developed, underpinned by the message interpretation processing model, inoculation theory, and constructivist learning theory, and was tailored to be culturally relevant to the Australian context. This program aimed to increase students' media deconstruction skills and reduce intent to drink alcohol. The purpose of this study was to evaluate the effectiveness of the program in achieving these goals through a short-term quasi-experimental trial. Elementary schools were assigned to either the intervention group (83 students) or a wait-list control group (82 students). Student questionnaires were administered at three time points (baseline, after the intervention group completed the program, and after the wait-list control group completed the program) to evaluate the effectiveness of the intervention. The intervention and wait-list control groups reported significantly higher media deconstruction skills as a result of the intervention. Both groups reported significantly lower social norms, whereas the wait-list control group reported significantly lower positive alcohol expectancies. There were no significant changes to self-efficacy to refuse alcohol, preference for alcohol-branded merchandise, and understanding of persuasive intent as a result of the intervention. To date, the majority of alcohol media literacy studies have been conducted in the United States and have focused on deconstructing television and print-based ads. This evaluation provides evidence that an alcohol media literacy program that was developed for a specific cultural context, and that incorporates a broad range of multimodal advertisements, can have a positive impact on beliefs and attitudes that are known predictors/precursors of drinking behaviors.

Questionnaire Evaluating Teaching Competencies in the University Environment. Evaluation of Teaching Competencies in the University

Science.gov (United States)

Moreno-Murcia, Juan Antonio; Silveira Torregrosa, Yolanda; Belando Pedreño, Noelia

2015-01-01

The objective of this study was to design and validate a measuring instrument to evaluate the performance of university professors. The Evaluation of Teaching Performance (CEID [Centro de Estudios e Investigaciones Docentes (Center for Teaching Studies and Research)]) questionnaire was administered to 1297 university students. Various factor…

Food consumption of adolescents. A simplified questionnaire for evaluating cardiovascular risk

Directory of Open Access Journals (Sweden)

Chiara Vera Lucia

2001-01-01

Full Text Available OBJECTIVE: To develop a simplified questionnaire for self-evaluation by adolescents of foods associated with the risk of coronary diseases. METHODS: Frequency questionnaires about 80 foods were answered by representative samples of 256 adolescents aged 12 to 19 from Rio de Janeiro as part of the Nutrition and Health Research project. The dependent variable was the serum cholesterol predicting equation as influenced by diet, and the independent variables were the foods. The variables were normalized and, using Pearson's correlation coefficient, those with r>0.10 were selected for the regression model. The model was analyzed for sex, age, random sample, and total calories. Those food products that explained 85% of the cholesterol variation equation were present in the caloric model, and contained trans fatty acids were selected for the questionnaire. RESULTS: Sixty-five food products had a statistically significant correlation (P<0.001 with the dependent variable. The simplified questionnaire included 9 food products present in all tested models: steak or broiled meat, hamburger, full-fat cheese, French fries or potato chips, whole milk, pies or cakes, cookies, sausages, butter or margarine. The limit of the added food points for self-evaluation was 100, and over 120 points was considered excessive. CONCLUSION: The scores given to the food products and the criteria for the evaluation of the consumption limits enabled the adolescents to get to know and to balance their intake.

Development of a questionnaire to evaluate asthma control in Japanese asthma patients.

Science.gov (United States)

Tohda, Yuji; Hozawa, Soichiro; Tanaka, Hiroshi

2018-01-01

The asthma control questionnaires used in Japan are Japanese translations of those developed outside Japan, and have some limitations; a questionnaire designed to optimally evaluate asthma control levels for Japanese may be necessary. The present study was conducted to validate the Japan Asthma Control Survey (JACS) questionnaire in Japanese asthma patients. A total of 226 adult patients with mild to severe persistent asthma were enrolled and responded to the JACS questionnaire, asthma control questionnaire (ACQ), and Mini asthma quality of life questionnaire (Mini AQLQ) at Weeks 0 and 4. The reliability, validity, and sensitivity/responsiveness of the JACS questionnaire were evaluated. The intra-class correlation coefficients (ICCs) were within the range of 0.55-0.75 for all JACS scores, indicating moderate/substantial reproducibility. For internal consistency, Cronbach's alpha coefficients ranged from 0.76 to 0.92 in total and subscale scores, which were greater than the lower limit of internal consistency. As for factor validity, the cumulative contribution ratio of four main factors was 0.66. For criterion-related validity, the correlation coefficients between the JACS total score and ACQ5, ACQ6, and Mini AQLQ scores were -0.78, -0.78, and 0.77, respectively, showing a significant correlation (p asthma control status in a higher number of patients. UMIN000016589. Copyright © 2017 Japanese Society of Allergology. Production and hosting by Elsevier B.V. All rights reserved.

Childbirth experience questionnaire (CEQ: development and evaluation of a multidimensional instrument

Directory of Open Access Journals (Sweden)

Bergqvist Liselotte

2010-12-01

Full Text Available Abstract Background Negative experiences of first childbirth increase risks for maternal postpartum depression and may negatively affect mothers' attitudes toward future pregnancies and choice of delivery method. Postpartum questionnaires assessing mothers' childbirth experiences are needed to aid in identifying mothers in need of support and counselling and in isolating areas of labour and birth management and care potentially in need of improvement. The aim of this study was to develop and evaluate a questionnaire for assessing different aspects of first-time mothers' childbirth experiences. Methods Childbirth domains were derived from literature searches, discussions with experienced midwives and interviews with first-time mothers. A draft version of the Childbirth Experience Questionnaire (CEQ was pilot tested for face validity among 25 primiparous women. The revised questionnaire was mailed one month postpartum to 1177 primiparous women with a normal pregnancy and spontaneous onset of active labor and 920 returned evaluable questionnaires. Exploratory factor analysis using principal components analysis and promax rotation was performed to identify dimensions of the childbirth experience. Multitrait scaling analysis was performed to test scaling assumptions and reliability of scales. Discriminant validity was assessed by comparing scores from subgroups known to differ in childbirth experiences. Results Factor analysis of the 22 item questionnaire yielded four factors accounting for 54% of the variance. The dimensions were labelled Own capacity, Professional support, Perceived safety, and Participation. Multitrait scaling analysis confirmed the fit of the four-dimensional model and scaling success was achieved in all four sub-scales. The questionnaire showed good sensitivity with dimensions discriminating well between groups hypothesized to differ in experience of childbirth. Conclusion The CEQ measures important dimensions of the first

Dysphagia in Multiple Sclerosis: Evaluation and Validation of the DYMUS Questionnaire.

Science.gov (United States)

Alali, Dalal; Ballard, Kirrie; Vucic, Steve; Bogaardt, Hans

2018-06-01

The 10-item Dysphagia in Multiple Sclerosis (DYMUS) questionnaire is a self-administered tool used to identify swallowing problems in adults with MS. The questionnaire was not validated against other existing questionnaires to assess its convergent validity. Moreover, its test-retest reliability was not measured previously. Therefore, the purpose of this study was to assess the factor analysis, internal consistency and test-retest reliability of the DYMUS, as well as its convergent validity against an established and validated questionnaire, the EAT-10. English-speaking adults with MS in New South Wales, Australia who were seen for routine medical check-ups were invited to complete two questionnaires across two phases. One hundred participants completed phase 1, while 55 completed phase 2. Statistical analyses were performed to investigate the psychometric properties of the DYMUS questionnaire. Internal consistency (Cronbach's Alpha) reduced the DYMUS questionnaire from ten to five items. The shortened version of the DYMUS showed high internal consistency (alpha = 0.904). It also showed satisfactory reproducibility, and adequate correlation with the 10-item Eating Assessment Tool (EAT-10). Evaluation of the DYMUS resulted in a shortened version of the questionnaire with five questions related to dysphagia. This shortened version is considered an easy and useful tool in identifying patients with MS-related dysphagia.

Validity and reliability of a self-administered foot evaluation questionnaire (SAFE-Q).

Science.gov (United States)

Niki, Hisateru; Tatsunami, Shinobu; Haraguchi, Naoki; Aoki, Takafumi; Okuda, Ryuzo; Suda, Yasunori; Takao, Masato; Tanaka, Yasuhito

2013-03-01

The Japanese Society for Surgery of the Foot (JSSF) is developing a QOL questionnaire instrument for use in pathological conditions related to the foot and ankle. The main body of the outcome instrument (the Self-Administered Foot Evaluation Questionnaire, SAFE-Q version 2) consists of 34 questionnaire items, which provide five subscale scores (1: Pain and Pain-Related; 2: Physical Functioning and Daily Living; 3: Social Functioning; 4: Shoe-Related; and 5: General Health and Well-Being). In addition, the instrument has nine optional questionnaire items that provide a Sports Activity subscale score. The purpose of this study was to evaluate the test-retest reliability of the SAFE-Q. Version 2 of the SAFE-Q was administered to 876 patients and 491 non-patients, and the test-retest reliability was evaluated for 131 patients. In addition, the SF-36 questionnaire and the JSSF Scale scoring form were administered to all of the participants. Subscale scores were scaled such that the final sum of scores ranged between zero (least healthy) to 100 (healthiest). The intraclass correlation coefficients were larger than 0.7 for all of the scores. The means of the five subscale scores were between 60 and 75. The five subscales easily separated patients from non-patients. The coefficients for the correlations of the subscale scores with the scores on the JSSF Scale and the SF-36 subscales were all highly statistically significantly greater than zero (p valid and reliable. In the future, it will be beneficial to test the responsiveness of the SAFE-Q.

Psychometric evaluation of 3-set 4P questionnaire.

Science.gov (United States)

Akerman, Eva; Fridlund, Bengt; Samuelson, Karin; Baigi, Amir; Ersson, Anders

2013-02-01

This is a further development of a specific questionnaire, the 3-set 4P, to be used for measuring former ICU patients' physical and psychosocial problems after intensive care and the need for follow-up. The aim was to psychometrically test and evaluate the 3-set 4P questionnaire in a larger population. The questionnaire consists of three sets: "physical", "psychosocial" and "follow-up". The questionnaires were sent by mail to all patients with more than 24-hour length of stay on four ICUs in Sweden. Construct validity was measured with exploratory factor analysis with Varimax rotation. This resulted in three factors for the "physical set", five factors for the "psychosocial set" and four factors for the "follow-up set" with strong factor loadings and a total explained variance of 62-77.5%. Thirteen questions in the SF-36 were used for concurrent validity showing Spearman's r(s) 0.3-0.6 in eight questions and less than 0.2 in five. Test-retest was used for stability reliability. In set follow-up the correlation was strong to moderate and in physical and psychosocial sets the correlations were moderate to fair. This may have been because the physical and psychosocial status changed rapidly during the test period. All three sets had good homogeneity. In conclusion, the 3-set 4P showed overall acceptable results, but it has to be further modified in different cultures before being considered a fully operational instrument for use in clinical practice. Copyright © 2012 Elsevier Ltd. All rights reserved.

Evaluation of a community-based falls prevention program in South Florida, 2008-2009.

Science.gov (United States)

Batra, Anamica; Melchior, Michael; Seff, Laura; Frederick, Newman; Palmer, Richard C

2012-01-01

Many older adults experience fear of falling, which may reduce participation in routine activities. A Matter of Balance (MOB) and Un Asunto de Equilibrio (ADE) workshops were offered in South Florida to reduce fear of falling and increase activity levels in older adults. The objectives of this study were to evaluate the effectiveness of the lay leader model of the programs in the first year of their implementation and to further report on participant outcome measures. We analyzed reach, adoption, and implementation data for participants who attended workshops between October 1, 2008, and December 31, 2009, who were aged 60 years or older, and who had both baseline and posttest outcome data. Workshops were in English and Spanish and consisted of 8 two-hour sessions. Participants completed a 7-item baseline and posttest questionnaire that consisted of a falls management scale, a social activity item, and modified version of Physician-Based Assessment and Counseling on Exercise. We analyzed outcome data on multiple characteristics using a general linear model. A class evaluation questionnaire measured participant satisfaction. Results for 562 participants who provided both baseline and posttest data showed significant improvement on 6 of 7 questions for MOB and all questions for ADE (P < .001). The 391 participants who provided evaluation data indicated that the programs were effective, beneficial, and well organized. Lay leaders successfully implemented the programs in community settings. The programs were effective in reducing fear of falling among older adults.

Determination of Satisfaction Index as a tool in evaluation of CME Program

Directory of Open Access Journals (Sweden)

Kuldeep Singh

2014-03-01

Full Text Available Continuing Medical Education is an indispensable part of physician's learning. Welldesigned program based on andragogy principles can enhance learning by motivatingthe learner and providing platform to encourage self directed learning. The presentstudy aimed to explore the impact of program “NAMS-AIIMS Regional Symposiumon Sleep Medicine” in changing the behavior and attitude of participants using“Satisfaction Index” and descriptive analysis of responses as evaluation tools forprogram effectiveness. This descriptive cross sectional study captured the response ofparticipants through a pre-tested and validated questionnaire administered at the end ofsymposium. The result showed almost equal sex distribution (M: F- 27: 34 withmajority being UG students (86%. Reliability of data showed Cronbach's Alpha of0.98 indicating high reliability. Satisfaction index (SI calculated as per WHOEducational Handbook for Health Personnel showed highest satisfaction for conduciveenvironment of symposium (87.87 % followed by provision for time to seekclarifications (87.21%, provision of appropriate Learning Resource material (85.90% and handling of critical comments by organizers (85.57%. Descriptive analysisshowed majority responses as highly positive to our questionnaire with suggestions formore such activity, inclusion of clinical cases and other aspects of practical relevance.Key words : evaluation, program, satisfaction index, Kirkpatrick Model, studentsatisfaction, adult learning, Knowles Theory.

Cross-cultural validation of the Prosthesis Evaluation Questionnaire in vascular amputees fitted with prostheses in Spain.

Science.gov (United States)

Benavent, Jose Vicente; Igual, Celedonia; Mora, Enrique; Antonio, Rosa; Tenias, Jose Maria

2016-12-01

The lack of specific prosthetic-related outcome instruments for Spanish amputees must be addressed. To elaborate a culturally equivalent version of the Prosthesis Evaluation Questionnaire in the Spanish language. Cross-cultural questionnaire validation. Two-step process for cultural adaptation: forward and backward translations of English original and Spanish translated versions; assessment of both construct and criterion validity and reliability in a group of vascular amputees. A total of 61 patients were recruited, 44 men (72.1%) and 17 women (27.9%), with a median age of 71.1 years (standard deviation: 7.7 years; range: 51-87 years). In the Prosthesis Evaluation Questionnaire-Spanish, the lowest scores were for gait and frustration, and the highest scores were for noise and stump health. Internal consistency of the questionnaire was acceptable (>0.70) for four of the scales used in the Prosthesis Evaluation Questionnaire but poor (<0.50) for the scales relating to appearance and stump health. Correlations with the quality-of-life levels as measured by the Short Form-36 were positive and mostly significant. Prosthesis Evaluation Questionnaire-Spanish could assess the quality of life in patients who have undergone vascular amputations and then been fitted with a prosthetic limb. The questionnaire shows adequate criteria validity when compared with other instruments for measuring quality of life. The Prosthesis Evaluation Questionnaire-Spanish could be a valid and reliable instrument for assessing adaptation to prostheses in vascular amputees. The questionnaire adds information relevant to the patient and the physician and may identify cases with poor expected adaptation to the prosthesis. © The International Society for Prosthetics and Orthotics 2015.

A Mokken scale analysis of the peer physical examination questionnaire.

Science.gov (United States)

Vaughan, Brett; Grace, Sandra

2018-01-01

Peer physical examination (PPE) is a teaching and learning strategy utilised in most health profession education programs. Perceptions of participating in PPE have been described in the literature, focusing on areas of the body students are willing, or unwilling, to examine. A small number of questionnaires exist to evaluate these perceptions, however none have described the measurement properties that may allow them to be used longitudinally. The present study undertook a Mokken scale analysis of the Peer Physical Examination Questionnaire (PPEQ) to evaluate its dimensionality and structure when used with Australian osteopathy students. Students enrolled in Year 1 of the osteopathy programs at Victoria University (Melbourne, Australia) and Southern Cross University (Lismore, Australia) were invited to complete the PPEQ prior to their first practical skills examination class. R, an open-source statistics program, was used to generate the descriptive statistics and perform a Mokken scale analysis. Mokken scale analysis is a non-parametric item response theory approach that is used to cluster items measuring a latent construct. Initial analysis suggested the PPEQ did not form a single scale. Further analysis identified three subscales: 'comfort', 'concern', and 'professionalism and education'. The properties of each subscale suggested they were unidimensional with variable internal structures. The 'comfort' subscale was the strongest of the three identified. All subscales demonstrated acceptable reliability estimation statistics (McDonald's omega > 0.75) supporting the calculation of a sum score for each subscale. The subscales identified are consistent with the literature. The 'comfort' subscale may be useful to longitudinally evaluate student perceptions of PPE. Further research is required to evaluate changes with PPE and the utility of the questionnaire with other health profession education programs.

Process Evaluation of a Workers' Health Surveillance Program for Meat Processing Workers.

Science.gov (United States)

van Holland, Berry J; Brouwer, Sandra; de Boer, Michiel R; Reneman, Michiel F; Soer, Remko

2017-09-01

Objective To evaluate the implementation process of a workers' health surveillance (WHS) program in a Dutch meat processing company. Methods Workers from five plants were eligible to participate in the WHS program. The program consisted of four evaluative components and an intervention component. Qualitative and quantitative methods were used to evaluate seven process aspects. Data were gathered by interviews with stakeholders, participant questionnaires, and from registries of the company and occupational health service. Results Two recruitment strategies were used: open invitation or automatic participation. Of the 986 eligible workers, 305 participated in the program. Average reach was 53 %. Two out of five program components could not be assessed on dose delivered, dose received and fidelity. If components were assessable, 85-100 % of the components was delivered, 66-100 % of the components was received by participants, and fidelity was 100 %. Participants were satisfied with the WHS program (mean score 7.6). Contextual factors that facilitated implementation were among others societal developments and management support. Factors that formed barriers were program novelty and delayed follow-up. Conclusion The WHS program was well received by participants. Not all participants were offered the same number of program components, and not all components were performed according to protocol. Deviation from protocol is an indication of program failure and may affect program effectiveness.

Development and initial psychometric evaluation of patient-reported outcome questionnaires to evaluate the symptoms and impact of hidradenitis suppurativa.

Science.gov (United States)

Kimball, Alexa B; Sundaram, Murali; Banderas, Benjamin; Foley, Catherine; Shields, Alan L

2018-03-01

Two patient-reported outcome (PRO) questionnaires, the Hidradenitis Suppurativa Symptom Assessment (HSSA) and Hidradenitis Suppurativa Impact Assessment (HSIA), were developed to measure signs, symptoms and impacts of HS in treatment efficacy studies. In accordance with FDA guidelines and published best practices, four stages of research were conducted to create the questionnaires: concept elicitation, questionnaire construction, content evaluation and psychometric evaluation. Subjects (N = 20) who participated in the concept elicitation stage reported 15 unique HS-related signs and symptoms and 51 impacts. Following this, eight sign and symptom concepts and 21 impacts were selected for construction of the HSSA and HSIA, respectively. During content evaluation, cognitive debriefing interviews with HS subjects (N = 20) confirmed subjects could read, comprehend and meaningfully respond to both questionnaires. Modifications made after this stage of work resulted in a nine-item HSSA and a 17-item HSIA. The HSSA and HSIA were subsequently entered into a US-based observational study (N = 40), and the scores produced by each were found to be reliable, construct valid, and able to distinguish among clinically distinct groups. The HSSA and HSIA are content-valid, HS-specific, PRO questionnaires with demonstrated ability to generate reliable, valid scores when administered to patients with HS in a research setting.

Process evaluation of a Toolbox-training program for construction foremen in Denmark

DEFF Research Database (Denmark)

Jeschke, Katharina Christiane; Kines, Pete; Rasmussen, Liselotte

2017-01-01

foremen’s knowledge and communication skills in daily planning of work tasks and their related OSH risks on construction sites. The program builds on the popular 'toolbox meeting' concept, however there is very little research evaluating these types of meetings. This article describes the development...... and revised until the final version after the fifth group. The evaluation utilized an action research strategy with a mixed–methods approach of triangulating questionnaire, interview, and observation data. Process evaluation results showed that the eight Toolbox-training topics were relevant and useful...

Evaluating a Health Risk Reduction Program.

Science.gov (United States)

Nagelberg, Daniel B.

1981-01-01

A health risk reduction program at Bowling Green State University (Ohio) tested the efficacy of peer education against the efficacy of returning (by mail) health questionnaire results. A peer health education program did not appear to be effective in changing student attitudes or lifestyles; however, the research methodology may not have been…

Psychometric Evaluation of Two Appetite Questionnaires in Patients With Heart Failure.

Science.gov (United States)

Andreae, Christina; Strömberg, Anna; Sawatzky, Richard; Årestedt, Kristofer

2015-12-01

Decreased appetite in heart failure (HF) may lead to undernutrition which could negatively influence prognosis. Appetite is a complex clinical issue that is often best measured with the use of self-report instruments. However, there is a lack of self-rated appetite instruments. The Council on Nutrition Appetite Questionnaire (CNAQ) and the Simplified Nutritional Appetite Questionnaire (SNAQ) are validated instruments developed primarily for elderly people. Yet, the psychometric properties have not been evaluated in HF populations. The aim of the present study was to evaluate the psychometric properties of CNAQ and SNAQ in patients with HF. A total of 186 outpatients with reduced ejection fraction and New York Heart Association (NYHA) functional classifications II-IV were included (median age 72 y; 70% men). Data were collected with the use of a questionnaire that included the CNAQ and SNAQ. The psychometric evaluation included data quality, factor structure, construct validity, known-group validity, and internal consistency. Unidimensionality was supported by means of parallel analysis and confirmatory factor analyses (CFAs). The CFA results indicated sufficient model fit. Both construct validity and known-group validity were supported. Internal consistency reliability was acceptable, with ordinal coefficient alpha estimates of 0.82 for CNAQ and 0.77 for SNAQ. CNAQ and SNAQ demonstrated sound psychometric properties and can be used to measure appetite in patients with HF. Copyright © 2015 Elsevier Inc. All rights reserved.

A standardised questionnaire for evaluating hospital-based rotations in general practice vocational training.

Science.gov (United States)

Viniol, Annika; Lommler-Thamer, Martina; Baum, Erika; Banzhoff, Norbert Donner

2015-05-01

The residency period of vocational training is a fundamental component for a general practitioner's (GP's) qualification. During the residency, teaching is given by consultants and staff from different medical disciplines who do not necessarily know the GP registrar's training objectives. To develop a standardised feedback questionnaire to evaluate residency attachments and enable GP registrars and their supervisors to discuss the actual training environment and areas for improvement. A cross-sectional study was carried out to assess GP registrars' ratings of items preselected by an expert group to reflect important elements in high-quality vocational training. We recruited GP registrars in Germany via mailing lists and online discussion forums and used the importance-severity-score method to score the content and importance of the selected items. On the basis of these ratings, we eliminated 74 items. This version of the questionnaire then underwent an intra-observer-reliability evaluation by the same GP registrars after eight weeks. Items with a correlation of less than 0.4 (Pearson correlation coefficient) were dropped or rephrased. Our initial questionnaire featured 117 potential items. We reduced this to 43 items after the first study; two additional items were dropped following the reliability test. To our knowledge, this is the first standardised feedback questionnaire evaluating the residency period of vocational training. We hope our work will improve the quality of GPs' vocational training. The importance-severity-score method is a fast and efficient method for developing instruments using personal judgement to evaluate constructs.

Questionnaire evaluating teaching competencies in the university environment. Evaluation of teaching competencies in the university

OpenAIRE

Juan Antonio Moreno-Murcia; Yolanda Silveira Torregrosa; Noelia Belando Pedreño

2015-01-01

The objective of this study was to design and validate a measuring instrument to evaluate the performance of university professors. The Evaluation of Teaching Performance (CEID [Centro de Estudios e Investigaciones Docentes (Center for Teaching Studies and Research)]) questionnaire was administered to 1297 university students. Various factor analyses were performed (exploratory and confirmatory), of the internal consistency, descriptive statistics, and correlation of all of the items. The dat...

Evaluation of doctoral nursing programs in Japan by faculty members and their educational and research activities.

Science.gov (United States)

Arimoto, Azusa; Gregg, Misuzu F; Nagata, Satoko; Miki, Yuko; Murashima, Sachiyo

2012-07-01

Evaluation of doctoral programs in nursing is becoming more important with the rapid increase in the programs in Japan. This study aimed to evaluate doctoral nursing programs by faculty members and to analyze the relationship of the evaluation with educational and research activities of faculty members in Japan. Target settings were all 46 doctoral nursing programs. Eighty-five faculty members from 28 programs answered the questionnaire, which included 17 items for program evaluation, 12 items for faculty evaluation, 9 items for resource evaluation, 3 items for overall evaluations, and educational and research activities. A majority gave low evaluations for sources of funding, the number of faculty members and support staff, and administrative systems. Faculty members who financially supported a greater number of students gave a higher evaluation for extramural funding support, publication, provision of diverse learning experiences, time of supervision, and research infrastructure. The more time a faculty member spent on advising doctoral students, the higher were their evaluations on the supportive learning environment, administrative systems, time of supervision, and timely feedback on students' research. The findings of this study indicate a need for improvement in research infrastructure, funding sources, and human resources to achieve quality nursing doctoral education in Japan. Copyright © 2011 Elsevier Ltd. All rights reserved.

Evaluation of the Pharmacy Safety Climate Questionnaire in European community pharmacies.

NARCIS (Netherlands)

Phipps, D.L.; Bie, J. de; Herborg, H.; Guerreiro, M.; Eickhoff, C.; Fernandes-Llimos, F.; Bouvy, M.L.; Rossing, C.; Mueller, U.; Ashcroft, D.M.

2012-01-01

Objective: To evaluate the internal reliability, factor structure and construct validity of the Pharmacy Safety Climate Questionnaire (PSCQ) when applied to a pan-European sample of community pharmacies. Design: A cross-sectional survey design was used. Setting: Community pharmacies in Denmark,

A standardized motor imagery introduction program (MIIP for neuro-rehabilitation: development and evaluation

Directory of Open Access Journals (Sweden)

Christine eWondrusch

2013-08-01

Full Text Available Background: For patients with central nervous system lesions and sensorimotor impairments a solid motor imagery (MI introduction is crucial to understand and use MI to improve motor performance. The study’s aim was to develop and evaluate a standardized MI group introduction program (MIIP for patients after stroke, multiple sclerosis, Parkinson’s disease, and traumatic brain injury. Methods:Phase 1: Based on literature a MIIP was developed comprising MI theory (definition, type, mode, perspective, planning and MI practice (performance, control. Phase 2: Development of a 27-item self-administered MIIP evaluation questionnaire, assessing MI knowledge self-evaluation of the ability to perform MI and patient satisfaction with the MIIP. Phase 3: Evaluation of MIIP and MI questionnaire by 2 independent MI experts based on predefined criteria and 2 patients using semi-structured interviews.Phase 4: Case series with a pre-post design to evaluate MIIP (3x30minutes using the MI questionnaire, Imaprax, Kinaesthetic and Visual Imagery Questionnaire, and Mental Chronometry. The paired t-test and the Wilcoxon signed-rank test were used to determine significant changes.Results: Data of eleven patients were analysed (5 females; age 62.3±14.1 years. Declarative MI knowledge improved significantly from 5.4±2.2 to 8.8±2.9 (p=0.010. Patients demonstrated good satisfaction with MIIP (mean satisfaction score: 83.2±11.4 %. MI ability remained on a high level but showed no significant change, except a significant decrease in the Kinaesthetic and Visual Imagery Questionnaire score.Conclusion: The presented MIIP seems to be valid and feasible for patients with central nervous system lesions and sensorimotor impairments resulting in improved MI knowledge. MIIP sessions can be held in groups of four or less. MI ability and Mental Chronometry remained unchanged after 3 training sessions.

A standardized motor imagery introduction program (MIIP) for neuro-rehabilitation: development and evaluation.

Science.gov (United States)

Wondrusch, C; Schuster-Amft, C

2013-01-01

For patients with central nervous system (CNS) lesions and sensorimotor impairments a solid motor imagery (MI) introduction is crucial to understand and use MI to improve motor performance. The study's aim was to develop and evaluate a standardized MI group introduction program (MIIP) for patients after stroke, multiple sclerosis (MS), Parkinson's disease (PD), and traumatic brain injury (TBI). Phase 1: Based on literature a MIIP was developed comprising MI theory (definition, type, mode, perspective, planning) and MI practice (performance, control). Phase 2: Development of a 27-item self-administered MIIP evaluation questionnaire, assessing MI knowledge self-evaluation of the ability to perform MI and patient satisfaction with the MIIP. Phase 3: Evaluation of MIIP and MI questionnaire by 2 independent MI experts based on predefined criteria and 2 patients using semi-structured interviews. Phase 4: Case series with a pre-post design to evaluate MIIP (3 × 30 min) using the MI questionnaire, Imaprax, Kinaesthetic and Visual Imagery Questionnaire, and Mental Chronometry. The paired t-test and the Wilcoxon signed-rank test were used to determine significant changes. Data of eleven patients were analysed (5 females; age 62.3 ± 14.1 years). Declarative MI knowledge improved significantly from 5.4 ± 2.2 to 8.8 ± 2.9 (p = 0.010). Patients demonstrated good satisfaction with MIIP (mean satisfaction score: 83.2 ± 11.4%). MI ability remained on a high level but showed no significant change, except a significant decrease in the Kinaesthetic and Visual Imagery Questionnaire score. The presented MIIP seems to be valid and feasible for patients with CNS lesions and sensorimotor impairments resulting in improved MI knowledge. MIIP sessions can be held in groups of four or less. MI ability and Mental Chronometry remained unchanged after 3 training sessions.

Using insects for STEM outreach: Development and evaluation of the UA Insect Discovery Program

Science.gov (United States)

Beal, Benjamin D.

Science and technology impact most aspects of modern daily life. It is therefore important to create a scientifically literate society. Since the majority of Americans do not take college-level science courses, strong K-12 science education is essential. At the K-5 level, however, many teachers lack the time, resources and background for effective science teaching. Elementary teachers and students may benefit from scientist-led outreach programs created by Cooperative Extension or other institutions. One example is the University of Arizona Insect Discovery Program, which provides short-duration programing that uses insects to support science content learning, teach critical thinking and spark interest in science. We conducted evaluations of the Insect Discovery programming to determine whether the activities offered were accomplishing program goals. Pre-post tests, post program questionnaires for teachers, and novel assessments of children's drawings were used as assessment tools. Assessments were complicated by the short duration of the program interactions with the children as well as their limited literacy. In spite of these difficulties, results of the pre-post tests indicated a significant impact on content knowledge and critical thinking skills. Based on post-program teacher questionnaires, positive impacts on interest in science learning were noted as much as a month after the children participated in the program. New programming and resources developed to widen the potential for impact are also described.

Questionnaire-based evaluation of everyday competence in older adults

Directory of Open Access Journals (Sweden)

Tobias Kalisch

2011-01-01

Full Text Available Tobias Kalisch1, Julia Richter3, Melanie Lenz1, Jan-Christoph Kattenstroth2, Izabela Kolankowska2, Martin Tegenthoff1, Hubert R Dinse21Department of Neurology, BG-Kliniken Bergmannsheil, 2Neural Plasticity Lab, Institute for Neuroinformatics, Department of Theoretical Biology, 3Faculty of Psychology, Department of Methods, Diagnostics and Evaluation, Ruhr-University Bochum, GermanyBackground: Gerontological research aims at understanding factors that are crucial for mediating “successful aging”. This term denotes the absence of significant disease and disabilities, maintenance of high levels of physical and cognitive function, and preservation of social and productive activities. Preservation of an active lifestyle is considered an effective means through which everyday competence can be attained. In this context, it is crucial to obtain ratings of modern day older adults’ everyday competence by means of appropriate assessments. Here, we introduce the Everyday Competence Questionnaire (ECQ, designed to assess healthy older adults' everyday competence.Methods: The ECQ includes 17 items, covering housekeeping, leisure activities, sports, daily routines, manual skills, subjective well-being, and general linguistic usage. The ECQ was administered to a population of 158 healthy subjects aged 60–91 years, who were divided into groups on the basis of their physical activity. These groups were community-dwelling subjects, those living independently and having a sedentary lifestyle, those living independently but characterized by a general lifestyle without any noteworthy physical activity, and those living independently and exercising regularly. Age, gender, and education levels were balanced between the groups.Results: Using the ECQ, we could identify and distinguish different everyday competence levels between the groups tested: Subjects characterized by an active lifestyle outperformed all other groups. Subjects characterized by a general

The Evaluation of a Pullout Program for Gifted Children in Israel.

Science.gov (United States)

Rosemarin, Shoshana

2001-01-01

Students, peers, teachers, principals, and parents (total N=180) responded to a questionnaire concerning a pullout program for gifted students in Israel. The questionnaire focused on the identification of the gifted, the level of parent involvement, teaching styles in the program, problems related to separation from home schools, relationships…

Technical report: an ePRO patient reported outcome program for the evaluation of patients with irritable bowel syndrome.

Science.gov (United States)

Gerson, C D; Gerson, M-J

2014-02-01

Patient reported outcome (PRO) is an important healthcare concept that describes patient's participation in their care by self-evaluation, usually in the form of questionnaires. This report describes an unique computerized technique, electronic PRO (ePRO), for following the progress of patients with irritable bowel syndrome (IBS). Patients first completed a series of questionnaires, including questions about their illness history, symptom severity, and, in this application, psychological and relationship issues. The symptom severity and psychological questionnaires were then completed at intervals by the patients on their own computers. The ePRO was constructed to allow scores to be automatically summed and placed on a time-line graph for review at the time of the next office visit. Of the 32 patients who completed the initial set of questionnaires, 20 maintained participation in the program for a 6-month period. Of those 20 patients, median number of submissions was 7.0; median interval between questionnaire submissions was 3.0 weeks, whereas median interval between office visits was 5.9 weeks. On average, questionnaire completion took less than 5 min and was positively experienced by the patients. The ePRO program proved to be technically feasible, clinically useful, and positively experienced by the patients. It provides a focus on a collaborative conversation between physician and patient. It has significant potential as a technique for evaluating outcome in response to various therapies. © 2013 John Wiley & Sons Ltd.

Systematic content evaluation and review of measurement properties of questionnaires for measuring self-reported fatigue among older people.

Science.gov (United States)

Egerton, Thorlene; Riphagen, Ingrid I; Nygård, Arnhild J; Thingstad, Pernille; Helbostad, Jorunn L

2015-09-01

The assessment of fatigue in older people requires simple and user-friendly questionnaires that capture the phenomenon, yet are free from items indistinguishable from other disorders and experiences. This study aimed to evaluate the content, and systematically review and rate the measurement properties of self-report questionnaires for measuring fatigue, in order to identify the most suitable questionnaires for older people. This study firstly involved identification of questionnaires that purport to measure self-reported fatigue, and evaluation of the content using a rating scale developed for the purpose from contemporary understanding of the construct. Secondly, for the questionnaires that had acceptable content, we identified studies reporting measurement properties and rated the methodological quality of those studies according to the COSMIN system. Finally, we extracted and synthesised the results of the studies to give an overall rating for each questionnaire for each measurement property. The protocol was registered with PROSPERO (CRD42013005589). Of the 77 identified questionnaires, twelve were selected for review after content evaluation. Methodological quality varied, and there was a lack of information on measurement error and responsiveness. The PROMIS-Fatigue item bank and short forms perform the best. The FACIT-Fatigue scale, Parkinsons Fatigue Scale, Perform Questionnaire, and Uni-dimensional Fatigue Impact Scale also perform well and can be recommended. Minor modifications to improve performance are suggested. Further evaluation of unresolved measurement properties, particularly with samples including older people, is needed for all the recommended questionnaires.

Energy-efficient buildings program evaluations. Volume 2: Evaluation summaries

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This document presents summaries of code and utility building program evaluations reviewed as the basis for the information presented in Energy-Efficient Buildings Program Evaluations, Volume 1: Findings and Recommendations, DOE/EE/OBT-11569, Vol. 1. The main purpose of this volume is to summarize information from prior evaluations of similar programs that may be useful background for designing and conducting an evaluation of the BSGP. Another purpose is to summarize an extensive set of relevant evaluations and provide a resource for program designers, mangers, and evaluators.

Development and validation of a questionnaire to evaluate infection control in oral radiology

Science.gov (United States)

Pinelli, Camila; da Silva Tagliaferro, Elaine P; Corrente, José E; Ambrosano, Glaucia M B

2017-01-01

Objectives: To create and validate a questionnaire to evaluate infection control in oral radiology. Methods: The questionnaire was developed after review of the literature, which included published articles and the biosafety protocols available from healthcare agencies. The initial version of the questionnaire was composed of 14 multiple choice questions and was divided into 3 domains on handwashing, disinfection/protection of surfaces and disinfectant used. Content validity was assessed by two expert committees, which reviewed the content and scope of the questionnaire and the relevance of each item, respectively. Reliability was evaluated using test–retest and internal consistency methods with 115 undergraduate dentistry students. Construct validity was assessed using the known-groups technique and factor analysis. The known-groups technique involved 641 undergraduate dentistry students, 20 PhD students and 15 oral radiology professors. In the factor analysis, 3 radiology technicians also participated in addition to the 641 undergraduates, 20 PhD students and 15 oral radiology professors. Results: The content validity results were found to be satisfactory to excellent for the ordinal variables (intraclass correlation coefficient = 0.722–1.000) and good to great for the yes/no questions (kappa = 0.662–0.913) in terms of reliability and good internal consistency (Cronbach's alpha = 0.88). After a factor analysis, some questions were excluded, and the questions were grouped into new domains. Significant differences were observed between answers from different groups. The final version of the questionnaire was composed of nine domains. Conclusions: The questionnaire created was found to exhibit good psychometric properties for assessing infection control in oral radiology. PMID:28112553

Design and Evaluation of the Psychometric Properties of a Paternal Adaptation Questionnaire.

Science.gov (United States)

Eskandari, Narges; Simbar, Masoumeh; Vadadhir, AbouAli; Baghestani, Ahmad Reza

2016-07-25

The present study aimed to design and evaluate the psychometric properties of the Paternal Adaptation Questionnaire (PAQ). The study was a mixed (qualitative and quantitative) sequential exploratory study. In the qualitative phase, a preliminary questionnaire with 210 items emerged from in-depth interviews with 17 fathers and 15 key informants. In the quantitative phase, psychometric properties of the PAQ were assessed. Considering cutoff points as 1.5 for item impact, 0.49 for content validity ratio (CVR), and 0.7 for content validity index (CVI), items of the questionnaire were reduced from 210 to 132. Assessment of the content validity of the questionnaire demonstrated S-CVR = 0.68 and S-CVI = 0.92. Exploratory factor analysis resulted in the development of a PAQ with 38 items classified under five factors (ability in performing the roles and responsibilities; perceiving the parental development; stabilization in paternal position; spiritual stability and internal satisfaction; and challenges and concerns), which explained 52.19% of cumulative variance. Measurement of internal consistency reported a Cronbach's α of .89 for PAQ (.61-.86 for subscales), and stability assessment of the PAQ through the test-retest demonstrated Spearman's correlation coefficients and intraclass correlation coefficient of .96 (.81-.97 for subscales). It was identified that the PAQ is a valid and reliable instrument that could be used to assess fatherhood adaptation with the paternal roles and fathers' needs, as well as to design appropriate interventions and to evaluate their effectiveness. © The Author(s) 2016.

EATING DISORDERS AND DIET MANAGEMENT IN CONTACT SPORTS; EAT-26 QUESTIONNAIRE DOES NOT SEEM APPROPRIATE TO EVALUATE EATING DISORDERS IN SPORTS.

Science.gov (United States)

Martínez Rodríguez, Alejandro; Vicente Salar, Néstor; Montero Carretero, Carlos; Cervelló Gimeno, Eduardo; Roche Collado, Enrique

2015-10-01

there is a growing concern in the appearance of eating disorders in athletes, especially those that practice sports grouped into weight categories. This affects the way athletes eat, using frequently unhealthy strategies to control weight, especially during the pre-competition period. this study analyses the prevalence of contact sports athletes in developing eating disorders, and how a controlled diet plan can reduce this risk. At the same time, it evaluates the use of the EAT-26 questionnaire to detect such disorders. a randomized frequency study was performed on 244 athletes (158 men, 86 women), who were separated into two groups: those that followed a diet plan given by a nutritionist, and a control group on a free diet. The athletes completed an EAT-26 questionnaire while participating in the University-level National Championships. the free diet group scored significantly higher on the questionnaire. Also, the female athletes controlled diet group scored significantly higher than their male counterparts. the results of the questionnaire indicate that an adequate nutritional program circumvents the use of unhealthy habits to control body weight and therefore avoids developing particular eating disorders. EAT-26 questionnaire does not seem the most appropriate tool to detect these disorders. Copyright AULA MEDICA EDICIONES 2014. Published by AULA MEDICA. All rights reserved.

Pioneering Integrated Education and Research Program in Graduate School of Engineering and its Inquiry by Questionnaire

Science.gov (United States)

Minamino, Yoritoshi

Department of Adaptive Machine Systems, Department of Materials and Manufucturing Science and Department of Business engineering have constructed the educational programs of consecutive system from master to doctor courses in graduate school of engineering, “Pioneering Integrated Education and Research Program (PP) ”, to produce volitional and original mind researchers with high abilities of research, internationality, leader, practice, management and economics by cooperation between them for reinforcement of their ordinary curriculums. This program consists of the basic PP for master course students and the international exchange PP, leadership pp and tie-up PP of company and University for Doctor course students. In 2005th the basic PP was given to the master course students and then their effectiveness of the PP was investigated by questionnaire. The results of questionnaire proved that the graduate school students improved their various abilities by the practical lesson in cooperation between companies and our Departments in the basic PP, and that the old boys after basic PP working in companies appreciated the advantages to business planning, original conception, finding solution, patents, discussion, report skills required in companies.

Development and evaluation of an educational intervention program for pre-professional adolescent ballet dancers: nutrition for optimal performance.

Science.gov (United States)

Doyle-Lucas, Ashley F; Davy, Brenda M

2011-06-01

The purpose of this investigation was to develop, implement, and evaluate a theoretically based nutritional education intervention through a DVD lecture series (three 30-minute classes) in summer intensive programs for pre-professional, adolescent ballet dancers. Objectives of this intervention program were to increase knowledge of basic sports nutrition principles and the Female Athlete Triad and promote self-efficacy for adopting healthier dietary habits. Dancers ranging from 13 to 18 years old who were attending summer intensive programs affiliated with professional ballet companies were recruited. Group One (n = 231) participated in the nutrition education program, while Group Two the control participants (n = 90) did not. Assessments of the participants' dietary status consisted of a demographic questionnaire, a Sports Nutrition Knowledge and Behavior Questionnaire, and a Food Frequency Questionnaire. The intervention group was assessed at baseline, immediately post-program, and at six weeks post-program. The control group was assessed at baseline and at six weeks post-baseline. The intervention program was effective at increasing nutrition knowledge, perceived susceptibility to the Female Athlete Triad, and self-efficacy constructs. Improvements in dietary intake were also observed among intervention group participants. To improve overall health and performance nutrition education should be incorporated into the training regimens of adolescent dancers. This potentially replicable DVD-based program may be an effective, low-cost mechanism for doing that.

The efficacy of an educational program for parents of children with epilepsy (FAMOSES): Results of a controlled multicenter evaluation study.

Science.gov (United States)

Hagemann, Anne; Pfäfflin, Margarete; Nussbeck, Fridtjof W; May, Theodor W

2016-11-01

The objective of this study was to evaluate the efficacy of the educational program FAMOSES (modular service package epilepsy for families) for parents of children with epilepsy. Parents of children with epilepsy from Germany and Austria were included in a controlled prospective multicenter study using a pre-post design. Participants of the FAMOSES program (FAMOSES group, n=148) completed a standardized questionnaire immediately before the program and six months later. The matched control group of parents not participating in the program (n=74, matching ratio 2:1) also answered the questionnaire twice, at an interval of six months. The questionnaire comprised epilepsy-specific outcome measures (e.g., knowledge, coping, fears) and disease-related variables (e.g., seizure frequency). The generalized estimation equation approach was used for statistical analysis. In addition, parents' satisfaction with the FAMOSES program was assessed six months after participation. Parents of the FAMOSES group significantly improved in epilepsy-specific knowledge (group×time interaction: pepilepsy-related fears (pepilepsy with their child (pepilepsy and reduce epilepsy-related fears. Copyright © 2016 Elsevier Inc. All rights reserved.

Developing medical educators – a mixed method evaluation of a teaching education program

Directory of Open Access Journals (Sweden)

Marco Roos

2014-03-01

Full Text Available Background: It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods: An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1 ‘Reaction’ on a professional and emotional level using standardized questionnaires; 2 ‘Learning’ applying a multiple choice test; 3 ‘Behavior’ by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4 ‘Results’ from student evaluations. Results: Our data indicate the success of the educational intervention at all observed levels. 1 Reaction: The participants showed a high acceptance of the instructional content. 2 Learning: There was a significant increase in knowledge (P<0.001 as deduced from a pre-post multiple-choice questionnaire, which was retained at 6 months (P<0.001. 3 Behavior: Peer-, self-, and expert-assessment indicated a transfer of learning into teaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4 Results: Teaching performance ratings improved in students’ evaluations. Conclusions: Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

An Analysis of Questionnaire Survey on Online Evaluation of Teaching by University Undergraduates

Science.gov (United States)

Sun, Dongyun

2013-01-01

This paper takes into consideration of the problems discovered in the teaching evaluation data statistics over the years in Changchun University of Science and Technology and cooperates with related departments to conduct a questionnaire survey on an online evaluation of teaching, with the purpose of detecting cognition of students in evaluation…

Suitability of a structured Fundamental Movement Skills program for long day care centres: a process evaluation.

Science.gov (United States)

Petrunoff, Nick; Lloyd, Beverley; Watson, Natalie; Morrisey, David

2009-04-01

Early childhood presents an opportunity to encourage development of Fundamental Movement Skills (FMS). Implementation of a structured program in the Long Day Care (LDC) setting presents challenges. Implementation of a structured FMS program FunMoves was assessed in LDC in metropolitan New South Wales. LDC staff attended a training session conducted by trained Health Promotion Officers (HPOs) and completed an evaluation. During implementation HPOs completed lesson observations. De-identified attendance data was collected and director and staff feedback on the program including barriers to implementation was obtained via questionnaire. Qualitative information relevant to process evaluation was obtained via open questions on questionnaires, and a de-brief diary recording feedback from directors and staff. Knowledge of FMS and FunMoves and staff confidence to deliver the program were high after training. On average, staff stated they ran lessons more than the suggested twice weekly and the majority of children attended 1-3 lessons per week. However, lesson delivery was not as designed, and staff found FunMoves disruptive and time consuming. Six directors and the majority of staff thought that FunMoves could be improved. Structured program delivery was hampered by contextual issues including significant staff turnover and program length and structure being at odds with the setting. Implementation could be enhanced by guidelines for more flexible delivery options including less structured approaches, shorter and simpler lessons, ongoing conversations with the early childhood sector, in-centre engagement of staff and post-training support.

Impacting Binational Health through Leadership Development: A Program Evaluation of the Leaders across Borders Program, 2010–2014

Directory of Open Access Journals (Sweden)

Omar A. Contreras

2017-08-01

Full Text Available BackgroundWorkforce and leadership development is imperative for the advancement of public health along the U.S./Mexico border. The Leaders across borders (LaB program aims to train the public health and health-care workforce of the border region. The LaB is a 6-month intensive leadership development program, which offers training in various areas of public health. Program curriculum topics include: leadership, border health epidemiology, health diplomacy, border public policies, and conflict resolution.MethodsThis article describes the LaB program evaluation outcomes across four LaB cohort graduates between 2010 and 2014. LaB graduates received an invitation to participate via email in an online questionnaire. Eighty-five percent (n = 34 of evaluation participants indicated an improvement in the level of binationality since participating in the LaB program. Identified themes in the evaluation results included increased binational collaborations and partnerships across multidisciplinary organizations that work towards improving the health status of border communities. Approximately 93% (n = 37 of the LaB samples were interested in participating in future binational projects while 80% (n = 32 indicated interest in the proposal of other binational initiatives. Participants expressed feelings of gratitude from employers who supported their participation and successful completion of LaB.DiscussionPrograms such as LaB are important in providing professional development and education to a health-care workforce along the U.S./Mexico border that is dedicated to positively impacting the health outcomes of vulnerable populations residing in this region.

Measuring the quality of governmental websites in a controlled versus a laboratory setting with the Website Evaluation Questionnaire

NARCIS (Netherlands)

Elling, Sanne; Lentz, Leo; de Jong, Menno D.T.; van den Bergh, Huub

2012-01-01

The quality of governmental websites is often measured with questionnaires that ask users for their opinions on various aspects of the website. This article presents the Website Evaluation Questionnaire (WEQ), which was specifically designed for the evaluation of governmental websites. The

Program evaluation

Energy Technology Data Exchange (ETDEWEB)

1988-01-01

This book contains the proceedings from the panel on program evaluation. Some of the papers included are the following: Seattle City Light's Industrial Retrofit Demonstration Project Uses Quasi-Experimental Research Design and Metering to Measure Savings, Evaluation for PUCs, and The Takeback Effect Low-income Weatherizations Fact or Fiction

Psychometric properties evaluation of a new ergonomics-related job factors questionnaire developed for nursing workers.

Science.gov (United States)

Coluci, Marina Zambon Orpinelli; Alexandre, Neusa Maria Costa

2014-11-01

The objectives of this study were to develop a questionnaire that evaluates the perception of nursing workers to job factors that may contribute to musculoskeletal symptoms, and to evaluate its psychometric properties. Internationally recommended methodology was followed: construction of domains, items and the instrument as a whole, content validity, and pre-test. Psychometric properties were evaluated among 370 nursing workers. Construct validity was analyzed by the factorial analysis, known-groups technique, and convergent validity. Reliability was assessed through internal consistency and stability. Results indicated satisfactory fit indices during confirmatory factor analysis, significant difference (p office workers, and moderate correlations between the new questionnaire and Numeric Pain Scale, SF-36 and WRFQ. Cronbach's alpha was close to 0.90 and ICC values ranged from 0.64 to 0.76. Therefore, results indicated that the new questionnaire had good psychometric properties for use in studies involving nursing workers. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

An evaluation of an airline cabin safety education program for elementary school children.

Science.gov (United States)

Liao, Meng-Yuan

2014-04-01

The knowledge, attitude, and behavior intentions of elementary school students about airline cabin safety before and after they took a specially designed safety education course were examined. A safety education program was designed for school-age children based on the cabin safety briefings airlines given to their passengers, as well as on lessons learned from emergency evacuations. The course is presented in three modes: a lecture, a demonstration, and then a film. A two-step survey was used for this empirical study: an illustrated multiple-choice questionnaire before the program, and, upon completion, the same questionnaire to assess its effectiveness. Before the program, there were significant differences in knowledge and attitude based on school locations and the frequency that students had traveled by air. After the course, students showed significant improvement in safety knowledge, attitude, and their behavior intention toward safety. Demographic factors, such as gender and grade, also affected the effectiveness of safety education. The study also showed that having the instructor directly interact with students by lecturing is far more effective than presenting the information using only video media. A long-term evaluation, the effectiveness of the program, using TV or video accessible on the Internet to deliver a cabin safety program, and a control group to eliminate potential extraneous factors are suggested for future studies. Copyright © 2013 Elsevier Ltd. All rights reserved.

Three-year emergency medicine training program in The Netherlands: first evaluation from the residents' perspective.

Science.gov (United States)

Koning, Salomon Willem; Gaakeer, Menno Iskander; Veugelers, Rebekka

2013-07-26

The Netherlands' 3-year training in Emergency Medicine (EM) was formally approved and introduced in November 2008. To identify areas for improvement, we conducted the first evaluation of this curriculum from the residents' perspective. A questionnaire was composed on ten aspects of the curriculum. It contained multiple-choice, open and opinion questions; answers to the latter were classified using the Likert scale. The questionnaires were mailed to all enrolled residents. We mailed questionnaires to all 189 enrolled residents, and 105 responded (55.6%). Although they were satisfied with their training overall, 96.2% thought it was currently too short: 18.3% desired extension to 4 years, 76.0% to 5 and 1.9% to 6 years. Nevertheless, residents expected that they would function effectively as emergency physicians (EPs) after finishing their 3-year training program. Bedside teaching was assessed positively by 35.2%. All rotations were assessed positively, with the general practice rotation seen as contributing the least to the program. According to 43.7%, supervising EPs were available for consultation; 40.7% thought that, in a clinical capacity, the EP was sufficiently present during residents' shifts. When EPs were present, 82.5% found them to be easily accessible, and 66.6% viewed them as role models. In the Emergency Medicine Departments (EDs) with a higher number of EPs employed, residents tended to perceive better supervision and were more likely to see their EPs as role models. While residents were stimulated to do research, actual support and assistance needed to be improved. Although overall, the current training program was evaluated positively, the residents identified four areas for improvement: (1) in training hospitals, trained EPs should be present more continuously for clinical supervision; (2) bedside teaching should be improved, (3) scientific research should be facilitated more and (4) the training program should be extended.

Questionnaire for usability evaluation of orthopaedic shoes: construction and reliability in patients with degenerative disorders of the foot

NARCIS (Netherlands)

Jannink, M.J.A.; de Vries, Jaap; Stewart, Roy E.; Groothoff, Johan W.; Lankhorst, Gustaaf J.

2004-01-01

Objective: To develop a self-report questionnaire for patients with degenerative disorders of the foot to evaluate the usability of their orthopaedic shoes, and to assess the reproducibility and responsiveness of the instrument. Design: Development of the Questionnaire for Usability Evaluation of

Questionnaire for usability evaluation of orthopaedic shoes : Construction and reliability in patients with degenerative disorders of the foot

NARCIS (Netherlands)

Jannink, MJA; de Vries, J; Stewart, RE; Groothoff, JW; Lankhorst, GJ

2004-01-01

Objective: To develop a self-report questionnaire for patients with degenerative disorders of the foot to evaluate the usability of their orthopaedic shoes, and to assess the reproducibility and responsiveness of the instrument. Design: Development of the Questionnaire for Usability Evaluation of

Questionnaire for usability evaluation of orthopaedic shoes : Construction and reliability in patients with degenerative disorders of the foot

NARCIS (Netherlands)

Jannink, MJA; de Vries, J; Stewart, RE; Groothoff, JW; Lankhorst, GJ

Objective: To develop a self-report questionnaire for patients with degenerative disorders of the foot to evaluate the usability of their orthopaedic shoes, and to assess the reproducibility and responsiveness of the instrument. Design: Development of the Questionnaire for Usability Evaluation of

Questionnaire evaluating teaching competencies in the university environment. Evaluation of teaching competencies in the university

Directory of Open Access Journals (Sweden)

Juan Antonio Moreno-Murcia

2015-01-01

Full Text Available The objective of this study was to design and validate a measuring instrument to evaluate the performance of university professors. The Evaluation of Teaching Performance (CEID [Centro de Estudios e Investigaciones Docentes (Center for Teaching Studies and Research] questionnaire was administered to 1297 university students. Various factor analyses were performed (exploratory and confirmatory, of the internal consistency, descriptive statistics, and correlation of all of the items. The data obtained confirmed a suitable psychometric structure for the CEID scale, which was made up of three dimensions (planning, development, and result. It is therefore concluded that it is a valid and reliable instrument for evaluating the performance of a university professor.

The Spiral-Interactive Program Evaluation Model.

Science.gov (United States)

Khaleel, Ibrahim Adamu

1988-01-01

Describes the spiral interactive program evaluation model, which is designed to evaluate vocational-technical education programs in secondary schools in Nigeria. Program evaluation is defined; utility oriented and process oriented models for evaluation are described; and internal and external evaluative factors and variables that define each…

Development and Evaluation of an Automated, Home-Based, Electronic Questionnaire for Detecting COPD Exacerbations

Directory of Open Access Journals (Sweden)

Francisco de B. Velazquez-Peña

2015-01-01

Full Text Available Collaboration between patients and their medical and technical experts enabled the development of an automated questionnaire for the early detection of COPD exacerbations (AQCE. The questionnaire consisted of fourteen questions and was implemented on a computer system for use by patients at home in an un-supervised environment. Psychometric evaluation was conducted after a 6-month field trial. Fifty-two patients were involved in the development of the questionnaire. Reproducibility was studied using 19 patients (ICC = 0.94. Sixteen out of the 19 subjects started the 6 month-field trial with the computer application. Cronbach’s alpha of 0.81 was achieved. In the concurrent validity analysis, a correlation of 0.80 (p = 0.002 with the CCQ was reported. The results suggest that AQCE is a valid and reliable questionnaire, showing that an automated home-based electronic questionnaire may enable early detection of exacerbations of COPD.

Environmental education curriculum evaluation questionnaire: A reliability and validity study

Science.gov (United States)

Minner, Daphne Diane

The intention of this research project was to bridge the gap between social science research and application to the environmental domain through the development of a theoretically derived instrument designed to give educators a template by which to evaluate environmental education curricula. The theoretical base for instrument development was provided by several developmental theories such as Piaget's theory of cognitive development, Developmental Systems Theory, Life-span Perspective, as well as curriculum research within the area of environmental education. This theoretical base fueled the generation of a list of components which were then translated into a questionnaire with specific questions relevant to the environmental education domain. The specific research question for this project is: Can a valid assessment instrument based largely on human development and education theory be developed that reliably discriminates high, moderate, and low quality in environmental education curricula? The types of analyses conducted to answer this question were interrater reliability (percent agreement, Cohen's Kappa coefficient, Pearson's Product-Moment correlation coefficient), test-retest reliability (percent agreement, correlation), and criterion-related validity (correlation). Face validity and content validity were also assessed through thorough reviews. Overall results indicate that 29% of the questions on the questionnaire demonstrated a high level of interrater reliability and 43% of the questions demonstrated a moderate level of interrater reliability. Seventy-one percent of the questions demonstrated a high test-retest reliability and 5% a moderate level. Fifty-five percent of the questions on the questionnaire were reliable (high or moderate) both across time and raters. Only eight questions (8%) did not show either interrater or test-retest reliability. The global overall rating of high, medium, or low quality was reliable across both coders and time, indicating

Faculty performance evaluation in accredited U.S. public health graduate schools and programs: a national study.

Science.gov (United States)

Gimbel, Ronald W; Cruess, David F; Schor, Kenneth; Hooper, Tomoko I; Barbour, Galen L

2008-10-01

To provide baseline data on evaluation of faculty performance in U.S. schools and programs of public health. The authors administered an anonymous Internet-based questionnaire using PHP Surveyor. The invited sample consisted of individuals listed in the Council on Education for Public Health (CEPH) Directory of Accredited Schools and Programs of Public Health. The authors explored performance measures in teaching, research, and service, and assessed how faculty performance measures are used. A total of 64 individuals (60.4%) responded to the survey, with 26 (40.6%) reporting accreditation/reaccreditation by CEPH within the preceding 24 months. Although all schools and programs employ faculty performance evaluations, a significant difference exists between schools and programs in the use of results for merit pay increases and mentoring purposes. Thirty-one (48.4%) of the organizations published minimum performance expectations. Fifty-nine (92.2%) of the respondents counted number of publications, but only 22 (34.4%) formally evaluated their quality. Sixty-two (96.9%) evaluated teaching through student course evaluations, and only 29 (45.3%) engaged in peer assessment. Although aggregate results of teaching evaluation are available to faculty and administrators, this information is often unavailable to students and the public. Most schools and programs documented faculty service activities qualitatively but neither assessed it quantitatively nor evaluated its impact. This study provides insight into how schools and programs of public health evaluate faculty performance. Results suggest that although schools and programs do evaluate faculty performance on a basic level, many do not devote substantial attention to this process.

Physical protection evaluation methodology program development and application

International Nuclear Information System (INIS)

Seo, Janghoon; Yoo, Hosik

2015-01-01

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Physical protection evaluation methodology program development and application

Energy Technology Data Exchange (ETDEWEB)

Seo, Janghoon; Yoo, Hosik [Korea Institute of Nuclear Non-proliferation and Control, Daejeon (Korea, Republic of)

2015-10-15

It is essential to develop a reliable physical protection evaluation methodology for applying physical protection concept to the design stage. The methodology can be used to assess weak points and improve performance not only for the design stage but also for nuclear facilities in operation. Analyzing physical protection property of nuclear facilities is not a trivial work since there are many interconnected factors affecting overall performance. Therefore several international projects have been organized to develop a systematic physical protection evaluation methodology. INPRO (The International Project on Innovative Nuclear Reactors and Fuel Cycles) and GIF PRPP (Generation IV International Forum Proliferation Resistance and Physical Protection) methodology are among the most well-known evaluation methodologies. INPRO adopts a checklist type of questionnaire and has a strong point in analyzing overall characteristic of facilities in a qualitative way. COMPRE program has been developed to help general users apply COMPRE methodology to nuclear facilities. In this work, COMPRE program development and a case study of the hypothetical nuclear facility are presented. The development of COMPRE program and a case study for hypothetic facility is presented in this work. The case study shows that COMPRE PP methodology can be a useful tool to assess the overall physical protection performance of nuclear facilities. To obtain meaningful results from COMPRE PP methodology, detailed information and comprehensive analysis are required. Especially, it is not trivial to calculate reliable values for PPSE (Physical Protection System Effectiveness) and C (Consequence), while it is relatively straightforward to evaluate LI (Legislative and Institutional framework), MC (Material Control) and HR (Human Resources). To obtain a reliable PPSE value, comprehensive information about physical protection system, vital area analysis and realistic threat scenario assessment are required. Like

Use of qualitative analysis to supplement program evaluation of a faculty development program

Directory of Open Access Journals (Sweden)

Thomas V Chacko

2013-01-01

Full Text Available Introduction: Generally for Program Evaluation of workshops, a structured questionnaire is used to measure learner satisfaction and learning and it yields results in quantitative terms and if there are open-ended questions, it yields a long list of responses which the evaluator finds it difficult to use. Hence, we used qualitative research methods to supplement it for a holistic understanding of the quality and extent of their learning. Materials and Methods: A faculty development program was used opportunistically to gather data using open-ended questions designed to elicit "thick descriptions" about their learning. Using the Grounded Theory approach where the data drives further analysis, data analysis was done by faculty in three groups using inductive reasoning leading to emergence of themes and categories of responses. The commonalities in the themes that emerged independently in the three groups as well as member checking to seek their agreement with the group′s observation of the primary data were used to ensure validity of the findings. Results: Themes and categories of new learning in terms of knowledge, skills, attitudes and processes emerged which gives a better understanding of the extent of the learning and its applicability to future professional tasks. The open-ended questions encouraging participants to give "thick description" of their learning yielded many quotable quotes which indicate the quality of their learning. Conclusion: The use of open-ended questions and qualitative research method of data analysis using the Grounded Theory approach helps in holistic understanding of the focus and quality of learning that is not usually possible through quantitative research methods. Hence, it is recommended that when understanding of the extent and quality of learning is important, traditional method of program evaluation should be supplemented with qualitative research methods as they are more effective in convincing decision

Evaluating an employee wellness program.

Science.gov (United States)

Mukhopadhyay, Sankar; Wendel, Jeanne

2013-12-01

What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor's ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.

Adaptive Vocational Personality Questionnaire Development and Validation of an adaptive personality questionnaire to analyze the vocational behavior of university students

Directory of Open Access Journals (Sweden)

Amparo Gómez-Artiga

2013-05-01

Full Text Available This study presents a personality evaluation instrument adapted to the vocational setting: the Adaptive Vocational Personality Questionnaire (AVPQ. The questionnaire was developed and tested in a sample of 2160 university students in the final years of their degree programs. The purpose of the study is to validate the questionnaire, providing evidence about its internal structure and its usefulness for predicting scores on a criterion scale. A confirmatory factor analysis combined with a cross-validation design was used: the exploratory sample (n = 879 helped to identify the model with the factorial structure that best fit the relations among the items. As expected, this model had two related but clearly separate factors: Adaptive Personality Characteristics (AC with 9 items and Non-Adaptive Personality Characteristics (NAC with 11 items. The validation sample (n =932 was used to test the generalization capacity of this model, which was satisfactory and showed a good reliability index. Regarding its usefulness in predicting proactive job-search behaviors, the results were also satisfactory. The questionnaire and keys are provided, as well as the criteria for calculating the scores on each scale and on the entire questionnaire.

Assessing managerial information needs: Modification and evaluation of the Hospital Shift Leaders' Information Needs Questionnaire.

Science.gov (United States)

Peltonen, Laura-Maria; Lundgrén-Laine, Heljä; Siirala, Eriikka; Löyttyniemi, Eliisa; Aantaa, Riku; Salanterä, Sanna

2018-03-01

The aims were (1) to evaluate the modified version of the Intensive Care Unit Information Need Questionnaire for the broader hospital setting, and (2) to describe the differences in respondents' managerial activities and information needs according to the position held by the respondent and the type of hospital unit. Information systems do not support managerial decision-making sufficiently and information needed in the day-to-day operations management in hospital units is unknown. An existing questionnaire was modified and evaluated. Shift leaders, that is, the nurses and physicians responsible for the day-to-day operations management in hospital units were reached using purposive sampling (n = 258). The questionnaire ascertained the importance of information. Cronbach's α ranged from .85-.96 for the subscales. Item - total correlations showed good explanatory power. Managerial activities and information needs differed between respondents in different positions, although all shared about one-third of important information needs. The response rate was 26% (n = 67). The validity and reliability of the questionnaire were good. Attention should be paid to the positions of shift leaders when developing information systems. The questionnaire can be used to determine important information when developing information systems to support day-to-day operations management in hospitals. © 2018 John Wiley & Sons Ltd.

Using Cognitive Interviews to Evaluate the Spanish-Language Translation of Dietary Questionnaire

Directory of Open Access Journals (Sweden)

Kerry Levin

2009-03-01

Full Text Available We present results from a qualitative evaluation of the Spanish-language version of a dietary intake questionnaire and characterize the types of findings which emerged from several rounds of cognitive testing. Cognitive interviews were used to test the Spanish translation of the National Health Interview Survey (NHIS Cancer Control Supplement dietary questions, with 36 Spanish-speaking and 9 English-speaking participants. Analyses of the results identified (a translation issues, (b culture-specific issues, and (c general design issues that affected both English and Spanish speakers. Results indicated that general design-oriented difficulties were particularly frequent. Our findings suggest that when appropriately structured, cognitive interviews that feature flexible probing can be useful for identifying a range of problems in survey translations, even after translations have been developed using currently accepted methods. We make several recommendations concerning practices that may be optimal in the conduct of empirical cross-cultural questionnaire evaluations.

Development and Evaluation of Science and Technology Education Program Using Interferometric SAR

Science.gov (United States)

Ito, Y.; Ikemitsu, H.; Nango, K.

2016-06-01

This paper proposes a science and technology education program to teach junior high school students to measure terrain changes by using interferometric synthetic aperture radar (SAR). The objectives of the proposed program are to evaluate and use information technology by performing SAR data processing in order to measure ground deformation, and to incorporate an understanding of Earth sciences by analyzing interferometric SAR processing results. To draft the teaching guidance plan for the developed education program, this study considers both science and technology education. The education program was used in a Japanese junior high school. An educational SAR processor developed by the authors and the customized Delft object-oriented radar interferometric software package were employed. Earthquakes as diastrophism events were chosen as practical teaching materials. The selected events indicate clear ground deformation in differential interferograms with high coherence levels. The learners were able to investigate the ground deformations and disasters caused by the events. They interactively used computers and became skilled at recognizing the knowledge and techniques of information technology, and then they evaluated the technology. Based on the results of pre- and post-questionnaire surveys and self-evaluation by the learners, it was clarified that the proposed program was applicable for junior high school education, and the learners recognized the usefulness of Earth observation technology by using interferometric SAR. The usefulness of the teaching materials in the learning activities was also shown through the practical teaching experience.

Right timing in formative program evaluation.

Science.gov (United States)

Hall, Jori; Freeman, Melissa; Roulston, Kathy

2014-08-01

Since many educational researchers and program developers have limited knowledge of formative evaluation, formative data may be underutilized during the development and implementation of an educational program. The purpose of this article is to explain how participatory, responsive, educative, and qualitative approaches to formative evaluation can facilitate a partnership between evaluators and educational researchers and program managers to generate data useful to inform program implementation and improvement. This partnership is critical, we argue, because it enables an awareness of when to take appropriate action to ensure successful educational programs or "kairos". To illustrate, we use examples from our own evaluation work to highlight how formative evaluation may facilitate opportune moments to (1) define the substance and purpose of a program, (2) develop understanding and awareness of the cultural interpretations of program participants, and (3) show the relevance of stakeholder experiences to program goals. Copyright © 2014 Elsevier Ltd. All rights reserved.

National Evaluation of the Weatherization Assistance Program: Preliminary Evaluation Plan for Program Year 2006

Energy Technology Data Exchange (ETDEWEB)

Ternes, Mark P [ORNL; Schweitzer, Martin [ORNL; Tonn, Bruce Edward [ORNL; Schmoyer, Richard L [ORNL; Eisenberg, Joel Fred [ORNL

2007-02-01

The U.S. Department of Energy's (DOE's) Weatherization Assistance Program was created by Congress in 1976 under Title IV of the Energy Conservation and Production Act. The purpose and scope of the Program as currently stated in the Code of Federal Regulations (CFR) 10CFR 440.1 is 'to increase the energy efficiency of dwellings owned or occupied by low-income persons, reduce their total residential expenditures, and improve their health and safety, especially low-income persons who are particularly vulnerable such as the elderly, persons with disabilities, families with children, high residential energy users, and households with high energy burden' (Code of Federal Regulations, 2005). DOE sponsored a comprehensive evaluation of the Program in the early 1990's to provide policy makers and program implementers with up-to-date and reliable information they needed for effective decision making and cost-effective operations. Oak Ridge National Laboratory (ORNL) managed the five part study which was based primarily on data from Program Year (PY) 1989 and supplemented by data from 1991-92 (Brown, Berry, and Kinney, 1994). In more recent years, ORNL has conducted four metaevaluations of the Program's energy savings using studies conducted by individual states between the years 1990-1996 (Berry, 1997), 1996-1998 (Schweitzer and Berry, 1999), 1993-2002 (Berry and Schweitzer, 2003), and 1993-2005 (Schweitzer, 2005). DOE announced through its Weatherization Program Notice 05-1 (DOE, 2004) that it would undertake a new national evaluation of the Program because the Program that was evaluated comprehensively in the early 1990's is vastly different from the Program of today. The Program has incorporated new funding sources, management principles, audit procedures, and energy-efficiency measures in response to findings and recommendations resulting from the 1989 National Evaluation, the Weatherization Plus strategic planning process, and other

Evaluation of the UNREST questionnaire for testing the social resistance framework.

Science.gov (United States)

Factor, Roni; Kawachi, Ichiro; Williams, David R

2013-07-01

The recently developed social resistance framework addresses a widespread pattern whereby non-dominant minority groups, such as ethnic/racial minorities and people of low socioeconomic status, often engage in unhealthy and risky behaviours at higher rates compared with society at large. The framework suggests that power relations within society may encourage members of non-dominant minority groups to actively engage in acts of everyday resistance, which may include risky and unhealthy behaviours. The current paper develops and psychometrically evaluates a research tool to test this innovative framework. The UNREST questionnaire measures the key concepts of the framework, along with four high-risk and unhealthy behaviours, as well as demographic and socioeconomic characteristics. A pilot survey was conducted among representative subsamples of a non-dominant group (African-Americans) and a dominant group (Caucasians). Consistent with the general premises of the framework, the evaluation of the questionnaire produced six valid and reliable scales, which were significantly correlated with some criterion-related items as well as unhealthy and risky behaviours. The preliminary results of our pilot study suggest that the new tool may be useful for testing the framework. The results also provide support for the framework in general.

The development and validation of a novel questionnaire to measure patient and family satisfaction with end-of-life care: the Canadian Health Care Evaluation Project (CANHELP) Questionnaire.

Science.gov (United States)

Heyland, Daren K; Cook, Deborah J; Rocker, Graeme M; Dodek, Peter M; Kutsogiannis, Demetrios J; Skrobik, Yoanna; Jiang, Xuran; Day, Andrew G; Cohen, S Robin

2010-10-01

The purpose of this study was to further validate a novel instrument to measure satisfaction with end-of-life care, called the Canadian Health Care Evaluation Project (CANHELP) questionnaire. Data were collected by a cross-sectional survey of patients who had advanced, life-limiting illnesses and their family caregivers, and who completed CANHELP, a global rating of satisfaction, and a quality of life questionnaire. We conducted factor analysis, assessed internal consistency using Cronbach's alpha, and evaluated construct validity by describing the correlation amongst CANHELP, global rating of satisfaction and the quality of life questionnaire scores. There were 361 patient and 193 family questionnaires available for analysis. In the factor analysis, we identified six easily interpretable factors which explained 55.4% and 60.2% of the variance for the patient and caregiver questionnaire, respectively. For the patient version, the subscales derived from these factors were Relationship with Doctors, Illness Management, Communication, Decision-Making, Role of the Family, and Your Well-being. For the family questionnaire, the factors were Relationship with Doctors, Characteristics of Doctors and Nurses, Illness Management, Communication and Decision-Making, Your Involvement, and Your Well-being. Each subscale for each questionnaire had acceptable to excellent internal consistency (Cronbach's alpha ranged from 0.69-0.94). We observed good correlations between the CANHELP overall satisfaction score and global rating of satisfaction (correlation coefficient 0.49 and 0.63 for patient and family, respectively) which was greater than the correlations between CANHELP and the quality of life instruments. We conclude that the CANHELP Questionnaire is a valid and internally consistent instrument to measure satisfaction with end-of-life care.

EVALUATION PROGRAM SEVEN A SIDE FOOTBALL COACHING NATIONAL PARALIMPIC COMMITTEE (NPC) OF INDONESIA AT ASEAN PARAGAMES 2015 IN SINGAPORE

OpenAIRE

Asmawi, Moch.

2017-01-01

The purpose of the study was to evaluate program seven a side football National Paralimpic Committee (NPC) of Indonesia at ASEAN Paragames 2015 in Singapore. The research is qualitative research approach to evaluation using the model Context, Input, Process, and Product (CIPP). Triangulation method of collecting data using questionnaires, interviews, document study and observation. Research result that: 1) Evaluation of Context: have a legal basis and strong government policy, vision mission ...

Evaluation of a semi-quantitative food frequency questionnaire to estimate iodine intake

DEFF Research Database (Denmark)

Rasmussen, Lone Banke; Ovesen, L.; Bulow, I.

2001-01-01

Objective: To evaluate a food frequency questionnaire (FFQ) used to assess the dietary intake of iodine. Design: The iodine intake determined by the FFQ was compared with 4-day dietary records and with iodine excretion in 24 h urine samples in a subgroup of participants in a cross-sectional study...

Labor and health status in economic evaluation of health care. The Health and Labor Questionnaire

NARCIS (Netherlands)

van Roijen, L.; Essink-Bot, M. L.; Koopmanschap, M. A.; Bonsel, G.; Rutten, F. F.

1996-01-01

A health care program may influence both costs and health effects. We developed the Health and Labor Questionnaire (HLQ), which consists of four modules, to collect data on absence from work, reduced productivity, unpaid labor production, and labor-related problems. We applied the HLQ in several

Remote programming of MED-EL cochlear implants: users' and professionals' evaluation of the remote programming experience.

Science.gov (United States)

Kuzovkov, Vladislav; Yanov, Yuri; Levin, Sergey; Bovo, Roberto; Rosignoli, Monica; Eskilsson, Gunnar; Willbas, Staffan

2014-07-01

Remote programming is safe and is well received by health-care professionals and cochlear implant (CI) users. It can be adopted into clinic routine as an alternative to face-to-face programming. Telemedicine allows a patient to be treated anywhere in the world. Although it is a growing field, little research has been published on its application to CI programming. We examined hearing professionals' and CI users' subjective reactions to the remote programming experience, including the quality of the programming and the use of the relevant technology. Remote CI programming was performed in Italy, Sweden, and Russia. Programming sessions had three participants: a CI user, a local host, and a remote expert. After the session, each CI user, local host, and remote expert each completed a questionnaire on their experience. In all, 33 remote programming sessions were carried out, resulting in 99 completed questionnaires. The overwhelming majority of study participants responded positively to all aspects of remote programming. CI users were satisfied with the results in 96.9% of the programming sessions; 100% of participants would use remote programming again. Although technical problems were encountered, they did not cause the sessions to be considerably longer than face-to-face sessions.

Impact of an educational program on the quality of life of patients with lymphedema: A preliminary evaluation.

Science.gov (United States)

Blaise, Sophie; Satger, Bernadette; Pernod, Gilles; Richaud, Cécile; Villemur, Béatrice; Carpentier, Patrick H

2017-09-01

We report on the preliminary evaluation of a well-designed program, Living with Lymphedema. This longitudinal cohort study assessed patients' quality of life using questionnaires. Our main objective was to evaluate the satisfaction of the patients and their adherence to the program. This was done using a specific questionnaire of satisfaction as well as by noting patients' adherence to the program (number of patients attending all three consultations). The secondary objective was to assess the effect of the program on the patient's quality of life. The assessment criteria were the evolution of the Medical Outcomes Study 36-Item Short Form Health Survey and EuroQol questionnaire scores between the first (C1) and third (C3) consultations. The Living with Lymphedema program targeted all patients with lymphedema in the Grenoble (France) conurbation and within the GRANTED health care network that includes vascular medicine specialists, primary care physicians, physical therapists, and dietitians in the Alpine region of France. All studied patients were ambulatory patients. The GRANTED network took care only of the educational aspect of the disease. All patients with primary or secondary lymphedema were offered the Living with Lymphedema program, whatever their age and the location of the lymphedema (upper or lower limbs). The collection of patient data conformed to the ethical and administrative regulations of the regional health authority. Grenoble Institutional Review Board (CPP Sud-Est V; No. 5891) approval for the study was specifically obtained for this evaluation on December 24, 2012. The program was built around one-to-one consultations, group workshops, and more specialized appointments. It was complementary to the routine medical care received by the patient (not evaluated in this study). It proposed three individual "educational" consultations, seven group workshops, and two specialized consultations with a dietitian. All the consultations or workshops were

Evaluating Dermatology Residency Program Websites.

Science.gov (United States)

Ashack, Kurt A; Burton, Kyle A; Soh, Jonathan M; Lanoue, Julien; Boyd, Anne H; Milford, Emily E; Dunnick, Cory; Dellavalle, Robert P

2016-03-16

Internet resources play an important role in how medical students access information related to residency programs.Evaluating program websites is necessary in order to provide accurate information for applicants and provide information regarding areas of website improvement for programs. To date, dermatology residency websites (D  WS) have not been evaluated.This paper evaluates dermatology residency websites based on availability of predefined measures. Using the FREIDA (Fellowship and Residency Electronic Interactive Database) Online database, authors searched forall accredited dermatology program websites. Eligible programs were identified through the FREIDA Online database and had a functioning website. Two authors independently extracted data with consensus or third researcher resolution of differences. This data was accessed and archived from July 15th to July 17th, 2015.Primary outcomes measured were presence of content on education, resident and faculty information, program environment, applicant recruitment, schedule, salary, and website quality evaluated using an online tool (WooRank.com). Out of 117 accredited dermatology residencies, 115 had functioning webpages. Of these, 76.5% (75) had direct links found on the FRIEDA Online database. Most programs contained information on education, faculty, program environment, and applicant recruitment. However, website quality and marketing effectiveness were highly variable; most programs were deemed to need improvements in the functioning of their webpages. Also, additional information on current residents and about potential away rotations were lacking from most websites with only 52.2% (60) and 41.7% (48) of programs providing this content, respectively. A majority of dermatology residency websites contained adequate information on many of the factors we evaluated. However, many were lacking in areas that matter to applicants. We hope this report will encourage dermatology residencyprograms

Evaluation of the childhood obesity prevention program Kids - 'Go for your life'

Directory of Open Access Journals (Sweden)

Gibbs Lisa

2010-05-01

Full Text Available Abstract Background Kids - 'Go for your life' (K-GFYL is an award-based health promotion program being implemented across Victoria, Australia. The program aims to reduce the risk of childhood obesity by improving the socio-cultural, policy and physical environments in children's care and educational settings. Membership of the K-GFYL program is open to all primary and pre-schools and early childhood services across the State. Once in the program, member schools and services are centrally supported to undertake the health promotion (intervention activities. Once the K-GFYL program 'criteria' are reached the school/service is assessed and 'awarded'. This paper describes the design of the evaluation of the statewide K-GFYL intervention program. Methods/Design The evaluation is mixed method and cross sectional and aims to: 1 Determine if K-GFYL award status is associated with more health promoting environments in schools/services compared to those who are members only; 2 Determine if children attending K-GFYL award schools/services have higher levels of healthy eating and physical activity-related behaviors compared to those who are members only; 3 Examine the barriers to implementing and achieving the K-GFYL award; and 4 Determine the economic cost of implementing K-GFYL in primary schools Parent surveys will capture information about the home environment and child dietary and physical activity-related behaviors. Environmental questionnaires in early childhood settings and schools will capture information on the physical activity and nutrition environment and current health promotion activities. Lunchbox surveys and a set of open-ended questions for kindergarten parents will provide additional data. Resource use associated with the intervention activities will be collected from primary schools for cost analysis. Discussion The K-GFYL award program is a community-wide intervention that requires a comprehensive, multi-level evaluation. The evaluation

An evaluation of an aggression management training program to cope with workplace violence in the healthcare sector.

Science.gov (United States)

Oostrom, Janneke K; van Mierlo, Heleen

2008-08-01

Workplace violence is a major occupational hazard for healthcare workers, generating a need for effective intervention programs. The purpose of this study was to evaluate the effectiveness of an aggression management training program. The evaluation design was based on the internal referencing strategy, an unobtrusive and applicable evaluation method that rules out some major threats to internal validity without the need for a control group. On three occasions, training participants completed a questionnaire containing experimental and control variables. As hypothesized, there was a significant improvement in the experimental variables that was larger than the non-significant change in the control variable. We conclude that aggression management training may be an effective instrument in the fight against workplace violence. 2008 Wiley Periodicals, Inc

["Active in rehab": development and formative evaluation of a patient education program to increase health literacy of patients with chronic illness].

Science.gov (United States)

Ullrich, A; Schöpf, A C; Nagl, M; Farin, E

2015-04-01

The aim of the article is to describe the development, the process of manualisation and results from the formative evaluation of a patient-oriented patient education program to increase health literacy of patients with chronic illness ("Active in rehab"). Themes of the patient education program were extracted from 17 focus groups. An expert meeting was conducted to validate the content of the patient education program. The formative evaluation was based on a questionnaire (N(max) = 295 patients and N(max) = 39 trainers). The patient education program includes 4 modules with 3 themes (bio-psycho-social model, rehabilitation goals, communication competencies). The evaluation of the modules was good to very good. An analysis of free texts and a follow-up survey among trainers helped us to infer important improvements to the patient education program. RESULTS from the formative evaluation show that the patient education program meets patients and trainers needs and is accepted. © Georg Thieme Verlag KG Stuttgart · New York.

A Revalidation of the SET37 Questionnaire for Student Evaluations of Teaching

Science.gov (United States)

Mortelmans, Dimitri; Spooren, Pieter

2009-01-01

In this study, the authors report on the validity and reliability of a paper-and-pencil instrument called SET37 used for Student Evaluation of Teaching (SET) in higher education. Using confirmatory factor analysis on 2525 questionnaires, a revalidation of the SET37 shows construct and discriminant validity of the 12 dimensions included in the…

Developing medical educators - a mixed method evaluation of a teaching education program.

Science.gov (United States)

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

Background It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. Methods An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) 'Reaction' on a professional and emotional level using standardized questionnaires; 2) 'Learning' applying a multiple choice test; 3) 'Behavior' by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) 'Results' from student evaluations. Results Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (Pteaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students' evaluations. Conclusions Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

Developing medical educators--a mixed method evaluation of a teaching education program.

Science.gov (United States)

Roos, Marco; Kadmon, Martina; Kirschfink, Michael; Koch, Eginhard; Jünger, Jana; Strittmatter-Haubold, Veronika; Steiner, Thorsten

2014-01-01

It is well accepted that medical faculty teaching staff require an understanding of educational theory and pedagogical methods for effective medical teaching. The purpose of this study was to evaluate the effectiveness of a 5-day teaching education program. An open prospective interventional study using quantitative and qualitative instruments was performed, covering all four levels of the Kirkpatrick model: Evaluation of 1) 'Reaction' on a professional and emotional level using standardized questionnaires; 2) 'Learning' applying a multiple choice test; 3) 'Behavior' by self-, peer-, and expert assessment of teaching sessions with semistructured interviews; and 4) 'Results' from student evaluations. Our data indicate the success of the educational intervention at all observed levels. 1) Reaction: The participants showed a high acceptance of the instructional content. 2) Learning: There was a significant increase in knowledge (Pteaching performance. Semistructured interviews reflected a higher level of professionalism in medical teaching by the participants. 4) Results: Teaching performance ratings improved in students' evaluations. Our results demonstrate the success of a 5-day education program in embedding knowledge and skills to improve performance of medical educators. This multimethodological approach, using both qualitative and quantitative measures, may serve as a model to evaluate effectiveness of comparable interventions in other settings.

Wiisokotaatiwin: development and evaluation of a community-based palliative care program in Naotkamegwanning First Nation.

Science.gov (United States)

Nadin, Shevaun; Crow, Maxine; Prince, Holly; Kelley, Mary Lou

2018-04-01

Approximately 474 000 Indigenous people live in 617 First Nations communities across Canada; 125 of those communities are located in Ontario, primarily in rural and remote areas. Common rural health challenges, including for palliative care, involve quality and access. The need for culturally relevant palliative care programs in First Nations communities is urgent because the population is aging with a high burden of chronic and terminal disease. Because local palliative care is lacking, most First Nations people now leave their culture, family and community to receive care in distant hospitals or long-term care homes. Due to jurisdictional issues, a policy gap exists where neither federal nor provincial governments takes responsibility for funding palliative care in First Nations communities. Further, no Canadian program models existed for how different levels of government can collaborate to fund and deliver palliative care in First Nations communities. This article describes an innovative, community-based palliative care program (Wiisokotaatiwin) developed in rural Naotkamegwanning, and presents the results of a process evaluation of its pilot implementation. The evaluation aimed to (i) document the program's pilot implementation, (ii) assess progress toward intended program outcomes and (iii) assess the perceived value of the program. The Wiisokotaatiwin Program was developed and implemented over 5 years using participatory action research (http://www.eolfn.lakeheadu.ca). A mixed-method evaluation approach was adopted. Descriptive data were extracted from program documents (eg client registration forms). Client tracking forms documented service provision data for a 4-month sample period. Quantitative and qualitative data were collected through client and family member questionnaires (n=7) and healthcare provider questionnaires (n=22). A focus group was conducted with the program leadership team responsible for program development. Quantitative data were

Solar energy program evaluation: an introduction

Energy Technology Data Exchange (ETDEWEB)

deLeon, P.

1979-09-01

The Program Evaluation Methodology provides an overview of the practice and methodology of program evaluation and defines more precisely the evaluation techniques and methodologies that would be most appropriate to government organizations which are actively involved in the research, development, and commercialization of solar energy systems. Formal evaluation cannot be treated as a single methodological approach for assessing a program. There are four basic types of evaluation designs - the pre-experimental design; the quasi-experimental design based on time series; the quasi-experimental design based on comparison groups; and the true experimental design. This report is organized to first introduce the role and issues of evaluation. This is to provide a set of issues to organize the subsequent sections detailing the national solar energy programs. Then, these two themes are integrated by examining the evaluation strategies and methodologies tailored to fit the particular needs of the various individual solar energy programs. (MCW)

Introducing Program Evaluation Models

Directory of Open Access Journals (Sweden)

Raluca GÂRBOAN

2008-02-01

Full Text Available Programs and project evaluation models can be extremely useful in project planning and management. The aim is to set the right questions as soon as possible in order to see in time and deal with the unwanted program effects, as well as to encourage the positive elements of the project impact. In short, different evaluation models are used in order to minimize losses and maximize the benefits of the interventions upon small or large social groups. This article introduces some of the most recently used evaluation models.

Critical evaluation of international health programs: Reframing global health and evaluation.

Science.gov (United States)

Chi, Chunhuei; Tuepker, Anaïs; Schoon, Rebecca; Núñez Mondaca, Alicia

2018-01-05

Striking changes in the funding and implementation of international health programs in recent decades have stimulated debate about the role of communities in deciding which health programs to implement. An important yet neglected piece of that discussion is the need to change norms in program evaluation so that analysis of community ownership, beyond various degrees of "participation," is seen as central to strong evaluation practices. This article challenges mainstream evaluation practices and proposes a framework of Critical Evaluation with 3 levels: upstream evaluation assessing the "who" and "how" of programming decisions; midstream evaluation focusing on the "who" and "how" of selecting program objectives; and downstream evaluation, the focus of current mainstream evaluation, which assesses whether the program achieved its stated objectives. A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities' high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies' predetermined priorities. In addition to critiquing evaluation practices and proposing an alternative framework, we acknowledge likely challenges and propose directions for future research. Copyright © 2018 John Wiley & Sons, Ltd.

Evaluation of the Nasal Surgical Questionnaire for Monitoring Results of Septoplasty

Directory of Open Access Journals (Sweden)

Rolf Haye

2015-01-01

Full Text Available Monitoring the results of surgery is important. The otorhinolaryngology department of our hospital currently uses preoperative and postoperative versions of the Nasal Surgical Questionnaire (NSQ for continuous evaluation of nasal septoplasty. In this study, 55 patients undergoing septoplasty answered the preoperative version twice to assess the NSQ’s test-retest precision, and 75 patients answered the preoperative questionnaire before and the postoperative one 6 months after surgery to evaluate the NSQ’s ability to detect change in symptoms following surgery. Both the pre- and postoperative versions of the NSQ use separate visual analogue scales (VAS to assess nasal obstruction during the day, at night, and during exercise. Other nasal symptoms are graded as secondary outcomes using 4-point Likert scales. The mean VAS scores for the two preoperative obstruction ratings were not significantly different. The scores were significantly higher than in a normal population. There were also significant differences between preoperative and postoperative ratings. The mean pre- and postoperative scores at night for those who reported complete improvement were 66.1 and 8.4, substantial improvement 74.5 and 24.2, and no improvement 83.3 and 76.4. The NSQ reliably assesses nasal symptoms in patients and may be useful for both short and long term prospective studies of septoplasty.

Building capacity for change: evaluation of an organisation-wide leadership development program.

Science.gov (United States)

Schultz, Tim; Shoobridge, Jodie; Harvey, Gill; Carter, Libby; Kitson, Alison

2018-05-23

Objective. This study evaluated Leading 4 Change, a change leadership development program designed to support healthcare middle managers through a period of significant organisational change and enhance workplace resilience. Methods. A mixed methods evaluation was conducted within the program's framework of a quality improvement activity. Quantitative measures were participant responses (n=160) to online questionnaires, which were compared before and after the program, using an uncontrolled pre-post study design. Four questionnaires were used: Resilience @ Work, General Self-Efficacy, the 11-item Learning Organization Survey and organisational climate. Differences between the pre- and post-program periods were compared using linear mixed-effects models, incorporating repeated measures between 'pre' and 'post' periods. Qualitative data were obtained by interviewing four participants on three occasions during the program, and through text responses provided by participants during a presentation session after the program finished. Both interview data and textual data were subjected to thematic analysis. Results. Integration of data from quantitative and qualitative analyses generated three main findings: (1) participants were satisfied and engaged with the program, which met their learning objectives; (2) the program led to increased workplace resilience, in particular the ability to manage stress and self-efficacy for individuals; and (3) organisational learning perceptions were unchanged. Conclusion. Although conducted during a period of intense internal and external pressure, Leading 4 Change led to demonstrable effects. It effectively engaged middle managers across a health system. However, there was no evidence that the effect of the program extended beyond individual participants to their perceptions of their work environment as a learning organisation. What is known about the topic? Although much has been written about change management and change leadership

The Danish national return-to-work program - aims, content, and design of the process and effect evaluation

DEFF Research Database (Denmark)

Aust, Birgit; Helverskov, Trine; Nielsen, Maj Britt D.

2012-01-01

approximately 19 500 working-age adults on long-term sickness absence, regardless of reason for sickness absence or employment status. It consists of three core elements: (i) establishment of multidisciplinary RTW teams, (ii) introduction of standardized workability assessments and sickness absence management......The Danish national return-to-work (RTW) program aims to improve the management of municipal sickness benefit in Denmark. A study is currently ongoing to evaluate the RTW program. The purpose of this article is to describe the study protocol. The program includes 21 municipalities encompassing...... procedures, and (iii) a comprehensive training course for the RTW teams. The effect evaluation is based on a parallel group randomized trial and a stratified cluster controlled trial and focuses on register-based primary outcomes - duration of sickness absence and RTW - and questionnaire-based secondary...

FY08 VPP Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Dossett, Sharon D.

2008-01-01

The Voluntary Protection Program (VPP) is a recognized third-party certification of worker safety and health program excellence, based on industry best practices that focus on management leadership and employee involvement, as well as other safety and health program elements. This Pacific Northwest National Laboratory (PNNL) VPP Program Evaluation is the FY-2008 report of the PNNL VPP Steering Committee regarding the status of VPP at PNNL. It is an update of the previous annual report dated January, 2007 and was completed in January 2008. An annual evaluation of the status of VPP is required of all sites that participate in the DOE-VPP. This report provides a detailed summary of the PNNL VPP Steering Committee’s evaluation of program performance and documents both strengths and improvement opportunities related to the various aspects of the VPP model.

Exploring the measurement properties of the osteopathy clinical teaching questionnaire using Rasch analysis.

Science.gov (United States)

Vaughan, Brett

2018-01-01

Clinical teaching evaluations are common in health profession education programs to ensure students are receiving a quality clinical education experience. Questionnaires students use to evaluate their clinical teachers have been developed in professions such as medicine and nursing. The development of a questionnaire that is specifically for the osteopathy on-campus, student-led clinic environment is warranted. Previous work developed the 30-item Osteopathy Clinical Teaching Questionnaire. The current study utilised Rasch analysis to investigate the construct validity of the Osteopathy Clinical Teaching Questionnaire and provide evidence for the validity argument through fit to the Rasch model. Senior osteopathy students at four institutions in Australia, New Zealand and the United Kingdom rated their clinical teachers using the Osteopathy Clinical Teaching Questionnaire. Three hundred and ninety-nine valid responses were received and the data were evaluated for fit to the Rasch model. Reliability estimations (Cronbach's alpha and McDonald's omega) were also evaluated for the final model. The initial analysis demonstrated the data did not fit the Rasch model. Accordingly, modifications to the questionnaire were made including removing items, removing person responses, and rescoring one item. The final model contained 12 items and fit to the Rasch model was adequate. Support for unidimensionality was demonstrated through both the Principal Components Analysis/t-test, and the Cronbach's alpha and McDonald's omega reliability estimates. Analysis of the questionnaire using McDonald's omega hierarchical supported a general factor (quality of clinical teaching in osteopathy). The evidence for unidimensionality and the presence of a general factor support the calculation of a total score for the questionnaire as a sufficient statistic. Further work is now required to investigate the reliability of the 12-item Osteopathy Clinical Teaching Questionnaire to provide evidence

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl, E-mail: blumstei@berkeley.ed [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Program evaluation and incentives for administrators of energy-efficiency programs. Can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl [University of California Energy Institute, 2547 Channing Way, Berkeley, CA 94720 (United States)

2010-10-15

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question - what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions. (author)

Program evaluation and incentives for administrators of energy-efficiency programs: Can evaluation solve the principal/agent problem?

International Nuclear Information System (INIS)

Blumstein, Carl

2010-01-01

This paper addresses the nexus between evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes the problems that arise when evaluators are asked to measure program performance by answering the counterfactual question-what would have happened in the absence of the program? Then the paper examines some ways of addressing these problems. Key conclusions are (1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, (2) given the current state of knowledge, the decision to tie all incentives to program outcomes is misguided, and (3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

Evaluation of an Online Educational Program for Parents and Caregivers of Children With Food Allergies.

Science.gov (United States)

Ruiz-Baqués, A; Contreras-Porta, J; Marques-Mejías, M; Cárdenas Rebollo, J M; Capel Torres, F; Ariño Pla, M N; Zorrozua Santisteban, A; Chivato, T

2018-01-01

The increasing prevalence of food allergy affects both patients and their families. Objective: The aim of this study was to evaluate the impact of an online educational program designed for parents and caregivers of children with food allergies. The program was developed by a multidisciplinary group comprising health care professionals, researchers, and expert patients under the participatory medicine model. Participants took a 2-week online educational program covering major topics in food allergy management. General knowledge about the disease, symptoms, treatment, and topics relevant to families' daily lives were evaluated. The contents included educational videos, online forums, and live video chats. A pretest/posttest questionnaire survey was used to evaluate the impact of the program. A total of 207 participants enrolled in the educational program, which was completed by 130 (62.8%). Knowledge acquisition improved significantly following participation in the program in 15 out of 30 items (50%), reaching P<.001 for 8 items (26.7%). Of the 207 participants who started the program, 139 (67.1%) visited online forums, and 27.5% attended video chats. Average overall satisfaction with the educational program was 8.78 (on a scale of 0 to 10). The results obtained show that parents improved their knowledge in all areas of food allergy. The high level of satisfaction among participants suggests that digital learning tools are effective and motivational, enabling patients to acquire appropriate knowledge and thus increasing their quality of life.

The usefulness of Quality of Life Childhood Epilepsy (QOLCE) questionnaire in evaluating the quality of life of children with epilepsy.

Science.gov (United States)

Talarska, D

2007-01-01

Evaluation of quality of life has become a frequently used method in treatment effects supervision. Quality of Life Childhood Epilepsy (QOLCE) questionnaire, which is completed by patients' parents, has been prepared for children with epilepsy. It enables to determine the quality of life in children aged 4-18 years. The aim of the study was to show the usefulness of QOLCE questionnaire in evaluating the quality of life of children with epilepsy. 160 epileptic children, aged 8-18 years and their parents were examined in the Chair and Department of Developmental Neurology, K. Marcinkowski University of Medical Sciences in Poznań. QOLCE questionnaire was completed by parents and "Young people and epilepsy" questionnaire was designed for children. Reliability index of the complete questionnaire in own research and in the original amounted to 0.93 Cronbach alpha coefficient. Epileptic, drug-resistant children constituted 28% of the examined group. Parents of children with controlled seizures evaluated children's functioning in analyzed areas of quality of life higher. 1. QOLCE questionnaire is a suitable tool to evaluate the quality of children's and adolescents' life. 2. The most significant differences in functioning of epileptic, drug-resistant patients and those with controlled seizures were observed in areas of cognitive processes and social activity.

Evaluating adolescent pregnancy programs: rethinking our priorities.

Science.gov (United States)

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Training for Future Esp Trainers: Evaluating the Training of Trainers (TOT Program in Labuan Bajo, Manggarai Barat, Flores

Directory of Open Access Journals (Sweden)

Irfan Rifai

2013-04-01

Full Text Available By cooperating with Yayasan Komodo Kita and Mandiri Bank, English department of Binus University was chiefly in charge of a 15 day Training Of Trainers (TOT program for 24 participants prepared for teaching English in Labuan Bajo, Flores. The training was aimed to prepare already fluent- in – English- teachers, tour guides, and university graduates with the right tools and method in teaching English. To assess the program, a set of evaluation questionnaire was given to the participants to know their responses on the training material, the trainers, and the program by using Likert’s scale type questions. An observational record was also used as a tool to measure participants’ achievement. The questionnaire reveals that the participants respond positively to the program and the material and favor the approaches made by the trainers during the training. However, the training shows various results in participants’ performance. It is assumed that the non teaching background of the majority of participants and the level of English as two key factors influencing their performance.  

Program evaluation and incentives for administrators of energy efficiency programs: can evaluation solve the principal/agent problem?

Energy Technology Data Exchange (ETDEWEB)

Blumstein, Carl (Univ. of California, Energy Institute (United States))

2009-07-01

This paper addresses the nexus between the evaluation of energy-efficiency programs and incentive payments based on performance for program administrators in California. The paper describes problems that arise when evaluators are asked to measure program performance by answering the counterfactual question, what would have happened in the absence of the program? Then some ways of addressing these problems are examined. Key conclusions are that 1) program evaluation cannot precisely and accurately determine the counterfactual, there will always be substantial uncertainty, 2) given the current state of knowledge, the decision to tie all of the incentive to program outcomes is misguided, and 3) incentive programs should be regularly reviewed and revised so that they can be adapted to new conditions.

An evaluation of a health screening program for migrant women to Taiwan, China

Directory of Open Access Journals (Sweden)

Yu-Chu Huang

2016-05-01

Full Text Available Objective: We aimed to evaluate an integrated screening program for female migrants to Taiwan. Method: We performed a mixed methodological evaluation of a public health nurse (PHN-led intervention to promote an integrated screening program for female migrants to Taiwan. The clinical case yield was determined by an audit, and staff/client questionnaires were used for the evaluation. Screening comprised surveillance for four untreated chronic diseases (hypertension, diabetes mellitus, tuberculosis, and liver disease, four cancers (mouth, bowel, liver, and cervix, parasitic infection, and hyperlipidemia. Results: Three hundred and thirty-six PHNs and 4751 immigrant women – with an average age of 29.2 years, most of whom were from Vietnam (44% or mainland China (41% – took part in the programme. Two thirds of screened women had no abnormalities. Further investigation was required in 1523 women, of whom 1220 were found to have significant disease. The majority of 280 PHNs (85% found the content, processes, and waiting time to be ‘highly acceptable’ and thought the program was worthwhile and could be incorporated into standard care. Conclusions: The Taipei County Comprehensive Health Screening Programme provided an accessible, free-of-charge, and preventative intervention for female migrants to Taiwan and had a good clinical case yield.

Study on team evaluation (4). Reliability and validity of questionnaire survey-based team work evaluation method of power plant operator team

International Nuclear Information System (INIS)

Sasou, Kunihide; Hirose, Ayako; Misawa, Ryou; Yamaguchi, Hiroyuki

2006-01-01

The series of this study describes the necessity of the evaluation of team work from two aspects of operator's behavior and operators' mind. The authors propose Team Work Element Model which consists of necessary elements to build high performance team. This report discusses a method to evaluate team work from the second aspect, that is, competency trust, competition, for-the team spirit, etc. The authors survey the previous studies on psychological measures and organize a set of questions to evaluate 10 team work sub elements that are the parts of Team Work Element Model. The factor analysis shows that this set of questions is consists of 13 factors such as task-oriented leadership, harmony-oriented team atmosphere, etc. Close examination of the questions in each factor shows that 8 of 10 team work sub elements can be evaluated by this questionnaire. In addition, this questionnaire comprises scales additional 8 scales such as job satisfaction, leadership, etc. As a result, it is possible to evaluate team work from more comprehensive view points. (author)

Evaluation of data of questionnaire Nutrition and Health (1997-1998) concerning the topic 'What consumers think about food irradiation?'

International Nuclear Information System (INIS)

Szabo, A.S.; Tolnay, P.

1998-01-01

Detailed information is presented about the evaluation of data of the title questionnaire. The data are based on 2000 questionnaires distributed and collected in 1997 and 1998. Evaluation is carried out taking into account the following parameters: age, sex, education level, living place and financial income. It is concluded that people have a rather limited information about food irradiation

Psychometric properties of self-reported questionnaires for the evaluation of symptoms and functional limitations in individuals with rotator cuff disorders: a systematic review.

Science.gov (United States)

St-Pierre, Corinne; Desmeules, François; Dionne, Clermont E; Frémont, Pierre; MacDermid, Joy C; Roy, Jean-Sébastien

2016-01-01

To conduct a systematic review of the psychometric properties (reliability, validity and responsiveness) of self-report questionnaires used to assess symptoms and functional limitations of individuals with rotator cuff (RC) disorders. A systematic search in three databases (Cinahl, Medline and Embase) was conducted. Data extraction and critical methodological appraisal were performed independently by three raters using structured tools, and agreement was achieved by consensus. A descriptive synthesis was performed. One-hundred and twenty articles reporting on 11 questionnaires were included. All questionnaires were highly reliable and responsive to change, and showed construct validity; seven questionnaires also shown known-group validity. The minimal detectable change ranged from 6.4% to 20.8% of total score; only two questionnaires (American Shoulder and Elbow Surgeon questionnaire [ASES] and Upper Limb Functional Index [ULFI]) had a measurement error below 10% of global score. Minimal clinically important differences were established for eight questionnaires, and ranged from 8% to 20% of total score. Overall, included questionnaires showed acceptable psychometric properties for individuals with RC disorders. The ASES and ULFI have the smallest absolute error of measurement, while the Western Ontario RC Index is one of the most responsive questionnaires for individuals suffering from RC disorders. All included questionnaires are reliable, valid and responsive for the evaluation of individuals with RC disorders. As all included questionnaires showed good psychometric properties for the targeted population, the choice should be made according to the purpose of the evaluation and to the construct being evaluated by the questionnaire. The WORC, a RC-specific questionnaire, appeared to be more responsive. It should therefore be used to evaluate change in time. If the evaluation is time-limited, shorter questionnaires or short versions should be considered (such as

[Hearing aid application performance evaluation questionnaire to presbycusis].

Science.gov (United States)

Chen, Xianghong; Zhou, Huifang; Zhang, Jing; Wang, Liqun

2011-02-01

By matching patients with presbycusis hearing aids,hearing aid performance assessment questionnaire to fill out to assess the effect of its use and targeted to solve problems encountered in its use and improve the quality of life of older persons. Through face to face way to investigate and analyse patients with hearing aids fitting, totally 30 subjects accepted the analysis, preliminary assessment of the use of hearing aids in patient with presbycusis results and solve problems encountered in its use by using SPSS software to analyze the collecting data. HHIE questionnaire on statistical analysis, obtained in patients with hearing loss use hearing aids after the problem is a significant improvement statistical analysis of the SADL questionnaire, the conclusion is relatively satisfied with the overall satisfaction. Effects Assessment Questionnaire in patients with hearing aids hearing impairment can be epitomized the disabled after use to improve the situation and understand the satisfaction of patients with hearing aids can be an initial effect as the rehabilitation of a reliable subjective assessment of the impact assessment indicators.

Design and Psychometric Evaluation of the Quality of Life in Patients With Anal Fistula Questionnaire.

Science.gov (United States)

Ferrer-Márquez, Manuel; Espínola-Cortés, Natalia; Reina-Duarte, Angel; Granero-Molina, José; Fernández-Sola, Cayetano; Hernández-Padilla, José Manuel

2017-10-01

Quality of life is often considered when deciding and evaluating the treatment strategy for patients diagnosed with anal fistula. The purpose of this study was to develop and psychometrically test the Quality of Life in Patients with Anal Fistula Questionnaire. This was an observational cross-sectional study for the development and validation of a psychometric tool. The study was conducted at a general hospital in the southeast of Spain. A convenience sample included 54 patients diagnosed with anal fistula. The reliability of the tool was assessed through its internal consistency (Cronbach α) and temporal stability (Spearman correlation coefficient (r) between test-retest). The content validity index of the items and the scale was calculated. Correlation analysis and an ordinal regression analysis between the developed tool and the Short Form 12 Health Survey examined its concurrent validity. Principal component analysis and known-group analysis using the Kruskal-Wallis test examined its construct validity. The reliability of the developed questionnaire was very high (α = 0.908; r = 0.861; p questionnaire to detect expected differences in patients presenting with different symptomatology. The major limitations of this study were the use of a small sample of Spanish-speaking patients, not including patients in the initial development of the questionnaire, and developing the scoring system using a summation method. The Quality of Life in Patients with Anal Fistula Questionnaire has proven to be a valid, reliable, and concise tool that could contribute to the evaluation of quality of life among patients with an anal fistula. See Video Abstract at http://links.lww.com/DCR/A368.

Development and Pilot Test of the Workplace Readiness Questionnaire, a Theory-Based Instrument to Measure Small Workplaces' Readiness to Implement Wellness Programs.

Science.gov (United States)

Hannon, Peggy A; Helfrich, Christian D; Chan, K Gary; Allen, Claire L; Hammerback, Kristen; Kohn, Marlana J; Parrish, Amanda T; Weiner, Bryan J; Harris, Jeffrey R

2017-01-01

To develop a theory-based questionnaire to assess readiness for change in small workplaces adopting wellness programs. In developing our scale, we first tested items via "think-aloud" interviews. We tested the revised items in a cross-sectional quantitative telephone survey. The study setting comprised small workplaces (20-250 employees) in low-wage industries. Decision-makers representing small workplaces in King County, Washington (think-aloud interviews, n = 9), and the United States (telephone survey, n = 201) served as study subjects. We generated items for each construct in Weiner's theory of organizational readiness for change. We also measured workplace characteristics and current implementation of workplace wellness programs. We assessed reliability by coefficient alpha for each of the readiness questionnaire subscales. We tested the association of all subscales with employers' current implementation of wellness policies, programs, and communications, and conducted a path analysis to test the associations in the theory of organizational readiness to change. Each of the readiness subscales exhibited acceptable internal reliability (coefficient alpha range, .75-.88) and was positively associated with wellness program implementation ( p < .05). The path analysis was consistent with the theory of organizational readiness to change, except change efficacy did not predict change-related effort. We developed a new questionnaire to assess small workplaces' readiness to adopt and implement evidence-based wellness programs. Our findings also provide empirical validation of Weiner's theory of readiness for change.

A 5-year evaluation of a smoking cessation incentive program for chemical employees.

Science.gov (United States)

Olsen, G W; Lacy, S E; Sprafka, J M; Arceneaux, T G; Potts, T A; Kravat, B A; Gondek, M R; Bond, G G

1991-11-01

This 5-year study of the Dow Chemical Texas Operations 1984-1985 Smoking Cessation Incentive Program (SCIP) evaluated the smoking habits of 1,097 participants and 1,174 nonparticipants. We observed, via questionnaire and saliva cotinine data, that participants were 2.3 times more likely to be long-term (greater than or equal to 5 years) nonusers of tobacco than nonparticipants (10.2% vs 4.4%, P less than or equal to 0.01). However, smoking cessation rates for 3-4 years, 1-2 years, and less than 1 year were similar for participants who remained smokers at the conclusion of SCIP and nonparticipants. Age and the interaction between the management job category and having quit smoking for at least 30 days sometime prior to the worksite program were important predictors of smoking cessation among participants. Thirty-six percent of the participants who were considered exsmokers of 6 months duration at the conclusion of the program in 1985 remained long-term quitters 5 years later. Stress and enjoyment of smoking were the two most important reasons provided by participants for recidivism. The results of this 5-year evaluation demonstrate the heterogeneity of employee participation and success with a worksite smoking cessation program.

Integrating a Web-Based Whole-Slide Imaging System and Online Questionnaires in a National Cytopathology Peer Comparison Educational Program in Taiwan.

Science.gov (United States)

Hang, Jen-Fan; Liang, Wen-Yih; Hsu, Chih-Yi; Lai, Chiung-Ru

2015-01-01

In a peer comparison educational program, transferring glass slides between laboratories and collecting responses are time- and cost-consuming. Integrating a web-based whole-slide imaging (WSI) system and online questionnaires may serve as a promising solution. Five gynecologic Papanicolaou-stained smears and 5 nongynecologic slides were selected. The 10 whole-slide images were acquired by a Leica SCN-400 system and released via an Aperio eSlide Manager. Online questionnaires generated by Google Forms with access to the 10 whole-slide images were released to all the practitioners in Taiwan by e-mail. After closing the program, an online posttest feedback survey was conducted. A total of 302 participants joined the gynecologic test, and 291 joined the nongynecologic test. The correct interpretation rates were 81.8-93.7% in the former and 28.5-93.1% in the latter. In the posttest feedback survey, there were 63.2% of the participants reporting first-time WSI experience, and 97.9% of them said they would like to participate in a similar program again. Integrating a web-based WSI system and online questionnaires is an easy method to access nationwide practitioners. Participants can make interpretations using WSI even without prior experience. The model is valuable for those who want to initiate a large-scale cytopathology peer comparison educational program. © 2015 S. Karger AG, Basel.

The Teachers of Quality Academy: Evaluation of the Effectiveness and Impact of a Health Systems Science Training Program.

Science.gov (United States)

Walsh, Danielle S; Lazorick, Suzanne; Lawson, Luan; Lake, Donna; Garrison, Herbert G; Higginson, Jason; Vos, Paul; Baxley, Elizabeth

2018-05-01

This project aimed to evaluate the effectiveness of a faculty development program in health systems science (HSS)-the Teachers of Quality Academy (TQA). Participants in TQA and a comparison group were evaluated before, during, and 1 year after the program using self-perception questionnaires, tests of HSS knowledge, and tracking of academic productivity and career advancement. Among program completers (n = 27), the mean self-assessed ratings of knowledge and skills of HSS topics immediately after the program, as compared to baseline, increased significantly compared to controls (n = 30). Participants demonstrated progressive improvement of self-perceived skills and attitudes, and retention of HSS knowledge, from baseline to completion of the program. Participants also demonstrated substantially higher HSS scholarly productivity, leadership, and career advancement compared to the comparison group. The TQA effectively created a faculty cadre able to role model, teach, and create a curriculum in HSS competencies for medical students, resident physicians, and other health professionals.

Development and Evaluation of a Model-Supported Scientific Inquiry Training Program for Elementary Teachers in Indonesia

Directory of Open Access Journals (Sweden)

Chandra Ertikanto

2017-07-01

Full Text Available A teacher training program, named Model-Supported Scientific Inquiry Training Program (MSSITP has been successfully developed to improve the inquiry skills of Indonesian elementary teachers. The skills enhanced by MSSITP are defining problems, formulating hypotheses, planning and doing investigations, drawing conclusions, and communicating the results. This teacher training program was evaluated by 48 teachers selected by stratified random sampling technique from 48 elementary schools in Bandar Lampung City, Lampung Province, Indonesia. The program was designed to follow Bandura’s stages of social learning: attention, retention, production, and motivation. The impact of MSSITP was evaluated in three ways. First, by analyzing the improvements of inquiry skills compared to conventional SITP through pretest and posttest control group design. Second, by using an inquiry questionnaire to describe teachers’ perceptions of inquiry learning. Last, by using a response instrument to elicit teachers’ opinions of the program. The results indicate a significant difference (sig 0.00 in teachers’ skills acquired from the two different training programs. Mean posttest scores, varying from 34.7 to 56.9 for the control group and 58.3 to 98.6 for the experimental group, confirmed the effectiveness of MSSITP.

Evaluation of Hawaii's Healthy Start Program.

Science.gov (United States)

Duggan, Anne K.; McFarlane, Elizabeth C.; Windham, Amy M.; Rohde, Charles A.; Salkever, David S.; Fuddy, Loretta; Rosenberg, Leon A.; Buchbinder, Sharon B.; Sia, Calvin C. J.

1999-01-01

Describes Hawaii's Healthy Start Program (HST), its ongoing evaluation study, and evaluation findings at the end of two of a planned three years of family-program participation and follow-up. HST uses home visitors to help prevent abusive and neglectful parenting. Found significant differences in program implementation among the three…

Clinical characteristics of patients with tinnitus evaluated with the Tinnitus Sample Case History Questionnaire in Japan: A case series.

Directory of Open Access Journals (Sweden)

Takashi Kojima

Full Text Available The Tinnitus Sample Case History Questionnaire was determined as a standardized questionnaire for obtaining patient case histories and for characterizing patients into subgroups at the Tinnitus Research Initiative in 2006. In this study, we developed a Japanese version of this questionnaire for evaluating the clinical characteristics of patients with tinnitus. The Japanese version of the questionnaire will be available for evaluating treatments for tinnitus and for comparing data on tinnitus in research centers.To evaluate the clinical characteristics of patients with tinnitus in Japan using a newly developed Japanese version of Tinnitus Sample Case History Questionnaire.This was a prospective study based on patient records.University hospitals, general hospitals, and clinics.We collected patient data using a Japanese translated version of the Tinnitus Sample Case History Questionnaire. In total, 584 patients who visited our institutions in Japan between August 2012 and March 2014 were included (280 males and 304 females; age 13-92 years; mean age, 60.8. We examined patients after dividing them into two groups according to the presence or absence of hyperacusis. The collected results were compared with those from the Tinnitus Research Initiative database.Compared with the TRI database, there were significantly more elderly female patients and fewer patients with trauma-associated tinnitus. There was a statistically lower ratio of patients with hyperacusis. We found that patients with tinnitus in addition to hyperacusis had greater tinnitus severity and exhibited higher rates of various complications.The Japanese version of the Tinnitus Sample Case History Questionnaire developed in this study can be a useful tool for evaluating patients with tinnitus in Japan. The results of this multicenter study reflect the characteristics of patients with tinnitus who require medical care in Japan. Our data provides a preliminary basis for an international

Curriculum Evaluation and Employers Opinions: the case study of Educational Technology Program in Bachelor Degree (Continuing Program

Directory of Open Access Journals (Sweden)

Nakhon Lalognam

2016-09-01

Full Text Available The purposes of this research were: 1 to evaluate the Educational Technology Program (Continuing Program in Bachelor Degree curriculum which is revised in 2007 by applying CIPP model for evaluation. 2 to study the opinions of the employers about the ideal characteristics and actual characteristics of graduates. 3 to study the opinions for the requirements of the Educational Technology Program in Bachelor Degree (Continuing Program and knowledge implementation in work of graduates. 4 to make the suggestions and guidelines to improve the Educational Technology Program in Bachelor Degree (Continuing Program to achieve potentiality and responsive for the requirements of learners and employers. The sample of this research were 310 persons ; consisted of graduates in the Educational Technology Program in Bachelor Degree (Continuing Program in academic year 2006 - 2010, the committee of the Educational Technology Program in Bachelor Degree (Continuing Program , instructors and employers by using Multi-stage Random Sampling and Simple Random Sampling. The instruments of this research were the 5 levels rating scale questionnaire and the structured interview type. They consisted of 3 sets: 1 for graduates, 2 for the committee of the Educational Technology Program in Bachelor Degree (Continuing Program and 3 for instructors and employers. The research found that: 1. The results of evaluation on the Educational Technology Program in Bachelor Degree (Continuing Program which is revised in 2007 were: 1.1 The opinions of graduates to curriculum in all of aspects were average at the uncertain level which the context aspect was at the high level, input aspect was at the uncertain level, process aspect was at the uncertain level and product aspect was at the high level. 1.2 The opinions of the curriculum committee and instructors to curriculum in all of aspects were average at the high level which the context aspect was at the high level, input aspect was at the

Evaluation of a class wide teaching program for developing preschool life skills.

Science.gov (United States)

Hanley, Gregory P; Heal, Nicole A; Tiger, Jeffrey H; Ingvarsson, Einar T

2007-01-01

Recently, nonmaternal center-based child care has been linked to problem behavior in young children (National Institute of Child Health and Human Development, 2003). In response, a comprehensive program to promote prosocial skills was evaluated in a classroom of 16 children between the ages of 3 and 5 years. Classroom observations were conducted during evocative situations to determine the likelihood of problem behavior (noncompliance, vocal or motor disruptions, aggression) and preschool life skills. A classwide teaching program was then implemented in a staggered manner across instruction following, functional communication, delay tolerance, and friendship skills. These four categories of preschool life skills, which included two to four related skills, were selected for classwide teaching because they were either identified by educators as important for early school success, have often been taught following functional assessments of more severe problem behavior, or both. Skills were taught on a classwide basis during typically scheduled activities (circle, free play, transitions, meals) via instructions, modeling, role play, and feedback. A multiple probe design showed that the program resulted in an 74% reduction in problem behavior and a more than four-fold increase in preschool life skills. Similar beneficial effects of the program were evident in questionnaire data gathered prior to and at the close of the evaluation. Finally, the teachers who implemented the program reported overall high levels of satisfaction with the classwide teaching program, the target skills, and the results. Implications for the design of early childhood experiences for preempting the development of serious problem behavior are discussed.

Evaluation of educational programs: an affiliate survey.

Science.gov (United States)

Kerker, B

1996-08-01

The Planned Parenthood Federation of America (PPFA) conducted a survey in 1996 to investigate the use of educational program evaluation among its affiliates. Of the 153 surveys mailed out, 55 (36%) were returned. Evaluations of school-based educational programs were conducted consistently by 19% of respondents and occasionally by 72%; non-school-based programs were evaluated consistently by 31% of associations and occasionally by 64%. In both types of presentations, evaluations were likely to consist of pre- and post-testing, post-tests alone, or informal discussions with participants. The outcome variables most often measured were participant satisfaction with the presentation, knowledge gained, and behavioral change. 75% of educational directors recognized the value of evaluations for purposes such as program planning, providing a baseline, and procuring funding; 80% were interested in doing more evaluations. However, directors identified numerous obstacles to evaluation: insufficient time, lack of expertise or models, problems conducting meaningful impact evaluations, limited funds for this purpose, and fear that results would be disappointing. Despite its low response rate, this survey identified a need for PPFA's Education Department to promote program evaluation among its affiliates, provide staff training, and develop meaningful program impact measures.

Methods for evaluation of industry training programs

International Nuclear Information System (INIS)

Morisseau, D.S.; Roe, M.L.; Persensky, J.J.

1987-01-01

The NRC Policy Statement on Training and Qualification endorses the INPO-managed Training Accreditation Program in that it encompasses the elements of effective performance-based training. Those elements are: analysis of the job, performance-based learning objectives, training design and implementation, trainee evaluation, and program evaluation. As part of the NRC independent evaluation of utilities implementation of training improvement programs, the staff developed training review criteria and procedures that address all five elements of effective performance-based training. The staff uses these criteria to perform reviews of utility training programs that have already received accreditation. Although no performance-based training program can be said to be complete unless all five elements are in place, the last two, trainee and program evaluation, are perhaps the most important because they determine how well the first three elements have been implemented and ensure the dynamic nature of training. This paper discusses the evaluation elements of the NRC training review criteria. The discussion will detail the elements of evaluation methods and techniques that the staff expects to find as integral parts of performance-based training programs at accredited utilities. Further, the review of the effectiveness of implementation of the evaluation methods is discussed. The paper also addresses some of the qualitative differences between what is minimally acceptable and what is most desirable with respect to trainee and program evaluation mechanisms and their implementation

Designing workload analysis questionnaire to evaluate needs of employees

Science.gov (United States)

Astuti, Rahmaniyah Dwi; Navi, Muhammad Abdu Haq

2018-02-01

Incompatibility between workload with work capacity is one of main problem to make optimal result. In case at the office, there are constraints to determine workload because of non-repetitive works. Employees do work based on the targets set in a working period. At the end of the period is usually performed an evaluation of employees performance to evaluate needs of employees. The aims of this study to design a workload questionnaire tools to evaluate the efficiency level of position as indicator to determine needs of employees based on the Indonesian State Employment Agency Regulation on workload analysis. This research is applied to State-Owned Enterprise PT. X by determining 3 positions as a pilot project. Position A is held by 2 employees, position B is held by 7 employees, and position C is held by 6 employees. From the calculation result, position A has an efficiency level of 1,33 or "very good", position B has an efficiency level of 1.71 or "enough", and position C has an efficiency level of 1.03 or "very good". The application of this tools giving suggestion the needs of employees of position A is 3 people, position B is 5 people, and position C is 6 people. The difference between the number of employees and the calculation result is then analyzed by interviewing the employees to get more data about personal perception. It can be concluded that this workload evaluation tools can be used as an alternative solution to evaluate needs of employees in office.

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

International Nuclear Information System (INIS)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-01-01

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Development and Evaluation of vetPAL, a Student-Led, Peer-Assisted Learning Program.

Science.gov (United States)

Bates, Lucy S W; Warman, Sheena; Pither, Zoe; Baillie, Sarah

Based on an idea from a final-year student, Bristol Veterinary School introduced vetPAL, a student-led, peer-assisted learning program. The program involved fifth-year (final-year) students acting as tutors and leading sessions for fourth-year students (tutees) in clinical skills and revision (review) topics. The initiative aimed to supplement student learning while also providing tutors with opportunities to further develop a range of skills. All tutors received training and the program was evaluated using questionnaires collected from tutees and tutors after each session. Tutees' self-rated confidence increased significantly in clinical skills and for revision topics. Advantages of being taught by students rather than staff included the informal atmosphere, the tutees' willingness to ask questions, and the relatability of the tutors. The small group size and the style of learning in the revision sessions (i.e., group work, discussions, and interactivity) were additional positive aspects identified by both tutees and tutors. Benefits for tutors included developing their communication and teaching skills. The training sessions were considered key in helping tutors feel prepared to lead sessions, although the most difficult aspects were the lack of teaching experience and time management. Following the successful pilot of vetPAL, plans are in place to make the program permanent and sustainable, while incorporating necessary changes based on the evaluation and the student leader's experiences running the program. A vetPAL handbook has been created to facilitate organization of the program for future years.

Evaluation of Agreement Between Video and Written Questionnaires for Asthma Symptoms Among Children of Tehran: ISAAC Study

Directory of Open Access Journals (Sweden)

MR Masjedi

2008-07-01

Full Text Available Introduction: International study on asthma was conducted to study the prevalence of Asthma symptoms among 13-14 year old children using written and video questionnaires during the early 90's. The aim of the present study (ISAAC was to evaluate the agreement between the two questionnaires which were self-completed by the children. Methods: This study, which was a part of the third phase of International Study of Asthma and Allergy in Childhood (ISAAC and performed exactly similar to phase1, was performed by National Research Institute of Tuberculosis and Lung Diseases (NRITLD in two cities of Iran; Rasht and Tehran. All stages of the study were performed in accordance with ISAAC protocol. The present study discusses data related to children of Tehran. A total of 3100 school children aged 13-14 years were questioned about asthma symptoms using written and video questionnaires of ISAAC study. For statistical analysis, initially a descriptive study of the available data was performed. Thereafter, chance corrected agreement between the two questionnaires was evaluated using Cohen’s Kappa co-efficiency. Results: Of the total of 3100 children, 52.4% were male and 47.6% female, with a mean age of 13.6 years. Although the questions discussed in the two questionnaires were not exactly similar, the results of the video questionnaires showed a statistically significant lower positive response to asthma symptoms as compared to the written version. Kappa co-efficiency ranged between 0.06- 0.21 (mean=0.12, which is considered poor for all variables. Conclusion: Positive responses to having asthma symptoms were significantly higher using the written questionnaire compared to the video questionnaire. Similar to previous studies, agreement between the two was considered poor for all variables. Although factors such as language, culture, dwelling area, e.t.c. have special effects on results of these questionnaires, results indicate that the two questionnaires

An initial psychometric evaluation and exploratory cross-sectional study of the body checking questionnaire among Brazilian women.

Directory of Open Access Journals (Sweden)

Angela Nogueira Neves Betanho Campana

Full Text Available Body checking is considered an expression of an excessive preoccupation with appearance. The first aim of this study was to evaluate the psychometric properties of a Brazilian Portuguese version of the Body Checking Questionnaire (BCQ. Additionally, we wanted to examine the questionnaire's associations with body avoidance behaviour, body mass index, dietary habits, and the intensity, frequency, and length of physical exercise. Finally, we also examined the differences between the total BCQ score and the individual BCQ factor scores. Differences between active and sedentary persons and between non-dieters and those on weight-loss diets were also analyzed. For the psychometric study, 546 female public university students from four different courses were surveyed. Two minor samples of university students and eating disorders women were also recruited. In the second part of the study, 403 women were recruited from weight-loss programs, gyms, and a university. All participants were verbally invited to participate in the research and voluntarily took part. Confirmatory factor analysis showed a good fit to the original model of the Brazilian BCQ that retained all 23 items. Satisfactory evidence of construct validity and internal consistency were also generated through analysis of factor loadings, t-values, Cronbach's alpha, and construct reliability tests. The results also showed associations among body checking and body avoidance, body satisfaction, social anxiety, body mass index, and the frequency and intensity of physical exercise. Significant differences were found between non-dieters and weight-loss dieters for all BCQ factors and the total BCQ score. For physically active and sedentary persons, a significant difference was only observed for idiosyncratic checking behaviour. In conclusion, the BCQ appears to be a valid and reliable scale for Brazilian research, and the associations and differences found in this study suggest that women at gyms

Development of the Attitudes to Domestic Violence Questionnaire for Children and Adolescents.

Science.gov (United States)

Fox, Claire L; Gadd, David; Sim, Julius

2015-09-01

To provide a more robust assessment of the effectiveness of a domestic abuse prevention education program, a questionnaire was developed to measure children's attitudes to domestic violence. The aim was to develop a short questionnaire that would be easy to use for practitioners but, at the same time, sensitive enough to pick up on subtle changes in young people's attitudes. We therefore chose to ask children about different situations in which they might be willing to condone domestic violence. In Study 1, we tested a set of 20 items, which we reduced by half to a set of 10 items. The factor structure of the scale was explored and its internal consistency was calculated. In Study 2, we tested the factor structure of the 10-item Attitudes to Domestic Violence (ADV) Scale in a separate calibration sample. Finally, in Study 3, we then assessed the test-retest reliability of the 10-item scale. The ADV Questionnaire is a promising tool to evaluate the effectiveness of domestic abuse education prevention programs. However, further development work is necessary. © The Author(s) 2014.

FY-2007 PNNL Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Fisher, Julie A.; Goheen, Steven C.; Isern, Nancy G.; Madson, Vernon J.; Meicenheimer, Russell L.; Pugh, Ray; Schneirla, Keri A.; Shockey, Loretta L.; Tinker, Mike R.

2008-08-15

This document reports the results of the FY-2007 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Evaluation of the Health Rocks! Program: The Association of Youth Engagement with Program Outcomes

Directory of Open Access Journals (Sweden)

Yan Xia

2017-01-01

Full Text Available This evaluation research examined the relationship between program process and program outcome, specifically, youth engagement in the national 4-H Council Health Rocks! program and their program outcomes.  Based on program evaluation surveys completed after the program by participants, youths’ engagement in the program was associated with their gains in knowledge and skills about substance use, and personal assets related to avoiding risks.  When youth participants find a program interesting, are actively engaged in the program, and find the program staff friendly, they benefit more from the program.  Findings underscore the importance of engaging curriculum and friendly staff to the success of extension or afterschool youth programs. The evaluation method may offer an example of balancing rigor of evaluation design and feasibility of implementing an evaluation.

The Groningen Radiotherapy-Induced Xerostomia questionnaire : Development and validation of a new questionnaire

NARCIS (Netherlands)

Beetz, I.; Burlage, Fred; Bijl, H.P.; Chouvalova, Olga; Christianen, M.E.; Vissink, A.; van der Laan, B.F.; de Bock, G.H.; Langendijk, J.A.

2010-01-01

Purpose: The purpose of this study was to develop and validate a questionnaire (Groningen Radiotherapy-Induced Xerostomia (GRIX) questionnaire) that has the ability to distinguish between patient-rated xerostomia during day and night and can be used to evaluate the impact of emerging radiation

Evaluation of Psychometric Properties of the Second Version of the Taqwa (Piety) Questionnaire in Bahasa Melayu.

Science.gov (United States)

Seghatoleslam, Tahereh; Habil, Hussain; Hatim, Ahmad; Ardakani, Abolfazl; Ishak, Khafidz; Rashid, Rusdi

2017-02-10

The aim of the study is to evaluate the psychometric properties of the Bahasa Melayu version of the Taqwa (piety) questionnaire, used for the measurement of behaviour of Drug Dependency Syndrome (DDS), in Malay patients. A sample of 98 males with a psychiatric diagnosis (DSM-IV-R) as the DDS was randomly selected from Kajang Khafidz Polyclinic Kuala Lumpur, Malaysia. After receiving their agreement to attend the study, they completed the Taqwa (piety) questionnaire. The reliability was assessed by determining the Cronbach's [Formula: see text] to measure the consistency of related questions for all four dimensions (subscales), including individual, social, cognitional, and emotional Taqwa behaviour. In the next step to evaluate the composite reliability, convergent, and discrimination validity, a measurement model was determined via Conformity Factor Analysis (CFA) based on Partial List Square method (Smart- PLS Ver: 2M3). The reliability of four dimensions of the questionnaire was acceptable ([Formula: see text] correlated to each other. However, according to the CFA method, the items with low loading factor (discrimination validity were satisfied in all conformity factor loading that exceeded 0/05. The psychometric properties of the Taqwa questionnaire are acceptable, and the scale is a good instrument for assessing the Islamic attitude, beliefs, and behaviour of the Bahasa Melayu DDS patients.

Guidance for training program evaluation

International Nuclear Information System (INIS)

1984-01-01

An increased concern about the training of nuclear reactor operators resulted from the incident at TMI-2 in 1979. Purpose of this guide is to provide a general framework for the systematic evaluation of training programs for DOE Category-A reactors. The primary goal of such evaluations is to promote continuing quality improvements in the selection, training and qualification programs

Summary of the Fourth International Nuclear Emergency Exercise (INEX-4). Exercise Conduct and Evaluation Questionnaires

International Nuclear Information System (INIS)

Auclair, Jean Patrice; Duchesne, David; Caamano, Delphine; Cessac, Bruno; Mehl-auget, Isabelle; Gering, Florian; Macsuga, Geza; Fukumoto, Masahiro; Holo, Eldri Naadland; Ugletveit, Finn; Griffiths, Mike; Breitinger, Mark; Heinrich, Ann; Mcclelland, Vincent; Ahier, Brian; Lazo, Ted; Mcinturff, Sandi; Kawabata, Masanori; Lazo, Ted; Okyar, Halil Burcin

2013-01-01

The INEX-4 consequence management exercise, part of the OECD Nuclear Energy Agency's ongoing series of International Nuclear Emergency Exercises (INEX), was developed under the auspices of the NEA/CRPPH Working Party on Nuclear Emergency Matters (WPNEM) in response to members desire to better prepare for the longer-term response to a nuclear or radiological emergency. The INEX-4 exercise was designed to allow participants to investigate the national and, in some cases, international arrangements for responding to widespread radiological contamination of the urban environment from a radiological dispersal devise (or dirty bomb) and the consequence management issues likely to be raised in the medium to longer term after such an event. The experiences of participating countries were gathered through an evaluation questionnaire and are summarised in this report. The INEX-4 series was developed in 2008, and conducted throughout 2010 and 2011 with 17 participating countries using the INEX-4 scenario for an event involving a radiological dispersal device. An INEX-4 evaluation questionnaire was developed to document the process and results of the exercise, which was designed mainly to test emergency responses/actions related to consequence management and transition to recovery. The conclusions drawn from the INEX-4 experiences varied greatly, but this was to be expected given the nature of the scenario and the involvement of organisations outside of the nuclear community. The evaluation questionnaires completed by each participating country provided detailed information on the national approaches taken with respect to each of the exercise objectives and on issues relating to the international interfaces between countries. In collaboration with the NEA Secretariat, staff from the United States Department of Energy (DOE) reviewed each completed questionnaire to identify and summarise the essential information derived from the exercise for consideration by WPNEM members

EVALUE : a computer program for evaluating investments in forest products industries

Science.gov (United States)

Peter J. Ince; Philip H. Steele

1980-01-01

EVALUE, a FORTRAN program, was developed to provide a framework for cash flow analysis of investment opportunities. EVALUE was designed to assist researchers in evaluating investment feasibility of new technology or new manufacturing processes. This report serves as user documentation for the EVALUE program. EVALUE is briefly described and notes on preparation of a...

Practical strategies for nursing education program evaluation.

Science.gov (United States)

Lewallen, Lynne Porter

2015-01-01

Self-evaluation is required for institutions of higher learning and the nursing programs within them. The literature provides information on evaluation models and instruments, and descriptions of how specific nursing education programs are evaluated. However, there are few discussions in the nursing education literature of the practical aspects of nursing education program evaluation: how to get started, how to keep track of data, who to involve in data collection, and how to manage challenging criteria. This article discusses the importance of program evaluation in the academic setting and provides information on practical ways to organize the evaluation process and aggregate data, and strategies for gathering data from students, graduates, alumni, and employers of graduates. Copyright © 2015 Elsevier Inc. All rights reserved.

Lessons learned from IRIS EPO program evaluations

Science.gov (United States)

Taber, J.; Hubenthal, M.

2012-12-01

Evaluating the overall impact of EPO programs that include activities ranging from formal education through broad public outreach, is a complex issue. The impact of education activities targeted at narrowly defined audiences is generally easier to quantify than the national impact of outreach activities conducted by a relatively small program. For educational activities, our approach has been to leverage the best-practices identified through research and to continuously assess the individual elements internally with the intention of making improvements based on the data generated and the existing research. By constructing our elements on the best practices identified by the research community we feel that internal formative evaluation is a valid means to determine if an activity is effective, particularly when the results are compared to similar programs. For example, effective practices of professional development are well documented in the literature. As a result, this allows us to shape our programs and our evaluations to monitor elements that have been identified as key by the educational research community. Further, such actions allow us to avoid allocating significant resources with the intention of pinning down direct causal relationships between our programs and consumers, when similar interventions (conducted by others) have already shown such relationships. Ongoing review by an EPO advisory committee also provides regular oversight of program impact. While we find internal and external formative evaluation extremely useful in shaping the program and documenting its impact, we also recognize the value of a summative evaluation process. For example, an external summative evaluation of the IRIS EPO program was conducted in 2009, followed by an external panel review, as part of the regular review of IRIS programs. We found that the most valuable part of the external evaluation was our preparation, including clarifying the goals of each of the elements of the

Effective Practices for Evaluating Education and Public Outreach Programs

Science.gov (United States)

Wilkerson, S.

2013-12-01

Stephanie Baird Wilkerson, PhD Carol Haden EdD Magnolia Consulting,LLC Education and public outreach (EPO) program developers and providers seeking insights regarding effective practices for evaluating EPO activities programs benefit from understanding why evaluation is critical to the success of EPO activities and programs, what data collection methods are appropriate, and how to effectively communicate and report findings. Based on our extensive experience evaluating EPO programs, we will share lessons learned and examples of how these practices play out in actual evaluation studies. EPO program developers, providers, and evaluators must consider several factors that influence which evaluation designs and data collection methods will be most appropriate, given the nature of EPO programs. Effective evaluation practices of EPO programs take into account a program's phase of development, duration, and budget as well as a program's intended outcomes. EPO programs that are just beginning development will have different evaluation needs and priorities than will well-established programs. Effective evaluation practices consider the 'life' of a program with an evaluation design that supports a program's growth through various phases including development, revision and refinement, and completion. It would be premature and inappropriate to expect the attainment of longer-term outcomes of activities during program development phases or early stages of implementation. During program development, EPO providers should clearly define program outcomes that are feasible and appropriate given a program's scope and expected reach. In many respects, this directly relates to the amount of time, or duration, intended audiences participate in EPO programs. As program duration increases so does the likelihood that the program can achieve longer-term outcomes. When choosing which outcomes are reasonable to impact and measure, program duration should be considered. Effective evaluation

7 CFR 550.31 - Questionnaires and survey plans.

Science.gov (United States)

2010-01-01

... 7 Agriculture 6 2010-01-01 2010-01-01 false Questionnaires and survey plans. 550.31 Section 550.31... Agreements Program Management § 550.31 Questionnaires and survey plans. The Cooperator is required to submit to the REE Agency copies of questionnaires and other forms for clearance in accordance with the...

Chronic depression: development and evaluation of the luebeck questionnaire for recording preoperational thinking (LQPT

Directory of Open Access Journals (Sweden)

Kühnen Tanja

2011-12-01

Full Text Available Abstract Background A standardized instrument for recording the specific cognitive psychopathology of chronically depressed patients has not yet been developed. Up until now, preoperational thinking of chronically depressed patients has only been described in case studies, or through the external observations of therapists. The aim of this study was to develop and evaluate a standardized self-assessment instrument for measuring preoperational thinking that sufficiently conforms to the quality criteria for test theory. Methods The "Luebeck Questionnaire for Recording Preoperational Thinking (LQPT" was developed and evaluated using a german sample consisting of 30 episodically depressed, 30 chronically depressed and 30 healthy volunteers. As an initial step the questionnaire was subjected to an item analysis and a final test form was compiled. In a second step, reliability and validity tests were performed. Results Overall, the results of this study showed that the LQPT is a useful, reliable and valid instrument. The reliability (split-half reliability 0.885; internal consistency 0.901 and the correlations with other instruments for measuring related constructs (control beliefs, interpersonal problems, stress management proved to be satisfactory. Chronically depressed patients, episodically depressed patients and healthy volunteers could be distinguished from one another in a statistically significant manner (p Conclusion The questionnaire fulfilled the classical test quality criteria. With the LQPT there is an opportunity to test the theory underlying the CBASP model.

Employee Assistance Programs in Canada.

Science.gov (United States)

Jaffe, Peter; And Others

1988-01-01

Employee assistance programs (EAP) are evaluated in questionnaire responses from 73 of 109 (67 percent) Canadian school boards and 35 (50 percent) of the clients of the EAP in London, Ontario. Explores the nature of current programs and emerging trends in this field. (MLF)

Methodologies for evaluation of AECB regulatory program

International Nuclear Information System (INIS)

Yarranton, G.A.; Gray, B.J.; Yarranton, M.

1986-05-01

AECB (Atomic Energy Control Board) commissioned this report to obtain information about methods of planning and conducting evaluation of its regulatory program. The report begins with a bibliography consisting of 280 abstracts assembled from an extensive search of international literature. Each cited publication describes or uses methods applicable to the evaluation of regulatory programs. The report continues with a review of the methodologies found in the literature. It identifies the most relevant references for each step in program evaluation: the commissioning of evaluation; the identification of evaluation issues; the defining of questions; the answering of questions; the reporting of reslts, and the implementation of recommendations. Finally, the report examines the applicability, advantages and disadvantages of the different evaluation methods and makes recommendations about the selection of methods and their application to the AECB program

Evaluation of Traffic Accident Risk in In-City Bus Drivers: The Use of Berlin Questionnaire

Science.gov (United States)

Ekren, Pervin Korkmaz; Uysal, Funda Elmas; Başoğlu, Özen K.

2018-01-01

OBJECTIVES Traffic accidents associated with high mortality rate may produce serious problems especially in highways. Obstructive sleep apnea (OSA) has been associated with a high risk for traffic accidents due to excessive daytime sleepiness even in in-city drivers. In the present study, it was aimed to evaluate the rate of OSA symptoms and to identify risk factors associated with traffic accidents in in-city bus drivers. MATERIAL AND METHODS A self-administered questionnaire including demographic and anthropometric features, sleep and work schedules, Berlin questionnaire, Epworth sleepiness score (ESS), and history of traffic accidents was used. RESULTS The questionnaire was conducted for 1400 male bus drivers (mean age, 38.0±6.4 y, body mass index, 27.8±3.9 kg/m2). A total of 1058 (75.6%) drivers had one or more accidents while driving bus. According to the Berlin questionnaire, 176 (12.6%) drivers were found to have high OSA risk and the accident rate was 83.0% in high-risk group, whereas 74.5% of low-risk drivers had accidents (p=0.043). The drivers with a history of traffic accident were older (p=0.030), had higher ESS (p=0.019), and were more in the high-risk OSA group according to the Berlin questionnaire (p=0.015). In multivariate linear regression analysis, traffic accident was associated with only Berlin questionnaire (p=0.015). CONCLUSION The present results support that city bus drivers with high OSA risk according to Berlin questionnaire have increased accident rates. Therefore, we suggest using Berlin questionnaire for screening sleep apnea not only in highway drivers but also in in-city bus drivers. PMID:29755810

Evaluating a Development Program.

Science.gov (United States)

Frantzreb, Arthur C.

Problems in evaluating the success of an institutional resource development program are examined and suggestions are offered for effective assessment. Such a program is seen as a sequence of events in the artful management of people, from the planning stage to obtaining a financial commitment in writing from persons who want to share their assets…

[Teaching evaluation at Medical School, UNAM].

Science.gov (United States)

Salas-Gómez, Luz Elena; Ortiz-Montalvo, Armando; Alaminos-Sager, Isabel Luisa

2006-01-01

The purpose of this article is to offer a synthesis of what has been done in the Teaching Evaluation Program at the Medical School of the Autonomous National University of Mexico (UNAM). The Program involves three questionnaires of the students' opinion that evaluate professors of the basic and sociomedical areas, microbiology and parasitology laboratory and surgery. Between 1994 and 2003, 134,811 questionnaires were answered to evaluate the teaching performance of 6262 professors of pregraduate students. Although the evaluation of teaching through a single way is insufficient, the results obtained allow us to affirm that the Medical School at UNAM has a good professor staff, as well as they are useful for the design of programs dedicated to the acknowledgment of excellence and the needs for teaching education.

Development and evaluation of the Communication over Language Barriers questionnaire (CoLB-q) in paediatric healthcare.

Science.gov (United States)

Granhagen Jungner, Johanna; Tiselius, Elisabet; Wenemark, Marika; Blomgren, Klas; Lützén, Kim; Pergert, Pernilla

2018-04-22

To develop a valid and reliable questionnaire addressing the experiences of healthcare personnel of communicating over language barriers and using interpreters in paediatric healthcare. A multiple- methods approach to develop and evaluate the questionnaire, including focus groups, cognitive interviews, a pilot test and test-retest. The methods were chosen in accordance with questionnaire development methodology to ensure validity and reliability. The development procedure showed that the issues identified were highly relevant to paediatric healthcare personnel and resulted in a valid and reliable Communication over Language Barriers questionnaire (CoLB-q) with 27 questions. The CoLB-q is perceived as relevant, important and easy to respond to by respondents and has satisfactory validity and reliability. The CoLB-q can be used to map how healthcare personnel overcome language barriers through communication tools and to identify problems encountered in paediatric healthcare. Furthermore, the transparently described process could be used as a guide for developing similar questionnaires. Copyright © 2018 The Authors. Published by Elsevier B.V. All rights reserved.

Evaluation of a program to reduce back pain in nursing personnel

Directory of Open Access Journals (Sweden)

Neusa Maria C Alexandre

2001-08-01

Full Text Available OBJECTIVE: To evaluate the effectiveness of a program designed to reduce back pain in nursing aides. METHODS: Female nursing aides from a university hospital who had suffered episodes of back pain for at least six months were included in the study. Participants were randomly divided into a control group and an intervention group. The intervention program involved a set of exercises and an educational component stressing the ergonomic aspect, administered twice a week during working hours for four months. All subjects answered a structured questionnaire and the intensity of pain was assessed before and after the program using a visual analogue scale (VAS. Student's t-test or the Wilcoxon Rank Sum Test for independent samples, and Chi-square test or the Exact Fisher test for categorical analysis, were used. The McNemar test and the Wilcoxon matched pairs test were used to compare the periods before and after the program. RESULTS: There was a statistically significant decrease in the frequency of cervical pain in the last two months and in the last seven days in the intervention group. There was also a reduction in cervical pain intensity in the two periods (2 months, 7 days and lumbar pain intensity in the last 7 days. CONCLUSIONS: The results suggest that a program of regular exercise with an emphasis on ergonomics can reduce musculoskeletal symptoms in nursing personnel.

Evaluation of a program to reduce back pain in nursing personnel

Directory of Open Access Journals (Sweden)

Alexandre Neusa Maria C

2001-01-01

Full Text Available OBJECTIVE: To evaluate the effectiveness of a program designed to reduce back pain in nursing aides. METHODS: Female nursing aides from a university hospital who had suffered episodes of back pain for at least six months were included in the study. Participants were randomly divided into a control group and an intervention group. The intervention program involved a set of exercises and an educational component stressing the ergonomic aspect, administered twice a week during working hours for four months. All subjects answered a structured questionnaire and the intensity of pain was assessed before and after the program using a visual analogue scale (VAS. Student's t-test or the Wilcoxon Rank Sum Test for independent samples, and Chi-square test or the Exact Fisher test for categorical analysis, were used. The McNemar test and the Wilcoxon matched pairs test were used to compare the periods before and after the program. RESULTS: There was a statistically significant decrease in the frequency of cervical pain in the last two months and in the last seven days in the intervention group. There was also a reduction in cervical pain intensity in the two periods (2 months, 7 days and lumbar pain intensity in the last 7 days. CONCLUSIONS: The results suggest that a program of regular exercise with an emphasis on ergonomics can reduce musculoskeletal symptoms in nursing personnel.

Formal psychological assessment in evaluating depression: a new methodology to build exhaustive and irredundant adaptive questionnaires.

Science.gov (United States)

Serra, Francesca; Spoto, Andrea; Ghisi, Marta; Vidotto, Giulio

2015-01-01

Psychological Assessment can be defined as a complex procedure of information collection, analysis and processing. Formal Psychological Assessment (FPA) tries to improve this procedure by providing a formal framework to build assessment tools. In this paper, FPA is applied to depression. Seven questionnaires widely used for the self-evaluation of depression were selected. Diagnostic criteria for major depressive disorder were derived from the DSM-5, literature and Seligman's and Beck's theories. A Boolean matrix was built, including 266 items from the questionnaires in the rows and 20 selected attributes, obtained through diagnostic criteria decomposition, in the columns. In the matrix, a 1 in a cell meant that the corresponding item investigated the specific attribute. It was thus possible to analyze the relationships between items and attributes and among items. While none of the considered questionnaires could alone cover all the criteria for the evaluation of depressive symptoms, we observed that a set of 30 items contained the same information that was obtained redundantly with 266 items. Another result highlighted by the matrix regards the relations among items. FPA allows in-depth analysis of currently used questionnaires based on the presence/absence of clinical elements. FPA allows for going beyond the mere score by differentiating the patients according to symptomatology. Furthermore, it allows for computerized-adaptive assessment.

Evaluation of a community transition to professional practice program for graduate registered nurses in Australia.

Science.gov (United States)

Aggar, Christina; Gordon, Christopher J; Thomas, Tamsin H T; Wadsworth, Linda; Bloomfield, Jacqueline

2018-03-26

Australia has an increasing demand for a sustainable primary health care registered nursing workforce. Targeting graduate registered nurses who typically begin their nursing career in acute-care hospital settings is a potential workforce development strategy. We evaluated a graduate registered nurse Community Transition to Professional Practice Program which was designed specifically to develop and foster skills required for primary health care. The aims of this study were to evaluate graduates' intention to remain in the primary health care nursing workforce, and graduate competency, confidence and experiences of program support; these were compared with graduates undertaking the conventional acute-care transition program. Preceptor ratings of graduate competence were also measured. All of the 25 graduates (n = 12 community, n = 13 acute-care) who completed the questionnaire at 6 and 12 months intended to remain in nursing, and 55% (n = 6) of graduates in the Community Transition Program intended to remain in the primary health care nursing workforce. There were no differences in graduate experiences, including level of competence, or preceptors' perceptions of graduate competence, between acute-care and Community Transition Programs. The Community Transition to Professional Practice program represents a substantial step towards developing the primary health care health workforce by facilitating graduate nurse employment in this area. Copyright © 2018 Elsevier Ltd. All rights reserved.

Dimensional Assessment of Anxiety in Puerto Rican Patients: Evaluating Applicability of Psychological Questionnaires.

Science.gov (United States)

González-Barrios, Polaris; Morales-Rodríguez, Carlos M; Merced-Morales, Kritzianel; Lampón, Anabelle; González, Rafael; Martínez, Karen

2016-09-01

A dimensional assessment model as a supplement to the diagnosis process could overcome the current pitfalls in classifying psychopathology in ethnic minorities. The aim of the study described herein was to examine a sample of Puerto Rican patients diagnosed with anxiety disorder in order to evaluate the psychometric properties of the specific scales that assess the following 3 domains: clinical symptoms, personality/trait, and affective style. 80 subjects were recruited and interviewed using the Structured Clinical Interview for DSM-IV to identify the presence of anxiety disorders. Following this, various questionnaires assessing each proposed domain were administered to the participants. Reliability and validity of these questionnaires were examined using Cronbach's alpha and exploratory factor analysis. The effect of the individual items of the questionnaires on the overall reliability and validity was assessed using factor scores component matrix. Analyses revealed moderate to high reliability and validity scores within all 3 domains. The sample obtained moderate to high scores on the scales comprising clinical and personality/trait domains. The use of self-report scales in accordance with the proposed dimensional framework may be an effective way to supplement categorical diagnoses within the Hispanic population represented by this sample.

The school evaluation program

International Nuclear Information System (INIS)

Fisher, E.; Harrison, J.; Turner, W.

1990-01-01

This paper reports on a pilot program to provide classroom and field training to school facility operators that was implemented by the U.S. Environmental Protection Agency's Office of Radiation Programs in 1989. This program consisted of two phases. The first phase developed and delivered a three-day workshop in Nashville, Tennessee. As a result of the workshop a second phase was initiated. The second phase investigated several school buildings with elevated indoor radon levels in the Western United States. Radon entry mechanisms were identified. Measurements to evaluate soil depressurization as a radon control method were made and HVAC systems were characterized. Measurements were made to evaluate HVAC modification as a radon control method. Building shell tightness measurements were made and information was collected to judge the suitability of potential sites for additional EPA sponsored 'hands on' school training. Physical and institutional problem areas were identified

Development and evaluation of oral Cancer quality-of-life questionnaire (QOL-OC).

Science.gov (United States)

Nie, Min; Liu, Chang; Pan, Yi-Chen; Jiang, Chen-Xi; Li, Bao-Ru; Yu, Xi-Jie; Wu, Xin-Yu; Zheng, Shu-Ning

2018-05-03

In this study scales and items for the Oral Cancer Quality-of-life Questionnaire (QOL-OC) were designed and the instrument was evaluated. The QOL-OC was developed and modified using the international definition of quality of life (QOL) promulgated by the European Organization for Research and Treatment of Cancer (EORTC) and analysis of the precedent measuring instruments. The contents of each item were determined in the context of the specific characteristics of oral cancer. Two hundred thirteen oral cancer patients were asked to complete both the EORTC core quality of life questionnaire (EORTC QLC-C30) and the QOL-OC. Data collected was used to conduct factor analysis, test-retest reliability, internal consistency, and construct validity. Questionnaire compliance was relatively high. Fourteen of the 213 subjects accepted the same tests after 24 to 48 h demonstrating a high test-retest reliability for all five scales. Overall internal consistency surpasses 0.8. The outcome of the factor analysis coincides substantially with our theoretical conception. Each item shows a higher correlation coefficient within its own scale than the others which indicates high construct validity. QOL-OC demonstrates fairly good statistical reliability, validity, and feasibility. However, further tests and modification are needed to ensure its applicability to the quality-of-life assessment of Chinese oral cancer patients.

Super Efficient Refrigerator Program (SERP) evaluation. Volume 1: Process evaluation

Energy Technology Data Exchange (ETDEWEB)

Sandahl, L.J.; Ledbetter, M.R.; Chin, R.I.; Lewis, K.S.; Norling, J.M.

1996-01-01

The Pacific Northwest National Laboratory (PNNL) conducted this study for the US Department of Energy (DOE) as part of the Super Efficient Refrigerator Program (SERP) Evaluation. This report documents the SERP formation and implementation process, and identifies preliminary program administration and implementation issues. The findings are based primarily on interviews with those familiar with the program, such as utilities, appliance manufacturers, and SERP administrators. These interviews occurred primarily between March and April 1995, when SERP was in the early stages of program implementation. A forthcoming report will estimate the preliminary impacts of SERP within the industry and marketplace. Both studies were funded by DOE at the request of SERP Inc., which sought a third-party evaluation of its program.

Development and validation of a questionnaire for evaluation of students' attitudes towards family medicine.

Science.gov (United States)

Šter, Marija Petek; Švab, Igor; Klemenc-Ketiš, Zalika; Kersnik, Janko

2015-03-01

The development of the EURACT (European Academy of Teachers in General Practice) Educational Agenda helped many family medicine departments in development of clerkship and the aims and objectives of family medicine teaching. Our aims were to develop and validate a tool for assessment of students' attitudes towards family medicine and to evaluate the impact of the clerkship on students' attitudes regarding the competences of family doctor. In the pilot study, experienced family doctors were asked to describe their attitudes towards family medicine by using the Educational Agenda as a template for brainstorming. The statements were paraphrased and developed into a 164-items questionnaire, which was administered to 176 final-year students in academic year 2007/08. The third phase consisted of development of a final tool using statistical analysis, which resulted in the 60-items questionnaire in six domains which was used for the evaluation of students' attitudes. At the beginning of the clerkship, person-centred care and holistic approach scored lower than the other competences. Students' attitudes regarding the competences at the end of 7 weeks clerkship in family medicine were more positive, with exception of the competence regarding primary care management. The students who named family medicine as his or her future career choice, found holistic approach as more important than the students who did not name it as their future career. With the decision tree, which included students' attitudes to the competences of family medicine, we can successfully predict the future career choice in family medicine in 93.5% of the students. This study reports on the first attempt to develop a valid and reliable tool for measuring attitudes towards family medicine based on EURACT Educational Agenda. The questionnaire could be used for evaluating changes of students' attitudes in undergraduate curricula and for prediction of students' preferences regarding their future professional

Putting program evaluation into practice: enhancing the Girls Just Wanna Have Fun program.

Science.gov (United States)

Bean, Corliss N; Kendellen, Kelsey; Halsall, Tanya; Forneris, Tanya

2015-04-01

In recent years there has been a call for increased community physical activity and sport programs for female youth that are deliberately structured to foster positive developmental outcomes. In addition, researchers have recognized the need to empirically evaluate such programs to ensure that youth are provided with optimal opportunities to thrive. This study represents a utilization-focused evaluation of Girls Just Wanna Have Fun, a female-only physical activity-based life skills community program. A utilization-focused evaluation is particularly important when the evaluation is to help stakeholders utilize the findings in practice. The purpose of this study was twofold: (a) to gain an understanding of the ongoing successes and challenges after year two of program implementation and (b) to examine how the adaptations made based on feedback from the first year evaluation were perceived as impacting the program. From interviews with youth participants and program leaders, three main themes with eight sub-themes emerged. The main themes were: (a) applying lessons learned can make a significant difference, (b) continually implementing successful strategies, and (c) ongoing challenges. Overall, this evaluation represents an important step in understanding how to improve program delivery to better meet the needs of the participants in community-based programming. Copyright © 2014 Elsevier Ltd. All rights reserved.

PNNL FY2005 DOE Voluntary Protection Program (VPP) Program Evaluation

Energy Technology Data Exchange (ETDEWEB)

Wright, Patrick A.; Madson, Vernon J.; Isern, Nancy G.; Haney, Janice M.; Fisher, Julie A.; Goheen, Steven C.; Gulley, Susan E.; Reck, John J.; Collins, Drue A.; Tinker, Mike R.; Walker, Landon A.; Wynn, Clifford L.

2005-01-31

This document reports the results of the FY 2005 PNNL VPP Program Evaluation, which is a self-assessment of the operational and programmatic performance of the Laboratory related to worker safety and health. The report was compiled by a team of worker representatives and safety professionals who evaluated the Laboratory's worker safety and health programs on the basis of DOE-VPP criteria. The principle elements of DOE's VPP program are: Management Leadership, Employee Involvement, Worksite Analysis, Hazard Prevention and Control, and Safety and Health Training.

Are web-based questionnaires accepted in patients attending rehabilitation?

Science.gov (United States)

Engan, Harald K; Hilmarsen, Christina; Sittlinger, Sverre; Sandmæl, Jon Arne; Skanke, Frode; Oldervoll, Line M

2016-12-01

The aim of the present paper was to study preferences for web based self-administered questionnaires (web SAQs) vs. paper-based self-administered questionnaires (paper SAQs) and to evaluate the feasibility of using web SAQs in patients referred to cardiac, lung, occupational and cancer rehabilitation programs. The patients were approached by mail and given the choice to answer the compulsory SAQs either on paper or on a web-based platform. Hundred and twenty seven out of 183 eligible patients (69.3%) were willing to participate and 126 completed the study. Web SAQs were preferred by 77.7%, and these patients were significantly younger, more often cohabiting and tended to have higher level of education than paper SAQ users. Mean number of data missing per patient was less among the web SAQ users than the paper SAQ users (0.55 vs. 2.15, p questionnaires on internet platforms when internet access is common and available. Implications for Rehabilitation The high acceptability of web-based self-administered questionnaires among rehabilitation patients suggests that internet platforms are suitable tools to collect patient information for rehabilitation units. Web-based modes of patient data collection demonstrate low number of missing data and can therefore improve the quality of data collection from rehabilitation patients. Use of web-based questionnaires considerably reduces administrative costs of data collection in rehabilitation settings compared to traditional pen and paper methods.

Vocal problems among teachers: evaluation of a preventive voice program.

Science.gov (United States)

Bovo, Roberto; Galceran, Marta; Petruccelli, Joseph; Hatzopoulos, Stavros

2007-11-01

Vocal education programs for teachers may prevent the emergence of vocal disorders; however, only a few studies have tried to evaluate the effectiveness of these preventive programs, particularly in the long term. Two hundred and sixty-four subjects, mostly kindergarten and primary school female teachers, participated in a course on voice care, including a theoretical seminar (120 minutes) and a short voice group therapy (180 minutes, small groups of 20 subjects). For 3 months, they had to either attend the vocal ergonomics norms and, as psychological reinforcement, they had to make out a daily report of vocal abuse, or to follow the given exercises for a more efficient vocal technique, reporting on whether the time scheduled was respected or not. The effectiveness of the course was assessed in a group of 21 female teachers through a randomized controlled study. Evaluation comprehended stroboscopy, perceptual and electro-acoustical voice analysis, Voice Handicap Index, and a course benefit questionnaire. A group of 20 teachers matched for age, working years, hoarseness grade, and vocal demand served as a control group. At 3 months evaluation, participants demonstrated amelioration in the global dysphonia rates (P=0.0003), jitter (P=0.0001), shimmer (P=0.0001), MPT (P=0.0001), and VHI (P=0.0001). Twelve months after the course, the positive effects remained, although they were slightly reduced. In conclusion, a course inclusive of two lectures, a short group voice therapy, home-controlled voice exercises, and hygiene, represents a feasible and cost-effective primary prevention of voice disorders in a homogeneous and well-motivated population of teachers.

How to Train Safe Drivers: Setting Up and Evaluating a Fatigue Training Program

Directory of Open Access Journals (Sweden)

Adamos Giannis

2015-02-01

Full Text Available Fatigue is considered as a serious risk driving behavior, causing road accidents, which in many cases involve fatalities and severe injuries. According to CARE database statistics, professional drivers are indicated as a high-risk group to be involved in a fatigue-related accident. Acknowledging these statistics, a training program on driving fatigue was organized, aiming at raising awareness of professional drivers of a leading company in building materials, in Greece. Selected experimental methods were used for collecting data before and after the training program, which allowed monitoring and assessing the potential behavioural changes. A questionnaire survey was conducted before the program implementation to 162 drivers of the company, while two months after the program, the same drivers replied to a second questionnaire. Impact assessment of the program relied on statistical analysis of the responses. Results showed the degree of penetration of the training program in the professional drivers' behavior towards safe driving.

The Value in Evaluating and Communicating Program Impact: The Ohio BR&E Program

Science.gov (United States)

Daivs, Gregory

2012-01-01

Assessing program impact can provide useful program evaluation data. It also provides a basis for program development, marketing, and justification. This article discusses recent impact evaluation efforts and findings of a long-time Extension program; referred to as Business Retention and Expansion (BR&E). How such information can be…

Evaluation of the effectiveness of a school-based cannabis prevention program.

Science.gov (United States)

Ariza, Carles; Pérez, Anna; Sánchez-Martínez, Francesca; Diéguez, Marta; Espelt, Albert; Pasarín, M Isabel; Suelves, Josep M; De la Torre, Rafael; Nebot, Manuel

2013-09-01

The effectiveness of a cannabis prevention program in high school students was assessed. A quasi-experimental study was designed to evaluate the effectiveness of an intervention implemented in an intervention group (IG) with 39 schools compared with a control group (CG) of 47 schools not exposed to the intervention. Of 224 secondary schools in Barcelona, 86 were assessed in the 2005-2006 school year through a personal questionnaire administered at baseline and 15 months after the intervention. Participants consisted of 4848 ninth graders (14-15 year-olds), 2803 assigned to the IG and 2043 to the CG, according to the type and size of the school and the socioeconomic status of the school's neighborhood. The intervention consisted of a school-based cannabis prevention program (xkpts.com), with four sessions and 16 activities, implemented over 6-10h, with materials for parents and web-based student involvement. Last-month cannabis use was assessed at baseline and at 15 months' follow-up. Process evaluation indicators were assessed. At 15 months follow-up, 8.2% of boys and 8.3% of girls in the IG became last-month cannabis users versus 11.8% of boys and 11.6% of girls in the CG. These differences were statistically significant (p=0.003), representing a 29% reduction in last-month cannabis users in the IG compared with the CG. The incidence of last-month cannabis use was lowest in classrooms that adhered to the program protocol. The xkpts.com program was effective in preventing progression to last-month cannabis use. Effectiveness was higher in classrooms that adhered closely to the protocol. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Evaluation of the United States Support Program’s Internship and Junior Professional Officer Programs

Energy Technology Data Exchange (ETDEWEB)

Cruz J.; Patterson, J.; Pepper, S.

2012-07-15

The U.S. Support Program (USSP) to International Atomic Energy Agency (IAEA) Safeguards established a program of one-year paid internships for students and recent graduates. The program was in effect from 2002 until 2006 with a total of forty-one U.S. citizens and permanent residents placed in the IAEA. The USSP created a Junior Professional Officer (JPO) Program in 2005 that replaced the internship program at the IAEA. The JPO program creates opportunities for U.S. college graduates to become IAEA employees for a period of one to two years to help increase the effectiveness and efficiency of safeguards. The twenty three former and current JPOs work in varying fields such as software development, information collection and analysis, non-destructive analysis systems, and unattended monitoring systems. This paper will look at the impacts of the USSP internship and JPO program on the interns and JPOs, the U.S. government, and the IAEA. Academic backgrounds, past involvement in nuclear fields, program assessment, and post-program positions were recorded and analyzed through two studies using questionnaires sent to former interns and former and current JPOs. This paper will discuss the effects of the programs on the careers of the interns and JPOs, present the evaluations of the internship and JPO Programs, and report the recommendations for changes.

Process evaluation of two home-based bimanual training programs in children with unilateral cerebral palsy (the COAD-study): protocol for a mixed methods study.

Science.gov (United States)

Beckers, Laura; van der Burg, Jan; Janssen-Potten, Yvonne; Rameckers, Eugène; Aarts, Pauline; Smeets, Rob

2018-04-24

As part of the COAD-study two home-based bimanual training programs for young children with unilateral Cerebral Palsy (uCP) have been developed, both consisting of a preparation phase and a home-based training phase. Parents are coached to use either an explicit or implicit motor learning approach while teaching bimanual activities to their child. A process evaluation of these complex interventions is crucial in order to draw accurate conclusions and provide recommendations for implementation in clinical practice and further research. The aim of the process evaluation is to systematically assess fidelity of the home-based training programs, to examine the mechanisms that contribute to their effects on child-related and parent-related outcomes, and to explore the influence of contextual factors. A mixed methods embedded design is used that emerges from a pragmatism paradigm. The qualitative strand involves a generic qualitative approach. The process evaluation components fidelity (quality), dose delivered (completeness), dose received (exposure and satisfaction), recruitment and context will be investigated. Data collection includes registration of attendance of therapists and remedial educationalists to a course regarding the home-based training programs; a questionnaire to evaluate this course by the instructor; a report form concerning the preparation phase to be completed by the therapist; registration and video analyses of the home-based training; interviews with parents and questionnaires to be filled out by the therapist and remedial educationalist regarding the process of training; and focus groups with therapists and remedial educationalists as well as registration of drop-out rates and reasons, to evaluate the overall home-based training programs. Inductive thematic analysis will be used to analyse qualitative data. Qualitative and quantitative findings are merged through meta-inference. So far, effects of home-based training programs in paediatric

School Health: Findings from Evaluated Programs.

Science.gov (United States)

Public Health Service (DHHS), Rockville, MD. Office of Disease Prevention and Health Promotion.

This publication presents findings from evaluations of many school health programs from across the United States. Each program includes at least one of the following eight components of a comprehensive school health program: health education, clinical services, counseling and mental health services, school environment, school food programs,…

Summary of Program Evaluation Results: 1985-1986 School Year Pre-Kindergarten Educational Program.

Science.gov (United States)

Heath, Robert W.; And Others

Reported are findings of the 1985-86 program evaluation of the prenatal-to-preschool and preschool programs operating under the auspices of the Kamehameha Schools/Bishop Estate. Evaluation of the prenatal-to-preschool program (the Kupulani Program) included item analysis of the Questions about Pregnancy Test, development of a revised data…

Design and validation of a questionnaire to evaluate the usability of computerized critical care information systems.

Science.gov (United States)

von Dincklage, Falk; Lichtner, Gregor; Suchodolski, Klaudiusz; Ragaller, Maximilian; Friesdorf, Wolfgang; Podtschaske, Beatrice

2017-08-01

The implementation of computerized critical care information systems (CCIS) can improve the quality of clinical care and staff satisfaction, but also holds risks of disrupting the workflow with consecutive negative impacts. The usability of CCIS is one of the key factors determining their benefits and weaknesses. However, no tailored instrument exists to measure the usability of such systems. Therefore, the aim of this study was to design and validate a questionnaire that measures the usability of CCIS. Following a mixed-method design approach, we developed a questionnaire comprising two evaluation models to assess the usability of CCIS: (1) the task-specific model rates the usability individually for several tasks which CCIS could support and which we derived by analyzing work processes in the ICU; (2) the characteristic-specific model rates the different aspects of the usability, as defined by the international standard "ergonomics of human-system interaction". We tested validity and reliability of the digital version of the questionnaire in a sample population. In the sample population of 535 participants both usability evaluation models showed a strong correlation with the overall rating of the system (multiple correlation coefficients ≥0.80) as well as a very high internal consistency (Cronbach's alpha ≥0.93). The novel questionnaire is a valid and reliable instrument to measure the usability of CCIS and can be used to study the influence of the usability on their implementation benefits and weaknesses.

Multimedia messages in genetics: design, development, and evaluation of a computer-based instructional resource for secondary school students in a Tay Sachs disease carrier screening program.

Science.gov (United States)

Gason, Alexandra A; Aitken, MaryAnne; Delatycki, Martin B; Sheffield, Edith; Metcalfe, Sylvia A

2004-01-01

Tay Sachs disease is a recessively inherited neurodegenerative disorder, for which carrier screening programs exist worldwide. Education for those offered a screening test is essential in facilitating informed decision-making. In Melbourne, Australia, we have designed, developed, and evaluated a computer-based instructional resource for use in the Tay Sachs disease carrier screening program for secondary school students attending Jewish schools. The resource entitled "Genetics in the Community: Tay Sachs disease" was designed on a platform of educational learning theory. The development of the resource included formative evaluation using qualitative data analysis supported by descriptive quantitative data. The final resource was evaluated within the screening program and compared with the standard oral presentation using a questionnaire. Knowledge outcomes were measured both before and after either of the educational formats. Data from the formative evaluation were used to refine the content and functionality of the final resource. The questionnaire evaluation of 302 students over two years showed the multimedia resource to be equally effective as an oral educational presentation in facilitating participants' knowledge construction. The resource offers a large number of potential benefits, which are not limited to the Tay Sachs disease carrier screening program setting, such as delivery of a consistent educational message, short delivery time, and minimum financial and resource commitment. This article outlines the value of considering educational theory and describes the process of multimedia development providing a framework that may be of value when designing genetics multimedia resources in general.

Evaluating programs that address ideological issues: ethical and practical considerations for practitioners and evaluators.

Science.gov (United States)

Lieberman, Lisa D; Fagen, Michael C; Neiger, Brad L

2014-03-01

There are important practical and ethical considerations for organizations in conducting their own, or commissioning external, evaluations and for both practitioners and evaluators, when assessing programs built on strongly held ideological or philosophical approaches. Assessing whether programs "work" has strong political, financial, and/or moral implications, particularly when expending public dollars, and may challenge objectivity about a particular program or approach. Using a case study of the evaluation of a school-based abstinence-until-marriage program, this article discusses the challenges, lessons learned, and ethical responsibilities regarding decisions about evaluation, specifically associated with ideologically driven programs. Organizations should consider various stakeholders and views associated with their program to help identify potential pitfalls in evaluation. Once identified, the program or agency needs to carefully consider its answers to two key questions: Do they want the answer and are they willing to modify the program? Having decided to evaluate, the choice of evaluator is critical to assuring that ethical principles are maintained and potential skepticism or criticism of findings can be addressed appropriately. The relationship between program and evaluator, including agreements about ownership and eventual publication and/or promotion of data, should be addressed at the outset. Programs and organizations should consider, at the outset, their ethical responsibility when findings are not expected or desired. Ultimately, agencies, organizations, and programs have an ethical responsibility to use their data to provide health promotion programs, whether ideologically founded or not, that appropriately and effectively address the problems they seek to solve.

Initial evaluation of the Robert Wood Johnson Foundation Nurse Faculty Scholars program.

Science.gov (United States)

Hickey, Kathleen T; Hodges, Eric A; Thomas, Tami L; Coffman, Maren J; Taylor-Piliae, Ruth E; Johnson-Mallard, Versie M; Goodman, Janice H; Jones, Randy A; Kuntz, Sandra; Galik, Elizabeth; Gates, Michael G; Casida, Jesus M

2014-01-01

The Robert Wood Johnson Foundation Nurse Faculty Scholars (RWJF NFS) program was developed to enhance the career trajectory of young nursing faculty and to train the next generation of nurse scholars. Although there are publications that describe the RWJF NFS, no evaluative reports have been published. The purpose of this study was to evaluate the first three cohorts (n = 42 scholars) of the RWJF NFS program. A descriptive research design was used. Data were derived from quarterly and annual reports, and a questionnaire (seven open-ended questions) was administered via Survey Monkey Inc. (Palo Alto, CA, USA). During their tenure, scholars had on average six to seven articles published, were teaching/mentoring at the graduate level (93%), and holding leadership positions at their academic institutions (100%). Eleven scholars (26%) achieved fellowship in the American Academy of Nursing, one of the highest nursing honors. The average ratings on a Likert scale of 1 (not at all supportive) to 10 (extremely supportive) of whether or not RWJF had helped scholars achieve their goals in teaching, service, research, and leadership were 7.7, 8.0, 9.4, and 9.5, respectively. The majority of scholars reported a positive, supportive relationship with their primary nursing and research mentors; although, several scholars noted challenges in connecting for meetings or telephone calls with their national nursing mentors. These initial results of the RWJF NFS program highlight the success of the program in meeting its overall goal-preparing the next generation of nursing academic scholars for leadership in the profession. Copyright © 2014 Elsevier Inc. All rights reserved.

Validation of a simplified food frequency questionnaire for the assessment of dietary habits in Iranian adults: Isfahan Healthy Heart Program, Iran.

Science.gov (United States)

Mohammadifard, Noushin; Sajjadi, Firouzeh; Maghroun, Maryam; Alikhasi, Hassan; Nilforoushzadeh, Farzaneh; Sarrafzadegan, Nizal

2015-03-01

Dietary assessment is the first step of dietary modification in community-based interventional programs. This study was performed to validate a simple food frequency questionnaire (SFFQ) for assessment of selected food items in epidemiological studies with a large sample size as well as community trails. This validation study was carried out on 264 healthy adults aged ≥ 41 years old living in 3 district central of Iran, including Isfahan, Najafabad, and Arak. Selected food intakes were assessed using a 48-item food frequency questionnaire (FFQ). The FFQ was interviewer-administered, which was completed twice; at the beginning of the study and 2 weeks thereafter. The validity of this SFFQ was examined compared to estimated amount by single 24 h dietary recall and 2 days dietary record. Validation of the FFQ was determined using Spearman correlation coefficients between daily frequency consumption of food groups as assessed by the FFQ and the qualitative amount of daily food groups intake accessed by dietary reference method was applied to evaluate validity. Intraclass correlation coefficients (ICC) were used to determine the reproducibility. Spearman correlation coefficient between the estimated amount of food groups intake by examined and reference methods ranged from 0.105 (P = 0.378) in pickles to 0.48 (P studies and clinical trial with large participants.

Strategies for Evaluating Complex Environmental Education Programs

Science.gov (United States)

Williams, V.

2011-12-01

Evidence for the effectiveness of environmental education programs has been difficult to establish for many reasons. Chief among them are the lack of clear program objectives and an inability to conceptualize how environmental education programs work. Both can lead to evaluations that make claims that are difficult to substantiate, such as significant changes in student achievement levels or behavioral changes based on acquisition of knowledge. Many of these challenges can be addressed by establishing the program theory and developing a logic model. However, claims of impact on larger societal outcomes are difficult to attribute solely to program activities. Contribution analysis may offer a promising method for addressing this challenge. Rather than attempt to definitively and causally link a program's activities to desired results, contribution analysis seeks to provide plausible evidence that can reduce uncertainty regarding the 'difference' a program is making to observed outcomes. It sets out to verify the theory of change behind a program and, at the same time, takes into consideration other influencing factors. Contribution analysis is useful in situations where the program is not experimental-there is little or no scope for varying how the program is implemented-and the program has been funded on the basis of a theory of change. In this paper, the author reviews the feasibility of using contribution analysis as a way of evaluating the impact of the GLOBE program, an environmental science and education program. Initially conceptualized by Al Gore in 1995, the program's implementation model is based on worldwide environmental monitoring by students and scientists around the globe. This paper will make a significant and timely contribution to the field of evaluation, and specifically environmental education evaluation by examining the usefulness of this analysis for developing evidence to assess the impact of environmental education programs.

Validity and responsiveness of a self-administered foot evaluation questionnaire in rheumatoid arthritis.

Science.gov (United States)

Yano, Koichiro; Ikari, Katsunori; Ochi, Kensuke; Ishida, Osamu; Sakuma, Yu; Yoshida, Shinji; Koyama, Takuma; Koenuma, Naoko; Momohara, Shigeki

2015-05-01

A self-administered foot evaluation questionnaire (SAFE-Q) was developed by the Japanese Society for Surgery of the Foot (JSSF). The aim of this study is to evaluate the validity and responsiveness of the SAFE-Q in patients with rheumatoid arthritis (RA). In total, 180 patients with RA answered the SAFE-Q. Of 180 patients, 34 answered the SAFE-Q twice, preoperatively and postoperatively, to assess responsiveness. Construct validity was tested by comparing the 5 SAFE-Q subscales and the JSSF standard rating system for the RA foot and ankle scale (JSSF-RA), a Japanese version of the Health Assessment Questionnaire (JHAQ), disease activity score in 28 joints (DAS28), simplified disease activity index (SDAI), and clinical disease activity index (CDAI). Responsiveness was examined by calculating the standardized response mean (SRM) and effect size (ES) 3 months after surgery. There were moderate correlations between the SAFE-Q and the JSSF-RA and JHAQ. Conversely, a low correlation was observed between the SAFE-Q and DAS28, SDAI, and CDAI. The responsiveness was high, with an SRM of 0.9 and ES of 0.7 for pain subscales. SAFE-Q is a useful tool for assessing the foot and ankle in RA patients.

The Groningen Radiotherapy-Induced Xerostomia questionnaire: Development and validation of a new questionnaire

International Nuclear Information System (INIS)

Beetz, Ivo; Burlage, Fred R.; Bijl, Henk P.; Hoegen-Chouvalova, Olga; Christianen, Miranda E.M.C.; Vissink, Arjan; Laan, Bernard F.A.M. van der; Bock, Geertruida H. de; Langendijk, Johannes A.

2010-01-01

Purpose: The purpose of this study was to develop and validate a questionnaire (Groningen Radiotherapy-Induced Xerostomia (GRIX) questionnaire) that has the ability to distinguish between patient-rated xerostomia during day and night and can be used to evaluate the impact of emerging radiation delivery techniques aiming at prevention of xerostomia in more detail. Materials and methods: All questions in the GRIX were generated from an exhaustive list of relevant questions according to xerostomia as reported in the literature and reported by patients and health care providers. Finally the GRIX was reduced from 56 questions to a 14-item questionnaire, with four subscales; xerostomia during day and night and sticky saliva during day and night. 315 patients filled out 2936 questionnaires and the GRIX was evaluated by calculating Crohnbach's α for all subscales. Criterion validity was evaluated to compare the GRIX with patient-rated xerostomia scored with the EORTC QLQ-HN35 and physician-rated xerostomia, test-retest analysis and responsiveness were also tested. Results: Crohnbach's α varied for all subscales between 0.88 and 0.94. The GRIX scored well for criterion-related validity on all subscales with high correlations with the EORTC QLQ-HN35 xerostomia and sticky saliva scale as well with physician-rated toxicity scoring. No significant differences were found between test and retest score and the GRIX showed good responsiveness with different time points for all subscales. Conclusion: The GRIX is a validated questionnaire which can be used in future research focusing on patient-rated xerostomia and sticky saliva during day and night in relation with the impact of emerging radiation delivery techniques aiming at reduction of xerostomia.

Connect: An Effective Community-Based Youth Suicide Prevention Program

Science.gov (United States)

Bean, Gretchen; Baber, Kristine M.

2011-01-01

Youth suicide prevention is an important public health issue. However, few prevention programs are theory driven or systematically evaluated. This study evaluated Connect, a community-based youth suicide prevention program. Analysis of pre and posttraining questionnaires from 648 adults and 204 high school students revealed significant changes in…

The advanced test reactor strategic evaluation program

International Nuclear Information System (INIS)

Buescher, B.J.

1989-01-01

Since the Chernobly accident, the safety of test reactors and irradiation facilities has been critically evaluated from the public's point of view. A systematic evaluation of all safety, environmental, and operational issues must be made in an integrated manner to prioritize actions to maximize benefits while minimizing costs. Such a proactive program has been initiated at the Advanced Test Reactor (ATR). This program, called the Strategic Evaluation Program (STEP), is being conducted for the ATR to provide integrated safety and operational reviews of the reactor against the standards applied to licensed commercial power reactors. This has taken into consideration the lessons learned by the US Nuclear Regulatory Commission (NRC) in its Systematic Evaluation Program (SEP) and the follow-on effort known as the Integrated Safety Assessment Program (ISAP). The SEP was initiated by the NRC to review the designs of older operating nuclear power plants to confirm and document their safety. The ATR STEP objectives are discussed

A Qualitative Program Evaluation of a Structured Leadership Mentoring Program at a Large Aerospace Corporation

Science.gov (United States)

Teller, Romney P.

2011-01-01

The researcher utilized a qualitative approach to conduct a program evaluation of the organization where he is employed. The study intended to serve as a program evaluation for the structured in-house mentoring program at a large aerospace corporation (A-Corp). This program evaluation clarified areas in which the current mentoring program is…

Evaluation of a Workplace-Based Migraine Education Program.

Science.gov (United States)

Burton, Wayne N; Chen, Chin-Yu; Li, Xingquan; McCluskey, Maureen; Erickson, Denise; Schultz, Alyssa B

2016-08-01

Migraine affects approximately 10% of working-age adults and is associated with increased health care costs, absenteeism, and presenteeism in the workplace. A migraine education program was offered to United States employees of a global financial services organization. Two hundred forty three employees (46% response rate) completed both a baseline and 6-month follow-up migraine questionnaire. The program included webinars, E-mailed educational tips, and intranet-based resources. No change was found in the frequency of migraines but improvements were observed in the severity, workdays missed, effectiveness at work during migraine, and work/activity limitations. Participants reported taking action to identify and reduce migraine triggers. A worksite disease education program for migraine headache has the potential to significantly impact lost productivity and absenteeism for migraineurs.

Feasibility testing of smart tablet questionnaires compared to paper questionnaires in an amputee rehabilitation clinic.

Science.gov (United States)

Payne, Michael; Janzen, Shannon; Earl, Eric; Deathe, Barry; Viana, Ricardo

2017-08-01

Capturing the variability that exists among patients attending an amputee clinic using standardized paper-based questionnaires is time-consuming and may not be practical for routine clinical use. Electronic questionnaires are a potential solution; however, the benefits are dependent on the feasibility and acceptance of this mode of data collection among patients. To determine the feasibility and patient preference/comfort in using a tablet-based questionnaire for data collection in an outpatient amputee rehabilitation clinic compared to a traditional paper-based questionnaire. Observational study. In all, 48 patients with major extremity amputations completed both tablet and paper questionnaires related to their amputation and prosthetic use. Both trials were timed; patients then completed a semi-structured questionnaire about their experience. In all, 20.5% of patients needed hands-on assistance completing the paper questionnaire compared to 20.8% for the tablet. The majority of participants (52.1%) indicated a preference for the tablet questionnaire; 64.6% of patients felt the tablet collected a more complete and accurate representation of their status and needs. In all, 70.8% of participants described themselves as comfortable using the tablet. Despite comorbidities, patients with amputations demonstrated excellent acceptance of the electronic tablet-based questionnaire. Tablet questionnaires have significant potential advantages over paper questionnaires and should be further explored. Clinical relevance A custom electronic questionnaire was found to be beneficial for routine clinic use and was well received by patients in an amputee rehabilitation clinic. Development of such questionnaires can provide an efficient mechanism to collect meaningful data that can be used for individual patient care and program quality improvement initiatives.

Cervical screening program and the psychological impact of an abnormal Pap smear: a self-assessment questionnaire study of 590 patients.

Science.gov (United States)

Thangarajah, Fabinshy; Einzmann, Thomas; Bergauer, Florian; Patzke, Jan; Schmidt-Petruschkat, Silke; Theune, Monika; Engel, Katja; Puppe, Julian; Richters, Lisa; Mallmann, Peter; Kirn, Verena

2016-02-01

Invasive cervical cancer is today the fourth most common cancer of women in western civilization. Screening programs have led to a continuously decrease. Nevertheless, both screening and a positive test result are known to be associated with a negative psychological impact. Screening programs in European countries differ and thus psychological impact might as well. The aim of this study was to evaluate the psychological impact of women with an abnormal Pap smear in a German cohort. Between July 2013 and May 2014, a self-assessment questionnaire was distributed to 595 patients that were referred to a special clinic for cervical dysplasia for further evaluation of an abnormal Pap smear. Patients were recruited in five different centers. Most patients (45.9 %) were informed about the test result via phone call by their doctor. 68.8 % of the patients felt anxious and 26.3 % even felt panic. After having talked to their physician, 51.4 % of our cohort still felt worried and only 24.4 % felt reassured. Concerning disease management, 48.4 % underwent a control Pap smear in 6 months. The preferred information source was the physician (63.9 %). Compared to the results in other European countries, our study cohort showed differences concerning age distribution, patients living in a partnership, number of children and especially disease management. Cancer screening itself and abnormal test results have an impact on patient's feelings. To reduce the psychological impact, patients need to be better informed about the risks and benefits of cancer screening programs and in case of cervical cancer screening about the meaning of an abnormal test result. Our results underline the importance of a trustful physician-patient relationship in that matter.

The Meal Pattern Questionnaire: A psychometric evaluation using the Eating Disorder Examination.

Science.gov (United States)

Alfonsson, S; Sewall, A; Lidholm, H; Hursti, T

2016-04-01

Meal pattern is an important variable in both obesity treatment and treatment for eating disorders. Momentary assessment and eating diaries are highly valid measurement methods but often cumbersome and not always feasible to use in clinical practice. The aim of this study was to design and evaluate a self-report instrument for measuring meal patterns. The Pattern of eating item from the Eating Disorder Examination (EDE) interview was adapted to self-report format to follow the same overall structure as the Eating Disorder Examination Questionnaire. The new instrument was named the Meal Patterns Questionnaire (MPQ) and was compared with the EDE in a student sample (n=105) and an obese sample (n=111). The individual items of the MPQ and the EDE showed moderate to high correlations (rho=.63-89) in the two samples. Significant differences between the MPQ and EDE were only found for two items in the obese sample. The total scores correlated to a high degree (rho=.87/.74) in both samples and no significant differences were found in this variable. The MPQ can provide an overall picture of a person's eating patterns and is a valid way to collect data regarding meal patterns. The MPQ may be a useable tool in clinical practice and research studies when more extensive instruments cannot be used. Future studies should evaluate the MPQ in diverse cultural populations and with more ecological assessment methods. Copyright © 2015 Elsevier Ltd. All rights reserved.

Strategies for Evaluating a Freshman Studies Program.

Science.gov (United States)

Ketkar, Kusum; Bennett, Shelby D.

1989-01-01

The study developed an economic model for the evaluation of Seaton Hall University's freshman studies program. Two techniques used to evaluate the economic success of the program are break-even analysis and elasticity coefficient. (Author/MLW)

Building capacity for water, sanitation, and hygiene programming: Training evaluation theory applied to CLTS management training in Kenya.

Science.gov (United States)

Crocker, Jonny; Shields, Katherine F; Venkataramanan, Vidya; Saywell, Darren; Bartram, Jamie

2016-10-01

Training and capacity building are long established critical components of global water, sanitation, and hygiene (WaSH) policies, strategies, and programs. Expanding capacity building support for WaSH in developing countries is one of the targets of the Sustainable Development Goals. There are many training evaluation methods and tools available. However, training evaluations in WaSH have been infrequent, have often not utilized these methods and tools, and have lacked rigor. We developed a conceptual framework for evaluating training in WaSH by reviewing and adapting concepts from literature. Our framework includes three target outcomes: learning, individual performance, and improved programming; and two sets of influences: trainee and context factors. We applied the framework to evaluate a seven-month community-led total sanitation (CLTS) management training program delivered to 42 government officials in Kenya from September 2013 to May 2014. Trainees were given a pre-training questionnaire and were interviewed at two weeks and seven months after initial training. We qualitatively analyzed the data using our conceptual framework. The training program resulted in trainees learning the CLTS process and new skills, and improving their individual performance through application of advocacy, partnership, and supervision soft skills. The link from trainees' performance to improved programming was constrained by resource limitations and pre-existing rigidity of trainees' organizations. Training-over-time enhanced outcomes and enabled trainees to overcome constraints in their work. Training in soft skills is relevant to managing public health programs beyond WaSH. We make recommendations on how training programs can be targeted and adapted to improve outcomes. Our conceptual framework can be used as a tool both for planning and evaluating training programs in WaSH. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Industrial Assessment Center Program Impact Evaluation

Energy Technology Data Exchange (ETDEWEB)

Martin, M.A.

2000-01-26

This report presents the results of an evaluation of the U.S. Department of Energy's Industrial Assessment Center (IAC) Program. The purpose of this program is to conduct energy, waste, and productivity assessments for small to medium-sized industrial firms. Assessments are conducted by 30 university-based industrial assessment centers. The purpose of this project was to evaluate energy and cost savings attributable to the assessments, the trained alumni, and the Websites sponsored by this program. How IAC assessments, alumni, and Web-based information may influence industrial energy efficiency decision making was also studied. It is concluded that appreciable energy and cost savings may be attributed to the IAC Program and that the IAC Program has resulted in more active and improved energy-efficiency decision making by industrial firms.

Handbook of evaluation of utility DSM programs

Energy Technology Data Exchange (ETDEWEB)

Hirst, E.; Reed, J. [eds.; Bronfman, B.; Fitzpatrick, G.; Hicks, E.; Hirst, E.; Hoffman, M.; Keating, K.; Michaels, H.; Nadel, S.; Peters, J.; Reed, J.; Saxonis, W.; Schoen, A.; Violette, D.

1991-12-01

Program evaluation has become a central issue in the world of utility integrated resource planning. The DSM programs that utilities were operating to meet federal requirements or to improve customer relations are now becoming big business. DSM is being considered an important resource in a utility`s portfolio of options. In the last five years, the amount of money that utilities have invested in DSM has grown exponentially in most regulatory jurisdictions. Market analysts are now talking about DSM being a $30 billion industry by the end of the decade. If the large volume of DSM-program investments was not enough to highlight the importance of evaluation, then the introduction of regulatory incentives has really focused the spotlight. This handbook was developed through a process that involved many of those people who represent the diverse constituencies of DSM-program evaluation. We have come to recognize the many technical disciplines that must be employed to evaluate DSM programs. An analysis might start out based on the principles of utility load research to find out what happened, but a combination of engineering and statistical methods must be used to ``triangulate`` an estimate of what would have happened without the program. The difference, of course, is that elusive but prized result of evaluation: what happened as the direct result of the DSM program. Technical performance of DSM measures is not the sole determinant of the answer, either. We also recognize the importance of such behavioral attributes of DSM as persistence and free ridership. Finally, DSM evaluation is meaningless without attention to planning an approach, communicating results to relevant decision-makers, and focusing as much on the process as the impacts of the program. These topics are all covered in this handbook.

[Evaluation of a grant program for improving health and safety in small and medium companies in Andalusia (Spain)].

Science.gov (United States)

Carrillo Castrillo, Jesús Antonio; Onieva Giménez, Luis; Ruiz Frutos, Carlos

2012-01-01

To evaluate a grant program for the development and support of occupational safety projects in small and medium companies (SMC) in Andalusia. The analysis includes data and results of the program between 2006 and 2008. We analyzed the program characteristics in terms of budget, proposals submitted and projects financed. The views of participating companies regarding the program were evaluated through a voluntary and anonymous postal survey. Occupational injury rates in 2006 and 2007 in a subgroup of companies that had obtained a grant in 2006 were calculated. Public investment in the program (> 17 million euros) covered 44% of the investment in occupational health projects proposed by participating companies. Nearly 50% of the projects presented received grant funding. The survey was completed by 573 companies (24% of the submitted questionnaires). Among grantee companies, 89% considered the investment to have been effective and 87% considered that working conditions in the company had improved. Most of the companies (>90%) considered that lack of economic resources is an obstacle for prevention activities and that these kinds of public subsidies are necessary. Occupational injury rates decreased between 2006 and 2007 (incidence rate 0.93; 95%confidence interval, 0.78-1.11). The grant program was viewed positively by participating companies and was accompanied by a reduction of occupational injury rates among grantee companies. These programs should incorporate evaluation criteria and indicators in their design. Copyright belongs to the Societat Catalana de Seguretat i Medicina del Treball.

Development of a cohesion questionnaire for youth: the Youth Sport Environment Questionnaire.

Science.gov (United States)

Eys, Mark; Loughead, Todd; Bray, Steven R; Carron, Albert V

2009-06-01

The purpose of the current study was to initiate the development of a psychometrically sound measure of cohesion for youth sport groups. A series of projects were undertaken in a four-phase research program. The initial phase was designed to garner an understanding of how youth sport group members perceived the concept of cohesion through focus groups (n = 56), open-ended questionnaires (n = 280), and a literature review. In Phase 2, information from the initial projects was used in the development of 142 potential items and content validity was assessed. In Phase 3, 227 participants completed a revised 87-item questionnaire. Principal components analyses further reduced the number of items to 17 and suggested a two-factor structure (i.e., task and social cohesion dimensions). Finally, support for the factorial validity of the resultant questionnaire was provided through confirmatory factor analyses with an independent sample (n = 352) in Phase 4. The final version of the questionnaire contains 16 items that assess task and social cohesion in addition to 2 negatively worded spurious items. Specific issues related to assessing youth perceptions of cohesion are discussed and future research directions are suggested.

Course evaluation questionnaire

International Nuclear Information System (INIS)

2011-01-01

This report evaluates the issues related to a radiological emergency and that the participants consider relevant such as: principles and response, emergency management, procedures for fist responders, radiation protection of workers, medical emergency, security, exercises and simulation

Developmental Kindergarten Program Evaluation Report.

Science.gov (United States)

Blois, George T.; Cushing, Katherine S.

The evaluation of the Developmental Kindergarten (DK) Program at the Harrison School District #2, Colorado Springs, Colorado, involved pre- and post-testing of student academic gains and interviewing of principals and teachers. The program aimed to provide developmentally appropriate activities for students believed to be "at risk" of…

Evaluating Educational Programs. ERIC Digest Series Number EA 54.

Science.gov (United States)

Beswick, Richard

In this digest, readers are introduced to the scope of instructional program evaluation and evaluators' changing roles in school districts. A program evaluation measures outcomes based on student-attainment goals, implementation levels, and external factors such as budgetary restraints and community support. Instructional program evaluation may be…

Evaluation of Enova's heating programs; Evaluering av Enovas varmeprogrammer

Energy Technology Data Exchange (ETDEWEB)

Rasmussen, Ingeborg; Grorud, Christian; Heldal, Nicolai; Trong, Maj Dang

2006-07-01

An evaluation of Enova's heating program is presented. The central point was to evaluate to which degree Enova's heating program had resulted in increased supply of renewable energy for heating purposes to the Norwegian energy system. Main results are presented in part 1, chapter 1 to 5, while the facts and analyses behind the evaluation are presented in part 2, chapter I to VII. The main conclusion is that the program seen as one has had triggering effect on the market. The program has thus provided results in the form of increased supply of heating energy. Because of the project limitations and the lack of systematically documented baselines in the procedures, there are insecurities connected to the exact data registered. This makes quantification of the results difficult (ml)

[Validation of the Polish version of The Authentic Leadership Questionnaire for the of evaluation purpose of nursing management staff in national hospital wards].

Science.gov (United States)

Sierpińska, Lidia

2013-09-01

The Authentic Leadership Questionnaire (ALQ) is a standardized research instrument for the evaluation of individual elements of leader's conduct which contribute to the authentic leadership. The application of this questionnaire in Polish conditions required to carry out the validation process. The aim of the study was to evaluate of validity and reliability of the Polish version of the American research instrument for the needs of evaluation of authenticity of leadership of the nursing management in Polish hospitals. The study covered 286 nurses (143 head nurses and 143 of their subordinates) employed in 45 hospitals in Poland. Theoretical validity of the instrument was evaluated using Fisher's transformation (r-Person correlation coefficient), while the criterion validity of the ALQ was evaluated using rho-Spearman correlation coefficient and the BOHIPSZO questionnaire. The reliability of the ALQ was assessed by means of the Cronbach-alpha coefficient. The ALQ questionnaire applied for the evaluation of authenticity of leadership of the nursing management in Polish hospital wards shows an acceptable theoretical and criterion validity and reliability (Cronbach-alpha coefficient 0.80). The Polish version of the ALQ is valid and reliable, and may be applied in studies concerning the evaluation of authenticity of leadership of the nursing management in Polish hospital wards.

Criteria to evaluate SAT-based training programs

International Nuclear Information System (INIS)

Arjona, O.; Venegas, M.; Rodriguez, L.; Lopez, M.

1997-01-01

This paper present some coefficients of error obtained to evaluate the quality of the design development and implementation of SAT-based personnel training programs. With the attainment of these coefficients, with the use of the GESAT system, is facilitated the continuos evaluation of training programs and the main deficiencies in the design, development and implementation of training programs are obtained, through the comparison between the program features and their standards or wanted features and doing an statistics analysis of the data kept in the GESAT system

Developing questionnaires for students′ evaluation of individual faculty′s teaching skills: A Saudi Arabian pilot study

OpenAIRE

Abdullah M Al-Rubaish; Sheikh Idris Abdel Rahim; Ammar Hassan; Amein Al Ali; Fatma Mokabel; Mohammed Hegazy; Ladé Wosornu

2010-01-01

Background: The National Commission for Academic Accreditation and Assessment is responsible for the academic accreditation of universities in the Kingdom of Saudi Arabia (KSA). Requirements for this include evaluation of teaching effectiveness, evidence-based conclusions, and external benchmarks. Aims: To develop a questionnaire for students’ evaluation of the teaching skills of individual instructors and provide a tool for benchmarking. Setting: College of Nursing, University of Dammam [UoD...

Development and Validation of a Theoretically Based, Multidimensional Questionnaire of Student Evaluation of University Teaching

Science.gov (United States)

Lemos, M. S.; Queiros, C.; Teixeira, P. M.; Menezes, I.

2011-01-01

The authors describe the development and validation of a multidimensional instrument of students' evaluation of university teaching (the Pedagogical Questionnaire of the University of Porto). The goal was to develop an instrument based on a sound psychometric analysis and simultaneously supported by the learning theory. Based on the data from 4875…

[Validation of a knowledge-questionnaire about asthma applied to teachers of elementary school of Monterrey, Mexico].

Science.gov (United States)

González Diaz, Sandra Nora; Cruz, Alfredo Arias; González González, Arya Yannel; Félix Berumen, José Alfredo; Weinmann, Alejandra Macías

2010-01-01

asthma is one of the most common chronic childhood diseases; is increasing in prevalence and an important cause of school absenteeism. Previous studies have failed to evaluate knowledge about asthma among elementary school teachers worldwide because of the lack of validated questionnaires. to validate a questionnaire about asthma knowledge for elementary school teachers in Monterrey, Nuevo Leon. an observational, cross sectional, descriptive study, from February to December 2004, by applying a questionnaire to a group of elementary school teachers in Monterrey, Nuevo Leon. The questionnaire is a translation and adaptation to the questionnaire of 13 questions used to assess the knowledge about asthma among parents, according to the National Asthma Education Program of US. a total of 179 questionnaires were applied, in which 6 of the 13 questions were answered correctly by more than 90% of the teachers. The internal consistency reliability was adequate with a Cronbach a coefficient of 0.75. in order to obtain reliable data using questionnaires, these must undergo a validation process. Our questionnaire got validation because of the reliability shown according to the internal consistency analysis.

Development and evaluation of the psychometric properties of the Adolescent Motor Competence Questionnaire (AMCQ) for Adolescents.

NARCIS (Netherlands)

Timler, Amanda; McIntyre, Fleur; Cantell, Marja; Crawford, Susan; Hands, Beth

2016-01-01

Background: There are no valid and reliable self-report measures designed to identify levelof motor competence and suspected motor difficulties among 12–18 year old adolescents.Aim: This paper reports the development and evaluation of a self-report questionnaire(Adolescent Motor Competence

Energy-efficient buildings program evaluations. Volume 1: Findings and recommendations

Energy Technology Data Exchange (ETDEWEB)

Lee, A.D.; Mayi, D.; Edgemon, S.D.

1997-04-01

This study was conducted for the US Department of Energy (DOE) by Pacific Northwest National Laboratory (PNNL). DOE operates the Building Standards and Guidelines Program (BSGP) to increase the effectiveness of building energy codes, standards, and guidelines. The main purpose of this report is to lay the groundwork for conducting an overall evaluation of the program and its effectiveness. Another purpose of this report is to summarize an extensive set of relevant evaluations and provide a building efficiency and program evaluation information resource for program designers, managers, and evaluators. This study presents information from 119 evaluations that have been conducted of both utility and code programs related to energy efficiency in new residential and commercial buildings. The authors used the information in these evaluations to identify major themes and lessons learned from utility and code programs. They also used the information to gain insights into appropriate evaluation methodologies and establish guidelines for designing future evaluations and an evaluation of the BSGP. The report presents general lessons about evaluating programs that have implications for future evaluations included the following. The evaluations provided the basis for developing an effective evaluation approach for residential building energy-efficiency codes and other energy-efficiency programs and other insights for conducting commercial building program evaluations. The findings for conducting effective evaluations are categorized by steps in the evaluation process.

Curated Collections for Educators: Five Key Papers about Program Evaluation.

Science.gov (United States)

Thoma, Brent; Gottlieb, Michael; Boysen-Osborn, Megan; King, Andrew; Quinn, Antonia; Krzyzaniak, Sara; Pineda, Nicolas; Yarris, Lalena M; Chan, Teresa

2017-05-04

The evaluation of educational programs has become an expected part of medical education. At some point, all medical educators will need to critically evaluate the programs that they deliver. However, the evaluation of educational programs requires a very different skillset than teaching. In this article, we aim to identify and summarize key papers that would be helpful for faculty members interested in exploring program evaluation. In November of 2016, the 2015-2016 Academic life in emergency medicine (ALiEM) Faculty Incubator program highlighted key papers in a discussion of program evaluation. This list of papers was augmented with suggestions by guest experts and by an open call on Twitter. This resulted in a list of 30 papers on program evaluation. Our authorship group then engaged in a process akin to a Delphi study to build consensus on the most important papers about program evaluation for medical education faculty. We present our group's top five most highly rated papers on program evaluation. We also summarize these papers with respect to their relevance to junior medical education faculty members and faculty developers. Program evaluation is challenging. The described papers will be informative for junior faculty members as they aim to design literature-informed evaluations for their educational programs.

The Nursing Leadership Institute program evaluation: a critique

Directory of Open Access Journals (Sweden)

Havaei F

2015-08-01

Full Text Available Farinaz Havaei, Maura MacPhee School of Nursing, University of British Columbia, Vancouver, BC, Canada Abstract: A theory-driven program evaluation was conducted for a nursing leadership program, as a collaborative project between university faculty, the nurses' union, the provincial Ministry of Health, and its chief nursing officers. A collaborative logic model process was used to engage stakeholders, and mixed methods approaches were used to answer evaluation questions. Despite demonstrated, successful outcomes, the leadership program was not supported with continued funding. This paper examines what happened during the evaluation process: What factors failed to sustain this program? Keywords: leadership development, theory-driven evaluation, mixed methods, collaborative logic modeling

The patient assessment questionnaire: a new instrument for evaluating the interpersonal skills of vocational dental practitioners.

Science.gov (United States)

Hurst, Y K; Prescott-Clements, L E; Rennie, J S

2004-10-23

This paper describes a pilot study aimed at evaluating a new instrument, the patient assessment questionnaire (PAQ), which uses patient ratings for the assessment of communication skills and professionalism in vocational practitioners (VDPs). The PAQ was developed as part of an assessment system designed to address all round competence. Acohort of 99 VDPs took part in the study. Questionnaires were distributed to consecutive patients in the general dental service at two time points in the training year. Data from the pilot study was analysed to determine whether the PAQ fulfilled the criteria for robust assessment. Results provide evidence of high levels of reliability, validity and feasibility of the PAQ instrument. All indications to date suggest that the PAQ will prove to be a valuable assessment tool. It is currently being evaluated as part of the system used to assess the all round competence of dental graduates undertaking vocational training in Scotland.

Cross-cultural differences in information disclosure evaluated through the EORTC questionnaires.

Science.gov (United States)

Arraras, Juan Ignacio; Greimel, Eva; Chie, Wei-Chu; Sezer, Orhan; Bergenmar, Mia; Costantini, Anna; Young, Teresa; Vlasic, Karin Kuljanic; Velikova, Galina

2013-02-01

Informational needs among cancer patients are similar, but the degree of information disclosure in different cultural areas varies. In this paper, we present the results of a cross-cultural study on information received. The EORTC information questionnaire, EORTC QLQ-INFO25, was administered during the treatment process. This questionnaire evaluates the information that patients report they have received. Cross-cultural differences in information have been evaluated using statistical tests such as Kruskall-Wallis and multivariate models with covariates to account for differences in clinical and demographic characteristics across areas. Four hundred and fifty-one patients from three cultural areas, North-Middle Europe, South Europe, and Taiwan, were included in the study. Significant differences among the three cultural areas appeared in eight QLQ-INFO25 dimensions: information about the disease; medical tests; places of care; written information; information on CD/tape/video; satisfaction; wish for more information; and information helpfulness. North-Middle Europe patients received more written information (mean = 67.2 (North) and 33.8 (South)) and South Europe patients received more information on different places of care (mean = 24.7 (North) and 35.0 (South)). Patients from North-Middle Europe and South Europe received more information than patients from Taiwan about the disease (mean = 57.9, 60.6, and 47.1, respectively) and medical tests (70.9, 70.4, and 54.5), showed more satisfaction (64.8, 70.2, and 35.0), and considered the information more helpful (71.9, 73.9, and 50.4). These results were confirmed when adjusting for age, education, and disease stage. There are cross-cultural differences in information received. Some of these differences are based on the characteristics of each culture. Copyright © 2011 John Wiley & Sons, Ltd.

Workplace nutrition knowledge questionnaire: psychometric validation and application.

Science.gov (United States)

Guadagnin, Simone C; Nakano, Eduardo Y; Dutra, Eliane S; de Carvalho, Kênia M B; Ito, Marina K

2016-11-01

Workplace dietary intervention studies in low- and middle-income countries using psychometrically sound measures are scarce. This study aimed to validate a nutrition knowledge questionnaire (NQ) and its utility in evaluating the changes in knowledge among participants of a Nutrition Education Program (NEP) conducted at the workplace. A NQ was tested for construct validity, internal consistency and discriminant validity. It was applied in a NEP conducted at six workplaces, in order to evaluate the effect of an interactive or a lecture-based education programme on nutrition knowledge. Four knowledge domains comprising twenty-three items were extracted in the final version of the NQ. Internal consistency of each domain was significant, with Kuder-Richardson formula values>0·60. These four domains presented a good fit in the confirmatory factor analysis. In the discriminant validity test, both the Expert and Lay groups scored>0·52, but the Expert group scores were significantly higher than those of the Lay group in all domains. When the NQ was applied in the NEP, the overall questionnaire scores increased significantly because of the NEP intervention, in both groups (Pnutrition knowledge among participants of NEP at the workplace. According to the NQ, an interactive nutrition education had a higher impact on nutrition knowledge than a lecture programme.

Questionnaire-based evaluation of everyday competence in older adults.

Science.gov (United States)

Kalisch, Tobias; Richter, Julia; Lenz, Melanie; Kattenstroth, Jan-Christoph; Kolankowska, Izabela; Tegenthoff, Martin; Dinse, Hubert R

2011-01-01

Gerontological research aims at understanding factors that are crucial for mediating "successful aging". This term denotes the absence of significant disease and disabilities, maintenance of high levels of physical and cognitive function, and preservation of social and productive activities. Preservation of an active lifestyle is considered an effective means through which everyday competence can be attained. In this context, it is crucial to obtain ratings of modern day older adults' everyday competence by means of appropriate assessments. Here, we introduce the Everyday Competence Questionnaire (ECQ), designed to assess healthy older adults' everyday competence. The ECQ includes 17 items, covering housekeeping, leisure activities, sports, daily routines, manual skills, subjective well-being, and general linguistic usage. The ECQ was administered to a population of 158 healthy subjects aged 60-91 years, who were divided into groups on the basis of their physical activity. These groups were community-dwelling subjects, those living independently and having a sedentary lifestyle, those living independently but characterized by a general lifestyle without any noteworthy physical activity, and those living independently and exercising regularly. Age, gender, and education levels were balanced between the groups. Using the ECQ, we could identify and distinguish different everyday competence levels between the groups tested: Subjects characterized by an active lifestyle outperformed all other groups. Subjects characterized by a general lifestyle showed higher everyday competence than those with a sedentary lifestyle or subjects who needed care. Furthermore, the ECQ data showed a significant positive correlation between individual physical activity and everyday competence. The ECQ is a novel tool for the questionnaire-based evaluation of everyday competence among healthy subjects. By including leisure activities, it considers the changed living conditions of modern

A process evaluation of a social cognitive theory-based childhood obesity prevention intervention: the Comics for Health program.

Science.gov (United States)

Branscum, Paul; Sharma, Manoj; Wang, Lihshing Leigh; Wilson, Bradley; Rojas-Guyler, Liliana

2013-03-01

Process evaluations are an often overlooked yet essential component of health promotion interventions. This study reports the results of a comprehensive process evaluation for the "Comics for Health" program, a childhood obesity prevention intervention implemented at 12 after-school programs. Qualitative and quantitative process data were collected using surveys, field notes, and open-item questionnaires, which assessed program fidelity, dose delivered, dose received, reach, recruitment, and context. Triangulation of methods was also employed to better understand how the program was implemented and received by the facilitator, staff members, and children in the program. Results indicated that program implementation had an almost perfect rate of fidelity with most lessons recording 100% tasks completed. Lessons were implemented in their intended order and lasted approximately 30 minutes as planned. After-school staff members reported that the program was well received by children, and this program should be replicated in the future. Attendance records showed that a majority of the children attended each lesson on the initial day of delivery (70.4%) and informal make-up lessons were implemented to compensate for the other children. Finally, several known sources of contamination were found such as past and concurrent exposure to similar health promotion interventions, which could potentially influence study outcomes. These findings will be used to help explain the results of this intervention and make recommendations for future intervention efforts.

Evaluation Of Career Guidance Program In Vocational High School

Directory of Open Access Journals (Sweden)

Martaningsih Sri Tutur

2018-01-01

This review of career guidance program evaluation is conducted qualitatively through surveys, interviews and leiterature studies to provide an overview of evaluation program and its relevance to the necessity. Understanding the quality, weaknesses, obstacles to service implementation, and potential utilization are expected to improve career guidance effectiveness services in vocational high school. An evaluation on the overall career guidance program, will provide feedback for ongoing improvement. Various evaluation models are available, it needs to be selected about the relevance to the career counseling program characteristics, so that evaluation feedback is more optimal.

An evaluative review of questionnaires recommended for the assessment of quality of life and symptom severity in women with urinary incontinence.

Science.gov (United States)

Hewison, Ann; McCaughan, Dorothy; Watt, Ian

2014-11-01

To provide an up-to-date assessment of the quality of commonly recommended questionnaires for measuring symptom severity and quality of life in women with urinary incontinence and also to consider their application to practice. Urinary incontinence is a common problem for women. In addition to various physical symptoms, there is a known effect on quality of life. Psychometrically robust questionnaires are reported to be the best way to measure an individual's perceptions of symptom severity and quality of life, and a number of different ones are recommended for use in international and national guidance, which can be confusing for clinicians. Moreover, there are concerns over the applicability of some of these instruments in clinical practice. An evaluative review was carried out examining selected questionnaires measuring symptom severity and/or quality of life. Selection of questionnaires for inclusion in the review was based on the recommendations of evidence-based guidance, followed by systematic scrutiny of the characteristics of the individual recommended questionnaires. Thirteen questionnaires were included in the review, of which three appeared to 'outperform' the remainder in terms of their psychometric properties and other characteristics. This review provides the most up-to-date and comprehensive analysis of the quality and applicability of the included questionnaires and offers the practitioner advice on which to select for use in practice. This review aims to help the practitioner choose a questionnaire based on a sound evaluation of the quality of the questionnaire and its applicability to the clinical setting. © 2013 John Wiley & Sons Ltd.

Independent Panel Evaluation of Dry Sludge PISA Program

International Nuclear Information System (INIS)

Fondeur, F.F.

1999-01-01

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program

Independent Panel Evaluation of Dry Sludge PISA Program

Energy Technology Data Exchange (ETDEWEB)

Fondeur, F.F.

1999-10-20

Dr. Kirk Yeager and Mr. Marvin Banks from Energetic Material Research and Technology Center (EMRTC) evaluated the Savannah River Site (SRS) efforts in the Dry Sludge program. They evaluated four program areas: energetic material formation, stability, initiation, and propagation. The panel evaluation included a site visit (July 13, 1999 and July 14, 1999) as well as a review of various reports and presentations by researchers involved in the program.

Development and evaluation of a leadership training program for public health emergency response: results from a Chinese study

Directory of Open Access Journals (Sweden)

Xu Yihua

2008-10-01

Full Text Available Abstract Background Since the 9/11 attack and severe acute respiratory syndrome (SARS, the development of qualified and able public health leaders has become a new urgency in building the infrastructure needed to address public health emergencies. Although previous studies have reported that the training of individual leaders is an important approach, the systemic and scientific training model need further improvement and development. The purpose of this study was to develop, deliver, and evaluate a participatory leadership training program for emergency response. Methods Forty-one public health leaders (N = 41 from five provinces completed the entire emergency preparedness training program in China. The program was evaluated by anonymous questionnaires and semi-structured interviews held prior to training, immediately post-training and 12-month after training (Follow-up. Results The emergency preparedness training resulted in positive shifts in knowledge, self-assessment of skills for public health leaders. More than ninety-five percent of participants reported that the training model was scientific and feasible. Moreover, the response of participants in the program to the avian influenza outbreak, as well as the planned evaluations for this leadership training program, further demonstrated both the successful approaches and methods and the positive impact of this integrated leadership training initiative. Conclusion The emergency preparedness training program met its aims and objectives satisfactorily, and improved the emergency capability of public health leaders. This suggests that the leadership training model was effective and feasible in improving the emergency preparedness capability.

The Practice of Health Program Evaluation.

Science.gov (United States)

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

An individual rehabilitation program: evaluation by Parkinsonian patients and their physiotherapists.

Science.gov (United States)

Ory Magne, F; Fabre, N; Gu, C; Pastorelli, C; Tardez, S; Marchat, J-C; Marque, P; Brefel Courbon, C

2014-11-01

The purpose of this work was to study the feasibility of an individual Parkinson disease (PD) rehabilitation program based on each patient's prevalent symptoms and to determine the effects of this program on patient's quality of life as well as the level of patient's and physiotherapist's satisfaction with the program. In association with physiotherapists with expertise in PD, a physical medicine and rehabilitation physician, we elaborated a physical therapy program based on the core areas for physical therapy in PD: transfers; posture; balance and falls; physical capacity and inactivity. Within this program, we selected exercises tailored to each patient's main impairment and proposed this selection to their local physiotherapist for three months. Quality of life was evaluated with PDQ-39 at baseline and after three months of the individualized physical therapy program. We built an anonymous satisfaction questionnaire for patients and physiotherapists that was filled out at the end of the program. One hundred and three individuals with moderately advanced but clinically stable idiopathic PD were included. Significant improvement was found for the emotional well-being, bodily discomfort and stigma domain (P ≤ 0.05). No significant improvement was found for the other PDQ-39 domains. The mean global satisfaction figures for this program were 6.0 ± 2.4 and 7.2 ± 2.1 for patients and physiotherapists respectively. Most of the patients felt improved by the physiotherapy program and especially for transfer, balance, gait, and mobility. Our study found evidence of the potential benefits of a patient-tailored physiotherapy program. Such a program was feasible and had a favorable impact on patients' quality of life and on physiotherapists' practices for PD patients. Specific physiotherapy may be effective to limit physical mobility impairment. Our results also pointed out that physiotherapy may be efficient to confine the negative impact of social isolation, pain and

Questionnaires for measuring physical activity in the elderly

Directory of Open Access Journals (Sweden)

Tânia Bertoldo Benedetti

2006-12-01

Full Text Available The identifi cation of the best amount of physical activity is fundamental so that coherent physical activity practices can be advised regarding the amount, intensity, and frequency, as well as intervention programs can be built to minimize and control problems from functional decline with age. Amongst the methods and techniques, questionnaires have been the most used tool to evaluate physical activity and energy expenditure. Thus, the present study proposed to evaluate psychometric characteristics, advantages and limitations of questionnaires that measure physical activity level in the elderly. A literature review in electronic databases was performed using Ovid Medline and also in personal fi les. After identifying the questionnaires, a new search was run. Six questionnaires were found, and their characteristics were presented. The Baecke and the IPAQ questionnaires are the only forms translated into Portuguese and validated. The IPAQ seemed to show the best conditions to be applied in aged Brazilians. Thus, the questionnaires evaluating physical activity level in the elderly population in Brazil have good reliability, but low validity. RESUMO Identificar a quantidade ideal de atividade física é fundamental para que se possa orientar práticas coerentes em relação à quantidade, intensidade e freqüência, bem como construir programas de intervenções para minimizar e controlar os problemas relacionados com o declínio funcional em idosos. Dentre os métodos e técnicas, os questionários têm sido os mais empregados para avaliar a atividade física e o gasto energético. Assim, o presente estudo objetivou avaliar as características, origens, aspectos psicométricos, vantagens e limitações de questionários que medem o nível de atividade física em idosos. Realizou-se umarevisão bibliográfi ca nos bancos de dados eletrônicos: Ovid Medline e o acervo bibliográfi co pessoal. Após a identifi cação dos instrumentos, realizou

Development, validation and clinical assessment of a short questionnaire to assess disease-related knowledge in inflammatory bowel disease patients.

LENUS (Irish Health Repository)

Keegan, Denise

2013-02-01

Only two inflammatory bowel disease (IBD) knowledge scales are available, both primarily aimed at evaluating the effectiveness of clinical education programs. The aim of this study was to develop and validate a short knowledge questionnaire for clinical and academic research purposes.

The Examination of Views of Parents about the Web-Based Performance Evaluation Program in the Science Teaching Process

OpenAIRE

Bakırcı, Hasan; KARA, YILMAZ; ÇEPNİ, Salih

2018-01-01

The research was aimed to reveal the views of parents on web-based performance evaluation program. The case study method adopted for this study. The research was conducted in the central district of Trabzon province during the fall semester of 2012-2013 academic years. A questionnaire was administered to three hundred parents and face-to-face interviews were conducted with 10 of those parents. The obtained data was analyzed through descriptive and content analysis. Majority of the parents wer...

Evaluation and validity of the Danish version of the Adult Strabismus Questionnaire AS-20

DEFF Research Database (Denmark)

Ali, Nafisa; Sørensen, Mette S; Sørensen, Torben L

2016-01-01

version by reassuring test-retest reliability, estimated the internal consistency, and analyzed the validity (discriminatory power) of the questionnaire by comparing patient scores with scores from control individuals. RESULTS: The Danish AS-20 produced high level of internal consistency (Cronbach's α...... and validity in adult patients with strabismus in Denmark. METHODS: The AS-20 was translated into Danish in accordance with standard international adopted methods. We presented the questionnaire to 64 adults with strabismus and to 13 non-strabismic adult controls. We tested the reliability of the Danish.......0001) but also on all individual questions in both subscales (psychosocial: 1-10 and functional: 11-20). CONCLUSION: The Danish version of AS-20 shows high reliability and validity, and in our opinion, AS-20 is therefore a suitable instrument for evaluating self-perceived psychosocial and functional influence...

Evaluation of training programs: A pragmatic perspective

International Nuclear Information System (INIS)

Wilkinson, J.D.

1996-01-01

The Canadian nuclear regulatory agency endorses the Systematic Approach to Training (SAT) as the most reliable method of providing effective, efficient training to Nuclear Power Plant (NPP) personnel. However the benefits of SAT cannot be realized unless all five phases of SAT are implemented. This is particularly true with respect to evaluation. Although each phase of SAT builds on the preceding one, the evaluation phase continuously feeds back into each of the others and also provides the means to verify the entire training programme building process. It is useful, therefore, to examine the issues relating to the what, why, who, when and how of training programme evaluation. ''What'' identifies the various aspects of the training programme to be evaluated, including the need for training, the training standard, the task list, trainer competence, test results, training results, program acceptance and numerous indicators that identify a need for evaluation. ''Why'' addresses legal and regulatory aspects, resource management, worker and public safety, worker and trainer competence and morale, and the cost/benefit of the training program. ''Who'' examines the need to involve trainers, trainees, plant subject matter experts (SMEs), and both plant and training centre supervisory and management staff. ''When'' addresses time-related concerns such as the importance of ensuring at the outset that the training program is actually needed, the necessity of responding promptly to local, national and world events, changes in legal and regulatory responsibilities, and the overriding importance of timely, routine training program evaluations. ''How'' describes the process of conducting a training program evaluation, and addresses the relationships of these five aspects of evaluation to each other. (author). 10 refs

Framework for a National Testing and Evaluation Program ...

Science.gov (United States)

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

Home safe home: Evaluation of a childhood home safety program.

Science.gov (United States)

Stewart, Tanya Charyk; Clark, Andrew; Gilliland, Jason; Miller, Michael R; Edwards, Jane; Haidar, Tania; Batey, Brandon; Vogt, Kelly N; Parry, Neil G; Fraser, Douglas D; Merritt, Neil

2016-09-01

The London Health Sciences Centre Home Safety Program (HSP) provides safety devices, education, a safety video, and home safety checklist to all first-time parents for the reduction of childhood home injuries. The objective of this study was to evaluate the HSP for the prevention of home injuries in children up to 2 years of age. A program evaluation was performed with follow-up survey, along with an interrupted time series analysis of emergency department (ED) visits for home injuries 5 years before (2007-2013) and 2 years after (2013-2015) implementation. Spatial analysis of ED visits was undertaken to assess differences in home injury rates by dissemination areas controlling differences in socioeconomic status (i.e., income, education, and lone-parent status) at the neighborhood level. A total of 3,458 first-time parents participated in the HSP (a 74% compliance rate). Of these, 20% (n = 696) of parents responded to our questionnaire, with 94% reporting the program to be useful (median, 6; interquartile range, 2 on a 7-point Likert scale) and 81% learning new strategies for preventing home injuries. The median age of the respondent's babies were 12 months (interquartile range, 1). The home safety check list was used by 87% of respondents to identify hazards in their home, with 95% taking action to minimize the risk. The time series analysis demonstrated a significant decline in ED visits for home injuries in toddlers younger than2 years of age after HSP implementation. The declines in ED visits for home injuries remained significant over and above each socioeconomic status covariate. Removing hazards, supervision, and installing safety devices are key facilitators in the reduction of home injuries. Parents found the HSP useful to identify hazards, learn new strategies, build confidence, and provide safety products. Initial finding suggests that the program is effective in reducing home injuries in children up to 2 years of age. Therapeutic/care management study

Validation of a stroke symptom questionnaire for epidemiological surveys.

Science.gov (United States)

Abe, Ivana Makita; Goulart, Alessandra Carvalho; Santos Júnior, Waldyr Rodrigues; Lotufo, Paulo Andrade; Benseñor, Isabela Martins

2010-07-01

Stroke is a relevant issue within public health and requires epidemiological surveillance tools. The aim here was to validate a questionnaire for evaluating individuals with stroke symptoms in the Stroke Morbidity and Mortality Study (Estudo de Mortalidade e Morbidade do Acidente Vascular Cerebral, EMMA), São Paulo, Brazil. This was a cross-sectional study performed among a sample of the inhabitants of Butantã, an area in the western zone of the city of São Paulo. For all households in the coverage area of a primary healthcare unit, household members over the age of 35 years answered a stroke symptom questionnaire addressing limb weakness, facial weakness, speech problems, sensory disorders and impaired vision. Thirty-six participants were randomly selected for a complete neurological examination (gold standard). Considering all the questions in the questionnaire, the sensitivity was 72.2%, specificity was 94.4%, positive predictive value was 92.9% and negative predictive value was 77.3%. The positive likelihood ratio was 12.9, the negative likelihood ratio was 0.29 and the kappa coefficient was 0.67. Limb weakness was the most sensitive symptom, and speech problems were the most specific. The stroke symptom questionnaire is a useful tool and can be applied by trained interviewers with the aim of identifying community-dwelling stroke patients, through the structure of the Family Health Program.

Cross-cultural adaptation and measurement properties of the italian version of the Patient-Rated Tennis Elbow Evaluation (PRTEE) questionnaire.

Science.gov (United States)

Cacchio, Angelo; Necozione, Stefano; MacDermid, Joy C; Rompe, Jan Dirk; Maffulli, Nicola; di Orio, Ferdinando; Santilli, Valter; Paoloni, Marco

2012-08-01

The Patient-Rated Tennis Elbow Evaluation (PRTEE) questionnaire is a tool designed for self-assessment of forearm pain and disability in patients with lateral elbow tendinopathy (LET). However, an Italian version of this questionnaire has not been available. The aims of this study were: (1) to translate and cross-culturally adapt the PRTEE questionnaire into Italian and (2) to evaluate its measurement properties. This was a longitudinal, observational measurement study. The PRTEE questionnaire was cross-culturally adapted to Italian according to established guidelines. Ninety-five individuals (41 women, 54 men) with unilateral, imaging-confirmed, chronic LET were selected consecutively to assess the measurement properties of the PRTEE questionnaire. Internal consistency, test-retest reliability, construct validity, and responsiveness were estimated. The Italian version of the PRTEE displayed a high degree of internal consistency, with a Cronbach alpha of .95. The test-retest reliability was high for both short-term and medium-term, with intraclass correlation coefficients (2,1) of .95 and .93, respectively. The PRTEE exhibited a strong correlation (r=.77-.91, P<.0001) with the Disabilities of the Arm, Shoulder and Hand (DASH) at the baseline and a moderate correlation (r=.58-.74, P<.0001) at discharge. The responsiveness was higher for the PRTEE than for the DASH. Limitations A methodological limitation of the study is that due to the small sample size, a factor analysis was not performed to assess convergent validity. The Italian version of the PRTEE questionnaire is internally consistent, demonstrates expected correlations with other measures, and is more responsive than the DASH in Italian patients with chronic LET.

Evaluating the High School Lunar Research Projects Program

Science.gov (United States)

Shaner, A. J.; Shipp, S. S.; Allen, J.; Kring, D. A.

2012-12-01

instrument is an open-ended, modified version of the Views of Nature of Science questionnaire. The science attitudes Likert-scale instrument is a modified version of the Attitudes Toward Science Inventory. The lunar science content instrument was developed by CLSE education staff. All three of these instruments are administered to students before and after their research experience to measure the program's impact on student views of the nature of science, attitudes toward science, and knowledge of lunar science. All instruments are administered online via Survey Monkey®. When asked if the program changed the way they view the Moon, 77.4% of students (n=53) replied "yes" and described their increase in knowledge of the formation of the Moon, lunar surface processes, etc. Just under half (41.5%) of the students reported that their experience in the program has contributed to their consideration of a career in science. When asked about obstacles teams had to overcome, teachers described issues with time, student motivation and technology. However, every teacher enthusiastically agreed that the authentic research experience was worthwhile to their students. Detailed evaluation results for the 2011-2012 program will be presented.

Development and Evaluation of a Parenting Resilience Elements Questionnaire (PREQ Measuring Resiliency in Rearing Children with Developmental Disorders.

Directory of Open Access Journals (Sweden)

Kota Suzuki

Full Text Available We developed a parenting resilience elements questionnaire (PREQ measuring the degree to which mothers possess elements that aid in adapting to challenges and difficulties related to children with developmental disorders (DD. A total of 424 parents of children with DD were recruited from five medical institutes. Psychometric properties of PREQ were evaluated using data of 363 mothers of children with DD. Furthermore, multiple regression analysis was performed, predicting depressive symptoms and parenting behavior with PREQ subscales, a general health questionnaire, and the total difficulties score of a strength and difficulties questionnaire. Factor analysis revealed three reliable factors: "knowledge of the child's characteristics," "perceived social supports," and "positive perceptions of parenting." Moreover, multiple regression analysis showed that "knowledge of the child's characteristics" was associated with parenting behavior, whereas "perceived social supports" predicted depressive symptoms; "positive perceptions of parenting" influenced both parenting behavior and depressive symptoms. These findings indicated that the PREQ may be used as a scale measuring resiliency in mothers of children with DD and is useful for evaluating their parenting ability in clinical interventions.

Cross-cultural adaptation and validation of the Patient-Rated Tennis Elbow Evaluation Questionnaire on lateral elbow tendinopathy for French-speaking patients.

Science.gov (United States)

Kaux, Jean-François; Delvaux, François; Schaus, Jean; Demoulin, Christophe; Locquet, Médéa; Buckinx, Fanny; Beaudart, Charlotte; Dardenne, Nadia; Van Beveren, Julien; Croisier, Jean-Louis; Forthomme, Bénédicte; Bruyère, Olivier

Translation and validation of algo-functional questionnaire. The lateral elbow tendinopathy is a common injury in tennis players and physical workers. The Patient-Rated Tennis Elbow Evaluation (PRTEE) Questionnaire was specifically designed to measure pain and functional limitations in patients with lateral epicondylitis (tennis elbow). First developed in English, this questionnaire has since been translated into several languages. The aims of the study were to translate and cross-culturally adapt the PRTEE questionnaire into French and to evaluate the reliability and validity of this translated version of the questionnaire (PRTEE-F). The PRTEE was translated and cross-culturally adapted into French according to international guidelines. To assess the reliability and validity of the PRTEE-F, 115 participants were asked twice to fill in the PRTEE-F, and once the Disabilities of Arm, Shoulder and Hand Questionnaire (DASH) and the Short Form Health Survey (SF-36). Internal consistency (using Cronbach's alpha), test-retest reliability (using intraclass correlation coefficient (ICC), standard error of measurement and minimal detectable change), and convergent and divergent validity (using the Spearman's correlation coefficients respectively with the DASH and with some subscales of the SF-36) were assessed. The PRTEE was translated into French without any problems. PRTEE-F showed a good test-retest reliability for the overall score (ICC 0.86) and for each item (ICC 0.8-0.96) and a high internal consistency (Cronbach's alpha = 0.98). The correlation analyses revealed high correlation coefficients between PRTEE-F and DASH (convergent validity) and, as expected, a low or moderate correlation with the divergent subscales of the SF-36 (discriminant validity). There was no floor or ceiling effect. The PRTEE questionnaire was successfully cross-culturally adapted into French. The PRTEE-F is reliable and valid for evaluating French-speaking patients with lateral elbow

Language Program Evaluation: Decisions, Problems, and Solutions.

Science.gov (United States)

Brown, James Dean

1995-01-01

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

Evaluating Optimism: Developing Children’s Version of Optimistic Attributional Style Questionnaire

Directory of Open Access Journals (Sweden)

Gordeeva T.O.,

2017-08-01

Full Text Available People differ significantly in how they usually explain to themselves the reasons of events, both positive and negative, that happen in their lives. Psychological research shows that children who tend to think optimistically have certain advantages as compared to their pessimistically thinking peers: they are less likely to suffer from depression, establish more positive relationships with peers, and demonstrate higher academic achievements. This paper describes the process of creating the children’s version of the Optimistic Attributional Style Questionnaire (OASQ-C. This technique is based on the theory of learned hopelessness and optimism developed by M. Seligman, L. Abramson and J. Teas dale and is an efficient (compact tool for measuring optimism as an explanatory style in children and adolescents (9-14 years. Confirmatory factor analysis revealed that this technique is a two-factor structure with acceptable reliability. Validity is supported by the presence of expected correlations between explanatory style and rates of psychological well-being, dispositional optimism, positive attitude to life and its aspects, depression, and academic performance. The outcomes of this technique are not affected by social desirability. The developed questionnaire may be recommended to researchers and school counsellors for evaluating optimism (optimistic thinking as one of the major factors in psychological well-being of children; it may also be used in assessing the effectiveness of cognitive oriented training for adolescents.

Senior Program Officer, Evaluation | IDRC - International ...

International Development Research Centre (IDRC) Digital Library (Canada)

... provides technical assistance to program staff and partners on evaluation ... monitoring and evaluation approaches; working with colleagues to maintain the ... provides technical supervision and assistance, including analysis of interim ...

Methodological Issues in Questionnaire Design.

Science.gov (United States)

Song, Youngshin; Son, Youn Jung; Oh, Doonam

2015-06-01

The process of designing a questionnaire is complicated. Many questionnaires on nursing phenomena have been developed and used by nursing researchers. The purpose of this paper was to discuss questionnaire design and factors that should be considered when using existing scales. Methodological issues were discussed, such as factors in the design of questions, steps in developing questionnaires, wording and formatting methods for items, and administrations methods. How to use existing scales, how to facilitate cultural adaptation, and how to prevent socially desirable responding were discussed. Moreover, the triangulation method in questionnaire development was introduced. Steps were recommended for designing questions such as appropriately operationalizing key concepts for the target population, clearly formatting response options, generating items and confirming final items through face or content validity, sufficiently piloting the questionnaire using item analysis, demonstrating reliability and validity, finalizing the scale, and training the administrator. Psychometric properties and cultural equivalence should be evaluated prior to administration when using an existing questionnaire and performing cultural adaptation. In the context of well-defined nursing phenomena, logical and systematic methods will contribute to the development of simple and precise questionnaires.

A questionnaire to evaluate the impact of chronic diseases: validated translation and Illness Effects Questionnaire (IEQ reliability study

Directory of Open Access Journals (Sweden)

Patrícia Pinto Fonseca

2012-01-01

Full Text Available INTRODUCTION: Patients' perception about their health condition, mainly involving chronic diseases, has been investigated in many studies and it has been associated to depression, compliance with the treatment, quality of life and prognosis. The Illness Effects Questionnaire (IEQ is a tool which makes the standardized evaluation of patients' perception about their illness possible, so that it is brief and accessible to the different clinical settings. This work aims to begin the transcultural adaptation of the IEQ to Brazil through the validated translation and the reliability study. METHODS: The back-translation method and the test-retest reliability study were used in a sample of 30 adult patients under chronic hemodialysis. The reliability indexes were estimated using the Pearson, Spearman, Weighted Kappa and Cronbach's alpha coefficients. RESULTS: The semantic equivalence was reached through the validated translation. In this study, the reliability indexes obtained were respectively: 0.85 and 0.75 (p < 0.001; 0.68 and 0.92 (p < 0.0001. DISCUSSION: The reliability indexes obtained attest to the stability of responses in both evaluations. Additional procedures are necessary for the transcultural adaptation of the IEQ to be complete. CONCLUSION: The results indicate the translation validity and the reliability of the Brazilian version of the IEQ for the sample studied.

Quality of life questionnaires in otorhinolaryngology: a systematic overview.

Science.gov (United States)

Koenraads, S P C; Aarts, M C J; van der Veen, E L; Grolman, W; Stegeman, I

2016-12-01

The importance of quality of life (QOL) as an endpoint and the use of validated QOL questionnaires have increased over time. To evaluate health-related quality of life (HR-QOL) measurement instruments used in patients in otorhinolaryngology (ORL). We aimed to establish the use of QOL questionnaires in ORL over a period of time, establish the use of QOL questionnaires within different domains and determine the use of validated QOL questionnaires. We performed a comprehensive search in PubMed up to 1 January 2014. Articles were included that measured HR-QOL questionnaires in clinical practice in children, adolescents or adults in 42 journals of ORL. Multiple unique QOL questionnaires, organised according to domain, time and survey of validation, were extracted from reported articles. Of 2442 articles, we utilised 1196 publications with a total of 2103 QOL questionnaires regarding ORL. We evaluated a variety of 363 unique QOL questionnaires in which 60% (n = 220) QOL questionnaires had been validated. We found a continuing increase in the amount of articles which used QOL questionnaires since the beginning of the 20th century, while the percentage of validated QOL questionnaires remained the same (76%). Most QOL questionnaires were used in the domains oncology (35%), otology (21%) and rhinology (20%). The domain otology had the largest amount of unique QOL questionnaires (n = 122). We identified and evaluated all unique HR-QOL questionnaires utilised in patients in ORL. Recently, the use of validated and non-validated HR-QOL questionnaires has increased within all domains of ORL. The assessment of QOL has become an important outcome measure in clinical practice, in medical research and for healthcare organisations. © 2015 John Wiley & Sons Ltd.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

Science.gov (United States)

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Preliminary evaluation of the BIODOSE computer program

International Nuclear Information System (INIS)

Bonner, N.A.; Ng, Y.C.

1979-09-01

The BIODOSE computer program simulates the environmental transport of radionuclides released to surface water and predicts the dosage to humans. We have evaluated the program for its suitability to the needs of the Nuclear Regulatory Commission Waste Management Program. In particular, it is an evaluation to determine whether BIODOSE models account for the significant pathways and mechanisms resulting in radiological doses to man. In general, BIODOSE is a satisfactory code for converting radionuclide releases to the aqueous environment into doses to man

A Practical Approach to Program Evaluation.

Science.gov (United States)

Lee, Linda J.; Sampson, John F.

1990-01-01

The Research and Evaluation Support Services Unit of the New South Wales (Australia) Department of Education conducts program evaluations to provide information to senior management for decision making. The 10-step system used is described, which provides for planning, evaluation, and staff development. (TJH)

Discount method for programming language evaluation

DEFF Research Database (Denmark)

Kurtev, Svetomir; Christensen, Tommy Aagaard; Thomsen, Bent

2016-01-01

This paper presents work in progress on developing a Discount Method for Programming Language Evaluation inspired by the Discount Usability Evaluation method (Benyon 2010) and the Instant Data Analysis method (Kjeldskov et al. 2004). The method is intended to bridge the gap between small scale...... internal language design evaluation methods and large scale surveys and quantitative evaluation methods. The method is designed to be applicable even before a compiler or IDE is developed for a new language. To test the method, a usability evaluation experiment was carried out on the Quorum programming...... language (Stefik et al. 2016) using programmers with experience in C and C#. When comparing our results with previous studies of Quorum, most of the data was comparable though not strictly in agreement. However, the discrepancies were mainly related to the programmers pre-existing expectations...

Motivation for Evaluation: A roadmap for Improving Program Efficacy

Science.gov (United States)

Taber, J. J.; Bohon, W.; Bravo, T. K.; Dorr, P. M.; Hubenthal, M.; Johnson, J. A.; Sumy, D. F.; Welti, R.; Davis, H. B.

2016-12-01

Over the past year, the Incorporated Research Institutions for Seismology (IRIS) Education and Public Outreach (EPO) program has undertaken a new effort to increase the rigor with which it evaluates its programs and products. More specifically we sought to make evaluation an integral part of our EPO staff's work, enable staff to demonstrate why we do the activities we do, enhance the impact or our products and programs, and empower staff to be able to make evidence-based claims. The challenges we faced included a modest budget, finding an applicable approach to both new and legacy programs ranging from formal and informal education to public outreach, and implementing the process without overwhelming staff. The Collaborative Impact Analysis Method (IAM; Davis and Scalice, 2015) was selected as it allowed us to combine the EPO staff's knowledge of programs, audiences and content with the expertise of an outside evaluation expert, through consultations and a qualitative rubric assessing the initial state of each product/program's evaluation. Staff then developed action plans to make incremental improvements to the evaluation of programs over time. We have found that this approach promotes the development of staff knowledge and skills regarding evaluation, provides a common language among staff, increases enthusiasm to collect and share data, encourages discussions of evaluative approaches when planning new activities, and improves each program's ability to capture the intended and unintended effects on the behaviors, attitudes, skills, interests, and/or knowledge of users/participants. We will share the initial IAM Scores for products and programs in the EPO portfolio, along with examples of the action plans for several key products and programs, and the impact that implementing those actions plans has had on our evaluations. Davis, H. & Scalice, D. (2015). Evaluate the Impact of your Education and Outreach Program Using the Quantitative Collaborative Impact Analysis

Acute Care of At-Risk Newborns (ACoRN: quantitative and qualitative educational evaluation of the program in a region of China

Directory of Open Access Journals (Sweden)

Singhal Nalini

2012-06-01

Full Text Available Abstract Background The Acute Care of at-Risk Newborns (ACoRN program was developed in Canada for trained health care providers for the identification and management of newborns who are at-risk and/or become unwell in the first few hours or days after birth. The ACoRN process follows an 8-step framework that enables the evaluation and management of babies irrespective of the experience or expertise of the caregiving individual or team. This study assesses the applicability of the program to Chinese pediatric practitioners. Methods Course content and educational materials were translated from English into Chinese by bilingual neonatal practitioners. Confidence and knowledge questionnaires were developed and reviewed for face and content validity by a team of ACoRN instructors. Bilingual Chinese instructors were trained at the tertiary perinatal centre in Hangzhou Zhejiang to deliver the course at 15 level II county hospitals. Participants completed pre- and post-course confidence and knowledge questionnaires and provided feedback through post-course focus groups. Results 216 physicians and nurses were trained. Confidence and knowledge relating to neonatal stabilization improved significantly following the courses. Participants rated course utility and function between 4.2 and 4.6/5 on all items. Pre/post measures of confidence were significantly correlated with post course knowledge. Focus group data supported the perceived value of the program and recommended course adjustments to include pre-course reading, and increased content related to simulation, communication skills, and management of respiratory illness and jaundice. Conclusions ACoRN, a Canadian educational program, appears to be well received by Chinese health care providers and results in improved knowledge and confidence. International program adaptation for use by health care professionals requires structured and systematic evaluation to ensure that the program meets the needs of

Brazilian version of the foot health status questionnaire (FHSQ-BR: cross-cultural adaptation and evaluation of measurement properties

Directory of Open Access Journals (Sweden)

Ana F. B. Ferreira

2008-01-01

Full Text Available OBJECTIVE: To conduct a cross-cultural adaptation of the Foot Health Status Questionnaire into Brazilian-Portuguese and to assess its measurement properties. INTRODUCTION: This instrument is an outcome measure with 10 domains with scores ranging from 0-100, worst to best, respectively. The translated instrument will improve the examinations and foot care of rheumatoid arthritis patients. METHODS: The questions were translated, back-translated, evaluated by a multidisciplinary committee and pre-tested (n = 40 rheumatoid arthritis subjects. The new version was submitted to a field test (n = 65 to evaluate measurement properties such as test-retest reliability, internal consistency and construct validity. The Health Assessment Questionnaire, Numeric Rating Scale for foot pain and Sharp/van der Heijde scores for foot X-rays were used to test the construct validity. RESULTS: The cross-cultural adaptation was completed with minor wording adaptations from the original instrument. The evaluation of measurement properties showed high reliability with low variation coefficients between interviews. The a-Cronbach coefficients varied from 0.468 to 0.855, while correlation to the Health Assessment Questionnaire and Numeric Rating Scale was statistically significant for five out of eight domains. DISCUSSION: Intra- and inter-observer correlations showed high reliability. Internal consistency coefficients were high for all domains, revealing higher values for less subjective domains. As for construct validity, each domain revealed correlations with a specific group of parameters according to what the domains intended to measure. CONCLUSION: The FHSQ was cross-culturally adapted, generating a reliable, consistent, and valid instrument that is useful for evaluating foot health in patients with rheumatoid arthritis.

Brazilian version of the foot health status questionnaire (FHSQ-BR): cross-cultural adaptation and evaluation of measurement properties.

Science.gov (United States)

Ferreira, Ana F B; Laurindo, Ieda M M; Rodrigues, Priscilla T; Ferraz, Marcos Bosi; Kowalski, Sérgio C; Tanaka, Clarice

2008-10-01

To conduct a cross-cultural adaptation of the Foot Health Status Questionnaire into Brazilian-Portuguese and to assess its measurement properties. This instrument is an outcome measure with 10 domains with scores ranging from 0-100, worst to best, respectively. The translated instrument will improve the examinations and foot care of rheumatoid arthritis patients. The questions were translated, back-translated, evaluated by a multidisciplinary committee and pre-tested (n = 40 rheumatoid arthritis subjects). The new version was submitted to a field test (n = 65) to evaluate measurement properties such as test-retest reliability, internal consistency and construct validity. The Health Assessment Questionnaire, Numeric Rating Scale for foot pain and Sharp/van der Heijde scores for foot X-rays were used to test the construct validity. The cross-cultural adaptation was completed with minor wording adaptations from the original instrument. The evaluation of measurement properties showed high reliability with low variation coefficients between interviews. The alpha-Cronbach coefficients varied from 0.468 to 0.855, while correlation to the Health Assessment Questionnaire and Numeric Rating Scale was statistically significant for five out of eight domains. Intra- and inter-observer correlations showed high reliability. Internal consistency coefficients were high for all domains, revealing higher values for less subjective domains. As for construct validity, each domain revealed correlations with a specific group of parameters according to what the domains intended to measure. The FHSQ was cross-culturally adapted, generating a reliable, consistent, and valid instrument that is useful for evaluating foot health in patients with rheumatoid arthritis.

Motor carrier evaluation program

International Nuclear Information System (INIS)

Portsmouth, James

1992-01-01

The U.S. Department of Energy-Headquarters (DOE-HQ), Transportation Management Program (TMP) has the overall responsibility to provide a well-managed transportation program for the safe, efficient, and economical transportation of DOE-owned materials. The DOE-TMP has established an excellent safety record in the transportation of hazardous materials including radioactive materials and radioactive wastes. This safety record can be maintained only through continued diligence and sustained effort on the part of the DOE-TMP, its field offices, and the contractors' organizations. Key elements in the DOE'S effective hazardous and radioactive materials shipping program are (1) integrity of packages, (2) strict adherence to regulations and procedures, (3) trained personnel, (4) complete management support, and (5) use of the best commercial carriers. The DOE Motor Carrier Evaluation Program was developed to better define the criteria and methodology needed to identify motor carriers for use in the transportation of Highway Route Controlled Quantities (HRCQ), Truck Load (TL) quantities of radioactive materials, hazardous materials and waste. (author)

Validated questionnaires heighten detection of difficult asthma comorbidities.

Science.gov (United States)

Radhakrishna, Naghmeh; Tay, Tunn Ren; Hore-Lacy, Fiona; Stirling, Robert; Hoy, Ryan; Dabscheck, Eli; Hew, Mark

2017-04-01

Multiple extra-pulmonary comorbidities contribute to difficult asthma, but their diagnosis can be challenging and time consuming. Previous data on comorbidity detection have focused on clinical assessment, which may miss certain conditions. We aimed to locate relevant validated screening questionnaires to identify extra-pulmonary comorbidities that contribute to difficult asthma, and evaluate their performance during a difficult asthma evaluation. MEDLINE was searched to identify key extra-pulmonary comorbidities that contribute to difficult asthma. Screening questionnaires were chosen based on ease of use, presence of a cut-off score, and adequate validation to help systematically identify comorbidities. In a consecutive series of 86 patients referred for systematic evaluation of difficult asthma, questionnaires were administered prior to clinical consultation. Six difficult asthma comorbidities and corresponding screening questionnaires were found: sinonasal disease (allergic rhinitis and chronic rhinosinusitis), vocal cord dysfunction, dysfunctional breathing, obstructive sleep apnea, anxiety and depression, and gastro-oesophageal reflux disease. When the questionnaires were added to the referring clinician's impression, the detection of all six comorbidities was significantly enhanced. The average time for questionnaire administration was approximately 40 minutes. The use of validated screening questionnaires heightens detection of comorbidities in difficult asthma. The availability of data from a battery of questionnaires prior to consultation can save time and allow clinicians to systematically assess difficult asthma patients and to focus on areas of particular concern. Such an approach would ensure that all contributing comorbidities have been addressed before significant treatment escalation is considered.

Evaluation of film dosemeters by linear programming

International Nuclear Information System (INIS)

Kragh, P.; Nitschke, J.

1992-01-01

An evaluation method for multi-component dosemeters is described which uses linear programming in order to decrease the dependence on energy and direction. The results of this method are more accurate than those obtained with the evaluation methods so far applied in film dosimetry. In addition, systematic errors can be given when evaluating individual measurements. Combined linear programming, as a special case of the presented method, is described taking a film dosemeter of particular type as an example. (orig.) [de

Development and validation of a new questionnaire assessing quality of life in adults with hypopituitarism: Adult Hypopituitarism Questionnaire (AHQ).

Science.gov (United States)

Ishii, Hitoshi; Shimatsu, Akira; Okimura, Yasuhiko; Tanaka, Toshiaki; Hizuka, Naomi; Kaji, Hidesuke; Hanew, Kunihiko; Oki, Yutaka; Yamashiro, Sayuri; Takano, Koji; Chihara, Kazuo

2012-01-01

To develop and validate the Adult Hypopituitarism Questionnaire (AHQ) as a disease-specific, self-administered questionnaire for evaluation of quality of life (QOL) in adult patients with hypopituitarism. We developed and validated this new questionnaire, using a standardized procedure which included item development, pilot-testing and psychometric validation. Of the patients who participated in psychometric validation, those whose clinical conditions were judged to be stable were asked to answer the survey questionnaire twice, in order to assess test-retest reliability. Content validity of the initial questionnaire was evaluated via two pilot tests. After these tests, we made minor revisions and finalized the initial version of the questionnaire. The questionnaire was constructed with two domains, one psycho-social and the other physical. For psychometric assessment, analyses were performed on the responses of 192 adult patients with various types of hypopituitarism. The intraclass correlations of the respective domains were 0.91 and 0.95, and the Cronbach's alpha coefficients were 0.96 and 0.95, indicating adequate test-retest reliability and internal consistency for each domain. For known-group validity, patients with hypopituitarism due to hypothalamic disorder showed significantly lower scores in 11 out of 13 sub-domains compared to those who had hypopituitarism due to pituitary disorder. Regarding construct validity, the domain structure was found to be almost the same as that initially hypothesized. Exploratory factor analysis (n = 228) demonstrated that each domain consisted of six and seven sub-domains. The AHQ showed good reliability and validity for evaluating QOL in adult patients with hypopituitarism.

Innovative strategies for nursing education program evaluation.

Science.gov (United States)

Story, Lachel; Butts, Janie B; Bishop, Sandra B; Green, Lisa; Johnson, Kathy; Mattison, Haley

2010-06-01

Nursing programs are mandated by accreditation bodies to report data significant to program quality and outcomes. The history at one school of nursing in the southern United States revealed the program evaluation committee experienced roadblocks in retrieving such information. Creative approaches were adopted to overcome some of the barriers to program evaluation, including the use of more technological-based approaches to engage alumni who embrace this technology as a way of life. Among the many advantages of these approaches were convenience, ease of administration and analysis, cost effectiveness, and more meaningful data. The advantages far outweighed the few disadvantages incurred, with the most prominent being potential sampling bias. Copyright 2010, SLACK Incorporated.

Validation of Standardized Questionnaires Evaluating Symptoms of Depression in Rheumatoid Arthritis Patients: Approaches to Screening for a Frequent Yet Underrated Challenge.

Science.gov (United States)

Englbrecht, Matthias; Alten, Rieke; Aringer, Martin; Baerwald, Christoph G; Burkhardt, Harald; Eby, Nancy; Fliedner, Gerhard; Gauger, Bettina; Henkemeier, Ulf; Hofmann, Michael W; Kleinert, Stefan; Kneitz, Christian; Krueger, Klaus; Pohl, Christoph; Roske, Anne-Eve; Schett, Georg; Schmalzing, Marc; Tausche, Anne-Kathrin; Peter Tony, Hans; Wendler, Joerg

2017-01-01

To validate standard self-report questionnaires for depression screening in patients with rheumatoid arthritis (RA) and compare these measures to one another and to the Montgomery-Åsberg Depression Rating Scale (MADRS), a standardized structured interview. In 9 clinical centers across Germany, depressive symptomatology was assessed in 262 adult RA patients at baseline (T0) and at 12 ± 2 weeks followup (T1) using the World Health Organization 5-Item Well-Being Index (WHO-5), the Patient Health Questionnaire (PHQ-9), and the Beck Depression Inventory II (BDI-II). The construct validity of these depression questionnaires (using convergent and discriminant validity) was evaluated using Spearman's correlations at both time points. The test-retest reliability of the questionnaires was evaluated in RA patients who had not undergone a psychotherapeutic intervention or received antidepressants between T0 and T1. The sensitivity and the specificity of the questionnaires were calculated using the results of the MADRS, a structured interview, as the gold standard. According to Spearman's correlation coefficients, all questionnaires met convergent validity criteria (ρ > |0.50|), with the BDI-II performing best, while correlations with age and disease activity for all questionnaires met the criteria for discriminant validity (ρ questionnaire to meet the predefined retest reliability criterion (ρ ≥ 0.70) was the BDI-II (r s  = 0.77), which also achieved the best results for both sensitivity and specificity (>80%) when using the MADRS as the gold standard. The BDI-II best met the predefined criteria, and the PHQ-9 met most of the validity criteria, with lower sensitivity and specificity. © 2016, American College of Rheumatology.

How Bigelow Laboratory Measured Broader Impacts: The Case Study of the Evaluation of the Keller BLOOM Program (Invited)

Science.gov (United States)

Fowler, R. A.; Repa, J.

2010-12-01

In this presentation we discuss the impetus for, the results of the short and long term effects, and the impacts of the Keller BLOOM Program, hosted by Bigelow Laboratory for Ocean Sciences of West Boothbay Harbor, Maine. Each May, for the last 21 years, 16 bright high school juniors, one from each county in Maine, have been invited to spend five days with the research scientists at the lab conducting and reporting research on the bottom layers of the ocean’s food chain: phytoplankton and zooplankton. Bigelow has chosen to evaluate BLOOM through a series of questionnaires delivered during the program, and long term tracking of participants after the program, in order to better understand the impact of the program on participants. The short term effect of the experience, measured at the end of the week, found that participants are able to: 1) develop testable research questions, 2) collect multiple water samples from a local estuary, 3) measure various characteristics of those samples with the sophisticated instruments in Bigelow’s labs assisted by their research scientists, 4) analyze and integrate the results from the various labs, and 5) present their findings to a non-scientific audience. To measure long term participation effects, a random sample of 40 of the 332 participants were interviewed resulting in the following findings: 100% attend college; 62% have STEM majors; 88% graduate from college; 57% pursue STEM careers; and 60% live and work in Maine. Bigelow scientists include a description of the BLOOM Program and the evaluation results in their NSF Broader Impacts statements to demonstrate that their research activities are being integrated into a successful STEM education program. Evaluation results are also used by Bigelow scientists and program administrators to refine program content and delivery, to promote the program to potential applicants, and to strengthen proposals to funding agencies when seeking financial support for BLOOM.

Evaluating OO example programs for CS1

DEFF Research Database (Denmark)

Börstler, Jürgen; Christensen, Henrik Bærbak; Bennedsen, Jens

2008-01-01

Example programs play an important role in learning to program. They work as templates, guidelines, and inspiration for learners when developing their own programs. It is therefore important to provide learners with high quality examples. In this paper, we discuss properties of example programs...... that might affect the teaching and learning of object-oriented programming. Furthermore, we present an evaluation instrument for example programs and report on initial experiences of its application to a selection of examples from popular introductory programming textbooks....

Development and Evaluation of a Parenting Resilience Elements Questionnaire (PREQ) Measuring Resiliency in Rearing Children with Developmental Disorders

Science.gov (United States)

Suzuki, Kota; Kobayashi, Tomoka; Moriyama, Karin; Kaga, Makiko; Hiratani, Michio; Watanabe, Kyota; Yamashita, Yushiro; Inagaki, Masumi

2015-01-01

We developed a parenting resilience elements questionnaire (PREQ) measuring the degree to which mothers possess elements that aid in adapting to challenges and difficulties related to children with developmental disorders (DD). A total of 424 parents of children with DD were recruited from five medical institutes. Psychometric properties of PREQ were evaluated using data of 363 mothers of children with DD. Furthermore, multiple regression analysis was performed, predicting depressive symptoms and parenting behavior with PREQ subscales, a general health questionnaire, and the total difficulties score of a strength and difficulties questionnaire. Factor analysis revealed three reliable factors: “knowledge of the child’s characteristics,” “perceived social supports,” and “positive perceptions of parenting.” Moreover, multiple regression analysis showed that “knowledge of the child’s characteristics” was associated with parenting behavior, whereas “perceived social supports” predicted depressive symptoms; “positive perceptions of parenting” influenced both parenting behavior and depressive symptoms. These findings indicated that the PREQ may be used as a scale measuring resiliency in mothers of children with DD and is useful for evaluating their parenting ability in clinical interventions. PMID:26633810

Cyber-Evaluation: Evaluating a Distance Learning Program.

Science.gov (United States)

Henderson, Denise L.

This paper examines how the process of soliciting evaluation feedback from nonresident students in the Army Management Staff College (Virginia) program on leadership and management for civilian employees of the Army has evolved since 1995. Course design is briefly described, including the use of video-teleconferences, chat rooms, an electronic…

Evaluation of a Clinical Decision Support System for Dyslipidemia Treatment (HTE-DLPR by QoE questionnaire

Directory of Open Access Journals (Sweden)

Alberto Zamora

2017-01-01

Full Text Available Introduction: Clinical decision support systems (CDSS are computer systems designed to assist clinicians with patient-related decision making, such as diagnosis and treatment. CDSS have shown to improve both patient outcomes and cost of care.Methods: A multi-center observational prospective study was conducted. Ten physicians agreed to participate. Seventy-seven patients with high or very high cardiovascular risk were included. After using CDSS for dyslipidemia (HTE-DLPR for a 3 months period, participants were asked to evaluate their experience with HTE-DLPR using a quality of experience questionnaire (QoE tool for mHealth applications.Results: Total score on the QoE was 3.89 out of 5. The highest scores were received for precision, ease of use and content quality. The lowest scores were given to security, appearance and performance. Physicians were in strong agreement with the 1st HTEDLPR recommendation in 86.1% and the system’s use was described as comfortablein 85% of cases. Users positively evaluated the development of a new version of HTEDLPR in the future receiving a total score of 4.25 out of 5.Conclusions: A CDSS for dyslipidemia (HTE-DLP has been positively evaluated by physicians using QoE questionnaire.

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs

Directory of Open Access Journals (Sweden)

Chloe S. Gordon

2017-02-01

Full Text Available Abstract Background Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children’s drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Methods Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews, program evaluation questionnaires completed by children (n = 166, lesson observations completed by teachers (n = 35 observations, and reflective journal entries completed by the researcher (n = 44 entries. A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Results Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students’ life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper

Qualitative process evaluation of an Australian alcohol media literacy study: recommendations for designing culturally responsive school-based programs.

Science.gov (United States)

Gordon, Chloe S; Kervin, Lisa K; Jones, Sandra C; Howard, Steven J

2017-02-02

Alcohol media literacy programs seek to mitigate the potentially harmful effects of alcohol advertising on children's drinking intentions and behaviours through equipping them with skills to challenge media messages. In order for such programs to be effective, the teaching and learning experiences must be tailored to their specific cultural context. Media in the Spotlight is an alcohol media literacy program aimed at 9 to 12 year old Australian children. This study evaluates the process and implementation of the program, outlining the factors that facilitated and inhibited implementation. From this evaluation, a pedagogical framework has been developed for health professionals implementing culturally responsive programs in school settings. Process measures included: semi-structured interviews with teachers before and after the program was implemented (n = 11 interviews), program evaluation questionnaires completed by children (n = 166), lesson observations completed by teachers (n = 35 observations), and reflective journal entries completed by the researcher (n = 44 entries). A thematic analysis approach was used to analyse all of the data sets using NVivo. Inductive coding was used, whereby the findings were derived from the research objectives and multiple readings and interpretations of the data. Five key pedagogical considerations were identified that facilitated implementation. These were: connecting to the students' life worlds to achieve cultural significance; empowering students with real-world skills to ensure relevance; ensuring programs are well structured with strong connections to the school curriculum; creating developmentally appropriate activities while providing a range of assessment opportunities; and including hands-on and interactive activities to promote student engagement. Three potential inhibitors to implementing the alcohol media literacy program in upper-elementary school classrooms were identified. These included topic

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

OpenAIRE

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subj...

Quality-of-life evaluation in chronic wounds: comparative analysis of three disease-specific questionnaires.

Science.gov (United States)

Augustin, Matthias; Baade, Katrin; Heyer, Kristina; Price, Patricia E; Herberger, Katharina; Wild, Thomas; Engelhardt, Michael; Debus, Eike S

2017-12-01

The study directly compared the feasibility and performance of three instruments measuring health-related quality of life (HRQoL) in chronic ulcers: the Freiburg Life Quality Assessment for wounds (FLQA-w), the Cardiff Wound Impact Schedule (CWIS) and the Würzburg Wound Score (WWS). The questionnaires were evaluated in a randomly assigned order in a longitudinal observational study of leg ulcer patients. Psychometric properties (internal consistency, responsiveness and construct validity) were analysed. Patient acceptance was recorded. Analysis of n = 154 patients revealed good internal consistency (Cronbach's alpha ≥ 0·85) for all instruments. There were minor floor effects in all questionnaires (acceptance was highest in the FLQA-w for wounds (54% best preferences) and lowest in the WWS (14%). In conclusion, the FLQA-w, the CWIS and the WWS are reliable, sensitive and valid instruments for the assessment of HRQoL in leg ulcers. However, they show differences in clinical feasibility and patient acceptance. © 2017 Medicalhelplines.com Inc and John Wiley & Sons Ltd.

Behavioral patterns of environmental performance evaluation programs.

Science.gov (United States)

Li, Wanxin; Mauerhofer, Volker

2016-11-01

During the past decades numerous environmental performance evaluation programs have been developed and implemented on different geographic scales. This paper develops a taxonomy of environmental management behavioral patterns in order to provide a practical comparison tool for environmental performance evaluation programs. Ten such programs purposively selected are mapped against the identified four behavioral patterns in the form of diagnosis, negotiation, learning, and socialization and learning. Overall, we found that schemes which serve to diagnose environmental abnormalities are mainly externally imposed and have been developed as a result of technical debates concerning data sources, methodology and ranking criteria. Learning oriented scheme is featured by processes through which free exchange of ideas, mutual and adaptive learning can occur. Scheme developed by higher authority for influencing behaviors of lower levels of government has been adopted by the evaluated to signal their excellent environmental performance. The socializing and learning classified evaluation schemes have incorporated dialogue, participation, and capacity building in program design. In conclusion we consider the 'fitness for purpose' of the various schemes, the merits of our analytical model and the future possibilities of fostering capacity building in the realm of wicked environmental challenges. Copyright © 2016 Elsevier Ltd. All rights reserved.

Experienced emotional burden in caregivers: psychometric properties of the Involvement Evaluation Questionnaire in caregivers of brain injured patients.

NARCIS (Netherlands)

Geurtsen, G.J.; Meijer, R.; Heugten, C.M. van; Martina, J.D.; Geurts, A.C.H.

2010-01-01

OBJECTIVE: To examine the psychometric properties (internal consistency, discriminant validity, and responsiveness) of the Involvement Evaluation Questionnaire for Brain Injury measuring emotional burden in caregivers of patients with chronic acquired brain injury. DESIGN: Inception cohort study.

Adding mindfulness to CBT programs for binge eating: a mixed-methods evaluation.

Science.gov (United States)

Woolhouse, Hannah; Knowles, Ann; Crafti, Naomi

2012-01-01

The current study investigated the effectiveness of a combined mindfulness-CBT group therapy program for women with binge eating problems. Questionnaires were completed by group participants pre-program (n = 30), post-program (n = 30) and 3 month follow-up (n = 28). Significant reductions between pre- and post-program scores were found on standardised measures assessing binge eating, dieting, and body image dissatisfaction, with all reductions maintained at follow-up. Qualitative interviews with 16 women following completion of the program revealed the value of mindfulness in improving eating behaviour through increased self-awareness. This exploratory study supports the value of adding mindfulness to the more commonly utilised CBT-based programs for binge eating.

Experienced emotional burden in caregivers: psychometric properties of the Involvement Evaluation Questionnaire in caregivers of brain injured patients

NARCIS (Netherlands)

Geurtsen, Gert J.; Meijer, Ron; van Heugten, Caroline M.; Martina, Juan D.; Geurts, Alexander C. H.

2010-01-01

To examine the psychometric properties (internal consistency, discriminant validity, and responsiveness) of the Involvement Evaluation Questionnaire for Brain Injury measuring emotional burden in caregivers of patients with chronic acquired brain injury. Inception cohort study. Caregivers of chronic

Implementation and Evaluation of a Smartphone-Based Telemonitoring Program for Patients With Heart Failure: Mixed-Methods Study Protocol.

Science.gov (United States)

Ware, Patrick; Ross, Heather J; Cafazzo, Joseph A; Laporte, Audrey; Seto, Emily

2018-05-03

Meta-analyses of telemonitoring for patients with heart failure conclude that it can lower the utilization of health services and improve health outcomes compared with the standard of care. A smartphone-based telemonitoring program is being implemented as part of the standard of care at a specialty care clinic for patients with heart failure in Toronto, Canada. The objectives of this study are to (1) evaluate the impact of the telemonitoring program on health service utilization, patient health outcomes, and their ability to self-care; (2) identify the contextual barriers and facilitators of implementation at the physician, clinic, and institutional level; (3) describe patient usage patterns to determine adherence and other behaviors in the telemonitoring program; and (4) evaluate the costs associated with implementation of the telemonitoring program from the perspective of the health care system (ie, public payer), hospital, and patient. The evaluation will use a mixed-methods approach. The quantitative component will include a pragmatic pre- and posttest study design for the impact and cost analyses, which will make use of clinical data and questionnaires administered to at least 108 patients at baseline and 6 months. Furthermore, outcome data will be collected at 1, 12, and 24 months to explore the longitudinal impact of the program. In addition, quantitative data related to implementation outcomes and patient usage patterns of the telemonitoring system will be reported. The qualitative component involves an embedded single case study design to identify the contextual factors that influenced the implementation. The implementation evaluation will be completed using semistructured interviews with clinicians, and other program staff at baseline, 4 months, and 12 months after the program start date. Interviews conducted with patients will be triangulated with usage data to explain usage patterns and adherence to the system. The telemonitoring program was launched in

Questionnaires for assessment of female sexual dysfunction

DEFF Research Database (Denmark)

Giraldi, Annamaria; Rellini, Alessandra; Pfaus, James G

2011-01-01

There are many methods to evaluate female sexual function and dysfunction (FSD) in clinical and research settings, including questionnaires, structured interviews, and detailed case histories. Of these, questionnaires have become an easy first choice to screen individuals into different categories...

Evaluation of demand-side management programs

International Nuclear Information System (INIS)

Kolbe, A.L.; O'Loughlin, M.P.

1990-01-01

Over the past few years, the attention accorded to demand-side management (DSM) measures has called into question the traditional cost minimization approach for evaluating such programs. Two broad approaches to DSM seem to be generally used: one examining the problem from multiple perspectives and the other including various practical methods used in-house by utility planners. Whatever the standard used to evaluate DSM, there remains at least one problem which cannot be quantified. The customers who participate in a DSM program cannot only take into account the effects of DSM on their electricity bills; their comfort can also be affected. This lowering of comfort constitutes a legitimate cost which can explain why some apparently sensible DSM measures are not adopted. A method is proposed to incorporate this cost. It establishes a way to evaluate DSM program tradeoffs that, from the perspective of standard economic theory, maximizes social welfare; explains why at least one of the perspectives in the multiple perspective approach needs to be modified to incorporate all customer costs; and outlines how the proposed standard can be implemented. 8 refs

USAF Weapon System Evaluation Program

National Research Council Canada - National Science Library

1999-01-01

During this task period, Schafer Corporation provided engineering services and analysis to the USAF at Eglin AFB, Florida in direct support of the USAF Air-to-Surface Weapon System Evaluation Program (WSEP...

The Diabetes Intention, Attitude, and Behavior Questionnaire: evaluation of a brief questionnaire to measure physical activity, dietary control, maintenance of a healthy weight, and psychological antecedents

Directory of Open Access Journals (Sweden)

Traina SB

2016-02-01

Full Text Available Shana B Traina,1 Susan D Mathias,2 Hilary H Colwell,2 Ross D Crosby,2–4 Charles Abraham5 1Patient-Reported Outcomes, Janssen Global Services, LLC, Raritan, NJ, USA; 2Health Outcomes Solutions, Winter Park, FL, USA; 3Biomedical Statistics & Methodology, Neuropsychiatric Research Institute, Fargo, ND, USA; 4Department of Clinical Neuroscience, University of North Dakota School of Medicine and Health Sciences, Grand Forks, ND, USA; 5Psychology Applied to Health, University of Exeter Medical School, Exeter, UK Background: This study assessed measurement properties of the 17-item Diabetes Intention, Attitude, and Behavior Questionnaire (DIAB-Q, which measures intention to engage in self-care behaviors, including following a diabetes diet and engaging in appropriate physical activity. Methods: The DIAB-Q includes questions based on the Theory of Planned Behavior. Items were developed using published literature, input from health care professionals, and qualitative research findings in patients with and without type 2 diabetes mellitus (T2DM. In Stage I of the study, 23 adults with T2DM were interviewed to evaluate the content and clarity of the DIAB-Q. In Stage II 1,015 individuals with T2DM completed the DIAB-Q and supplemental questionnaires, including the Short Form-36 acute (SF-36, section III of the Multidimensional Diabetes Questionnaire, the Summary of Diabetes Self-Care Activities questionnaire, and self-administered items relevant to the treatment and management of T2DM (eg, blood pressure and glycated hemoglobin [HbA1c] at baseline and 3–7 days later. Once the DIAB-Q scale structure was determined, its test–retest reliability, construct validity, and known-groups validity were evaluated, and minimal clinically important change was estimated. Results: In Stage I, the 23 respondents surveyed generally reported that the DIAB-Q was clear and comprehensive and endorsed questions as relevant to their intentions to engage in diabetes

Developing a Questionnaire to Evaluate College Students' Knowledge, Attitude, Behavior, Self-efficacy, and Environmental Factors Related to Canned Foods.

Science.gov (United States)

Richards, Rickelle; Brown, Lora Beth; Williams, D Pauline; Eggett, Dennis L

2017-02-01

Develop a questionnaire to measure students' knowledge, attitude, behavior, self-efficacy, and environmental factors related to the use of canned foods. The Knowledge-Attitude-Behavior Model, Social Cognitive Theory, and Canned Foods Alliance survey were used as frameworks for questionnaire development. Cognitive interviews were conducted with college students (n = 8). Nutrition and survey experts assessed content validity. Reliability was measured via Cronbach α and 2 rounds (1, n = 81; 2, n = 65) of test-retest statistics. Means and frequencies were used. The 65-item questionnaire had a test-retest reliability of .69. Cronbach α scores were .87 for knowledge (9 items), .86 for attitude (30 items), .80 for self-efficacy (12 items), .68 for canned foods use (8 items), and .30 for environment (6 items). A reliable questionnaire was developed to measure perceptions and use of canned foods. Nutrition educators may find this questionnaire useful to evaluate pretest-posttest changes from canned foods-based interventions among college students. Copyright © 2016 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Evaluating the Effectiveness of a Health Promotion Intervention Program Among Physiotherapy Undergraduate Students

Science.gov (United States)

Korn, Liat; Ben-Ami, Noa; Azmon, Michal; Einstein, Ofira; Lotan, Meir

2017-01-01

This study evaluated the effectiveness of a health promotion (HP) intervention program among physiotherapy undergraduate students in an academic institution by examining pre- and post-intervention health perceptions and behaviors compared to a control group (non-physiotherapy students). Participants completed questionnaires on their health perceptions and behaviors at T1 (April 2009–May 2009) before the intervention program was initiated, and at T2 (April 2015–May 2015) after the intervention program was implemented for several years. At T1, 1,087 undergraduate students, including 124 physiotherapy students, participated. At T2, 810 undergraduate students, including 133 physiotherapy students participated. Self-reported health-related perceptions and behaviors were compared in the study group (physiotherapy students) over time (T1 versus T2), and between the study group and the control group (non-physiotherapy students) pre-intervention (T1) and post-intervention (T2). Findings showed more positive perceptions and behaviors at T2 compared to T1 in the study group (51.0% at T2 versus 35.2% at T1; p<0.05). There was no significant difference at T2 compared to T1 in health perceptions reported by the control group (37.8% at T2 versus 32.8% at T1; non-significant difference). Our findings demonstrated the effectiveness of the intervention program. PMID:28735335

Development of the 3-SET 4P questionnaire for evaluating former ICU patients' physical and psychosocial problems over time: a pilot study.

Science.gov (United States)

Akerman, Eva; Fridlund, Bengt; Ersson, Anders; Granberg-Axéll, Anetth

2009-04-01

Current studies reveal a lack of consensus for the evaluation of physical and psychosocial problems after ICU stay and their changes over time. The aim was to develop and evaluate the validity and reliability of a questionnaire for assessing physical and psychosocial problems over time for patients following ICU recovery. Thirty-nine patients completed the questionnaire, 17 were retested. The questionnaire was constructed in three sets: physical problems, psychosocial problems and follow-up care. Face and content validity were tested by nurses, researchers and patients. The questionnaire showed good construct validity in all three sets and had strong factor loadings (explained variance >70%, factor loadings >0.5) for all three sets. There was good concurrent validity compared with the SF 12 (r(s)>0.5). Internal consistency was shown to be reliable (Cronbach's alpha 0.70-0.85). Stability reliability on retesting was good for the physical and psychosocial sets (r(s)>0.5). The 3-set 4P questionnaire was a first step in developing an instrument for assessment of former ICU patients' problems over time. The sample size was small and thus, further studies are needed to confirm these findings.

Evaluation of web-based, self-administered, graphical food frequency questionnaire.

Science.gov (United States)

Kristal, Alan R; Kolar, Ann S; Fisher, James L; Plascak, Jesse J; Stumbo, Phyllis J; Weiss, Rick; Paskett, Electra D

2014-04-01

Computer-administered food frequency questionnaires (FFQs) can address limitations inherent in paper questionnaires by allowing very complex skip patterns, portion size estimation based on food pictures, and real-time error checking. We evaluated a web-based FFQ, the Graphical Food Frequency System (GraFFS). Participants completed the GraFFS, six telephone-administered 24-hour dietary recalls over the next 12 weeks, followed by a second GraFFS. Participants were 40 men and 34 women, aged 18 to 69 years, living in the Columbus, OH, area. Intakes of energy, macronutrients, and 17 micronutrients/food components were estimated from the GraFFS and the mean of all recalls. Bias (second GraFFS minus recalls) was -9%, -5%, +4%, and -4% for energy and percentages of energy from fat, carbohydrate, and protein, respectively. De-attenuated, energy-adjusted correlations (intermethod reliability) between the recalls and the second GraFFS for fat, carbohydrate, protein, and alcohol were 0.82, 0.79, 0.67, and 0.90, respectively; for micronutrients/food components the median was 0.61 and ranged from 0.40 for zinc to 0.92 for beta carotene. The correlations between the two administrations of the GraFFS (test-retest reliability) for fat, carbohydrate, protein, and alcohol were 0.60, 0.63, 0.73, and 0.87, respectively; among micronutrients/food components the median was 0.67 and ranged from 0.49 for vitamin B-12 to 0.82 for fiber. The measurement characteristics of the GraFFS were at least as good as those reported for most paper FFQs, and its high intermethod reliability suggests that further development of computer-administered FFQs is warranted. Copyright © 2014 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Evaluation of integrated child development services program in rajasthan, India

Directory of Open Access Journals (Sweden)

Madan Singh Rathore

2015-01-01

Full Text Available Background: The Integrated Child Development Services (ICDS scheme is the largest program for promotion of maternal and child health and nutrition. Aims: The present study is aimed to evaluate ICDS program in terms of infrastructure of anganwadi centers (AWCs, characteristics of anganwadi workers (AWWs, coverage of supplementary nutrition (SN, and preschool education (PSE to the beneficiaries. Methods: A total of 39 AWCs from a rural area and 15 from the urban area were surveyed. AWWs were interviewed, and records were reviewed. Information was collected using a predesigned and pretested questionnaire. Results: In the selected AWCs, 88.9% were running in Pucca buildings, 38.9% had electricity, 35.1% had a separate kitchen, 1.8% had cooking gas, and toilets were available in 59.3% AWCs. All the AWW have received job training, 83.3% AWW have received refresher training. 38.8% AWW have received orientation training, 37% have received skill training in World Health Organization growth standards and 18.5% AWW have received skill training in mother and child health. 86.9% registered pregnant women, 90.7% registered lactating women, 72.6% registered adolescent girls were availing SN. 95.4% registered children 6 months to 3 years and 92.4% registered children 3-6 years of age were availing SN. Interruption in SN in last 6 months was seen in 22.2% AWCs. Appropriate and adequate PSE material was available in 59.2% AWCs. Conclusion: There are program gaps in the infrastructure of AWCs, training of AWW, coverage of SN, interruption in the supply of SN.

Design of psychosocial factors questionnaires: a systematic measurement approach

Science.gov (United States)

Vargas, Angélica; Felknor, Sarah A

2012-01-01

Background Evaluation of psychosocial factors requires instruments that measure dynamic complexities. This study explains the design of a set of questionnaires to evaluate work and non-work psychosocial risk factors for stress-related illnesses. Methods The measurement model was based on a review of literature. Content validity was performed by experts and cognitive interviews. Pilot testing was carried out with a convenience sample of 132 workers. Cronbach’s alpha evaluated internal consistency and concurrent validity was estimated by Spearman correlation coefficients. Results Three questionnaires were constructed to evaluate exposure to work and non-work risk factors. Content validity improved the questionnaires coherence with the measurement model. Internal consistency was adequate (α=0.85–0.95). Concurrent validity resulted in moderate correlations of psychosocial factors with stress symptoms. Conclusions Questionnaires´ content reflected a wide spectrum of psychosocial factors sources. Cognitive interviews improved understanding of questions and dimensions. The structure of the measurement model was confirmed. PMID:22628068

Alberta: evaluation of nursing retention and recruitment programs.

Science.gov (United States)

Weidner, Arlene; Graham, Carol; Smith, Jennifer; Aitken, Julia; Odell, Jill

2012-03-01

Retention and recruitment strategies are essential to address nursing workforce supply and ensure the viability of healthcare delivery in Canada. Knowledge transfer between experienced nurses and those new to the profession is also a focus for concern. The Multi-Employer/United Nurses of Alberta Joint Committee attempted to address these issues by introducing a number of retention and recruitment (R&R) initiatives for nurses in Alberta: in total, seven different programs that were introduced to some 24,000 nurses and employers across the province of Alberta in 2001 (the Transitional Graduate Nurse Recruitment Program) and 2007 (the remaining six R&R programs). Approximately 1,600 nurses participated in the seven programs between 2001 and 2009. Of the seven strategies, one supported entry into the workplace, two were pre-retirement strategies and four involved flexible work options. This project entailed a retrospective evaluation of the seven programs and differed from the other Research to Action (RTA) projects because it was solely concerned with evaluation of pre-existing initiatives. All seven programs were launched without a formal evaluation component, and the tracking of local uptake varied throughout the province. The union and various employers faced challenges in implementing these strategies in a timely fashion, as most were designed at the bargaining table during negotiations. As a result, systems, policy and procedural changes had to be developed to support their implementation after they became available.Participants in the programs indicated improvements over time in several areas, including higher levels of satisfaction with work–life balance, hours worked and their current practice and profession. The evaluation found that participation led to perceived improvements in nurses' confidence, greater control over their work environment, decreased stress levels, increased energy and morale and perceived improved ability to provide high-quality care

Systematic review of the psychometric properties of the questionnaire to evaluate the adherence to HIV therapy (CEAT-VIH).

Science.gov (United States)

Remor, Eduardo

2013-01-01

Since the use of the questionnaire to evaluate adherence to HIV therapy (acronym CEAT-VIH) has increased in the last decade and translation into new language versions has been requested, summarizing information regarding the psychometric properties of the instrument may be useful for researchers and practitioners. The purpose of this work was to review the psychometric properties of the questionnaire CEAT-VIH, available from published studies and research reports. Medline, PsycINFO, Google Scholar and Google; the searched period was from 2001 to 2012. Forty-eight research materials referring to the questionnaire CEAT-VIH were initially gathered from academic databases and direct contact with researchers, before being analyzed. From the initial pool of material compiled (i.e., abstracts, technical reports or database files, dissertations or complete articles), only 20 comprised original data. The selected research material described a variety of information in terms of the psychometric properties of the questionnaire. The results from the primary studies were then summarized in tables for evaluation, description and comparison. Thirteen out of 16 studies reported a Cronbach's alpha value of above 0.70, supporting the internal consistency reliability of the CEAT-VIH questionnaire. No floor or ceiling effects were observed. Hypothesized relationships between the CEAT-VIH score and adherence-related variables (e.g., viral load, CD4+, compliance evaluated by physician or pharmacist, complexity of treatment and pill numbers) were observed, indicating validity evidence. Thus, variables expected to act as psychological risk factors for low adherence (e.g., stress, depression and anxiety) or protector factor (e.g., social support) to good adherence were observed. The scores of the questionnaire were also related to quality of life outcomes. Moreover, patients that received adherence intervention showed increased CEAT-VIH adherence scores. Sensitivity and specificity to

An evaluation of the American Indian Air Quality Training Program

Science.gov (United States)

Quartaroli, Marylynn

During centuries of geographic, economic, and cultural domination, the federal government held the responsibility for the management of environmental issues on tribal lands. Today, tribes are reasserting their sovereignty in many ways, including the development of their own environmental programs. Tribal agencies desperately search for tribal members who are qualified to make decisions for the benefit of the tribes from both Western scientific and traditional cultural viewpoints. To meet this need, the American Indian Air Quality Training Program (AIAQTP) offers technical and regulatory training courses that are both scientifically up-to-date and culturally responsive to this community. This study is an evaluation of these courses. To supplement data from existing program documents and databases, I also observed five courses, sent follow-up questionnaires, and interviewed lead instructors and course participants to develop an understanding of their perceptions of the training received. Computer analysis of this quantitative and qualitative data revealed patterns and themes; an external reviewer also independently analyzed the data set. The training courses offered by AIAQTP were judged to have merit and value by the course instructors, the participants, the external evaluator, and me. Designed to be both culturally responsive and technically rigorous, these courses provided relevant and useful information and skills to the tribal environmental professionals in attendance, meeting the demands of their jobs. Although not all training needs or expectations were met, the study participants indicated their intentions to continue their education and training in air quality and other environmental media. A significant benefit of attendance at AIAQTP training courses was the development of a network of tribal professionals across the nation that acts as a support system for the implementation and continuation of changes in the professional practice for the trainees and

Evaluating a physician leadership development program - a mixed methods approach.

Science.gov (United States)

Throgmorton, Cheryl; Mitchell, Trey; Morley, Tom; Snyder, Marijo

2016-05-16

Purpose - With the extent of change in healthcare today, organizations need strong physician leaders. To compensate for the lack of physician leadership education, many organizations are sending physicians to external leadership programs or developing in-house leadership programs targeted specifically to physicians. The purpose of this paper is to outline the evaluation strategy and outcomes of the inaugural year of a Physician Leadership Academy (PLA) developed and implemented at a Michigan-based regional healthcare system. Design/methodology/approach - The authors applied the theoretical framework of Kirkpatrick's four levels of evaluation and used surveys, observations, activity tracking, and interviews to evaluate the program outcomes. The authors applied grounded theory techniques to the interview data. Findings - The program met targeted outcomes across all four levels of evaluation. Interview themes focused on the significance of increasing self-awareness, building relationships, applying new skills, and building confidence. Research limitations/implications - While only one example, this study illustrates the importance of developing the evaluation strategy as part of the program design. Qualitative research methods, often lacking from learning evaluation design, uncover rich themes of impact. The study supports how a PLA program can enhance physician learning, engagement, and relationship building throughout and after the program. Physician leaders' partnership with organization development and learning professionals yield results with impact to individuals, groups, and the organization. Originality/value - Few studies provide an in-depth review of evaluation methods and outcomes of physician leadership development programs. Healthcare organizations seeking to develop similar in-house programs may benefit applying the evaluation strategy outlined in this study.

The Advanced Test Reactor Strategic Evaluation Program

International Nuclear Information System (INIS)

Buescher, B.J.

1990-01-01

A systematic evaluation of safety, environmental, and operational issues has been initiated at the Advanced Test Reactor (ATR). This program, the Strategic Evaluation Program (STEP), provides an integrated review of safety and operational issues against the standards applied to licensed commercial facilities. In the review of safety issues, 18 deviations were identified which required prompt attention. Resolution of these items has been accelerated in the program. An integrated living schedule is being developed to address the remaining findings. A risk evaluation is being performed on the proposed corrective actions and these actions will then be formally ranked in order of priority based on considerations of safety and operational significance. Once the final ranking is completed, an integrated schedule will be developed, which will include considerations of availability of funding and operating schedule. 3 refs., 2 figs

An Evaluative Study of the WOW Program on Patients' Satisfaction in Acute Psychiatric Units

Directory of Open Access Journals (Sweden)

Xie Huiting

2013-01-01

Full Text Available Background: Patient satisfaction is one of the key evidence of the quality of health-care delivery in nursing. Nursing is a patient-centered activity; although nurse-patient interaction is one of the key tenets of mental health nursing, a structured program to enhance this interaction is lacking. To address the gap, the WOW program was developed in a psychiatric hospital but its effectivenesss had not been evaluated.Objective: This study aims to compare satisfaction levels between patients who have undertaken the WOW program and those who have not.Methodology: A comparative survey design was employed for this study. A purposive sample of 91 adults was obtained from two inpatient psychiatric units: one where the WOW program had beenimplemented and the other, a matched control unit. After patients had been admitted to one of the two inpatient psychiatric units for a week, a questionnaire, modified from the Newcastle Satisfaction with Nursing Scale (NSNS, was administered to participants to assess their level of satisfaction with nursing care.Results and Conclusion: When the satisfaction scores of participants in the WOW group and the control group were compared, it was revealed that the WOW group was more satisfied with nursing care than the control group. Though the difference was not statistically significant, the potential of a structured nurse-patient interaction program to enhance patients’ satisfaction is encouraging. Theresults of this study offer valuable information that may direct the future enhancement and development of programs to improve patient satisfaction.

Evaluation of a parenting skills program in Russia.

Science.gov (United States)

MacKinnon, Lee

2013-01-01

This article analyzes participant interviews and the photovoice project of 15 young disadvantaged mothers in Pskov, Russia. The women's statements and photovoice were part of a formative evaluation of the Pskov Positive Parenting Program, designed by the University of Massachusetts Institute for Global Health (IGH) and funded by USAID. The evaluation revealed that the Program met its goal of helping the women learn sensitive caregiving behaviors. The mothers emphasized that the Program met their need for social connection. The young mothers' participation in the positive social network of the group may have been a key ingredient to the Program's success and may have implications for the design of parenting programs cross-culturally.

Evaluation of a Research Mentorship Program in Community Care

Science.gov (United States)

Ploeg, Jenny; de Witt, Lorna; Hutchison, Brian; Hayward, Lynda; Grayson, Kim

2008-01-01

This article describes the results of a qualitative case study evaluating a research mentorship program in community care settings in Ontario, Canada. The purpose of the program was to build evaluation and research capacity among staff of community care agencies through a mentorship program. Data were collected through in-depth, semi-structured…

E-Basics: Online Basic Training in Program Evaluation

Science.gov (United States)

Silliman, Ben

2016-01-01

E-Basics is an online training in program evaluation concepts and skills designed for youth development professionals, especially those working in nonformal science education. Ten hours of online training in seven modules is designed to prepare participants for mentoring and applied practice, mastery, and/or team leadership in program evaluation.…

Determining the Use and Perceived Effectiveness of a Point-of-Purchase Cafeteria Nutrition Education Program.

Science.gov (United States)

Ruzansky, ANITA S.; Whiting, Susan; Dobson, JOANNE DESMARAIS

1998-01-01

The Eat Smart Heart Beat Cafeteria Program (ESCP) is a point-of-purchase nutrition education program (PPNEP), which was developed by the Ottawa-Carleton Health Department (OCHD). The intent of this program was to increase the awareness and availability of lower-fat, higher-fibre foods in cafeterias. The purpose of this study was to evaluate the ESCP using a Feedback Questionnaire. The questionnaire was developed primarily to determine the use of the ESCP manual and to evaluate the users' perceived effectiveness of this program. Purchasers of the ESCP were asked to complete the questionnaire one year after they received the program resources. Forty of the 88 program recipients (45%) returned the questionnaire. Most responses were from nutritionists or dietitians, health service managers and occupational health workers. Most respondents represented large workplaces (more than 250 employees) such as hospitals, government, health units and educational institutions. Of the 40 respondents, 10 implemented the program and indicated that they were moderately to very satisfied with all of the resources and that they would continue using the program. The 30 respondents who reported not using the program indicated that this was mainly due to time constraints. The ESCP has the potential to increase the awareness and availability of lower-fat, higher-fibre foods. Therefore, it is recommended that the program be continued in a ready-to-use format to increase its usability. Further research is needed to clarify the effects of the ESCP on behaviour change.

Evaluating the Sharing Stories youth theatre program: an interactive theatre and drama-based strategy for sexual health promotion among multicultural youth.

Science.gov (United States)

Roberts, Meagan; Lobo, Roanna; Sorenson, Anne

2017-03-01

Issue addressed Rates of sexually transmissible infections among young people are high, and there is a need for innovative, youth-focused sexual health promotion programs. This study evaluated the effectiveness of the Sharing Stories youth theatre program, which uses interactive theatre and drama-based strategies to engage and educate multicultural youth on sexual health issues. The effectiveness of using drama-based evaluation methods is also discussed. Methods The youth theatre program participants were 18 multicultural youth from South East Asian, African and Middle Eastern backgrounds aged between 14 and 21 years. Four sexual health drama scenarios and a sexual health questionnaire were used to measure changes in knowledge and attitudes. Results Participants reported being confident talking to and supporting their friends with regards to safe sex messages, improved their sexual health knowledge and demonstrated a positive shift in their attitudes towards sexual health. Drama-based evaluation methods were effective in engaging multicultural youth and worked well across the cultures and age groups. Conclusions Theatre and drama-based sexual health promotion strategies are an effective method for up-skilling young people from multicultural backgrounds to be peer educators and good communicators of sexual health information. Drama-based evaluation methods are engaging for young people and an effective way of collecting data from culturally diverse youth. So what? This study recommends incorporating interactive and arts-based strategies into sexual health promotion programs for multicultural youth. It also provides guidance for health promotion practitioners evaluating an arts-based health promotion program using arts-based data collection methods.

Motor carrier evaluation program plan

International Nuclear Information System (INIS)

Portsmouth, J.H.; Maxwell, J.E.; Boness, G.O.; Rice, L.E.

1991-04-01

The US Department of Energy (DOE) Transportation Management Program (TMP) has established a program to assist the DOE field offices and their contractors in evaluating the motor carriers used to transport DOE-owned hazardous and radioactive materials. This program was initiated to provide the DOE field offices with the tools necessary to help ensure, during this period of motor carrier deregulation, that only highly qualified carriers transport radioactive and hazardous commodities for the DOE. This program will assist DOE in maintaining their excellent performance record in the safe transportation of hazardous commodities. The program was also developed in response to public concern surrounding the transportation of hazardous materials. Representatives of other federal agencies, states, and tribal governments, as well as the news media, have expressed concern about the selection and qualification of carriers engaged in the transportation of Highway Route-Controlled Quantities (HRCQ) and Truckload (TL) quantities of radioactive material for the DOE. 8 refs

Purposive facebook recruitment endows cost-effective nutrition education program evaluation.

Science.gov (United States)

Lohse, Barbara; Wamboldt, Patricia

2013-08-15

Recent legislation established a requirement for nutrition education in federal assistance programs to be evidence-based. Recruitment of low-income persons to participate and evaluate nutrition education activities can be challenging and costly. Facebook has been shown to be a cost-effective strategy to recruit this target audience to a nutrition program. The purpose of our study was to examine Facebook as a strategy to recruit participants, especially Supplemental Nutrition Assistance Program Education (SNAP-Ed) eligible persons, to view and evaluate an online nutrition education program intended to be offered as having some evidence base for SNAP-Ed programming. English-speaking, low-income Pennsylvania residents, 18-55 years with key profile words (eg, Supplemental Nutrition Assistance Program, Food bank), responded to a Facebook ad inviting participation in either Eating Together as a Family is Worth It (WI) or Everyone Needs Folic Acid (FA). Participants completed an online survey on food-related behaviors, viewed a nutrition education program, and completed a program evaluation. Facebook set-up functions considered were costing action, daily spending cap, and population reach. Respondents for both WI and FA evaluations were similar; the majority were white, Cost per completed evaluation was US $25.48; cost per low-income completer was US $39.92. Results were similar for the FA evaluation; 795 Facebook users clicked on the ad with 110 unique site visitors, and 73 completing the evaluation (ie, 73/795, 9.2% of ad clickers and 73/110, 66% of site visitors completed the evaluation). Cost per valid completed survey with program evaluation was US $18.88; cost per low-income completer was US $27.53. With Facebook we successfully recruited low-income Pennsylvanians to online nutrition program evaluations. Benefits using Facebook as a recruitment strategy included real-time recruitment management with lower costs and more efficiency compared to previous data from

A Psychometric Evaluation of the Learning Styles Questionnaire: 40-Item Version

Science.gov (United States)

Klein, Britt; McCall, Louise; Austin, David; Piterman, Leon

2007-01-01

Sixty-six English-speaking postgraduate distance-education medical students completed the Learning Styles Questionnaire (LSQ: 40-item version). This was completed while attending a residential workshop at the beginning of the semester, and 44 of these students completed the same LSQ questionnaire 5 months later at the completion of the semester.…

Evaluation of the Effectiveness of the "Friends for Life" Program on Children’s Anxiety and Depression

Directory of Open Access Journals (Sweden)

Fatemeh Moharrari

2017-10-01

Full Text Available Introduction: Anxiety disorders and depression during childhood and adolescence are among highly prevalent serious mental health problems, which lead to reduced performance in children and can also negatively affect on children’s emotional and social long-term development.Methods: This study is a controlled clinical trial that evaluates the effectiveness of the "Friends for Life" cognitive-behavioral program in reducing the symptoms of anxiety and depression in children. In this study, 248 male students aged 10 were screened using the Revised Children’s Manifest Anxiety (RCMA and the Children’s Depression Inventory (CDI in terms of mild to moderate symptoms of anxiety and depression. Of the subjects, 40 students met the inclusion criteria.The demographic questionnaire, the Strengths and Difficulties Questionnaire (SDQ and the Depression-Anxiety-Stress Scale (DASS were filled out by parents. The children in the experimental group received the "Friends for Life" cognitive-behavioral training program for eight 1-hour weekly sessions. RCMA, CDI, SDQ, and DASS were filled out again in both groups at the end of the sessions and 3 months later.Results: Children’s depression and manifest anxiety scores before intervention were not significantly different in the two groups; however, their changes immediately after intervention and during 3 months of follow-up were significant (p<0.001. Moreover, hyperactivity (p=0.039, peer problems (p=0.011 and parental depression (p=0.015 scores significantly changed in both groups over time.Conclusions: Implementation of "Friends for Life" program is effective in prevention and treatment of the symptoms of anxiety and depression in children.

The New Brunswick Laboratory Safeguards Measurement Evaluation Program

International Nuclear Information System (INIS)

Cacic, C.G.; Trahey, N.M.; Zook, A.C.

1987-01-01

The New Brunswick Laboratory (NBL) has been tasked by the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) to assess and evaluate the adequacy of measurement technology as applied to materials accounting in DOE nuclear facilities. The Safeguards Measurement Evaluation (SME) Program was developed as a means to monitor and evaluate the quality and effectiveness of accounting measurements by site, material balance area (MBA), or unit process. Phase I of the SME Program, initiated during 1985, involved evaluation of the primary accountability measurement methods at six DOE Defense Programs facilities: Savannah River Plant, Portsmouth Gaseous Diffusion Plant, Y-12 Plant, Rocky Flats Plant, Rockwell Hanford Operations, and NBL. Samples of uranyl nitrate solution, dried plutonium nitrates, and plutonium oxides were shipped to the participants for assay and isotopic abundance measurements. Resulting data are presented and evaluated as indicators of current state-of-the-practice accountability measurement methodology, deficiencies in materials accounting practices, and areas for possible assistance in upgrading measurement capabilities. Continuing expansion of the SME Program to include materials which are representative of specific accountability measurement points within the DOE complex is discussed

Issues Surrounding the Evaluation of Teacher Internship Programs

Science.gov (United States)

Barrett, D.

2006-12-01

Georgia Intern-Fellowships for Teachers (GIFT) is a collaborative effort designed to enhance mathematics and science experiences of Georgia teachers and their students through summer research internships for teachers. By offering business, industry, public science institute and research summer fellowships to teachers, GIFT provides educators with first-hand exposure to the skills and knowledge necessary for the preparation of our future workforce. Since 1991, GIFT has placed middle and high school math, science and technology teachers in over 1100 positions throughout the state. In these fellowships, teachers are involved in cutting edge scientific and engineering research, data analysis, curriculum development and real-world inquiry and problem solving, and create Action Plans to assist them in translating the experience into changed classroom practice. Since 2004, an increasing number of high school students have worked with their teachers in research laboratories. The GIFT program has an advisory board composed of university researchers, business and education leaders. The board members work in various subcommittees assisting the program with areas such as sponsor recruitment, evaluation and long term planning. The evaluation subcommittee has been actively involved in providing direction regarding the evaluation of the GIFT program's impact on teachers and their students. The program recently conducted a survey of its former participants. This presentation will discuss the results of the survey and the challenges associated with program evaluation of teacher internship programs.

A QUALITATIVE EVALUATION OF THE DIDACTIC ACTING OF THE TUTORS INVOLVED IN THE PROGRAM OF TUTORIA IN BIOCHEMISTRY AT UFV

Directory of Open Access Journals (Sweden)

J.D. Damasceno

2007-05-01

Full Text Available The Tutorial Program in Biochemistry is part of a Program of Didactic Support atUFV that intends to give academic-pedagogic support to students that arrived tothe UFV with deficiency of previous knowledge in basic areas of the sciences. Thetutors are under-graduated students chosen by public selection. The present workseeks to evaluate the tutors of the biochemistry area as for the aspects publicspeaking, didacticism and satisfaction of the tutor and of the students assisted bythe program. Two questionnaires were applied, one to the tutors and one to theunder-graduated assisted-students. The totality of the tutors answered that theparticipation in this program contributes professionally by increasing the capacityof relationship in group, dynamism, decisions and organization, helped them to bemore extroverted and they felt satisfied to help other people, which characteristicsthat are more and more appraised in the job market. The evaluation showed alsothat the ability to express in public developed positively and improved the diction,presenting safety when speaking in public. The tutors also opened your vision onthe teaching form in the University, a positive result, considering their positions ofstudent in one public university.

Energy 2000: effects of the program and conclusions from its evaluation

International Nuclear Information System (INIS)

Balthasar, A.

2000-01-01

The action program Energy 2000 has been continually reviewed by independent experts in view of its effects. This resulted in around 50 scientific studies between 1991 and 1999, dealing with different aspects of the program. In the book 'Energy 2000: effects of the program and conclusions from its evaluation', the results of these evaluations are summarised, and conclusions for the design of the follow-up program are drawn. The organisational frame of the program is presented and the question answered whether the determining principles of the program proved practical. Besides, the effects of state intervention, of the conflict solving groups and the voluntary actions of Energy 2000 are appraised. A separate chapter is dedicated to the evaluation strategy of the program, its implementation and the benefits of the evaluations. Propositions for the evaluation of the follow-up program are formulated as well. Dr. Andreas Balthasar is President of the Swiss Evaluation Society. (author)

Initiatives in training program evaluation outside the nuclear utility industry

International Nuclear Information System (INIS)

Allen, C.J.

1987-01-01

Training literature is reviewed, and program evaluative practices outside the nuclear utility industry are reported. The findings indicate some innovations in philosophy and practice and program evaluation, although not necessarily in the context of evaluation as a route to assessing the impact of training. Program evaluation is described in the context of the impact of training, suggesting continued efforts to accept a multivariate concept of individual and organizational performance

The Evaluation of an Employee Assistance Program.

Science.gov (United States)

Gam, John; And Others

1983-01-01

Presents the results of an evaluative study of an employee assistance program sponsored by the Russell Corporation, an apparel manufacturing firm. Results suggested that the program is beneficial in terms of both productivity enhancement and humanitarianism. (Author)

Construction of exercise attitude questionnaire-18 to evaluate patients' attitudes toward exercises.

Science.gov (United States)

Manigandan, C; Charles, J; Divya, I; Edward, S J; Aaron, A

2004-09-01

The importance of exercise for health and the long-term management of various diseases is now well documented and established. However, the challenge is the lack of patient compliance to exercises, which is true for almost all diseases, from acute back pain to chronic arthritis. One of the factors for compliance is the perception that exercises are effective in ameliorating unpleasant symptoms. Precisely, people's perception and their attitude towards exercises matter the most in determining the treatment outcome in such conditions. Unfortunately, the psychology of exercise initiation and adherence in the patient population is seriously under-researched. Recent literature has identified the need to consider various similar factors like motivation, barriers to exercise, exercise-related beliefs, attitudes, and the formulation of self-perceptions and self-identity towards exercises. However, no good instrument exists that is sensitive and standardized to evaluate people's attitude towards exercises, which is fundamental and crucial in determining the final outcome of exercise-treatable diseases. Hence we have attempted to design a questionnaire to 'evaluate the level of people's attitude towards exercises'.

Inpatient cardiac rehabilitation programs' exercise therapy for patients undergoing cardiac surgery: National Korean Questionnaire Survey.

Science.gov (United States)

Seo, Yong Gon; Jang, Mi Ja; Park, Won Hah; Hong, Kyung Pyo; Sung, Jidong

2017-02-01

Inpatient cardiac rehabilitation (ICR) has been commonly conducted after cardiac surgery in many countries, and has been reported a lots of results. However, until now, there is inadequacy of data on the status of ICR in Korea. This study described the current status of exercise therapy in ICR that is performed after cardiac surgery in Korean hospitals. Questionnaires modified by previous studies were sent to the departments of thoracic surgery of 10 hospitals in Korea. Nine replies (response rate 90%) were received. Eight nurses and one physiotherapist completed the questionnaire. Most of the education on wards after cardiac surgery was conducted by nurses. On postoperative day 1, four sites performed sitting on the edge of bed, sit to stand, up to chair, and walking in the ward. Only one site performed that exercise on postoperative day 2. One activity (stairs up and down) was performed on different days at only two sites. Patients received education preoperatively and predischarge for preventing complications and reducing muscle weakness through physical inactivity. The results of the study demonstrate that there are small variations in the general care provided by nurses after cardiac surgery. Based on the results of this research, we recommended that exercise therapy programs have to conduct by exercise specialists like exercise physiologists or physiotherapists for patients in hospitalization period.

Can a structured questionnaire identify patients with reduced renal function?

DEFF Research Database (Denmark)

Azzouz, Manal; Rømsing, Janne; Thomsen, Henrik

2014-01-01

To evaluate a structured questionnaire in identifying outpatients with renal dysfunction before MRI or CT in various age groups.......To evaluate a structured questionnaire in identifying outpatients with renal dysfunction before MRI or CT in various age groups....

Interfacing theories of program with theories of evaluation for advancing evaluation practice: Reductionism, systems thinking, and pragmatic synthesis.

Science.gov (United States)

Chen, Huey T

2016-12-01

Theories of program and theories of evaluation form the foundation of program evaluation theories. Theories of program reflect assumptions on how to conceptualize an intervention program for evaluation purposes, while theories of evaluation reflect assumptions on how to design useful evaluation. These two types of theories are related, but often discussed separately. This paper attempts to use three theoretical perspectives (reductionism, systems thinking, and pragmatic synthesis) to interface them and discuss the implications for evaluation practice. Reductionism proposes that an intervention program can be broken into crucial components for rigorous analyses; systems thinking view an intervention program as dynamic and complex, requiring a holistic examination. In spite of their contributions, reductionism and systems thinking represent the extreme ends of a theoretical spectrum; many real-world programs, however, may fall in the middle. Pragmatic synthesis is being developed to serve these moderate- complexity programs. These three theoretical perspectives have their own strengths and challenges. Knowledge on these three perspectives and their evaluation implications can provide a better guide for designing fruitful evaluations, improving the quality of evaluation practice, informing potential areas for developing cutting-edge evaluation approaches, and contributing to advancing program evaluation toward a mature applied science. Copyright © 2016 Elsevier Ltd. All rights reserved.

[Validation and reliability study of the parent concerns about surgery questionnaire: What worries parents?

Science.gov (United States)

Gironés Muriel, Alberto; Campos Segovia, Ana; Ríos Gómez, Patricia

2018-01-01

The study of mediating variables and psychological responses to child surgery involves the evaluation of both the patient and the parents as regards different stressors. To have a reliable and reproducible valid evaluation tool that assesses the level of paternal involvement in relation to different stressors in the setting of surgery. A self-report questionnaire study was completed by 123 subjects of both sexes, subdivided into 2populations, due to their relationship with the hospital setting. The items were determined by a group of experts and analysed using the Lawshe validity index to determine a first validity of content. Subsequently, the reliability of the tool was determined by an item-re-item analysis of the 2sub-populations. A factorial analysis was performed to analyse the construct validity with the maximum likelihood and rotation of varimax type factors. A questionnaire of paternal concern was offered, consisting of 21 items with a Cronbach coefficient of 0.97, giving good precision and stability. The posterior factor analysis gives an adequate validity to the questionnaire, with the determination of 10 common stressors that cover 74.08% of the common and non-common variance of the questionnaire. The proposed questionnaire is reliable, valid and easy-to-apply and is developed to assess the level of paternal concern about the surgery of a child and to be able to apply measures and programs through the prior assessment of these elements. Copyright © 2016 Asociación Española de Pediatría. Publicado por Elsevier España, S.L.U. All rights reserved.

Systematic review: questionnaires for assessment of gastroesophageal reflux disease.

Science.gov (United States)

Bolier, E A; Kessing, B F; Smout, A J; Bredenoord, A J

2015-01-01

Numerous questionnaires with a wide variety of characteristics have been developed for the assessment of gastroesophageal reflux disease (GERD). Four well-defined dimensions are noticeable in these GERD questionnaires, which are symptoms, response to treatment, diagnosis, and burden on the quality of life of GERD patients. The aim of this review is to develop a complete overview of all available questionnaires, categorized per dimension of the assessment of GERD. A systematic search of the literature up to January 2013 using the Pubmed database and the Embase database, and search of references and conference abstract books were conducted. A total number of 65 questionnaires were extracted and evaluated. Thirty-nine questionnaires were found applicable for the assessment of GERD symptoms, three of which are generic gastrointestinal questionnaires. For the assessment of response to treatment, 14 questionnaires were considered applicable. Seven questionnaires with diagnostic purposes were found. In the assessment of quality of life in GERD patients, 18 questionnaires were found and evaluated. Twenty questionnaires were found to be used for more than one assessment dimension, and eight questionnaires were found for GERD assessment in infants and/or children. A wide variety of GERD questionnaires is available, of which the majority is used for assessment of GERD symptoms. Questionnaires differ in aspects such as design, validation and translations. Also, numerous multidimensional questionnaires are available, of which the Reflux Disease Questionnaire is widely applicable. We provided an overview of GERD questionnaires to aid investigators and clinicians in their search for the most appropriate questionnaire for their specific purposes. © 2013 International Society for Diseases of the Esophagus.

Californium-252 Program Equipment Evaluation

Energy Technology Data Exchange (ETDEWEB)

Chattin, Fred Rhea [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Wilson, Kenton [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States); Ezold, Julie G. [Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)

2017-12-01

To successfully continue the ²⁵²Cf production and meet the needs of the customers, a comprehensive evaluation of the Building 7920 processing equipment was requested to identify equipment critical to the operational continuity of the program.

Jamie's Ministry of Food: quasi-experimental evaluation of immediate and sustained impacts of a cooking skills program in Australia.

Science.gov (United States)

Flego, Anna; Herbert, Jessica; Waters, Elizabeth; Gibbs, Lisa; Swinburn, Boyd; Reynolds, John; Moodie, Marj

2014-01-01

To evaluate the immediate and sustained effectiveness of the first Jamie's Ministry of Food Program in Australia on individuals' cooking confidence and positive cooking/eating behaviours. A quasi- experimental repeated measures design was used incorporating a wait-list control group. A questionnaire was developed and administered at baseline (T1), immediately post program (T2) and 6 months post completion (T3) for participants allocated to the intervention group, while wait -list controls completed it 10 weeks prior to program commencement (T1) and just before program commencement (T2). The questionnaire measured: participants' confidence to cook, the frequency of cooking from basic ingredients, and consumption of vegetables, vegetables with the main meal, fruit, ready-made meals and takeaway. Analysis used a linear mixed model approach for repeated measures using all available data to determine mean differences within and between groups over time. All adult participants (≥18 years) who registered and subsequently participated in the program in Ipswich, Queensland, between late November 2011- December 2013, were invited to participate. In the intervention group: 694 completed T1, 383 completed T1 and T2 and 214 completed T1, T2 and T3 assessments. In the wait-list group: 237 completed T1 and 149 completed T1 and T2 assessments. Statistically significant increases within the intervention group (Pcooking confidence measures between T1 and T2 as well as cooking from basic ingredients, frequency of eating vegetables with the main meal and daily vegetable intake (0.52 serves/day increase). Statistically significant increases at T2 were sustained at 6 months post program in the intervention group. Jamie's Ministry of Food Program, Australia improved individuals' cooking confidence and cooking/eating behaviours contributing to a healthier diet and is a promising community-based strategy to influence diet quality.

Caregiving in severe mental illness: the psychometric properties of the Involvement Evaluation Questionnaire in Portugal

Directory of Open Access Journals (Sweden)

Gonçalves-Pereira Manuel

2012-03-01

Full Text Available Abstract Background Despite the achievements of previous research, caregiving assessments in severe mental illness should be crossculturally validated in order to define risk groups or to evaluate family work. This study reports on the psychometric properties of the European version of the Involvement Evaluation Questionnaire (IEQ-EU in Portugal. Methods A Portuguese translation of the IEQ-EU was developed according to the 'European Psychiatric Services: Inputs Linked to Outcome Domains and Needs' (EPSILON group guidelines. We then studied 194 caregivers who were related to patients with schizophrenia spectrum disorders in psychiatric outpatient services. All relatives were assessed using the IEQ-EU. In order to describe the corresponding patients' sample, the majority (n = 162 was evaluated with the World Health Organization Disability Assessment Schedule (WHO-DAS II; 108 patients were also assessed with the Brief Psychiatric Rating Scale (BPRS and the Global Assessment of Functioning (GAF. Results The factor structure of the Portuguese version of the questionnaire was similar to the original; internal consistency was good, with Cronbach's α ranging from 0.71 to 0.87 in the IEQ-EU scales (total score and domains: tension, supervision, worrying, urging; test-retest reliability yielded intraclass correlation coefficients (ICCs from 0.80 to 0.94, concerning the same scores. Ecological validity was confirmed. Most caregiving consequences were reported on the worrying domain of the IEQ-EU. Conclusions Validity and reliability of the Portuguese IEQ-EU translation were established. Specifically the four IEQ-EU subscale domains seem to be valid in Portugal.

Evaluation of a guided continuous quality improvement program in community pharmacies.

Science.gov (United States)

Chinthammit, Chanadda; Rupp, Michael T; Armstrong, Edward P; Modisett, Tara; Snead, Rebecca P; Warholak, Terri L

2017-01-01

The importance of creating and sustaining a strong culture of patient safety has been recognized as a critical component of safe medication use. This study aims to assess changes in attitudes toward patient safety culture and frequency of quality-related event (QRE) reporting after guided implementation of a continuous quality improvement (CQI) program in a panel of community pharmacies in the United States (U.S.). Twenty-one community pharmacies volunteered to participate in the project and were randomly assigned to intervention or control groups. Pharmacy staff in the intervention group received guided training to ensure full implementation of a CQI program while those in the control group partially implemented the program. Pharmacy staff in both groups completed retrospective pre-post safety culture questionnaires and reported medication errors and near misses that occurred in their practices. Rasch analysis was applied to assess questionnaire validity and reliability and to confirm if the ordinal level data approximated interval level measures. Paired t-tests and repeated measure analysis of covariance tests were subsequently used to compare observed changes in the attitudes of subjects and frequency of QREs reporting in intervention and control groups. Sixty-nine employees completed the questionnaire, a 43.9% response rate. Improvement in attitudes toward patient safety was statistically significant in the intervention group in six domains: staff, training, and skill ( p  = 0.017); patient counseling ( p  = 0.043); communication about mistakes ( p  continuous improvement ( p  < 0.001); and overall patient safety perceptions ( p  = 0.033). No significant differences were observed in QRE reporting rates between intervention and control groups. However, differences were observed in the types of QREs reported (e.g., incorrect safety cap) and the point in the prescription processing workflow where a QRE was detected (e.g., partner check station, and drug

Prospective Patient-Related Outcome Evaluation of Secondary Cleft Rhinoplasty Using a Validated Questionnaire.

Science.gov (United States)

Sawyer, Adam R; Robinson, Stephen; Cadier, Michael

2017-07-01

To evaluate patient satisfaction and quality of life following secondary cleft rhinoplasty. Prospective consecutive patient, single unit, single surgeon study. Spires Cleft Centre, Salisbury, Wilshire, United Kingdom, and private practice. 56 (27 secondary cleft rhinoplasty) patients completed evaluation forms preoperatively and 3 to 6 months postoperatively. Subjective assessment was performed using a validated Rhinoplasty Outcomes Evaluation (ROE) questionnaire. This instrument comprises six questions that capture three quality-of-life domains: physical, mental/emotional, and social. Rhinoplasty outcomes evaluation scores were calculated (range = 0 to 100) to indication satisfaction with rhinoplasty outcomes. Average age was 28 years (range = 18 to 59 years). There was a significant subjective improvement in the total ROE evaluation scores from 28 ± 10 to 80 ± 11 (P aesthetic appearance improved from 0.3 ± 0.2 to 3.2 ± 0.3 (P < .01) in secondary cleft rhinoplasty. No significant change was seen in breathing capacity in secondary cleft rhinoplasty (from 2.7 ± 0.3 to 3.2 ± 0.2; P = .29). All patients said they would undergo the procedure again. Our results demonstrate high patient satisfaction after cleft rhinoplasty with particular regard to cosmetic appearance. These results are similar to those for noncleft rhinoplasty. We would recommend the use of this simple and quick validated outcome tool with all rhinoplasty patients.

Evaluation assessment of Rail Freight Transportation Research and Development Program

Energy Technology Data Exchange (ETDEWEB)

1983-02-01

This report presents an evaluation assessment of the Canadian Rail Freight Transportation Research and Development (R and D) Program. The assessment was to assist in preparing for an evaluation of the Program and to stimulate a better understanding of the broader issues and problems of evaluating R and D programs. In general, the objectives of the program are aimed at improving rail freight productivity, capacity, safety, cost, and the domestic and foreign competitive position of railway suppliers. This is to be acccomplished by stimulating a stronger industry commitment to R and D and inducing investment in new technology through joint federal-industry funding and participation in rail freight R and D projects. In view of the low funding levels of the Program, it is unlikely that it will have a significant direct impact upon these ultimate objectives. Impacts will likely only be achieved through the Program's ability to stimulate increased industrial R and D and investment in new technology. A model of the Program developed in the report shows that the critical linkages between the activities and objectives of the Program are the leadership or advocacy functions performed by the Program's managers and of the results of projects supported under the Program; and the processes of program planning and project selection. An assessment of the Program's structure indicates that there are no significant issues that would make the evaluation of the Program or its major components inadvisable. Twelve potential evaluation questions and the basic approaches required to address each of them are presented in the report. 5 figs., 10 tabs.

Implications of Continuous Quality Improvement for Program Evaluation and Evaluators.

Science.gov (United States)

Mark, Melvin M.; Pines, Edward

1995-01-01

Explores the implications that continuous quality improvement (CQI) programs are likely to have for evaluation. CQI, often known as total quality management, offers a structured approach to the analysis of an organization's processes and improvement that should provide advantages to evaluators once they have gained experience with the approach.…

Polish adaptation of Bad Sobernheim Stress Questionnaire-Brace and Bad Sobernheim Stress Questionnaire-Deformity.

Science.gov (United States)

Misterska, Ewa; Głowacki, Maciej; Harasymczuk, Jerzy

2009-12-01

Bad Sobernheim Stress Questionnaire-Brace and Bad Sobernheim Stress Questionnaire-Deformity are relatively new tools aimed at facilitating the evaluation of long-term results of therapy in persons with idiopathic scoliosis undergoing conservative treatment. To use these tools properly in Poland, they must be translated into Polish and adapted to the Polish cultural settings. The process of cultural adaptation of the questionnaires was compliant with the guidelines of International Quality of Life Assessment (IQOLA) Project. In the first stage, two independent translators converted the originals into Polish. Stage two, consisted of a comparison of the originals and two translated versions. During that stage, the team of two translators and authors of the project identified differences in those translations and created a combination of the two. In the third stage, two independent translators, who were native speakers of German, translated the adjusted version of the Polish translation into the language of the original document. At the last stage, a commission composed of: specialists in orthopedics, translators, a statistician and a psychologist reviewed all translations and drafted a pre-final version of the questionnaires. Thirty-five adolescent girls with idiopathic scoliosis who were treated with Cheneau brace were subjected to the questionnaire assessment. All patients were treated in an out-patient setting by a specialist in orthopedics at the Chair and Clinic of Orthopedics and Traumatology. Median age of patients was 14.8 SD 1.5, median value of the Cobb's angle was 27.8 degrees SD 7.4. 48.6% of patients had thoracic scoliosis, 31.4% had thoracolumbar scoliosis, and 20% patients had lumbar scoliosis. Median results obtained by means of the Polish version of BSSQ-Brace and BSSQ-Deformity questionnaires were 17.9 SD 5.0 and 11.3 SD 4.7, respectively. Internal consistency of BSSQ-Brace and BSSQ-Deformity was at the level of 0.80 and 0.87, whereas the value of

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

Science.gov (United States)

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

7 CFR 3405.22 - Evaluation of program.

Science.gov (United States)

2010-01-01

... 7 Agriculture 15 2010-01-01 2010-01-01 false Evaluation of program. 3405.22 Section 3405.22 Agriculture Regulations of the Department of Agriculture (Continued) COOPERATIVE STATE RESEARCH, EDUCATION, AND EXTENSION SERVICE, DEPARTMENT OF AGRICULTURE HIGHER EDUCATION CHALLENGE GRANTS PROGRAM...

Beyond Customer Satisfaction: Reexamining Customer Loyalty to Evaluate Continuing Education Programs

Science.gov (United States)

Hoyt, Jeff E.; Howell, Scott L.

2011-01-01

This article provides questionnaire items and a theoretical model of factors predictive of customer loyalty for use by administrators to determine ways to increase repeat purchasing in their continuing education programs. Prior studies in the literature are discussed followed by results of applying the model at one institution and a discussion of…

Improving utility conservation programs: outcomes, interventions, and evaluations

Energy Technology Data Exchange (ETDEWEB)

Condelli, L; Archer, D; Aronson, E; Curbow, B; McLeod, B; Pettigrew, T F; White, L T; Yates, S

1984-06-01

Four major California utility companies have active energy conservation programs mandated by the State's Public Utilities Commission (CPUC). These companies evaluate their programs and send reports of the evaluations to the CPUC. A review of 213 of these reports revealed a marketing research approach toward promoting conservation. Advertising and informational campaigns characterize most programs, and attitudes and self-reported behavior were the major outcome measures. This approach is shown to be ineffective. Suggestions for improvement include: (1) the use of actual energy consumption as the primary outcome measure in evaluating conservation programs; (2) the abandonment of conventional advertising, and the use of it only for the promotion of ''hard'' interventions; (3) increased use of social diffusion methods to disseminate information; (4) the design of more effective educational material by incorporating cognitive social psychological principles; and (5) the utilization of ''hard'' interventions that have a direct, verifiable link to conservation.

Evaluation Planning, Evaluation Management, and Utilization of Evaluation Results within Adult Literacy Campaigns, Programs and Projects (with Implications for Adult Basic Education and Nonformal Education Programs in General). A Working Paper.

Science.gov (United States)

Bhola, H. S.

Addressed to professionals involved in program evaluation, this working paper covers various aspects of evaluation planning, including the following: planning as a sociotechnical process, steps in evaluation planning, program planning and implementation versus evaluation planning and implementation, the literacy system and its subsystems, and some…

Psychometric evaluation of the Work Readiness Questionnaire in schizophrenia.

Science.gov (United States)

Potkin, Steven G; Bugarski-Kirola, Dragana; Edgar, Chris J; Soliman, Sherif; Le Scouiller, Stephanie; Kunovac, Jelena; Miguel Velasco, Eugenio; Garibaldi, George M

2016-04-01

Unemployment can negatively impact quality of life among patients with schizophrenia. Employment status depends on ability, opportunity, education, and cultural influences. A clinician-rated scale of work readiness, independent of current work status, can be a valuable assessment tool. A series of studies were conducted to create and validate a Work Readiness Questionnaire (WoRQ) for clinicians to assess patient ability to engage in socially useful activity, independent of work availability. Content validity, test-retest and inter-rater reliability, and construct validity were evaluated in three separate studies. Content validity was supported. Cronbach's α was 0.91, in the excellent range. Clinicians endorsed WoRQ concepts, including treatment adherence, physical appearance, social competence, and symptom control. The final readiness decision showed good test-retest reliability and moderate inter-rater reliability. Work readiness was associated with higher function and lower levels of negative symptoms. Low positive and high negative predictive values confirmed the concept validity. The WoRQ has suitable psychometric properties for use in a clinical trial for patients with a broad range of symptom severity. The scale may be applicable to assess therapeutic interventions. It is not intended to assess eligibility for supported work interventions. The WoRQ is suitable for use in schizophrenia clinical trials to assess patient work functional potential.

Program of internal training of the ININ personnel participating in the PERE of the CLV (1998). I. Initial evaluation

International Nuclear Information System (INIS)

Suarez, G.

1999-01-01

According to the document 'Program of Internal Training of the Personnel of the ININ participant in the PERE of the CLV (1998)' presented to the National Center of Disasters Prevention, it was included an action of previous evaluation to courses and practices with the purpose of knowing the state of knowledge regarding those activities that have to carry out. In this report the results of the evaluation are presented. Six questionnaires were elaborated: 1. The PERE and its procedures. 2. Control of the radiological exposure of the response personnel. 3. Control of water and foods. 4. Communications system of the PERE. 5. Monitoring, classification and decontamination of having evacuated. 6. Specialized medical attention. (Author)

Questionnaires for Measuring Refractive Surgery Outcomes.

Science.gov (United States)

Kandel, Himal; Khadka, Jyoti; Lundström, Mats; Goggin, Michael; Pesudovs, Konrad

2017-06-01

To identify the questionnaires used to assess refractive surgery outcomes, assess the available questionnaires in regard to their psychometric properties, validity, and reliability, and evaluate the performance of the available questionnaires in measuring refractive surgery outcomes. An extensive literature search was done on PubMed, MEDLINE, Scopus, CINAHL, Cochrane, and Web of Science databases to identify articles that described or used at least one questionnaire to assess refractive surgery outcomes. The information on content quality, validity, reliability, responsiveness, and psychometric properties was extracted and analyzed based on an extensive set of quality criteria. Eighty-one articles describing 27 questionnaires (12 refractive error-specific, including 4 refractive surgery-specific, 7 vision-but-non-refractive, and 8 generic) were included in the review. Most articles (56, 69.1%) described refractive error-specific questionnaires. The Quality of Life Impact of Refractive Correction (QIRC), the Quality of Vision (QoV), and the Near Activity Visual Questionnaire (NAVQ) were originally constructed using Rasch analysis; others were developed using the Classical Test Theory. The National Eye Institute Refractive Quality of Life questionnaire was the most frequently used questionnaire, but it does not provide a valid measurement. The QoV, QIRC, and NAVQ are the three best existing questionnaires to assess visual symptoms, quality of life, and activity limitations, respectively. This review identified three superior quality questionnaires for measuring different aspects of quality of life in refractive surgery. Clinicians and researchers should choose a questionnaire based on the concept being measured with superior psychometric properties. [J Refract Surg. 2017;33(6):416-424.]. Copyright 2017, SLACK Incorporated.

The NLM evaluation lecture series: introduction to the special section on evaluating health communication programs.

Science.gov (United States)

Logan, Robert A; Kreps, Gary L

2014-12-01

This article introduces the Journal of Health Communication's special section, Evaluating Health Communication Programs. This special section is based on a public lecture series supported by the National Library of Medicine titled "Better Health: Evaluating Health Communication Programs" designed to share best practices for using evaluation research to develop, implement, refine, and institutionalize the best health communication programs for promoting public health. This introduction provides an overview to the series, summarizes the major presentations in the series, and describe implications from the series for translational health communication research, interventions, and programs that can enhance health outcomes.

The formulation of a peer evaluation measure for special forces: operational forces operator traits and attitude questionnaire (SFO-TAQ)

CSIR Research Space (South Africa)

Van Heerden, A

2016-11-01

Full Text Available International Military Testing Association (IMTA) Conference, New Delhi, India, 7-11 November 2016 The formulation of a peer evaluation measure for special forces: operational forces operator traits and attitude questionnaire (SFO-TAQ) Van Heerden A...

Chinese adaptation of Emotion Regulation Questionnaire for Children and Adolescents (ERQ-CCA): A psychometric evaluation in Chinese children.

Science.gov (United States)

Liu, Wen; Chen, Liang; Tu, Xintian

2017-10-01

This study validated a Chinese adaptation of the Emotion Regulation Questionnaire for Children and Adolescents (ERQ-CCA), a self-report instrument that evaluates two emotion regulation (ER) strategies, based on the process model of ER. The ERQ-CCA was evaluated using a sample of 1381 Chinese children aged between 7 and 12 years. The internal consistencies of the two factors indicated adequate reliability. Confirmatory factor analysis (CFA) revealed good support as the structure proved to be identical with that of the original instrument. Multigroup CFA supported an invariant factor solution of the ERQ-CCA across several demographic variations (gender, age, registered permanent residence and migrant status) in different groups. Test-retest correlations over a 2-month period were calculated using a subsample of children (N = 70). Convergent validity was evaluated in relation to the model dimensions of the ERQ-CCA, Chinese version of the Children's Depression Inventory, and Chinese version of the Eysenck Personality Questionnaire for Children and Adolescents. Results indicated that the ERQ-CCA has generally satisfactory reliability and validity in investigating the use of two ER strategies during the middle childhood developmental period. © 2015 International Union of Psychological Science.

Voiding patterns in men evaluated by a questionnaire survey

DEFF Research Database (Denmark)

Sommer, P; Nielsen, K K; Bauer, T

1990-01-01

A questionnaire on obstructive and irritative voiding symptoms was sent to 572 men aged between 20 and 79 years, selected at random from the National Register; 337 questionnaires were completed. None of the responders had consulted a doctor because of voiding symptoms. There was a significant...... voiding symptoms in men aged 60 to 79 years without subjective prostatism was the same as in patients admitted with prostatism, although most of the men had milder symptoms. Only nocturia and urge incontinence were more prevalent in patients admitted with prostatism. About 20% of men in the oldest decades...... had symptoms equal in severity to those found in men undergoing prostatectomy; 29% and 11% of men in the eighth decade [corrected] had nocturia twice and 3 times or more respectively; 19% complained of urge incontinence. More information on possible treatment is needed....

Evaluation of the Effect of Physical Activity Programs on Self-Esteem and Body Mass Index of Overweight Adolescent Girls, based on Health Belief Model with School-Centered Approach

Directory of Open Access Journals (Sweden)

Leili Rabiei

2018-02-01

Full Text Available Background: Obesity in adolescents leads to physical and mental complications. Exercise is one of the main components of weight control programs. This study aimed to evaluate the effect of physical activity programs on self-esteem and Body Mass Index of overweight adolescent girls. Materials and Methods: This study was a semi experimental study.The subjects were 140 second grade student girls from two high schools in 5th district of Isfahan. Data collection scales included: tape measure, carriage scale, questionnaire to collect background and personal information, designed questionnaire based on Health Belief Model, weekly physical self- reportedand adolescent weekly food record form, parent’s nutritional performance questionnaire, teachers’ attitude on adolescents’ nutrition questionnaire and Cooper Smith's Standard Self-esteem questionnaire. Education based program on Health Belief Model for improving nutritional status consistent with model structures during six sessions each 60-minute was conducted with emphasis on diet to control weight in overweight and at-risk adolescents. Questionnaires were compared immediately afterand two months after intervention. Results: Average score of model structures and self-esteem of students in both groups had no significant difference at baseline, but immediately after and 2 months after the intervention, the mean component scores were significantly higher in intervention group in comparison with the control group. There was a significant difference in component scores at different times in the experimental group. Significant difference in BMI scores was seen at different times in experimental group. Conclusion: Findings of this study showed that school based approach of physical activity training leads to increase in knowledge, sensitivity, severity and perceived benefits and eventually increase in self- esteem and physical activity in students.

Prospective evaluation of PBC-specific health-related quality of life questionnaires in patients with primary sclerosing cholangitis.

Science.gov (United States)

Raszeja-Wyszomirska, Joanna; Wunsch, Ewa; Krawczyk, Marek; Rigopoulou, Eirini I; Bogdanos, Dimitrios; Milkiewicz, Piotr

2015-06-01

Primary biliary cirrhosis and Primary sclerosing cholangitis are autoimmune cholestatic liver diseases sharing a lot in common, including a significant impairment of patients' health-related quality of life HRQoL HRQoL in PBC is assessed with disease-specific PBC-40 and PBC-27 questionnaires. A PSC-specific questionnaire has not been developed. Neither PBC-40 nor PBC-27s applicability for PSC has been evaluated. We applied these three questionnaires for HRQoL assessment in a large homogenous cohort of PSC patients. This cross-sectional study enrolled 102 Caucasian PSCs and 53 matched healthy controls and measured HRQoL using generic SF-36, and disease-specific (PBC-40/PBC-27) questionnaires. (i) SF-36. Most SF-36 domains were significantly lower in PSCs than controls. Physical Functioning and Mental Component Summary scores were significantly lower in female patients and correlated negatively with age but not with concurrent inflammatory bowel disease. Cirrhosis was associated with lower Physical Functioning, Role Physical, General Health, Vitality and Physical Component Summary. (ii) PBC-40 and PBC-27. Both tools showed similar HRQoL impairment scoring. Fatigue and Cognitive were impaired in female patients. Several correlations existed between HRQoL and laboratory parameters, including cholestatic tests and Itch. Cirrhosis correlated with Other symptoms and Fatigue PBC-40. (iii) PBC-40 vs PBC-27. Strong correlations among most domains of both questionnaires were seen, as well as between (iv) SF-36 vs PBC-40 or SF-36 vs PBC-27. This is the first study directly comparing PBC-40, PBC-27 and SF-36 in PSC. PSC patients, especially females, show HRQoL impairment. PBC-40 and PBC-27 questionnaires could be of potential use for HRQoL assessment in PSC. © 2014 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Assessing obstetric patient experience: a SERVQUAL questionnaire.

Science.gov (United States)

Garrard, Francesca; Narayan, Harini

2013-01-01

Across health services, there is a drive to respond to patient feedback and to incorporate their views into service improvement. The SERVQUAL method has been used in several clinical settings to quantify whether services meet patient expectations. However, work has been limited in the obstetric population. This paper seeks to address these issues. This study used an adapted SERVQUAL questionnaire to assess a reconfigured antenatal clinic service. The most important care aspects, as rated by patients, were used to construct the SERVQUAL questions. The questionnaire was administered to eligible women in two parts. The first was completed before their first hospital antenatal appointment and the second either at home (a postal-chasing exercise) or while waiting for their next appointment. Only fully completed questionnaires (both parts) were analysed. Service strengths included staff politeness, patient respect and privacy. Areas for improvement included hand cleanliness, women's involvement in decision making and communicating risk. However, the low variability in patient responses makes concrete conclusions difficult and methodological issues complicate evaluating hand cleanliness. The new antenatal clinic service received low negative weighted and un-weighted overall scores. The SERVQUAL measure was developed from patient feedback and used to further improve services. The SERVQUAL-based measure allowed an internal evaluation of patient experience and highlighted areas for improvement. However, without validation, the questionnaire cannot be used as an outcome measure and variation between published SERVQUAL questionnaires makes comparisons difficult. This highlights an important balance in patient evaluation measures--between locally responsive and externally comparable. The SERVQUAL approach allows healthcare teams to evaluate patient experience, while accounting for variation in their expectations and priorities. The study highlights several areas that are

Evaluation of an international faculty development program for developing countries in Asia: the Seoul Intensive Course for Medical Educators.

Science.gov (United States)

Kim, Do-Hwan; Yoon, Hyun Bae; Sung, Minsun; Yoo, Dong-Mi; Hwang, Jinyoung; Kim, Eun Jung; Lee, Seunghee; Shin, Jwa-Seop

2015-12-18

The issue of collaboration in medical education is becoming prominent. Some faculty development programs have suggested an approach for promoting collaboration on a global level. However, non-English-speaking developing countries in Asia, especially in Southeast Asia, do not take advantage of them due to their unique context, such as language and culture. To address these issues, Seoul National University College of Medicine initiated a 6-week international faculty development program called the "Seoul Intensive Course for Medical Educators" for 16 fellows from five Asian countries (Cambodia, Laos, Mongolia, Myanmar, and Vietnam). The aim of this study is to report the evaluation results of the outcome of the program and discuss better ways of collaborating with developing countries. Three levels of collaboration-intraorganizational, intranational, and international-were central initiatives of the program. Prior to setting up the program details, we first established four design principles, following which the contents, materials, and facilitators were determined to maintain consistency with the design principles. The evaluation of the program was done with Kirkpatrick's four-level model. Most of the evaluation data for level 1 were collected by two questionnaires, the post-module survey and the post-program survey. Portfolios and progress reports were mainly used to collect outcome data for levels 2 and 3, respectively. The reaction was generally positive throughout the program and there was a significant correlation between satisfaction and relevance to one's job or needs. Despite the fellows' propensity for overestimating themselves, both the evaluators and fellows reported that there was significant improvement in learning. Opinions on the impact or urgency of the topics were slightly different from country to country; however, the answers regarding feasibility were fairly similar. Moreover, we could observe from the post-program progress reports that the

[A specific questionnaire to evaluate therapeutic inertia in hypertensive patients: a pilot study].

Science.gov (United States)

Pretorean, T; Claisse, G; Delsart, P; Caudrelier, T; Devos, P; Mounier-Vehier, C

2014-02-01

Therapeutic inertia (TI) is a recent concept still unknown by many physicians. In chronic diseases such as hypertension, it is defined as the tendency of physicians not to increase or change antihypertensive medications when the target blood pressure is not reached. Acting on TI could improve blood pressure control in France. This was a single-center prospective pilot study conducted by hypertension specialist physicians at the University Cardio-Vascular Center in Lille (France). It was conducted between March and June 2011. Data was collected from 161 hypertensive patients (mean age: 61.64±11.18 years; 98 (60.9%) male; 75 secondary prevention patients). Each physician completed a questionnaire on therapeutic inertia. TI was defined as a consultation in which treatment change was indicated (systolic blood pressure [BP]≥140 and/or diastolic BP≥90mmHg in all patients), but did not occur, with absence of an adapted justification of this choice. We considered as an adapted justification: a white coat effect demonstrated by ambulatory blood pressure monitoring (ABPM) or home blood pressure monitoring; scheduled reassessment of the BP by ABPM; recent change in antihypertensive treatment (less than 4 weeks); hospitalization needed for complete evaluation of secondary causes of hypertension and a more detailed assessment of potential target organ damage in patients with grade 1 or 2 hypertension. Our study aimed to evaluate rates of TI, to identify factors associated with TI, and to test the TI questionnaire. Therapeutic inertia as defined in this study occurred in 11 consultations (8.3%) of the 133 hypertensive patients having uncontrolled BP above or equal to 140 and/or 90mmHg. Significant factors associated with TI were older age (Z=2.35, PP>0.05) and the number of consultations (Z=1.92, 0.1>P>0.05) exhibited a significant trend to be associated with TI. Although the rate of TI was low in our study conducted in a specialized center, a well-accepted definition of

Evaluation of Big Five model in Serbian culture by FIBI questionnaire

Directory of Open Access Journals (Sweden)

Čolović Petar

2005-01-01

Full Text Available The main purpose of this study was to evaluate personality dimensions, proposed by Big Five model, in our culture, by the use of the questionnaire FIBI, developed on the basis of the psycho lexical study of personality descriptions in Serbian language (Smederevac, 2000. There were 627 subjects in the study (407 females and 220 males, aged 17 to 77, and the inventory UKL7 (Smederevac, 2000 and the Big Five Inventory (BFI; John, Donahue, Kentle, 1991; John, Srivastava, 1999 were applied. The FIBI inventory was created from UKL7 by exclusion of evaluative items, items of probable artificial factor Emotional control and items with poor psychometric properties were excluded. Final solution with 69 items demonstrated solid psychometric properties. The construct validity of the FIBI has been assessed by examination of its relationship to the Big Five Inventory and results showed that scales Conventionality and Extraversion in those two inventories differ in content. Subscale Conventionality in FIBI was highly related to subscale Consciousness in BFI and showed no significant correlation to Openness to Experience of the BFI. The content of the FIBI's Extraversion scale includes positive self-evaluation, assertiveness and activity. Indicators of sociability, usually considered as dominant (or at least very important markers of extraverted behavior, were omitted from the FIBI Extraversion scale. These content differences justify application of the emic approach in the personality psychology research. Although there are some other available instruments based on Big Five, FIBI represents product of our cultural background and seems to be worth of further examination and improvement.

International evaluation of the psychometrics of health-related quality of life questionnaires for use among long-term survivors of testicular and prostate cancer.

Science.gov (United States)

van Leeuwen, Marieke; Kieffer, Jacobien M; Efficace, Fabio; Fosså, Sophie D; Bolla, Michel; Collette, Laurence; Colombel, Marc; De Giorgi, Ugo; Holzner, Bernhard; van de Poll-Franse, Lonneke V; van Poppel, Hendrik; White, Jeff; de Wit, Ronald; Osanto, Susanne; Aaronson, Neil K

2017-05-11

Understanding of the physical, functional and psychosocial health problems and needs of cancer survivors requires cross-national and cross-cultural standardization of health-related quality of life (HRQoL) questionnaires that capture the full range of issues relevant to cancer survivors. To our knowledge, only one study has investigated in a comprehensive way whether a questionnaire used to evaluate HRQoL in cancer patients under active treatment is also reliable and valid when used among (long-term) cancer survivors. In this study we evaluated, in an international context, the psychometrics of HRQoL questionnaires for use among long-term, disease-free, survivors of testicular and prostate cancer. In this cross-sectional study, we recruited long-term survivors of testicular and prostate cancer from Northern and Southern Europe and from the United Kingdom who had participated in two phase III EORTC clinical trials. Participants completed the SF-36 Health Survey, the EORTC QLQ-C30 questionnaire, the QLQ-PR25 (for prostate cancer) or the QLQ-TC26 (for testicular cancer) questionnaires, and the Impact of Cancer questionnaire. Testicular cancer survivors also completed subscales from the Nordic Questionnaire for Monitoring the Age Diverse Workforce. Two hundred forty-two men (66% response rate) were recruited into the study. The average time since treatment was more than 10 years. Overall, there were few missing questionnaire data, although scales related to sexuality, satisfaction with care and relationship concerns of men without partners were missing in more than 10% of cases. Debriefing showed that in general the questionnaires were accepted well. Many of the survivors scored at the upper extremes of the questionnaires, resulting in floor and ceiling effects in 64% of the scales. All of the questionnaires investigated met the threshold of 0.70 for group level reliability, with the exception of the QLQ-TC26 (mean reliability .64) and the QLQ-PR25 (mean reliability

Which Questionnaire Should Be Used to Measure Quality-of-Life Utilities in Patients with Acute Leukemia? An Evaluation of the Validity and Interpretability of the EQ-5D-5L and Preference-Based Questionnaires Derived from the EORTC QLQ-C30.

Science.gov (United States)

van Dongen-Leunis, Annemieke; Redekop, W Ken; Uyl-de Groot, Carin A

The aim of this study was to assess the validity and interpretability of different preference-based questionnaires (generic 5-level EuroQol five-dimensional questionnaire [EQ-5D-5L], cancer-specific Quality of Life Questionnaire Preference-Based Measure, and European Organization of Randomized Controlled Trials 8 Dimension [EORTC-8D]) in patients with acute leukemia. Patients who participated in Hemato-Oncologie voor Volwassenen Nederland (HOVON - the Haemato Oncology Foundation for Adults in the Netherlands) clinical trials between 1999 and 2011 at a single hospital were invited to complete the questionnaires. Interpretability was evaluated by the frequency of incomplete data and highest and lowest possible scores. Content validity was evaluated by exploring the health-related quality-of-life domains included in the questionnaires. Construct validity was assessed using correlations with other quality-of-life scales (EQ-visual analogue scale score and global quality-of-life scale of the EORTC Quality of Life Questionnaire) and ability to distinguish between patients with different health statuses. Questionnaires were returned by 89% (111 of 125) of the patients. Six to seven respondents did not return full questionnaires. Perfect health on the EQ-5D-5L was reported by 32 respondents and many of them (N = 17) did report health problems on other questionnaires. All questionnaires were strongly correlated (range 0.61-0.78) with other quality-of-life scales and yielded substantially different utility values for patients with different health statuses. Nevertheless, the disease-specific preference-based questionnaires showed greater discriminatory power. Although the Quality of Life Questionnaire Preference-Based Measure and the EORTC-8D appear to have better validity, this study does not provide any strong evidence against the use of the EQ-5D-5L for measuring quality-of-life utilities in acute leukemia. However, our findings need to be confirmed in larger longitudinal

The construction of a questionnaire to evaluate the science orientedness of students’ identities as learners from a cognitive perspective

NARCIS (Netherlands)

Taconis, R.; Putter-Smits, de L.G.A.; Henry, S.F.; Brok, den P.J.; Beijaard, D.

2010-01-01

Forming a science-oriented identity is considered a process underlying both interest and achievement in science education. A questionnaire is developed for describing "identities as learners" and evaluating their science orientedness. The instrument (k = 65) focuses on cognitive aspects. An internal

Questionnaires that screen for multiple sleep disorders.

Science.gov (United States)

Klingman, Karen J; Jungquist, Carla R; Perlis, Michael L

2017-04-01

The goal of this review was to identify, describe, and evaluate the existing multiple sleep disorders screening questionnaires for their comprehensiveness, brevity, and psychometric quality. A systematic review was conducted using Medline/PubMed, cumulative index to nursing & allied health literature, health and psychosocial instruments and the "grey literature". Search terms were "sleep disorders, screening, questionnaires, and psychometrics". The scope of the search was limited to English language articles for adult age groups from 1989 through 2015. Of the n = 2812 articles identified, most were assessment or treatment guideline reviews, topical reviews, and/or empirical articles. Seven of the articles described multiple sleep disorders screening instruments. Of the identified instruments, two questionnaires (the Holland sleep Disorders questionnaire and sleep-50) were evaluated as comprehensive and one questionnaire (the global sleep assessment questionnaire [GSAQ]) was judged to be both comprehensive and efficient. The GSAQ was found to cover four of the six core intrinsic disorders, sleep insufficiency, and daytime sequela with 11 questions. Accordingly, the GSAQ is the most suitable for application as a general sleep disorders screener. Additional work is required to validate this instrument in the context of primary care. Finally, the future development of multiple sleep disorders screening questionnaires should not only cover all six intrinsic sleep disorders but also acquire some basic demographic information (age, sex, body mass index, presence/absence of bed partner, work status and shift) and some limited data regarding sleep sufficiency and the daytime consequences of sleep disturbance. Copyright © 2016 Elsevier Ltd. All rights reserved.

The evaluation of a culturally appropriate, community-based lifestyle intervention program for elderly Chinese immigrants with chronic diseases: a pilot study.

Science.gov (United States)

Lu, Yifan; Dipierro, Moneika; Chen, Lingjun; Chin, Richard; Fava, Maurizio; Yeung, Albert

2014-03-01

The 'Healthy Habits Program' is a 6-month community-based program, which offers exercise facilities, training and weekly health education group to underserved elderly Chinese Americans with chronic medical diseases in their native languages. This pilot study evaluates the acceptability and the health effects of the 'Healthy Habits Program'. Ninety-nine subjects participated in the 'Healthy Habits Program' in 2011. Before and after the program, the participants were assessed in their physical and mental health using various fitness tests as well as measures of disability and psychological functioning. Participants provided overwhelmingly positive feedback on the program, which was associated with significant improvements in physical and mental health including a significant decrease in body mass index (BMI), blood pressure and increase in stamina. The participants reported lower mean scores on the Patient Health Questionnaire-9 item Scale (PHQ-9), indicating improved psychological well-being. These promising pilot study results from this lifestyle intervention program for elderly Chinese American immigrants with chronic diseases inform the design of a more definitive trial using a randomized design and larger sample size.

Process Evaluation for a Prison-based Substance Abuse Program.

Science.gov (United States)

Staton, Michele; Leukefeld, Carl; Logan, T. K.; Purvis, Rick

2000-01-01

Presents findings from a process evaluation conducted in a prison-based substance abuse program in Kentucky. Discusses key components in the program, including a detailed program description, modifications in planned treatment strategies, program documentation, and perspectives of staff and clients. Findings suggest that prison-based programs have…

FHWA Research and Technology Evaluation: Public-Private Partnership Capacity Building Program

Science.gov (United States)

2018-02-01

This report details the evaluation of the Federal Highway Administrations Office of Innovative Program Delivery Public-Private Partnership (P3) Capacity Building Program (P3 Program). The evaluators focused on the P3 Programs P3 Toolkit as an e...

Process Evaluation and Continuous Improvement in Community Youth Programs

Directory of Open Access Journals (Sweden)

Jennifer V. Trachtenberg

2008-06-01

Full Text Available A method of using process evaluation to provide improvement plans in order to promote community youth programs is described. The core elements of this method include the following: (1 collection and analysis of baseline data, (2 feedback provided to programs describing their strengths and limitations, (3 programs provided with assistance in preparing improvement plans in regard to their baseline data, and (4 follow-up evaluation assessed program changes based on their improvement plans and baseline data. A case study of an inner-city neighborhood youth center is used to demonstrate this method.

Evaluability Assessment of a National Driver Retraining Program: Are We Evaluating in the Right Lane?

Science.gov (United States)

Joanisse, Melanie; Stinchcombe, Arne; Yamin, Stephanie

2010-01-01

An evaluability assessment (EA) of the 55 Alive program, a national older driver refresher course aimed at improving driving skills, was conducted. This EA adds to the evaluation literature as previous outcome evaluations neglected to explore whether this program was prepared for such assessments. A mixed-method protocol was executed across three…

1992-1993 Bonneville Appliance Efficiency Program: Showerhead evaluation. Volume I - report

Energy Technology Data Exchange (ETDEWEB)

Warwick, W.M.

1995-01-01

The Bonneville Power Administration (Bonneville) provides wholesale electric power to over 100 retail distribution utilities in the Pacific Northwest. Bonneville is faced with meeting growing loads from these utilities. It acquires conservation as one means of meeting this load growth. Bonneville has offered a variety of conservation programs since 1980. Efficient showerheads have been a feature in residential conservation programs ever since. Bonneville launched the Residential Appliance Efficiency Program to focus on water-heater energy conservation opportunities in 1992. The Residential Appliance Efficiency Program consists of two parts, a water-heater efficiency program, and a hot-water efficiency program. This report evaluates the savings and costs of the first two years of the showerhead portion of the Residential Appliance Efficiency Program (the showerhead program). Although it is not a formal evaluation of the program limited to implementation or a {open_quotes}process{close_quotes} evaluation, observations about program design and implementation are included as appropriate. Results of this evaluation are limited to program participants within the Bonneville service territory.

Economic value evaluation in disease management programs.

Science.gov (United States)

Magnezi, Racheli; Reicher, Sima; Shani, Mordechai

2008-05-01

Chronic disease management has been a rapidly growing entity in the 21st century as a strategy for managing chronic illnesses in large populations. However, experience has shown that disease management programs have not been able to demonstrate their financial value. The objectives of disease management programs are to create quality benchmarks, such as principles and guidelines, and to establish a uniform set of metrics and a standardized methodology for evaluating them. In order to illuminate the essence of disease management and its components, as well as the complexity and the problematic nature of performing economic calculations of their profitability and value, we collected data from several reports that dealt with the economic intervention of disease management programs. The disease management economic evaluation is composed of a series of steps, including the following major categories: data/information technology, information generation, assessment/recommendations, actionable customer plans, and program assessment/reassessment. We demonstrate the elements necessary for economic analysis. Disease management is one of the most innovative tools in the managed care environment and is still in the process of being defined. Therefore, objectives should include the creation of quality measures, such as principles and guidelines, and the establishment of a uniform set of metrics and a standardized methodology for evaluating them.

78 FR 29375 - Protected Critical Infrastructure Information (PCII) Office Self-Assessment Questionnaire

Science.gov (United States)

2013-05-20

... Information (PCII) Office Self- Assessment Questionnaire AGENCY: National Protection and Programs Directorate... comments concerning New Information Collection Request, PCII Officer Questionnaire. DHS previously... without alteration at http://www.regulations.gov , including any personal information provided. OMB is...

Evaluating and Selecting Sport Management Undergraduate Programs.

Science.gov (United States)

Cuneen, Jacquelyn; Sidwell, M. Joy

1998-01-01

States that the accelerated growth of sport management undergraduate programs that began in the 1980s has continued into the current decade. There are currently 180 sport management major programs in American colleges and universities. Describes the sports management approval process and suggests useful strategies to evaluate sport management…

The pornography craving questionnaire: psychometric properties.

Science.gov (United States)

Kraus, Shane; Rosenberg, Harold

2014-04-01

Despite the prevalence of pornography use, and recent conceptualization of problematic use as an addiction, we could find no published scale to measure craving for pornography. Therefore, we conducted three studies employing young male pornography users to develop and evaluate such a questionnaire. In Study 1, we had participants rate their agreement with 20 potential craving items after reading a control script or a script designed to induce craving to watch pornography. We dropped eight items because of low endorsement. In Study 2, we revised both the questionnaire and cue exposure stimuli and then evaluated several psychometric properties of the modified questionnaire. Item loadings from a principal components analysis, a high internal consistency reliability coefficient, and a moderate mean inter-item correlation supported interpreting the 12 revised items as a single scale. Correlations of craving scores with preoccupation with pornography, sexual history, compulsive internet use, and sensation seeking provided support for convergent validity, criterion validity, and discriminant validity, respectively. The enhanced imagery script did not impact reported craving; however, more frequent users of pornography reported higher craving than less frequent users regardless of script condition. In Study 3, craving scores demonstrated good one-week test-retest reliability and predicted the number of times participants used pornography during the following week. This questionnaire could be applied in clinical settings to plan and evaluate therapy for problematic users of pornography and as a research tool to assess the prevalence and contextual triggers of craving among different types of pornography users.

ENergy and Power Evaluation Program

Energy Technology Data Exchange (ETDEWEB)

NONE

1996-11-01

In the late 1970s, national and international attention began to focus on energy issues. Efforts were initiated to design and test analytical tools that could be used to assist energy planners in evaluating energy systems, particularly in developing countries. In 1984, the United States Department of Energy (DOE) commissioned Argonne National Laboratory`s Decision and Information Sciences Division (DIS) to incorporate a set of analytical tools into a personal computer-based package for distribution in developing countries. The package developed by DIS staff, the ENergy and Power Evaluation Program (ENPEP), covers the range of issues that energy planners must face: economic development, energy demand projections, supply-and-demand balancing, energy system expansion, and environmental impact analysis. Following the original DOE-supported development effort, the International Atomic Energy Agency (IAEA), with the assistance from the US Department of State (DOS) and the US Department of Energy (DOE), provided ENPEP training, distribution, and technical support to many countries. ENPEP is now in use in over 60 countries and is an international standard for energy planning tools. More than 500 energy experts have been trained in the use of the entire ENPEP package or some of its modules during the international training courses organized by the IAEA in collaboration with Argonne`s Decision and Information Sciences (DIS) Division and the Division of Educational Programs (DEP). This report contains the ENPEP program which can be download from the internet. Described in this report is the description of ENPEP Program, news, forums, online support and contacts.

Evaluation of programs to improve complementary feeding in infants and young children.

Science.gov (United States)

Frongillo, Edward A

2017-10-01

Evaluation of complementary feeding programs is needed to enhance knowledge on what works, to document responsible use of resources, and for advocacy. Evaluation is done during program conceptualization and design, implementation, and determination of effectiveness. This paper explains the role of evaluation in the advancement of complementary feeding programs, presenting concepts and methods and illustrating them through examples. Planning and investments for evaluations should occur from the beginning of the project life cycle. Essential to evaluation is articulation of a program theory on how change would occur and what program actions are required for change. Analysis of program impact pathways makes explicit the dynamic connections in the program theory and accounts for contextual factors that could influence program effectiveness. Evaluating implementation functioning is done through addressing questions about needs, coverage, provision, and utilization using information obtained from process evaluation, operations research, and monitoring. Evaluating effectiveness is done through assessing impact, efficiency, coverage, process, and causality. Plausibility designs ask whether the program seemed to have an effect above and beyond external influences, often using a nonrandomized control group and baseline and end line measures. Probability designs ask whether there was an effect using a randomized control group. Evaluations may not be able to use randomization, particularly for programs implemented at a large scale. Plausibility designs, innovative designs, or innovative combinations of designs sometimes are best able to provide useful information. Further work is needed to develop practical designs for evaluation of large-scale country programs on complementary feeding. © 2017 John Wiley & Sons Ltd.

Comparative Evaluation of Financing Programs: Insights From California’s Experience

Energy Technology Data Exchange (ETDEWEB)

Deason, Jeff [Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). Electricity Markets and Policy Group

2017-07-31

Berkeley Lab examines criteria for a comparative assessment of multiple financing programs for energy efficiency, developed through a statewide public process in California. The state legislature directed the California Alternative Energy and Advanced Transportation Financing Authority (CAEATFA) to develop these criteria. CAEATFA's report to the legislature, an invaluable reference for other jurisdictions considering these topics, discusses the proposed criteria and the rationales behind them in detail. Berkeley Lab's brief focuses on several salient issues that emerged during the criteria development and discussion process. Many of these issues are likely to arise in other states that plan to evaluate the impacts of energy efficiency financing programs, whether for a single program or multiple programs. Issues discussed in the brief include: -The stakeholder process to develop the proposed assessment criteria -Attribution of outcomes - such as energy savings - to financing programs vs. other drivers -Choosing the outcome metric of primary interest: program take-up levels vs. savings -The use of net benefits vs. benefit-cost ratios for cost-effectiveness evaluation -Non-energy factors -Consumer protection factors -Market transformation impacts -Accommodating varying program goals in a multi-program evaluation -Accounting for costs and risks borne by various parties, including taxpayers and utility customers, in cost-effectiveness analysis -How to account for potential synergies among programs in a multi-program evaluation

Development and Psychometric Evaluation of a Questionnaire Based on the Nursing Outcomes Classification to Determine the Knowledge of Parents on Breast-Feeding: Research Protocol.

Science.gov (United States)

Paloma-Castro, Olga; Romero-Sánchez, José Manuel; Paramio-Cuevas, Juan Carlos; Pastor-Montero, Sonia María; Del Carmen Sánchez-Dalda, María; Rozadillas-Sanmiguel, Elena; Moreno-Corral, Luis Javier

2017-04-01

To develop and psychometrically evaluate a questionnaire based on the outcome "Knowledge: Breast-feeding" of the Nursing Outcomes Classification (NOC) to determine the knowledge of parents on breast-feeding. The NOC outcome "Knowledge: Breast-feeding" allows for nurses/midwives to assess the efficacy of interventions aimed to improve the knowledge on breast-feeding in parents thought the clinical interview/observation. However, the use of self-administered questionnaires by patients could facilitate its evaluation. Two-phased study: (1) Development of the questionnaire based on experts' opinions; (2) Methodological design to assess its psychometric properties. The availability of tools that enable the determination of the knowledge of patients would facilitate nurses/midwives to set objectives, individualize interventions, and measure their effectiveness. © 2015 NANDA International, Inc.

The Evaluation Of A Diversity Program

Directory of Open Access Journals (Sweden)

Christa Fouche

2004-11-01

Die artikel evalueer die inhoud van ’n diversiteits-program wat ontwerp en ontwikkel is ten einde die redes waarom diversiteits-opleiding faal, aan te spreek.’n Groot maatskappy in die banksektor het die ontwikkeling geinisieer en ’n aantal senior personeellede is genader om die inhoud te evalueer. Daar is bevind dat die inhoud aan wêreldklas standaarde voldoen.

Repetitive Model Refinement for Questionnaire Design Improvement in the Evaluation of Working Characteristics in Construction Enterprises

Directory of Open Access Journals (Sweden)

Jeng-Wen Lin

2015-11-01

Full Text Available This paper presents an iterative confidence interval based parametric refinement approach for questionnaire design improvement in the evaluation of working characteristics in construction enterprises. This refinement approach utilizes the 95% confidence interval of the estimated parameters of the model to determine their statistical significance in a least-squares regression setting. If this confidence interval of particular parameters covers the zero value, it is statistically valid to remove such parameters from the model and their corresponding questions from the designed questionnaire. The remaining parameters repetitively undergo this sifting process until their statistical significance cannot be improved. This repetitive model refinement approach is implemented in efficient questionnaire design by using both linear series and Taylor series models to remove non-contributing questions while keeping significant questions that are contributive to the issues studied, i.e., employees’ work performance being explained by their work values and cadres’ organizational commitment being explained by their organizational management. Reducing the number of questions alleviates the respondent burden and reduces costs. The results show that the statistical significance of the sifted contributing questions is decreased with a total mean relative change of 49%, while the Taylor series model increases the R-squared value by 17% compared with the linear series model.

Association between sleep disorders, hyperacusis and tinnitus: Evaluation with tinnitus questionnaires

Directory of Open Access Journals (Sweden)

Alessandra B Fioretti

2013-01-01

Full Text Available Patients with tinnitus are heterogeneous and several factors influence the impact of this symptom on the quality of life. The aim of the study is to evaluate the relationship between age, gender, sleep disorders, hyperacusis and tinnitus annoyance and to demonstrate the utility of tinnitus questionnaires as screening tools for sleep disorders and hyperacusis in patients with tinnitus. 37 consecutive patients (18 males and 19 females with subjective tinnitus lasting over 3 months were evaluated with a complete interview, otological examination, pure tone audiometry, Italian version of tinnitus sample case history (TSCH and tinnitus handicap inventory (THI. Statistical analysis was performed with the Wilcoxon′s rank sum test, the Spearman′s rho non-parametric correlation and the logistic regression analysis. THI grades were slight (16%, mild (32%, moderate (30%, severe (19% and catastrophic (3%. Based on the answers to TSCH 20 patients reported sleep disorders (54% and 20 patients reported hyperacusis (54%. 11 patients (30% reported sleep disorders and hyperacusis. No significant correlation was found between the severity of tinnitus and patients′ age and gender. Significant correlation was found between sleep disorders (P = 0.0009 and tinnitus annoyance and between hyperacusis (P = 0.03 and tinnitus annoyance. TSCH and THI may be considered as screening tools in the clinical practice to evidence sleep disorders and hyperacusis in patients with tinnitus.

Development and validation of a beverage and snack questionnaire for use in evaluation of school nutrition policies.

Science.gov (United States)

Neuhouser, Marian L; Lilley, Sonya; Lund, Anne; Johnson, Donna B

2009-09-01

School nutrition policies limiting access to sweetened beverages, candy, and salty snacks have the potential to improve the health of children. To effectively evaluate policy success, appropriate and validated dietary assessment instruments are needed. The objective of this study was to develop and validate a beverage and snack questionnaire suitable for use among young adolescents. A new 19-item Beverage and Snack Questionnaire (BSQ) was administered to middle school students on two occasions, 2 weeks apart, to measure test-retest reliability. The questionnaire inquired about frequency of consumption, both at school and away from school, of soft drinks, salty snacks, sweets, milk, and fruits and vegetables. Students also completed 4-day food records. To assess validity, food-record data were compared with BSQ data. Forty-six students of diverse backgrounds from metropolitan Seattle, WA, participated in this study. Participants answered the BSQ during class time and completed the food record at home. Pearson correlation coefficients assessed test-retest reliability and validity. Using frequency per week data, the test-retest reliability coefficients were r=0.85 for fruits and vegetables consumed at school and r=0.74 and r=0.72 for beverages and sweets/snacks, respectively, consumed at school. Correlations ranged from r=0.73 to 0.77 for foods consumed outside of school. Compared with the criterion food record, validity coefficients were very good: r=0.69 to 0.71 for foods consumed at school and r=0.63 to 0.70 for foods consumed away from school. The validity coefficients for the 19 individual food items ranged from r=0.56 to 0.87. This easy-to-administer 19-item questionnaire captures data on sugar-sweetened beverages, salty snacks, sweets, milk, and fruit and vegetables as well as a more lengthy and expensive food record does. The BSQ can be used by nutrition researchers and practitioners to accurately evaluate student consumption of foods that are the focus of

Evaluating Youth Sexual Health Peer Education Programs: "Challenges and Suggestions for Effective Evaluation Practices"

Science.gov (United States)

Jaworsky, Denise; Larkin, June; Sriranganathan, Gobika; Clout, Jerri; Janssen, Jesse; Campbell, Lisa; Flicker, Sarah; Stadnicki, Dan; Erlich, Leah; Flynn, Susan

2013-01-01

Although peer sexual health education is a common form of sexual health promotion for youth, systematic reviews of these programs are relatively rare. In this study we interviewed youth peer educators to inquire about their experience of program evaluation and their perception of what is needed to develop effective evaluation practices. Data were…

A framework for telehealth program evaluation.

Science.gov (United States)

Nepal, Surya; Li, Jane; Jang-Jaccard, Julian; Alem, Leila

2014-04-01

Evaluating telehealth programs is a challenging task, yet it is the most sensible first step when embarking on a telehealth study. How can we frame and report on telehealth studies? What are the health services elements to select based on the application needs? What are the appropriate terms to use to refer to such elements? Various frameworks have been proposed in the literature to answer these questions, and each framework is defined by a set of properties covering different aspects of telehealth systems. The most common properties include application, technology, and functionality. With the proliferation of telehealth, it is important not only to understand these properties, but also to define new properties to account for a wider range of context of use and evaluation outcomes. This article presents a comprehensive framework for delivery design, implementation, and evaluation of telehealth services. We first survey existing frameworks proposed in the literature and then present our proposed comprehensive multidimensional framework for telehealth. Six key dimensions of the proposed framework include health domains, health services, delivery technologies, communication infrastructure, environment setting, and socioeconomic analysis. We define a set of example properties for each dimension. We then demonstrate how we have used our framework to evaluate telehealth programs in rural and remote Australia. A few major international studies have been also mapped to demonstrate the feasibility of the framework. The key characteristics of the framework are as follows: (a) loosely coupled and hence easy to use, (b) provides a basis for describing a wide range of telehealth programs, and (c) extensible to future developments and needs.

Using Evaluability Assessment to Improve Program Evaluation for the Blue-Throated Macaw Environmental Education Project in Bolivia

Science.gov (United States)

Salvatierra da Silva, Daniela; Jacobson, Susan K.; Monroe, Martha C.; Israel, Glenn D.

2016-01-01

An evaluability assessment of a program to save a critically endangered bird helped prepare the Blue-throated Macaw Environmental Education Project for evaluation and program improvement. The evaluability assessment facilitated agreement among key stakeholders on evaluation criteria and intended uses of evaluation information in order to maximize…

Education Model Program on Water-Energy Research: A New STEM Graduate Program from Development through Evaluation

Science.gov (United States)

McCay, D.; Fiorenza, P.; Lautz, L.

2017-12-01

More than half of Ph.D. scientists and engineers find employment in non-academic sectors. Recognizing the range of career options for graduate degree holders and the need to align graduate education with the expectations of prospective employers, the National Science Foundation (NSF) created the NSF Research Traineeship (NRT) program. To date, over 100 NRT programs have been funded. As these programs are implemented, it is important to assess their progress, successes, and challenges. This presentation describes the ongoing evaluation of one NRT program, "Education Model Program on Water-Energy Research" (or EMPOWER) at Syracuse University. Through seminars, mini-grants, professional development activities, field courses, internship opportunities, and coursework, EMPOWER's goal is to equip students with the skills needed for the range of career options in water and energy. In collaboration with an external evaluator, EMPOWER is examining the fidelity of the program to proposed goals, providing feedback to inform project improvement (formative assessment) and assessing the effectiveness of achieving program goals (summative assessment). Using a convergent parallel mixed method design, qualitative and quantitative data were collected to develop a full assessment of the first year of the program. Evaluation findings have resulted in several positive changes to the program. For example, EMPOWER students perceive themselves to have high technical skills, but the data show that the students do not believe that they have a strong professional network. Based on those findings, EMPOWER offered several professional development events focused on building one's professional network. Preliminary findings have enabled the EMPOWER leadership team to make informed decisions about the ways the program elements can be redesigned to better meet student needs, about how to the make the program more effective, and determine the program elements that may be sustained beyond the funding

Self evaluation of communication experiences after laryngeal cancer – A longitudinal questionnaire study in patients with laryngeal cancer

Directory of Open Access Journals (Sweden)

Finizia Caterina

2008-03-01

Full Text Available Abstract Background Aim of this longitudinal study was to investigate the sensitivity to change of the Swedish Self Evaluation of Communication Experiences after Laryngeal Cancer questionnaire (the S-SECEL, addressing communication dysfunction in patients treated for laryngeal cancer. Previous studies have highlighted the need for more specific questionnaires for this purpose. Methods 100 patients with Tis-T4 laryngeal cancer were included prior to treatment onset. Patients answered four questionnaires at six occasions during one year; the S-SECEL, the European Organisation for Research and Treatment of Cancer (EORTC Core Quality of Life Core Questionnaire (QLQ-C30 supplemented by the Head and Neck cancer module (QLQ-H&N35 and the Hospital Anxiety and Depression (HAD scale. In addition, performance status was assessed. Differences within groups were tested with the Wilcoxon paired signed ranks test and between-group analyses were carried out using the Mann-Whitney U test. Magnitude of group differences was analyzed by means of effect sizes. Results The S-SECEL was well accepted with a response rate of 76%. Communication dysfunction increased at 1 month, followed by a continuous decrease throughout the year. Changes were statistically significant at most measurement, demonstrating the sensitivity of the S-SECEL to changes in communication over time. The S-SECEL and the EORTC QLQ-C30 with the QLQ-H&N35 demonstrated similar results; however the S-SECEL was more sensitive regarding communication dysfunction. The largest changes were found in the most diagnose specific items concerning voice and speech. Conclusion The S-SECEL was investigated in the largest Scandinavian longitudinal study concerning health-related quality of life (HRQL in laryngeal cancer patients. The questionnaire was responsive to change and showed convergent results when compared to established HRQL questionnaires. Our findings also indicate that the S-SECEL could be a more

Program Evaluation of a Special Education Day School for Conduct Problem Adolescents.

Science.gov (United States)

Maher, Charles A.

1981-01-01

Describes a procedure for program evaluation of a special education day school. The procedure enables a program evaluator to: (1) identify priority evaluation information needs of a school staff, (2) involve those persons in evaluation design and implementation, and (3) determine the utility of the evaluation for program decision-making purposes.…

Wineries Evaluation of Costs and Benefits of Sustainability Certification Program: The Case of Terra Vitis in France.

Science.gov (United States)

Jourjon, Frederique; Chou, Hsia-Chi; Gezart, Anna; Kadison, Amy E; Martinat, Lea; Pomarici, Eugenio; Vecchio, Riccardo

2016-01-01

The current paper analyses the evaluation of the costs and benefits of French wineries (N=69) participating in the sustainability program Terra Vitis, a widespread environmental certification scheme within the French wine industry. An online questionnaire was sent to all Terra Vitis participants, in order to analyse the evaluation of economic costs and benefits (together with environmental benefits) as perceived by wineries. Our findings reveal that older participants in the scheme (over 5 years), firms with higher export share (>40% of annual turnover) and cooperative wineries tend to be keener to assign a positive evaluation to the benefits/costs ratio in both the vineyard and the winery. In the context of increasing concerns regarding the economic and environmental performance of the French agricultural sector, such findings and also the patent research could be useful for policy makers and entrepreneurs in defining mainstream normative and corporate strategies. Copyright© Bentham Science Publishers; For any queries, please email at epub@benthamscience.org.

The postgraduate hospital educational environment measure (PHEEM questionnaire identifies quality of instruction as a key factor predicting academic achievement

Directory of Open Access Journals (Sweden)

Joaquim Edson Vieira

2008-01-01

Full Text Available OBJECTIVE: This study analyzes the reliability of the PHEEM questionnaire translated into Portuguese. We present the results of PHEEM following distribution to doctors in three different medical residency programs at a university hospital in Brazil. INTRODUCTION: Efforts to understand environmental factors that foster effective learning resulted in the development of a questionnaire to measure medical residents' perceptions of the level of autonomy, teaching quality and social support in their programs. METHODS: The questionnaire was translated using the modified Brislin back-translation technique. Cronbach's alpha test was used to ensure good reliability and ANOVA was used to compare PHEEM results among residents from the Surgery, Anesthesiology and Internal Medicine departments. The Kappa coefficient was used as a measure of agreement, and factor analysis was employed to evaluate the construct strength of the three domains suggested by the original PHEEM questionnaire. RESULTS: The PHEEM survey was completed by 306 medical residents and the resulting Cronbach's alpha was 0.899. The weighted Kappa was showed excellent reliability. Autonomy was rated most highly by Internal Medicine residents (63.7% ± 13.6%. Teaching was rated highest in Anesthesiology (66.7% ± 15.4%. Residents across the three areas had similar perceptions of social support (59.0% ± 13.3% for Surgery; 60.5% ± 13.6% for Internal Medicine; 61.4% ± 14.4% for Anesthesiology. Factor analysis suggested that nine factors explained 58.9% of the variance. CONCLUSIONS: This study indicates that PHEEM is a reliable instrument for measuring the quality of medical residency programs at a Brazilian teaching hospital. The results suggest that quality of teaching was the best indicator of overall response to the questionnaire.

Psychometric evaluation of the general health questionnaire-12 and Rosenberg self-esteem scale in Hungarian and Slovak early adolescents

NARCIS (Netherlands)

Sarkova, M.; Nagyova, I.; Katreniakova, Z.; Geckova, A.M.; Orosova, O.; Middel, B.; van Dijk, J.P.; van den Heuvel, W.

2006-01-01

The reliability and factor structure of the General Health Questionnaire-12 (GHQ-12) and the Rosenberg Self-Esteem scale (RSE) were evaluated in samples of Hungarian and Slovak early adolescents. The principal component analyses support the two-factor solution for GHQ-12 with subscales

Cognitive Laboratory Experiences : On Pre-testing Computerised Questionnaires

NARCIS (Netherlands)

Snijkers, G.J.M.E.

2002-01-01

In the literature on questionnaire design and survey methodology, pre-testing is mentioned as a way to evaluate questionnaires (i.e. investigate whether they work as intended) and control for measurement errors (i.e. assess data quality). As the American Statistical Association puts it (ASA, 1999,

The design and evaluation of psychometric properties for a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis.

Science.gov (United States)

Mahmoudian, Amaneh; Torabi Chafjiri, Razieh; Alipour, Atefeh; Shamsalinia, Abbas; Ghaffari, Fatemeh

2018-01-01

Older adults with chronic disease are more vulnerable to abuse. Early and accurate detection of the elderly abuse phenomenon can help identify health-promoting solutions for the elderly, their family, and society. The purpose of this study was to design and evaluate the psychometric properties of a questionnaire on elderly abuse by family caregivers among older adults on hemodialysis. Qualitative and quantitative research methodologies were used to develop the questionnaire. The item pool was compiled from literature reviews and the Delphi method. The literature reviews comprised 22 studies. The psychometric properties of the questionnaire were verified using face, content, and construct validity, and the reliability was tested using Cronbach's alpha reliability. A 57-item questionnaire was developed after the psychometric evaluation. The Kaiser-Meyer-Olkin index and Bartlett's test of sphericity showed reliable results. Seven components from the exploratory content analysis including psychological misbehavior, authority deprivation, physical misbehavior, financial misbehavior, being abandoned, caring neglect, and emotional misbehavior explained 74.769% of the total variance. Cronbach's alpha was 0.98 and the interclass correlation coefficient was r =0.91 responding to the items twice ( p <0.001), which shows a high level of tool stability. This study developed a questionnaire to assess elderly abuse by family caregivers among older adults on hemodialysis. It is recommended as a mini scale that can be used both in statistical and practical studies, and that is valid and reliable. Nurses or other health care providers can use it in health centers, dialysis centers, or at the house of the patient.

Manipulator system man-machine interface evaluation program. [technology assessment

Science.gov (United States)

Malone, T. B.; Kirkpatrick, M.; Shields, N. L.

1974-01-01

Application and requirements for remote manipulator systems for future space missions were investigated. A manipulator evaluation program was established to study the effects of various systems parameters on operator performance of tasks necessary for remotely manned missions. The program and laboratory facilities are described. Evaluation criteria and philosophy are discussed.

Evaluation of otolaryngology residency program websites.

Science.gov (United States)

Svider, Peter F; Gupta, Amar; Johnson, Andrew P; Zuliani, Giancarlo; Shkoukani, Mahdi A; Eloy, Jean Anderson; Folbe, Adam J

2014-10-01

Prior to applying or interviewing, most prospective applicants turn to the Internet when evaluating residency programs, making maintenance of a comprehensive website critical. While certain "intangibles" such as reputation may not be communicated effectively online, residency websites are invaluable for conveying other aspects of a program. Prior analyses have reported that certain criteria such as research experience and didactics are important considerations for applicants. To evaluate the comprehensiveness of otolaryngology residency websites. Review of otolaryngology residency program websites. Websites of 99 civilian residency programs were searched for the presence of 23 criteria. Presence of 23 criteria for application process, incentives, instruction, research, clinical training, and other. Only 5 programs contained at least three-quarters of the criteria analyzed; on average programs reported less than 50% of information sought. Among the 99 residency program websites, a description of the following criteria was noted: comprehensive faculty listing (88%), didactics (80%), contact e-mail (77%), current residents (74%), description of facilities (70%), intern schedule (70%), research requirements (69%), otolaryngology rotation schedule (64%), other courses (61%), ERAS (Electronic Residency Application Service) link (55%), year-to-year responsibility progression (47%), call schedule (40%), active/past research projects (37%), area information (34%), message from the program director (33%) or chair (23%), selection criteria (30%), salary (directly on site) (23%), surgical statistics (18%), parking (9%), and meal allowance (7%). The mean (SD) percentage present of factors encompassing "clinical training" was 55% (23%), significantly higher than the mean (SD) percentage of factors covered under the "incentives" category (19% [11%]; P = .01). The proportion of overall criteria present on websites did not differ on organizing programs by region (range, 42