WorldWideScience

Sample records for resident assessment instrument

  1. Resident Assessment Instrument/Minimum Data Set (RAI/MDS)

    Data.gov (United States)

    Department of Veterans Affairs — The Resident Assessment Instrument/Minimum Data Set (RAI/MDS) is a comprehensive assessment and care planning process used by the nursing home industry since 1990 as...

  2. The Resident Assessment Instrument-Minimum Data Set 2.0 quality indicators: a systematic review

    Directory of Open Access Journals (Sweden)

    Squires Janet E

    2010-06-01

    Full Text Available Abstract Background The Resident Assessment Instrument-Minimum Data Set (RAI-MDS 2.0 is designed to collect the minimum amount of data to guide care planning and monitoring for residents in long-term care settings. These data have been used to compute indicators of care quality. Use of the quality indicators to inform quality improvement initiatives is contingent upon the validity and reliability of the indicators. The purpose of this review was to systematically examine published and grey research reports in order to assess the state of the science regarding the validity and reliability of the RAI-MDS 2.0 Quality Indicators (QIs. Methods We systematically reviewed the evidence for the validity and reliability of the RAI-MDS 2.0 QIs. A comprehensive literature search identified relevant original research published, in English, prior to December 2008. Fourteen articles and one report examining the validity and/or reliability of the RAI-MDS 2.0 QIs were included. Results The studies fell into two broad categories, those that examined individual quality indicators and those that examined multiple indicators. All studies were conducted in the United States and included from one to a total of 209 facilities. The number of residents included in the studies ranged from 109 to 5758. One study conducted under research conditions examined 38 chronic care QIs, of which strong evidence for the validity of 12 of the QIs was found. In response to these findings, the 12 QIs were recommended for public reporting purposes. However, a number of observational studies (n = 13, conducted in "real world" conditions, have tested the validity and/or reliability of individual QIs, with mixed results. Ten QIs have been studied in this manner, including falls, depression, depression without treatment, urinary incontinence, urinary tract infections, weight loss, bedfast, restraint, pressure ulcer, and pain. These studies have revealed the potential for systematic bias in

  3. Validating the Mental Health Assessment Protocols (MHAPs) in the Resident Assessment Instrument Mental Health (RAI-MH).

    Science.gov (United States)

    Martin, L; Hirdes, J P; Morris, J N; Montague, P; Rabinowitz, T; Fries, B E

    2009-09-01

    For persons with mental illness and addictions, comprehensive assessment of their strengths, preferences and needs is central to person-centred care planning. In this study, the validity of the Mental Health Assessment Protocols (MHAPs) embedded in the Resident Assessment Instrument Mental Health instrument (the mandated assessment system for Ontario adult inpatient psychiatry) is examined, and triggering rates are compared in inpatient and community-based mental health settings. The sample is based on adults admitted to a psychiatric facility (n = 963) and to community mental health programmes (n = 1505) participating in the study. An international panel of mental health experts further evaluated study results. Among the 27 MHAPs, all but one had sensitivity rates above 80%, and the specificity was over 80% for 74% of the MHAPs. The expert panel found that the MHAPs worked well and could be used to support mental health care. The present study found that the MHAPs are valid measures, though more complex triggering algorithms capable of differentiating individuals based on outcomes were suggested to enhance their clinical relevance to care planning. Further, the use of compatible instrumentation in community-based mental health settings was promoted to enhance continuity of care.

  4. Development and Testing of Screen-Based and Psychometric Instruments for Assessing Resident Performance in an Operating Room Simulator

    Directory of Open Access Journals (Sweden)

    Richard R. McNeer

    2016-01-01

    Full Text Available Introduction. Medical simulators are used for assessing clinical skills and increasingly for testing hypotheses. We developed and tested an approach for assessing performance in anesthesia residents using screen-based simulation that ensures expert raters remain blinded to subject identity and experimental condition. Methods. Twenty anesthesia residents managed emergencies in an operating room simulator by logging actions through a custom graphical user interface. Two expert raters rated performance based on these entries using custom Global Rating Scale (GRS and Crisis Management Checklist (CMC instruments. Interrater reliability was measured by calculating intraclass correlation coefficients (ICC, and internal consistency of the instruments was assessed with Cronbach’s alpha. Agreement between GRS and CMC was measured using Spearman rank correlation (SRC. Results. Interrater agreement (GRS: ICC = 0.825, CMC: ICC = 0.878 and internal consistency (GRS: alpha = 0.838, CMC: alpha = 0.886 were good for both instruments. Subscale analysis indicated that several instrument items can be discarded. GRS and CMC scores were highly correlated (SRC = 0.948. Conclusions. In this pilot study, we demonstrated that screen-based simulation can allow blinded assessment of performance. GRS and CMC instruments demonstrated good rater agreement and internal consistency. We plan to further test construct validity of our instruments by measuring performance in our simulator as a function of training level.

  5. Improvements in the quality of co-ordination of nursing care following implementation of the Resident Assessment Instrument in Dutch nursing homes.

    NARCIS (Netherlands)

    Achterberg, W.P.; Holtkamp, C.C.M.; Kerkstra, A.; Pot, A.M.; Ooms, M.E.; Ribbe, M.W.

    2001-01-01

    Aim: To study the effect of implementation of the Resident Assessment Instrument (RAI) on the quality of co-ordination of nursing care in Dutch nursing homes. Background: The Resident Assessment Instrument (RAI) was designed to improve the quality of care and quality of life in nursing homes. Until

  6. Predictors of Caregiver Distress in the Community Setting Using the Home Care Version of the Resident Assessment Instrument.

    Science.gov (United States)

    Pauley, Tim; Chang, Byung Wook; Wojtak, Anne; Seddon, Gayle; Hirdes, John

    The purpose of this study was to identify factors predictive of new onset and improved caregiver distress among informal caregivers providing assistance for clients receiving home care. Home care. The sample included 323,409 clients receiving home care from a Community Care Access Centre between March 2002 and March 2015 for whom data were available from two subsequent Resident Assessment Instrument-Home Care (RAI-HC) assessments. Separate multivariate logistic regression models were created for onset of and improvement in caregiver distress. Variables that increase the odds in onset of caregiver distress included primary caregiver is not satisfied with support received from family and friends; client lives with primary caregiver; 65 years and older; has Alzheimer and other related dementia; has condition or disease that makes cognition, activities of daily living, mood, or behavior patterns unstable; took sedatives in the last 7 days; Method for Assigning Priority Levels (MAPLe) score 4 or more; demonstrates persistent anger; has difficulty using the telephone; is married; requires 20 hr or more of informal help weekly; and Clinical Risk Scale score 4 or more. Variables that increased the odds of improved caregiver distress include client now lives with other persons (as compared with 90 days ago); demonstrates good prospects for recovery; treatment changes in last 30 days; surgical wound; female; one or more hospital visits in last 90 days; greater number of months between RAI-HC assessments; and two or more hours of physical activities in the last 3 days. Variables that decreased the odds of improved caregiver distress (i.e., persistent distress) include MAPLe score 4 or more; persistent anger; difficulty using telephone; Alzheimer, related dementia; requires interpreter; and lives with primary caregiver. Informal caregivers provide essential support for home care clients. Factors predictive of new onset and improved caregiver distress can be used by case

  7. A novel assessment of odor sources using instrumental analysis combined with resident monitoring records for an industrial area in Korea

    Science.gov (United States)

    Lee, Hyung-Don; Jeon, Soo-Bin; Choi, Won-Joon; Lee, Sang-Sup; Lee, Min-Ho; Oh, Kwang-Joong

    2013-08-01

    The residents living nearby the Sa-sang industrial area (SSIA) continuously were damaged by odorous pollution since 1990s. We determined the concentrations of reduced sulfur compounds (RSCs) [hydrogen sulfide (H2S), methyl mercaptan (CH3SH), dimethyl sulfide (DMS), and dimethyl disulfide (DMDS)], nitrogenous compounds (NCs) [ammonia (NH3) and trimethylamine (TMA)], and carbonyl compounds (CCs) [acetaldehyde and butyraldehyde] by instrumental analysis in the SSIA in Busan, Korea from Jun to Nov, 2011. We determined odor intensity (OI) based on the concentrations of the odorants and resident monitoring records (RMR). The mean concentration of H2S was 10-times higher than NCs, CCs and the other RSC. The contribution from RSCs to the OI was over 50% at all sites excluding the A-5 (chemical production) site. In particular, A-4 (food production) site showed more than 8-times higher the sum of odor activity value (SOAV) than the other sites. This suggested that the A-4 site was the most malodorous area in the SSIA. From the RMR analysis, the annoyance degree (OI ≥ 2) was 51.9% in the industrial area. The 'Rotten' smell arising from the RSCs showed the highest frequency (25.3%) while 'Burned' and 'Other' were more frequent than 'Rotten' in the residential area. The correlation between odor index calculated by instrumental analysis and OI from the RMR was analyzed. The Pearson correlation coefficient (r) of the SOAV was the highest at 0.720 (P food production causes significant annoyance in the SSIA. We also confirm RMR data can be used effectively to evaluate the characteristic of odorants emitted from the SSIA.

  8. Oral/dental items in the resident assessment instrument - minimum Data Set 2.0 lack validity: results of a retrospective, longitudinal validation study.

    Science.gov (United States)

    Hoben, Matthias; Poss, Jeffrey W; Norton, Peter G; Estabrooks, Carole A

    2016-01-01

    Oral health in nursing home residents is poor. Robust, mandated assessment tools such as the Resident Assessment Instrument - Minimum Data Set (RAI-MDS) 2.0 are key to monitoring and improving quality of oral health care in nursing homes. However, psychometric properties of RAI-MDS 2.0 oral/dental items have been challenged and criterion validity of these items has never been assessed. We used 73,829 RAI-MDS 2.0 records (13,118 residents), collected in a stratified random sample of 30 urban nursing homes in Western Canada (2007-2012). We derived a subsample of all residents ( n  = 2,711) with an admission and two or more subsequent annual assessments. Using Generalized Estimating Equations, adjusted for known covariates of nursing home residents' oral health, we assessed the association of oral/dental problems with time, dentate status, dementia, debris, and daily cleaning. Prevalence of oral/dental problems fluctuated (4.8 %-5.6 %) with no significant differences across time. This range of prevalence is substantially smaller than the ones reported by studies using clinical assessments by dental professionals. Denture wearers were less likely than dentate residents to have oral/dental problems (adjusted odds ratio [OR] = 0.458, 95 % confidence interval [CI]: 0.308, 0.680). Residents lacking teeth and not wearing dentures had higher odds than dentate residents of oral/dental problems (adjusted OR = 2.718, 95 % CI: 1.845, 4.003). Oral/dental problems were more prevalent in persons with debris (OR = 2.187, 95 % CI: 1.565, 3.057). Of the other variables assessed, only age at assessment was significantly associated with oral/dental problems. Robust, reliable RAI-MDS 2.0 oral health indicators are vital to monitoring and improving oral health related quality and safety in nursing homes. However, severe underdetection of oral/dental problems and lack of association of well-known oral health predictors with oral/dental problems suggest validity

  9. Oral/dental items in the resident assessment instrument – minimum Data Set 2.0 lack validity: results of a retrospective, longitudinal validation study

    Directory of Open Access Journals (Sweden)

    Matthias Hoben

    2016-10-01

    Full Text Available Abstract Background Oral health in nursing home residents is poor. Robust, mandated assessment tools such as the Resident Assessment Instrument – Minimum Data Set (RAI-MDS 2.0 are key to monitoring and improving quality of oral health care in nursing homes. However, psychometric properties of RAI-MDS 2.0 oral/dental items have been challenged and criterion validity of these items has never been assessed. Methods We used 73,829 RAI-MDS 2.0 records (13,118 residents, collected in a stratified random sample of 30 urban nursing homes in Western Canada (2007–2012. We derived a subsample of all residents (n = 2,711 with an admission and two or more subsequent annual assessments. Using Generalized Estimating Equations, adjusted for known covariates of nursing home residents’ oral health, we assessed the association of oral/dental problems with time, dentate status, dementia, debris, and daily cleaning. Results Prevalence of oral/dental problems fluctuated (4.8 %–5.6 % with no significant differences across time. This range of prevalence is substantially smaller than the ones reported by studies using clinical assessments by dental professionals. Denture wearers were less likely than dentate residents to have oral/dental problems (adjusted odds ratio [OR] = 0.458, 95 % confidence interval [CI]: 0.308, 0.680. Residents lacking teeth and not wearing dentures had higher odds than dentate residents of oral/dental problems (adjusted OR = 2.718, 95 % CI: 1.845, 4.003. Oral/dental problems were more prevalent in persons with debris (OR = 2.187, 95 % CI: 1.565, 3.057. Of the other variables assessed, only age at assessment was significantly associated with oral/dental problems. Conclusions Robust, reliable RAI-MDS 2.0 oral health indicators are vital to monitoring and improving oral health related quality and safety in nursing homes. However, severe underdetection of oral/dental problems and lack of association of well-known oral

  10. Exploring faecal incontinence in nursing home patients: a cross-sectional study of prevalence and associations derived from the Residents Assessment Instrument for Long-Term Care Facilities.

    Science.gov (United States)

    Blekken, Lene Elisabeth; Vinsnes, Anne Guttormsen; Gjeilo, Kari Hanne; Norton, Christine; Mørkved, Siv; Salvesen, Øyvind; Nakrem, Sigrid

    2016-07-01

    To explore prevalence and associations of faecal incontinence among nursing home patients, to examine the effect of clustering of observations and to study the variation in faecal incontinence rates on both the level of nursing home units and individual patients. Faecal incontinence affects 40-55% of the patients in nursing homes and is associated with increased risk of morbidity and reduced quality of life. There is a lack of studies investigating faecal incontinence with validated instruments. More studies need to include models of analyses that allow for clustering of observations. Cross-sectional. Data on 261 patients from 20 nursing home units were collected during September-October 2014. The Norwegian version of the Resident Assessment Instrument for Long-Term Care Facilities was used. Mixed effect models were conducted. Prevalence of faecal incontinence was 42·1% or 54% depending on the frequency labelling chosen. The effect of clustering by nursing home unit was not statistically significant. Most of the variation in faecal incontinence rates was explained by differences in patient characteristics, the most important being deficiencies in activities of daily living, cognitive impairment, diarrhoea and not participating in activities. Nursing home patients should be offered individualized assessment and continence care matching their patient characteristics. The Resident Assessment Instrument for Long-Term Care Facilities is a useful instrument because of its' combination of a comprehensive range of individual items and scales allowing for comparison of immediate or long-term change in patients status. Studies evaluating interventions targeting faecal incontinence are warranted. © 2016 John Wiley & Sons Ltd.

  11. Improving health status and reduction of institutionalization in long-term care--Effects of the Resident Assessment Instrument-Home Care by degree of implementation.

    Science.gov (United States)

    Stolle, Claudia; Wolter, Annika; Roth, Günter; Rothgang, Heinz

    2015-10-01

    A cluster randomized controlled trial showed that the Resident Assessment Instrument (RAI) could not improve or stabilize the health status of people in need of long-term care or reduce the rate of institutionalization in Germany among clients of home care agencies. The aim of this article is to investigate whether the effect of RAI depends on the degree of implementation. A factor analysis was used to distinguish between those agencies that implemented RAI intensively and those that did not. The clients of home care agencies working intensively with RAI were significantly less hospitalized (P = 0.0284) and fared slightly better according to activities of daily living (ADL, instrumental ADL (IADL)), cognitive skills (Mini-Mental Status Test (MMST)) and quality of life (EuroQol (EQ-5D)) compared with the control group. In contrast, those not working intensively with RAI had worse outcomes (IADL, MMST, EQ-5D) than the control group (not significant). It is important to guarantee a successful implementation of RAI. © 2014 Wiley Publishing Asia Pty Ltd.

  12. 38 CFR 51.110 - Resident assessment.

    Science.gov (United States)

    2010-07-01

    ... Medicaid Services (CMS) Resident Assessment Instrument Minimum Data Set, Version 2.0; and (ii) Describing... Set, Version 2.0 must be submitted electronically to VA at the IP address provided by VA to the State... information collection requirements in this section under control number 2900-0160) [65 FR 968, Jan. 6, 2000...

  13. [French residents' training in instrumental deliveries: A national survey].

    Science.gov (United States)

    Saunier, C; Raimond, E; Dupont, A; Pelissier, A; Bonneau, S; Gabriel, R; Graesslin, O

    2016-11-01

    To evaluate French residents in Obstetrics and Gynaecology's training in instrumental deliveries in 2015. We conducted a national descriptive survey among 758 residents between December 2014 and January 2015. Respondents were invited by email to specify their University Hospital, their current university term, the number of instrumental deliveries performed by vacuum extractor, forceps or spatulas, and whether they made systematic ultrasound exams before performing the extraction. Response rate was 34.7 % (n=263). There were important differences between regions in terms of type of instruments used. Vacuum extractor was the most commonly used instrument for instrumental deliveries by French residents (56.9 %), more than forceps (25.2 %) and spatulas (17.9 %). At the end of the residency, all the residents had been trained in instrumental deliveries with at least two instruments. The training of difficult techniques as well as their perfect control is required for instrumental deliveries. Yet, we are forced to note that there are substantial differences in the French residents' training in instrumental deliveries depending on their region. So, teaching at least two techniques seems essential as well as improving the training capacities and standardizing practices. A greater systematization of the teaching of the mechanics and obstetric techniques might be a solution to be considered too. Copyright © 2016 Elsevier Masson SAS. All rights reserved.

  14. Learning environment: assessing resident experience.

    Science.gov (United States)

    Byszewski, Anna; Lochnan, Heather; Johnston, Donna; Seabrook, Christine; Wood, Timothy

    2017-06-01

    Given their essential role in developing professional identity, academic institutions now require formal assessment of the learning environment (LE). We describe the experience of introducing a novel and practical tool in postgraduate programmes. The Learning Environment for Professionalism (LEP) survey, validated in the undergraduate setting, is relatively short, with 11 questions balanced for positive and negative professionalism behaviours. LEP is anonymous and focused on rotation setting, not an individual, and can be used on an iterative basis. We describe how we implemented the LEP, preliminary results, challenges encountered and suggestions for future application. Academic institutions now require formal assessment of the learning environment METHODS: The study was designed to test the feasibility of introducing the LEP in the postgraduate setting, and to establish the validity and the reliability of the survey. Residents in four programmes completed 187 ratings using LEP at the end of one of 11 rotations. The resident response rate was 87 per cent. Programme and rotation ratings were similar but not identical. All items rated positively (favourably), but displays of altruism tended to have lower ratings (meaning less desirable behaviour was witnessed), as were ratings for derogatory comments (again meaning that less desirable behaviour was witnessed). We have shown that the LEP is a feasible and valid tool that can be implemented on an iterative basis to examine the LE. Two LEP questions in particular, regarding derogatory remarks and demonstrating altruism, recorded the lowest scores, and these areas deserve attention at our institution. Implementation in diverse programmes is planned at our teaching hospitals to further assess reliability. This work may influence other postgraduate programmes to introduce this assessment tool. © 2016 John Wiley & Sons Ltd and The Association for the Study of Medical Education.

  15. A Database Management Assessment Instrument

    Science.gov (United States)

    Landry, Jeffrey P.; Pardue, J. Harold; Daigle, Roy; Longenecker, Herbert E., Jr.

    2013-01-01

    This paper describes an instrument designed for assessing learning outcomes in data management. In addition to assessment of student learning and ABET outcomes, we have also found the instrument to be effective for determining database placement of incoming information systems (IS) graduate students. Each of these three uses is discussed in this…

  16. An instrument to characterize the environment for residents' evidence-based medicine learning and practice.

    Science.gov (United States)

    Mi, Misa; Moseley, James L; Green, Michael L

    2012-02-01

    Many residency programs offer training in evidence-based medicine (EBM). However, these curricula often fail to achieve optimal learning outcomes, perhaps because they neglect various contextual factors in the learning environment. We developed and validated an instrument to characterize the environment for EBM learning and practice in residency programs. An EBM Environment Scale was developed following scale development principles. A survey was administered to residents across six programs in primary care specialties at four medical centers. Internal consistency reliability was analyzed with Cronbach's coefficient alpha. Validity was assessed by comparing predetermined subscales with the survey's internal structure as assessed via factor analysis. Scores were also compared for subgroups based on residency program affiliation and residency characteristics. Out of 262 eligible residents, 124 completed the survey (response rate 47%). The overall mean score was 3.89 (standard deviation=0.56). The initial reliability analysis of the 48-item scale had a high reliability coefficient (Cronbach α=.94). Factor analysis and further item analysis resulted in a shorter 36-item scale with a satisfactory reliability coefficient (Cronbach α=.86). Scores were higher for residents with prior EBM training in medical school (4.14 versus 3.62) and in residency (4.25 versus 3.69). If further testing confirms its properties, the EBM Environment Scale may be used to understand the influence of the learning environment on the effectiveness of EBM training. Additionally, it may detect changes in the EBM learning environment in response to programmatic or institutional interventions.

  17. Instruments to assess integrated care

    DEFF Research Database (Denmark)

    Lyngsø, Anne Marie; Godtfredsen, Nina Skavlan; Høst, Dorte

    2014-01-01

    INTRODUCTION: Although several measurement instruments have been developed to measure the level of integrated health care delivery, no standardised, validated instrument exists covering all aspects of integrated care. The purpose of this review is to identify the instruments concerning how to mea...... was prevalent. It is uncertain whether development of a single 'all-inclusive' model for assessing integrated care is desirable. We emphasise the continuing need for validated instruments embedded in theoretical contexts.......INTRODUCTION: Although several measurement instruments have been developed to measure the level of integrated health care delivery, no standardised, validated instrument exists covering all aspects of integrated care. The purpose of this review is to identify the instruments concerning how...... to measure the level of integration across health-care sectors and to assess and evaluate the organisational elements within the instruments identified. METHODS: An extensive, systematic literature review in PubMed, CINAHL, PsycINFO, Cochrane Library, Web of Science for the years 1980-2011. Selected...

  18. Instruments to assess integrated care

    DEFF Research Database (Denmark)

    Lyngsø, Anne Marie; Godtfredsen, Nina Skavlan; Høst, Dorte

    2014-01-01

    to measure the level of integration across health-care sectors and to assess and evaluate the organisational elements within the instruments identified. METHODS: An extensive, systematic literature review in PubMed, CINAHL, PsycINFO, Cochrane Library, Web of Science for the years 1980-2011. Selected...

  19. Needs Assessment for Incoming PGY-1 Residents in Neurosurgical Residency.

    Science.gov (United States)

    Brandman, David M; Haji, Faizal A; Matte, Marie C; Clarke, David B

    2015-01-01

    Residents must develop a diverse range of skills in order to practice neurosurgery safely and effectively. The purpose of this study was to identify the foundational skills required for neurosurgical trainees as they transition from medical school to residency. Based on the CanMEDS competency framework, a web-based survey was distributed to all Canadian academic neurosurgical centers, targeting incoming and current PGY-1 neurosurgical residents as well as program directors. Using Likert scale and free-text responses, respondents rated the importance of various cognitive (e.g. management of raised intracranial pressure), technical (e.g. performing a lumbar puncture) and behavioral skills (e.g. obtaining informed consent) required for a PGY-1 neurosurgical resident. Of 52 individuals contacted, 38 responses were received. Of these, 10 were from program directors (71%), 11 from current PGY-1 residents (58%) and 17 from incoming PGY-1 residents (89%). Respondents emphasized operative skills such as proper sterile technique and patient positioning; clinical skills such as lesion localization and interpreting neuro-imaging; management skills for common scenarios such as raised intracranial pressure and status epilepticus; and technical skills such as lumbar puncture and external ventricular drain placement. Free text answers were concordant with the Likert scale results. We surveyed Canadian neurosurgical program directors and PGY-1 residents to identify areas perceived as foundational to neurosurgical residency education and training. This information is valuable for evaluating the appropriateness of a training program's goals and objectives, as well as for generating a national educational curriculum for incoming PGY-1 residents.

  20. 24 CFR 902.50 - Resident service and satisfaction assessment.

    Science.gov (United States)

    2010-04-01

    ... 24 Housing and Urban Development 4 2010-04-01 2010-04-01 false Resident service and satisfaction... URBAN DEVELOPMENT PUBLIC HOUSING ASSESSMENT SYSTEM PHAS Indicator #4: Resident Service and Satisfaction § 902.50 Resident service and satisfaction assessment. (a) Objective. The objective of the Resident...

  1. An assessment of emotional intelligence in emergency medicine resident physicians.

    Science.gov (United States)

    Papanagnou, Dimitrios; Linder, Kathryn; Shah, Anuj; London, Kory Scott; Chandra, Shruti; Naples, Robin

    2017-12-27

    To define the emotional intelligence (EI) profile of emergency medicine (EM) residents, and identify resident EI strengths and weaknesses. First-, second-, and third-year residents (post-graduate years [PGY] 1, 2, and 3, respectively) of Thomas Jefferson University Hospital's EM Program completed the Emotional Quotient Inventory (EQ-i 2.0), a validated instrument offered by Multi-Health Systems. Reported scores included total mean EI, 5 composite scores, and 15 subscales of EI. Scores are reported as means with 95% CIs. The unpaired, two-sample t-test was used to evaluate differences in means. Thirty-five residents completed the assessment (response rate 97.2%). Scores were normed to the general population (mean 100, SD 15). Total mean EI for the cohort was 103 (95%CI,100-108). EI was higher in female (107) than male (101) residents. PGY-2s demonstrated the lowest mean EI (95) versus PGY-1s (104) and PGY-3s (110). The difference in PGY-3 EI (110; 95%CI,103-116) and PGY-1 EI (95, 95%CI,87-104) was statistically significant (unpaired t-test, pself-actualization (107); empathy (107); interpersonal relationships (106); impulse control (106); and stress tolerance (106). Lowest subscale score was in assertiveness (98). Self-regard (89), assertiveness (88), and independence (90) were areas in which PGY-2s attained relatively lower scores (unpaired t-test, ptraining that may assist in developing EM residents, specifically in self-regard, assertiveness, and self-expression. Further study is required to ascertain if patterns in level of training are idiosyncratic or relate to the natural maturation of residents.

  2. Advancing resident assessment in graduate medical education.

    Science.gov (United States)

    Swing, Susan R; Clyman, Stephen G; Holmboe, Eric S; Williams, Reed G

    2009-12-01

    The Outcome Project requires high-quality assessment approaches to provide reliable and valid judgments of the attainment of competencies deemed important for physician practice. The Accreditation Council for Graduate Medical Education (ACGME) convened the Advisory Committee on Educational Outcome Assessment in 2007-2008 to identify high-quality assessment methods. The assessments selected by this body would form a core set that could be used by all programs in a specialty to assess resident performance and enable initial steps toward establishing national specialty databases of program performance. The committee identified a small set of methods for provisional use and further evaluation. It also developed frameworks and processes to support the ongoing evaluation of methods and the longer-term enhancement of assessment in graduate medical education. The committee constructed a set of standards, a methodology for applying the standards, and grading rules for their review of assessment method quality. It developed a simple report card for displaying grades on each standard and an overall grade for each method reviewed. It also described an assessment system of factors that influence assessment quality. The committee proposed a coordinated, national-level infrastructure to support enhancements to assessment, including method development and assessor training. It recommended the establishment of a new assessment review group to continue its work of evaluating assessment methods. The committee delivered a report summarizing its activities and 5 related recommendations for implementation to the ACGME Board in September 2008.

  3. Utility of factor analysis in optimization of resident assessment and faculty evaluation.

    Science.gov (United States)

    Teman, Nicholas R; Minter, Rebecca M; Kasten, Steven J

    2016-06-01

    Increasing focus on more granular assessment in medical education has led to more lengthy instruments, with concern that the increased complexity undermines the utility of these tools. This study evaluated the relative contribution of individual questions in an assessment of resident performance and a faculty performance evaluation by residents. The authors performed factor analysis on the individual items in the resident assessment instrument (3,009 assessments of 71 residents) and faculty evaluations (7,328 evaluations of 61 faculty) collected from 2006 to 2012. Factor analysis of the resident assessment tool revealed that 1 component was responsible for 96.6% of the variance. This component encompassed each question from the assessment form, and could also be termed "overall resident competency." Factor analysis of the attending evaluation form revealed 2 unique components, representing "clinical care" and "interpersonal skills," which accounted for 89.9% of variance. Three components accounted for 90% to 97% of the observed variance in our analysis. Factor analysis represents a useful strategy for analyzing the utility of data obtained from individual items in the assessment and evaluation instruments. Copyright © 2015 Elsevier Inc. All rights reserved.

  4. Under the microscope: assessing surgical aptitude of otolaryngology residency applicants.

    Science.gov (United States)

    Carlson, Matthew L; Archibald, David J; Sorom, Abraham J; Moore, Eric J

    2010-06-01

    Application to otolaryngology residency is a highly competitive process. Programs identify the best candidates by evaluating academic performance in medical school, board scores, research experience, performance during an interview, and letters of recommendation. Unfortunately, none of these metrics completely assess an applicant's capacity to learn and perform surgical skills. We describe a direct assessment of an applicant's ability for rapid surgical skill acquisition, manual dexterity, and response to stress that can be performed during the interview process. A retrospective study at an academic otolaryngology residency program. After orientation, applicants were seated at a microsurgical training station and allotted 20 minutes to suture an incision using 10-0 nylon suture on a latex practice card. Their performance was graded using a 1-to-5 scoring system for the following categories: microscope use, respect for tissue, instrument handling, knot tying and suture control, skills acquisition, and attitude toward the exercise. Applicants were given some instruction and assessed on their ability to incorporate what they had learned into their technique. The average total applicant score was 23.2, standard deviation (SD) 3.6 (maximum 30); 13.4% of applicants scored 1 SD above the mean. The value of applicant screening tests in predicting surgical competency is controversial. We describe a direct assessment tool that may prove useful in identifying outliers, both high and low, to aid in final applicant ranking.

  5. Assessment of noise exposures in a pediatric dentistry residency clinic.

    Science.gov (United States)

    Jadid, Khaled; Klein, Ulrich; Meinke, Deanna

    2011-01-01

    In addition to sounds from dental equipment, pediatric dentists are exposed to noise produced by precooperative and/or noncooperative children. The purpose of this study was to evaluate the daily personal noise exposure of a pediatric dentistry resident while treating children in a teaching clinic to determine both comprehensive noise doses and peak noise occurrences as well as to assess the risk for noise-induced hearing loss. A noise dosimeter (Noise-Pro DLX) was used to measure the total personal noise exposure dose using the Occupational Safety and Health Administration (OSHA) Hearing Conservation Amendment criteria and the US National Institute for Occupational Safety and Health (NIOSH) occupational noise exposure revised criteria. Comprehensive noise doses for 31 days were obtained for a single resident. OSHA and NIOSH-allowable limits were not exceeded during any one day in the study period. Noise levels during crying episodes, however, were higher than the reported noise levels of dental instruments and reached maximum levels of 112.9 dBA. Noise levels to which the pediatric dental resident was exposed fell below the Occupational Safety and Health Administration's and National Institute for Occupational Safety and Health's damage-risk thresholds for noise-induced hearing loss.

  6. What are internal medicine residents missing? A communication needs assessment of outpatient clinical encounters.

    Science.gov (United States)

    Lundberg, Kristina L

    2014-09-01

    In order to guide curricular innovation, we looked at the feasibility and utility of performing a targeted needs assessment of the communication skills of PGY2 internal medicine (IM) residents in their continuity clinic, utilizing faculty direct observation with a validated instrument for communication skills evaluation. A convenience sample of PGY2 residents in the Emory University School of Medicine IM Residency Program was invited to participate. Using the SEGUE Framework, a checklist of medical communication tasks, faculty assessed residents during a clinic encounter. Thirty out of 53 (57%) PGY2 residents were assessed. SEGUE results indicate residents were most likely to "maintain patient's privacy" (100%), "greet patient appropriately" (97%) and "check/clarify information" (100%). Residents were least likely to "acknowledge waiting time" (7%), "explore psychosocial/emotional factors" (27%) and "outline agenda for visit" (33%). The SEGUE Framework is a feasible tool to evaluate the communication skills of IM residents in a clinic setting. Many PGY2 IM residents in a large, urban practice do not elicit important psychosocial information during outpatient clinic visits. More observation and evaluation of residents' communication skills are needed, with emphasis on building skills to "Understand the Patient's Perspective." Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  7. Early Grade Writing Assessment: An Instrument Model

    Science.gov (United States)

    Jiménez, Juan E.

    2017-01-01

    The United Nations Educational, Scientific, and Cultural Organization promoted the creation of a model instrument for individual assessment of students' foundational writing skills in the Spanish language that was based on a literature review and existing writing tools and assessments. The purpose of the "Early Grade Writing Assessment"…

  8. 42 CFR 413.343 - Resident assessment data.

    Science.gov (United States)

    2010-10-01

    ...; OPTIONAL PROSPECTIVELY DETERMINED PAYMENT RATES FOR SKILLED NURSING FACILITIES Prospective Payment for Skilled Nursing Facilities § 413.343 Resident assessment data. (a) Submission of resident assessment data... such other assessments that are necessary to account for changes in patient care needs. (c...

  9. Anesthesiology resident personality type correlates with faculty assessment of resident performance.

    Science.gov (United States)

    Schell, Randall M; Dilorenzo, Amy N; Li, Hsin-Fang; Fragneto, Regina Y; Bowe, Edwin A; Hessel, Eugene A

    2012-11-01

    To study the association between anesthesiology residents' personality preference types, faculty evaluations of residents' performance, and knowledge. Convenience sample and prospective study. Academic department of anesthesiology. Consenting anesthesiology residents (n = 36). All participants completed the Myers Briggs Type Indicator® (MBTI®). All residents' 6-month summation of daily focal evaluations completed by faculty [daily performance score (DPS); 1 = unsatisfactory, 2 = needs improvement, 3 = meets expectations, 4 = exceeds expectations], as well as a global assessment of performance (GAP) score based on placement of each resident into perceived quartile compared with their peers (ie,1 = first, or top, quartile) by senior faculty (n = 7) who also completed the MBTI, were obtained. The resident MBTI personality preferences were compared with the DPS and GAP scores, the United States Medical Licensing Examination (USMLE) I and II scores, and faculty MBTI personality type. There was no association between personality preference type and performance on standardized examinations (USMLE I, II). The mean GAP score was better (higher quartile score) for Extraverts than Introverts (median 2.0 vs 2.6, P = 0.0047) and for Sensing versus Intuition (median 2.0 vs 2.6, P = 0.0206) preference. Faculty evaluator MBTI preference type did not influence the GAP scores they assigned residents. Like GAP, the DPS was better for residents with Sensing versus Intuition preference (median 3.5 vs 3.3, P = 0.0111). No difference in DPS was noted between Extraverts and Introverts. Personality preference type was not associated with resident performance on standardized examinations, but it was associated with faculty evaluations of resident performance. Residents with Sensing personality preference were evaluated more favorably on global and focal faculty evaluations than those residents who chose the Intuition preference. Extraverted residents were evaluated more favorably on

  10. Psychometric properties of instruments for assessing depression ...

    African Journals Online (AJOL)

    Psychometric properties of instruments for assessing depression among African youth: A systematic review. ... Journal of Child and Adolescent Mental Health ... Studies examining the reliability and/or validity of depression assessment tools were selected for inclusion if they were based on data collected from youth (any ...

  11. A Self-Assessment Guide for Resident Teaching Experiences.

    Science.gov (United States)

    Engle, Janet P; Franks, Amy M; Ashjian, Emily; Bingham, Angela L; Burke, John M; Erstad, Brian L; Haines, Seena L; Hilaire, Michelle L; Rager, Michelle L; Wienbar, Rebecca

    2016-06-01

    The 2015 American College of Clinical Pharmacy (ACCP) Educational Affairs Committee was charged with developing a self-assessment guide for residency programs to quantitatively and qualitatively evaluate the outcomes of resident teaching curricula. After extensively reviewing the literature, the committee developed assessment rubrics modeled after the 2013 ACCP white paper titled "Guidelines for Resident Teaching Experiences" and the revised American Society of Health-System Pharmacists (ASHP) 2014 accreditation standards for PGY1 residencies, which place greater emphasis on the teaching and learning curriculum (TLC) than the previous accreditation standards. The self-assessment guide developed by the present committee can serve as an assessment tool for both basic and expanded TLCs. It provides the criteria for program goals, mentoring, directed readings with topic discussions, teaching experiences, and assessment methodology. For an expanded TLC, the committee has provided additional guidance on developing a teaching philosophy, becoming involved in interactive seminars, expanding teaching experiences, developing courses, and serving on academic committees. All the guidelines listed in the present paper use the measures "not present," "developing," and "well developed" so that residency program directors can self-assess along the continuum and identify areas of excellence and areas for improvement. Residency program directors should consider using this new assessment tool to measure program quality and outcomes of residency teaching experiences. Results of the assessment will help residency programs focus on areas within the TLC that will potentially benefit from additional attention and possible modification. © 2016 Pharmacotherapy Publications, Inc.

  12. Validación de un instrumento para la evaluación de la interpretación de los resultados de estudios de investigación en los residentes de un hospital universitario Validation of an instrument to assess research critical appraisal skills in residents in a university hospital

    Directory of Open Access Journals (Sweden)

    Rodolfo Pizarro

    2011-09-01

    Full Text Available Objetivo. Validar por el método de grupos extremos un instrumento para evaluar la interpretación de las pruebas estadísticas más utilizadas en residentes de un hospital universitario. Sujetos y métodos. Respondieron 272 residentes. La media de respuestas correctas fue del 45%. Resultados. No hubo diferencias entre género, especialidad ni años de formación. La fiabilidad fue aceptable (alfa = 0,83 y la diferencia entre grupos extremos fue significativa (0,45 frente a 0,91. Conclusiones. Los residentes mostraron déficits en interpretación crítica de estudios de investigación, hallazgo que es consistente con otros centros internacionales.Aim. To validate an instrument to assess research critical appraisal skills in residents in a university hospital by the extreme groups method. Subjects and methods. 272 residents completed the questionnaire. The mean of correct answers was 45%. Results. No significant differences between gender, specialty or post-graduate year were found. Reliability (alpha = 0.83 was acceptable and difference between extreme groups was significant (0.45 vs. 0.91. Conclusions. Residents showed poor skills to interpret typical results of clinical studies, finding consistent with other countries.

  13. An Objective Structured Clinical Examination to Assess Pharmacy Resident Performance

    Directory of Open Access Journals (Sweden)

    Kimberly A.B. Cauthon

    2017-04-01

    Full Text Available Objective: The objective was to utilize an Objective Structured Clinical Examination (OSCE for assessment of pharmacy residents. Innovation: Post-graduate year 1 (PGY1 and post-graduate year 2 (PGY2 pharmacy residents completing multiple, local residency programs were invited to participate in an OSCE. A total of eight PGY1 residents and one PGY2 resident completed the OSCE. American Society of Health-System Pharmacists (ASHP residency program goals were aligned for each case, which were originally developed for a fourth-year pharmacy student OSCE. Station design included outpatient and inpatient settings with patient and physician interactions. Median communication and clinical skills scores were evaluated. Critical Analysis: The OSCE allows for assessment of all residents on common scenarios. Pharmacy residents met competency requirements and demonstrated excellent communication skills. The OSCE was able to evaluate both physician-pharmacist communication and patient-pharmacist communication. Baseline performance related to the ASHP goals and objectives was not completed; however, the OSCE could highlight resident strengths and weaknesses in communication and clinical skills. The OSCE could simulate independent practice, may reduce bias, and could provide an evaluation of the resident by a patient. However, the OSCE incurs higher resource utilization, specifically monetary and time, than other assessment methods. Next Steps: The pilot study results provide a beginning for further study of OSCEs for pharmacy residents. Further study should include surveying the residency directors about use of the OSCE, a comparison of performance between the OSCE and preceptor evaluations of residents on ASHP goals and objectives, and an evaluation of OSCE implementation at different time points within the residency. Conflict of Interest We declare no conflicts of interest or financial interests that the authors or members of their immediate families have in

  14. MAIN: Multilingual Assessment Instrument for Narratives

    OpenAIRE

    Gagarina, Natalʹja Vladimirovna; Klop, Daleen; Kunnari, Sari; Tantele, Koula; Välimaa, Taina; Balčiūnienė, Ingrida; Bohnacker, Ute; Walters, Joel

    2016-01-01

    The Multilingual Assessment Instrument for Narratives (MAIN) was designed in order to assess narrative skills in children who acquire one or more languages from birth or from early age. MAIN is suitable for children from 3 to 10 years and evaluates both comprehension and production of narratives. Its design allows for the assessment of several languages in the same child, as well as for different elicitation modes: Model Story, Retelling, and Telling. MAIN contains four parallel stories, e...

  15. Assessment of medical residents technology readiness for an online residents-as-teachers curriculum.

    Science.gov (United States)

    Silva, Débora; Lewis, Kadriye O

    2014-06-01

    The University of Puerto Rico School of Medicine has a need to expand the current Residents-as-Teachers workshops into a comprehensive curriculum. One way to do so is to implement an online curriculum, but prior to this, the readiness of the medical residents to participate in such a curriculum should be assessed. Our objective was to determine whether the residents at the University of Puerto Rico School of Medicine are prepared to engage in an online Residents-as-Teachers program. This was a descriptive, mixed-method-design study that collected qualitative and quantitative data using an online survey and a focus-group interview. The study was conducted with students from 11 of the residency programs at the University of Puerto Rico School of Medicine. More than 80% of the participating residents had the technical knowledge to engage in an online program; 90.5% thought an online Residents-as-Teachers course would be a good alternative to what was currently available; 87.5% would be willing to participate in an online program, and 68.6% of the residents stated that they preferred an online course to a traditional one. Determinants of readiness for online learning at the University of Puerto Rico School of Medicine were identified and discussed. Our results suggest that the majority of the residents who participated in this study are ready to engage in an online Residents-as-Teachers program. The only potential barrier found was that one-third of the residents still preferred a traditional curriculum, even when they thought an online Residents-as-Teachers curriculum was a good alternative and were willing to participate in the course or courses forming part of such a curriculum. Therefore, prior to wide-spread implementation of such a curriculum, a pilot test should be conducted to maximize the presumed and eventual success of that curriculum.

  16. Assessment for Learning Instrumentation in Higher Education

    Science.gov (United States)

    Akib, Erwin; Ghafar, Mohamad Najib Abdul

    2015-01-01

    This study explains assessment for learning instrumentation, especially in higher education. The population of this study was 100 lecturers of the Muhammadiyah Makassar University, Indonesia. A total of 50 items from six construct were analyzed and used to determine the reliability and validity of the questionnaire. The result shows that the…

  17. Evaluating the effectiveness of impact assessment instruments

    DEFF Research Database (Denmark)

    Cashmore, Matthew; Richardson, Tim; Hilding-Ryedvik, Tuija

    2010-01-01

    the contemporary research context, learning derived from analysing the meaning and implications of plural interpretations of effectiveness represents the most constructive strategy for advancing impact assessment and policy integration theory. Crown Copyright (C) 2010 Published by Elsevier Inc. All rights reserved.......The central role of impact assessment instruments globally in policy integration initiatives has been cemented in recent years. Associated with this trend, but also reflecting political emphasis on greater accountability in certain policy sectors and a renewed focus on economic competitiveness...... to sharpen effectiveness evaluation theory for impact assessment instruments this article critically examines the neglected issue of their political constitution. Analytical examples are used to concretely explore the nature and significance of the politicisation of impact assessment. It is argued...

  18. Instruments to assess stigmatization in dermatology.

    Science.gov (United States)

    Dimitrov, Dimitre; Szepietowski, Jacek C

    2017-11-03

    Stigmatization is the assignment of negative perceptions to an individual because of a perceived difference from the population at large. Skin conditions are frequently the reason of social rejection with a consequent negative influence on the personal and social life of patients. The aim of the current study was to review the available instruments that can be successfully utilized to measure the stigmatization level among dermatological patients. We performed our search on PubMed up to November 2016 and utilized combinations of key phrases containing such words as stigmatization, skin, dermatology, names of various skin conditions (psoriasis, vitiligo, acne, etc.), measurement. The search found a considerable number of articles - 548. After filtering them through a precise selection process, 58 articles remained. We concentrated only on the methodological aspects to assess stigmatization in various dermatoses. The review ascertained that there exist numerous instruments in the form of questionnaires. They were utilized in various researches in order to assess the stigmatization level in patients with skin problems. We divided them into two main groups: dermatology specific instruments (6 questionnaires) and dermatosis/disease specific ones (8 questionnaires). It is recommended to use dermatology-specific instruments to compare the stigmatization level in various skin conditions. They can be utilized as well as a first line tools to study the feeling of stigmatization in specific skin diseases; however, where it is possible, they should be supplemented with the disease-specific instrument for deeper analysis of both qualities of life and stigmatization.

  19. Use of Entrustable Professional Activities in the Assessment of Surgical Resident Competency.

    Science.gov (United States)

    Wagner, Justin P; Lewis, Catherine E; Tillou, Areti; Agopian, Vatche G; Quach, Chi; Donahue, Timothy R; Hines, O Joe

    2017-11-15

    Competency-based assessments of surgical resident performance require metrics of entrustable autonomy. To designate entrustable professional activities (EPAs) in global performance and in specific operations, and to identify differences in perceived capability, autonomy, and expectations between surgical faculty and residents. This survey study was conducted from August 9, 2016, through August 24, 2016, in the Department of Surgery at the UCLA David Geffen School of Medicine. The survey instrument consisted of 5-point Likert scales for assessing perceptions of entrustability for 5 global and 5 operative EPAs. Faculty members were surveyed regarding resident capabilities and expected capabilities by postgraduate year. Residents were surveyed regarding their own capabilities, actual autonomy entrusted in the last EPA performed, and expected capabilities. Differences in mean ratings were assessed across 7 comparison domains. Among 78 total faculty members, 31 (40%) participated in the survey. Among 49 residents, 39 (80%) participated in the survey. Residents generally rated their global EPA performance higher than the faculty did (mean, 3.7 vs 2.8; P < .01), but operative EPA performance ratings were equivalent (mean, 2.7 vs 2.4; P < .12). Faculty members perceived senior residents as underperforming expectations in operative EPAs. Most faculty members (80%) expected residents not to be independently capable of performing complex operations by graduation. Faculty members perceived residents in postgraduate years 4 and 5 to have greater operative capability than the level of autonomy entrusted to those residents (95% CI, 3.3-3.5 vs 1.9-2.2). Global and operative EPAs are practical for developing competency-based curricula. Graduated autonomy should be granted to improve the operative experience for residents.

  20. Embracing the new paradigm of assessment in residency training: an assessment programme for first-year residency training in anaesthesiology

    DEFF Research Database (Denmark)

    Ringsted, C; Østergaard, D; Scherpbier, A

    2003-01-01

    is to specify the evaluation situations and develop appropriate methods. This paper describes the intrinsic rational validation process in outlining an assessment programme for first-year anaesthesiology residency training according to the new paradigm. The applicability to other residency programmes and higher......-level training in anaesthesiology is discussed. Udgivelsesdato: 2003-Jan...

  1. [Assessment of a residency training program in endocrinology and nutrition: results of a resident survey].

    Science.gov (United States)

    Gutiérrez-Alcántara, Carmen; Moreno-Fernández, Jesús; Palomares-Ortega, Rafael; García-Manzanares, Alvaro; Benito-López, Pedro

    2011-12-01

    In 2006, a new training program was approved for resident physicians in endocrinology and nutrition (EN). A survey was conducted to EN residents to assess their training, their depth of knowledge, and compliance with the new program, as well as potential changes in training, and the results obtained were compared to those from previous surveys. A survey previously conducted in 2000 and 2005 was used for this study. The survey included demographic factors, questions about the different rotations, scientific and practical training, assessment of their training departments and other aspects. Results of the current survey were compared to those of the 2005 survey. The survey was completed by 40 residents. Mandatory rotations are mainly fulfilled, except for neurology. Some rotations removed from the program, such as radiology and nuclear medicine, still are frequently performed and popular among residents, who would include them back into the program. There was a low compliance with practical training in the endocrinology area. Forty percent of residents were not aware of the new program, but 60% thought that it was fulfilled. A total of 82.5% of residents thought that their departments fulfilled the training objectives. Few differences were found in rotations as compared to the data collected in 2005 despite changes in the training program, and there was still a lack of practical training. By contrast, rating of training received from departments and senior physicians was improved as compared to prior surveys. Copyright © 2011 SEEN. Published by Elsevier Espana. All rights reserved.

  2. Resident Career Planning Needs in Internal Medicine: A Qualitative Assessment

    Science.gov (United States)

    Garcia, Rina L.; Windish, Donna M.; Rosenbaum, Julie R.

    2010-01-01

    Background Few residency programs have centralized resources for career planning. As a consequence, little is known about residents' informational needs regarding career planning. Objective To examine career preparation stressors, practical needs, and information that residents wished they were privy to when applying. Methods In 2007 and 2008, we surveyed 163 recent graduates or graduating residents from 10 Yale-based and Yale-affiliated hospitals' internal medicine programs regarding their experiences with applying for positions after residency. We included questions about demographics, mentorship, stress of finding a job or fellowship, and open-ended questions to assess barriers and frustrations. Qualitative data were coded independently and a classification scheme was negotiated by consensus. Results A total of 89 residents or recent graduates responded, and 75% of them found career planning during residency training at least somewhat stressful. Themes regarding the application process included (1) knowledge about the process, (2) knowledge about career paths and opportunities, (3) time factors, (4) importance of adequate personal guidance and mentorship, and (5) self-knowledge regarding priorities and the desired outcome. Residents identified the following advice as most important: (1) start the process as early as possible and with a clear knowledge of the process timeline, (2) be clear about personal goals and priorities, and (3) be well-informed about a prospective employer and what that employer is looking for. Most residents felt career planning should be structured into the curriculum and should occur in the first year or throughout residency. Conclusions This study highlights residents' desire for structured dissemination of information and counseling with regard to career planning during residency. Our data suggest that exposure to such resources may be beneficial as early as the first year of training. PMID:22132271

  3. Resident career planning needs in internal medicine: a qualitative assessment.

    Science.gov (United States)

    Garcia, Rina L; Windish, Donna M; Rosenbaum, Julie R

    2010-12-01

    Few residency programs have centralized resources for career planning. As a consequence, little is known about residents' informational needs regarding career planning. To examine career preparation stressors, practical needs, and information that residents wished they were privy to when applying. In 2007 and 2008, we surveyed 163 recent graduates or graduating residents from 10 Yale-based and Yale-affiliated hospitals' internal medicine programs regarding their experiences with applying for positions after residency. We included questions about demographics, mentorship, stress of finding a job or fellowship, and open-ended questions to assess barriers and frustrations. Qualitative data were coded independently and a classification scheme was negotiated by consensus. A total of 89 residents or recent graduates responded, and 75% of them found career planning during residency training at least somewhat stressful. Themes regarding the application process included (1) knowledge about the process, (2) knowledge about career paths and opportunities, (3) time factors, (4) importance of adequate personal guidance and mentorship, and (5) self-knowledge regarding priorities and the desired outcome. Residents identified the following advice as most important: (1) start the process as early as possible and with a clear knowledge of the process timeline, (2) be clear about personal goals and priorities, and (3) be well-informed about a prospective employer and what that employer is looking for. Most residents felt career planning should be structured into the curriculum and should occur in the first year or throughout residency. This study highlights residents' desire for structured dissemination of information and counseling with regard to career planning during residency. Our data suggest that exposure to such resources may be beneficial as early as the first year of training.

  4. Assessment of wind turbine load measurement instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Morfiadakis, E.; Papadopoulos, K. [CRES (Greece); Borg, N. van der [ECN, Petten (Netherlands); Petersen, S.M. [Risoe, Roskilde (Denmark); Seifert, H. [DEWI, Wilhelmshaven (Germany)

    1999-03-01

    In the framework of Sub-Task3 `Wind turbine load measurement instrumentation` of EU-project `European Wind Turbine Testing Procedure Development`, the load measurement techniques have been assessed by laboratory, full scale and numerical tests. The existing methods have been reviewed with emphasis on the strain gage application techniques on composite materials and recommendations are provided for the optimisation of load measurement techniques. (au) EU. 14 refs.

  5. Validation of the organizational culture assessment instrument.

    Directory of Open Access Journals (Sweden)

    Brody Heritage

    Full Text Available Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102 Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged.

  6. Validation of the Organizational Culture Assessment Instrument

    Science.gov (United States)

    Heritage, Brody; Pollock, Clare; Roberts, Lynne

    2014-01-01

    Organizational culture is a commonly studied area in industrial/organizational psychology due to its important role in workplace behaviour, cognitions, and outcomes. Jung et al.'s [1] review of the psychometric properties of organizational culture measurement instruments noted many instruments have limited validation data despite frequent use in both theoretical and applied situations. The Organizational Culture Assessment Instrument (OCAI) has had conflicting data regarding its psychometric properties, particularly regarding its factor structure. Our study examined the factor structure and criterion validity of the OCAI using robust analysis methods on data gathered from 328 (females = 226, males = 102) Australian employees. Confirmatory factor analysis supported a four factor structure of the OCAI for both ideal and current organizational culture perspectives. Current organizational culture data demonstrated expected reciprocally-opposed relationships between three of the four OCAI factors and the outcome variable of job satisfaction but ideal culture data did not, thus indicating possible weak criterion validity when the OCAI is used to assess ideal culture. Based on the mixed evidence regarding the measure's properties, further examination of the factor structure and broad validity of the measure is encouraged. PMID:24667839

  7. The use of error analysis to assess resident performance.

    Science.gov (United States)

    D'Angelo, Anne-Lise D; Law, Katherine E; Cohen, Elaine R; Greenberg, Jacob A; Kwan, Calvin; Greenberg, Caprice; Wiegmann, Douglas A; Pugh, Carla M

    2015-11-01

    The aim of this study was to assess validity of a human factors error assessment method for evaluating resident performance during a simulated operative procedure. Seven postgraduate year 4-5 residents had 30 minutes to complete a simulated laparoscopic ventral hernia (LVH) repair on day 1 of a national, advanced laparoscopic course. Faculty provided immediate feedback on operative errors and residents participated in a final product analysis of their repairs. Residents then received didactic and hands-on training regarding several advanced laparoscopic procedures during a lecture session and animate lab. On day 2, residents performed a nonequivalent LVH repair using a simulator. Three investigators reviewed and coded videos of the repairs using previously developed human error classification systems. Residents committed 121 total errors on day 1 compared with 146 on day 2. One of 7 residents successfully completed the LVH repair on day 1 compared with all 7 residents on day 2 (P = .001). The majority of errors (85%) committed on day 2 were technical and occurred during the last 2 steps of the procedure. There were significant differences in error type (P ≤ .001) and level (P = .019) from day 1 to day 2. The proportion of omission errors decreased from day 1 (33%) to day 2 (14%). In addition, there were more technical and commission errors on day 2. The error assessment tool was successful in categorizing performance errors, supporting known-groups validity evidence. Evaluating resident performance through error classification has great potential in facilitating our understanding of operative readiness. Copyright © 2015 Elsevier Inc. All rights reserved.

  8. Perinatal and Maternal Outcomes After Training Residents in Forceps Before Vacuum Instrumental Birth.

    Science.gov (United States)

    Skinner, Sasha; Davies-Tuck, Miranda; Wallace, Euan; Hodges, Ryan

    2017-07-01

    To compare the rates of attempted and successful instrumental births, intrapartum cesarean delivery, and subsequent perinatal and maternal morbidity before and after implementing a training intervention to arrest the decline in forceps competency among resident obstetricians. This retrospective cohort study examined all attempted instrumental births at Monash Health from 2005 to 2014. We performed an interrupted time-series analysis to compare outcomes of attempted instrumental births in 2005-2009 with those in 2010-2014. There were 72,490 births from 2005 to 2014 at Monash Health, of which 8,789 (12%) were attempted instrumental vaginal births. After the intervention, rates of forceps births increased [autoregressive integrated moving average coefficient (β) 1.5, 95% confidence interval (CI) 1.03-1.96; Pvacuum births decreased (β -1.43, 95% CI -2.5 to -0.37; Pvacuum training results in more forceps births, fewer postpartum hemorrhages, and no increase in third- and fourth-degree perineal injuries or episiotomies.

  9. Objective Assessment of General Surgery Residents Followed by Remediation.

    Science.gov (United States)

    Gas, Becca L; Buckarma, EeeLN H; Mohan, Monali; Pandian, T K; Farley, David R

    Surgical training programs often lack objective assessment strategies. Complicated scheduling characteristics frequently make it difficult for surgical residents to undergo formal assessment; actually having the time and opportunity to remediate poor performance is an even greater problem. We developed a novel methodology of assessment for residents and created an efficient remediation system using a combination of simulation, online learning, and self-assessment options. Postgraduate year (PGY) 2 to 5 general surgery (GS) residents were tested in a 5 station, objective structured clinical examination style event called the Surgical X-Games. Stations were 15 minutes in length and tested both surgical knowledge and technical skills. Stations were scored on a scale of 1 to 5 (1 = Fail, 2 = Mediocre, 3 = Pass, 4 = Good, and 5 = Stellar). Station scores ≤ 2 were considered subpar and required remediation to a score ≥ 4. Five remediation sessions allowed residents the opportunity to practice the stations with staff surgeons. Videos of each skill or test of knowledge with clear instructions on how to perform at a stellar level were offered. Trainees also had the opportunity to checkout take-home task trainers to practice specific skills. Residents requiring remediation were then tested again in-person or sent in self-made videos of their performance. Academic medical center. PGY2, 3, 4, and 5 GS residents at Mayo Clinic in Rochester, MN. A total of, 35 residents participated in the Surgical X-Games in the spring of 2015. Among all, 31 (89%) had scores that were deemed subpar on at least 1 station. Overall, 18 (58%) residents attempted remediation. All 18 (100%) achieved a score ≥ 4 on the respective stations during a makeup attempt. Overall X-Games scores and those of PGY2s, 3s, and 4s were higher after remediation (p < 0.05). No PGY5s attempted remediation. Despite difficulties with training logistics and busy resident schedules, it is feasible to objectively

  10. [The Computer Book of the Internal Medicine resident: validity and reliability of a questionnaire for self-assessment of competences in internal medicine residents].

    Science.gov (United States)

    Oristrell, J; Casanovas, A; Jordana, R; Comet, R; Gil, M; Oliva, J C

    2012-12-01

    There are no simple and validated instruments for evaluating the training of specialists. To analyze the reliability and validity of a computerized self-assessment method to quantify the acquisition of medical competences during the Internal Medicine residency program. All residents of our department participated in the study during a period of 28 months. Twenty-two questionnaires specific for each rotation (the Computer-Book of the Internal Medicine Resident) were constructed with items (questions) corresponding to three competence domains: clinical skills competence, communication skills and teamwork. Reliability was analyzed by measuring the internal consistency of items in each competence domain using Cronbach's alpha index. Validation was performed by comparing mean scores in each competence domain between senior and junior residents. Cut-off levels of competence scores were established in order to identify the strengths and weaknesses of our training program. Finally, self-assessment values were correlated with the evaluations of the medical staff. There was a high internal consistency of the items of clinical skills competences, communication skills and teamwork. Higher scores of clinical skills competence and communication skills, but not in those of teamwork were observed in senior residents than in junior residents. The Computer-Book of the Internal Medicine Resident identified the strengths and weaknesses of our training program. We did not observe any correlation between the results of the self- evaluations and the evaluations made by staff physicians. The items of Computer-Book of the Internal Medicine Resident showed high internal consistency and made it possible to measure the acquisition of medical competences in a team of Internal Medicine residents. This self-assessment method should be complemented with other evaluation methods in order to assess the acquisition of medical competences by an individual resident. Copyright © 2012 Elsevier Espa

  11. Register of Validated Short Dietary Assessment Instruments

    Science.gov (United States)

    The register contains descriptive information about the instruments identified (over 135) along with any associated validation studies and publications, and copies of the instruments themselves when available.

  12. Perceptual Assessment of Velopharyngeal Dysfunction by Otolaryngology Residents.

    Science.gov (United States)

    Butts, Sydney C; Truong, Alan; Forde, Christina; Stefanov, Dimitre G; Marrinan, Eileen

    2016-12-01

    To assess the ability of otolaryngology residents to rate the hypernasal resonance of patients with velopharyngeal dysfunction. We hypothesize that experience (postgraduate year [PGY] level) and training will result in improved ratings of speech samples. Prospective cohort study. Otolaryngology training programs at 2 academic medical centers. Thirty otolaryngology residents (PGY 1-5) were enrolled in the study. All residents rated 30 speech samples at 2 separate times. Half the residents completed a training module between the rating exercises, with the other half serving as a control group. Percentage agreement with the expert rating of each speech sample and intrarater reliability were calculated for each resident. Analysis of covariance was used to model accuracy at session 2. The median percentage agreement at session 1 was 53.3% for all residents. At the second session, the median scores were 53.3% for the control group and 60% for the training group, but this difference was not statistically significant. Intrarater reliability was moderate for both groups. Residents were more accurate in their ratings of normal and severely hypernasal speech. There was no correlation between rating accuracy and PGY level. Score at session 1 positively correlated with score at session 2. Perceptual training of otolaryngology residents has the potential to improve their ratings of hypernasal speech. Length of time in residency may not be best predictor of perceptual skill. Training modalities incorporating practice with hypernasal speech samples could improve rater skills and should be studied more extensively. © American Academy of Otolaryngology—Head and Neck Surgery Foundation 2016.

  13. Risk assessment instruments in clinical practice.

    Science.gov (United States)

    Côté, Gilles; Crocker, Anne G; Nicholls, Tonia L; Seto, Michael C

    2012-04-01

    To determine whether the items in one of the most widely validated instruments of violence risk assessment, the Historical-Clinical-Risk Management-20 (HCR-20), are used in review board hearings to assess the risk of violence by people found Not Criminally Responsible on account of Mental Disorder (NCRMD). This study was conducted from October 2004 to August 2006 in Quebec's sole forensic psychiatric hospital and 2 large civil psychiatric hospitals designated for the care of people declared NCRMD in the Montreal metropolitan area. The risk assessments presented by clinicians at annual review board hearings and the boards' rationale for the release or detention of people found NCRMD were contrasted with the risk assessments conducted by the research team using the HCR-20. The final sample was comprised of 96 men. Very few of the risk factors identified by prior research (HCR-20 items) were mentioned in the hearing process, whether in clinical reports, discussions during the hearing, or in the disposition justification. The findings confirm that there remains a significant gap between research evidence and risk assessment practice.

  14. [Assessment and assessment instruments in palliative care. Trail of an assessment of the significance of assessment instruments in Palliative Care].

    Science.gov (United States)

    Büche, Daniel J

    2012-02-01

    Assessment in palliative care is very important. The assessment is a structured and goal oriented procedure. Both is important - structure and goal - because of the patient's vulnerability and in respect to his life-threatening illness. Assessment instruments play a limited role in the process of assessment because many values in palliative care are individual, subjective and their comparison to each other and their measure are limited. It isn't scientific to measure values which aren't measureable. Values become less measureable when complexity grows. Complexity can't be simplified because simplification destroys complexity. It makes sense to ask oneself which outcome an assessment instrument will measure before we use it.

  15. Teaching and Assessing Professionalism in Radiology Resident Education.

    Science.gov (United States)

    Kelly, Aine Marie; Gruppen, Larry D; Mullan, Patricia B

    2017-05-01

    Radiologists in teaching hospitals and in practices with residents rotating through are involved in the education of their residents. The Accreditation Council for Graduate Medical Education requires evidence that trainees are taught and demonstrate competency not only in medical knowledge and in patient care-the historic focus of radiology education-but also in the so-called non-interpretative core competencies, which include professionalism and interpersonal skills. In addition to accreditation agencies, the prominent assessment practices represented by the American Board of Radiology core and certifying examinations for trainees, as well as Maintenance of Certification for practitioners, are planning to feature more non-interpretative competency assessment, including professionalism to a greater extent. Because professionalism was incorporated as a required competency in medical education as a whole, more clarity about the justification and expected content for teaching about competence in professionalism, as well as greater understanding and evidence about appropriate and effective teaching and assessment methods, have emerged. This article summarizes justifications and expectations for teaching and assessing professionalism in radiology residents and best practices on how to teach and evaluate professionalism that can be used by busy radiology faculty in their everyday practice supervising radiology residents. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

  16. The Nursing Home Minimum Data Set Assessment Instrument: Manifest Functions and Unintended Consequences--Past, Present, and Future

    Science.gov (United States)

    Rahman, Anna N.; Applebaum, Robert A.

    2009-01-01

    The Minimum Data Set (MDS) is a uniform instrument used in nursing homes to assess residents. In January 2008, the Centers for Medicare and Medicaid Services published a draft of a new MDS--version 3.0. This article traces the instrument's development and the design decisions that shaped it, discusses the MDS's manifest functions--data collection…

  17. The effects of self-assessment and supervisor feedback on residents' patient-education competency using videoed outpatient consultations.

    Science.gov (United States)

    Wouda, Jan C; van de Wiel, Harry B M

    2014-10-01

    To determine the effects of residents' communication self-assessment and supervisor feedback on residents' communication-competency awareness, on their patient-education competency, and on their patients' opinion. The program consisted of the implementation of a communication self-assessment and feedback process using videoed outpatient consultations (video-CAF). Residents wrote down communication learning objectives during the instruction and after each video-CAF session. Residents' patient-education competency was assessed by trained raters, using the CELI instrument. Participating patients completed a questionnaire about the contact with their physician. Forty-four residents and 21 supervisors participated in 87 video-CAF sessions. After their first video-CAF session, residents wrote down more learning objectives addressing their control and rapport skills and their listening skills. Video-CAF participation improved residents' patient-education competency, but only in their control and rapport skills. Video-CAF participation had no effect on patients' opinion. Video-CAF appears to be a feasible procedure and might be effective in improving residents' patient-education competency in clinical practice. Video-CAF could fill the existing deficiency of communication training in residency programs. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  18. Instrumentation

    International Nuclear Information System (INIS)

    Decreton, M.

    2001-01-01

    SCK-CEN's research and development programme on instrumentation involves the assessment and the development of sensitive measurement systems used within a radiation environment. Particular emphasis is on the assessment of optical fibre components and their adaptability to radiation environments. The evaluation of ageing processes of instrumentation in fission plants, the development of specific data evaluation strategies to compensate for ageing induced degradation of sensors and cable performance form part of these activities. In 2000, particular emphasis was on in-core reactor instrumentation applied to fusion, accelerator driven and water-cooled fission reactors. This involved the development of high performance instrumentation for irradiation experiments in the BR2 reactor in support of new instrumentation needs for MYRRHA, and for diagnostic systems for the ITER reactor

  19. Instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Decreton, M

    2001-04-01

    SCK-CEN's research and development programme on instrumentation involves the assessment and the development of sensitive measurement systems used within a radiation environment. Particular emphasis is on the assessment of optical fibre components and their adaptability to radiation environments. The evaluation of ageing processes of instrumentation in fission plants, the development of specific data evaluation strategies to compensate for ageing induced degradation of sensors and cable performance form part of these activities. In 2000, particular emphasis was on in-core reactor instrumentation applied to fusion, accelerator driven and water-cooled fission reactors. This involved the development of high performance instrumentation for irradiation experiments in the BR2 reactor in support of new instrumentation needs for MYRRHA, and for diagnostic systems for the ITER reactor.

  20. Residents as teachers: psychiatry and family medicine residents' self-assessment of teaching knowledge, skills, and attitudes.

    Science.gov (United States)

    Brand, Michael W; Ekambaram, Vijayabharathi; Tucker, Phebe; Aggarwal, Ruchi

    2013-09-01

    Residents are one of the prime sources of information and education for medical students. As an initial step in supporting residents as teachers, a baseline self-assessment of residents' knowledge, skills, attitudes, and values related to teaching was conducted among psychiatry and family medicine residents to compare and improve their confidence and skills as teachers. Psychiatry residents (N=12) and family medicine residents (N=23) completed self-assessments of their knowledge, skills, attitudes, and values related to teaching. Residents also were asked to list steps used in the One-Minute Preceptor process and estimate the time each spent in teaching. Descriptive summary statistics were used for four main areas related to teaching; t-test and chi-square analyses were conducted to ascertain whether there was a significant difference in resident groups. In the current study, the perceived amount of time spent for teaching patients was significantly higher among family practice residents, whereas no group differences were found for time teaching medical students, peers, community members, non-physicians, or others. However, family medicine residents rated themselves higher than psychiatry residents in their understanding of their roles in teaching medical students and teaching patients. Also, family medicine residents' self-reported teaching skills were more advanced (82.4%) than psychiatry residents' (54.2%). They most likely applied at least two different teaching methods in inpatient and outpatient settings, as compared with psychiatry residents. No significant group differences were found in the other 15 items assessing teaching knowledge, skills, attitudes, and values. Results indicate that residents' knowledge, skills, attitudes, and values regarding teaching varies across institutions and training programs. The psychiatry residents in this study do not clearly understand their role as educators with patients and medical students; they have a less clear

  1. Neurosurgical Skills Assessment: Measuring Technical Proficiency in Neurosurgery Residents Through Intraoperative Video Evaluations.

    Science.gov (United States)

    Sarkiss, Christopher A; Philemond, Steven; Lee, James; Sobotka, Stanislaw; Holloway, Terrell D; Moore, Maximillian M; Costa, Anthony B; Gordon, Errol L; Bederson, Joshua B

    2016-05-01

    Although technical skills are fundamental in neurosurgery, there is little agreement on how to describe, measure, or compare skills among surgeons. The primary goal of this study was to develop a quantitative grading scale for technical surgical performance that distinguishes operator skill when graded by domain experts (residents, attendings, and nonsurgeons). Scores provided by raters should be highly reliable with respect to scores from other observers. Neurosurgery residents were fitted with a head-mounted video camera while performing craniotomies under attending supervision. Seven videos, 1 from each postgraduate year (PGY) level (1-7), were anonymized and scored by 16 attendings, 8 residents, and 7 nonsurgeons using a grading scale. Seven skills were graded: incision, efficiency of instrument use, cauterization, tissue handling, drilling/craniotomy, confidence, and training level. A strong correlation was found between skills score and PGY year (P Technical skills of neurosurgery residents recorded during craniotomy can be measured with high interrater reliability. Surgeons and nonsurgeons alike readily distinguish different skill levels. This type of assessment could be used to coach residents, to track performance over time, and potentially to compare skill levels. Developing an objective tool to evaluate surgical performance would be useful in several areas of neurosurgery education. Copyright © 2016 Elsevier Inc. All rights reserved.

  2. Outcomes assessment of a residency program in laboratory medicine.

    Science.gov (United States)

    Morse, E E; Pisciotto, P T; Hopfer, S M; Makowski, G; Ryan, R W; Aslanzadeh, J

    1997-01-01

    During a down-sizing of residency programs at a State University Medical School, hospital based residents' positions were eliminated. It was determined to find out the characteristics of the residents who graduated from the Laboratory Medicine Program, to compare women graduates with men graduates, and to compare IMGs with United States Graduates. An assessment of a 25 year program in laboratory medicine which had graduated 100 residents showed that there was no statistically significant difference by chi 2 analysis in positions (laboratory directors or staff), in certification (American Board of Pathology [and subspecialties], American Board of Medical Microbiology, American Board of Clinical Chemistry) nor in academic appointments (assistant professor to full professor) when the male graduates were compared with the female graduates or when graduates of American medical schools were compared with graduates of foreign medical schools. There were statistically significant associations by chi 2 analysis between directorship positions and board certification and between academic appointments and board certification. Of 100 graduates, there were 57 directors, 52 certified, and 41 with academic appointments. Twenty-two graduates (11 women and 11 men) attained all three.

  3. Development process and psychometric testing of foot health assessment instrument.

    Science.gov (United States)

    Stolt, Minna; Suhonen, Riitta; Puukka, Pauli; Viitanen, Matti; Voutilainen, Päivi; Leino-Kilpi, Helena

    2013-05-01

    To describe the development process of the foot health assessment instrument for the assessment of foot health in older people and to evaluate the psychometric properties of the foot health assessment instrument. In clinical nursing, assessment of foot health and recognition of foot problems in older people is fundamental for maintain older persons' independent functional ability. However, valid and reliable nurse-administered foot health assessment instruments are lacking. A cross-sectional methodological design. The foot health assessment instrument was developed in 2008-2011 based on a literature review and expertise in podiatry and nursing. Content validity was evaluated in four expert panels. Inter-rater reliability between nurses' and researcher (MS) assessments was evaluated in the pilot test and in the empirical testing of the instrument with a sample of visiting home nurses. Inter-rater reliability was calculated with Cohen's kappa, internal consistency reliability was examined with Cronbach's alpha coefficients and item analysis, and construct validity was evaluated by principal component analysis with Varimax rotation and confirmatory factor analysis. Content validity was guaranteed by the expert analyses. Inter-rater reliability improved after pilot test. The Cronbach's alpha coefficient for the total foot health assessment instrument was satisfactory. Item-to-total correlations varied between but most of them were acceptable. Principal component analysis and confirmatory factor analysis supported the four component structure of the foot health assessment instrument. The 23-item foot health assessment instrument showed preliminary acceptable psychometric properties. However, further modifications and testing are needed to strengthen the psychometric properties of the foot health assessment instrument. The existence of a foot health assessment instrument and its application would considerably improve the assessment of foot health in daily nursing

  4. Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

    Science.gov (United States)

    Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

    2014-01-01

    Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

  5. Does using the interRAI Palliative Care instrument reduce the needs and symptoms of nursing home residents receiving palliative care?

    Science.gov (United States)

    Hermans, Kirsten; De Almeida Mello, Johanna; Spruytte, Nele; Cohen, Joachim; Van Audenhove, Chantal; Declercq, Anja

    2018-02-01

    This study aimed to evaluate whether using the interRAI Palliative Care instrument (the interRAI PC) in nursing homes is associated with reduced needs and symptoms in residents nearing the end of their lives. A quasi-experimental pretest-posttest study using the Palliative care Outcome Scale (POS) was conducted to compare the needs and symptoms of residents nearing the end of their lives in the control and intervention nursing homes. Care professionals at the intervention nursing homes filled out the interRAI PC over the course of a year for all residents aged 65 years and older who were nearing the end of their lives. This intervention was not implemented in the control nursing homes. At baseline, POS scores in the intervention nursing homes were lower (more favorable) than in the control nursing homes on the items "pain", "other symptoms", "family anxiety", and the total POS score. Posttest POS scores for "wasted time" were higher (less favorable) than pretest scores in the intervention nursing homes. In the intervention nursing homes where care professionals did not have prior experience with the interRAI Long-Term Care Facilities (LTCF) assessment instrument (n = 8/15), total POS scores were lower (more favorable) at posttest. One year after introducing the interRAI PC, no reduction in residents' needs and symptoms were detected in the intervention nursing homes. However, reductions in needs and symptoms were found in the subgroup of intervention nursing homes without prior experience with the interRAI LTCF instrument. This may suggest that the use of an interRAI instrument other than the interRAI PC specifically can improve care. Future research should aim at replicating this research with a long-term design in order to evaluate the effect of integrating the use of the interRAI PC in the day-to-day practices at nursing homes.

  6. Instrumentation

    International Nuclear Information System (INIS)

    Decreton, M.

    2002-01-01

    SCK-CEN's R and D programme on instrumentation involves the development of advanced instrumentation systems for nuclear applications as well as the assessment of the performance of these instruments in a radiation environment. Particular emphasis is on the use of optical fibres as umbilincal links of a remote handling unit for use during maintanance of a fusion reacor, studies on the radiation hardening of plasma diagnostic systems; investigations on new instrumentation for the future MYRRHA accelerator driven system; space applications related to radiation-hardened lenses; the development of new approaches for dose, temperature and strain measurements; the assessment of radiation-hardened sensors and motors for remote handling tasks and studies of dose measurement systems including the use of optical fibres. Progress and achievements in these areas for 2001 are described

  7. Instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Decreton, M

    2002-04-01

    SCK-CEN's R and D programme on instrumentation involves the development of advanced instrumentation systems for nuclear applications as well as the assessment of the performance of these instruments in a radiation environment. Particular emphasis is on the use of optical fibres as umbilincal links of a remote handling unit for use during maintanance of a fusion reacor, studies on the radiation hardening of plasma diagnostic systems; investigations on new instrumentation for the future MYRRHA accelerator driven system; space applications related to radiation-hardened lenses; the development of new approaches for dose, temperature and strain measurements; the assessment of radiation-hardened sensors and motors for remote handling tasks and studies of dose measurement systems including the use of optical fibres. Progress and achievements in these areas for 2001 are described.

  8. Assessment of residency program outcomes via alumni surveys.

    Science.gov (United States)

    Lüer, Sonja; Aebi, Christoph

    2017-01-01

    One trend in medical education is outcomes-oriented training. Outcomes usually refer to individuals' acquisition of competencies, for example, during training in residency programs. However, little is known about outcomes of these programs. In order to fill this gap, human resource (HR) data were analyzed and alumni of a pediatric residency program were surveyed at the Department of Pediatrics, Bern University Hospital, Switzerland. Residency program outcomes (demographics, career choices, part-time or full-time work status, competencies, feedback) were assessed through in-house HR databases, publicly available data on the Internet (physician directory and practice homepages), and 2 alumni surveys (S1, S2). In all, 109 alumni met the inclusion criteria. Retention rate at the hospital was low (14%). Forty-six alumni (42%) in private practice were eligible for alumni surveys. Response rates were 87% (S1) and 61% (S2). Time intervals between 2 career decisions (selecting specialty of pediatrics vs selecting setting of private practice) varied widely (late-training decision to enter private practice). Mean employment level in private practice was 60% (range 20%-100%). Most valued rotation was emergency medicine; most desired competencies in future colleagues were the ability to work in a team, proficiency in pediatrics, and working economically. A broadened view on outcomes - beyond individuals' competency acquisition - provides informative insights into a training program, can allow for informed program updates, and guide future program development.

  9. OMPS Limb Profiler Instrument Performance Assessment

    Science.gov (United States)

    Jaross, Glen R.; Bhartia, Pawan K.; Chen, Grace; Kowitt, Mark; Haken, Michael; Chen, Zhong; Xu, Philippe; Warner, Jeremy; Kelly, Thomas

    2014-01-01

    Following the successful launch of the Ozone Mapping and Profiler Suite (OMPS) aboard the Suomi National Polar-orbiting Partnership (SNPP) spacecraft, the NASA OMPS Limb team began an evaluation of instrument and data product performance. The focus of this paper is the instrument performance in relation to the original design criteria. Performance that is closer to expectations increases the likelihood that limb scatter measurements by SNPP OMPS and successor instruments can form the basis for accurate long-term monitoring of ozone vertical profiles. The team finds that the Limb instrument operates mostly as designed and basic performance meets or exceeds the original design criteria. Internally scattered stray light and sensor pointing knowledge are two design challenges with the potential to seriously degrade performance. A thorough prelaunch characterization of stray light supports software corrections that are accurate to within 1% in radiances up to 60 km for the wavelengths used in deriving ozone. Residual stray light errors at 1000nm, which is useful in retrievals of stratospheric aerosols, currently exceed 10%. Height registration errors in the range of 1 km to 2 km have been observed that cannot be fully explained by known error sources. An unexpected thermal sensitivity of the sensor also causes wavelengths and pointing to shift each orbit in the northern hemisphere. Spectral shifts of as much as 0.5nm in the ultraviolet and 5 nm in the visible, and up to 0.3 km shifts in registered height, must be corrected in ground processing.

  10. Assessing Professionalism and Ethics Knowledge and Skills: Preferences of Psychiatry Residents

    Science.gov (United States)

    Marrero, Isis; Bell, Michael; Dunn, Laura B.; Roberts, Laura Weiss

    2013-01-01

    Background: Professionalism is one of the fundamental expectations and a core competency in residency education. Although programs use a variety of evaluative methods, little is known about residents' views of and preferences regarding various methods of assessment. Method: The authors surveyed residents at seven psychiatry residency programs…

  11. Developing an Instrument to Examine Student-Faculty Interaction in Faculty-in-Residence Programs

    Science.gov (United States)

    Sriram, Rishi; McLevain, Melissa

    2016-01-01

    Faculty-in-residence programs are a distinct feature of residential colleges (Ryan, 2001), but more recently, institutions of higher education have created more opportunities for faculty to reside in various types of living-learning programs, including theme housing and first-year experience communities. Within the context of this study,…

  12. Resident Self-Assessment and Learning Goal Development: Evaluation of Resident-Reported Competence and Future Goals.

    Science.gov (United States)

    Li, Su-Ting T; Paterniti, Debora A; Tancredi, Daniel J; Burke, Ann E; Trimm, R Franklin; Guillot, Ann; Guralnick, Susan; Mahan, John D

    2015-01-01

    To determine incidence of learning goals by competency area and to assess which goals fall into competency areas with lower self-assessment scores. Cross-sectional analysis of existing deidentified American Academy of Pediatrics' PediaLink individualized learning plan data for the academic year 2009-2010. Residents self-assessed competencies in the 6 Accreditation Council for Graduate Medical Education (ACGME) competency areas and wrote learning goals. Textual responses for goals were mapped to 6 ACGME competency areas, future practice, or personal attributes. Adjusted mean differences and associations were estimated using multiple linear and logistic regression. A total of 2254 residents reported 6078 goals. Residents self-assessed their systems-based practice (51.8) and medical knowledge (53.0) competencies lowest and professionalism (68.9) and interpersonal and communication skills (62.2) highest. Residents were most likely to identify goals involving medical knowledge (70.5%) and patient care (50.5%) and least likely to write goals on systems-based practice (11.0%) and professionalism (6.9%). In logistic regression analysis adjusting for postgraduate year (PGY), gender, and degree type (MD/DO), resident-reported goal area showed no association with the learner's relative self-assessment score for that competency area. In the conditional logistic regression analysis, with each learner serving as his or her own control, senior residents (PGY2/3+s) who rated themselves relatively lower in a competency area were more likely to write a learning goal in that area than were PGY1s. Senior residents appear to develop better skills and/or motivation to explicitly turn self-assessed learning gaps into learning goals, suggesting that individualized learning plans may help improve self-regulated learning during residency. Copyright © 2015 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

  13. A behavior setting assessment for community programs and residences.

    Science.gov (United States)

    Perkins, D V; Baker, F

    1991-10-01

    Using the concept of person-environment fit to determine the effectiveness of residential and program placements for chronic psychiatric clients requires systematic and concrete information about these community environments in addition to information about the clients themselves. The conceptual and empirical development of the Behavior Setting Assessment (BSA), a measure based on Barker's behavior setting theory, is described. Use of the BSA with 28 residences (117 settings) and 11 programs (176 settings) from two community support systems demonstrated that all 293 settings assessed could be described and analyzed in terms of differences in their demands for self-care skills, food preparation and consumption, verbal/cognitive responses, and solitary or group activities. The BSA is an efficient measure for obtaining specific, concrete information about the behavioral demands of important community environments.

  14. Assessment of residency program outcomes via alumni surveys

    Directory of Open Access Journals (Sweden)

    Lüer S

    2017-04-01

    Full Text Available Sonja Lüer, Christoph Aebi Department of Pediatrics, Bern University Hospital, Inselspital, University of Bern, Bern, Switzerland Background: One trend in medical education is outcomes-oriented training. Outcomes usually refer to individuals’ acquisition of competencies, for example, during training in residency programs. However, little is known about outcomes of these programs. In order to fill this gap, human resource (HR data were analyzed and alumni of a pediatric residency program were surveyed at the Department of Pediatrics, Bern University Hospital, Switzerland.Methods: Residency program outcomes (demographics, career choices, part-time or full-time work status, competencies, feedback were assessed through in-house HR databases, publicly available data on the Internet (physician directory and practice homepages, and 2 alumni surveys (S1, S2. Results: In all, 109 alumni met the inclusion criteria. Retention rate at the hospital was low (14%. Forty-six alumni (42% in private practice were eligible for alumni surveys. Response rates were 87% (S1 and 61% (S2. Time intervals between 2 career decisions (selecting specialty of pediatrics vs selecting setting of private practice varied widely (late-training decision to enter private practice. Mean employment level in private practice was 60% (range 20%–100%. Most valued rotation was emergency medicine; most desired competencies in future colleagues were the ability to work in a team, proficiency in pediatrics, and working economically.Conclusion: A broadened view on outcomes – beyond individuals’ competency acquisition – provides informative insights into a training program, can allow for informed program updates, and guide future program development. Keywords: medical education, career choice, pediatrics, private practice

  15. Assessment of otolaryngic knowledge in primary care residents.

    Science.gov (United States)

    Error, Marc E; Wilson, Kevin F; Ward, P Daniel; Gale, Derrick C; Meier, Jeremy D

    2013-03-01

    (1) Determine the amount of exposure to otolaryngology in medical training of non-otolaryngology residents. (2) Evaluate the general otolaryngic knowledge in these residents. Cross-sectional survey. Academic medical center. A 10-question multiple-choice quiz was given to residents in family practice, pediatrics, emergency medicine, and internal medicine during scheduled educational conferences. Residents were also asked if they ever participated in an otolaryngology rotation during medical school or residency. Medical students and otolaryngology residents completed the quiz to act as controls. A total of 98 examinations were analyzed (49 non-otolaryngology residents, 10 otolaryngology residents, and 39 second-year medical students). Only 24% of the non- otolaryngology residents had an otolaryngology rotation during medical school. The same amount (24%) had a rotation during residency. The average percentage correct on the quiz was 48%, 56%, and 92% for medical students, non-otolaryngology, and otolaryngology residents, respectively (P medical school or residency. This nonvalidated questionnaire also suggested significant deficiencies in basic otolaryngic knowledge in these residents. Identifying mechanisms to improve exposure to otolaryngology in the medical training curriculum is needed.

  16. Assessing the local windfield with instrumentation

    Energy Technology Data Exchange (ETDEWEB)

    Zambrano, T.G.

    1980-10-01

    This report concerns the development and testing of a technique for the initial screening and evaluation of potential sites for wind-energy conversion systems (WECS). The methodology was developed through a realistic siting exercise. The siting exercise involved measurements of winds along the surface and winds aloft using a relatively new instrument system, the Tethered Aerodynamic Lifting Anemometer (TALA) kite; notation of ecological factors such as vegetation flagging, soil erosion and site exposure, and verification of an area best suited for wind-energy development by establishing and maintaining a wind monitoring network. The siting exercise was carried out in an approximately 100-square-mile region of the Tehachapi Mountains of Southern California. The results showed that a comprehensive site survey involving field measurements, ecological survey, and wind-monitoring can be an effective tool for preliminary evaluation of WECS sites.

  17. [work motivation -- assessment instruments and their relevance for medical care].

    Science.gov (United States)

    Fiedler, Rolf G; Ranft, Andreas; Greitemann, Bernhard; Heuft, Gereon

    2005-11-01

    The relevance of work motivation for medical research and healthcare, in particular rehabilitation, is described. Four diagnostic instruments in the German language are introduced which can assess work motivation using a scale system: AVEM, JDS, LMI and FBTM. Their possible application and potential usage for the clinical area are discussed. Apart from the FBTM, none of these instruments can be directly used as a general instrument in a normal medical clinical setting. Finally, a current model for work motivation (compensatory model of work motivation and volition) is presented that contains basis concepts, which are judged as important for future research questions concerning the development of motivation diagnostic instruments.

  18. Continuity of care: a nursing needs assessment instrument.

    Science.gov (United States)

    Holland, D E; Hansen, D C; Matt-Hensrud, N N; Severson, M A; Wenninger, C R

    1998-01-01

    Based on testing of the Uniform Needs Assessment Instrument (UNAI), a nursing needs assessment tool for adult hospitalized patients was integrated into nursing practice. Some content and format changes to the UNAI occurred as a result of the research process. The revised assessment form is called the Nursing Needs Assessment Instrument (NNAI). Community providers, including nursing home and home health care personnel, use the NNAI to derive necessary admission data for assessing patients, planning care, and communicating with other staff regarding patient needs. Instituting an evidence-based practice change in hospital discharge forms enables the next care provider to consistently meet the patient's continuing needs.

  19. Frailty assessment instruments: Systematic characterization of the uses and contexts of highly-cited instruments

    Science.gov (United States)

    Buta, Brian J.; Walston, Jeremy D.; Godino, Job G.; Park, Minsun; Kalyani, Rita R.; Xue, Qian-Li; Bandeen-Roche, Karen; Varadhan, Ravi

    2016-01-01

    The medical syndrome of frailty is widely recognized, yet debate remains over how best to measure it in clinical and research settings. This study reviewed the frailty-related research literature by (a) comprehensively cataloging the wide array of instruments that have been utilized to measure frailty, and (b) systematically categorizing the different purposes and contexts of use for frailty instruments frequently cited in the research literature. We identified 67 frailty instruments total; of these, nine were highly-cited (≥200 citations). We randomly sampled and reviewed 545 English-language articles citing at least one highly-cited instrument. We estimated the total number of uses, and classified use into eight categories: risk assessment for adverse health outcomes (31% of all uses); etiological studies of frailty (22%); methodology studies (14%); biomarker studies (12%); inclusion/exclusion criteria (10%); estimating prevalence as primary goal (5%); clinical decision-making (2%); and interventional targeting (2%). The most common assessment context was observational studies of older community-dwelling adults. Physical Frailty Phenotype was the most used frailty instrument in the research literature, followed by the Deficit Accumulation Index and the Vulnerable Elders Survey. This study provides an empirical evaluation of the current uses of frailty instruments, which may be important to consider when selecting instruments for clinical or research purposes. We recommend careful consideration in the selection of a frailty instrument based on the intended purpose, domains captured, and how the instrument has been used in the past. Continued efforts are needed to study the validity and feasibility of these instruments. PMID:26674984

  20. the research quality plus (rq+) assessment instrument

    International Development Research Centre (IDRC) Digital Library (Canada)

    sclarke

    the research, and the extent to which attention to integrity is reflected in the research outputs. Ways of judging integrity will differ for qualitative, quantitative or mixed methods designs; care should be taken to ensure that appropriate standards are applied for each case. In making this assessment, external reviewers should ...

  1. Standardized methodological assessment of research presentations (SHARP): development of a new instrument.

    Science.gov (United States)

    Farrokhyar, Forough; Dath, Deepak; Amin, Nalin; Bhandari, Mohit; Kelly, Stephen; Kolkin, Ann; Gill Pottruff, Catherine; Reid, Susan

    2014-06-01

    There are currently no validated guidelines to assess the quality of the content and the delivery style of scientific podium surgical presentations. We have developed a simple, short, and reliable instrument to objectively assess the overall quality of scientific podium presentations. A simple and efficient rating instrument was developed to assess the scientific content and presentation style/skills of the surgical residents' presentations from 1996 to 2013. Absolute and consistency agreement for the different sections of the instrument was determined and assessed overtime, by stage of the project and study design. Intraclass correlation coefficients with 95% confidence intervals were calculated and reported using a mixed-effects model. Inter-rater reliability for both absolute and consistency agreement was substantial for total score and for each of the 3 sections of the instrument. The absolute agreement for the overall rating of the presentations was .87 (.63 to .98) and .78 (.50 to .95), and the consistency agreement was .90 (.70 to .99) and .87 (.67 to .97) for the 2012 and 2013 institutional research presentations, respectively. Rater agreement for evaluating project stage and different study designs varied from .70 to .81 and was consistent over the years. The consistency agreement in rating of the presentation was .77 for both faculty and resident raters. Standardized methodological assessment of research presentations (SHARP) instrument rates the scientific quality of the research and style of the delivered presentation. It is highly reliable in scoring the quality of the all study designs regardless of their stage. We recommend that researchers focus on presenting the key concepts and significant elements of their evidence using visually simple slides in a professionally engaging manner for effective delivery of their research and better communication with the audience. Copyright © 2014 Elsevier Inc. All rights reserved.

  2. Consultants' opinion on a new practice-based assessment programme for first-year residents in anaesthesiology

    DEFF Research Database (Denmark)

    Ringsted, C; ØStergaard, D; Scherpbier, A

    2002-01-01

    , organizational skills and collaborative skills, scholarly proficiencies and professionalism. Eighteen out of a total of 21 assessment instruments were used for pass/fail decisions. The aim of this study was to survey consultants' opinions of the programme in terms of the representativeness of competencies tested......BACKGROUND: Assessment in postgraduate education is moving towards using a broad spectrum of practice-based assessment methods. This approach was recently introduced in first-year residency in anaesthesiology in Denmark. The new assessment programme covers: clinical skills, communication skills......, the suitability of the programme as a basis for pass/fail decisions and the relevance and sufficiency of the content of the different assessment instruments. METHODS: A description of the assessment programme and a questionnaire were sent to all consultants of anaesthesiology in Denmark. The questionnaire...

  3. Assessing hospitals' clinical risk management: Development of a monitoring instrument

    Directory of Open Access Journals (Sweden)

    Pfeiffer Yvonne

    2010-12-01

    Full Text Available Abstract Background Clinical risk management (CRM plays a crucial role in enabling hospitals to identify, contain, and manage risks related to patient safety. So far, no instruments are available to measure and monitor the level of implementation of CRM. Therefore, our objective was to develop an instrument for assessing CRM in hospitals. Methods The instrument was developed based on a literature review, which identified key elements of CRM. These elements were then discussed with a panel of patient safety experts. A theoretical model was used to describe the level to which CRM elements have been implemented within the organization. Interviews with CRM practitioners and a pilot evaluation were conducted to revise the instrument. The first nationwide application of the instrument (138 participating Swiss hospitals was complemented by in-depth interviews with 25 CRM practitioners in selected hospitals, for validation purposes. Results The monitoring instrument consists of 28 main questions organized in three sections: 1 Implementation and organizational integration of CRM, 2 Strategic objectives and operational implementation of CRM at hospital level, and 3 Overview of CRM in different services. The instrument is available in four languages (English, German, French, and Italian. It allows hospitals to gather comprehensive and systematic data on their CRM practice and to identify areas for further improvement. Conclusions We have developed an instrument for assessing development stages of CRM in hospitals that should be feasible for a continuous monitoring of developments in this important area of patient safety.

  4. Assessing hospitals' clinical risk management: Development of a monitoring instrument.

    Science.gov (United States)

    Briner, Matthias; Kessler, Oliver; Pfeiffer, Yvonne; Wehner, Theo; Manser, Tanja

    2010-12-13

    Clinical risk management (CRM) plays a crucial role in enabling hospitals to identify, contain, and manage risks related to patient safety. So far, no instruments are available to measure and monitor the level of implementation of CRM. Therefore, our objective was to develop an instrument for assessing CRM in hospitals. The instrument was developed based on a literature review, which identified key elements of CRM. These elements were then discussed with a panel of patient safety experts. A theoretical model was used to describe the level to which CRM elements have been implemented within the organization. Interviews with CRM practitioners and a pilot evaluation were conducted to revise the instrument. The first nationwide application of the instrument (138 participating Swiss hospitals) was complemented by in-depth interviews with 25 CRM practitioners in selected hospitals, for validation purposes. The monitoring instrument consists of 28 main questions organized in three sections: 1) Implementation and organizational integration of CRM, 2) Strategic objectives and operational implementation of CRM at hospital level, and 3) Overview of CRM in different services. The instrument is available in four languages (English, German, French, and Italian). It allows hospitals to gather comprehensive and systematic data on their CRM practice and to identify areas for further improvement. We have developed an instrument for assessing development stages of CRM in hospitals that should be feasible for a continuous monitoring of developments in this important area of patient safety.

  5. Group assessments of resident physicians improve reliability and decrease halo error.

    Science.gov (United States)

    Thomas, Matthew R; Beckman, Thomas J; Mauck, Karen F; Cha, Stephen S; Thomas, Kris G

    2011-07-01

    Individual faculty assessments of resident competency are complicated by inconsistent application of standards, lack of reliability, and the "halo" effect. We determined whether the addition of faculty group assessments of residents in an ambulatory clinic, compared with individual faculty-of-resident assessments alone, have better reliability and reduced halo effects. This prospective, longitudinal study was performed in the outpatient continuity clinics of a large internal medicine residency program. Faculty-on-resident and group faculty-on-resident assessment scores were used for comparison. Overall mean scores were significantly higher for group than individual assessments (3.92 ± 0.51 vs. 3.83 ± 0.38, p = 0.0001). Overall inter-rater reliability increased when combining group and individual assessments compared to individual assessments alone (intraclass correlation coefficient, 95% CI = 0.828, 0.785-0.866 vs. 0.749, 0.686-0.804). Inter-item correlations were less for group (0.49) than individual (0.68) assessments. This study demonstrates improved inter-rater reliability and reduced range restriction (halo effect) of resident assessment across multiple performance domains by adding the group assessment method to traditional individual faculty-on-resident assessment. This feasible model could help graduate medical education programs achieve more reliable and discriminating resident assessments.

  6. Competency-based achievement system: using formative feedback to teach and assess family medicine residents' skills.

    Science.gov (United States)

    Ross, Shelley; Poth, Cheryl N; Donoff, Michel; Humphries, Paul; Steiner, Ivan; Schipper, Shirley; Janke, Fred; Nichols, Darren

    2011-09-01

    Family medicine residency programs require innovative means to assess residents' competence in "soft" skills (eg, patient-centred care, communication, and professionalism) and to identify residents who are having difficulty early enough in their residency to provide remedial training. To develop a method to assess residents' competence in various skills and to identify residents who are having difficulty. The Competency-Based Achievement System (CBAS) was designed to measure competence using 3 main principles: formative feedback, guided self-assessment, and regular face-to-face meetings. The CBAS is resident driven and provides a framework for meaningful interactions between residents and advisors. Residents use the CBAS to organize and review their feedback, to guide their own assessment of their progress, and to discern their future learning needs. Advisors use the CBAS to monitor, guide, and verify residents' knowledge of and competence in important skills. By focusing on specific skills and behaviour, the CBAS enables residents and advisors to make formative assessments and to communicate their findings. Feedback indicates that the CBAS is a user-friendly and helpful system to assess competence.

  7. Assessing work-related musculoskeletal symptoms among otolaryngology residents.

    Science.gov (United States)

    Wong, Kevin; Grundfast, Kenneth M; Levi, Jessica R

    Previous studies have suggested that musculoskeletal symptoms are common among practicing otolaryngologists. Early training can be the ideal time to foster knowledge of ergonomics and develop safe work habits, however, little data exists regarding musculoskeletal symptoms in residents. The purpose of this study was to identify and characterize musculoskeletal symptoms in a preliminary sample of otolaryngology residents. A cross-sectional survey incorporating the Nordic Musculoskeletal Questionnaire was sent to 30 Otolaryngology-Head and Neck Surgery residencies to examine musculoskeletal symptoms among residents. A two-sample test of proportions was performed to compare symptoms between male and female residents. In total, 141 respondents (response rate=34.7%) completed the survey. Fifty-five percent of survey respondents were male and 45% were female. Musculoskeletal symptoms were most frequently reported in the neck (82.3%), followed by the lower back (56%), upper back (40.4%), and shoulders (40.4%). The most common symptoms were stiffness in the neck (71.6%), pain in the neck (61.7%), and pain in the lower back (48.2%). In total, 6.4% of residents missed work and 16.3% of residents stopped during an operation at some point due to their symptoms. Most residents (88.3%) believed their musculoskeletal symptoms were attributed to their surgical training. Female residents were significantly more likely to experience neck (p<0.0001) and wrist/hand (p=0.019) discomfort compared to male residents. Musculoskeletal symptoms were common among residents, approaching rates similar to those previously identified in practicing otolaryngologists. Increased emphasis on surgical ergonomics is warranted to improve workplace safety and prevent future injury. Copyright © 2017. Published by Elsevier Inc.

  8. Interprofessional education assessment and planning instrument for academic institutions.

    Science.gov (United States)

    Greer, Annette Grady; Clay, Maria C

    2010-01-01

    This article describes the creation, development, and peer review of an instrument for the assessment and improvement of interprofessional health educational programs in public and private health educational institutions nationally and internationally. The self-assessment is constructed with consideration of the following domains: educational venues, educational evaluation, programmatic participation, institutional support, and faculty incentives. The interprofessional education assessment and planning instrument for academic institutions can be a major aide in helping national and international leaders promoting IPE as the method to prepare future health professionals.

  9. Using Longitudinal Scales Assessment for Instrumental Music Students

    Science.gov (United States)

    Simon, Samuel H.

    2014-01-01

    In music education, current assessment trends emphasize student reflection, tracking progress over time, and formative as well as summative measures. This view of assessment requires instrumental music educators to modernize their approaches without interfering with methods that have proven to be successful. To this end, the Longitudinal Scales…

  10. Advanced Practice Nursing Competency Assessment Instrument (APNCAI): clinimetric validation

    OpenAIRE

    Sastre-Fullana, Pedro; Morales-Asencio, Jose Miguel; Ses?-Abad, Albert; Bennasar-Veny, Miquel; Fern?ndez-Dom?nguez, Juan Carlos; De Pedro-G?mez, Joan

    2017-01-01

    Objective To describe the development and clinimetric validation of the Advanced Practice Nursing Competency Assessment Instrument (APNCAI) through several evidence sources about reliability and validity in the Spanish context. Design and setting APNCAI development was based on a multisequential and systematic process: literature review, instrument content consensus through qualitative Delphi method approach (a panel of 51 Advanced Practice in Nursing ?APN? experts was selected) and the clini...

  11. Towards Developing a Quantitative Literacy/Reasoning Assessment Instrument

    Directory of Open Access Journals (Sweden)

    Eric Gaze

    2014-07-01

    Full Text Available This article reports on the development and implementation of a non-proprietary assessment instrument for Quantitative Literacy/Reasoning. This instrument was based on prior work by Bowdoin College, Colby-Sawyer College, and Wellesley College and was piloted in 2012 and 2013. This article presents a discussion of its development as well as the results of the pilot implementation. This work was supported by a TUES Type 1 grant from the National Science Foundation.

  12. Assessing Residents' Confidence in the Context of Pharmacotherapy Competence.

    Science.gov (United States)

    Rakofsky, Jeffrey J; Garlow, Steven J; Haroon, Ebrahim; Hermida, Adriana P; Young, John Q; Dunlop, Boadie W

    2017-06-01

    We aimed to determine whether residents' confidence initiating medications increased with the number of times they prescribed individual medications and to quantify the relationship between prescription frequency and gains in confidence. From July 2011 to June 2014, PGY-3 residents completed a survey of confidence levels at their psychopharmacology clinic orientation and then again 12 months later. The Emory Healthcare electronic medical record was used to identify all medications prescribed by each resident during their 12-month rotation and the frequency of these prescriptions. Confidence in initiating treatment with all medicines/medication classes increased over the 12-month period. For three of the medication classes for which residents indicated they were least confident at orientation, the number of prescriptions written during the year was significantly associated with an increase in confidence. Measuring resident confidence is a relevant and achievable outcome and provides data for educators regarding the amount of experience needed to increase confidence.

  13. Menopause education: needs assessment of American obstetrics and gynecology residents.

    Science.gov (United States)

    Christianson, Mindy S; Ducie, Jennifer A; Altman, Kristiina; Khafagy, Ayatallah M; Shen, Wen

    2013-11-01

    This study aims to understand the current teaching of menopause medicine in American obstetrics and gynecology residency programs. A Web-based survey was e-mailed to all American obstetrics and gynecology residency directors, with a request that they forward it to their residents. Of 258 residency program directors contacted, 79 (30.6%) confirmed forwarding the survey. In all, 1,799 people received the survey, with 510 completions, for a response rate of 28.3%. Most residents reported that they had limited knowledge and needed to learn more about these aspects of menopause medicine: pathophysiology of menopause symptoms (67.1%), hormone therapy (68.1%), nonhormone therapy (79.0%), bone health (66.1%), cardiovascular disease (71.7%), and metabolic syndrome (69.5%). Among fourth-year residents who will be entering clinical practice soon, a large proportion also reported a need to learn more in these areas: pathophysiology of menopause symptoms (45.9%), hormone therapy (54.2%), nonhormone therapy (69.4%), bone health (54.2%), cardiovascular disease (64.3%), and metabolic syndrome (63.8%). When asked to rate the most preferred modalities for learning about menopause, the top choice was supervised clinics (53.2%), followed by case presentations (22.2%), formal lectures (21.3%), small groups (14.7%), Web-based learning (7.8%), and independent reading (5.2%). Only 20.8% of residents reported that their program had a formal menopause medicine learning curriculum, and 16.3% had a defined menopause clinic as part of their residency. It seems that some American residency programs do not fulfill the educational goals of their residents in menopause medicine. A curriculum would be beneficial for increasing knowledge and clinical experience on menopause issues.

  14. EARLY READING ASSESSMENT INSTRUMENTS: ABILITIES AND PROCESSES INVOLVED

    Directory of Open Access Journals (Sweden)

    Ana Cláudia de Souza

    2017-04-01

    Full Text Available This study investigates the following early reading assessment instruments: “Bateria de Recepção e Produção da Linguagem Verbal” (SCLIAR-CABRAL, 2003a and “Teste de Competência de Leitura de Palavras e Pseudopalavras” (SEABRA; CAPOVILLA, 2010. The main research goal is to analyze in each one of these reading assessment instruments some of the multiple cognitive processes and basic low-level abilities involved in reading. In this sense, decoding, word recognition, lexical access, syntactic and textual processing, and comprehension are the cognitive processes taken into account. With regard to the basic reading abilities, accuracy and fluency (rhythm, prosody and speed are considered. The results indicate that each one of the analyzed reading assessment instruments assesses different aspects of the reading processes and abilities, mainly through off-line measures. ScliarCabral’s assessment battery allows the researcher or the teacher to evaluate the following processes: perception of the grapheme opposition in minimal pairs of words and in sentences, difficulties in sentence processing, skills in decoding the graphemic-phonemic relationship, and textual comprehension. In its turn, the reading assessment instrument proposed by Seabra e Capovilla allows one to evaluate student’s reading development level, by classifying the kind of processing as logographic, alphabetic or orthographic.

  15. Practical Implications for an Effective Radiology Residency Quality Improvement Program for Milestone Assessment.

    Science.gov (United States)

    Leddy, Rebecca; Lewis, Madelene; Ackerman, Susan; Hill, Jeanne; Thacker, Paul; Matheus, Maria; Tipnis, Sameer; Gordon, Leonie

    2017-01-01

    Utilization of a radiology resident-specific quality improvement (QI) program and curriculum based on the Accreditation Council for Graduate Medical Education (ACGME) milestones can enable a program's assessment of the systems-based practice component and prepare residents for QI implementation post graduation. This article outlines the development process, curriculum, QI committee formation, and resident QI project requirements of one institution's designated radiology resident QI program. A method of mapping the curriculum to the ACGME milestones and assessment of resident competence by postgraduate year level is provided. Sample projects, challenges to success, and lessons learned are also described. Survey data of current trainees and alumni about the program reveal that the majority of residents and alumni responders valued the QI curriculum and felt comfortable with principles and understanding of QI. The most highly valued aspect of the program was the utilization of a resident education committee. The majority of alumni responders felt the residency quality curriculum improved understanding of QI, assisted with preparation for the American Board of Radiology examination, and prepared them for QI in their careers. In addition to the survey results, outcomes of resident project completion and resident scholarly activity in QI are evidence of the success of this program. It is hoped that this description of our experiences with a radiology resident QI program, in accordance with the ACGME milestones, may facilitate the development of successful QI programs in other diagnostic radiology residencies. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

  16. Needs assessment of Wisconsin primary care residents and faculty regarding interest in global health training

    Directory of Open Access Journals (Sweden)

    Sanders James

    2009-06-01

    Full Text Available Abstract Background The primary objectives of this study were to assess Wisconsin's primary care residents' attitudes toward international health training, the interest among faculty to provide IH training, and the preferred modality of IH training. Methods Surveys were administered using 505 residents and 413 medical faculty in primary care residencies in Wisconsin. Results from 128 residents and 118 medical school faculty members were collected during the spring of 2007 and analyzed. Results In total, 25% of residents (128/505 and 28% of faculty (118/413 responded to the survey. A majority of residents (58% and faculty (63% were interested in global health issues. Among residents, 63% planned on spending professional time working abroad. Few residents (9% and faculty (11% assess their residencies as preparing residents well to address topics relating to international health. The survey indicates that adequate faculty in Wisconsin could provide mentorship in international health as 47% (55 of faculty had experience working as a physician internationally, 49% (58 of faculty spend more than 25% clinical time caring for patient from underserved communities and 39% (46 would be willing to be involved with developing curriculum, lecturing and/or mentoring residents in international health. Conclusion Overall, the majority of the respondents expressed high interest in IH and few felt prepared to address IH issues indicating a need for increased training in this area. The findings of this survey are likely relevant as a prototype for other primary care residencies.

  17. Contribution of promoting the green residence assessment scheme to energy saving

    International Nuclear Information System (INIS)

    Huang, Zhiyu; Yuan, Hongping; Shen, Liyin

    2012-01-01

    Green residence development has been one of the important strategies for promoting sustainable urban development. Governments throughout the world have been encouraging property developers to deliver green properties. In line with this development, governments have been implementing various assessment programs to certify green residential buildings with the aim of contributing to sustainable urban development. With reference to the Chinese construction practice, this paper examines the effectiveness of the green residence assessment scheme toward its defined aim through investigating the contents and procedures of the green residence assessment scheme by referring to the practices of Chongqing city in western China. Based on the results of five case studies and five semi-structured interviews, this study reveals the significant contribution from implementing the green residence assessment scheme particularly to energy saving in residential buildings. Further, the green residence assessment scheme promotes the application of green building materials and green construction technologies in the entire process of delivering and operating residential buildings. The findings provide valuable references for further investigating alternative methods to achieve better energy saving in developing residential buildings. - Highlights: ► Energy saving in residence development is important for sustainable urban development. ► Green residence assessment scheme contributes significantly to energy saving in residences. ► Green residence assessment promotes application of environmentally friendly building materials and technologies

  18. Evaluating Psychiatry Residents as Physician-Managers: Development of an Assessment Tool

    Science.gov (United States)

    Sockalingam, Sanjeev; Stergiopoulos, Vicky; Maggi, Julie D.; Zaretsky, Ari; Stovel, Laura; Hodges, Brian

    2013-01-01

    Objectives: With the emergence of physician-manager (PM) curricula in medical education, more effective assessment tools are needed to evaluate psychiatry trainees in this role. The aim of this study was to determine psychiatry residents', program directors', and PM educators' perceptions about PM role-assessment. Methods: Psychiatry residents at…

  19. Social worker assessment of bad news delivery by emergency medicine residents: a novel direct-observation milestone assessment.

    Science.gov (United States)

    Min, Alice Ann; Spear-Ellinwood, Karen; Berman, Melissa; Nisson, Peyton; Rhodes, Suzanne Michelle

    2016-09-01

    The skill of delivering bad news is difficult to teach and evaluate. Residents may practice in simulated settings; however, this may not translate to confidence or competence during real experiences. We investigated the acceptability and feasibility of social workers as evaluators of residents' delivery of bad news during patient encounters, and assessed the attitudes of both groups regarding this process. From August 2013 to June 2014, emergency medicine residents completed self-assessments after delivering bad news. Social workers completed evaluations after observing these conversations. The Assessment tools were designed by modifying the global Breaking Bad News Assessment Scale. Residents and social workers completed post-study surveys. 37 evaluations were received, 20 completed by social workers and 17 resident self-evaluations. Social workers reported discussing plans with residents prior to conversations 90 % of the time (18/20, 95 % CI 64.5, 97.8). Social workers who had previously observed the resident delivering bad news reported that the resident was more skilled on subsequent encounters 90 % of the time (95 % CI 42.2, 99). Both social workers and residents felt that prior training or experience was important. First-year residents valued advice from social workers less than advice from attending physicians, whereas more experienced residents perceived advice from social workers to be equivalent with that of attending physicians (40 versus 2.9 %, p = 0.002). Social worker assessment of residents' abilities to deliver bad news is feasible and acceptable to both groups. This formalized self-assessment and evaluation process highlights the importance of social workers' involvement in delivery of bad news, and the teaching of this skill. This method may also be used as direct-observation for resident milestone assessment.

  20. Choosing Assessment Instruments for Bulimia Practice and Outcome Research

    Science.gov (United States)

    Sandberg, Katie; Erford, Bradley T.

    2013-01-01

    Six commonly used instruments for assessment of eating disorders were analyzed. Effect size results from Erford et al.'s (2013) meta-analysis for the treatment of bulimia nervosa were used to compare each scale's ability to measure treatment outcomes for bulimia nervosa. Effect size comparisons indicated higher overall effect sizes using the…

  1. Creation and Validation of a Sabbatical Assessment Instrument.

    Science.gov (United States)

    Miller, Michael T.

    Personal narratives provide typically unabashed enthusiasm for sabbatical leave programs, but few studies have explored the results of sabbaticals and the impact that these sabbaticals can and do have on the department and the university. This paper reports on the creation of an assessment instrument to measure the impact of a faculty member's…

  2. Facet Analysis of the Client Needs Assessment Instrument.

    Science.gov (United States)

    Dancer, L. Suzanne; Stanley, Lawrence R.

    The structure of the revised Client Needs Assessment Instrument (CNAI) is examined. In 1978-79, the Texas Department of Human Resources (DHR) developed the CNAI to provide an index of applicants' and clients' capacity for self-care by measuring the respondents' levels of functioning in: (1) physical health; (2) daily living activities; (3) mental…

  3. development and validation of an instrument for assessing junior ...

    African Journals Online (AJOL)

    PROF. BARTH EKWEME

    school Mathematics classroom environment as it affects teaching and learning of Mathematics in Enugu. State. ... plays a significant role in computer technology. ... classroom. The main purpose of this study was to develop and validate an instrument for assessing junior secondary school Mathematics classroom learning ...

  4. Self-assessment on the competencies and reported improvement priorities for pediatrics residents.

    Science.gov (United States)

    Li, Su-Ting T; Tancredi, Daniel J; Burke, Ann E; Guillot, Ann; Guralnick, Susan; Trimm, R Franklin; Mahan, John D

    2012-12-01

    Self-assessment and self-directed learning are essential to becoming an effective physician. To identify factors associated with resident self-assessment on the competencies, and to determine whether residents chose areas of self-assessed relative weakness as areas for improvement in their Individualized Learning Plan (ILP). We performed a cross-sectional analysis of the American Academy of Pediatrics' PediaLink ILP database. Pediatrics residents self-assessed their competency in the 6 Accreditation Council for Graduate Medical Education competencies using a color-coded slider scale with end anchors "novice" and "proficient" (0-100), and then chose at least 1 competency to improve. Multivariate regression explored the relationship between overall confidence in core competencies, sex, level of training, and degree (MD or DO) status. Correlation examined whether residents chose to improve competencies in which they rated themselves as lower. A total of 4167 residents completed an ILP in academic year 2009-2010, with residents' ratings improving from advanced beginner (48 on a 0-100 scale) in postgraduate year-1 residents (PGY-1s) to competent (75) in PGY-3s. Residents rated themselves as most competent in professionalism (mean, 75.3) and least competent in medical knowledge (mean, 55.8) and systems-based practice (mean, 55.2). In the adjusted regression model, residents' competency ratings increased by level of training and whether they were men. In PGY-3s, there was no difference between men and women. Residents selected areas for improvement that correlated to competencies where they had rated themselves lower (P self-assessment of their competencies increased by level of training, although residents rated themselves as least competent in medical knowledge and systems-based practice, even as PGY-3s. Residents tended to choose subcompetencies, which they rated as lower to focus on improving.

  5. EVA: laparoscopic instrument tracking based on Endoscopic Video Analysis for psychomotor skills assessment.

    Science.gov (United States)

    Oropesa, Ignacio; Sánchez-González, Patricia; Chmarra, Magdalena K; Lamata, Pablo; Fernández, Alvaro; Sánchez-Margallo, Juan A; Jansen, Frank Willem; Dankelman, Jenny; Sánchez-Margallo, Francisco M; Gómez, Enrique J

    2013-03-01

    The EVA (Endoscopic Video Analysis) tracking system is a new system for extracting motions of laparoscopic instruments based on nonobtrusive video tracking. The feasibility of using EVA in laparoscopic settings has been tested in a box trainer setup. EVA makes use of an algorithm that employs information of the laparoscopic instrument's shaft edges in the image, the instrument's insertion point, and the camera's optical center to track the three-dimensional position of the instrument tip. A validation study of EVA comprised a comparison of the measurements achieved with EVA and the TrEndo tracking system. To this end, 42 participants (16 novices, 22 residents, and 4 experts) were asked to perform a peg transfer task in a box trainer. Ten motion-based metrics were used to assess their performance. Construct validation of the EVA has been obtained for seven motion-based metrics. Concurrent validation revealed that there is a strong correlation between the results obtained by EVA and the TrEndo for metrics, such as path length (ρ = 0.97), average speed (ρ = 0.94), or economy of volume (ρ = 0.85), proving the viability of EVA. EVA has been successfully validated in a box trainer setup, showing the potential of endoscopic video analysis to assess laparoscopic psychomotor skills. The results encourage further implementation of video tracking in training setups and image-guided surgery.

  6. Assessing Resident Performance in Screening Mammography: Development of a Quantitative Algorithm.

    Science.gov (United States)

    Lewis, Petra J; Rooney, Timothy B; Frazee, Tracy E; Poplack, Steven P

    2018-01-20

    This study aims to provide objective performance data and feedback, including examination volumes, recall rates, and concordance with faculty interpretations, for residents performing independent interpretation of screening mammography examinations. Residents (r) and faculty (f) interpret screening mammograms separately and identify non-callbacks (NCBs) and callbacks (CBs). Residents review all discordant results. The number of concordant interpretations (fCB-rCB and fNCB-rNCB) and discordant interpretations (fCB-rNCB and fNCB-rCB) are entered into a macro-driven spreadsheet. These macros weigh the data dependent on the perceived clinical impact of the resident's decision. Weighted outcomes are combined with volumes to generate a weighted mammography performance score. Rotation-specific goals are assigned for the weighted score, screening volumes, recall rate relative to faculty, and concordance rates. Residents receive one point for achieving each goal. Between July 2013 and May 2017, 18,747 mammography examinations were reviewed by 31 residents, in 71 resident rotations, over 246 resident weeks. Mean resident recall rate was 9.9% and significantly decreased with resident level (R), R2 = 11.3% vs R3 = 9.4%, R4 = 9.2%. Mean resident-faculty discordance rate was 10% and significantly decreased from R2 = 12% to R4 = 9.6%. Weighted performance scores ranged from 1.1 to 2.0 (mean 1.6, standard deviation 0.17), but did not change with rotation experience. Residents had a mean goal achievement score of 2.6 (standard deviation 0.47). This method provides residents with easily accessible case-by-case individualized screening outcome data over the longitudinal period of their residency, and provides an objective method of assessing resident screening mammography performance. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

  7. Geriatric assessment with focus on instrument selectivity for outcomes.

    Science.gov (United States)

    Extermann, Martine

    2005-01-01

    More than one half of all cancers in developed countries occur in patients aged 70 years and older. Therefore, in recent years, there has been a growing interest in integrating a comprehensive geriatric assessment into the management of these patients with cancer. This review article emphasizes the data gathered so far on the correlation between such an assessment and outcome in patients with cancer. The most developed data relate to functional status and comorbidity. Geriatric instruments appear more sensitive than classic oncological instruments in measuring functional status. There is also good evidence that as a patient's age advances, comorbidity affects in an increasing fashion their survival and cancer management. Some evidence is beginning to appear as to the impact a comprehensive geriatric assessment could have on the oncologic management of older patients with cancer.

  8. Development and Validation of an Instrument to Assess Secondary School Students' Perceptions of Assessment Tasks

    Science.gov (United States)

    Dorman, Jeffrey P.; Knightley, Wendy M.

    2006-01-01

    Research aimed at developing and validating an instrument to assess secondary school students' perceptions of assessment tasks was conducted. Following a review of literature, a five-scale instrument of 40 items was trialled with a sample of 658 science students in 11 English secondary schools. Based on internal consistency reliability data and…

  9. Competences, competences assessment, validity of instruments, Preschool Education

    Directory of Open Access Journals (Sweden)

    Rigoberto Marín Uribe

    2012-05-01

    Full Text Available The purpose of this article is to describe the design process, validation and assurance of an instrument for the assessment of the success level of competences in preschool children. Initially is presented a theoretical and contextual framework of the competences in preschool. With this, it is problematized about the absence of tools for that the educators could perform the diagnostic evaluation of competences required in the reform of preschool education 2004. In the design of the instrument, the concept of “situation” is central. The validation and assurance included a process of pilotage with 512 preschool children with the implementing in practice of three different ways of application of the instrument. The results show high levels of assurance and power of discrimination that allow to distinguish significantly people by age and socioeconomic level, not finding differences by genre.

  10. Assessment of resident physicians in professionalism, interpersonal and communication skills: a multisource feedback.

    Science.gov (United States)

    Qu, Bo; Zhao, Yu-hong; Sun, Bao-zhi

    2012-01-01

    To assess the internal validity and reliability of a multisource feedback (MSF) program by China Medical Board for resident physicians in China. Multisource feedback was used to assess professionalism, interpersonal and communication skills. 258 resident physicians were assessed by attending doctors, self-evaluation, resident peers, nurses, office staffs, and patients who completed a sealed questionnaire at 19 hospitals in China. Cronbach's alpha coefficient was used to assess reliability. Validity was assessed by exploratory factor analyses and by profile ratings. 4128 questionnaires were collected from this study. All responses had high internal consistency and reliability (Cronbach's α > 0.90), which suggests that both questions and form data were internally consistent. The exploratory factor analysis with varimax rotation for the evaluators' questionnaires was able to account for 70 to 74% of the total variance. The current MSF assessment tools are internally valid and reliable for assessing resident physician professionalism and interpersonal and communication skills in China.

  11. Recognition and assessment of resident' deterioration in the nursing home setting: a critical ethnography.

    Science.gov (United States)

    Laging, Bridget; Kenny, Amanda; Bauer, Michael; Nay, Rhonda

    2018-02-03

    To explore the recognition and assessment of resident deterioration in the nursing home setting. There is a dearth of research exploring how nurses and personal-care-assistants manage a deteriorating nursing home resident. Critical ethnography. Observation and semi-structured interviews with 66 participants (residents, family, nurses, personal-care-assistants and general practitioners) in two Australian nursing homes. The study has been reported in accordance with the Consolidated Criteria for Reporting Qualitative Research guidelines. The value of nursing assessment is poorly recognized in the nursing home setting. A lack of clarity regarding the importance of nursing assessments associated with resident care has contributed to a decreasing presence of registered nurses and an increasing reliance on personal-care-assistants who had inadequate skills and knowledge to recognize signs of deterioration. Registered nurses experienced limited organizational support for autonomous decision-making and were often expected to undertake protocol-driven decisions that contributed to potentially avoidable hospital transfers. Nurses need to demonstrate the importance of assessment, in association with day-to-day resident care, and demand standardized, regulated, educational preparation of an appropriate workforce who are competent in undertaking this role. Workforce structures that enhance familiarity between nursing home staff and residents could result in improved resident outcomes. The value of nursing assessment, in guiding decisions at the point of resident deterioration, warrants further consideration. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

  12. Do emergency medicine residents and faculty have similar learning styles when assessed with the Kolb learning style assessment tool?

    Science.gov (United States)

    Fredette, Jenna; O'Brien, Corinne; Poole, Christy; Nomura, Jason

    2015-04-01

    Experiential learning theory and the Kolb Learning Style Inventory (Kolb LSI) have influenced educators worldwide for decades. Knowledge of learning styles can create efficient learning environments, increase information retention, and improve learner satisfaction. Learning styles have been examined in medicine previously, but not specifically with Emergency Medicine (EM) residents and attendings. Using the Kolb LSI, the learning styles of Emergency Medicine residents and attendings were assessed. The findings showed that the majority of EM residents and attendings shared the accommodating learning style. This result was different than prior studies that found the majority of medical professionals had a converging learning style and other studies that found attendings often have different learning styles than residents. The issue of learning styles among emergency medical residents and attendings is important because learning style knowledge may have an impact on how a residency program structures curriculum and how EM residents are successfully, efficiently, and creatively educated.

  13. Exposure assessment of residents living near a wood treatment plant

    International Nuclear Information System (INIS)

    Dahlgren, James; Warshaw, Raphael; Horsak, Randy D.; Parker, Frank M. III; Takhar, Harpreet

    2003-01-01

    We report the results of environmental sampling and modeling in a neighborhood adjacent to a wood processing plant. This plant used creosote and pentachlorophenol (PCP) to treat wood for over 70 years. Between 1999 and 2001, environmental samples were obtained to quantify the level of environmental contamination from the wood processing plant. Blood from 10 residents was measured for chlorinated dioxins and dibenzofurans. Soil sediment samples from drainage ditches and attic/dust samples from nearby residents' homes were tested for polychlorinated dioxins, furans, and polycyclic aromatic hydrocarbons (PAH). The dioxin congeners analysis of the 10 residents revealed elevated valued for octachlorodibenzo-p-dioxin and heptachlorodibenzo-p-dioxin compatible with PCP as the source. The levels of carcinogenic PAHs were higher than background levels and were similar to soil contamination on wood preserving sites. Wipe sampling in the kitchens of 11 homes revealed that 20 of the 33 samples were positive for octachlorinated dioxins with a mean value of 10.27 ng/m 2 . The soil, ditch samples, and positive wipe samples from the homes indicate a possible ongoing route of exposure to the contaminants in the homes of these residents. Modeled air exposure estimated for the wood processing waste chemicals indicate some air exposure to combustion products. The estimated air levels for benzo(a)pyrene and tetrachlorodibenzodiozin in this neighborhood exceeded the recommended levels for these compounds in some states. The quantitative data presented suggest a significant contamination of a neighborhood by wood processing waste chemicals. These findings suggest the need for more stringent regulations on waste discharges from wood treatment plants

  14. Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

    Science.gov (United States)

    Fransson, Boel A; Chen, Chi-Ya; Noyes, Julie A; Ragle, Claude A

    2016-11-01

    To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. Evaluation study. Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score. © Copyright 2016 by The American College of Veterinary Surgeons.

  15. Assessing the New Competencies for Resident Education: A Model from an Emergency Medicine Program.

    Science.gov (United States)

    Reisdorff, Earl J.; Hayes, Oliver W.; Carlson, Dale J.; Walker, Gregory L.

    2001-01-01

    Based on the experience of Michigan State University's emergency medicine residency program, proposes a practical method for modifying an existing student evaluation format. The model provides a template other programs could use in assessing residents' acquisition of the knowledge, skills, and attitudes reflected in the six general competencies…

  16. Preparing International Medical Graduates for Psychiatry Residency: A Multi-Site Needs Assessment

    Science.gov (United States)

    Sockalingam, Sanjeev; Hawa, Raed; Al-Battran, Mazin; Abbey, Susan E.; Zaretsky, Ari

    2012-01-01

    Objective: Despite the growing number of international medical graduates (IMGs) training in medicine in Canada and the United States, IMG-specific challenges early in psychiatry residency have not been fully explored. Therefore, the authors conducted a needs-assessment survey to determine the needs of IMGs transitioning into psychiatry residency.…

  17. Metacognition Assessment Interview: Instrument description and factor structure

    Directory of Open Access Journals (Sweden)

    Giovanni Pellecchia

    2015-12-01

    Full Text Available Objective: Metacognition is a multi-component psychological construct, characterised by the ability to identify and describe one’s own mental states and those of others. Evidence has been found for an association between deficits in metacognitive abilities and poor social functioning, low quality of life, psychopathology, and symptoms in Personality Disorders (PDs. However, to date, there are few psychometrically validated instruments available for assessing the different components of metacognition. A semi-structured interview, the Metacognition Assessment Interview (MAI, has been developed to evaluate different domains of metacognition. In the present study, we investigated the psychometric properties of the MAI in an outpatient clinical sample. Method: The MAI was administered to a clinical population of 306 outpatients attending a private clinical centre. Exploratory factor analysis, confirmatory factor analysis and correlation with instruments assessing alexithymia and interpersonal problems were carried out to examine the dimensionality and validity of the MAI. Result: Explorative and confirmatory factor analyses revealed a good fit for both a two-factor model and a four-factor model of metacognition. The two-factor model yielded two main dimensions, which we named: Self domain, defined as self-reflection, and Other domain, defined as critical distancing from one’s own mental state and that of others. The four-factor solution is composed of four sub-domains: monitoring, integration, differentiation and decentration. Moreover, the MAI showed good convergent validity, with significant correlations with both alexithymia and interpersonal problems. Conclusions: These results confirm that the MAI is a reliable instrument for measuring metacognition and its different sub-domains. In particular, the MAI represents a useful and flexible instrument for the assessment of metacognition impairments in different psychopathologies and it can provide

  18. Structural Analysis of the Resident Assistant Cultural Diversity Questionnaire

    Science.gov (United States)

    Johnson, Vanessa D.; Kang, Young-Shin; Thompson, George F.

    2011-01-01

    This study investigated the five-factor structure of the Resident Assistant Cultural Diversity (RACD) instrument, which assesses resident assistant (RA) confidence in addressing issues of cultural diversity in college and university residence halls. The instrument has five components that explore RA confidence: (1) belief in the need for cultural…

  19. Anesthesiology residents' perspective about good teaching--a qualitative needs assessment.

    Science.gov (United States)

    Ortwein, Heiderose; Blaum, Wolf E; Spies, Claudia D

    2014-01-01

    Germany, like many other countries, will soon have a shortage of qualified doctors. One reason for the dissatisfaction amongst medical residents are the relatively unstructured residency training programs despite increasing importance of outcome-based education. The aim of our study was to identify characteristics and requirements for good teaching during anesthesiology residency training from the resident's point of view. A consensus workshop with residents from all medical universities in Germany was held. Participants were allocated to one of the three topics, chosen based on a 2009 nationwide evaluation of residency. The three topics were (A) characteristics of helpful/good teachers, (B) characteristics of helpful/good conditions and (C) characteristics of helpful/good curricular structure. Each group followed a nominal group technique consensus process to define and rank characteristics for a good residency. 31 (79.5%) resident representatives were present. The consented results put emphasis on the importance of structured curricula including transparent goals and objectives, in training formative assessments and quality assurance measures for the program. Residents further long for trained trainers with formal teaching qualifications and protected teaching time. Good residency training requires careful consideration of all stakeholders' needs. Results reflect and extend previous findings and are at least to some degree easily implemented. These findings are an important step to establish a broader consensus within the discipline.

  20. Integrating the NAS Milestones and handheld technology to improve residency training and assessment.

    Science.gov (United States)

    Cooney, Carisa M; Redett, Richard J; Dorafshar, Amir H; Zarrabi, Bahar; Lifchez, Scott D

    2014-01-01

    To incorporate the use of an intuitive and robust assessment tool in conjunction with the Next Accreditation System Milestones to maximize opportunities for trainee performance feedback and continuous trainee assessment, with the long-term goal of increasing the rate of performance improvement and mastery of knowledge and surgical skills. Pilot study. Johns Hopkins Medicine, Baltimore, MD. Primary, tertiary, and quaternary clinical care; institutional environment. Experimental group: two randomly selected postgraduate year-1 integrated training program residents per year for 2 consecutive years from the Department of Plastic and Reconstructive Surgery. traditionally trained residents from the integrated training program in the Department of Plastic and Reconstructive Surgery. Study duration: 7 years (until residents complete residency training). This assessment strategy would create large amounts of informative data on trainees, which can be cross-referenced to determine trainee progress. Assessment data would be collected continuously from all faculty surgeons. Comparisons of faculty and resident self-assessments would facilitate resident evaluations. Ease of use of the data collection structure would improve faculty evaluation compliance and timely resident case report completion. Improving the efficiency and efficacy of competency documentation is critical. Using portable technologies is an intuitive way to improve the trainee assessment process. We anticipate that this 2-pronged approach to trainee assessments would quickly provide large amounts of informative data to better assess trainee progress and inform Milestone assessments in a manner that facilitates immediate feedback. Assessments of faculty and resident satisfaction would help us further refine the assessment process as needed. If successful, this format could easily be implemented by other training programs. Innovations in Surgical Education: Milestones. © 2013 Published by Association of Program

  1. The psychometric properties of a shortened corporate entrepreneurship assessment instrument

    Directory of Open Access Journals (Sweden)

    Renier Steyn

    2017-08-01

    Aim: The aim of this research was to evaluate the psychometric properties of a measure of entrepreneurial climate. Entrepreneurial climate was measured using a shortened version of the Hornsby, Kuratko and Zahra (2002 instrument, called the Corporate Entrepreneurship Assessment Instrument (CEAI. Making information on the psychometric properties of the instrument available directly relates to its utility. Setting: The setting was medium to large South African companies. A random sample of employees was drawn from 53 selected companies across South Africa, with 60 respondents per company (N = 3 180. Methods: A cross-sectional survey design was used. Several instruments were administered, including the shortened version of the CEAI. Cronbach’s alpha was used to test for reliability and several methods were used to test for validity. Correlation analysis was used to test for concurrent validity, convergent validity and divergent validity. Principle component factor analysis was used to test for factorial validity and a t-test to test for known-group validity. Results: The results showed that the reliability for the total score of the shortened version of the CEAI was acceptable at 0.758. The results also showed some evidence of concurrent validity, as well as homogeneity among the items. With regard to factorial validity, all items loaded in accordance with the subscales of the instrument. The measure was able to distinguish, as expected, between government organisations and private business entities, suggesting known-group validity. Convergent validity and divergent validity were also assessed. Interesting to note was that entrepreneurship climate correlates more with general employee attitude (e.g. employee engagement; R= 0.420, p < 0.001 and organisational commitment, R = 0.331, p < 0.001 than with self-reported innovation (R = 0.277, p < 0.001 and R = 0.267, p < 0.001. Contribution: This paper not only provided information on the reliability

  2. Measuring general surgery residents' communication skills from the patient's perspective using the Communication Assessment Tool (CAT).

    Science.gov (United States)

    Stausmire, Julie M; Cashen, Constance P; Myerholtz, Linda; Buderer, Nancy

    2015-01-01

    The Communication Assessment Tool (CAT) has been used and validated to assess Family and Emergency Medicine resident communication skills from the patient's perspective. However, it has not been previously reported as an outcome measure for general surgery residents. The purpose of this study is to establish initial benchmarking data for the use of the CAT as an evaluation tool in an osteopathic general surgery residency program. Results are analyzed quarterly and used by the program director to provide meaningful feedback and targeted goal setting for residents to demonstrate progressive achievement of interpersonal and communication skills with patients. The 14-item paper version of the CAT (developed by Makoul et al. for residency programs) asks patients to anonymously rate surgery residents on discrete communication skills using a 5-point rating scale immediately after the clinical encounter. Results are reported as the percentage of items rated as "excellent" (5) by the patient. The setting is a hospital-affiliated ambulatory urban surgery office staffed by the residency program. Participants are representative of adult patients of both sexes across all ages with diverse ethnic backgrounds. They include preoperative and postoperative patients, as well as those needing diagnostic testing and follow-up. Data have been collected on 17 general surgery residents from a single residency program representing 5 postgraduate year levels and 448 patient encounters since March 2012. The reliability (Cronbach α) of the tool for surgery residents was 0.98. The overall mean percentage of items rated as excellent was 70% (standard deviations = 42%), with a median of 100%. The CAT is a useful tool for measuring 1 facet of resident communication skills-the patient's perception of the physician-patient encounter. The tool provides a unique and personalized outcome measure for identifying communication strengths and improvement opportunities, allowing residents to receive

  3. ASSESSMENT OF KNOWLEDGE & ATTITUDE OF THE PEDIATRIC RESIDENT ABOUT NEONATAL & PEDIATRIC CARDIOPULMONARY RESUSCITATION

    Directory of Open Access Journals (Sweden)

    M KADIAVAR

    2003-09-01

    Full Text Available Introduction: A high leve of skill & knowledge is required in circumstances of cardiopulmonary resucitation which represents the most urgent clinical situations. The difficulties for pediatric residents who are fronted with the most cases of pediatric & neonatal resucitation are due to different causes of cardiorespiratory arrest in camparison to adults. This study aimed to assess the knowledge & their personal attitude toward the neonatal & pediatric cardiopulmonary resuscitatin. Methods: By cross - sectional multicenter study between the pediatric residents who were studied in the teaching hospitals in Tehran (1378-90. Data were gathered among 140 residents by self-completed questionnaires which were included three parts as. demographic information assessment of their attitude by summation of score via ranking list questions and total score from assessment to their knowledge by different scenarios which were formatted in the multiple choice questions. Results: 35.7% of the residents studied in the first year of residency 35.0% in the second year and the remainder (29/3% in the third year More than 90% of them considered their knowledge about neonatal and pediatric cardiopulmonary resuscitation low & less than average. Net only 80% of the residents self - assessed their actual ability about this issue low but also declaired the insufficient education during the medical training. The total score of knowledge assessment was 14.7 + 1_0.54 from 30 without any significant relations among the residents in different hospitals or various levels of pediatric residency. (P value= 0.1 , 0.7 There was not significant correlation between the total score from their attitude & their knowledge. Conclusion: Pediatric residents as the key personnel in the management of cardiopulmonary resuscitation of the neonates and children should have enough knowledge and skills about this topic. This survey demonstrates a low level of the pediatric & neonatal

  4. Instrumentation

    International Nuclear Information System (INIS)

    Prieur, G.; Nadi, M.; Hedjiedj, A.; Weber, S.

    1995-01-01

    This second chapter on instrumentation gives little general consideration on history and classification of instrumentation, and two specific states of the art. The first one concerns NMR (block diagram of instrumentation chain with details on the magnets, gradients, probes, reception unit). The first one concerns precision instrumentation (optical fiber gyro-meter and scanning electron microscope), and its data processing tools (programmability, VXI standard and its history). The chapter ends with future trends on smart sensors and Field Emission Displays. (D.L.). Refs., figs

  5. Intelligence Assessment Instruments in Adult Prison Populations: A Systematic Review.

    Science.gov (United States)

    van Esch, A Y M; Denzel, A D; Scherder, E J A; Masthoff, E D M

    2017-10-01

    Detection of intellectual disability (ID) in the penitentiary system is important for the following reasons: (a) to provide assistance to people with ID in understanding their legal rights and court proceedings; (b) to facilitate rehabilitation programs tailored to ID patients, which improves the enhancement of their quality of life and reduces their risk of reoffending; and (c) to provide a reliable estimate of the risk of offence recidivism. It requires a short assessment instrument that provides a reliable estimation of a person's intellectual functioning at the earliest possible stage of this process. The aim of this systematic review is (a) to provide an overview of recent short assessment instruments that provide a full-scale IQ score in adult prison populations and (b) to achieve a quality measurement of the validation studies regarding these instruments to determine which tests are most feasible in this target population. The Preferred Reporting Items for Systematic reviews and Meta-Analyses Statement is used to ensure reliability. The Satz-Mögel, an item-reduction short form of the Wechsler Adult Intelligence Scale, shows the highest correlation with the golden standard and is described to be most reliable. Nevertheless, when it comes to applicability in prison populations, the shorter and less verbal Quick Test can be preferred over others. Without affecting these conclusions, major limitations emerge from the present systematic review, which give rise to several important recommendations for further research.

  6. Hazard Assessment of Chemical Air Contaminants Measured in Residences

    Energy Technology Data Exchange (ETDEWEB)

    Logue, J.M.; McKone, T.E.; Sherman, M. H.; Singer, B.C.

    2010-05-10

    Identifying air pollutants that pose a potential hazard indoors can facilitate exposure mitigation. In this study, we compiled summary results from 77 published studies reporting measurements of chemical pollutants in residences in the United States and in countries with similar lifestyles. These data were used to calculate representative mid-range and upper bound concentrations relevant to chronic exposures for 267 pollutants and representative peak concentrations relevant to acute exposures for 5 activity-associated pollutants. Representative concentrations are compared to available chronic and acute health standards for 97 pollutants. Fifteen pollutants appear to exceed chronic health standards in a large fraction of homes. Nine other pollutants are identified as potential chronic health hazards in a substantial minority of homes and an additional nine are identified as potential hazards in a very small percentage of homes. Nine pollutants are identified as priority hazards based on the robustness of measured concentration data and the fraction of residences that appear to be impacted: acetaldehyde; acrolein; benzene; 1,3-butadiene; 1,4-dichlorobenzene; formaldehyde; naphthalene; nitrogen dioxide; and PM{sub 2.5}. Activity-based emissions are shown to pose potential acute health hazards for PM{sub 2.5}, formaldehyde, CO, chloroform, and NO{sub 2}.

  7. Teaching and Assessing Systems-based Competency in Ophthalmology Residency Training Programs

    NARCIS (Netherlands)

    Lee, Andrew G.; Beaver, Hilary A.; Greenlee, Emily; Oetting, Thomas A.; Boldt, H. Culver; Olson, Richard; Abramoff, Michael; Carter, Keith

    2007-01-01

    The Accreditation Council for Graduate Medical Education (ACGME) has mandated that residency programs, including ophthalmology, teach and assess specific competencies, including systems-based learning. We review the pertinent literature on systems-based learning for ophthalmology and recommend

  8. Cross-Institutional Evaluation of a Mastoidectomy Assessment Instrument.

    Science.gov (United States)

    Kerwin, Thomas; Hittle, Brad; Stredney, Don; De Boeck, Paul; Wiet, Gregory

    2017-10-24

    The objective of this work is to obtain validity evidence for an evaluation instrument used to assess the performance level of a mastoidectomy. The instrument has been previously described and had been formulated by a multi-institutional consortium. Mastoidectomies were performed on a virtual temporal bone system and then rated by experts using a previously described 15 element task-based checklist. Based on the results, a second, similar checklist was created and a second round of rating was performed. Twelve otolaryngological surgical training programs in the United States. In all, 65 mastoidectomy performances were evaluated coming from 37 individuals with a variety of temporal bone dissection experience, from medical students to attending physicians. Raters were attending surgeons from 12 different institutions. Intraclass correlation scores varied greatly between items in the checklist with some being low and some being high. Percentage agreement scores were similar to previous rating instruments. There is strong evidence that a high score on the task-based checklist is necessary for a rater to consider a mastoidectomy to be performed at the level of an expert but a high score is not a sufficient condition. Rewording of the instrument items to focus on safety does not result in increased reliability of the instrument. The strong result of the Necessary Condition Analysis suggests that going beyond simple correlation measures can give extra insight into grading results. Additionally, we suggest using a multiple point scale instead of a binary pass/fail question combined with descriptive mastery levels. Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  9. The Systematic Evaluation of Instruments Designed to Assess Pain in Persons with Limited Ability to Communicate*

    Directory of Open Access Journals (Sweden)

    Michèle Aubin

    2007-01-01

    Full Text Available Chronic pain is often underdetected and undertreated in long-term care facilities. The use of self-report measures of pain (such as the visual analogue scale is often problematic for older adults residing in long-term care because of the high prevalence of visual and auditory deficits and severe cognitive impairment. Observational measures of pain have been developed to address this concern. A systematic grid designed to assess the properties of existing observational measures of pain was used for seniors with dementia. The grid focused on the evaluation of content validity (12 items, construct validity (12 items, reliability (13 items and clinical utility (10 items. Among the 24 instruments that were evaluated, several were deemed to be promising in the assessment of pain among older persons with severe dementia. Nonetheless, additional research is needed before their routine integration in the practices of long-term care settings.

  10. The practice and perception of pain assessment in US pediatric dentistry residency programs.

    Science.gov (United States)

    Jayagopal, Anita; Jaju, Rishita A; Tate, Anupama

    2010-01-01

    The purpose of this study was to describe the current practice and perception of pain assessment in US accredited advanced pediatric dentistry residency programs, as reported by directors of these programs. A questionnaire was sent out to 68 accredited US pediatric dentistry residency programs. Responses were statistically analyzed to find significant correlations between the actual practice of pain assessment and the perceived usefulness of pain assessment. Forty-four surveys (65% response rate) were completed and returned. Sixty-eight percent of program directors stated that pain is assessed at all types of appointments. A statistically significant correlation exists between program directors who regard pain assessment scales as useful and those who teach the use of such resources in their programs (chi-square = 3.73, P = .05). A statistically significant correlation exists between program directors who regard preoperative pain assessment as clinically beneficial and those who report a need to place more emphasis on pain assessment (chi-square = 6.22, P = .01). Pediatric dentistry residency program directors generally regard pain assessment as clinically beneficial in patient treatment. Implementing increased pain assessment teaching in pediatric dentistry residency programs could improve the confidence and skills of residents in assessing the pain of young children and those with special health care needs.

  11. Obstetric and Gynecologic Ultrasound Curriculum and Competency Assessment in Residency Training Programs

    DEFF Research Database (Denmark)

    Abuhamad, Alfred; Minton, Katherine K; Benson, Carol B

    2018-01-01

    Ultrasound imaging has become integral to the practice of obstetrics and gynecology. With increasing educational demands and limited hours in residency programs, dedicated time for training and achieving competency in ultrasound has diminished substantially. The American Institute of Ultrasound...... in Medicine assembled a multisociety task force to develop a consensus-based, standardized curriculum and competency assessment tools for obstetric and gynecologic ultrasound training in residency programs. The curriculum and competency assessment tools were developed based on existing national...

  12. Obstetric and gynecologic ultrasound curriculum and competency assessment in residency training programs

    DEFF Research Database (Denmark)

    Abuhamad, Alfred; Minton, Katherine K; Benson, Carol B

    2018-01-01

    Ultrasound imaging has become integral to the practice of obstetrics and gynecology. With increasing educational demands and limited hours in residency programs, dedicated time for training and achieving competency in ultrasound has diminished substantially. The American Institute of Ultrasound...... in Medicine assembled a multisociety task force to develop a consensus-based, standardized curriculum and competency assessment tools for obstetric and gynecologic ultrasound training in residency programs. The curriculum and competency assessment tools were developed based on existing national...

  13. Increasing faculty participation in resident education and providing cost-effective self-assessment module credit to faculty through resident-generated didactics.

    Science.gov (United States)

    Kim, Hyun; Malatesta, Theresa M; Anné, Pramila R; McAna, John; Bar-Ad, Voichita; Dicker, Adam P; Den, Robert B

    Board certified radiation oncologists and medical physicists are required to earn self-assessment module (SAM) continuing medical education (CME) credit, which may require travel costs or usage fees. Data indicate that faculty participation in resident teaching activities is beneficial to resident education. Our hypothesis was that providing the opportunity to earn SAM credit in resident didactics would increase faculty participation in and improve resident education. SAM applications, comprising CME certified category 1 resident didactic lectures and faculty-generated questions with respective answers, rationales, and references, were submitted to the American Board of Radiology for formal review. Surveys were distributed to assess main academic campus physician, affiliate campus physician, physicist, and radiation oncology resident impressions regarding the quality of the lectures. Survey responses were designed in Likert-scale format. Sign-test was performed with P < .05 considered statistically different from neutral. First submission SAM approval was obtained for 9 of 9 lectures to date. A total of 52 SAM credits have been awarded to 4 physicists and 7 attending physicians. Main academic campus physician and affiliate campus physician attendance increased from 20% and 0%, respectively, over the 12 months preceding CME/SAM lectures, to 55.6% and 20%, respectively. Survey results indicated that the change to SAM lectures increased the quality of resident lectures (P = .001), attending physician participation in resident education (P < .0001), physicist involvement in medical resident education (P = .0006), and faculty motivation to attend resident didactics (P = .004). Residents reported an increased amount of time required to prepare lectures (P = .008). We are the first department, to our knowledge, to offer SAM credit to clinical faculty for participation in resident-generated didactics. Offering SAM credit at resident lectures is a cost-effective alternative

  14. A Checklist Intervention to Assess Resident Diagnostic Knee and Shoulder Arthroscopic Efficiency.

    Science.gov (United States)

    Nwachukwu, Benedict; Gaudiani, Michael; Hammann-Scala, Jennifer; Ranawat, Anil

    The purpose of this investigation was to apply an arthroscopic shoulder and knee checklist in the evaluation of orthopedic resident arthroscopic skill efficiency and to demonstrate the use of a surgical checklist for assessing resident surgical efficiency over the course of a surgical rotation. Orthopedic surgery residents rotating on the sports medicine service at our institution between 2011 and 2015 were enrolled in this study. Residents were administered a shoulder and knee arthroscopy assessment tool at the beginning and end of their 6-week rotation. The assessment tools consisted of checklist items for knee and shoulder arthroscopy skills. Residents were timed while performing these checklist tasks. The primary outcome measure was resident improvement as a function of time to completion for the checklist items, and the intervention was participation in a 6-week resident rotation with weekly arthroscopy didactics, cadaver simulator work, and operating room experience. A paired t test was used to compare means. Mean time to checklist completion during week 1 among study participants for the knee checklist was 787.4 seconds for the knee checklist and 484.4 seconds at the end of the rotation. Mean time to checklist completion during week 1 among study participants for the shoulder checklist was 1655.3 seconds and 832.7 seconds for the shoulder checklist at the end of the rotation. Mean improvement in time to completion was 303 seconds (p = 0.0006, SD = 209s) and 822.6 seconds (p = 0.00008, SD = 525.2s) for the arthroscopic knee and shoulder assessments, respectively. An arthroscopic checklist is 1 method to evaluate and assess resident efficiency and improvement during surgical training. Among residents participating in this study, we found statistically significant improvements in time for arthroscopic task completion. II. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  15. Using portable particle sizing instrumentation to rapidly measure the penetration of fine and ultrafine particles in unoccupied residences.

    Science.gov (United States)

    Zhao, H; Stephens, B

    2017-01-01

    Much of human exposure to particulate matter of outdoor origin occurs inside buildings, particularly in residences. The particle penetration factor through leaks in a building's exterior enclosure assembly is a key parameter that governs the infiltration of outdoor particles. However, experimental data for size-resolved particle penetration factors in real buildings, as well as penetration factors for fine particles less than 2.5 μm (PM 2.5 ) and ultrafine particles less than 100 nm (UFPs), remain limited, in part because of previous limitations in instrumentation and experimental methods. Here, we report on the development and application of a modified test method that utilizes portable particle sizing instrumentation to measure size-resolved infiltration factors and envelope penetration factors for 0.01-2.5 μm particles, which are then used to estimate penetration factors for integral measures of UFPs and PM 2.5 . Eleven replicate measurements were made in an unoccupied apartment unit in Chicago, IL to evaluate the accuracy and repeatability of the test procedure and solution methods. Mean estimates of size-resolved penetration factors ranged from 0.41 ± 0.14 to 0.73 ± 0.05 across the range of measured particle sizes, while mean estimates of penetration factors for integral measures of UFPs and PM 2.5 were 0.67 ± 0.05 and 0.73 ± 0.05, respectively. Average relative uncertainties for all particle sizes/classes were less than 20%. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

  16. 77 FR 25457 - Applications for New Awards; Enhanced Assessment Instruments Grants Program-Enhanced Assessment...

    Science.gov (United States)

    2012-04-30

    ... least an annual measure of English proficiency and student progress in learning English for English... English proficiency and student progress in learning English (including data disaggregated by English... Program--Enhanced Assessment Instruments (English Language Proficiency (ELP) Competition) AGENCY: Office...

  17. Assessing Residents' Readiness for OR Autonomy: A Qualitative Descriptive Study of Expert Surgical Teachers' Best Practices.

    Science.gov (United States)

    Chen, Xiaodong Phoenix; Sullivan, Amy M; Alseidi, Adnan; Kwakye, Gifty; Smink, Douglas S

    Providing resident autonomy in the operating room (OR) is one of the major challenges for surgical educators today. The purpose of this study was to explore what approaches expert surgical teachers use to assess residents' readiness for autonomy in the OR. We particularly focused on the assessments that experts make prior to conducting the surgical time-out. We conducted semistructured in-depth interviews with expert surgical teachers from March 2016 to September 2016. Purposeful sampling and snowball sampling were applied to identify and recruit expert surgical teachers from general surgery residency programs across the United States to represent a range of clinical subspecialties. All interviews were audio-recorded, deidentified, and transcribed. We applied the Framework Method of content analysis, discussed and reached final consensus on the themes. We interviewed 15 expert teachers from 9 institutions. The majority (13/15) were Program or Associate Program Directors; 47% (7/15) primarily performed complex surgical operations (e.g., endocrine surgery). Five themes regarding how expert surgical teachers determine residents' readiness for OR autonomy before the surgical time-out emerged. These included 3 domains of evidence elicited about the resident (resident characteristics, medical knowledge, and beyond the current OR case), 1 variable relating to attending characteristics, and 1 variable composed of contextual factors. Experts obtained one or more examples of evidence, and adjusted residents' initial autonomy using factors from the attending variable and the context variable. Expert surgical teachers' assessments of residents' readiness for OR autonomy included 5 key components. Better understanding these inputs can contribute to both faculty and resident development, enabling increased resident autonomy and preparation for independent practice. Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  18. Assessment of medical resident's attention to the health literacy level of newly admitted patients.

    Science.gov (United States)

    Karsenty, Cecile; Landau, Michael; Ferguson, Robert

    2013-01-01

    The objective of this study was to assess communication at the bedside in the emergency room between residents and their patients in order to identify common communication gaps. We also intended to evaluate whether residents for whom English is a second language (ESL residents) communicate less effectively. A scorable checklist was developed in order to assess and identify communication gaps between the residents and their patients. Medical students observed the internal medicine and family medicine residents while they admitted patients to the medical service in the Emergency Room. Before this, medical students were trained for two weeks with a senior internist. The role of the medical student was not revealed; rather they were self-described as observers of the admission process. Over an 8 week period, 71 observations were made of 27 medicine residents. 71 patient intakes were observed, evaluating 27 residents. In 52.1% of these interactions, the residents used medical acronyms when communicating with the patients. During 66.2% of interactions, technical medical terms or expressions were used during the history taking and in only 27.6% of those cases were the terms explained at least partially. Teach back technique was not observed in any of the interactions evaluated. Data was also analyzed based on whether the doctors were ESL residents or native English speakers. ESL residents tended to use significantly more technical language than the native English speakers, but the native English speakers tended to use more acronyms. How much patients understand of what their doctor says is called "health literacy." Resident physicians often overestimate their patients' health literacy, and this leads to communication gaps which have the potential to result in poorer health outcomes for the patients. The checklist developed for this pilot study assessed how well residents tailor their communication to their patients' health literacy. Our assessment revealed much room for

  19. Assessment of medical resident's attention to the health literacy level of newly admitted patients

    Directory of Open Access Journals (Sweden)

    Cecile Karsenty

    2013-12-01

    Full Text Available Objectives: The objective of this study was to assess communication at the bedside in the emergency room between residents and their patients in order to identify common communication gaps. We also intended to evaluate whether residents for whom English is a second language (ESL residents communicate less effectively. Methods: A scorable checklist was developed in order to assess and identify communication gaps between the residents and their patients. Medical students observed the internal medicine and family medicine residents while they admitted patients to the medical service in the Emergency Room. Before this, medical students were trained for two weeks with a senior internist. The role of the medical student was not revealed; rather they were self-described as observers of the admission process. Results: Over an 8 week period, 71 observations were made of 27 medicine residents. 71 patient intakes were observed, evaluating 27 residents. In 52.1% of these interactions, the residents used medical acronyms when communicating with the patients. During 66.2% of interactions, technical medical terms or expressions were used during the history taking and in only 27.6% of those cases were the terms explained at least partially. Teach back technique was not observed in any of the interactions evaluated. Data was also analyzed based on whether the doctors were ESL residents or native English speakers. ESL residents tended to use significantly more technical language than the native English speakers, but the native English speakers tended to use more acronyms. Conclusions: How much patients understand of what their doctor says is called “health literacy.” Resident physicians often overestimate their patients’ health literacy, and this leads to communication gaps which have the potential to result in poorer health outcomes for the patients. The checklist developed for this pilot study assessed how well residents tailor their communication to

  20. Instrumented toys for assessing spatial cognition in infants

    Science.gov (United States)

    Campolo, Domenico; Taffoni, Fabrizio; Formica, Domenico; Keller, Flavio; Guglielmelli, Eugenio

    2011-03-01

    This paper describes an interdisciplinary approach to the assessment on infants' behavior, with a focus on the technology. The goal is an objective, quantitative analysis of concurrent maturation of sensory, motor and cognitive abilities in young children, in relation to the achievement of developmental milestones. An instrumented block-box toy specifically developed to assess the ability to insert objects into holes is presented. The functional specifications are derived from experimental protocols devised by neuroscientists to assess spatial cognition skills. Technological choices are emphasized with respect to ecological requirements. An ad hoc calibration procedure is also presented which is suitable to unstructured environments. Finally, preliminary tests carried out at a local day-care with 12-24 months old infants are presented which prove the in-field usability of the proposed technology.

  1. Development of the Test Of Astronomy STandards (TOAST) Assessment Instrument

    Science.gov (United States)

    Slater, Timothy F.; Slater, S. J.

    2008-05-01

    Considerable effort in the astronomy education research (AER) community over the past several years has focused on developing assessment tools in the form of multiple-choice conceptual diagnostics and content knowledge surveys. This has been critically important in advancing the AER discipline so that researchers could establish the initial knowledge state of students as well as to attempt measure some of the impacts of innovative instructional interventions. Unfortunately, few of the existing instruments were constructed upon a solid list of clearly articulated and widely agreed upon learning objectives. This was not done in oversight, but rather as a result of the relative youth of AER as a discipline. Now that several important science education reform documents exist and are generally accepted by the AER community, we are in a position to develop, validate, and disseminate a new assessment instrument which is tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. In response, researchers from the Cognition in Astronomy, Physics and Earth sciences Research (CAPER) Team at the University of Wyoming's Science & Math Teaching Center (UWYO SMTC) have designed a criterion-referenced assessment tool, called the Test Of Astronomy STandards (TOAST). Through iterative development, this instrument has a high degree of reliability and validity for instructors and researchers needing information on students’ initial knowledge state at the beginning of a course and can be used, in aggregate, to help measure the impact of course-length duration instructional strategies for courses with learning goals tightly aligned to the consensus goals of our community.

  2. The Impact of Using Mean Versus Mode When Assessing Resident Competency.

    Science.gov (United States)

    Barlow, Patrick B; Thoma, Kate DuChene; Ferguson, Kristi J

    2017-06-01

    The Accreditation Council for Graduate Medical Education Milestone Project was implemented in 2014 to standardize assessments and progression of residents. While it is recommended that milestones not be used as tools for direct assessments of resident competency, many programs have used or adapted milestone tools for this purpose. We sought to explore use of the most frequent milestone level at which a resident was evaluated (ie, the mode), and compared this to the standard practice of using the arithmetic mean for summarizing performance. We reviewed all Family Medicine Milestone evaluations from 1 program for the first 2 academic years of milestone implementation. Mean and mode scores were calculated across 24 unique residents, 841 evaluation forms, and 5897 measurements. The proportion of overestimation errors (where the mean is at least 0.5 larger than the mode) and underestimation errors (where the mean is at least 0.5 less than the mode) were then compared across resident training year and subcompetency. For the 24 residents, an estimation error occurred in 175 of 792 of the comparisons (22%). Of these errors, 118 (67%) were overestimation errors. First-year residents accounted for 55% (96 of 175) of all estimation errors. All subcompetencies had some estimation errors, with 6 having greater than 5%. If the trend for using the milestones as stand-alone assessment tools is to continue, aggregating data by using frequency distributions and mode would be a more stable and appropriate approach given their nominal or, at best, ordinal nature.

  3. Advanced Practice Nursing Competency Assessment Instrument (APNCAI): clinimetric validation.

    Science.gov (United States)

    Sastre-Fullana, Pedro; Morales-Asencio, Jose Miguel; Sesé-Abad, Albert; Bennasar-Veny, Miquel; Fernández-Domínguez, Juan Carlos; De Pedro-Gómez, Joan

    2017-02-23

    To describe the development and clinimetric validation of the Advanced Practice Nursing Competency Assessment Instrument (APNCAI) through several evidence sources about reliability and validity in the Spanish context. APNCAI development was based on a multisequential and systematic process: literature review, instrument content consensus through qualitative Delphi method approach (a panel of 51 Advanced Practice in Nursing -APN- experts was selected) and the clinimetric validation process based on a sample of 600 nurses from the Balearic Islands public healthcare setting. An initial step for tool's content development process based on Delphi method approach of expert consensus was implemented. A subsequent phase of tool validation started from the analysis of APN core competencies latent measurement model, including exploratory and confirmatory techniques. Reliability evidence for each latent factor was also obtained. Items' scores were submitted to descriptive analysis, plus univariate and multivariate normality tests. An eight-factor competency assessment latent model obtained adequate fit, and it was composed by 'Research and Evidence-Based Practice', 'Clinical and Professional Leadership', 'Interprofessional Relationship and Mentoring', 'Professional Autonomy', 'Quality Management', 'Care Management', 'Professional Teaching and Education' and 'Health Promotion'. Adequate empirical evidence of reliability and validity for APNCAI makes it useful for application in healthcare policy programmes for APN competency assessment in Spain. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

  4. Accuracy assessment of ALOS optical instruments: PRISM and AVNIR-2

    Science.gov (United States)

    Tadono, Takeo; Shimada, Masanobu; Iwata, Takanori; Takaku, Junichi; Kawamoto, Sachi

    2017-11-01

    This paper describes the updated results of calibration and validation to assess the accuracies for optical instruments onboard the Advanced Land Observing Satellite (ALOS, nicknamed "Daichi"), which was successfully launched on January 24th, 2006 and it is continuously operating very well. ALOS has an L-band Synthetic Aperture Radar called PALSAR and two optical instruments i.e. the Panchromatic Remotesensing Instrument for Stereo Mapping (PRISM) and the Advanced Visible and Near Infrared Radiometer type-2 (AVNIR-2). PRISM consists of three radiometers and is used to derive a digital surface model (DSM) with high spatial resolution that is an objective of the ALOS mission. Therefore, geometric calibration is important in generating a precise DSM with stereo pair images of PRISM. AVNIR-2 has four radiometric bands from blue to near infrared and uses for regional environment and disaster monitoring etc. The radiometric calibration and image quality evaluation are also important for AVNIR-2 as well as PRISM. This paper describes updated results of geometric calibration including geolocation determination accuracy evaluations of PRISM and AVNIR-2, image quality evaluation of PRISM, and validation of generated PRISM DSM. These works will be done during the ALOS mission life as an operational calibration to keep absolute accuracies of the standard products.

  5. Saudi Internal Medicine Residents׳ Perceptions of the Objective Structured Clinical Examination as a Formative Assessment Tool

    Directory of Open Access Journals (Sweden)

    Salwa Alaidarous

    2016-12-01

    Full Text Available The Saudi Commission for Health Specialties first implemented the Objective Structured Clinical Examinations (OSCE as part of the final year Internal Medicine clerkship exam during the 2007–2008 academic year. This study evaluated Internal Medicine residents׳ overall perceptions of the OSCE as a formative assessment tool. It focused on residents׳ perceptions of the OSCE stations׳ attributes, determined the acceptability of the process, and provided feedback to enhance further development of the assessment tool. The main objective was to assess Internal Medicine resident test-takers׳ perceptions and acceptance of the OSCE, and to identify its strengths and weaknesses through their feedback. Sixty six residents were involved in the studied administered on November 8th 2012 at King Abdulaziz University Hospital in Jeddah, Kingdom of Saudi Arabia. Overall, resident׳s evaluation of the OSCE was favorable and encouraging. To this end, we recommend that formative assessment opportunities using the OSCE for providing feedback to students should be included in the curriculum, and continuing refinement and localized adaptation of OSCEs in use should be pursued by course directors and assessment personnel.

  6. Faculty feedback versus residents' self-assessment of operative performance: Different but complementary.

    Science.gov (United States)

    Tanoue, Nathan; Korovin, Lev N; Carton, Melissa; Galvani, Carlos A; Ghaderi, Iman

    2018-02-01

    Surgical training requires development of both technical and cognitive skills. The study analyzed feedback by faculty and residents' self-assessments during a laparoscopic training course to identify structure of feedback in this context and compared the focus of trainees to faculty. This study collected assessments by surgical residents and faculty during an intensive laparoscopic training course at a single institution. The residents' operative performance was assessed using validated assessment tools including free text feedback. Assessments were completed immediately following procedures. Feedback was analyzed using qualitative method. Eighty (80) residents participated. Three themes were identified: Assessment, instruction and occasion. Faculty provided significantly more feedback than trainees. Moreover, the content of feedback was different. Residents focused on technical performance, while faculty commented on technical and cognitive skills, efficiency and level of independence. Errors were mainly addressed by faculty. This study demonstrated differences in cognitive focus of trainees and faculty. Text feedback is informative in understanding perceived challenges. Faculty provided explicit assessment and instruction for improvement. The effectiveness of self-assessment and feedback should be further studied. Copyright © 2017 Elsevier Inc. All rights reserved.

  7. Instrument development and evaluation for patient-related outcomes assessments

    Directory of Open Access Journals (Sweden)

    Farnik M

    2012-03-01

    Full Text Available Małgorzata Farnik, Władysław PierzchałaDepartment of Pneumonology, Silesian University of Medicine, Katowice, PolandAbstract: Patient-related outcomes measures could provide important information for the current state of the art in medical care and even have an impact on macrodecisions in the health care system. Patient-related outcomes were initially defined as subjective health indicators that allow disability and illness to be assessed, based on patient, caregiver, or physician self-reports. As illness involves psychological and behavioral complex processes of care, a multidisciplinary approach in measuring patient-reported outcomes should be recommended, such as quality of life questionnaires. Patient-related outcomes measures should correspond to specific clinical situations and bring opportunities to improve quality of care. Objective measurements enable quantitative data to be collected and analyzed. Depending on the aim of the research, investigators can use existing methods or develop new tools. This publication presents a methodology for developing patient-related outcomes measures, based on a multistage procedure. The proper definition of specific study objectives and the methodology of instrument development are crucial for successfully transferring the study concept. The model of instrument development is the process of starting from the preliminary phase and includes questionnaire design and scaling, pilot testing (cognitive debriefing, revision of the preliminary version, evaluation of the new tool, and implementation. Validation of the new instrument includes reliability, reproducibility, internal consistency, and responsiveness. The process of designing the new tool should involve a panel of experts, including clinicians, psychologists (preliminary phase, and statisticians (scale development and scoring, and patients (cognitive debriefing. Implementation of a new tool should be followed by evaluation study – assessment of

  8. Can both residents and chief physicians assess surgical skills?

    DEFF Research Database (Denmark)

    Oestergaard, Jeanett; Larsen, Christian Rifbjerg; Maagaard, Mathilde

    2012-01-01

    It is known that structured assessment of an operation can provide trainees with useful knowledge and potentially shorten their learning curve. However, methods for objective assessment have not been widely adopted into the clinical setting. This might be because of a lack of expertise using an a...

  9. Career-Success Scale – A new instrument to assess young physicians' academic career steps

    Directory of Open Access Journals (Sweden)

    Buddeberg Claus

    2008-06-01

    Full Text Available Abstract Background Within the framework of a prospective cohort study of Swiss medical school graduates, a Career-Success Scale (CSS was constructed in a sample of young physicians choosing different career paths in medicine. Furthermore the influence of personality factors, the participants' personal situation, and career related factors on their career success was investigated. Methods 406 residents were assessed in terms of career aspired to, and their career progress. The Career-Success Scale, consisting of 7 items, was developed and validated, addressing objective criteria of academic career advancement. The influence of gender and career aspiration was investigated by a two-factorial analysis of variance, the relationships between personality factors, personal situation, career related factors and the Career-Success Scale by a multivariate linear regression analysis. Results The unidimensional Career-Success Scale has an internal consistency of 0.76. It is significantly correlated at the bivariate level with gender, instrumentality, and all career related factors, particularly with academic career and received mentoring. In multiple regression, only gender, academic career, surgery as chosen specialty, and received mentoring are significant predictors. The highest values were observed in participants aspiring to an academic career, followed by those pursuing a hospital career and those wanting to run a private practice. Independent of the career aspired to, female residents have lower scores than their male colleagues. Conclusion The Career-Success Scale proved to be a short, reliable and valid instrument to measure career achievements. As mentoring is an independent predictor of career success, mentoring programs could be an important instrument to specifically enhance careers of female physicians in academia.

  10. Career-success scale - a new instrument to assess young physicians' academic career steps.

    Science.gov (United States)

    Buddeberg-Fischer, Barbara; Stamm, Martina; Buddeberg, Claus; Klaghofer, Richard

    2008-06-02

    Within the framework of a prospective cohort study of Swiss medical school graduates, a Career-Success Scale (CSS) was constructed in a sample of young physicians choosing different career paths in medicine. Furthermore the influence of personality factors, the participants' personal situation, and career related factors on their career success was investigated. 406 residents were assessed in terms of career aspired to, and their career progress. The Career-Success Scale, consisting of 7 items, was developed and validated, addressing objective criteria of academic career advancement. The influence of gender and career aspiration was investigated by a two-factorial analysis of variance, the relationships between personality factors, personal situation, career related factors and the Career-Success Scale by a multivariate linear regression analysis. The unidimensional Career-Success Scale has an internal consistency of 0.76. It is significantly correlated at the bivariate level with gender, instrumentality, and all career related factors, particularly with academic career and received mentoring. In multiple regression, only gender, academic career, surgery as chosen specialty, and received mentoring are significant predictors. The highest values were observed in participants aspiring to an academic career, followed by those pursuing a hospital career and those wanting to run a private practice. Independent of the career aspired to, female residents have lower scores than their male colleagues. The Career-Success Scale proved to be a short, reliable and valid instrument to measure career achievements. As mentoring is an independent predictor of career success, mentoring programs could be an important instrument to specifically enhance careers of female physicians in academia.

  11. Instrumentation

    International Nuclear Information System (INIS)

    Umminger, K.

    2008-01-01

    A proper measurement of the relevant single and two-phase flow parameters is the basis for the understanding of many complex thermal-hydraulic processes. Reliable instrumentation is therefore necessary for the interaction between analysis and experiment especially in the field of nuclear safety research where postulated accident scenarios have to be simulated in experimental facilities and predicted by complex computer code systems. The so-called conventional instrumentation for the measurement of e. g. pressures, temperatures, pressure differences and single phase flow velocities is still a solid basis for the investigation and interpretation of many phenomena and especially for the understanding of the overall system behavior. Measurement data from such instrumentation still serves in many cases as a database for thermal-hydraulic system codes. However some special instrumentation such as online concentration measurement for boric acid in the water phase or for non-condensibles in steam atmosphere as well as flow visualization techniques were further developed and successfully applied during the recent years. Concerning the modeling needs for advanced thermal-hydraulic codes, significant advances have been accomplished in the last few years in the local instrumentation technology for two-phase flow by the application of new sensor techniques, optical or beam methods and electronic technology. This paper will give insight into the current state of instrumentation technology for safety-related thermohydraulic experiments. Advantages and limitations of some measurement processes and systems will be indicated as well as trends and possibilities for further development. Aspects of instrumentation in operating reactors will also be mentioned.

  12. [Assessment of shoulder dystocia related knowledge among French obstetrics and gynecology residents].

    Science.gov (United States)

    Schmitt, A; Heckenroth, H; Cravello, L; Boubli, L; d'Ercole, C; Courbiere, B

    2016-09-01

    To study the related knowledge of French residents in obstetrics concerning maneuvers for shoulder dystocia (SD). Multicenter descriptive transversal study conducted from June to September 2014. Data collection was performed through questionnaires sent by email to French resident in obstetrics. Among the 1080 questionnaires sent, 366 responses were obtained with a response rate of 33.9%. One hundred and forty-three residents (39.1%) were in the first part of their training (≤5th semester) and 60.9% (n=223) were in the second part of their training. Theoretical training on the SD was provided to 88.2% of resident (n=323). In total, 38.8% (n=142) obtained their French degree in mechanical and technical obstetric and among them 77.5% (n=110) had the opportunity to train on simulators and dummies. Concerning their practical experiences, 31.5% (n=45) residents ≤5th semester reported having experienced SD during their residency vs 58.3% (n=130) amongst oldest residents (PObstetrics and Gynecology, which have to develop dependable measures to assess resident competencies to execute practical maneuvers for clinical emergencies in obstetrics. Copyright © 2015 Elsevier Masson SAS. All rights reserved.

  13. Implementation and assessment of a training course for residents in neonatology and pediatric emergency medicine.

    Science.gov (United States)

    Brossier, D; Bellot, A; Villedieu, F; Fazilleau, L; Brouard, J; Guillois, B

    2017-05-01

    Residents must balance patient care and the ongoing acquisition of medical knowledge. With increasing clinical responsibilities and patient overload, medical training is often left aside. In 2010, we designed and implemented a training course in neonatology and pediatric emergency medicine for residents in pediatrics, in order to improve their medical education. The course was made of didactic sessions and several simulation-based seminars for each year of residency. We conducted this study to assess the impact of our program on residents' satisfaction and self-assessed clinical skills. A survey was conducted at the end of each seminar. The students were asked to complete a form on a five-point rating scale to evaluate the courses and their impact on their satisfaction and self-assessed clinical skills, following the French National Health Institute's adapted Kirkpatrick model. Sixty-four (84%) of the 76 residents who attended the courses completed the form. The mean satisfaction score for the entire course was 4.78±0.42. Over 80% of the students felt that their clinical skills had improved. Medical education is an important part of residency training. Our training course responded to the perceived needs of the students with consistently satisfactory evaluations. Before the evaluation of the impact of the course on patient care, further studies are needed to assess the acquisition of knowledge and skills through objective evaluations. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

  14. Gait assessment with solesound instrumented footwear in spinal muscular atrophy.

    Science.gov (United States)

    Montes, Jacqueline; Zanotto, Damiano; Dunaway Young, Sally; Salazar, Rachel; De Vivo, Darryl C; Agrawal, Sunil

    2017-08-01

    Gait impairment is common in spinal muscular atrophy (SMA) and is described using clinical assessments and instrumented walkways. Continuous over-ground walking has not been studied. Nine SMA participants completed the 6-minute walk test (6MWT) and 10-meter walk/run wearing instrumented footwear (SoleSound). Data were simultaneously collected using a reference system (GAITRite). The root-mean-square error (RMSE) indicated criterion validity. The decrease in walking speed represented fatigue. Foot loading patterns were evaluated using force sensors. The RMSE for stride time, length, and velocity ranged from 1.3% to 1.7%. Fatigue was 11.6 ± 9.1%, which corresponded to an average deceleration of 0.37 ± 0.28 mm/s 2 . Participants spent most of their stance without heel contact. Forefoot contact occurred early in the gait cycle. These results suggest that footwear-based devices are an alternative to specialized equipment for gait assessment. Better understanding of gait disturbances should inform ongoing treatment efforts and provide a more sensitive outcome measure. Muscle Nerve 56: 230-236, 2017. © 2016 Wiley Periodicals, Inc.

  15. Development of a software security assessment instrument to reduce software security risk

    Science.gov (United States)

    Gilliam, D. P.; Kelly, J. C.; Powell, J. D.; Bishop, M.

    2001-01-01

    This paper discusses development of a security assessment instrument for the software development and maintenance life cycle. The assessment instrument is a collection of tools and procedures to support development of secure software.

  16. Capturing the essence of developing endovascular expertise for the construction of a global assessment instrument

    DEFF Research Database (Denmark)

    Bech, Bo; Lönn, L; Schroeder, T V

    2010-01-01

    To explore what characterises the development of endovascular expertise and to construct a novel global assessment instrument.......To explore what characterises the development of endovascular expertise and to construct a novel global assessment instrument....

  17. Clinical skills assessment of procedural and advanced communication skills: performance expectations of residency program directors

    Science.gov (United States)

    Langenau, Erik E.; Zhang, Xiuyuan; Roberts, William L.; DeChamplain, Andre F.; Boulet, John R.

    2012-01-01

    Background High stakes medical licensing programs are planning to augment and adapt current examinations to be relevant for a two-decision point model for licensure: entry into supervised practice and entry into unsupervised practice. Therefore, identifying which skills should be assessed at each decision point is critical for informing examination development, and gathering input from residency program directors is important. Methods Using data from previously developed surveys and expert panels, a web-delivered survey was distributed to 3,443 residency program directors. For each of the 28 procedural and 18 advanced communication skills, program directors were asked which clinical skills should be assessed, by whom, when, and how. Descriptive statistics were collected, and Intraclass Correlations (ICC) were conducted to determine consistency across different specialties. Results Among 347 respondents, program directors reported that all advanced communication and some procedural tasks are important to assess. The following procedures were considered ‘important’ or ‘extremely important’ to assess: sterile technique (93.8%), advanced cardiovascular life support (ACLS) (91.1%), basic life support (BLS) (90.0%), interpretation of electrocardiogram (89.4%) and blood gas (88.7%). Program directors reported that most clinical skills should be assessed at the end of the first year of residency (or later) and not before graduation from medical school. A minority were considered important to assess prior to the start of residency training: demonstration of respectfulness (64%), sterile technique (67.2%), BLS (68.9%), ACLS (65.9%) and phlebotomy (63.5%). Discussion Results from this study support that assessing procedural skills such as cardiac resuscitation, sterile technique, and phlebotomy would be amenable to assessment at the end of medical school, but most procedural and advanced communications skills would be amenable to assessment at the end of the first

  18. Assessment of technical and nontechnical skills in surgical residents.

    Science.gov (United States)

    Ponton-Carss, Alicia; Kortbeek, John B; Ma, Irene W Y

    2016-11-01

    Surgical competence encompasses both technical and nontechnical skills. This study seeks to evaluate the validity evidence for a comprehensive surgical skills examination and to examine the relationship between technical and nontechnical skills. Six examination stations assessing both technical and nontechnical skills, conducted yearly for surgical trainees (n = 120) between 2010 and 2014 are included. The assessment tools demonstrated acceptable internal consistency. Interstation reliability for technical skills was low (alpha = .39). Interstation reliability for the nontechnical skills was lower (alpha range -.05 to .31). Nontechnical skills domains were strongly correlated, ranging from r = .65, P technical skills were inconsistent, ranging from poor (r = -.06; P = .54) to moderate (r = .45; P technical and nontechnical skills are necessary to assess overall surgical competency. Copyright © 2016 Elsevier Inc. All rights reserved.

  19. Instruments

    Energy Technology Data Exchange (ETDEWEB)

    Buehrer, W. [Paul Scherrer Inst. (PSI), Villigen (Switzerland)

    1996-12-31

    The present paper mediates a basic knowledge of the most commonly used experimental techniques. We discuss the principles and concepts necessary to understand what one is doing if one performs an experiment on a certain instrument. (author) 29 figs., 1 tab., refs.

  20. 77 FR 4553 - Proposed Revision to Selection Criteria-Enhanced Assessment Instruments

    Science.gov (United States)

    2012-01-30

    ... Selection Criteria--Enhanced Assessment Instruments AGENCY: Office of Elementary and Secondary Education... Education proposes to amend the selection criteria under the Enhanced Assessment Instruments Grant program... assessment instruments and systems used by States for measuring the academic achievement of elementary and...

  1. Assessment of Paediatric resident doctors' knowledge of metered ...

    African Journals Online (AJOL)

    ... all consenting paediatric senior registrars, who were present at the 2016 Health Resource management course organized by both Postgraduate Medical colleges in Nigeria, were recruited. Knowledge of critical steps of Metered Dose Inhaler (MDI) device technique was assessed via a self administered questionnaire.

  2. Determinants, associations, and psychometric properties of resident assessments of anesthesiologist operating room supervision.

    Science.gov (United States)

    Hindman, Bradley J; Dexter, Franklin; Kreiter, Clarence D; Wachtel, Ruth E

    2013-06-01

    A study by de Oliveira Filho et al. reported a validated set of 9 questions by which Brazilian anesthesia residents assessed faculty supervision in the operating room. The aim of this study was to use this question set to determine whether faculty operating room supervision scores were associated with residents' year of clinical anesthesia training and/or number of specific resident-faculty interactions. We also characterized associations between faculty operating room supervision scores and resident assessments of: (1) faculty supervision in settings other than operating rooms, (2) faculty clinical ability (family choice), and (3) faculty teaching effectiveness. Finally, we characterized the psychometric properties of the de Oliveira Filho etal. question set in an United States anesthesia residency program. All 39 residents in the Department of Anesthesia of the University of Iowa in their first (n = 14), second (n = 13), or third (n = 12) year of clinical anesthesia training evaluated the supervision provided by all anesthesia faculty who staffed in at least 1 of 3 clinical settings (operating room [n = 49], surgical intensive care unit [n = 10], pain clinic [n = 6]). For all resident-faculty pairs, departmental billing data were used to quantitate the number of resident-faculty interactions and the interval between the last interaction and the assessment. A generalizability study was performed to determine the minimum number of resident evaluations needed for high reliability and dependability. There were no significant associations between faculty mean operating room supervision scores and: (1) resident-faculty patient encounters (Kendall τb = 0.01; 95% confidence interval [CI], -0.02 to +0.04; P = 0.71), (2) resident-faculty days of interaction (τb = -0.01; 95% CI, -0.05 to +0.02; P = 0.46), and (3) days since last resident-faculty interaction (τb = 0.01; 95% CI, -0.02 to 0.05; P = 0.49). Supervision scores for the operating room and surgical intensive care

  3. The Danger Assessment: Validation of a Lethality Risk Assessment Instrument for Intimate Partner Femicide

    Science.gov (United States)

    Campbell, Jacquelyn C.; Webster, Daniel W.; Glass, Nancy

    2009-01-01

    The Danger Assessment (DA) is an instrument designed to assess the likelihood of lethality or near lethality occurring in a case of intimate partner violence. This article describes the development, psychometric validation, and suggestions for use of the DA. An 11-city study of intimate partner femicide used multivariate analysis to test the…

  4. Can personal dignity be assessed by others? A survey study comparing nursing home residents' with family members', nurses' and physicians' answers on the MIDAM-LTC.

    Science.gov (United States)

    Oosterveld-Vlug, Mariska G; Onwuteaka-Philipsen, Bregje D; Pasman, H Roeline W; van Gennip, Isis E; de Vet, Henrica C W

    2015-02-01

    Preserving dignity is an important goal of the care given in nursing homes. Although nursing home residents themselves are the preferred source of information about the factors that influence their dignity, they may not always be able to provide this. In these cases, information must be obtained from proxy informants such as family members or caregiver staff. Knowledge on comparability of proxies' and residents' answers is then important to interpret this information appropriately. To explore the extent to which responses of different types of proxies correspond with nursing home residents' responses when they both assess the resident's personal dignity. A cross-sectional survey. The general medical wards of six nursing homes in the Netherlands. Ninety-five nursing home residents, their family members, nurses and elderly care physicians. Agreement percentages were calculated between residents' and proxies' answers on the Measurement Instrument for Dignity AMsterdam-for Long Term Care facilities, an instrument consisting of 31 symptoms or experiences for which presence as well as influence on dignity were asked, and a single item score for overall personal dignity. Proxies generally rated the residents' dignity more negatively on the single item score than residents did themselves. Agreement percentages between residents and the different proxies ranged between 53% and 63% for the single item score, between 68% and 72% for the presence of items and between 68% and 76% for items' influence on dignity. Agreement on items' presence and influence on dignity was highest for physicians and lowest for family. Family members tended to overestimate the presence of items in the resident's life as well as their influence on dignity. They could however best recognize when a resident's dignity was considerably violated, whereas physicians and nurses overlooked this more often. Physicians and nurses were not always aware that certain items were present--especially of care items

  5. Assessing the performance and satisfaction of medical residents utilizing standardized patient versus mannequin-simulated training

    Directory of Open Access Journals (Sweden)

    Alsaad AA

    2017-07-01

    Full Text Available Ali A Alsaad,1 Swetha Davuluri,2 Vandana Y Bhide,3 Amy M Lannen,4 Michael J Maniaci3 1Department of Internal Medicine, Mayo Clinic, 2University of Miami, Coral Gables, 3Division of Hospital Internal Medicine, 4J. Wayne and Delores Barr Weaver Simulation Center, Mayo Clinic, Jacksonville, FL, USA Background: Conducting simulations of rapidly decompensating patients are a key part of internal medicine (IM residency training. Traditionally, mannequins have been the simulation tool used in these scenarios. Objective: To compare IM residents’ performance and assess realism in specific-simulated decompensating patient scenarios using standardized patients (SPs as compared to mannequin. Methods: Nineteen IM residents were randomized to undergo simulations using either a mannequin or an SP. Each resident in the two groups underwent four different simulation scenarios (calcium channel blocker overdose, severe sepsis, severe asthma exacerbation, and acute bacterial meningitis. Residents completed pretest and post-test evaluations as well as a questionnaire to assess the reality perception (realism score. Results: Nine residents completed mannequin-based scenarios, whereas 10 completed SP-based scenarios. Improvement in the post-test scores was seen in both groups. However, there were significantly higher post-test scores achieved with SP simulations in three out of the four scenarios (P=0.01. When compared with the mannequin group, the SP simulation group showed a significantly higher average realism score (P=0.002. Conclusions: Applying SP-based specific-simulation scenarios in IM residency training may result in better performance and a higher sense of a realistic experience by medical residents. Keywords: simulation, standardized patient, satisfaction, mannequin, assessment, resident education

  6. Use of 360-degree assessment of residents in internal medicine in a Danish setting

    DEFF Research Database (Denmark)

    Allerup, Peter

    2007-01-01

    The aim of the study was to explore the feasibility of 360 degree assessment in early specialist training in a Danish setting. Present Danish postgraduate training requires assessment of specific learning objectives. Residency in Internal Medicine was chosen for the study. It has 65 learning...

  7. Health of the elderly: multidisciplinary residence as an instrument for the care improvement Saúde do idoso: residência multiprofissional como instrumento transformador do cuidado

    Directory of Open Access Journals (Sweden)

    Rosana Klaesener

    2009-08-01

    Full Text Available Objective: To describe the actions taken by the team of the Health Aging Program Multidisciplinary Residency in Health (PREMUS / PUCRS. Description of the experience: In the primary care, the residents participated in home assistance, outpatient services and developed actions of health popular education in aged groups. The team was also inserted in a University hospital, assisting in the fields of outpatient and hospitalization units. Conclusion: The Multidisciplinary Residency Program in Health, with emphasis on the health of the elderly, has proposed a dynamic care based on the concepts of interdisciplinarity, integration and humanized care, as well as guided by the guidelines of the Unified Health System (SUS.Objetivo: Relatar as ações realizadas pela equipe Saúde do Idoso do Programa de Residência Multiprofissional em Saúde (PREMUS/PUCRS. Descrição da experiência: Na atenção básica, os residentes participaram na assistência domiciliar, ambulatorial e desenvolveram ações de educação popular em saúde em um grupo de idosos. A equipe também atuou em um hospital universitário, prestando assistência nos âmbitos ambulatorial e unidades de internação. Conclusão: O Programa de Residência Multiprofissional em Saúde, com ênfase na saúde do idoso, proporcionou aos residentes uma dinâmica assistencial fundamentada nos conceitos da interdisciplinaridade, integralidade e humanização do cuidado, tal como orientado pelas diretrizes do Sistema Único de Saúde (SUS.

  8. Instruments for the assessment of physical balance in the elderly

    Directory of Open Access Journals (Sweden)

    Ricardo Oliveira Guerra

    2007-12-01

    Full Text Available Esse trabalho objetivou identifi car os instrumentos mais utilizados para avaliação do equilíbrio corporal estático, dinâmico e risco de quedas em idosos no âmbito internacional e no Brasil. O estudo foi do tipo revisão sistemática qualitativa da literatura, os trabalhos consultados foram localizados por meio de pesquisa eletrônica nas bases de dados LILACS e MEDLINE e a partir das referências bibliográfi cas citadas em artigos científi cos. Uma vez escolhidos os instrumentos, realizou-se a investigação do histórico, utilização e adaptação transcultural dos mesmos. Vários testes têm sido desenvolvidos com o objetivo de medir funcionalmente o equilíbrio e estabelecer parâmetros para identificação de idosos com maior suscetibilidade de cair. De acordo com os critérios de seleção desse trabalho, chegou-se a escolha de cinco instrumentos com as propriedades psicométricas bem estabelecidas, o Teste de Alcance Funcional (FRT, o teste “Timed Up and Go” (TUG, o Teste de Performance Física (PPT, a Escala de Equilíbrio de Berg e a porção do equilíbrio da Avaliação da Mobilidade Orientada pelo Desempenho (POMA, tendo sido apenas esses dois últimos adaptados para a língua portuguesa. Diante disso, conclui-se que focalizar a atenção apenas em sinais e sintomas dos pacientes é extremamente limitado quando se deseja decidir qual intervenção melhorará a condição funcional do idoso, portanto, a avaliação funcional é o ponto de partida para uma reabilitação efetiva nessa população. Sendo necessária a existência de instrumentos de medida adaptados e validados para a população brasileira que avaliem o domínio do equilíbrio e contribuam para uma intervenção eficaz. ABSTRACT The objective of this study was to identify the instruments that are most often used to assess seniors for static and dynamic physical balance and risk of falling, both internationally and in Brazil. This was a systematic

  9. Novel Mobile App Allows for Fast and Validated Intraoperative Assessment of Otolaryngology Residents

    Directory of Open Access Journals (Sweden)

    Elliott D. Kozin MD

    2017-01-01

    Full Text Available Evaluation of resident operative skills is challenging in the fast-paced operating room environment and limited by lack of validated assessment metrics. We describe a smartphone-based app that enables rapid assessment of operative skills. Accreditation Council for Graduate Medical Education (ACGME otolaryngology taxonomy surgical procedures (n = 593 were uploaded to the software platform. The app was piloted over 1 month. Outcomes included (1 completion of evaluation, (2 time spent completing the evaluation, and (3 quantification of case complexity, operative autonomy, and performance. During the study, 12 of 12 procedures, corresponding to 3 paired evaluated by the resident/attending dyad. Mean ± SD time of evaluation completion was 98.0 ± 24.2 and 123.0 ± 14.0 seconds for the resident and attending, respectively. Mean time between resident and attending evaluation completion was 27.9 ± 26.8 seconds. Resident and attending scores for case complexity, operative autonomy, and performance were strongly correlated ( P < .0001. Rapid evaluation of resident intraoperative performance is feasible using smartphone-based technology.

  10. Assessment of Residents Readiness to Perform Lumbar Puncture

    DEFF Research Database (Denmark)

    Henriksen, Mikael Johannes Vuokko; Wienecke, Troels; Thagesen, Helle

    2017-01-01

    and 18 novices performing the procedure in a simulated, ward-like setting with a standardized patient. Procedural performance was assessed by three content experts. We used generalizability theory to explore reliability. The discriminative ability of the tool was explored by comparing performance scores......Background: Lumbar puncture is a common procedure in many specialties. The procedure serves to diagnose life-threatening conditions, often requiring rapid performance. However, junior doctors possess uncertainties regarding performing the procedure and frequently perform below expectations. Hence...... between the two groups. The contrasting groups method was used to set a pass/fail standard and the consequences of this was explored. Key results: The interviews identified that in addition to the technical aspects of the procedure, non-technical elements involving planning and conducting the procedure...

  11. Peer-Assessment Debriefing Instrument (PADI): Assessing Faculty Effectiveness in Simulation Education.

    Science.gov (United States)

    Saylor, Jennifer L; Wainwright, Susan F; Herge, E A; Pohlig, Ryan T

    2016-01-01

    Evaluating the debriefing skill of faculty in simulations is essential but often challenging. The Peer Assessment Debriefing Instrument (PADI) is a self and peer assessment designed to assess a debriefers' effectiveness and is grounded in current scientific debriefing literature and peer review methodology. This pilot study tested the PADI at three institutions during 10 different healthcare debriefing sessions. The PADI is useful to faculty and administrators of simulation centers by demonstrating ongoing quality improvement and as a guide to train new debriefers.

  12. The spiritual distress assessment tool: an instrument to assess spiritual distress in hospitalised elderly persons

    Directory of Open Access Journals (Sweden)

    Martin Estelle

    2010-12-01

    Full Text Available Abstract Background Although spirituality is usually considered a positive resource for coping with illness, spiritual distress may have a negative influence on health outcomes. Tools are needed to identify spiritual distress in clinical practice and subsequently address identified needs. This study describes the first steps in the development of a clinically acceptable instrument to assess spiritual distress in hospitalized elderly patients. Methods A three-step process was used to develop the Spiritual Distress Assessment Tool (SDAT: 1 Conceptualisation by a multidisciplinary group of a model (Spiritual Needs Model to define the different dimensions characterizing a patient's spirituality and their corresponding needs; 2 Operationalisation of the Spiritual Needs Model within geriatric hospital care leading to a set of questions (SDAT investigating needs related to each of the defined dimensions; 3 Qualitative assessment of the instrument's acceptability and face validity in hospital chaplains. Results Four dimensions of spirituality (Meaning, Transcendence, Values, and Psychosocial Identity and their corresponding needs were defined. A formalised assessment procedure to both identify and subsequently score unmet spiritual needs and spiritual distress was developed. Face validity and acceptability in clinical practice were confirmed by chaplains involved in the focus groups. Conclusions The SDAT appears to be a clinically acceptable instrument to assess spiritual distress in elderly hospitalised persons. Studies are ongoing to investigate the psychometric properties of the instrument and to assess its potential to serve as a basis for integrating the spiritual dimension in the patient's plan of care.

  13. Assessment of dementia in nursing home residents by nurses and assistants

    DEFF Research Database (Denmark)

    Sørensen, Lisbeth Uhrskov; Foldspang, Anders; Gulmann, Nils Christian

    2001-01-01

    Objectives To describe the criterion validity of nursing home staff's assessment of organic disorder compared with ICD-10 criteria, and to identify determinants of staff assessment of organic disorder. Method Two hundred and eighty-eight residents were diagnosed using the GMS-AGECAT. Nursing staff...... as under-labelling of residents, a tendency that will affect communication with medical personnel and may lead to inadequate or wrong medical treatment and to negative performance as well as negative role expectations in everyday life in nursing homes....

  14. Targeted needs assessment for a transitional "boot camp" curriculum for pediatric surgery residents.

    Science.gov (United States)

    Blackmore, Christopher; Lopushinsky, Steve; Lockyer, Jocelyn; Paolucci, Elizabeth Oddone

    2015-05-01

    Transition periods in medical education are associated with increased risk for learners and patients. For pediatric surgery residents, the transition to training is especially difficult as learners must adjust to new patient populations. In this study we perform a targeted needs assessment to determine the ideal content and format of a pediatric surgery boot camp to facilitate the transition to residency. A needs assessment survey was developed and distributed to pediatric surgery residents and staff across North America. The survey asked participants to rank 30 pediatric surgical diagnoses, 20 skills, and 11 physiological topics on "frequency" and "importance". Items were then ranked using empirical methods. The survey also evaluated the preferred boot camp format. In total, 12 residents and 23 staff completed the survey. No significant differences were identified between staff and residents in survey responses. The top 5 topics identified for inclusion in a boot camp were: (1) fluid and electrolyte management, (2) appendicitis, (3) pediatric hernias, (4) nutrition and (5) pain management. The preferred format for a boot camp was 3-4days in duration applying a blend of educational methods. Based on the results of the needs assessment survey, a novel pediatric surgery boot camp curriculum can be developed. Crown Copyright © 2015. Published by Elsevier Inc. All rights reserved.

  15. Assessment of physician competency in patient education: reliability and validity of a model-based instrument

    NARCIS (Netherlands)

    Wouda, Jan C.; Zandbelt, Linda C.; Smets, Ellen M. A.; van de Wiel, Harry B. M.

    2011-01-01

    Establish the inter-rater reliability and the concept, convergent and construct validity of an instrument for assessing the competency of physicians in patient education. Three raters assessed the quality of patient education in 30 outpatient consultations with the CELI instrument. This instrument

  16. Singing voice handicap mapped by different self-assessment instruments.

    Science.gov (United States)

    Paoliello, Karla; Oliveira, Gisele; Behlau, Mara

    2013-01-01

    To map voice handicap of popular singers with a general voice and two singing voice self-assessment questionnaires. Fifty singers, 25 male and 25 female, 23 with vocal complaint and 27 without vocal complaint answered randomly the questionnaires. For the comparison of data, the following statistical tests were performed: Mann-Whitney, Friedman, Wilcoxon, Spearman and Correlation. Data showed that the VHI yielded a smaller handicap when compared to the other two questionnaires (VHI x S-VHI - p=0.001; VHI x MSVH - p=0.004). The S-VHI and MSVH produced similar results (p=0.723). Singers with vocal complaint had a VHI total score of 17.5. The other two instruments showed more deviated scores (S-VHI - 24.9; MSVH - 25.2). There was no relationship between gender and singing style with the handicap perceived. A weak negative correlation between the perceived handicap and the time of singing experience was found (-37.7 to -13.10%), that is, the smaller the time of singing experience, the greater the handicap is. The questionnaires developed for the assessment of singing voice, S-VHI and MSVH, showed to be more specific and correspondent to each other for the evaluation of vocal handicap in singers. Findings showed that the more the time of singer's singing experience, the smaller the handicap is. Gender and singing styles did not influence the perception of the handicap.

  17. Performance assessment instrument to assess the senior high students' psychomotor for the salt hydrolysis material

    Science.gov (United States)

    Nahadi, Firman, Harry; Yulina, Erlis

    2016-02-01

    The purposes of this study were to develop a performance assessment instrument for assessing the competence of psychomotor high school students on salt hydrolysis concepts. The design used in this study was the Research & Development which consists of three phases: development, testing and application of instruments. Subjects in this study were high school students in class XI science, which amounts to 93 students. In the development phase, seven validators validated 17 tasks instrument. In the test phase, we divided 19 students into three-part different times to conduct performance test in salt hydrolysis lab work and observed by six raters. The first, the second, and the third groups recpectively consist of five, six, and eight students. In the application phase, two raters observed the performance of 74 students in the salt hydrolysis lab work in several times. The results showed that 16 of 17 tasks of performance assessment instrument developed can be stated to be valid with CVR value of 1,00 and 0,714. While, the rest was not valid with CVR value was 0.429, below the critical value (0.622). In the test phase, reliability value of instrument obtained were 0,951 for the five-student group, 0,806 for the six-student group and 0,743 for the eight-student group. From the interviews, teachers strongly agree with the performance instrument developed. They stated that the instrument was feasible to use for maximum number of students were six in a single observation.

  18. [Assessment of a residency training program in endocrinology and nutrition by physicians: results of a survey].

    Science.gov (United States)

    Moreno-Fernández, Jesús; Gutiérrez-Alcántara, Carmen; Palomares-Ortega, Rafael; García-Manzanares, Alvaro; Benito-López, Pedro

    2011-12-01

    The current training program for resident physicians in endocrinology and nutrition (EN) organizes their medical learning. Program evaluation by physicians was assessed using a survey. The survey asked about demographic variables, EN training methods, working time and center, and opinion on training program contents. Fifty-one members of Sociedad Castellano-Manchega de Endocrinología, Nutrición y Diabetes, and Sociedad Andaluza de Endocrinología y Nutrición completed the survey. Forty-percent of them disagreed with the compulsory nature of internal medicine, cardiology, nephrology and, especially, neurology rotations (60%); a majority (>50%) were against several recommended rotations included in the program. The fourth year of residence was considered by 37.8% of respondents as the optimum time for outpatient and inpatient control and monitoring without direct supervision. The recommended monthly number of on-call duties was 3.8±1.2. We detected a positive opinion about extension of residence duration to 4.4±0.5 years. Doctoral thesis development during the residence period was not considered convenient by 66.7% of physicians. Finally, 97.8% of resident physicians would recommend residency in EN to other colleagues. Endocrinologists surveyed disagreed with different training program aspects such as the rotation system, skill acquisition timing, and on-call duties. Therefore, an adaptation of the current training program in EN would be required. Copyright © 2011 SEEN. Published by Elsevier Espana. All rights reserved.

  19. A framework for assessing Health Economic Evaluation (HEE) quality appraisal instruments

    Science.gov (United States)

    2012-01-01

    Background Health economic evaluations support the health care decision-making process by providing information on costs and consequences of health interventions. The quality of such studies is assessed by health economic evaluation (HEE) quality appraisal instruments. At present, there is no instrument for measuring and improving the quality of such HEE quality appraisal instruments. Therefore, the objectives of this study are to establish a framework for assessing the quality of HEE quality appraisal instruments to support and improve their quality, and to apply this framework to those HEE quality appraisal instruments which have been subject to more scrutiny than others, in order to test the framework and to demonstrate the shortcomings of existing HEE quality appraisal instruments. Methods To develop the quality assessment framework for HEE quality appraisal instruments, the experiences of using appraisal tools for clinical guidelines are used. Based on a deductive iterative process, clinical guideline appraisal instruments identified through literature search are reviewed, consolidated, and adapted to produce the final quality assessment framework for HEE quality appraisal instruments. Results The final quality assessment framework for HEE quality appraisal instruments consists of 36 items organized within 7 dimensions, each of which captures a specific domain of quality. Applying the quality assessment framework to four existing HEE quality appraisal instruments, it is found that these four quality appraisal instruments are of variable quality. Conclusions The framework described in this study should be regarded as a starting point for appraising the quality of HEE quality appraisal instruments. This framework can be used by HEE quality appraisal instrument producers to support and improve the quality and acceptance of existing and future HEE quality appraisal instruments. By applying this framework, users of HEE quality appraisal instruments can become aware

  20. Script concordance testing: assessing residents' clinical decision-making skills for infant lumbar punctures.

    Science.gov (United States)

    Chang, Todd P; Kessler, David; McAninch, Brett; Fein, Daniel M; Scherzer, D J; Seelbach, Elizabeth; Zaveri, Pavan; Jackson, Jennifer M; Auerbach, Marc; Mehta, Renuka; Van Ittersum, Wendy; Pusic, Martin V

    2014-01-01

    Residents must learn which infants require a lumbar puncture (LP), a clinical decision-making skill (CDMS) difficult to evaluate because of considerable practice variation. The authors created an assessment model of the CDMS to determine when an LP is indicated, taking practice variation into account. The objective was to detect whether script concordance testing (SCT) could measure CDMS competency among residents for performing infant LPs. In 2011, using a modified Delphi technique, an expert panel of 14 attending physicians constructed 15 case vignettes (each with 2 to 4 SCT questions) that represented various infant LP scenarios. The authors distributed the vignettes to residents at 10 academic pediatric centers within the International Simulation in Pediatric Innovation, Research, and Education Network. They compared SCT scores among residents of different postgraduate years (PGYs), specialties, training in adult medicine, LP experience, and practice within an endemic Lyme disease area. Of 730 eligible residents, 102 completed 47 SCT questions. They could earn a maximum score of 47. Median SCT scores were significantly higher in PGY-3s compared with PGY-1s (difference: 3.0; 95% confidence interval [CI] 1.0-4.9; effect size d = 0.87). Scores also increased with increasing LP experience (difference: 3.3; 95% CI 1.1-5.5) and with adult medicine training (difference: 2.9; 95% CI 0.6-5.0). Residents in Lyme-endemic areas tended to perform more LPs than those in nonendemic areas. SCT questions may be useful as an assessment tool to determine CDMS competency among residents for performing infant LPs.

  1. Assessing the scholar CanMEDS role in residents using critical appraisal techniques

    Directory of Open Access Journals (Sweden)

    Aliya Kassam

    2013-03-01

    Full Text Available Background: In this brief report, we describe two ways in which we assessed the Scholar CanMEDS role using a method to measure residents’ ability to complete a critical appraisal.  These were incorporated into a modified OSCE format where two stations consisted of 1 critically appraising an article and 2 critiquing an abstract. Method: Residents were invited to participate in the CanMEDS In-Training Exam (CITE through the Office of Postgraduate Medical Education. Mean scores for the two Scholar stations were calculated using the number of correct responses out of 10. The global score represented the examiner’s overall impression of the resident’s knowledge and effort.  Correlations between scores are also presented between the two Scholar stations and a paired sample t-test comparing the global mean scores of the two stations was also performed. Results: Sixty-three of the 64 residents registered to complete the CanMEDS In-Training Exam including the two Scholar stations.  There were no significant differences between the global scores of the Scholar stations showing that the overall knowledge and effort of the residents was similar across both stations (3.8 vs. 3.5, p = 0.13.  The correlation between the total mean scores of both stations (inter-station reliability was also non-significant (r = 0.05, p = 0.67.  No significant differences between senior residents and junior residents were detected or between internal medicine residents and non-internal medicine residents. Conclusion: Further testing of these stations is needed and other novel ways of assessing the Scholar role competencies should also be investigated.

  2. 78 FR 31359 - Applications for New Awards; Ehanced Assessment Instruments Grants Program-Enhanced Assessment...

    Science.gov (United States)

    2013-05-23

    ... instruments, such as performance- and technology-based academic assessments. Absolute Priority 5--Kindergarten... history of unsatisfactory performance; has a financial or other management system that does not meet the... final performance report, including financial information, as directed by the Secretary. If you receive...

  3. Assessment of Resident Physicians' Communicator and Collaborator Competencies by Interprofessional Clinicians: A Mixed-Methods Study.

    Science.gov (United States)

    Sonnenberg, Lyn K; Pritchard-Wiart, Lesley; Hodgson, Carol S; Yu, YongQiang; King, Sharla

    2017-01-01

    Phenomenon: As we move toward competency-based medical education, greater emphasis is being placed on assessing a more comprehensive skill set, including the ability to communicate and collaborate effectively in the workplace. Nonphysician members on interprofessional (IP) teams have valuable perspectives on actual resident performance and are often not adequately engaged in the provision of feedback to residents. Based on the educational theories of collaborative evaluation and social constructivism, this research examined the ability of IP clinicians to provide feedback to residents. The aim of this study was to examine IP clinicians' perceptions of their ability to provide formative feedback, through their observations and assessments of developmental pediatric residents, compared to physician supervisors on the rotation, and to qualitatively explore potential barriers to the feedback process from their perspective. This explanatory, sequential mixed-methods design study first examined which and how many of the CanMEDS Communicator and Collaborator training objectives (N = 40) were considered to be observable and assessable by IP clinicians and physicians. A comparison of the mean number of objectives that were observed and practically assessed by (a) each group (IP clinicians vs. physicians) and (b) clinical service teams during the core developmental pediatrics rotations, were examined using independent t tests. Second, a thematic qualitative analysis of focus groups was used to develop a contextual understanding of the factors that influenced this process. Data were analyzed using three levels of open coding and descriptive qualitative analysis techniques. Physicians reported they could observe (M = 33.3, SD = 5.2, 83.3%) and assess (M = 31.5, SD = 7.3, 79%) a larger number of objectives compared to the IP clinician group (M = 24.7, SD = 8.6, 61.8% and M = 20.3, SD = 10.6, 51%, respectively). There were no differences between the clinical service teams (i

  4. Milestone-compatible neurology resident assessments: A role for observable practice activities.

    Science.gov (United States)

    Jones, Lyell K; Dimberg, Elliot L; Boes, Christopher J; Eggers, Scott D Z; Dodick, David W; Cutsforth-Gregory, Jeremy K; Leep Hunderfund, Andrea N; Capobianco, David J

    2015-06-02

    Beginning in 2014, US neurology residency programs were required to report each trainee's educational progression within 29 neurology Milestone competency domains. Trainee assessment systems will need to be adapted to inform these requirements. The primary aims of this study were to validate neurology resident assessment content using observable practice activities (OPAs) and to develop assessment formats easily translated to the Neurology Milestones. A modified Delphi technique was used to establish consensus perceptions of importance of 73 neurology OPAs among neurology educators and trainees at 3 neurology residency programs. A content validity score (CVS) was derived for each neurology OPA, with scores ≥4.0 determined in advance to indicate sufficient content validity. The mean CVS for all OPAs was 4.4 (range 3.5-5.0). Fifty-seven (78%) OPAs had a CVS ≥4.0, leaving 16 (22%) below the pre-established threshold for content validity. Trainees assigned a higher importance to individual OPAs (mean CVS 4.6) compared to faculty (mean 4.4, p = 0.016), but the effect size was small (η(2) = 0.10). There was no demonstrated effect of length of education experience on perceived importance of neurology OPAs (p = 0.23). Two sample resident assessment formats were developed, one using neurology OPAs alone and another using a combination of neurology OPAs and the Neurology Milestones. This study provides neurology training programs with content validity evidence for items to include in resident assessments, and sample assessment formats that directly translate to the Neurology Milestones. Length of education experience has little effect on perceptions of neurology OPA importance. © 2015 American Academy of Neurology.

  5. Normalization and the Assessment of Residences and Workshops by Mentally Handicapped Consumers.

    Science.gov (United States)

    Curtis, Charles K.

    Checklists have been developed with which mildly or moderately mentally retarded people can assess the quality of services provided them in residences and workshops. Based on the normalization principle, the checklists include examination of residential factors (such as the building's external appearance, rules, degree of privacy, and use of…

  6. Assessment of first-year post-graduate residents: Usefulness of multiple tools

    Directory of Open Access Journals (Sweden)

    Ying-Ying Yang

    2011-12-01

    Conclusion: The strong correlations between 360-degree evaluation and small-scale OSCE+DOPS+IM-ITE®-composited scores suggested that both methods were measuring the same quality. Our results showed that the small-scale OSCE, when associated with both the DOPS and IM-ITE®, could be an important assessment method for PGY1 residents.

  7. Content validity of the Geriatric Health Assessment Instrument.

    Science.gov (United States)

    Pedreira, Rhaine Borges Santos; Rocha, Saulo Vasconcelos; Santos, Clarice Alves Dos; Vasconcelos, Lélia Renata Carneiro; Reis, Martha Cerqueira

    2016-01-01

    Assess the content validity of the Elderly Health Assessment Tool with low education. The data collection instrument/questionnaire was prepared and submitted to an expert panel comprising four healthcare professionals experienced in research on epidemiology of aging. The experts were allowed to suggest item inclusion/exclusion and were asked to rate the ability of individual items in questionnaire blocks to encompass target dimensions as "not valid", "somewhat valid" or "valid", using an interval scale. Percent agreement and the Content Validity Index were used as measurements of inter-rater agreement; the minimum acceptable inter-rater agreement was set at 80%. The mean instrument percent agreement rate was 86%, ranging from 63 to 99%, and from 50 to 100% between and within blocks respectively. The Mean Content Validity Index score was 93.47%, ranging from 50 to 100% between individual items. The instrument showed acceptable psychometric properties for application in geriatric populations with low levels of education. It enabled identifying diseases and assisted in choice of strategies related to health of the elderly. Avaliar a validade de conteúdo do Instrumento de Avaliação da Saúde do Idoso com baixa escolaridade. Após a elaboração do instrumento de coleta de dados, o questionário foi submetido à avaliação de um comitê de especialistas, formado por quatro profissionais da área da saúde com experiência em pesquisas da epidemiologia do envelhecimento. Os especialistas puderam sugerir questões a serem incluídas/excluídas do instrumento, e avaliar cada bloco do questionário, observando se as dimensões a serem avaliadas foram abrangidas pelos itens do instrumento, em escala intervalar, como "não válida", "pouco válida" e "válida". Como medidas para avaliar o grau de concordância do instrumento, foram utilizados o porcentual de concordância e o Índice de Validade de Conteúdo. Considerou-se uma taxa aceitável de concordância o valor de

  8. International Residency Program Evaluation: Assessing the Reliability and Initial Validity of the ACGME-I Resident Survey in Abu Dhabi, United Arab Emirates.

    Science.gov (United States)

    Ibrahim, Halah; Lindeman, Brenessa; Matarelli, Steven A; Nair, Satish Chandrasekhar

    2014-09-01

    Educators agree on the importance of assessing the quality of graduate medical education. In the United States, the Accreditation Council for Graduate Medical Education (ACGME) resident survey is an important part of the accreditation process, yet some studies have questioned its validity. We assessed the reliability and acceptance of the ACGME-International (ACGME-I) resident survey in the culturally distinct, nonnative English-speaking resident population of Abu Dhabi in the United Arab Emirates. A total of 158 residents in ACGME-I accredited institutions in Abu Dhabi received an online link to the ACGME-I survey. Reliability analysis was conducted using the Cronbach α. A focus group was then held with a convenience sample of 25 residents from different institutions and specialties to understand potential challenges encountered by survey participants. Completed surveys were received from 116 residents (73.4%). The 39 items in the survey demonstrated high reliability, with a Cronbach α of 0.918. Of the 5 subscales, 4 demonstrated acceptable to very good reliability, ranging from 0.72 to 0.888. The subscale "resources" had lower reliability at 0.584. Removal of a single item increased the Cronbach α to a near-acceptable score of 0.670. Focus group results indicated that the survey met standards for readability, length, and time for completion. The ACGME-I resident survey demonstrates acceptable reliability and validity for measuring the perceptions of residents in an international residency program. The data derived from the survey can offer an important set of metrics for educational quality improvement in the United Arab Emirates.

  9. The development of an integrated assessment instrument for measuring analytical thinking and science process skills

    Science.gov (United States)

    Irwanto, Rohaeti, Eli; LFX, Endang Widjajanti; Suyanta

    2017-05-01

    This research aims to develop instrument and determine the characteristics of an integrated assessment instrument. This research uses 4-D model, which includes define, design, develop, and disseminate. The primary product is validated by expert judgment, tested it's readability by students, and assessed it's feasibility by chemistry teachers. This research involved 246 students of grade XI of four senior high schools in Yogyakarta, Indonesia. Data collection techniques include interview, questionnaire, and test. Data collection instruments include interview guideline, item validation sheet, users' response questionnaire, instrument readability questionnaire, and essay test. The results show that the integrated assessment instrument has Aiken validity value of 0.95. Item reliability was 0.99 and person reliability was 0.69. Teachers' response to the integrated assessment instrument is very good. Therefore, the integrated assessment instrument is feasible to be applied to measure the students' analytical thinking and science process skills.

  10. Scoping review of pediatric tonsillectomy quality of life assessment instruments.

    Science.gov (United States)

    Kao, Stephen Shih-Teng; Peters, Micah D J; Dharmawardana, Nuwan; Stew, Benjamin; Ooi, Eng Hooi

    2017-10-01

    Sleep-disordered breathing or recurrent tonsillitis have detrimental effects on the child's physical health and quality of life. Tonsillectomy is commonly performed to treat these common conditions and improve the child's quality of life. This scoping review aims to present a comprehensive and descriptive analysis of quality of life questionnaires as a resource for clinicians and researchers when deciding which tool to use when assessing the quality of life effects after tonsillectomy. A comprehensive search strategy was undertaken across MEDLINE (PubMed), CINAHL, Embase, and Cochrane CENTRAL. Quality of life questionnaires utilized in studies investigating pediatric patients undergoing tonsillectomy for chronic tonsillitis or sleep-disordered breathing were included. Methodological quality and data extraction were conducted as per Joanna Briggs Institute methodology. Ten questionnaires were identified, consisting of six generic and four disease-specific instruments. The Pediatric Quality of Life Inventory was the most commonly utilized generic questionnaire. The Obstructive Sleep Apnea-18 was the most commonly utilized disease-specific questionnaire. This review identified a range of generic and disease-specific quality of life questionnaires utilized in pediatric patients who have undergone tonsillectomy with or without adenoidectomy for sleep-disordered breathing or chronic tonsillitis. Important aspects of each questionnaire have been summarized to aid researchers and clinicians in choosing the appropriate questionnaire when evaluating the quality of life effects of tonsillectomy. NA Laryngoscope, 127:2399-2406, 2017. © 2017 The American Laryngological, Rhinological and Otological Society, Inc.

  11. Development and Validation of an Instrument for Assessing Junior ...

    African Journals Online (AJOL)

    The instrument covered nine dimensions as follows: Involvement, Affiliation, Teacher Support, Task- Orientation, Cooperation, Competition, Order and organization, Teacher Control and innovation. The instrument has two sections: students' actual and students' preferred forms. These items will enable students to provide ...

  12. Accounting for professionalism: an innovative point system to assess resident professionalism

    Directory of Open Access Journals (Sweden)

    Gary L. Malakoff

    2014-04-01

    Full Text Available Background: Professionalism is a core competency for residency required by the Accreditation Council of Graduate Medical Education. We sought a means to objectively assess professionalism among internal medicine and transitional year residents. Innovation: We established a point system to document unprofessional behaviors demonstrated by internal medicine and transitional year residents along with opportunities to redeem such negative points by deliberate positive professional acts. The intent of the policy is to assist residents in becoming aware of what constitutes unprofessional behavior and to provide opportunities for remediation by accruing positive points. A committee of core faculty and department leadership including the program director and clinic nurse manager determines professionalism points assigned. Negative points might be awarded for tardiness to mandatory or volunteered for events without a valid excuse, late evaluations or other paperwork required by the department, non-attendance at meetings prepaid by the department, and inappropriate use of personal days or leave. Examples of actions through which positive points can be gained to erase negative points include delivery of a mentored pre-conference talk, noon conference, medical student case/shelf review session, or a written reflection. Results: Between 2009 and 2012, 83 residents have trained in our program. Seventeen categorical internal medicine and two transitional year residents have been assigned points. A total of 55 negative points have been assigned and 19 points have been remediated. There appears to be a trend of fewer negative points and more positive points being assigned over each of the past three academic years. Conclusion: Commitment to personal professional behavior is a lifelong process that residents must commit to during their training. A professionalism policy, which employs a point system, has been instituted in our programs and may be a novel tool to

  13. Validation and reliability of Global Operative Assessment of Laparoscopic Skills for surgical residents and consultants.

    Science.gov (United States)

    Malik, Awais Amjad; Naeem, Awais; Toor, Asad Ali; Bhatti, Samiullah; Mansoor, Rashid; Mazhar, Amin; Farooka, Waris; Ayyaz, Mahmood

    2016-01-01

    To institute and validate the Global Assessment of Laparoscopic Surgery score as a measure of intraoperative performance. The observational study was conducted at the Services Hospital, Lahore, and the National Hospital and Medical Centre, Lahore, from August 1, 2013, to February 28, 2014, and comprised Residents, Senior Registrars and Consultants who were divided into 3 groups. The Junior group comprised Residents from years 1, 2 and3; the Intermediate group had year 4 Residents and Senior Registrars; and the Senior group included Consultants. All participants had their evaluation using Global Assessment of Laparoscopic Surgeryscore while performing dissection of gall bladder from the liver bed during laparoscopic cholecystectomy. SPSS 20 was used for statistical analysis. Of the 24 subjects in the study, 12(50%) were Residents, 6(25%) Senior Registrars and 6(25%) Consultants. The mean score for Junior group was 7.64±0.988, for Intermediate group 16.25±2.602 and for Senior group 22.83±1.169The score was highly reliable with intra-class coefficient 0.96, and internal consistency was excellent with Cronbach's Alpha 0.981. Global Assessment of Laparoscopic Surgery was found to be a valid and reliable measure of intraoperative laparoscopic skills.

  14. [Assessment of the instrument Edmonton Symptom Assessment System in hospice care: an integrative review].

    Science.gov (United States)

    Monteiro, Daiane da Rosa; Kruse, Maria Henriqueta Luce; Almeida, Miriam de Abreu

    2010-12-01

    Hospice Care (HC) is given to patients out of therapeutic possibilities of cure,focusing on symptoms control and life quality. The Edmonton Symptom Assessment System (ESAS) is an instrument to assess and monitor nine physical and psychological symptoms in patients in HC. The study aims to perform an integrative review on the assessment of health professionals and/or patients regarding the use of ESAS in cancer patients in Hospice Care. Eight papers have been localized at Medical Literature Analysis and Retrieval System Online (MEDLINE) between 1998 and 2009. The results displayed that although there are few studies on this topic, the ESAS is a valid instrument to detect and monitor symptoms in HC, presenting some limitations. The results led to the importance of the study continuity in translation and cross-cultural adaptation of this scale to Brazilian Portuguese.

  15. Assessment of Surgery Residents' Interpersonal Communication Skills: Validation Evidence for the Communication Assessment Tool in a Simulation Environment.

    Science.gov (United States)

    Trickey, Amber W; Newcomb, Anna B; Porrey, Melissa; Wright, Jeffrey; Bayless, Jordan; Piscitani, Franco; Graling, Paula; Dort, Jonathan

    Although development of trainees' competency in interpersonal communication is essential to high-quality patient-centered surgical care, nontechnical skills present assessment challenges for residency program directors. The Communication Assessment Tool (CAT) demonstrated internal reliability and content validity for general surgery residents, though the tool has not yet been applied in simulation. The study provides validation evidence for using the CAT to assess surgical residents' interpersonal communication skills in simulation scenarios. Simulations of delivering bad news were completed by 21 general surgery residents during a mandatory communication curriculum. Upon completion of the 10-minute scenario, standardized participants (SPs) assessed performance using the 14-item CAT rating scale and individually provided feedback to residents. Discrete communication behaviors were recorded on video review by a trained blinded observer. The traits emotional intelligence questionnaire short form (TEIQue-SF) was completed by the residents 6 months later. SP-CAT ratings are evaluated with respect to learner characteristics, observed behaviors, and TEIQue results. Surgical simulation center in a 900-bed tertiary care hospital. General surgery residents were targeted learners. Trauma survivors network volunteers served as SPs, acting as a family member of a patient who developed an intracerebral hemorrhage following a small bowel procedure. Discrete communication behaviors were reliably assessed by the observer (interrater reliability with trainer: 89% agreement, κ = 0.77). SP-CAT ratings ranged from 34 to 61. Higher SP-CAT ratings were correlated with positive communication behaviors (Spearman ρ = 0.42, p = 0.056). Total TEIQue was positively related to SP-CAT ratings (ρ = 0.42, p = 0.061). The TEIQue emotionality factor was strongly correlated with SP-CAT ratings (ρ = 0.52, p = 0.016). The CAT demonstrates content validity in a simulation environment with former

  16. Impedance e-tongue instrument for rapid liquid assessment

    International Nuclear Information System (INIS)

    Cabral, Flavio P. A.; Bergamo, Bruno B.; Dantas, Cleber A. R.; Giacometti, Jose A.; Riul, A. Jr

    2009-01-01

    We present a compact and easy to handle instrument developed to perform rapid analysis of liquids utilizing an 'electronic tongue' system. Briefly, the e-tongue used here is based on impedance measurements of an array of sensing units fabricated with ultrathin films of different materials deposited onto gold interdigitated electrodes. The instrument has the capability of measuring up to eight different sensor sets, each comprising an array of eight sensing units, and can perform a series of measurements in less than half of an hour. Additionally, there is a user-friendly software interface for instrument control, allowing the statistical correlation of samples using principal component analysis.

  17. Surgery resident learning styles and academic achievement.

    Science.gov (United States)

    Contessa, Jack; Ciardiello, Kenneth A; Perlman, Stacie

    2005-01-01

    To determine if surgical residents share a preferred learning style as measured by Kolb's Learning Style Inventory (LSI) and if a relationship exists between resident learning style and achievement as measured by a standardized examination (AME). Also, core faculty learning styles were assessed to determine if faculty and residents share a preferred learning style. Kolb's LSI, Version 3, was administered to 16 surgical residents and the residency program's core faculty of 6 attending physicians. To measure academic achievement, the American Medical Education (AME) examination was administered to residents. The Hospital of Saint Raphael, General Surgery Residency Program, New Haven, Connecticut. Both instruments were administered to residents during protected core curriculum time. Core faculty were administered the LSI on an individual basis. Surgical residents of the Hospital of Saint Raphael's General Surgery Residency Program and 6 core faculty members Analysis of resident learning style preference revealed Converging as the most commonly occurring style for residents (7) followed by Accommodating (5), Assimilating (3), and Diverging (1). The predominant learning style for core faculty was also Converging (4) with 2 Divergers. The average score for the Convergers on the AME was 62.6 compared with 42 for the next most frequently occurring learning style, Accommodators. In this surgical residency program, a preferred learning style for residents seems to exist (Converging), which confirms what previous studies have found. Additionally, residents with this learning style attained a higher average achievement score as measured by the AME. Also, core faculty share the same preferential learning style as this subset of residents.

  18. Project W-314 DST and DCRT instrument and control systems, initial assessment

    International Nuclear Information System (INIS)

    Acree, C.D.

    1996-01-01

    This report contains an assessment of the instrument and control systems in the Double Shell Tank Farms and the 244-A DCRT. The assessment report contains data from physical inspection activities and an overall engineering assessment of the instruments and control systems in use in the Double Shell Tanks

  19. Cultural adaptation: translatability assessment and linguistic validation of the patient-reported outcome instrument for irritable bowel syndrome with diarrhea

    Directory of Open Access Journals (Sweden)

    Delgado-Herrera L

    2016-06-01

    Full Text Available Leticia Delgado-Herrera,1 Kathryn Lasch,2 Ana Popielnicki,3 Akito Nishida,4 Rob Arbuckle,5 Benjamin Banderas,6 Susan Zentner,1 Ingrid Gagainis,1 Bernhardt Zeiher1 1Astellas Pharma Global Development, Northbrook, IL, 2Pharmerit International, Newton, MA, USA; 3TransPerfect, Linguistic Validation Group, Boston, MA, USA; 4Development Project Management, Astellas Pharma Inc, Tokyo, Japan; 5Patient-Centered Outcomes Adelphi Values, Bollington, UK; 6Patient-Centered Outcomes Adelphi Values, Boston, MA, USA Background and objective: Following a 2009 US Food and Drug Administration guidance, a new patient-reported outcome (PRO instrument was developed to support end points in multinational clinical trials assessing irritable bowel syndrome with diarrhea (IBS-D symptom severity. Our objective was to assess the translatability of the IBS-D PRO instrument into ten languages, and subsequently perform a cultural adaptation/linguistic validation of the questionnaire into Japanese and US Spanish. Materials and methods: Translatability assessments of the US English version of the IBS-D PRO were performed by experienced PRO translators who were native speakers of each target language and currently residing in target-language countries. Languages were Chinese (People’s Republic of China, Dutch (the Netherlands, French (Belgium, German (Germany, Japanese (Japan, Polish (Poland, Portuguese (Brazil, Russian (Russia, Spanish (Mexico, and Spanish (US. The project team assessed the instrument to identify potential linguistic and/or cultural adaptation issues. After the issues identified were resolved, the instrument was translated into Spanish (US and Japanese through a process of two forward translations, one reconciled translation, and one backward translation. The project team reviewed the translated versions before the instruments were evaluated by cognitive debriefing interviews with samples of five Spanish (US and five Japanese IBS-D patients. Results

  20. Higher Education and Disability: A Systematic Review of Assessment Instruments Designed for Students, Faculty, and Staff

    Science.gov (United States)

    Lombardi, Allison; Gelbar, Nicholas; Dukes, Lyman L., III; Kowitt, Jennifer; Wei, Yan; Madaus, Joseph; Lalor, Adam R.; Faggella-Luby, Michael

    2018-01-01

    In this study, the literature in disability and higher education was examined, with a specific focus on assessment instruments. Published articles (n = 203) on development of new or refinement of existing instruments were reviewed for traits measured and psychometric rigor reported. Findings showed instruments are intended for professionals and…

  1. Simulation-based Assessment to Reliably Identify Key Resident Performance Attributes.

    Science.gov (United States)

    Blum, Richard H; Muret-Wagstaff, Sharon L; Boulet, John R; Cooper, Jeffrey B; Petrusa, Emil R; Baker, Keith H; Davidyuk, Galina; Dearden, Jennifer L; Feinstein, David M; Jones, Stephanie B; Kimball, William R; Mitchell, John D; Nadelberg, Robert L; Wiser, Sarah H; Albrecht, Meredith A; Anastasi, Amanda K; Bose, Ruma R; Chang, Laura Y; Culley, Deborah J; Fisher, Lauren J; Grover, Meera; Klainer, Suzanne B; Kveraga, Rikante; Martel, Jeffrey P; McKenna, Shannon S; Minehart, Rebecca D; Mitchell, John D; Mountjoy, Jeremi R; Pawlowski, John B; Pilon, Robert N; Shook, Douglas C; Silver, David A; Warfield, Carol A; Zaleski, Katherine L

    2018-04-01

    Obtaining reliable and valid information on resident performance is critical to patient safety and training program improvement. The goals were to characterize important anesthesia resident performance gaps that are not typically evaluated, and to further validate scores from a multiscenario simulation-based assessment. Seven high-fidelity scenarios reflecting core anesthesiology skills were administered to 51 first-year residents (CA-1s) and 16 third-year residents (CA-3s) from three residency programs. Twenty trained attending anesthesiologists rated resident performances using a seven-point behaviorally anchored rating scale for five domains: (1) formulate a clear plan, (2) modify the plan under changing conditions, (3) communicate effectively, (4) identify performance improvement opportunities, and (5) recognize limits. A second rater assessed 10% of encounters. Scores and variances for each domain, each scenario, and the total were compared. Low domain ratings (1, 2) were examined in detail. Interrater agreement was 0.76; reliability of the seven-scenario assessment was r = 0.70. CA-3s had a significantly higher average total score (4.9 ± 1.1 vs. 4.6 ± 1.1, P = 0.01, effect size = 0.33). CA-3s significantly outscored CA-1s for five of seven scenarios and domains 1, 2, and 3. CA-1s had a significantly higher proportion of worrisome ratings than CA-3s (chi-square = 24.1, P < 0.01, effect size = 1.50). Ninety-eight percent of residents rated the simulations more educational than an average day in the operating room. Sensitivity of the assessment to CA-1 versus CA-3 performance differences for most scenarios and domains supports validity. No differences, by experience level, were detected for two domains associated with reflective practice. Smaller score variances for CA-3s likely reflect a training effect; however, worrisome performance scores for both CA-1s and CA-3s suggest room for improvement.

  2. Assessment of Multiple Scattering Errors of Laser Diffraction Instruments

    National Research Council Canada - National Science Library

    Strakey, Peter

    2003-01-01

    The accuracy of two commercial laser diffraction instruments was compared under conditions of multiple scattering designed to simulate the high droplet number densities encountered in liquid propellant rocket combustors...

  3. Assessment of resident and fellow knowledge of the organ donor referral process

    Science.gov (United States)

    Passarella, Ralph J.; Salter, Megan L.; Kucirka, Lauren M.; Orandi, Babak J.; Law, Andrew H.; Segev, Dorry L.

    2015-01-01

    Maximizing deceased donation rates can decrease the organ shortage. Non-transplant physicians play a critical role in facilitating conversion of potential deceased donors to actual donors, but studies suggest that physicians lack knowledge about the organ donation process. Since residency and fellowship are often the last opportunities for formal medical training, we hypothesized that deficiencies in knowledge might originate in residency and fellowship. We conducted a cross-sectional survey to assess knowledge about organ donation, experience in donor conversion, and opinions of the process among residents and fellows after their intensive care unit rotations at the Johns Hopkins Hospital. Of 40 participants, 50% had previously facilitated donor conversion, 25% were familiar with the guidelines of the Organ Procurement Organization (OPO), and 10% had received formal instruction from the OPO. The median score on the knowledge assessment was 5 out of 10; higher knowledge score was not associated with level of medical training, prior training in or experience with donor conversion, or with favorable opinions about the OPO. We identified a pervasive deficit in knowledge among residents and fellows at an academic medical center with an active transplant program that may help explain attending-level deficits in knowledge about the organ donation process. PMID:24673146

  4. Examination to assess the clinical examination and documentation of spine pathology among orthopedic residents.

    Science.gov (United States)

    Haglin, Jack M; Zeller, John L; Egol, Kenneth A; Phillips, Donna P

    2017-12-01

    The Accreditation Council for Graduate Medical Education (ACGME) guidelines requires residency programs to teach and evaluate residents in six overarching "core competencies" and document progress through educational milestones. To assess the progress of orthopedic interns' skills in performing a history, physical examination, and documentation of the encounter for a standardized patient with spinal stenosis, an objective structured clinical examination (OSCE) was conducted for 13 orthopedic intern residents, following a 1-month boot camp that included communications skills and curriculum in history and physical examination. Interns were objectively scored based on their performance of the physical examination, communication skills, completeness and accuracy of their electronic medical record (EMR), and their diagnostic conclusions gleaned from the patient encounter. The purpose of this study was to meaningfully assess the clinical skills of orthopedic post-graduate year (PGY)-1 interns. The findings can be used to develop a standardized curriculum for documenting patient encounters and highlight common areas of weakness among orthopedic interns with regard to the spine history and physical examination and conducting complete and accurate clinical documentation. A major orthopedic specialty hospital and academic medical center. Thirteen PGY-1 orthopedic residents participated in the OSCE with the same standardized patient presenting with symptoms and radiographs consistent with spinal stenosis. Videos of the encounters were independently viewed and objectively evaluated by one investigator in the study. This evaluation focused on the completeness of the history and the performance and completion of the physical examination. The standardized patient evaluated the communication skills of each intern with a separate objective evaluation. Interns completed these same scoring guides to evaluate their own performance in history, physical examination, and communications

  5. Is there a role for the use of aviation assessment instruments in surgical training preparation? A feasibility study.

    Science.gov (United States)

    Stolk-Vos, Aline C; Heres, Marion H; Kesteloo, Jasper; Verburg, Dick; Hiddema, Frans; Lie, Desiree A; de Korne, Dirk F

    2017-01-01

    Selection for surgical residency programmes could potentially be improved through pretraining preparation, after assessment of surgical candidates' sensorimotor skills and personality traits. Existing aviation pilot selection instruments are available to test sensorimotor skills and personality traits. This study examined selected instruments to assess medical trainees' sensorimotor skills and personality traits. Aviation's validated computer-based Computerized Pilot Aptitude and Screening System (COMPASS) and Checklist Professional Profile (CPP) were applied to 166 final year medical students during a surgical clerkship between 2013 and 2015. All trainees completed COMPASS and CPP within the prescribed 2 hours. Compared with an age-matched and gender-matched cohort of 165 pilot candidates, medical trainees scored significantly higher on eye-hand coordination (peye-hand-foot coordination (p<0.001), spatial orientation (p<0.001), persuasiveness (p<0.001), stress tolerance (p<0.001), dominance (p<0.001), ambition (p<0.001) and resilience (p<0.001). Final year medical trainees from one medical school were able to complete aviation's sensorimotor skills and personality traits selection instruments within the set time frame. They scored differently from aviation trainees on selected skills and personality traits. The applicability and utility of aviation instruments to presurgical training preparation remains to be tested. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

  6. Validity of evaluation instrument on the implementation of performance assessment to measure science process skills

    OpenAIRE

    Marina Ramadani; Supahar Supahar; Dadan Rosana

    2017-01-01

    This study aims to develop an evaluation instrument CIPP (context, input, process, product) model that suitable at implementation of performance assessment instrument to measure students' science process skills of junior high school. Methods in this study are research and development (R & D) which is adopted by model Borg & Gall model. This evaluation instrument used one of evaluation CIPP model with context, input, process, and product components. The evaluation instrument is used to determi...

  7. Analyzing reflective narratives to assess the ethical reasoning of pediatric residents.

    Science.gov (United States)

    Moon, Margaret; Taylor, Holly A; McDonald, Erin L; Hughes, Mark T; Beach, Mary Catherine; Carrese, Joseph A

    2013-01-01

    A limiting factor in ethics education in medical training has been difficulty in assessing competence in ethics. This study was conducted to test the concept that content analysis of pediatric residents' personal reflections about ethics experiences can identify changes in ethical sensitivity and reasoning over time. Analysis of written narratives focused on two of our ethics curriculum's goals: 1) To raise sensitivity to ethical issues in everyday clinical practice and 2) to enhance critical reflection on personal and professional values as they affect patient care. Content analysis of written reflections was guided by a tool developed to identify and assess the level of ethical reasoning in eight domains determined to be important aspects of ethical competence. Based on the assessment of narratives written at two times (12 to 16 months/apart) during their training, residents showed significant progress in two specific domains: use of professional values, and use of personal values. Residents did not show decline in ethical reasoning in any domain. This study demonstrates that content analysis of personal narratives may provide a useful method for assessment of developing ethical sensitivity and reasoning.

  8. Creating Entrustable Professional Activities to Assess Internal Medicine Residents in Training: A Mixed-Methods Approach.

    Science.gov (United States)

    Taylor, David R; Park, Yoon Soo; Smith, Christopher A; Karpinski, Jolanta; Coke, William; Tekian, Ara

    2018-04-17

    Competency-based medical education has not advanced residency training as much as many observers expected. Some medical educators now advocate reorienting competency-based approaches to focus on a resident's ability to do authentic clinical work. To develop descriptions of clinical work for which internal medicine residents must gain proficiency to deliver meaningful patient care (for example, "Admit and manage a medical inpatient with a new acute problem"). A modified Delphi process involving clinical experts followed by a conference of educational experts. The Royal College of Physicians and Surgeons of Canada. In phase 1 of the project, members of the Specialty Committee for Internal Medicine participated in a modified Delphi process to identify activities in internal medicine that represent the scope of the specialty. In phase 2 of the project, 5 experts who were scholars and leaders in competency-based medical education reviewed the results. Phase 1 identified important activities, revised descriptions to improve accuracy and avoid overlap, and assigned activities to stages of training. Phase 2 compared proposed activity descriptions with published guidelines for their development and application in medical education. The project identified 29 activities that qualify as entrustable professional activities. The project also produced a detailed description of each activity and guidelines for using them to assess residents. These activities reflect the practice patterns of the developers and may not fully represent internal medicine practice in Canada. Identification of these activities is expected to facilitate modification of training and assessment programs for medical residents so that programs focus less on isolated skills and more on integrated tasks. Southeastern Ontario Academic Medical Organization Endowed Scholarship and Education Fund and Queen's University Department of Medicine Innovation Fund.

  9. Bimanual Psychomotor Performance in Neurosurgical Resident Applicants Assessed Using NeuroTouch, a Virtual Reality Simulator.

    Science.gov (United States)

    Winkler-Schwartz, Alexander; Bajunaid, Khalid; Mullah, Muhammad A S; Marwa, Ibrahim; Alotaibi, Fahad E; Fares, Jawad; Baggiani, Marta; Azarnoush, Hamed; Zharni, Gmaan Al; Christie, Sommer; Sabbagh, Abdulrahman J; Werthner, Penny; Del Maestro, Rolando F

    Current selection methods for neurosurgical residents fail to include objective measurements of bimanual psychomotor performance. Advancements in computer-based simulation provide opportunities to assess cognitive and psychomotor skills in surgically naive populations during complex simulated neurosurgical tasks in risk-free environments. This pilot study was designed to answer 3 questions: (1) What are the differences in bimanual psychomotor performance among neurosurgical residency applicants using NeuroTouch? (2) Are there exceptionally skilled medical students in the applicant cohort? and (3) Is there an influence of previous surgical exposure on surgical performance? Participants were instructed to remove 3 simulated brain tumors with identical visual appearance, stiffness, and random bleeding points. Validated tier 1, tier 2, and advanced tier 2 metrics were used to assess bimanual psychomotor performance. Demographic data included weeks of neurosurgical elective and prior operative exposure. This pilot study was carried out at the McGill Neurosurgical Simulation Research and Training Center immediately following neurosurgical residency interviews at McGill University, Montreal, Canada. All 17 medical students interviewed were asked to participate, of which 16 agreed. Performances were clustered in definable top, middle, and bottom groups with significant differences for all metrics. Increased time spent playing music, increased applicant self-evaluated technical skills, high self-ratings of confidence, and increased skin closures statistically influenced performance on univariate analysis. A trend for both self-rated increased operating room confidence and increased weeks of neurosurgical exposure to increased blood loss was seen in multivariate analysis. Simulation technology identifies neurosurgical residency applicants with differing levels of technical ability. These results provide information for studies being developed for longitudinal studies on the

  10. Validity evidence of non-technical skills assessment instruments in simulated anaesthesia crisis management.

    Science.gov (United States)

    Jirativanont, T; Raksamani, K; Aroonpruksakul, N; Apidechakul, P; Suraseranivongse, S

    2017-07-01

    We sought to evaluate the validity of two non-technical skills evaluation instruments, the Anaesthetists' Non-Technical Skills (ANTS) behavioural marker system and the Ottawa Global Rating Scale (GRS), to apply them to anaesthesia training. The content validity, response process, internal structure, relations with other variables and consequences were described for validity evidence. Simulated crisis management sessions were initiated during which two trained raters evaluated the performance of postgraduate first-, second- and third-year (PGY-1, PGY-2 and PGY-3) anaesthesia residents. The study included 70 participants, composed of 24 PGY-1, 24 PGY-2 and 22 PGY-3 residents. Both instruments differentiated the non-technical skills of PGY-1 from PGY-3 residents ( P skills were 0.86, 0.83, 0.84, 0.87, 0.80 and 0.86, respectively. The Cronbach's alpha for internal consistency of the ANTS instrument was 0.93, and was 0.96 for the Ottawa GRS. There was a high correlation between the ANTS and Ottawa GRS. The raters reported the ease of use of the Ottawa GRS compared to the ANTS. We found sufficient evidence of validity in the ANTS instrument and the Ottawa GRS for the evaluation of non-technical skills in a simulated anaesthesia setting, but the Ottawa GRS was more practical and had higher reliability.

  11. An attempt to recalibrate instrumental criteria for intensity assessment

    Directory of Open Access Journals (Sweden)

    Horea SANDI

    2014-12-01

    Full Text Available The authors contributed during a quite long period of time to the development of comprehensive and flexible system of estimating seismic intensity on the basis of instrumental (accelerographic data on earthquake ground motion. The system makes it possible to determine for a record, according to needs, global intensities, intensities corresponding to definite frequencies, intensities averaged upon a spectral band, continuous or discrete intensity spectra. Moreover, the intensity measures developed may rely, according to choice, on different outcomes of processing of primary instrumental data. A problem to which the paper is devoted is represented by the calibration of an important parameter, namely the logarithm base adopted in view of conversing instrumental information to intensity measures. After the attempts of the past, new sources are used this time to solve the problem. Alternative solutions are examined and discussed in this view.

  12. Description of a developmental criterion-referenced assessment for promoting competence in internal medicine residents.

    Science.gov (United States)

    Varney, Andrew; Todd, Christine; Hingle, Susan; Clark, Michael

    2009-09-01

    End-of- rotation global evaluations can be subjective, produce inflated grades, lack interrater reliability, and offer information that lacks value. This article outlines the generation of a unique developmental criterion-referenced assessment that applies adult learning theory and the learner, manager, teacher model, and represents an innovative application to the American Board of Internal Medicine (ABIM) 9-point scale. We describe the process used by Southern Illinois University School of Medicine to develop rotation-specific, criterion-based evaluation anchors that evolved into an effective faculty development exercise. The intervention gave faculty a clearer understanding of the 6 Accreditation Council for Graduate Medical Education competencies, each rotation's educational goals, and how rotation design affects meaningful work-based assessment. We also describe easily attainable successes in evaluation design and pitfalls that other institutions may be able to avoid. Shifting the evaluation emphasis on the residents' development of competence has made the expectations of rotation faculty more transparent, has facilitated conversations between program director and residents, and has improved the specificity of the tool for feedback. Our findings showed the new approach reduced grade inflation compared with the ABIM end-of-rotation global evaluation form. We offer the new developmental criterion-referenced assessment as a unique application of the competences to the ABIM 9-point scale as a transferable model for improving the validity and reliability of resident evaluations across graduate medical education programs.

  13. The Utility of Risk Assessment Instruments for the Prediction of Recidivism in Sexual Homicide Perpetrators

    Science.gov (United States)

    Hill, Andreas; Rettenberger, Martin; Habermann, Niels; Berner, Wolfgang; Eher, Reinhard; Briken, Peer

    2012-01-01

    To examine the predictive accuracy of four well established risk assessment instruments (PCL-R, HCR-20, SVR-20, and Static-99) in an important subgroup of sexual offenders, these instruments were assessed retrospectively based on information from forensic psychiatric court reports in a sample of 90 released male sexual homicide offenders (out of…

  14. Development and evaluation of the content validity, practicability and feasibility of the Innovative dementia-oriented Assessment system for challenging behaviour in residents with dementia.

    Science.gov (United States)

    Halek, Margareta; Holle, Daniela; Bartholomeyczik, Sabine

    2017-08-14

    One of the most difficult issues for care staff is the manifestation of challenging behaviour among residents with dementia. The first step in managing this type of behaviour is analysing its triggers. A structured assessment instrument can facilitate this process and may improve carers' management of the situation. This paper describes the development of an instrument designed for this purpose and an evaluation of its content validity and its feasibility and practicability in nursing homes. The development process and evaluation of the content validity were based on Lynn's methodology (1998). A literature review (steps 1 + 2) provided the theoretical framework for the instrument and for item formation. Ten experts (step 3) evaluated the first version of the instrument (the Innovative dementia-oriented Assessment (IdA®)) regarding its relevance, clarity, meaningfulness and completeness; content validity indices at the scale-level (S-CVI) and item-level (I-CVI) were calculated. Health care workers (step 4) evaluated the second version in a workshop. Finally, the instrument was introduced to 17 units in 11 nursing homes in a field study (step 5), and 60 care staff members assessed its practicability and feasibility. The IdA® used the need-driven dementia-compromised behaviour (NDB) model as a theoretical framework. The literature review and expert-based panel supported the content validity of the IdA®. At the item level, 77% of the ratings had a CVI greater than or equal to 0.78. The majority of the question-ratings (84%, n = 154) and answer-ratings (69%, n = 122) showed valid results, with none below 0.50. The health care workers confirmed the understandability, completeness and plausibility of the IdA®. Steps 3 and 4 led to further item clarification. The carers in the study considered the instrument helpful for reflecting challenging behaviour and beneficial for the care of residents with dementia. Negative ratings referred to the time required and the

  15. A Review of Instruments for Assessing Body Image in Preschoolers

    Science.gov (United States)

    Cuesta-Zamora, Cristina; Navas, Leandro

    2017-01-01

    Society has produced many idealized and unattainable standards of beauty. These may be internalized by young children, increasing the risk of body dissatisfaction, which is the strongest predictor of eating disorders. Prompted by this concern, the aim of the present research was to identify and analyze the instruments that have been used to…

  16. Policy instruments for energy conservation: A multidimensional assessment

    International Nuclear Information System (INIS)

    Giraudet, Louis-Gaetan

    2011-01-01

    This thesis evaluates the effectiveness of various forms of taxes, subsidies and regulations implemented to correct for market failures that may prevent energy savings. It builds on various approaches, with gradual complexity. First, a standard micro-economic model is developed to compare the static performances of these instruments. Second, the representation of consumer behaviour is strengthened in a model of the residential energy demand for space heating in France, which allows to identify the dynamic mechanisms by which instruments can correct for the main market failures. Third, an empirical evaluation of 'white certificate' schemes - tradable energy saving obligations imposed on energy operators - is made from the comparison between the British, Italian and French experiences, taking into account national institutions. The following conclusions can be drawn from these various approaches: (i) energy taxes, by encouraging both energy efficiency investment and sufficiency behaviour, are particularly effective; (ii) energy efficiency regulations have a significant impact on the diffusion of efficient technologies; (iii) subsidies to energy efficiency induce a large rebound effect; (iv) depending on the institutional environment in which they operate, white certificate schemes combine different properties of these instruments. Applied to the French residential building sector, the most effective combination of these instruments does not allow to reach the energy saving target set by the Government. (author)

  17. Selecting Suicide Ideation Assessment Instruments: A Meta-Analytic Review

    Science.gov (United States)

    Erford, Bradley T.; Jackson, Jessica; Bardhoshi, Gerta; Duncan, Kelly; Atalay, Zumra

    2018-01-01

    Psychometric meta-analyses and reviews were provided for four commonly used suicidal ideation instruments: the Beck Scale for Suicide Ideation, the Suicide Ideation Questionnaire, the Suicide Probability Scale, and Columbia--Suicide Severity Rating Scale. Practical and technical issues and best use recommendations for screening and outcome…

  18. Instrumental vaginal delivery - an assessment of use in a tertiary ...

    African Journals Online (AJOL)

    Background: Majority of women in sub-Saharan Africa expect to achieve spontaneous vaginal delivery at the end of pregnancy. This is usually possible, but, a few women will receive one form of assistance or another (forceps or vacuum) to avert maternal or foetal morbidity or mortality. Training and research in instrumental ...

  19. Application and interview features used to assess applicant qualifications for residency training.

    Science.gov (United States)

    Butts, Allison R; Smith, Kelly M

    2015-02-01

    To determine what factors residency program directors (RPDs) consider and what methods they use to assess applicants. Respondents ranked the importance of 27 applicant features within domains: academics/credentials, application features/program fit, involvement, professional experience, research/ teaching experience, and postgraduate year 1 (PGY-1) residency experience. Rank was assigned in an ordinal fashion (1 = most important feature). The domains were characterized by their importance (mean % ± SD) in selecting candidates for interviews. Participants characterized their screening process according to 8 application and 6 interview features and the corresponding applicant dimensions evaluated. RPDs rated the importance of 14 methods applicants used to communicate with the program and 3 methods by which references were obtained. A Likert scale was used for rating (4 = crucial features). The approaches the program used to evaluate 12 application features or interpersonal interactions were reported. The most important application domain was application features/program fit (26.28 ± 19.11). The highest ranked application feature was program fit (2.04 ± 1.17). The applicant's cover letter, recommendation letters, curriculum vitae, and interview meal were commonly used to assess communication and interpersonal skills, knowledge base, and experience. The most important communication venue was the on-site interview (3.95 ± 0.23). Recommendations solicited by RPDs (3.42 ± 0.69) were most important. Programs formally evaluated the interview (89%) and recommendation letters (84%). Understanding the importance that RPDs place on application and interview features, as well as the process used to assess communication skills and interpersonal interactions, should allow residency candidates to become more competitive residency prospects.

  20. Assessment of instruments in facilitating investment in off-grid renewable energy projects

    International Nuclear Information System (INIS)

    Shi, Xunpeng; Liu, Xiying; Yao, Lixia

    2016-01-01

    Renewable off-grid solution plays a critical role in supporting rural electrification. However, off-grid Renewable Energy (OGRE) project financing faces significant challenges due to limited financing access, low affordability of consumers, high transactions costs and etc. Various supporting instruments have been implemented to facilitate OGRE investment. This study assesses the effectiveness of those instruments with a framework consists of three dimensions: feasibility, sustainability and replicability. The weights of each dimension in the framework and the scores of each instrument are assessed by expert surveys based on the Delphi method. It is suggested that all the three dimensions should be taken into consideration while assessing the instruments, among which feasibility and sustainability are considered as the most important dimensions in the assessment framework. Furthermore, the top-5 most effective instruments in facilitating OGRE investment are local engagement in operation and maintenance, loan guarantee, start-up grant, end user financing, and concessional finance. Developing countries that need to increase electrification, such as most of the ASEAN member states, could use these top scored instruments despite of their limited amount of public finance. - Highlights: •Assess the effectiveness of instruments for promoting financing for OGRE projects. •A three-dimension assessment framework: feasibility, sustainability, replicability. •Use online surveys and the Delphi method to collect experts’ assessment. •The most effective instruments: local engagement, loan guarantee, and start-up grant.

  1. Assessment of open operative vascular surgical experience among general surgery residents.

    Science.gov (United States)

    Krafcik, Brianna M; Sachs, Teviah E; Farber, Alik; Eslami, Mohammad H; Kalish, Jeffrey A; Shah, Nishant K; Peacock, Matthew R; Siracuse, Jeffrey J

    2016-04-01

    General surgeons have traditionally performed open vascular operations. However, endovascular interventions, vascular residencies, and work-hour limitations may have had an impact on open vascular surgery training among general surgery residents. We evaluated the temporal trend of open vascular operations performed by general surgery residents to assess any changes that have occurred. The Accreditation Council for Graduate Medical Education's database was used to evaluate graduating general surgery residents' cases from 1999 to 2013. Mean and median case volumes were analyzed for carotid endarterectomy, open aortoiliac aneurysm repair, and lower extremity bypass. Significance of temporal trends were identified using the R(2) test. The average number of carotid endarterectomies performed by general surgery residents decreased from 23.1 ± 14 (11.6 ± 9 chief, 11.4 + 10 junior) cases per resident in 1999 to 10.7 ± 9 (3.4 ± 5 chief, 7.3 ± 6 junior) in 2012 (R(2) = 0.98). Similarly, elective open aortoiliac aneurysm repairs decreased from 7.4 ± 5 (4 ± 4 chief, 3.4 ± 4 junior) in 1999 to 1.3 ± 2 (0.4 ± 1 chief, 0.8 ± 1 junior) in 2012 (R(2) = 0.98). The number of lower extremity bypasses decreased from 21 ± 12 (9.5 ± 7 chief, 11.8 ± 9 junior) in 1999 to 7.6 ± 2.6 (2.4 ± 1.3 chief, 5.2 + 1.8 junior) in 2012 (R(2) = 0.94). Infrapopliteal bypasses decreased from 8.1 ± 3.8 (3.5 ± 2.2 chief, 4.5 ± 2.9 junior) in 2001 to 3 ± 2.2 (1 ± 1.6 chief, 2 ± 1.6 junior) in 2012 (R(2) = 0.94). General surgery resident exposure to open vascular surgery has significantly decreased. Current and future graduates may not have adequate exposure to open vascular operations to be safely credentialed to perform these procedures in future practice without advanced vascular surgical training. Copyright © 2016 Society for Vascular Surgery. Published by Elsevier Inc. All rights reserved.

  2. Pediatric resident and faculty attitudes toward self-assessment and self-directed learning: a cross-sectional study.

    Science.gov (United States)

    Li, Su-Ting T; Favreau, Michele A; West, Daniel C

    2009-04-13

    The development of self-assessment and self-directed learning skills is essential to lifelong learning and becoming an effective physician. Pediatric residents in the United States are now required to use Individualized Learning Plans (ILPs) to document self-assessment and self-directed learning. A better understanding of resident and faculty attitudes and skills about self-assessment and self-directed learning will allow more successful integration of lifelong learning into residency education. The objective of this study was to compare faculty and resident attitudes, knowledge and skills about self-assessment, self-directed learning and ILPs. Survey of pediatric residents and faculty at a single institution. Respondents rated their attitudes, knowledge, and self-perceived skills surrounding self-assessment, self-directed learning and ILPs. Overall survey response rate was 81% (79/97); 100% (36/36) residents and 70% (43/61) faculty. Residents and faculty agreed that lifelong learning is a necessary part of being a physician. Both groups were comfortable with assessing their own strengths and weaknesses and developing specific goals to improve their own performance. However, residents were less likely than faculty to continuously assess their own performance (44% vs. 81%; p direct their own learning (53% vs. 86%; p directing their own learning (64% vs. 19%; p self-directed learner (50% vs. 83%; p = 0.04).Qualitative comments indicated that while ILPs have the potential to help learners develop individualized, goal-directed learning plans based on strengths and weaknesses, successful implementation will require dedicated time and resident and faculty development. These findings suggest that training and experience are necessary for physicians to understand the role of self-directed learning in education. Deliberate practice, for example by requiring residents to use ILPs, may facilitate self-directed, lifelong learning.

  3. Media Lityeracy of Teachers: An Instrument for Assessing Their Competence

    Directory of Open Access Journals (Sweden)

    Vicent Gozálvez Pérez

    2014-10-01

    Full Text Available This article describes the process to elaborate and validate a survey that aims to identify and evaluate the media literacy level of non-university teachers.Currently, in a highly connected environment where media and communication technologies are increasingly relevant in the educational scope, it is essential to design an instrument that allows us to measure teachers media literacy level. This survey may support the enhancement of pedagogical proposals in order to improve teachers practice as well as teacher professional training. To validate the survey content, Delphi methodology was used by experts of seven Spanish universities. Converging validation has been done on the basis of a sample of 906 teachers from nine Spanish Autonomous Communities. The conclusion after survey psychometric analysis is that this instrument is adequate to measure media literacy level of non-university teachers.

  4. Communication skills training in surgical residency: a needs assessment and metacognition analysis of a difficult conversation objective structured clinical examination.

    Science.gov (United States)

    Falcone, John L; Claxton, René N; Marshall, Gary T

    2014-01-01

    The objective structured clinical examination (OSCE) can be used to evaluate the Accreditation Council for Graduate Medical Education Core Competencies of Professionalism and Interpersonal and Communication Skills. The aim of this study was to describe general surgery resident performance on a "difficult conversation" OSCE. In this prospective study, junior and senior residents participated in a 2-station OSCE. Junior stations involved discussing operative risks and benefits and breaking bad news. Senior stations involved discussing goals of care and discussing transition to comfort measures only status. Residents completed post-OSCE checklist and Likert-based self-evaluations of experience, comfort, and confidence. Trained standardized patients (SPs) evaluated residents using communication skill-based checklists and Likert-based assessments. Pearson correlation coefficients were determined between self-assessment and SP assessment. Mann-Whitney U tests were conducted between junior and senior resident variables, using α = 0.05. There were 27 junior residents (age 28.1 ± 1.9 years [29.6% female]) and 27 senior residents (age 32.1 ± 2.5 years [26.9% female]). The correlation of self-assessment and SP assessment of overall communication skills by junior residents was -0.32 on the risks and benefits case and 0.07 on the breaking bad news case. The correlation of self-assessment and SP assessment of overall communication skills by senior residents was 0.30 on the goals of care case and 0.26 on the comfort measures only case. SP assessments showed that junior residents had higher overall communication skills than senior residents (p = 0.03). Senior residents perceived that having difficult conversations was more level appropriate (p skills are correlated, and that skills-based training is needed across all residency levels. This well-received method may be used to observe, document, and provide resident feedback for these important skills. © 2014 Published by

  5. Development of an instrument to assess learning strategies.

    Science.gov (United States)

    Chissom, B; Iran-Nejad, A

    1992-12-01

    Items to measure learning strategies were extracted from students' written narratives about their study and learning habits. A resulting 79-item instrument was administered to 321 graduate and undergraduate students. From factor analysis of the correlation matrix four factors were identified: (I) reflective metacognition, (II) procedural metacognition, (III) rote memorization, and (IV) procrastination. There were significant positive correlations between GPA and Factors I and II and a significant negative correlation between Factor IV and GPA.

  6. MODERN TECHNIQUES OF CERVICAL INSTRUMENTATION IN IMMATURE SKELETON: VIABILITY ASSESSMENT

    Directory of Open Access Journals (Sweden)

    Ayrana Soares Aires

    Full Text Available ABSTRACT Objective: This study describes the use of materials for modern cervical instrumentation, evaluating its viability in children and adolescents, and the techniques used in different cases. The efficacy of the techniques was analyzed through improvement of pain, maintenance of cervical range of motion, recovery of craniocervical stability, bone consolidation, and spinal stenosis in the postoperative follow-up. Method: Retrospective study of the clinical and radiological parameters of 27 patients aged two to 16 years with cervical spine diseases. Results: Two patients had chronic dislocation in C1-C2, one had congenital axis spondylolisthesis, two had congenital dislocation in C1-C2, three had tumors, one had kyphosis after laminectomy, one had post-infection kyphosis, one had fracture, 11 were syndromic with instabilities, and five had congenital cervical scoliosis. As to surgical approaches, two patients were transorally operated, three by anterior approach, 15 by posterior approach, two by anterior and posterior approaches, and five were treated in three stages (anterior, posterior and anterior approaches. Regarding the technique of cervical stabilization, seven patients were treated by Goel-Harms technique, two received Goel’s facet distraction, and three, Wright translaminar screws. There were complications in four cases. Two patients in the instrumentation of C1 lateral mass due to poor positioning, one with cerebrospinal fluid fistula and one with surgical wound infection. Conclusion: Modern cervical instrumentation in pediatric patients is a safe and effective technique for the treatment of cervical instability.

  7. The effects of self-assessment and supervisor feedback on residents' patient-education competency using videoed outpatient consultations

    NARCIS (Netherlands)

    Wouda, Jan C.; van de Wiel, Harry B. M.

    2014-01-01

    Objectives: To determine the effects of residents' communication self-assessment and supervisor feedback on residents' communication-competency awareness, on their patient-education competency, and on their patients' opinion. Methods: The program consisted of the implementation of a communication

  8. Adequacy of Antidepressant Treatment by Psychiatric Residents: The Antidepressant Treatment History Form as a Possible Assessment Tool

    Science.gov (United States)

    Dew, Rachel Elizabeth; Kramer, Stephen I.; McCall, W. Vaughn

    2005-01-01

    Objective: Facility in psychopharmacology is a major goal of psychiatric residency. This study assesses the adequacy of pharmacotherapy provided to depressed patients in a resident clinic. Methods: Charts of all 285 patients seen in an outpatient triage clinic during 2000 were reviewed. One hundred twelve patients had diagnoses of major…

  9. Process Skill Assessment Instrument: Innovation to measure student’s learning result holistically

    Science.gov (United States)

    Azizah, K. N.; Ibrahim, M.; Widodo, W.

    2018-01-01

    Science process skills (SPS) are very important skills for students. However, the fact that SPS is not being main concern in the primary school learning is undeniable. This research aimed to develop a valid, practical, and effective assessment instrument to measure student’s SPS. Assessment instruments comprise of worksheet and test. This development research used one group pre-test post-test design. Data were obtained with validation, observation, and test method to investigate validity, practicality, and the effectivenss of the instruments. Results showed that the validity of assessment instruments is very valid, the reliability is categorized as reliable, student SPS activities have a high percentage, and there is significant improvement on student’s SPS score. It can be concluded that assessment instruments of SPS are valid, practical, and effective to be used to measure student’s SPS result.

  10. Instruments to assess self-care among healthy children: A systematic review of measurement properties.

    Science.gov (United States)

    Urpí-Fernández, Ana-María; Zabaleta-Del-Olmo, Edurne; Montes-Hidalgo, Javier; Tomás-Sábado, Joaquín; Roldán-Merino, Juan-Francisco; Lluch-Canut, María-Teresa

    2017-12-01

    To identify, critically appraise and summarize the measurement properties of instruments to assess self-care in healthy children. Assessing self-care is a proper consideration for nursing practice and nursing research. No systematic review summarizes instruments of measurement validated in healthy children. Psychometric review in accordance with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) panel. MEDLINE, CINAHL, PsycINFO, Web of Science and Open Grey were searched from their inception to December 2016. Validation studies with a healthy child population were included. Search was not restricted by language. Two reviewers independently assessed the methodological quality of included studies using the COSMIN checklist. Eleven studies were included in the review assessing the measurement properties of ten instruments. There was a maximum of two studies per instrument. None of the studies evaluated the properties of test-retest reliability, measurement error, criterion validity and responsiveness. Internal consistency and structural validity were rated as "excellent" or "good" in four studies. Four studies were rated as "excellent" in content validity. Cross-cultural validity was rated as "poor" in the two studies (three instruments) which cultural adaptation was carried out. The evidence available does not allow firm conclusions about the instruments identified in terms of reliability and validity. Future research should focus on generate evidence about a wider range of measurement properties of these instruments using a rigorous methodology, as well as instrument testing on different countries and child population. © 2017 John Wiley & Sons Ltd.

  11. Developing Instrumentation for Assessing Creativity in Engineering Design

    Science.gov (United States)

    Denson, Cameron D.; Buelin, Jennifer K.; Lammi, Matthew D.; D'Amico, Susan

    2015-01-01

    A perceived inability to assess creative attributes of students' work has often precluded creativity instruction in the classroom. The Consensual Assessment Technique (CAT) has shown promise in a variety of domains for its potential as a valid and reliable means of creativity assessment. Relying upon an operational definition of creativity and a…

  12. Attention to gender in communication skills assessment instruments in medical education: a review.

    Science.gov (United States)

    Dielissen, Patrick; Bottema, Ben; Verdonk, Petra; Lagro-Janssen, Toine

    2011-03-01

    Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. In 2009 at Radboud University Nijmegen Medical Centre, an online search was conducted in the bibliographic databases PubMed, PsycINFO and ERIC for references about communication skills assessment instruments designed to be completed by trained faculty staff and used in medical education. The search strategy used the following search terms: 'consultation skills'; 'doctor-patient communication'; 'physician-patient relations'; 'medical education'; 'instruments'; 'measurement', and 'assessment'. Papers published between January 1999 and June 2009 were included. The assessment instruments identified were analysed for gender-specific content. The search yielded 21 communication skills assessment instruments. Only two of the 17 checklists obtained explicitly considered gender as a communication-related issue. Only six of 21 manuals considered gender in any way and none gave specific details to explain which aspects of communication behaviour should be assessed with regard to gender. Very few communication assessment instruments in medical education focus on gender. Nevertheless, interest exists in using gender in communication skills assessment. The criteria for and purpose of assessing gender in communication skills in medical education are yet to be clarified. © Blackwell Publishing Ltd 2011.

  13. A simple framework for assessing technical skills in a resident observed structured clinical examination (OSCE): vaginal laceration repair.

    Science.gov (United States)

    Winkel, Abigail Ford; Lerner, Veronica; Zabar, Sondra R; Szyld, Demian

    2013-01-01

    Educators of trainees in procedure-based specialties need focused assessment tools that are valid, objective, and assess technical skills in a realistic context. A framework for hybrid assessment using standardized patient scenarios and bench skills testing might facilitate evaluation of competency. Seven PGY-1 obstetrics and gynecology residents participated in a hybrid assessment that used observed structured clinical examination (OSCE) by a standardized patient who had sustained a vaginal laceration during vaginal delivery. The residents elicited a history and counseled the patient, and then completed a laceration repair on a pelvic model. The residents were rated on their performance in the scenario, which included issues of cultural competency, rapport-building, patient counseling. The technical skills were videotaped and rated using a modified global assessment form by 2 faculty members on a 3-point scale from "not done" to "partly done" to "well-done." Residents also completed a subjective assessment of the station. Mean technical performance of the residents on the technical skills was 55% "well-done," with a range of 20%-90%. The assessment identified 3 residents as below the mean, and 1 resident with areas of deficiency. Subjective assessment by the residents was that juggling the technical, cognitive, and affective components of the examination was challenging. Technical skills can be included in a case-based assessment using scenarios that address a range of cognitive and affective skills required of physicians. Results may help training programs assess individuals' abilities as well as identify program needs for curricular improvement. This framework might be useful in setting standards for competency and identifying poor performers. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  14. Developing formative authentic assessment instruments based on learning trajectory for elementary school

    Directory of Open Access Journals (Sweden)

    Anesa Surya

    2016-06-01

    Full Text Available This research aims to (1 develop research formative authentic assessment instruments based on learning trajectory that is eligible for the fourth grade students of elementary schools; and (2 develop formative authentic assessment instruments based on learning trajectory that is effective for the fourth grade students of elementary schools. This developmental study refers to the model developed by Borg & Gall. The developmental design was grouped into four development procedures, consisting of: (a Exploration, (b development of the draft/prototype, (c product testing and revisions, and (d final validation. The experimental subjects are some pilot project elementary schools which used Curriculum 2013 in Ngawi Regency. The data were collected using interview guides, documentation, assessment sheets of the product instrument of authentic assessment, observation sheets of the students, achievement test, questionnaire responses of teachers and students. The data of the instrument reliability were analyzed in terms of item discrimination and item difficulty, and the agreement index was employed for the reliability of the instrument. The research finding reveals that the research instrument in terms of attitude assessment, assessment of knowledge and skills according to subject-matter experts and experts in evaluation is categorized as ‘very good’. The results of the item discrimination analysis show that nonnegative and item difficulties  range from easy to hard. The formative authentic assessment instruments are categorized as ‘reliable’ by the agreement index of ≥ 0.75.

  15. A systematic review of instruments to assess organizational readiness for knowledge translation in health care.

    Directory of Open Access Journals (Sweden)

    Marie-Pierre Gagnon

    Full Text Available The translation of research into practices has been incomplete. Organizational readiness for change (ORC is a potential facilitator of effective knowledge translation (KT. However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc. up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments.We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69% of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University -ORC (TCU-ORC scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University - Director version (TCU-ORC-D, reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19% instruments.Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its

  16. Micro-dosemeter instrument (MIDN) for assessing risk in space

    International Nuclear Information System (INIS)

    Pisacane, V. L.; Dolecek, Q. E.; Malak, H.; Cucinotta, F. A.; Zaider, M.; Rosenfeld, A. B.; Rusek, A.; Sivertz, M.; Dicello, J. F.

    2011-01-01

    Radiation in space generally produces higher dose rates than that on the Earth's surface, and contributions from primary galactic and solar events increase with altitude within the magnetosphere. Presently, no personnel monitor is available to astronauts for real-time monitoring of dose, radiation quality and regulatory risk. This group is developing a prototypic instrument for use in an unknown, time-varying radiation field. This micro-dosemeter-dosemeter nucleon instrument is for use in a space-suit, spacecraft, remote rover and other applications. It provides absorbed dose, dose rate and dose equivalent in real time so that action can be taken to reduce exposure. Such a system has applications in health physics, anti-terrorism and radiation-hardening of electronics as well. The space system is described and results of ground-based studies are presented and compared with predictions of transport codes. An early prototype in 2007 was successfully launched, the only solid-state micro-dosemeter to have flown in space. Published by Oxford Univ. Press on behalf of the US Government 2011. (authors)

  17. Aging assessment of reactor instrumentation and protection system components

    International Nuclear Information System (INIS)

    Gehl, A.C.; Hagen, E.W.

    1992-07-01

    A study of the aging-related operating experiences throughout a five-year period (1984--1988) of six generic instrumentation modules (indicators, sensors, controllers, transmitters, annunciators, and recorders) was performed as a part of the Nuclear Plant Aging Research Program. The effects of aging from operational and environmental stressors were characterized from results depicted in Licensee Event Reports (LERs). The data are graphically displayed as frequency of events per plant year for operating plant ages from 1 to 28 years to determine aging-related failure trend patterns. Three main conclusions were drawn from this study: (1) Instrumentation and control (I ampersand C) modules make a modest contribution to safety-significant events: 17% of LERs issued during 1984--1988 dealt with malfunctions of the six I ampersand C modules studied, and 28% of the LERs dealing with these I ampersand C module malfunctions were aging related (other studies show a range 25--50%); (2) Of the six modules studied, indicators, sensors, and controllers account for the bulk (83%) of aging-related failures; and (3) Infant mortality appears to be the dominant aging-related failure mode for most I ampersand C module categories (with the exception of annunciators and recorders, which appear to fail randomly)

  18. Validity of evaluation instrument on the implementation of performance assessment to measure science process skills

    Directory of Open Access Journals (Sweden)

    Marina Ramadani

    2017-10-01

    Full Text Available This study aims to develop an evaluation instrument CIPP (context, input, process, product model that suitable at implementation of performance assessment instrument to measure students' science process skills of junior high school. Methods in this study are research and development (R & D which is adopted by model Borg & Gall model. This evaluation instrument used one of evaluation CIPP model with context, input, process, and product components. The evaluation instrument is used to determine the implementation of performance assessment instrument to measure junior high school students' science process skills in excretion system topic. This development study involves some experts to give validation of the development of feasibility products. Experts involved, they are two lecturers of evaluation expert, two junior high school science teachers, and four peers. The validity of evaluation instruments was analyzed using V'aiken formula. The results of this study are evaluation instrument of CIPP model of the implementation of performance assessment to measure junior high school students' science process skills of grade VIII in excretion system topic. The results of the validity of this product indicates that this evaluation instruments are eligible in using with V'eiken coefficient of 0.86. It indicates that the evaluation instruments are valid in substance, construction, and language aspects.

  19. WATCH: Warwick Assessment insTrument for Clinical teacHing: Development and testing.

    Science.gov (United States)

    Haider, Sonia Ijaz; Johnson, Neil; Thistlethwaite, Jill Elizabeth; Fagan, Gay; Bari, Muhammad Furqan

    2015-03-01

    Medical education and teaching skills are core competencies included in the generic curriculum for specialty training. To support the development of these skills, there is need for a validated instrument. This study aims to develop and test an instrument to measure the attributes of specialty trainees as effective teachers. The study was conducted in two phases. In first phase, the content of the instrument was generated from the literature and tested using the Delphi technique. In second phase, the instrument was field tested for validity and reliability using factor analysis and generalizability study. Feasibility was calculated by the time taken to complete the instrument. Acceptability and educational impact were determined by qualitative analysis of written feedback. Attributes of specialty trainees were assessed by clinical supervisors, peers, and students. The Delphi study produced consensus on 15 statements which formed the basis of the instrument. In field study, a total of 415 instruments were completed. Factor analysis demonstrated a three-factor solution ('learning-teaching milieu', 'teaching skills', and 'learner-orientated'). A generalizability coefficient was 0.92. Mean time to complete the instrument was five minutes. Feedback indicated that it was an acceptable and useful method of assessment. This new instrument provides valid, reliable, feasible, and acceptable assessment of clinical teaching.

  20. [Recovery Self Assessment: Translation and cultural adaption of a recovery oriented assessment instrument].

    Science.gov (United States)

    Zuaboni, Gianfranco; Degano Kieser, Luciana; Kozel, Bernd; Glavanovits, Katharina; Utschakowski, Jörg; Behrens, Johann

    2015-08-01

    The recovery approach is becoming increasingly important in mental health services and research. In English-speaking countries, its practical implementation as well as the scientific discussion is far more advanced. To support the approach, assessment instruments are required. A widespread and recognised tool is the Recovery Self Assessment Scale {RSA}. This includes four versions of a questionnaire, which cover the perspectives of users, providers, family members and management. In this article, the development of the instrument and the system atictranslation process are presented. Two independent research groups applied different translation. The Swiss research group {AGS} used the ISOPR principles, the German research group (AGN} the Guidelines of the European Social Survey Programme for survey translations TRAPD. The methods differ in the fact,that TRAPD uses focus groups. The results of both groups were combined by means of a consensus process. Within the translation and cultural adjustment of the RSA-D, the the oretical framework of the RSA as well as the transferability into the German speaking context has been ensured. Before the RSA-D c~n beused in practice and research, further studies towards psychometric testing should be conducted.

  1. Defining competencies for the practice of telepsychiatry through an assessment of resident learning needs.

    Science.gov (United States)

    Crawford, Allison; Sunderji, Nadiya; López, Jenna; Soklaridis, Sophie

    2016-01-26

    A foundational assessment of learning needs is missing from previous reports of telepsychiatry curricula. We used an in-depth needs assessment to identify specific skills required for the practice of effective telepsychiatry, and provide an evidence base to guide the development of telepsychiatry curricula in postgraduate psychiatry training. Many of these skills set telepsychiatry apart from practice in traditional face-to-face clinical settings, or result from adaptations to clinical practice to meet the needs of a telepsychiatry interface in patient care. We used a qualitative, modified grounded theory approach to gain insight into areas of importance for telepsychiatry training in postgraduate psychiatry residency. 16 interviews of faculty and residents (9 and 7 interviews, respectively), allowed participants to reflect on their experiences in telepsychiatry. Data were then thematically analyzed. Interview respondents identified important aspects of the context for telepsychiatry training; the skills required to competently practice telepsychiatry; and the desired teaching and learning methods for acquiring these skills. Specific domains of competency were identified: technical skills; assessment skills; relational skills and communication; collaborative and interprofessional skills; administrative skills; medico-legal skills; community psychiatry and community-specific knowledge; cultural psychiatry skills, including knowledge of Indigenous cultures; and, knowledge of health systems. The skills identified in this study map well to competency- based medical education frameworks. Telepsychiatry is increasingly being adopted as a solution to health systems problems such as regional disparities in access to care, and it requires explicit competency development. Ensuring adequate and quality exposure to telepsychiatry during residency training could positively impact our health systems and health equity.

  2. Development and validation of an instrument to assess perceived social influence on health behaviors

    Science.gov (United States)

    HOLT, CHERYL L.; CLARK, EDDIE M.; ROTH, DAVID L.; CROWTHER, MARTHA; KOHLER, CONNIE; FOUAD, MONA; FOUSHEE, RUSTY; LEE, PATRICIA A.; SOUTHWARD, PENNY L.

    2012-01-01

    Assessment of social influence on health behavior is often approached through a situational context. The current study adapted an existing, theory-based instrument from another content domain to assess Perceived Social Influence on Health Behavior (PSI-HB) among African Americans, using an individual difference approach. The adapted instrument was found to have high internal reliability (α = .81–.84) and acceptable testretest reliability (r = .68–.85). A measurement model revealed a three-factor structure and supported the theoretical underpinnings. Scores were predictive of health behaviors, particularly among women. Future research using the new instrument may have applied value assessing social influence in the context of health interventions. PMID:20522506

  3. Instruments for the assessment of suicide risk: A systematic review evaluating the certainty of the evidence.

    Directory of Open Access Journals (Sweden)

    Bo Runeson

    Full Text Available Instruments have been developed to facilitate suicide risk assessment. We aimed to evaluate the evidence for these instruments including assessment of risk of bias and diagnostic accuracy for suicide and suicide attempt.PubMed (NLM, PsycInfo, Embase, Cinahl and the Cochrane Library databases were searched until December 2014. We assessed risk of bias with QUADAS-2. The average sensitivity and specificity of each instrument was estimated and the certainty of the evidence was assessed with GRADE. We considered instruments with a sensitivity > 80% and a specificity > 50% to have sufficient diagnostic accuracy.Thirty-five relevant studies were identified but 14 were considered to have high risk of bias, leaving 21 studies evaluating altogether 15 risk assessment instruments. We could carry out meta-analyses for five instruments. For the outcome suicide attempt SAD PERSONS Scale had a sensitivity of 15% (95% CI 8-24 and specificity of 97% (96-98, and the Manchester Self-Harm Rule (MSHR a sensitivity of 97% (97-97 and a specificity of 20% (20-21. ReACT, which is a modification of MSHR, had a similar low specificity, as did the Sodersjukhuset Self Harm Rule. For the outcome suicide, the Beck Hopelessness Scale had a sensitivity of 89% (78-95 and specificity of 42% (40-43.Most suicide risk assessment instruments were supported by too few studies to allow for evaluation of accuracy. Among those that could be evaluated, none fulfilled requirements for sufficient diagnostic accuracy.

  4. Development of Assessment Instrument of Critical Thinking in Physics at Senior High School

    Science.gov (United States)

    Sugiarti, T.; Kaniawati, I.; Aviyanti, L.

    2017-02-01

    The result of preliminary study shows that the assessment of physics in school did not train students’ critical thinking skill. The assessment instrument just measured low cognitive aspects. Supposedly, critical thinking skill is trained in the assessment activity. The study aims to determine the characteristics and the quality of critical thinking skill instrument. It employs descriptive-qualitative method with research and development as the research design. The research participants are 35 students involved in the limited trial and 188 students in the wider trial from three public senior high school in Ciamis which in high level school. The data was collected through expert validation, tests and interviews. The results indicate that the characteristics of the assessment instrument of critical thinking skill is open-ended. The instrument fulfills some indicators namely analyzing argument, deduction, induction, and display information in the form of scenario, text, graphic and table. In addition, the data processing through V4 Anates program shows that the instrument reliability achieves 0.67 with high interpretation of 0.67 and the validity is 0.47 with enough interpretation. Thus, the assessment instrument of critical thinking skill in the form of open-ended essay meets the criteria of quality test, so it can use as instrument of assessment critical thinking skill.

  5. A systematic review on assessment instruments for dementia in persons with intellectual disabilities.

    Science.gov (United States)

    Zeilinger, Elisabeth L; Stiehl, Katharina A M; Weber, Germain

    2013-11-01

    This work describes an extensive systematic literature review on assessment instruments for dementia in persons with intellectual disability (ID). Existing instruments for the detection of dementia in persons with ID were collected and described systematically. This allows a direct and quick overview of available tools. Additionally, it contributes to the availability and usability of information about these instruments, thus enhancing further developments in this field. A systematic literature search in five databases (CINAHL, PsycInfo, PubMed, Scopus, and Web of Science) was conducted. In order to include gray literature an invisible college approach was used. Relevant studies were identified and selected using defined inclusion and exclusion criteria. After the selection process all instruments were coded and classified. It was determined which concepts they assess, whether they were especially developed or adapted for persons with ID, and whether they were designed to assess dementia. The selection of relevant papers, as well as the coding of instruments was done independently by two researchers. In total, 97 records met the search criteria. Out of these, 114 different instruments were extracted. There were 79 instruments to be completed by the person with ID, and 35 informant-based instruments. Additionally, four test batteries were found. Some of these instruments were neither designed for the assessment of dementia, nor for persons with ID. There are a variety of different tools used for the assessment of dementia in ID. Nevertheless, an agreed-upon approach or instrument is missing. Establishing this would improve the quality of assessment in clinical practice, and benefit research. Data collected would become comparable and combinable, and allow research to have more informative value. Copyright © 2013 Elsevier Ltd. All rights reserved.

  6. The validity and reliability of an instrument to assess nursing competencies in spiritual care

    NARCIS (Netherlands)

    Leeuwen, R.R.; Tiesinga, L.J.; Middel, L.J.; Post, D.; Jochemsen, H.

    2009-01-01

    Aim. This study contributes to the development of a valid and reliable instrument, the spiritual care competence scale, as an instrument to assess nurses’ competencies in providing spiritual care. Background. Measuring these competencies and their development is important and the construction of a

  7. The validity and reliability of an instrument to assess nursing competencies in spiritual care

    NARCIS (Netherlands)

    van Leeuwen, Rene; Tiesinga, Lucas J.; Middel, Berrie; Post, Doeke; Jochemsen, Henk

    2009-01-01

    Aim. This study contributes to the development of a valid and reliable instrument, the spiritual care competence scale, as an instrument to assess nurses' competencies in providing spiritual care. Background. Measuring these competencies and their development is important and the construction of a

  8. Development and Validation of an Instrument to Assess Youth Motivation to Participate in Career Development Events

    Science.gov (United States)

    Knobloch, Neil A.; Brady, Colleen M.; Orvis, Kathryn S.; Carroll, Natalie J.

    2016-01-01

    Career development events develop career and life skills in youth, but limited work has been done to assess the motivation of students who participate in these events. The purpose of this study was to validate an instrument developed to measure youth motivation to participate in career development events. An instrument grounded in expectancy-value…

  9. Developing evaluation instrument based on CIPP models on the implementation of portfolio assessment

    Science.gov (United States)

    Kurnia, Feni; Rosana, Dadan; Supahar

    2017-08-01

    This study aimed to develop an evaluation instrument constructed by CIPP model on the implementation of portfolio assessment in science learning. This study used research and development (R & D) method; adapting 4-D by the development of non-test instrument, and the evaluation instrument constructed by CIPP model. CIPP is the abbreviation of Context, Input, Process, and Product. The techniques of data collection were interviews, questionnaires, and observations. Data collection instruments were: 1) the interview guidelines for the analysis of the problems and the needs, 2) questionnaire to see level of accomplishment of portfolio assessment instrument, and 3) observation sheets for teacher and student to dig up responses to the portfolio assessment instrument. The data obtained was quantitative data obtained from several validators. The validators consist of two lecturers as the evaluation experts, two practitioners (science teachers), and three colleagues. This paper shows the results of content validity obtained from the validators and the analysis result of the data obtained by using Aikens' V formula. The results of this study shows that the evaluation instrument based on CIPP models is proper to evaluate the implementation of portfolio assessment instruments. Based on the experts' judgments, practitioners, and colleagues, the Aikens' V coefficient was between 0.86-1,00 which means that it is valid and can be used in the limited trial and operational field trial.

  10. The development of a self-assessment learning style instrument for ...

    African Journals Online (AJOL)

    A process of analysing existing instruments and adaptation was used to construct a new self-assessment learning-style instrument, based on the Kolb model of experiential learning, which should be used by all students and educators in order to improve the quality of teaching and learning. It is further recommended that the ...

  11. Vocational Education Students' Generic Working Life Competencies: Developing a Self-Assessment Instrument

    Science.gov (United States)

    Kyndt, Eva; Janssens, Ine; Coertjens, Liesje; Gijbels, David; Donche, Vincent; Van Petegem, Peter

    2014-01-01

    The current study reports on the process of developing a self-assessment instrument for vocational education students' generic working life competencies. The instrument was developed based on a competence framework and in close collaboration with several vocational education teachers and intermediary organisations offering various human…

  12. In vitro assessment of cutting efficiency and durability of zirconia removal diamond rotary instruments.

    Science.gov (United States)

    Kim, Joon-Soo; Bae, Ji-Hyeon; Yun, Mi-Jung; Huh, Jung-Bo

    2017-06-01

    Recently, zirconia removal diamond rotary instruments have become commercially available for efficient cutting of zirconia. However, research of cutting efficiency and the cutting characteristics of zirconia removal diamond rotary instruments is limited. The purpose of this in vitro study was to assess and compare the cutting efficiency, durability, and diamond rotary instrument wear pattern of zirconia diamond removal rotary instruments with those of conventional diamond rotary instruments. In addition, the surface characteristics of the cut zirconia were assessed. Block specimens of 3 mol% yttrium cation-doped tetragonal zirconia polycrystal were machined 10 times for 1 minute each using a high-speed handpiece with 6 types of diamond rotary instrument from 2 manufacturers at a constant force of 2 N (n=5). An electronic scale was used to measure the lost weight after each cut in order to evaluate the cutting efficiency. Field emission scanning electron microscopy was used to evaluate diamond rotary instrument wear patterns and machined zirconia block surface characteristics. Data were statistically analyzed using the Kruskal-Wallis test, followed by the Mann-Whitney U test (α=.05). Zirconia removal fine grit diamond rotary instruments showed cutting efficiency that was reduced compared with conventional fine grit diamond rotary instruments. Diamond grit fracture was the most dominant diamond rotary instrument wear pattern in all groups. All machined zirconia surfaces were primarily subjected to plastic deformation, which is evidence of ductile cutting. Zirconia blocks machined with zirconia removal fine grit diamond rotary instruments showed the least incidence of surface flaws. Although zirconia removal diamond rotary instruments did not show improved cutting efficiency compared with conventional diamond rotary instruments, the machined zirconia surface showed smoother furrows of plastic deformation and fewer surface flaws. Copyright © 2016 Editorial Council

  13. Training Neurosurgery and Radiation Oncology Residents in Stereotactic Radiosurgery: Assessment Gathered from Participants in AANS and ASTRO Training Course.

    Science.gov (United States)

    Sheehan, Jason; Suh, John H; Kavanagh, Brian; Xu, Zhiyuan; Ren, Lydia; Sheehan, Kimball; Lunsford, L Dade

    2018-01-01

    Stereotactic radiosurgery (SRS) represents an expanding approach for neurosurgeons and radiation oncologists. We evaluate educational gaps of senior residents drawn from each specialty as part of a focused SRS course. We also evaluate the strengths and limitations of SRS training in current residency programs of the course residents and faculty. The American Association of Neurological Surgeons and American Society of Radiation Oncology jointly held a senior resident course in SRS. Residents were nominated by program directors from across the United States. Thirty residents were chosen to participate in the course. The residents were surveyed before and after the course. Faculty (n = 14) were also surveyed to ascertain their perspectives on current training in SRS. Most (96.7%) of the residents planned to perform SRS when finished, and 94% anticipated SRS indications to expand. Regarding SRS technique, 47% reported average/above average understanding of intracranial SRS; only 17% expressed similar understanding of spinal SRS. Before the course, 76.6% noted below average/average ability to recognize and manage SRS complications. Twenty-three percent of the faculty indicated that graduating residents from their programs were unprepared to perform radiosurgery. Residents' self-assessed understanding of brain SRS indication (P = 0.000693), SRS techniques (P = 0.000021), spinal SRS indications (P = 0.000050), spinal SRS techniques (P = 0.000019), and complication recognition and management (P = 0.00033) significantly improved following the course. Knowledge and training gaps in SRS appear evident to the senior residents and faculty of both specialties. We believe that other educational opportunities for SRS experience are necessary to optimize clinical competency, as well as meet future clinical staffing needs for this expanding, multidisciplinary approach. Further evaluation of gaps in SRS is necessary through a larger, nationwide survey of U.S. neurosurgeons

  14. An online spaced-education game to teach and assess residents: a multi-institutional prospective trial.

    Science.gov (United States)

    Kerfoot, B Price; Baker, Harley

    2012-03-01

    While games are frequently used in resident education, there is little evidence supporting their efficacy. We investigated whether a spaced-education (SE) game can be both a reliable and valid method of assessing residents' knowledge and an effective means of teaching core content. The SE game consisted of 100 validated multiple-choice questions and explanations on core urology content. Residents were sent 2 questions each day via email. Adaptive game mechanics re-sent the questions in 2 or 6 weeks if answered incorrectly and correctly, respectively. Questions expired if not answered on time (appointment dynamic). Residents retired questions by answering each correctly twice in a row (progression dynamic). Competition was fostered by posting relative performance among residents. Main outcomes measures were baseline scores (percentage of questions answered correctly on initial presentation) and completion scores (percentage of questions retired). Nine hundred thirty-one US and Canadian residents enrolled in the 45-week trial. Cronbach alpha reliability for the SE baseline scores was 0.87. Baseline scores (median 62%, interquartile range [IQR] 17%) correlated with scores on the 2008 American Urological Association in-service examination (ISE08), 2009 American Board of Urology qualifying examination (QE09), and ISE09 (r = 0.76, 0.46, and 0.64, respectively; all p games. An SE game is a reliable and valid means to assess residents' knowledge and is a well-accepted method by which residents can master core content. Published by Elsevier Inc.

  15. The development of the PARENTS: a tool for parents to assess residents' non-technical skills in pediatric emergency departments.

    Science.gov (United States)

    Moreau, Katherine A; Eady, Kaylee; Tang, Kenneth; Jabbour, Mona; Frank, Jason R; Campbell, Meaghan; Hamstra, Stanley J

    2017-11-14

    Parents can assess residents' non-technical skills (NTS) in pediatric emergency departments (EDs). There are no assessment tools, with validity evidence, for parental use in pediatric EDs. The purpose of this study was to develop the Parents' Assessment of Residents Enacting Non-Technical Skills (PARENTS) educational assessment tool and collect three sources of validity evidence (i.e., content, response process, internal structure) for it. We established content evidence for the PARENTS through interviews with physician-educators and residents, focus groups with parents, a literature review, and a modified nominal group technique with experts. We collected response process evidence through cognitive interviews with parents. To examine the internal structure evidence, we administered the PARENTS and performed exploratory factor analysis. Initially, a 20-item PARENTS was developed. Cognitive interviews led to the removal of one closed-ended item, the addition of resident photographs, and wording/formatting changes. Thirty-seven residents and 434 parents participated in the administration of the resulting 19-item PARENTS. Following factor analysis, a one-factor model prevailed. The study presents initial validity evidence for the PARENTS. It also highlights strategies for potentially: (a) involving parents in the assessment of residents, (b) improving the assessment of NTS in pediatric EDs, and (c) capturing parents' perspectives to improve the preparation of future physicians.

  16. A pilot study of orthopaedic resident self-assessment using a milestones' survey just prior to milestones implementation.

    Science.gov (United States)

    Bradley, Kendall E; Andolsek, Kathryn M

    2016-01-11

    To pilot test if Orthopaedic Surgery residents could self-assess their performance using newly created milestones, as defined by the Accreditation Council on Graduate Medical Education. In June 2012, an email was sent to Program Directors and administrative coordinators of the 154 accredited Orthopaedic Surgery Programs, asking them to send their residents a link to an online survey. The survey was adapted from the Orthopaedic Surgery Milestone Project. Completed surveys were aggregated in an anonymous, confidential database. SAS 9.3 was used to perform the analyses. Responses from 71 residents were analyzed. First and second year residents indicated through self-assessment that they had substantially achieved Level 1 and Level 2 milestones. Third year residents reported they had substantially achieved 30/41, and fourth year residents, all Level 3 milestones. Fifth year, graduating residents, reported they had substantially achieved 17 Level 4 milestones, and were extremely close on another 15. No milestone was rated at Level 5, the maximum possible. Earlier in training, Patient Care and Medical Knowledge milestones were rated lower than the milestones reflecting the other four competencies of Practice Based Learning and Improvement, Systems Based Practice, Professionalism, and Interpersonal Communication. The gap was closed by the fourth year. Residents were able to successfully self-assess using the 41 Orthopaedic Surgery milestones. Respondents' rate improved proficiency over time. Graduating residents report they have substantially, or close to substantially, achieved all Level 4 milestones. Milestone self-assessment may be a useful tool as one component of a program's overall performance assessment strategy.

  17. A pilot study of orthopaedic resident self-assessment using a milestones’ survey just prior to milestones implementation

    Science.gov (United States)

    Bradley, Kendall E.

    2016-01-01

    Objectives To pilot test if Orthopaedic Surgery residents could self-assess their performance using newly created milestones, as defined by the Accreditation Council on Graduate Medical Education.  Methods In June 2012, an email was sent to Program Directors and administrative coordinators of the154 accredited Orthopaedic Surgery Programs, asking them to send their residents a link to an online survey. The survey was adapted from the Orthopaedic Surgery Milestone Project. Completed surveys were aggregated in an anonymous, confidential database. SAS 9.3 was used to perform the analyses. Results Responses from 71 residents were analyzed. First and second year residents indicated through self-assessment that they had substantially achieved Level 1 and Level 2 milestones. Third year residents reported they had substantially achieved 30/41, and fourth year residents, all Level 3 milestones. Fifth year, graduating residents, reported they had substantially achieved 17 Level 4 milestones, and were extremely close on another 15. No milestone was rated at Level 5, the maximum possible.  Earlier in training, Patient Care and Medical Knowledge milestones were rated lower than the milestones reflecting the other four competencies of Practice Based Learning and Improvement, Systems Based Practice, Professionalism, and Interpersonal Communication. The gap was closed by the fourth year. Conclusions Residents were able to successfully self-assess using the 41 Orthopaedic Surgery milestones. Respondents’ rate improved proficiency over time. Graduating residents report they have substantially, or close to substantially, achieved all Level 4 milestones.  Milestone self-assessment may be a useful tool as one component of a program’s overall performance assessment strategy. PMID:26752012

  18. An Assessment Of Bias And Fairness Of The Culture Assessment Instrument

    Directory of Open Access Journals (Sweden)

    Themba J. Nkosi

    2004-11-01

    Full Text Available The aim of this study was to investigate the bias and fairness of the Culture Assessment Instrument (CAI, that is, to assess whether the mean culture scores of different groups (race, gender, age and language discriminate on a total score and an item level. The sample consisted of 4066 respondents from five different companies, originating from various industries. The scores of the 56 CAI-items were factor analysed on two levels, followed by an iterative item analyses. Significant differences between race and language mean scores were identified on a total score and item level. Where differences on an item level were detected, such item-wordings were scrutinized to ensure that they were fair, non-prejudiced and not stereotyping any group. Based on these findings, it was concluded that the CAI in its current form is not biased against any particular group and is therefore fair. OpsommingDie doel van hierdie studie was om die sydigheid en billikheid van die Culture Assessment Instrument (CAI te ondersoek, dit is om te bepaal of gemiddelde kultuurtellings van verskillende groepe (ras, geslag, ouderdom en taal diskrimineer op ’n totaaltelling en itemvlak. Die steekproef het bestaan uit 4066 respondente uit vyf verskillende organisasies, afkomstig uit verskillende bedrywe. Die tellings van die 56 CAI-items is op twee vlakke gefaktoranaliseer, gevolg deur ’n iteratiewe itemontleding. Beduidende verskille tussen gemiddelde tellings van rasen taalgroepe is identifiseer, maar slegs ’n klein proporsie van die variansie kon aan kultuurverskille toegeskryf word. In gevalle waar verskille op itemvlak geïdentifiseer is, is sulke item-bewoordings ondersoek vir billikheid, bevooroordeling en die nie-stereotipering van enige groep. Gebaseer op hierdie bevindinge, is daar tot die gevolgtrekking gekom dat die CAI in sy huidige vorm nie sydig teenoor enige groep is nie en gevolglik billik is.

  19. Self-report family assessment instruments: an evaluative review [see comment].

    Science.gov (United States)

    Halvorsen, J G

    1991-03-01

    Family medicine is challenged to document the impact of family systems on health and physiologic function. For this research investigators must measure family system variables with instruments that are both valid and reliable. In this context, eight self-report measures of total family functioning are reviewed and assessed according to a standardized approach to instrument design. The instruments evaluated include the Family Assessment Device, the Family Assessment Measure, the Family Adaptability and Cohesion Evaluation Scales, the Family Environment Scale, the Family Functioning Index, the Self-Report Family Inventory, the Family APGAR, and the Family Functioning Questionnaire. The analysis indicates two major problems with these instruments. First, there is disagreement on key concepts and definitions. Second, there is inconsistency in design and attention to detail in empirical analysis and psychometic evaluation. Family assessment techniques need further development and remain a fertile research field for family medicine investigation.

  20. Pediatric fractures – an educational needs assessment of Canadian pediatric emergency medicine residents

    Directory of Open Access Journals (Sweden)

    Dixon AC

    2015-06-01

    Full Text Available Andrew C Dixon Department of Pediatrics, University of Alberta, Edmonton, AB, Canada Objectives: To determine the gaps in knowledge of Canadian pediatric emergency medicine residents with regards to acute fracture identification and management. Due to their predominantly medical prior training, fractures may be an area of weakness requiring a specific curriculum to meet their needs. Methods: A questionnaire was developed examining comfort level and performance on knowledge based questions of trainees in the following areas: interpreting musculoskeletal X-rays; independently managing pediatric fractures, physical examination techniques, applied knowledge of fracture management, and normal development of the bony anatomy. Using modified Dillman technique the instrument was distributed to pediatric emergency medicine residents at seven Canadian sites. Results: Out of 43 potential respondents, 22 (51% responded. Of respondents, mean comfort with X-ray interpretation was 69 (62–76 95% confidence interval [CI] while mean comfort with fracture management was only 53 (45–63 95% CI; mean comfort with physical exam of shoulder 60 (53–68 95% CI and knee 69 (62–76 95% CI was low. Less than half of respondents (47%; 95% CI 26%–69% could accurately identify normal wrist development, correctly manage a supracondylar fracture (39%; 95% CI 20%–61%, or identify a medial epicondyle fracture (44%; 95% CI 24%–66%. Comfort with neurovascular status of the upper (mean 82; 95% CI 75–89 and lower limb (mean 81; 95% CI 74–87 was high. Interpretation: There are significant gaps in knowledge of physical exam techniques, fracture identification and management among pediatric emergency medicine trainees. A change in our current teaching methods is required to meet this need. Keywords: pediatric, fractures, education, radiologic interpretation

  1. Advanced reactor instrumentation and control reliability and risk assessment

    International Nuclear Information System (INIS)

    Fullwood, R.; Gunther, W.; Valente, J.; Azarm, M.A.

    1991-01-01

    Advanced nuclear power reactors will used different approaches to achieving a higher level of safety than the first generation. One approach used the technological developments in computation and electronics in the form of digital instrumentation and control (I ampersand C) to enhance the reliability, and accuracy of information for plant control, responding to the information, and controlling the plant and its systems under normal and upset environments in various states of degradation. Evaluating the reliability and safety of advanced I ampersand C systems requires determining the reliability of the I ampersand C used in the advanced reactors which involves distributed processing, data pile-up, interactive systems, the man-machine interface, various forms of automatic control, and systems interactions. From these analyses will come an understanding of the potential of the new I ampersand C, and protection from its vulnerabilities to enhance the safe operation of the new plants. Technological, safety, reliability, and regulatory issues associated with advanced I ampersand C for the new reactors are discussed herein. The issues are presented followed by suggested approaches to their resolution

  2. Review of risk assessment instruments for juvenile sex offenders: What is next?

    NARCIS (Netherlands)

    Hempel, I.S.; Buck, N.M.; Cima, M.; Marle, H.J.C. van

    2013-01-01

    Risk assessment is considered to be a key element in the prevention of recidivism among juvenile sex offenders (JSOs), often by imposing long-term consequences based on that assessment. The authors reviewed the literature on the predictive accuracy of six well-known risk assessment instruments used

  3. Review of risk assessment instruments for juvenile sex offenders : What is next?

    NARCIS (Netherlands)

    Hempel, I.; Buck, N.M.L.; Cima-Knijff, M.J.; van Marle, H.

    2013-01-01

    Risk assessment is considered to be a key element in the prevention of recidivism among juvenile sex offenders (JSOs), often by imposing long-term consequences based on that assessment. The authors reviewed the literature on the predictive accuracy of six well-known risk assessment instruments used

  4. Standardised assessment of patients' capacity to manage medications: a systematic review of published instruments

    Directory of Open Access Journals (Sweden)

    Elliott Rohan A

    2009-07-01

    Full Text Available Abstract Background Older people are commonly prescribed complex multi-drug regimens while also experiencing declines in the cognitive and physical abilities required for medication management, leading to increased risk of medication errors and need for assisted living. The purpose of this study was to review published instruments designed to assess patients' capacity to self-administer medications. Methods Searches of Medline, EMBASE, CINAHL, PsycINFO, International Pharmaceutical Abstracts, Health and Psychosocial Instruments, Google, and reference lists of identified publications were conducted to identify English-language articles describing development and validation of instruments designed to assess patients' capacity to self-administer medications. Methodological quality of validation studies was rated independently against published criteria by two reviewers and reliability and validity data were reviewed. Results Thirty-two instruments were identified, of which 14 met pre-defined inclusion criteria. Instruments fell into two categories: those that used patients' own medications as the basis for assessment and those that used a simulated medication regimen. The quality of validation studies was generally low to moderate and few instruments were subjected to reliability testing. Most instruments had some evidence of construct validity, through associations with tests of cognitive function, health literacy, activities of daily living or measures of medication management or adherence. Only one instrument had sensitivity and specificity data with respect to prediction of medication-related outcomes such as adherence to therapy. Only three instruments had validity data from more than one independent research group. Conclusion A number of performance-based instruments exist to assess patients' capacity to manage their own medications. These may be useful for identifying physical and cognitive barriers to successful medication management, but

  5. Development of the Leadership Influence Self-Assessment (LISA©) instrument.

    Science.gov (United States)

    Shillam, Casey R; Adams, Jeffrey M; Bryant, Debbie Chatman; Deupree, Joy P; Miyamoto, Suzanne; Gregas, Matt

    2017-11-15

    This study aims to describe the development and psychometric evaluation of the Leadership Influence Self-Assessment (LISA©) tool. LISA© was designed to help nurse leaders assess and enhance their influence capacity by measuring influence traits and practices and identifying areas of strength and weakness. Concepts identified in the Adams Influence Model and input from content experts guided the development of 145 items for testing. Administered to 165 nurse leaders, the assessment was subjected to exploratory factor analysis (EFA). EFA yielded a four-factor solution that comprised 80 items. Cronbach's alpha for factors ranged between 0.912 and 0.938. All factor loadings were >0.4; the smallest factor contained 14 items. Items grouped together in the theoretical model also clustered together in the EFA. Preliminary psychometric testing supports validity and reliability of the LISA© and its potential use as a tool to assess influence capacity for purposes of leadership development and research. Copyright © 2017 Elsevier Inc. All rights reserved.

  6. Financial and testamentary capacity evaluations: procedures and assessment instruments underneath a functional approach.

    Science.gov (United States)

    Sousa, Liliana B; Simões, Mário R; Firmino, Horácio; Peisah, Carmelle

    2014-02-01

    Mental health professionals are frequently involved in mental capacity determinations. However, there is a lack of specific measures and well-defined procedures for these evaluations. The main purpose of this paper is to provide a review of financial and testamentary capacity evaluation procedures, including not only the traditional neuropsychological and functional assessment but also the more recently developed forensic assessment instruments (FAIs), which have been developed to provide a specialized answer to legal systems regarding civil competencies. Here the main guidelines, papers, and other references are reviewed in order to achieve a complete and comprehensive selection of instruments used in the assessment of financial and testamentary capacity. Although some specific measures for financial abilities have been developed recently, the same is not true for testamentary capacity. Here are presented several instruments or methodologies for assessing financial and testamentary capacity, including neuropsychological assessment, functional assessment scales, performance based functional assessment instruments, and specific FAIs. FAIs are the only specific instruments intended to provide a specific and direct answer to the assessment of financial capacity based on legal systems. Considering the need to move from a diagnostic to a functional approach in financial and testamentary capacity evaluations, it is essential to consider both general functional examination as well as cognitive functioning.

  7. An assessment of residents' and fellows' personal finance literacy: an unmet medical education need.

    Science.gov (United States)

    Ahmad, Fahd A; White, Andrew J; Hiller, Katherine M; Amini, Richard; Jeffe, Donna B

    2017-05-29

    This study aimed to assess residents' and fellows' knowledge of finance principles that may affect their personal financial health. A cross-sectional, anonymous, web-based survey was administered to a convenience sample of residents and fellows at two academic medical centers.  Respondents answered 20 questions on personal finance and 28 questions about their own financial planning, attitudes, and debt. Questions regarding satisfaction with one's financial condition and investment-risk tolerance used a 10-point Likert scale (1=lowest, 10=highest).  Of 2,010 trainees, 422 (21%) responded (median age 30 years; interquartile range, 28-33). The mean quiz score was 52.0% (SD = 19.1). Of 299 (71%) respondents with student loan debt, 144 (48%) owed over $200,000.  Many respondents had other debt, including 86 (21%) with credit card debt. Of 262 respondents with retirement savings, 142 (52%) had saved less than $25,000. Respondents' mean satisfaction with their current personal financial condition was 4.8 (SD = 2.5) and investment-risk tolerance was 5.3 (SD = 2.3). Indebted trainees reported lower satisfaction than trainees without debt (4.4 vs. 6.2, F (1,419) = 41.57, p < .001).   Knowledge was moderately correlated with investment-risk tolerance (r=0.41, p < .001), and weakly correlated with satisfaction with financial status (r=0.23, p < .001). Residents and fellows had low financial literacy and investment-risk tolerance, high debt, and deficits in their financial preparedness.  Adding personal financial education to the medical education curriculum would benefit trainees.  Providing education in areas such as budgeting, estate planning, investment strategies, and retirement planning early in training can offer significant long-term benefits.

  8. [Psychometric properties of an instrument for assessing cyber-sex addiction].

    Science.gov (United States)

    Ballester Arnal, Rafael; Gil Llario, Ma Dolores; Gómez Martínez, Sandra; Gil Juliá, Beatriz

    2010-11-01

    Psychometric properties of an instrument for assessing cyber-sex addiction. Cyber-sex addiction is a «new pathology» whose prevalence has grown rapidly in recent years. Therefore, it is important to have validated assessment instruments. The aim of this study was the adaptation and validation of the Internet Sex Screening Test (ISST) for its use in a Spanish population. The instrument was administered to 1239 Spanish college students. The results yielded five components that account for 47.5% of the variance. Internal consistency was .88 and temporal stability was .84. Moreover, the instrument had adequate convergent and discriminant validity and was related to other behaviors such as the use of pornography, internet addiction, number of hours online and sexual frequency. Therefore, this tool is proposed as an appropriate measure to assess cyber-sex addiction.

  9. Cultural Competence of Healthcare Providers: A Systematic Review of Assessment Instruments.

    Science.gov (United States)

    Lin, Chia-Jung; Lee, Chia-Kuei; Huang, Mei-Chih

    2017-06-01

    Few articles in the literature identify and describe the instruments that are regularly used by scholars to measure cultural competence in healthcare providers. This study reviews the psychometric properties of the several instruments that are used regularly to assess the cultural competence of healthcare providers. Researchers conducted a systematic review of the relevant articles that were published between 1983 and 2013 and listed on academic and government Web sites or on one or more of the following databases: CINAHL, MEDLINE, ERIC, PsycINFO, Psyc ARTICLES, PubMed, Cochrane, Pro Quest, Google Scholar, CNKI (China), and the National Digital Library of Theses and Dissertations (Taiwan). This study included 57 articles. Ten instruments from these articles were identified and analyzed. These instruments included five that were presented in English and five that were presented in Chinese. All were self-administered and based on respondent perceptions. Five of the 10 instruments were designed to measure cultural competence, two were designed to measure cultural sensitivity, two were designed to measure transcultural self-efficacy, and one was designed to measure cultural awareness. The six cultural dimensions addressed by these instruments were attitudes, knowledge, skills, behaviors, desires, and encounters. An expert panel validated the content of the 10 instruments. The subscales explained 33%-90% of the variance in scores for eight of the instruments. The reliability of the 10 instruments was estimated based on the internal consistency, which ranged from .57 to .97. This systematic review may assist researchers to choose appropriate instruments to assess the cultural competence of healthcare providers. The findings of this review indicate that no single instrument is adequate to evaluate cultural competence in all contexts.

  10. How students measure up: An assessment instrument for introductory computer science

    Science.gov (United States)

    Decker, Adrienne

    This dissertation presents an assessment instrument specifically designed for programming-first introductory sequences in computer science as given in Computing Curricula 2001: Computer Science Volume. The first-year computer science course has been the focus of many recent innovations and many recent debates in the computer science curriculum. There is significant disagreement as to effective methodology in the first year of computing, and there has been no shortage of ideas as to what predicts student success in the first year of the computing curriculum. However, most investigations into predictors of success lack an appropriately validated assessment instrument to support or refute their findings. This is presumably due to the fact that there are very few validated assessment instruments available for assessing student performance in the first year of computing instruction. The instrument presented here is not designed to test particular language constructs, but rather the underlying principles of the first year of computing instruction. It has been administered to students at the end of their first year of an introductory computer science curriculum. Data needed for analysis of the instrument for reliability and validity was collected and analyzed. Use of this instrument enables validated assessment of student progress at the end of their first year, and also enables the study of further innovations in the curriculum for the first year computer science courses.

  11. The quality of instruments to assess the process of shared decision making: A systematic review

    Science.gov (United States)

    Bomhof-Roordink, Hanna; Smith, Ian P.; Scholl, Isabelle; Stiggelbout, Anne M.; Pieterse, Arwen H.

    2018-01-01

    Objective To inventory instruments assessing the process of shared decision making and appraise their measurement quality, taking into account the methodological quality of their validation studies. Methods In a systematic review we searched seven databases (PubMed, Embase, Emcare, Cochrane, PsycINFO, Web of Science, Academic Search Premier) for studies investigating instruments measuring the process of shared decision making. Per identified instrument, we assessed the level of evidence separately for 10 measurement properties following a three-step procedure: 1) appraisal of the methodological quality using the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist, 2) appraisal of the psychometric quality of the measurement property using three possible quality scores, 3) best-evidence synthesis based on the number of studies, their methodological and psychometrical quality, and the direction and consistency of the results. The study protocol was registered at PROSPERO: CRD42015023397. Results We included 51 articles describing the development and/or evaluation of 40 shared decision-making process instruments: 16 patient questionnaires, 4 provider questionnaires, 18 coding schemes and 2 instruments measuring multiple perspectives. There is an overall lack of evidence for their measurement quality, either because validation is missing or methods are poor. The best-evidence synthesis indicated positive results for a major part of instruments for content validity (50%) and structural validity (53%) if these were evaluated, but negative results for a major part of instruments when inter-rater reliability (47%) and hypotheses testing (59%) were evaluated. Conclusions Due to the lack of evidence on measurement quality, the choice for the most appropriate instrument can best be based on the instrument’s content and characteristics such as the perspective that they assess. We recommend refinement and validation of

  12. Wind galleries: an instrument for environmental impact assessment

    International Nuclear Information System (INIS)

    Zunino, C.

    1998-01-01

    In the last decades wind galleries for non-aeronautic utilisation have proved to be a useful investigation tool in various fields, such as studies on environmental impact and risk assessment, associated with permanent or incidental release of harmful substances. In this framework the feasibility of a new installation has been evaluated in Italy, having as main target the reproduction of thermal stratification phenomena. The great deal of 'hazardous' industries, often in areas having a complex orography, as well as the high pollution levels in Italian cities, lead to the conclusion that a thermally stratified wind gallery might be an economically viable investment [it

  13. Development of esMOCA RULA, Motion Capture Instrumentation for RULA Assessment

    Science.gov (United States)

    Akhmad, S.; Arendra, A.

    2018-01-01

    The purpose of this research is to build motion capture instrumentation using sensors fusion accelerometer and gyroscope to assist in RULA assessment. Data processing of sensor orientation is done in every sensor node by digital motion processor. Nine sensors are placed in the upper limb of operator subject. Development of kinematics model is done with Simmechanic Simulink. This kinematics model receives streaming data from sensors via wireless sensors network. The output of the kinematics model is the relative angular angle between upper limb members and visualized on the monitor. This angular information is compared to the look-up table of the RULA worksheet and gives the RULA score. The assessment result of the instrument is compared with the result of the assessment by rula assessors. To sum up, there is no significant difference of assessment by the instrument with an assessment by an assessor.

  14. The Health Technology Assessment-disease management instrument reliably measured methodologic quality of health technology assessments of disease management.

    Science.gov (United States)

    Steuten, L M G; Vrijhoef, H J M; van Merode, G G; Severens, J L; Spreeuwenberg, C

    2004-09-01

    Systematic reviews aim to summarize the evidence in a particular topic area, giving attention to the identified methodologic quality of published research. Because research in a specific area may be susceptible to specific biases, it is assumed that the methodologic quality of Health Technology Assessment (HTA) of disease management cannot properly be measured with the existing methodologic quality assessment instruments. The purpose of this study was to describe to what extent existing instruments are useful in assessing the methodologic quality of HTA of disease management. An inventory was made of the problems that arise when assessing the methodologic quality of six HTAs of disease management with three different instruments. Based on these findings, a new instrument is proposed and validated. Problems mainly concern the items related to the study design, criteria for selection and restriction of patients, baseline and outcome measures, blinding of patients and providers, and the description of (co)-interventions. With its more specific characteristics, the HTA-DM addresses the problems mentioned. The HTA-DM is a reliable instrument for methodologic quality assessment of HTA of disease management in comparison with the other three instruments.

  15. Contextualizing and assessing the social capital of seniors in congregate housing residences: study design and methods

    Directory of Open Access Journals (Sweden)

    Riley Therese

    2005-04-01

    Full Text Available Abstract Background This article discusses the study design and methods used to contextualize and assess the social capital of seniors living in congregate housing residences in Calgary, Alberta. The project is being funded as a pilot project under the Institute of Aging, Canadian Institutes for Health Research. Design/Methods Working with seniors living in 5 congregate housing residencies in Calgary, the project uses a mixed method approach to develop grounded measures of the social capital of seniors. The project integrates both qualitative and quantitative methods in a 3-phase research design: 1 qualitative, 2 quantitative, and 3 qualitative. Phase 1 uses gender-specific focus groups; phase 2 involves the administration of individual surveys that include a social network module; and phase 3 uses anamolous-case interviews. Not only does the study design allow us to develop grounded measures of social capital but it also permits us to test how well the three methods work separately, and how well they fit together to achieve project goals. This article describes the selection of the study population, the multiple methods used in the research and a brief discussion of our conceptualization and measurement of social capital.

  16. Biologic and chemical terrorism in children: an assessment of residents' knowledge.

    Science.gov (United States)

    Schobitz, Erik P; Schmidt, James M; Poirier, Michael P

    2008-04-01

    This study was conducted to determine the baseline fund of knowledge of pediatric and emergency medicine residents at a single institution in the medical management of pediatric victims of biologic and chemical terrorism. A test covering essential content was developed and validated by experts. The test was given anonymously to volunteer pediatric and emergency medicine residents at a single institution. The test was readministered 5 months after a lecture on the content. The 34 pediatric residents and 15 emergency medicine residents scored a median of 65% and 73%, respectively (P = .03). Residents from both specialties combined scored a median of 70% correct versus those residents who did not attend the lecture. Pediatric and emergency medicine residents are significantly unprepared to manage pediatric victims of biologic and chemical terrorism. Education curriculums on this topic must be incorporated into these residencies. The traditional lecture format may not be the most effective technique.

  17. DEVELOPMENT OF PERFORMANCE ASSESSMENT INSTRUMENT FOR NURSES BASED ON WEB IN INPATIENT UNIT

    Directory of Open Access Journals (Sweden)

    Aprilia Nuryanti

    2017-06-01

    Full Text Available Introduction: Performance assessment instrument will be problematic when it is not representative in describing the competency because it is not obvious indicators and inappropriate performance standard to nursing’s task. The purpose of this study is to develop nurses’ performance assessment instrument based on the web from multi sources assessment inpatient unit at SMC Hospital. Methods: This study had two phases. The first phase was an explanatory overview of the performance assessment system using questionnaires completed by 53 respondents of nurses, selected by purposive sampling. Instrument development based on FGD with six decision makers in the hospital. Validity was tested by Pearson Product Moment Correlation and reliability of instrument’s was tested by alpha Cronbach. The second phase was socialization and instrument test to observe the quality of instrument using a questionnaire by 47 respondents and recommendations made by 8 participants of FGD. The samples were selected by purposive sampling technique. Performance assessment system was moderate at 58.49%. All questions which aimed to measure the performance of nurses were valid and reliable. The quality of nurses’ performance assessment instruments based on the web was a good category, which was functionality: 81.60; reliability: 78.16; efficiency: 80.85; usability: 81.70 and portability: 81.70. Results: The result was a web-based assessment format, scoring with Likert scale, resource assessment by the direct supervisor which was a multisource evaluator, the development of performance graph, and confidentiality of data on the database server. Discussion: Recommendations for hospital is to make policy based on the final value of the performance assessment by the supervisor which was multisource feedback and it needs a global writing on a form of performance assessment result.

  18. Are pedometers adequate instruments for assessing energy expenditure?

    Science.gov (United States)

    Kumahara, H; Tanaka, H; Schutz, Y

    2009-12-01

    Assessing energy expenditure (EE) is important for the control of obesity. Daily step counts have become popular and constitute one practical technique for evaluating the physical activity (PA) in large population studies. However, information on the capacity of pedometers to track EE in free-living conditions remains scanty. The 24-h EE of 71 healthy adults was measured by indirect calorimetry in a large respiratory chamber. Two accelerometers were attached to the waist, one for counting the total daily steps (ACC(STEP)) and another for measuring the anteroposterior whole body acceleration calculated as the root mean square of the acceleration signal at every second (ACC(RMS)). The ACC(STEP) was not associated with PA-related EE (PAEE) or 24-h EE. Body weight (BW) was the main determinant of both the values (explaining 30 and 75% of the variance, respectively). Approximately 8% (P<0.001) of the variance in PAEE was attributed to the ACC(RMS) after BW was accounted for, whereas the ACC(STEP) did not explain any additional variance. A multiple stepwise regression analysis revealed that BW, height and ACC(RMS) were highly significant determinants of 24-h EE and accounted for as much as 83% of the total variance. Recording the number of steps per day does not provide accurate information on EE, and at best is only a crude predictor of the general PA in terms of displacement. In contrast, accelerometry signals are considered to be a more meaningful factor in the assessment of EE rather than step counts under sedentary conditions.

  19. The design of an instrumented rebar for assessment of corrosion in cracked reinforced concrete

    DEFF Research Database (Denmark)

    Pease, Bradley Justin; Geiker, Mette Rica; Stang, Henrik

    2011-01-01

    rebar with 17 electronically isolated corrosion sensors. Instrumented and standard rebars were cast into concrete beams and bending cracks were induced and held open using steel frames. Epoxy impregnation was used to assess and compare cracks in the concrete around the instrumented and standard rebar...... between the steel and concrete. Cracked beams with cast-in instrumented and standard rebars were ponded with a 10\\% chloride solution and the open circuit corrosion potential (OCP) of the 17 sensors was measured for up to 62 days. Measurements from the individual sensors indicate when and where active....... As bending-induced cracks reached the reinforcement, slip and separation occurred along the concrete-reinforcement interface. Cracks in the concrete surrounding standard and instrumented rebars are largely similar in appearance; however, sensors protruding from the instrumented rebar reduced the separation...

  20. Development and validation of an instrument to assess job satisfaction in eye-care personnel.

    Science.gov (United States)

    Paudel, Prakash; Cronjé, Sonja; O'Connor, Patricia M; Khadka, Jyoti; Rao, Gullapalli N; Holden, Brien A

    2017-11-01

    The aim was to develop and validate an instrument to measure job satisfaction in eye-care personnel and assess the job satisfaction of one-year trained vision technicians in India. A pilot instrument for assessing job satisfaction was developed, based on a literature review and input from a public health expert panel. Rasch analysis was used to assess psychometric properties and to undertake an iterative item reduction. The instrument was then administered to vision technicians in vision centres of Andhra Pradesh in India. Associations between vision technicians' job satisfaction and factors such as age, gender and experience were analysed using t-test and one-way analysis of variance. Rasch analysis confirmed that the 15-item job satisfaction in eye-care personnel (JSEP) was a unidimensional instrument with good fit statistics, measurement precisions and absence of differential item functioning. Overall, vision technicians reported high rates of job satisfaction (0.46 logits). Age, gender and experience were not associated with high job satisfaction score. Item score analysis showed non-financial incentives, salary and workload were the most important determinants of job satisfaction. The 15-item JSEP instrument is a valid instrument for assessing job satisfaction among eye-care personnel. Overall, vision technicians in India demonstrated high rates of job satisfaction. © 2016 Optometry Australia.

  1. [Training of residents in obstetrics and gynecology: Assessment of an educational program including formal lectures and practical sessions using simulators].

    Science.gov (United States)

    Jordan, A; El Haloui, O; Breaud, J; Chevalier, D; Antomarchi, J; Bongain, A; Boucoiran, I; Delotte, J

    2015-01-01

    Evaluate an educational program in the training of residents in gynecology-obstetrics (GO) with a theory session and a practical session on simulators and analyze their learning curve. Single-center prospective study, at the university hospital (CHU). Two-day sessions were leaded in April and July 2013. An evaluation on obstetric and gynecological surgery simulator was available to all residents. Theoretical knowledge principles of obstetrics were evaluated early in the session and after formal lectures was taught to them. At the end of the first session, a satisfaction questionnaire was distributed to all participants. Twenty residents agreed to participate to the training sessions. Evaluation of theoretical knowledge: at the end of the session, the residents obtained a significant improvement in their score on 20 testing knowledge. Obstetrical simulator: a statistically significant improvement in scores on assessments simulator vaginal delivery between the first and second session. Subjectively, a larger increase feeling was seen after breech delivery simulation than for the cephalic vaginal delivery. However, the confidence level of the resident after breech delivery simulation has not been improved at the end of the second session. Simulation in gynecological surgery: a trend towards improvement in the time realized on the peg-transfer between the two sessions was noted. In the virtual simulation, no statistically significant differences showed, no improvement for in salpingectomy's time. Subjectively, the residents felt an increase in the precision of their gesture. Satisfaction: All residents have tried the whole program. They considered the pursuit of these sessions on simulators was necessary and even mandatory. The approach chosen by this structured educational program allowed a progression for the residents, both objectively and subjectively. This simulation program type for the resident's training would use this tool in assessing their skills and develop

  2. Developing and Assessing Curriculum on the Physics of Medical Instruments

    Science.gov (United States)

    Christensen, Warren; Johnson, James K.; Van Ness, Grace R.; Mylott, Elliot; Dunlap, Justin C.; Anderson, Elizabeth A.; Widenhorn, Ralf

    2013-01-01

    Undergraduate educational settings often struggle to provide students with authentic biologically or medically relevant situations and problems that simultaneously improve their understanding of physics. Through exercises and laboratory activities developed in an elective Physics in Biomedicine course for upper-level biology or pre–health majors at Portland State University, we aim to teach fundamental physical concepts, such as light absorption and emission and atomic energy levels, through analysis of biological systems and medical devices. The activities address the properties of electromagnetic waves as they relate to the interaction with biological tissue and make links between physics and biomedical applications such as microscopy or laser eye surgery. We report on the effect that engaging students in tasks with actual medical equipment has had on their conceptual understanding of light and spectroscopy. These initial assessments indicate that students’ understanding improves in some areas as a result of taking the course, but gains are not uniform and are relatively low for other topics. We also find a promising “nonshift” in student attitudes toward learning science as a result of taking the course. A long-term goal of this work is to develop these materials to the extent that they can eventually be imported into an introductory curriculum for life sciences majors. PMID:23737632

  3. Developing and assessing curriculum on the physics of medical instruments.

    Science.gov (United States)

    Christensen, Warren; Johnson, James K; Van Ness, Grace R; Mylott, Elliot; Dunlap, Justin C; Anderson, Elizabeth A; Widenhorn, Ralf

    2013-06-01

    Undergraduate educational settings often struggle to provide students with authentic biologically or medically relevant situations and problems that simultaneously improve their understanding of physics. Through exercises and laboratory activities developed in an elective Physics in Biomedicine course for upper-level biology or pre-health majors at Portland State University, we aim to teach fundamental physical concepts, such as light absorption and emission and atomic energy levels, through analysis of biological systems and medical devices. The activities address the properties of electromagnetic waves as they relate to the interaction with biological tissue and make links between physics and biomedical applications such as microscopy or laser eye surgery. We report on the effect that engaging students in tasks with actual medical equipment has had on their conceptual understanding of light and spectroscopy. These initial assessments indicate that students' understanding improves in some areas as a result of taking the course, but gains are not uniform and are relatively low for other topics. We also find a promising "nonshift" in student attitudes toward learning science as a result of taking the course. A long-term goal of this work is to develop these materials to the extent that they can eventually be imported into an introductory curriculum for life sciences majors.

  4. Rhett Talks: The development, implementation, and assessment of a faculty-in-residence program.

    Science.gov (United States)

    Healea, C Daryl; Ribera, Robert

    2015-01-01

    Student-faculty interactions outside the classroom have long been touted as beneficial to students' success at an institution of higher education. However, obstacles to realizing these interactions have also been well-documented. This case study profiles how student affairs administrators and faculty-in-residence overcame these obstacles to develop, implement, and assess an award-winning program for facilitating student-faculty interactions outside the classroom. Named after the Boston University (BU) mascot (Rhett the Boston terrier) and inspired by the popular online lecture series (TED Talks), Rhett Talks has met BU's unique campus needs, facilitated potent student-faculty interactions, and demonstrated effective partnering between student affairs and academic affairs.

  5. Development of the objective, structured communication assessment of residents (OSCAR) tool for measuring communication skills with patients.

    Science.gov (United States)

    Caron, Aleece; Perzynski, Adam; Thomas, Charles; Saade, Jimmy Y; McFarlane, Michael; Becker, Jeffery

    2013-12-01

    Although interpersonal and communication skills are essential to physician practice, there is a dearth of effective tools to meaningfully teach and assess communication skills. The purpose of our study was to create a standardized tool for evaluation of communication skills for residents across specialties. We designed an Objective, Structured Communication Assessment of Residents (OSCAR) tool, consisting of 4 clinical stations, to assess intern communication skills with relationship development, their establishment of case goals, and their organization and time management skills. Interns from 11 training programs completed the stations, with senior residents trained to function as standardized patients. The 4 stations' scenarios were a disruptive patient, handling a phone call for a narcotics refill, disclosing a medical mistake, and delivering bad news. Eighty-three interns completed OSCAR during orientation. The assessment took interns about 40 minutes to complete, and participants were given immediate feedback by the standardized patients. The total possible score for each station was 50. Resident performance was highest for disclosing a medical error (94%, 47 of 50), followed by handling a disruptive patient (90%, 45 of 50), disclosing bad news (86%, 43 of 50), and handling the phone call for the narcotics refill (62%, 31 of 50). Multivariate analysis of variance results indicated differences between residents from US and international medical schools, but there were no significant differences across specialties. Interrater reliability was excellent for each station (> 0.80). OSCAR is a practical tool for assessing interns' communication skills to provide timely results to program directors.

  6. Assessing Student Outcomes of Undergraduate Research with URSSA, the Undergraduate Student Self-Assessment Instrument

    Science.gov (United States)

    Laursen, S. L.; Weston, T. J.; Thiry, H.

    2012-12-01

    URSSA is the Undergraduate Research Student Self-Assessment, an online survey instrument for programs and departments to use in assessing the student outcomes of undergraduate research (UR). URSSA focuses on what students learn from their UR experience, rather than whether they liked it. The online questionnaire includes both multiple-choice and open-ended items that focus on students' gains from undergraduate research. These gains include skills, knowledge, deeper understanding of the intellectual and practical work of science, growth in confidence, changes in identity, and career preparation. Other items probe students' participation in important research-related activities that lead to these gains (e.g. giving presentations, having responsibility for a project). These activities, and the gains themselves, are based in research and thus constitute a core set of items. Using these items as a group helps to align a particular program assessment with research-demonstrated outcomes. Optional items may be used to probe particular features that are augment the research experience (e.g. field trips, career seminars, housing arrangements). The URSSA items are based on extensive, interview-based research and evaluation work on undergraduate research by our group and others. This grounding in research means that URSSA measures what we know to be important about the UR experience The items were tested with students, revised and re-tested. Data from a large pilot sample of over 500 students enabled statistical testing of the items' validity and reliability. Optional items about UR program elements were developed in consultation with UR program developers and leaders. The resulting instrument is flexible. Users begin with a set of core items, then customize their survey with optional items to probe students' experiences of specific program elements. The online instrument is free and easy to use, with numeric results available as raw data, summary statistics, cross-tabs, and

  7. Instrument validation for assessing critically ill patients on mechanical ventilation according to the ABCDE

    Directory of Open Access Journals (Sweden)

    Percival Vitorino Guimarães

    2015-03-01

    Full Text Available The objective of this study was to validate the content of an instrument aimed at guiding the nursing care provided to patients on artificial respiration. An instrument was created with five indicators, inspired on the mnemonic ABCDE method, used in the Advanced Trauma Life Support course, namely: A – Airway maintenance, with 38 items; B – Breathing and ventilation, 11 items; C – Circulation with hemorrhage control, 16 items; D – Disability/neurologic assessment, 08 items; and E – Exposure and environmental control, 08 items. The Content Validity Index (CVI was used to calculate the degree of agreement among the experts for the general analysis of the instrument and the analysis of the set of items. In conclusion, this instrument works as an assessment tool for patients on artificial respiration, especially when they are in adapted environments to intensive care, as it guides the nurse to observe aspects that may cause harm to the patient.

  8. Assessing the performance of renewable electricity support instruments

    International Nuclear Information System (INIS)

    Verbruggen, Aviel; Lauber, Volkmar

    2012-01-01

    The performance of feed-in tariffs and tradable certificates is assessed on criteria of efficacy, efficiency, equity and institutional feasibility. In the early stage of transition to an energy system based entirely on renewable energy supplies, renewable electricity can only thrive if support takes into account the specific technical, economic and political problems which result from embedding this electricity in conventional power systems whose technology, organizational structure, environmental responsibility and general mission differ profoundly from the emerging, renewable-based system. Support schemes need to capture the diversity of power supplies, the variable nature of some renewable supplies, and their different attributes for the purposes of public policy. They must take into account the variety of generators – including small, decentralized generation – emerging in a renewable-based system, and the new relationships between generators and customers. Renewable energy policies need a clear point of reference: because the incumbent power systems are not sustainable they must adapt to the requirements of the renewable ones, not the other way round. Incumbent systems carry the responsibility of paying the transition, something that corresponds best with the polluter pays principle. - Highlights: ► Present power systems must adapt to the requirements of growing renewable ones, not the opposite. ► Well performing support systems capture the diversity of renewable sources and technologies. ► Feed-in Tariffs are superior in addressing the renewables' diversity and in promoting innovation. ► Feed-in Tariffs put transition burdens on incumbents and stimulate independent producers.

  9. Assessment of Customer Service in Academic Health Care Libraries (ACSAHL): an instrument for measuring customer service.

    Science.gov (United States)

    Crossno, J E; Berkins, B; Gotcher, N; Hill, J L; McConoughey, M; Walters, M

    2001-04-01

    In a pilot study, the library had good results using SERVQUAL, a respected and often-used instrument for measuring customer satisfaction. The SERVQUAL instrument itself, however, received some serious and well-founded criticism from the respondents to our survey. The purpose of this study was to test the comparability of the results of SERVQUAL with a revised and shortened instrument modeled on SERVQUAL. The revised instrument, the Assessment of Customer Service in Academic Health Care Libraries (ACSAHL), was designed to better assess customer service in academic health care libraries. Surveys were sent to clients who had used the document delivery services at three academic medical libraries in Texas over the previous twelve to eighteen months. ACSAHL surveys were sent exclusively to clients at University of Texas (UT) Southwestern, while the client pools at the two other institutions were randomly divided and provided either SERVQUAL or ACSAHL surveys. Results indicated that more respondents preferred the shorter ACSAHL instrument to the longer and more complex SERVQUAL instrument. Also, comparing the scores from both surveys indicated that ACSAHL elicited comparable results. ACSAHL appears to measure the same type of data in similar settings, but additional testing is recommended both to confirm the survey's results through data replication and to investigate whether the instrument applies to different service areas.

  10. Development of the evaluation instrument use CIPP on the implementation of project assessment topic optik

    Science.gov (United States)

    Asfaroh, Jati Aurum; Rosana, Dadan; Supahar

    2017-08-01

    This research aims to develop an evaluation instrument models CIPP valid and reliable as well as determine the feasibility and practicality of an evaluation instrument models CIPP. An evaluation instrument models CIPP to evaluate the implementation of the project assessment topic optik to measure problem-solving skills of junior high school class VIII in the Yogyakarta region. This research is a model of development that uses 4-D. Subject of product trials are students in class VIII SMP N 1 Galur and SMP N 1 Sleman. Data collection techniques in this research using non-test techniques include interviews, questionnaires and observations. Validity in this research was analyzed using V'Aikens. Reliability analyzed using ICC. This research uses 7 raters are derived from two lecturers expert (expert judgment), two practitioners (science teacher) and three colleagues. The results of this research is the evaluation's instrument model of CIPP is used to evaluate the implementation of the implementation of the project assessment instruments. The validity result of evaluation instrument have V'Aikens values between 0.86 to 1, which means a valid and 0.836 reliability values into categories so well that it has been worth used as an evaluation instrument.

  11. Use of 360-degree assessment of residents in internal medicine in a Danish setting: a feasibility study

    DEFF Research Database (Denmark)

    Allerup, P; Aspegren, K; Ejlersen, E

    2007-01-01

    BACKGROUND: The aim of the study was to explore the feasibility of 360 degree assessment in early specialist training in a Danish setting. Present Danish postgraduate training requires assessment of specific learning objectives. Residency in Internal Medicine was chosen for the study. It has 65...

  12. Improving the Effectiveness of TalentCorp’s Initiatives : Assessment of Returning Expert Program and Residence Pass-Talent

    OpenAIRE

    World Bank

    2015-01-01

    The information contained in this summary report reflects the analysis and assessment that have been undertaken beginning January 2013 mainly to assess the effectiveness of TalentCorp’s efforts to attract and retain global talent through its Returning Expert Program (REP) and Residence Pass-Talent (RP-T). The initial research included various activities aimed at improving the client’s abil...

  13. Developing an instrument model to assess teachers’ creativity in designing and teaching music subject

    Directory of Open Access Journals (Sweden)

    Udi Utomo

    2017-08-01

    Full Text Available This paper aims at developing an instrument model to assess teacher’s creativity in designing and teaching music at school. The study was conducted by adapting the approach of Research and Development (R&D from the model designed by Borg and Gall and the cycle model design developed by Cenamo & Kalk. The development comprises two stages; the model development and dissemination. The model development encompassed of model planning, model designing, as well as the try out. While, the dissemination stage was done by presenting the research result at a conference. At the end of the study, it was proven that the assessment instrument model used to assess teachers’ creativity in designing and teaching music subject at school had met with the research aim. It was shown from the try out test on the assessment instrument model development that: (1 the assessment material, assessment technique, rater criteria, assessment object, units of observation, competence test process, time allotment, observation process, measurement criteria, as well as the measurement rubric had been considered appropriate and had provenly matched from one to another so that it can be applied well; (2 the reliability of the assessment instrument based on Intraclass Correlation Coefficients/ICC test on consistency and absolute agreement definition type as well as the Generalizability Coefficient had met the criteria.

  14. A Comparison of Two Instruments for the Assessment of Legibility of ...

    African Journals Online (AJOL)

    Purpose: To compare the utility of a rating and visual analogue scale for the assessment of legibility in prescriptions Methods: A sample of fifty randomly selected ... Conclusion: The findings support the utility of both instruments in the assessment of handwriting but suggest that there may be important differences between ...

  15. Assessment of physician competency in patient education : Reliability and validity of a model-based instrument

    NARCIS (Netherlands)

    Wouda, Jan C.; Zandbelt, Linda C.; Smets, Ellen M. A.; van de Wiel, Harry B. M.

    2011-01-01

    Objective: Establish the inter-rater reliability and the concept, convergent and construct validity of an instrument for assessing the competency of physicians in patient education. Methods: Three raters assessed the quality of patient education in 30 outpatient consultations with the CELI

  16. Bridging the Educational Research-Teaching Practice Gap: Tools for Evaluating the Quality of Assessment Instruments

    Science.gov (United States)

    Anderson, Trevor R.; Rogan, John M.

    2010-01-01

    Student assessment is central to the educational process and can be used for multiple purposes including, to promote student learning, to grade student performance and to evaluate the educational quality of qualifications. It is, therefore, of utmost importance that assessment instruments are of a high quality. In this article, we present various…

  17. A Comparison of Two Instruments for the Assessment of Legibility of ...

    African Journals Online (AJOL)

    Erah

    there have to be reliable means to assess legibility in the absence of computer software. This study compared the utility of two instruments - a rating scale and a visual analogue scale - for the assessment of legibility of handwriting in prescriptions written in a tertiary health institution in a developing country. EXPERIMENTAL.

  18. A systematic review of instruments that assess the implementation of hospital quality management systems.

    NARCIS (Netherlands)

    Groene, O.; Botje, D.; Suñol, R.; Lopez, M.A.; Wagner, C.

    2013-01-01

    Purpose: Health-care providers invest substantial resources to establish and implement hospital quality management systems. Nevertheless, few tools are available to assess implementation efforts and their effect on quality and safety outcomes. This review aims to (i) identify instruments to assess

  19. The caries assessment spectrum and treatment (CAST) instrument: its reproducibility in clinical studies

    NARCIS (Netherlands)

    Souza, A.L. de; Bronkhorst, E.M.; Creugers, N.H.; Leal, S.C.; Frencken, J.E.

    2014-01-01

    A new caries assessment instrument, the Caries Assessment Spectrum and Treatment (CAST), was developed. It covers carious lesion progression from no lesion, sealants and restorations to lesions in enamel and dentine, advanced stages in pulpal and tooth-surrounding tissues, and tooth loss owing to

  20. Attention to gender in communication skills assessment instruments in medical education: a review.

    NARCIS (Netherlands)

    Dielissen, P.W.; Bottema, B.J.A.M.; Verdonk, P.; Lagro-Janssen, T.

    2011-01-01

    CONTEXT: Gender is increasingly regarded as an important factor in doctor-patient communication education. This review aims to assess if and how gender is addressed by current assessment instruments for communication skills in medical education. METHODS: In 2009 at Radboud University Nijmegen

  1. A Combined XRD/XRF Instrument for Lunar Resource Assessment

    Science.gov (United States)

    Vaniman, D. T.; Bish, D. L.; Chipera, S. J.; Blacic, J. D.

    1992-01-01

    Robotic surface missions to the Moon should be capable of measuring mineral as well as chemical abundances in regolith samples. Although much is already known about the lunar regolith, our data are far from comprehensive. Most of the regolith samples returned to Earth for analysis had lost the upper surface, or it was intermixed with deeper regolith. This upper surface is the part of the regolith most recently exposed to the solar wind; as such it will be important to resource assessment. In addition, it may be far easier to mine and process the uppermost few centimeters of regolith over a broad area than to engage in deep excavation of a smaller area. The most direct means of analyzing the regolith surface will be by studies in situ. In addition, the analysis of the impact-origin regolith surfaces, the Fe-rich glasses of mare pyroclastic deposits, are of resource interest, but are inadequately known; none of the extensive surface-exposed pyroclastic deposits of the Moon have been systematically sampled, although we know something about such deposits from the Apollo 17 site. Because of the potential importance of pyroclastic deposits, methods to quantify glass as well as mineral abundances will be important to resource evaluation. Combined x ray diffraction (XRD) and x ray fluorescence (XRF) analysis will address many resource characterization problems on the Moon. XRF methods are valuable for obtaining full major-element abundances with high precision. Such data, collected in parallel with quantitative mineralogy, permit unambiguous determination of both mineral and chemical abundances where concentrations are high enough to be of resource grade. Collection of both XRD and XRF data from a single sample provides simultaneous chemical and mineralogic information. These data can be used to correlate quantitative chemistry and mineralogy as a set of simultaneous linear equations, the solution of which can lead to full characterization of the sample. The use of

  2. A combined XRD/XRF instrument for lunar resource assessment

    Science.gov (United States)

    Vaniman, D. T.; Bish, D. L.; Chipera, S. J.; Blacic, J. D.

    1992-12-01

    Robotic surface missions to the Moon should be capable of measuring mineral as well as chemical abundances in regolith samples. Although much is already known about the lunar regolith, our data are far from comprehensive. Most of the regolith samples returned to Earth for analysis had lost the upper surface, or it was intermixed with deeper regolith. This upper surface is the part of the regolith most recently exposed to the solar wind; as such it will be important to resource assessment. In addition, it may be far easier to mine and process the uppermost few centimeters of regolith over a broad area than to engage in deep excavation of a smaller area. The most direct means of analyzing the regolith surface will be by studies in situ. In addition, the analysis of the impact-origin regolith surfaces, the Fe-rich glasses of mare pyroclastic deposits, are of resource interest, but are inadequately known; none of the extensive surface-exposed pyroclastic deposits of the Moon have been systematically sampled, although we know something about such deposits from the Apollo 17 site. Because of the potential importance of pyroclastic deposits, methods to quantify glass as well as mineral abundances will be important to resource evaluation. Combined x ray diffraction (XRD) and x ray fluorescence (XRF) analysis will address many resource characterization problems on the Moon. XRF methods are valuable for obtaining full major-element abundances with high precision. Such data, collected in parallel with quantitative mineralogy, permit unambiguous determination of both mineral and chemical abundances where concentrations are high enough to be of resource grade. Collection of both XRD and XRF data from a single sample provides simultaneous chemical and mineralogic information. These data can be used to correlate quantitative chemistry and mineralogy as a set of simultaneous linear equations, the solution of which can lead to full characterization of the sample. The use of

  3. Development of an instrument to assess professional behaviour of foreign medical graduates.

    OpenAIRE

    Tromp, F.; Rademakers, J.J.D.J.M.; Cate, Th.J. ten

    2007-01-01

    BACKGROUND: Foreign medical graduates have to overcome challenges such as language proficiency and cultural differences. Several studies indicate that foreign medical graduates show deficiencies in professional behaviour. For the assessment of foreign medical graduates' professional behaviour, a more specific and sensitive instrument was needed. The aim of this study was to develop such an instrument. The starting point was the Amsterdam Attitudes and Communications Scale (AACS). Two research...

  4. Assessing patient‐centred communication in teaching: a systematic review of instruments

    OpenAIRE

    Brouwers, Marianne; Rasenberg, Ellemieke; van Weel, Chris; Laan, Roland; van Weel‐Baumgarten, Evelyn

    2017-01-01

    Context Patient‐centred communication is a key component of patient centredness in medical care. Therefore, adequate education in and assessment of patient‐centred communication skills are necessary. In general, feedback on communication skills is most effective when it is provided directly and is systematic. This calls for adequate measurement instruments. Objectives The aim of this study was to provide a systematic review of existing instruments that measure patient centredness in doctor–pa...

  5. Assessment of informal caregiver's needs by self-administered instruments: a literature review.

    Science.gov (United States)

    Lefranc, Anne; Pérol, David; Plantier, Morgane; Chatelain, Pierre; de Rohan-Chabot, Henri; Schell, Matthias

    2017-10-01

    Clinicians, researchers and politicians are seeking to better assess caregiver's needs. Challenges exist in broadly implementing this so as to provide appropriate support. The aim of this review was to compile self-administered instruments for assessment of caregiver's needs that are deemed to be scientifically robust. The Medline database was searched for publications reporting self-administered instruments assessing caregiver's needs with acceptable psychometric properties. These instruments were analyzed in terms of the development context, target population, concept, purpose, structure, content and psychometric properties. The dimensions of the needs were listed and categorized. A total of nine self-administered instruments were analyzed. They averaged 32 items, they were specifically developed for a targeted subpopulation of caregivers and dedicated to epidemiological research. Response devices were based on Likert scales. The main dimensions of the needs identified were 'Health and Care', 'Psychological - Emotional Support', 'Information-Knowledge', 'Social Life-Work-Finance'. None was specifically geared toward caregivers for the elderly, children or teenagers. In the absence of transcultural validation, no instrument was directly usable in Europe. Assessing caregivers' needs is a key part in providing caregivers with appropriate support. The development of self-administered instruments constitutes a complex field that is still underexplored at the international level; strict specifications with psychometric validation are essential. To be efficient, the instrument should be integrated in a larger process including: upstream, recognition, identification and assessment of the overall situation of the caregiver; and downstream, guidance, establishment and follow-up of a suitable action plan. © The Author 2017. Published by Oxford University Press on behalf of the European Public Health Association. All rights reserved.

  6. A Reliability and Validity of an Instrument to Evaluate the School-Based Assessment System: A Pilot Study

    Science.gov (United States)

    Ghazali, Nor Hasnida Md

    2016-01-01

    A valid, reliable and practical instrument is needed to evaluate the implementation of the school-based assessment (SBA) system. The aim of this study is to develop and assess the validity and reliability of an instrument to measure the perception of teachers towards the SBA implementation in schools. The instrument is developed based on a…

  7. Internal medicine resident knowledge of transfusion medicine: results from the BEST-TEST international education needs assessment.

    Science.gov (United States)

    Haspel, Richard L; Lin, Yulia; Mallick, Ranjeeta; Tinmouth, Alan; Cid, Joan; Eichler, Hermann; Lozano, Miguel; van de Watering, Leo; Fisher, Patrick B; Ali, Asma; Parks, Eric

    2015-06-01

    Blood transfusion is the most common hospital procedure performed in the United States. While inadequate physician transfusion medicine knowledge may lead to inappropriate practice, such an educational deficit has not been investigated on an international scale using a validated assessment tool. Identifying specific deficiencies is critical for developing curricula to improve patient care. Rasch analysis, a method used in high-stakes testing, was used to validate an assessment tool consisting of a 23-question survey and a 20-question examination. The assessment tool was administered to internal medicine residents to determine prior training, attitudes, perceived ability, and actual knowledge related to transfusion medicine. A total of 474 residents at 23 programs in nine countries completed the examination. The overall mean score of correct responses was 45.7% (site range, 32%-56%). The mean score for Postgraduate Year (PGY)1 (43.9%) was significantly lower than for PGY3 (47.1%) and PGY4 (50.6%) residents. Although 89% of residents had participated in obtaining informed consent from a patient for transfusion, residents scored poorly (<25% correct) on questions related to transfusion reactions. The majority of residents (65%) would find additional transfusion medicine training "very" or "extremely" helpful. Internationally, internal medicine residents have poor transfusion medicine knowledge and would welcome additional training. The especially limited knowledge of transfusion reactions suggests an initial area for focused training. This study not only represents the largest international assessment of transfusion medicine knowledge, but also serves as a model for rigorous, collaborative research in medical education. © 2014 AABB.

  8. Assessment of sleep quality in post-graduate residents in a tertiary hospital and teaching institute

    Directory of Open Access Journals (Sweden)

    Vasantmeghna Srinivasa Murthy

    2014-01-01

    Full Text Available Objectives: To evaluate subjective sleep quality, day-time sleepiness, prevalence of substance use, satisfaction with life among residents at our institute. To evaluate association of sleep qualitywith satisfaction with life and day-time sleepiness. To compare the findings between residents in clinical and para-clinical departments. Materials and Methods: Eighty-four residents filled questionnaires to obtain socio-demographic information and use of substance (s. Pittsburgh Sleep Quality Index (PSQI, Epworth Sleepiness Scale (ESS, and Satisfaction With Life scale (SWLS were also used. Association between sleep quality and sleepiness and satisfaction with life was evaluated. From the data collected, comparisons were made between the clinical and para-clinical department residents. Results: A significant number of residents belonging to the clinical faculty were poorsleepers; reported high levels of abnormal day-time sleepiness and less satisfaction with life compared to residents in para-clinical faculties. The differences in correlation between sleepiness and satisfaction with life with sleep quality among the two groups were not found to be significant. A larger percentage of clinical residents reported use of at least one substance during the residency period compared to the para-clinical residents. Conclusions: Poor sleep quality is perceived greatly by the resident doctors in our public hospital, especially among clinical faculties. Interventions are thus necessary in order to ensure adequate sleep among them.

  9. Associations between self-assessed masticatory disability and health of community-residing elderly people.

    Science.gov (United States)

    Nakanishi, N; Hino, Y; Ida, O; Fukuda, H; Shinsho, F; Tatara, K

    1999-10-01

    To examine the relationship between the self-assessed masticatory disability and the health of community-residing older people. Of 1473 randomly selected people aged 65 years and older living in Settsu, Osaka Prefecture, in October 1992, data on general health status, history of health management, psychosocial conditions, and dental conditions were obtained from 1405 people by interviews made during home visits. Follow-up for 54 months was completed for 1306 subjects (93.0%; 1072 living, 234 deceased). Being over 75 years of age, having poor general health and poor dental status, not using dental health checks, not using general health checks, not participating in social activities, not feeling that life is worth living (no "ikigai"), and feeling anxious about the future were univariately and significantly associated with self-assessed masticatory disability. Logistic regression analyses indicated that being older than 75 years, having poor general health and poor dental status, not using dental health checks, and not participating in social activities were independently associated with self-assessed masticatory disability. The Cox proportional hazards model showed that being male, over 75 years of age, and in poor general health, as well as not using general health checks, and not participating in social activities were independently associated with mortality. Self-assessed masticatory disability was univariately and significantly related to mortality, but by itself was not a significant risk factor for mortality, because of the potential influence of other variables. Certain health and psychosocial factors are closely associated with self-assessed masticatory disability among older people. Further investigations are needed to determine whether masticatory disability is a significant risk factor for mortality.

  10. Developing an assessment instrument of junior high school students’ higher order thinking skills in mathematics

    Directory of Open Access Journals (Sweden)

    Samritin Samritin

    2016-06-01

    Full Text Available This study is a research and development study. It aims to produce an instrument for assessing junior high school (JHS students’ higher order thinking skills (HOTS in mathematics. Its procedure consists of nine steps: (1 Constructing the test specification; (2 writing test items; (3 analyzing test items; (4 conducting the first tryout; (5 analyzing the results of the first try out; (6 revising the test; (7 assembling the test; (8 conducting the second tryout; and (9 analyzing the results of the second tryout. The instrument content validity was obtained through the focus group discussion (FGD forum, and Delphi technique. The construct validity was found out through the tryout data analysis. The instrument tryout was conducted twice involving 264 participants in the first tryout and 821 participants in the second tryout. The results of the study indicate that the instrument for assessing JHS students’ HOTS in mathematics has met the validity and reliability criteria. From the results of the content validity analysis, it can be concluded that the instrument is valid, and it was supported by the items validity indices above  0.79. From the results of the construct validity analysis, it can be concluded that the instrument is valid, as indicated by the value of χ2 = 67.69, with p-value = 0.10, Root Mean Square Error of Approximation (RMSEA = 0.03, supported by Goodness of Fit Index (GFI of 0.97, Normed Fit Index (NFI of 0.95, and Adjusted Goodness of Fit Index (AGFI of 0.95. The instrument reliability is 0.88. The developed instrument for assessing HOTS in mathematics consists of 12 items, each of which is of essay test type. The test items have difficulty indices in a range of 0.30 ≤ Pi ≤ 0.7.

  11. The patient assessment questionnaire: a new instrument for evaluating the interpersonal skills of vocational dental practitioners.

    Science.gov (United States)

    Hurst, Y K; Prescott-Clements, L E; Rennie, J S

    2004-10-23

    This paper describes a pilot study aimed at evaluating a new instrument, the patient assessment questionnaire (PAQ), which uses patient ratings for the assessment of communication skills and professionalism in vocational practitioners (VDPs). The PAQ was developed as part of an assessment system designed to address all round competence. Acohort of 99 VDPs took part in the study. Questionnaires were distributed to consecutive patients in the general dental service at two time points in the training year. Data from the pilot study was analysed to determine whether the PAQ fulfilled the criteria for robust assessment. Results provide evidence of high levels of reliability, validity and feasibility of the PAQ instrument. All indications to date suggest that the PAQ will prove to be a valuable assessment tool. It is currently being evaluated as part of the system used to assess the all round competence of dental graduates undertaking vocational training in Scotland.

  12. Assessing Social Networks in Patients with Psychotic Disorders: A Systematic Review of Instruments.

    Science.gov (United States)

    Siette, Joyce; Gulea, Claudia; Priebe, Stefan

    2015-01-01

    Evidence suggests that social networks of patients with psychotic disorders influence symptoms, quality of life and treatment outcomes. It is therefore important to assess social networks for which appropriate and preferably established instruments should be used. To identify instruments assessing social networks in studies of patients with psychotic disorders and explore their properties. A systematic search of electronic databases was conducted to identify studies that used a measure of social networks in patients with psychotic disorders. Eight instruments were identified, all of which had been developed before 1991. They have been used in 65 studies (total N of patients = 8,522). They assess one or more aspects of social networks such as their size, structure, dimensionality and quality. Most instruments have various shortcomings, including questionable inter-rater and test-retest reliability. The assessment of social networks in patients with psychotic disorders is characterized by a variety of approaches which may reflect the complexity of the construct. Further research on social networks in patients with psychotic disorders would benefit from advanced and more precise instruments using comparable definitions of and timescales for social networks across studies.

  13. FEAST: Empowering Community Residents to Use Technology to Assess and Advocate for Healthy Food Environments.

    Science.gov (United States)

    Sheats, Jylana L; Winter, Sandra J; Romero, Priscilla Padilla; King, Abby C

    2017-04-01

    Creating environments that support healthy eating is important for successful aging, particularly in light of the growing population of older adults in the United States. There is an urgent need to identify innovative upstream solutions to barriers experienced by older adults in accessing and buying healthy food. FEAST (Food Environment Assessment STudy) is an effort that is part of the global Our Voice initiative, which utilizes a combination of technology and community-engaged methods to empower citizen scientists (i.e., community residents) to: (1) use the Healthy Neighborhood Discovery Tool (Discovery Tool) mobile application to collect data (geocoded photos, audio narratives) about aspects of their environment that facilitate or hinder healthy living; and (2) use findings to advocate for change in partnership with local decision and policy makers. In FEAST, 23 racially/ethnically diverse, low-income, and food-insecure older adults residing in urban, North San Mateo County, CA, were recruited to use the Discovery Tool to examine factors that facilitated or hindered their access to food as well as their food-related behaviors. Participants collectively reviewed data retrieved from the Discovery Tool and identified and prioritized important, yet feasible, issues to address. Access to affordable healthy food and transportation were identified as the major barriers to eating healthfully and navigating their neighborhood food environments. Subsequently, participants were trained in advocacy skills and shared their findings with relevant decision and policymakers, who in turn dispelled myths and discussed and shared resources to address relevant community needs. Proximal and distal effects of the community-engaged process at 3, 6, 12, and 24 months were documented and revealed individual-, community-, and policy-level impacts. Finally, FEAST contributes to the evidence on multi-level challenges that low-income, racially/ethnically diverse older adults experience

  14. Assessing Interpersonal and Communication Skills in Radiation Oncology Residents: A Pilot Standardized Patient Program

    International Nuclear Information System (INIS)

    Ju, Melody; Berman, Abigail T.; Hwang, Wei-Ting; LaMarra, Denise; Baffic, Cordelia; Suneja, Gita; Vapiwala, Neha

    2014-01-01

    Purpose: There is a lack of data for the structured development and evaluation of communication skills in radiation oncology residency training programs. Effective communication skills are increasingly emphasized by the Accreditation Council for Graduate Medical Education and are critical for a successful clinical practice. We present the design of a novel, pilot standardized patient (SP) program and the evaluation of communication skills among radiation oncology residents. Methods and Materials: Two case scenarios were developed to challenge residents in the delivery of “bad news” to patients: one scenario regarding treatment failure and the other regarding change in treatment plan. Eleven radiation oncology residents paired with 6 faculty participated in this pilot program. Each encounter was scored by the SPs, observing faculty, and residents themselves based on the Kalamazoo guidelines. Results: Overall resident performance ratings were “good” to “excellent,” with faculty assigning statistically significant higher scores and residents assigning lower scores. We found inconsistent inter rater agreement among faculty, residents, and SPs. SP feedback was also valuable in identifying areas of improvement, including more collaborative decision making and less use of medical jargon. Conclusions: The program was well received by residents and faculty and regarded as a valuable educational experience that could be used as an annual feedback tool. Poor inter rater agreement suggests a need for residents and faculty physicians to better calibrate their evaluations to true patient perceptions. High scores from faculty members substantiate the concern that resident evaluations are generally positive and nondiscriminating. Faculty should be encouraged to provide honest and critical feedback to hone residents' interpersonal skills

  15. Development of an assessment instrument to evaluate performance of the skill of decontamination.

    Science.gov (United States)

    Farra, Sharon; Smith, Sherrill; French, DeAnne; Gillespie, Gordon

    2015-10-01

    Nurses must competently demonstrate psychomotor skills. Few reliable and valid instruments are available for psychomotor evaluation for disaster skills, including the skill of decontamination. The purpose of this study was to develop and refine an instrument to measure the skill of decontamination. A seven step instrument development design was implemented that included content validity and reliability as well as inter-rater reliability analysis. A convenience sample of approximately 140 participants was drawn from two colleges of nursing at two large academic universities. The sample included senior nursing students in either their community or final practicum nursing course. Based on a sample of 140 students who participated in a decontamination training experience using virtual reality simulation, a seven step established process for assessment of reliability and validity was implemented to develop a checklist for the skill of decontamination. The final instrument statistics: Content Validity Index for the overall instrument score was 0.94, Internal consistency coefficient=0.607(KR-20) and Inter-rater reliability=0.9114. This instrument provides a reliable and valid assessment of nurses' competency in performing the skill of decontamination offering a template for educators to develop similar tools. Copyright © 2015 Elsevier Ltd. All rights reserved.

  16. [Comprehensive Assessment of Psychiatric Residents: An Addition to the Program Admission Process].

    Science.gov (United States)

    Luis, E Jaramillo G; Elena, Martín C

    2012-01-01

    The training of medical specialists is a long and complex process. Its purpose is to guarantee the society that they are the right professionals to meet the health needs of the population. The first step to ensure this objective is the admission process. In psychiatry this process, monitoring resident students and the criteria for each one are different in each country. Admission in Colombia is a heterogeneous process, not standardized, which varies greatly from one university to another, even between private and public universities. At the National University of Colombia, the admissions process is handled by the Admissions Office and includes: a written test for which you must obtain a minimum score, a resume rating and an interview. The Teaching Committee and the Department of Psychiatry considered the admission procedure in general to be good, but in need of refinement. Due to the experience of some teachers and given the current rules, a "comprehensive assessment" for master and doctoral students was required and in 1996 it was decided that this method of assessment for admission to a specialization in Psychiatry would serve to complement the admission process. The article describes the experience of the process and its outcomes, strengths and weaknesses. Copyright © 2012 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

  17. Customisation of an instrument to assess anaesthesiologists' non-technical skills.

    Science.gov (United States)

    Jepsen, Rikke M H G; Spanager, Lene; Lyk-Jensen, Helle T; Dieckmann, Peter; Østergaard, Doris

    2015-02-22

    The objectives of the study were to identify Danish anaesthesiologists' non-technical skills and to customise the Scottish-developed Anaesthetists' Non-Technical Skills instrument for Danish anaesthesiologists. Six semi-structured group interviews were conducted with 31 operating room team members: anaes-thesiologists, nurse anaesthetists, surgeons, and scrub nurses. Interviews were transcribed verbatim and analysed using directed content analysis. Anaesthesiologists' non-technical skills were identified, coded, and sorted using the original instrument as a basis. The resulting prototype instrument was discussed with anaesthesiologists from 17 centres to ensure face validity. Interviews lasted 46-67 minutes. Identified examples of anaesthesiologists' good or poor non-technical skills fit the four categories in the original instrument: situation awareness; decision making; team working; and task management. Anaesthesiologists' leadership role in the operating room was emphasised: the original 'Task Management' category was named 'Leadership'. One new element, 'Demonstrating self-awareness' was added under the category 'Situation Awareness'. Compared with the original instrument, half of the behavioural markers were new, which reflected that being aware of and communicating one's own abilities to the team; working systematically; and speaking up to avoid adverse events were important skills. The Anaesthetists' Non-Technical Skills instrument was customised to a Danish setting using the identified non-technical skills for anaesthesiologists and the original instrument as basis. The customised instrument comprises four categories and 16 underpinning elements supported by multiple behavioural markers. Identifying non-technical skills through semi-structured group interviews and analysing them using direct content analysis proved a useful method for customising an assessment instrument to another setting.

  18. Radiology residents' comprehension of the breast imaging reporting and data system: The ultrasound lexicon and final assessment category

    Energy Technology Data Exchange (ETDEWEB)

    Jeong, Sun Hye; Lee, Eun Hye [Bucheon Hospital, Bucheon (Korea, Republic of); Roh, Yun Ho; Kim, Min Jung; Youk, Ji Hyun [Yonsei University College of Medicine, Seoul (Korea, Republic of); Yoon, Jung Hyun; Kim, Sung Hun [The Catholic University of Korea, Seoul (Korea, Republic of); Kim, You Me [Dankook University College of Medicine, Cheonan (Korea, Republic of)

    2017-07-15

    To evaluate radiology residents' performance in interpretation and comprehension of breast ultrasonographic descriptors in the Breast Imaging Reporting and Data System (BI-RADS) to suggest the adequate duration of training in breast ultrasonography. A total of 102 radiology residents working in the Department of Radiology were included in this study. They were asked to answer 16 questions about the ultrasonographic lexicon and 11 questions about the BI-RADS category. We analyzed the proportion of correct answers according to the radiology residents’ year of training and duration of breast imaging training. With respect to the duration of breast imaging training, the proportion of correct answers for lexicon descriptors ranged from 77.2% to 81.3% (p = 0.368) and the proportion of correct answers for the BI-RADS category was highest after three-four months of training compared with after one month of training (p = 0.033). The proportion of correct answers for lexicon descriptors and BI-RADS category did not differ significantly according to the year of residency training. Radiology residents' comprehension of the BI-RADS category on breast ultrasonography was not associated with their year of residency training. Based on our findings, radiology residents' assessment of the BI-RADS category was significantly improved with three-four months of training compared with one month of training.

  19. Evaluating the effectiveness of impact assessment instruments: Theorising the nature and implications of their political constitution

    International Nuclear Information System (INIS)

    Cashmore, Matthew; Richardson, Tim; Hilding-Ryedvik, Tuija; Emmelin, Lars

    2010-01-01

    The central role of impact assessment instruments globally in policy integration initiatives has been cemented in recent years. Associated with this trend, but also reflecting political emphasis on greater accountability in certain policy sectors and a renewed focus on economic competitiveness in Western countries, demand has increased for evidence that these instruments are effective (however defined). Resurgent interest in evaluation has not, however, been accompanied by the conceptual developments required to redress longstanding theoretical problems associated with such activities. In order to sharpen effectiveness evaluation theory for impact assessment instruments this article critically examines the neglected issue of their political constitution. Analytical examples are used to concretely explore the nature and significance of the politicisation of impact assessment. It is argued that raising awareness about the political character of impact assessment instruments, in itself, is a vital step in advancing effectiveness evaluation theory. Broader theoretical lessons on the framing of evaluation research are also drawn from the political analysis. We conclude that, at least within the contemporary research context, learning derived from analysing the meaning and implications of plural interpretations of effectiveness represents the most constructive strategy for advancing impact assessment and policy integration theory.

  20. Psychometric properties of assessment instruments for autism spectrum disorder: a systematic review of Brazilian studies

    Directory of Open Access Journals (Sweden)

    Bárbara Backes

    2014-07-01

    Full Text Available Objective To systematically review the scientific literature on the psychometric properties of international instruments for the assessment of autism spectrum disorder (ASD in the Brazilian population. Methods A search of bibliographic references was conducted in six electronic databases: PsycINFO, PubMed, IndexPsi, Lilacs, Capes (theses and dissertations and SciELO. The studies were selected by two independent researchers. Results The procedure identified 11 studies of the Brazilian population that encompassed six ASD assessment tools. Given the information provided, the adaptation of the M-CHAT, a screening instrument, was the best conducted. All steps of the adaptation process were described and the changes made to the final version of the instrument were presented, which was not addressed in other studies. In terms of reliability, all of the instruments that assessed internal consistency showed adequate values. In addition, the ADI-R and the CARS adaptations also satisfactorily contemplated inter-rater reliability and test-retest indices, respectively. Finally, all studies aiming to validate instruments showed evidence of validity and sensitivity, and specificity values above 0.90 were observed in the ASQ, ADI-R and ABC. Conclusion Considering both the psychometric aspects and the copyright information, the screening instrument that currently appears to be best indicated for clinical and research use is the M-CHAT. It was also noticed that there are still no specific ASD diagnostic tools available for use in Brazil. This lack of diagnostic instruments consists in a critical situation for the improvement of clinical practice and the development of research in this area.

  1. Social and emotional wellbeing assessment instruments for use with Indigenous Australians: A critical review.

    Science.gov (United States)

    Le Grande, M; Ski, C F; Thompson, D R; Scuffham, P; Kularatna, S; Jackson, A C; Brown, A

    2017-08-01

    There is growing recognition that in addition to universally recognised domains and indicators of wellbeing (such as population health and life expectancy), additional frameworks are required to fully explain and measure Indigenous wellbeing. In particular, Indigenous Australian wellbeing is largely determined by colonisation, historical trauma, grief, loss, and ongoing social marginalisation. Dominant mainstream indicators of wellbeing based on the biomedical model may therefore be inadequate and not entirely relevant in the Indigenous context. It is possible that "standard" wellbeing instruments fail to adequately assess indicators of health and wellbeing within societies that have a more holistic view of health. The aim of this critical review was to identify, document, and evaluate the use of social and emotional wellbeing measures within the Australian Indigenous community. The instruments were systematically described regarding their intrinsic properties (e.g., generic v. disease-specific, domains assessed, extent of cross-cultural adaptation and psychometric characteristics) and their purpose of utilisation in studies (e.g., study setting, intervention, clinical purpose or survey). We included 33 studies, in which 22 distinct instruments were used. Three major categories of social and emotional wellbeing instruments were identified: unmodified standard instruments (10), cross-culturally adapted standard instruments (6), and Indigenous developed measures (6). Recommendations are made for researchers and practitioners who assess social and emotional wellbeing in Indigenous Australians, which may also be applicable to other minority groups where a more holistic framework of wellbeing is applied. It is advised that standard instruments only be used if they have been subject to a formal cross-cultural adaptation process, and Indigenous developed measures continue to be developed, refined, and validated within a diverse range of research and clinical settings

  2. Career-Success Scale – A new instrument to assess young physicians' academic career steps

    OpenAIRE

    Buddeberg Claus; Stamm Martina; Buddeberg-Fischer Barbara; Klaghofer Richard

    2008-01-01

    Abstract Background Within the framework of a prospective cohort study of Swiss medical school graduates, a Career-Success Scale (CSS) was constructed in a sample of young physicians choosing different career paths in medicine. Furthermore the influence of personality factors, the participants' personal situation, and career related factors on their career success was investigated. Methods 406 residents were assessed in terms of career aspired to, and their career progress. The Career-Success...

  3. Preschool language assessment instrument, second edition, in Brazilian Portuguese-speaking children.

    Science.gov (United States)

    Lindau, Tâmara Andrade; Rossi, Natalia Freitas; Giacheti, Célia Maria

    2014-01-01

    To present a brief report on the initial results of the application of Preschool Language Assessment Instrument, second edition, in Brazilian Portuguese-speaking children. The study included 300 children with typical language development, from both genders, aged from 3 to 5 years and 11 months, as proposed by the original test version. After translation, back-translation, and adaptation of the second edition of the Preschool Language Assessment Instrument, the instrument was administered to investigate the receptive and expressive language skills. There was a significant difference between the average gross scores of the three groups for both "receptive" and "expressive" language skills, and a growing tendency of scores according to age. After analysis, we found that versions translated and adapted for Brazilian Portuguese speakers allow one to evaluate and discriminate the performance of children in receptive and expressive language skills, according to age group, as well as the original version.

  4. Reliability assessment of a peer evaluation instrument in a team-based learning course

    Directory of Open Access Journals (Sweden)

    Wahawisan J

    2016-03-01

    Full Text Available Objective: To evaluate the reliability of a peer evaluation instrument in a longitudinal team-based learning setting. Methods: Student pharmacists were instructed to evaluate the contributions of their peers. Evaluations were analyzed for the variance of the scores by identifying low, medium, and high scores. Agreement between performance ratings within each group of students was assessed via intra-class correlation coefficient (ICC. Results: We found little variation in the standard deviation (SD based on the score means among the high, medium, and low scores within each group. The lack of variation in SD of results between groups suggests that the peer evaluation instrument produces precise results. The ICC showed strong concordance among raters. Conclusions: Findings suggest that our student peer evaluation instrument provides a reliable method for peer assessment in team-based learning settings.

  5. The relevance of residency in the assessment of tax liability in Nigeria

    African Journals Online (AJOL)

    Residency is a key factor in taxation, since a taxpayer is generally liable to payment of taxes to the state where he is resident. This paper intends to examine this important factor, the rules involved and whether it is still relevant to taxation of companies and individuals, under the present day tax regime in Nigeria.

  6. Development of a Tool to Assess Resident Physicians' Perceived Competence for Patient-Centered Obesity Counseling

    Science.gov (United States)

    Burton, Amy M.; Brezausek, Carl M.; Hendricks, Peter S.; Agne, April A.; Hankins, Shirley L.; Cherrington, Andrea L.

    2015-01-01

    Physicians report a number of barriers to obesity counseling, among them low perceived competence in the ability to counsel. While there is increasing recognition of the need for resident training on counseling, implementation requires residency programs to have the necessary curricula and tools to evaluate training effectiveness. This study's…

  7. A Simulation-based, cognitive assessment of resident decision making during complex urinary catheterization scenarios.

    Science.gov (United States)

    Nathwani, Jay N; Law, Katherine E; Witt, Anna K; Ray, R D; DiMarco, S M; Pugh, C M

    2017-04-01

    This study explores general surgery residents' decision making skills in uncommon, complex urinary catheter scenarios. 40 residents were presented with two scenarios. Scenario A was a male with traumatic urethral injury and scenario B was a male with complete urinary blockage. Residents verbalized whether they would catheterize the patient and described the workup and management of suspected pathologies. Residents' decision paths were documented and analyzed. In scenario A, 45% of participants chose to immediately consult Urology. 47.5% named five diagnostic tests to decide if catheterization was safe. In scenario B, 27% chose to catheterize with a 16 French Coude. When faced with catheterization failure, participants randomly upsized or downsized catheters. Chi-square analysis revealed no measurable consensus amongst participants. Residents need more training in complex decision making for urinary catheterization. The decision trees generated in this study provide a useful blueprint of residents' learning needs. Exploration of general surgery residents' decision making skills in uncommon, complex urinary catheter scenarios revealed major deficiencies. The resulting decision trees reveal residents' learning needs. Copyright © 2017 Elsevier Inc. All rights reserved.

  8. Development of an instrument to measure medical students' perceptions of the assessment environment: initial validation.

    Science.gov (United States)

    Sim, Joong Hiong; Tong, Wen Ting; Hong, Wei-Han; Vadivelu, Jamuna; Hassan, Hamimah

    2015-01-01

    Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students' perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument. The Assessment Environment Questionnaire (AEQ), a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree) Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors' institution. The response rate was 626/794 (78.84%). To establish construct validity, exploratory factor analysis (EFA) with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined. Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items), learning and performance (five items), information on assessment (five items), and assessment system/procedure (three items), which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of 'feedback mechanism' recorded the lowest mean (2.39/4.00), whereas the factor/subscale of 'assessment system/procedure' scored the highest mean (2.92/4.00). Significant differences were found among the AEQ scores of students from different academic years. The AEQ is a valid and reliable

  9. Development of an instrument to measure medical students’ perceptions of the assessment environment: initial validation

    Directory of Open Access Journals (Sweden)

    Joong Hiong Sim

    2015-10-01

    Full Text Available Introduction: Assessment environment, synonymous with climate or atmosphere, is multifaceted. Although there are valid and reliable instruments for measuring the educational environment, there is no validated instrument for measuring the assessment environment in medical programs. This study aimed to develop an instrument for measuring students’ perceptions of the assessment environment in an undergraduate medical program and to examine the psychometric properties of the new instrument. Method: The Assessment Environment Questionnaire (AEQ, a 40-item, four-point (1=Strongly Disagree to 4=Strongly Agree Likert scale instrument designed by the authors, was administered to medical undergraduates from the authors’ institution. The response rate was 626/794 (78.84%. To establish construct validity, exploratory factor analysis (EFA with principal component analysis and varimax rotation was conducted. To examine the internal consistency reliability of the instrument, Cronbach's α was computed. Mean scores for the entire AEQ and for each factor/subscale were calculated. Mean AEQ scores of students from different academic years and sex were examined. Results: Six hundred and eleven completed questionnaires were analysed. EFA extracted four factors: feedback mechanism (seven items, learning and performance (five items, information on assessment (five items, and assessment system/procedure (three items, which together explained 56.72% of the variance. Based on the four extracted factors/subscales, the AEQ was reduced to 20 items. Cronbach's α for the 20-item AEQ was 0.89, whereas Cronbach's α for the four factors/subscales ranged from 0.71 to 0.87. Mean score for the AEQ was 2.68/4.00. The factor/subscale of ‘feedback mechanism’ recorded the lowest mean (2.39/4.00, whereas the factor/subscale of ‘assessment system/procedure’ scored the highest mean (2.92/4.00. Significant differences were found among the AEQ scores of students from different

  10. Radiology resident MR and CT image analysis skill assessment using an interactive volumetric simulation tool - the RadioLOG project

    Energy Technology Data Exchange (ETDEWEB)

    Gondim Teixeira, Pedro Augusto; Leplat, Christophe [CHRU-Nancy Hopital Central, Service d' Imagerie Guilloz, Nancy (France); Universite de Lorraine, IADI U947, Nancy (France); Cendre, Romain [INSERM, CIC-IT 1433, Nancy (France); Hossu, Gabriela; Felblinger, Jacques [Universite de Lorraine, IADI U947, Nancy (France); INSERM, CIC-IT 1433, Nancy (France); Blum, Alain [CHRU-Nancy Hopital Central, Service d' Imagerie Guilloz, Nancy (France); Braun, Marc [CHRU-Nancy Hopital Central, Service de Neuroradiologie, Nancy (France)

    2017-02-15

    Assess the use of a volumetric simulation tool for the evaluation of radiology resident MR and CT interpretation skills. Forty-three participants were evaluated with a software allowing the visualisation of multiple volumetric image series. There were 7 medical students, 28 residents and 8 senior radiologists among the participants. Residents were divided into two sub-groups (novice and advanced). The test was composed of 15 exercises on general radiology and lasted 45 min. Participants answered a questionnaire on their experience with the test using a 5-point Likert scale. This study was approved by the dean of the medical school and did not require ethics committee approval. The reliability of the test was good with a Cronbach alpha value of 0.9. Test scores were significantly different in all sub-groups studies (p < 0.0225). The relation between test scores and the year of residency was logarithmic (R{sup 2} = 0.974). Participants agreed that the test reflected their radiological practice (3.9 ± 0.9 on a 5-point scale) and was better than the conventional evaluation methods (4.6 ± 0.5 on a 5-point scale). This software provides a high quality evaluation tool for the assessment of the interpretation skills in radiology residents. (orig.)

  11. Mixed-realism simulation of adverse event disclosure: an educational methodology and assessment instrument.

    Science.gov (United States)

    Matos, Francisco M; Raemer, Daniel B

    2013-04-01

    Physicians have an ethical duty to disclose adverse events to patients or families. Various strategies have been reported for teaching disclosure, but no instruments have been shown to be reliable for assessing them.The aims of this study were to report a structured method for teaching adverse event disclosure using mixed-realism simulation, develop and begin to validate an instrument for assessing performance, and describe the disclosure practice of anesthesiology trainees. Forty-two anesthesiology trainees participated in a 2-part exercise with mixed-realism simulation. The first part took place using a mannequin patient in a simulated operating room where trainees became enmeshed in a clinical episode that led to an adverse event and the second part in a simulated postoperative care unit where the learner is asked to disclose to a standardized patient who systematically moves through epochs of grief response. Two raters scored subjects using an assessment instrument we developed that combines a 4-element behaviorally anchored rating scale (BARS) and a 5-stage objective rating scale. The performance scores for elements within the BARS and the 5-stage instrument showed excellent interrater reliability (Cohen's κ = 0.7), appropriate range (mean range for BARS, 4.20-4.47; mean range for 5-stage instrument, 3.73-4.46), and high internal consistency (P realism simulation that engages learners in an adverse event and allows them to practice disclosure to a structured range of patient responses. We have developed a reliable 2-part instrument with strong psychometric properties for assessing disclosure performance.

  12. Velopharyngeal dysfunction: a systematic review of major instrumental and auditory-perceptual assessments

    Directory of Open Access Journals (Sweden)

    Paniagua, Lauren Medeiros

    2014-01-01

    Full Text Available Introduction: Velopharyngeal dysfunction may cause impaired verbal communication skills in individuals with cleft lip and palate; thus, patients with this disorder need to undergo both instrumental and auditory-perceptual assessments. Objective: To investigate the main methods used to evaluate velopharyngeal function in individuals with cleft lip and palate and to determine whether there is an association between videonasoendoscopy results and auditory-perceptual assessments. Method: We conducted a systematic review of the literature on instrumental and auditory-perceptual assessments. We searched the PubMed, Medline, Lilacs, Cochrane, and SciELO databases from October to November 2012. Summary of findings: We found 1,300 studies about the topic of interest published between 1990 and 2012. Of these, 56 studies focused on velopharyngeal physiology; 29 studies presented data on velopharyngeal physiology using at least 1 instrumental assessment and/or 1 auditory-perceptual assessment, and 12 studies associated the results of both types of assessments. Only 3 studies described in detail the analysis of both methods of evaluating velopharyngeal function; however, associations between these findings were not analyzed. Conclusion: We found few studies clearly addressing the criteria chosen to investigate velopharyngeal dysfunction and associations between videonasoendoscopy results and auditory-perceptual assessments.

  13. Challenges encountered when conducting a dental health needs assessment of older people resident in care homes: experience from England.

    Science.gov (United States)

    Shah, K K; Tabari, E D

    2013-03-01

    This paper describes the process of undertaking a dental health needs assessment of older people resident in care homes in the North East of England and the challenges involved. It illustrates many competency areas of interest to dental public health practitioners: oral health surveillance, dental public health intelligence and collaborative working.

  14. Questionnaire surveys on health and working conditions: development of an instrument for risk assessment in companies

    NARCIS (Netherlands)

    Weel, A. N.; Broersen, J. P.; van Dijk, F. J.

    2000-01-01

    Periodic Occupational Health Surveys (POHS) are frequently used by occupational health and safety services in the Netherlands as a risk assessment instrument. These surveys include a questionnaire on work and health. Systematic attention is paid in this questionnaire to a broad range of working

  15. Food Sanitation and Safety Self-Assessment Instrument for School Nutrition Programs.

    Science.gov (United States)

    California State Dept. of Education, Sacramento.

    Like food-service establishments, child nutrition programs are responsible for preserving the quality and wholesomeness of food. Proper food-handling practices prevent contamination and job-related accidents. Application of the evaluation instrument presented in this document to individual programs helps to define proper practices, assess the…

  16. Development of an Instrument to Assess Parent-College Child Communication Regarding Alcohol Use Behaviors

    Science.gov (United States)

    Chaney, Beth H.; Cremeens, Jennifer

    2013-01-01

    Background: Past research suggests that parent-child communication can serve as protective factors to reduce alcohol misuse among college-aged children. Purpose: This article presents the methodology used and preliminary findings for developing and validating an instrument to assess parent-college student communication regarding alcohol use.…

  17. Reliability and sources of validity evidences for a instrument assessing the quality of concept maps

    Directory of Open Access Journals (Sweden)

    Beatriz Lucas-Molina

    2017-05-01

    Full Text Available Several authors have noticed the interest and relevance of concept mapping as a tool for promoting meaningful learning. However, the current literature highlights the lack of procedures for the assessment of concept mapping using objective criteria, as well as the complexity of the existing ones. The aim of this study was to develop an instrument for assessing concept maps through a rubric format. It is expected to provide the students with a tool that allows, through precise indicators, the assessment of the quality of their and others’ performance. A rubric that includes the most widely accepted criteria in the literature is presented and examined. Two pilot studies with a group of pre-service teacher students each one (n = 31 and n = 18, respectively were conducted through a four hours training program. The results indicated that the designed instrument shows good indicators of interrater reliability and discriminant validity. It is then concluded that the designed instrument shows adequate psychometric properties. The instrument allows both the use of objective criteria in the assessment of concept maps, and the comparison between different executions.

  18. Validation and Exploration of Instruments for Assessing Public Knowledge of and Attitudes toward Nanotechnology

    Science.gov (United States)

    Lin, Shu-Fen; Lin, Huann-shyang; Wu, Yi-ying

    2013-01-01

    The purposes of this study were to develop instruments that assess public knowledge of nanotechnology (PKNT), public attitudes toward nanotechnology (PANT) and conduct a pilot study for exploring the relationship between PKNT and PANT. The PKNT test was composed of six scales involving major nanotechnology concepts, including size and scale,…

  19. Identifying Promising Items: The Use of Crowdsourcing in the Development of Assessment Instruments

    Science.gov (United States)

    Sadler, Philip M.; Sonnert, Gerhard; Coyle, Harold P.; Miller, Kelly A.

    2016-01-01

    The psychometrically sound development of assessment instruments requires pilot testing of candidate items as a first step in gauging their quality, typically a time-consuming and costly effort. Crowdsourcing offers the opportunity for gathering data much more quickly and inexpensively than from most targeted populations. In a simulation of a…

  20. Technological Pedagogical Content Knowledge (TPACK): The Development and Validation of an Assessment Instrument for Preservice Teachers

    Science.gov (United States)

    Schmidt, Denise A.; Baran, Evrim; Thompson, Ann D.; Mishra, Punya; Koehler, Matthew J.; Shin, Tae S.

    2009-01-01

    Based in Shulman's idea of Pedagogical Content Knowledge, Technological Pedagogical Content Knowledge (TPACK) has emerged as a useful frame for describing and understanding the goals for technology use in preservice teacher education. This paper addresses the need for a survey instrument designed to assess TPACK for preservice teachers. The paper…

  1. Assessment of asymmetric leg loading before and after total hip arthroplasty using instrumented shoes.

    Science.gov (United States)

    Martínez-Ramírez, Alicia; Weenk, Dirk; Lecumberri, Pablo; Verdonschot, Nico; Pakvis, Dean; Veltink, Peter H

    2014-02-28

    Total hip arthroplasty is a successful surgical treatment in patients with osteoarthritis of the hip. Different questionnaires are used by the clinicians to assess functional capacity and the patient's pain, despite these questionnaires are known to be subjective. Furthermore, many studies agree that kinematic and kinetic parameters are crucial to evaluate and to provide useful information about the patient's evolution for clinicians and rehabilitation specialists. However, these quantities can currently only be obtained in a fully equipped gait laboratory. Instrumented shoes can quantify gait velocity, kinetic, kinematic and symmetry parameters. The aim of this study was to investigate whether the instrumented shoes is a sufficiently sensitive instrument to show differences in mobility performance before and after total hip arthroplasty. In this study, patients undergoing total hip arthroplasty were measured before and 6-8 months after total hip arthroplasty. Both measurement sessions include 2 functional mobility tasks while the subject was wearing instrumented shoes. Before each measurement the Harris Hip Score and the Traditional Western Ontario and McMaster Universities osteoarthritis index were administered as well. The stance time and the average vertical ground reaction force measured with the instrumented shoes during walking, and their symmetry index, showed significant differences before and after total hip arthroplasty. However, the data obtained with the sit to stand test did not reveal this improvement after surgery. Our results show that inter-limb asymmetry during a walking activity can be evaluated with the instrumented shoes before and after total hip arthroplasty in an outpatient clinical setting.

  2. Three instruments for assessment of WBGT and a comparison wiwh WGT (Botsball).

    Science.gov (United States)

    Onkaram, B; Stroschein, L A; Goldman, R F

    1980-09-01

    Environmental heat stress, expressed as the Wet Bulb Globe Temperature (WBGT), was measured outdoors using three different instruments: a) the conventional shaded dry-bulb, 15.2-cm black globe and naturally convected wet bulb thermometers, b) a minaturized thermometer kit, and c) a commercial WBGT instrument using a thermistor sensors. The WBGT values were compared with the Wet Globe Temperature (WGT) measured with a Botsball. Measurements were made visually on the instruments at regular intervals and an automated data collection system also was used to obtain data from thermocouples attached to the instruments. Statisticallly significant differences in WBGT readings were found among the instruments; however, the difference for a given environment usually was less than 0.5 degrees C. Readings taken by visual observations resulted in WBGT values which differed by less than 0.3 degrees C from those calculated from the automated data collection system. By using an equation derived for the Botsball, WBGT = 1.044 WGT - 0.187 (in degrees C), it is possible to convert the Botsball thermometer dial to indicate the conventional WBGT for outdoor environments, thus making it a simple instrument for assessing environmental heat stress at the work site.

  3. Instrument for assessing the quality of mobile emergency pre-hospital care: content validation

    Directory of Open Access Journals (Sweden)

    Rodrigo Assis Neves Dantas

    2015-06-01

    Full Text Available OBJECTIVES To validate an instrument to assess quality of mobile emergency pre-hospital care. METHOD A methodological study where 20 professionals gave their opinions on the items of the proposed instrument. The analysis was performed using Kappa test (K and Content Validity Index (CVI, considering K> 0.80 and CVI ≥ 0.80. RESULTS Three items were excluded from the instrument: Professional Compensation; Job Satisfaction and Services Performed. Items that obtained adequate K and CVI indexes and remained in the instrument were: ambulance conservation status; physical structure; comfort in the ambulance; availability of material resources; user/staff safety; continuous learning; safety demonstrated by the team; access; welcoming; humanization; response time; costumer privacy; guidelines on care; relationship between professionals and costumers; opportunity for costumers to make complaints and multiprofessional conjunction/actuation. CONCLUSION The instrument to assess quality of care has been validated and may contribute to the evaluation of pre-hospital care in mobile emergency services.

  4. Assessment of instrumentation needs for advanced coal power plant applications: Final report

    Energy Technology Data Exchange (ETDEWEB)

    Nelson, E.T.; Fischer, W.H.; Lipka, J.V.; Rutkowski, M.D.; Zaharchuk, R.

    1987-10-01

    The purpose of this study was to identify contaminants, identify instrumentation needs, assess available instrumentation and identify instruments that should be developed for controlling and monitoring gas streams encountered in the following power plants: Integrated Gasification Combined Cycle, Pressurized Fluidized Bed Combustion, and Gasification Molten Carbonate Fuel Cell. Emphasis was placed on hot gas cleanup system gas stream analysis, and included process control, research and environmental monitoring needs. Commercial process analyzers, typical of those currently used for process control purposes, were reviewed for the purpose of indicating commercial status. No instrument selection guidelines were found which were capable of replacing user interaction with the process analyzer vendors. This study leads to the following conclusions: available process analyzers for coal-derived gas cleanup applications satisfy current power system process control and regulatory requirements, but they are troublesome to maintain; commercial gas conditioning systems and in situ analyzers continue to be unavailable for hot gas cleanup applications; many research-oriented gas stream characterization and toxicity assessment needs can not be met by commercially available process analyzers; and greater emphasis should be placed on instrumentation and control system planning for future power plant applications. Analyzers for specific compounds are not recommended other than those needed for current process control purposes. Instead, some generally useful on-line laser-based and inductively coupled plasma methods are recommended for further development because of their potential for use in present hot gas cleanup research and future optimization, component protection and regulation compliance activities. 48 refs., 21 figs., 26 tabs.

  5. Development of a video-simulation instrument for assessing cognition in older adults

    OpenAIRE

    Ip, Edward H.; Barnard, Ryan; Marshall, Sarah A.; Lu, Lingyi; Sink, Kaycee; Wilson, Valerie; Chamberlain, Dana; Rapp, Stephen R.

    2017-01-01

    BACKGROUND: Commonly used methods to assess cognition, such as direct observation, self-report, or neuropsychological testing, have significant limitations. Therefore, a novel tablet computer-based video simulation was created with the goal of being valid, reliable, and easy to administer. The design and implementation of the SIMBAC (Simulation-Based Assessment of Cognition) instrument is described in detail, as well as informatics "lessons learned" during development.RESULTS: The software em...

  6. Intimate Partner Violence Programs in a Children's Hospital: Comprehensive Assessment Utilizing a Delphi Instrument.

    Science.gov (United States)

    Randell, Kimberly A; Evans, Sarah E; O'Malley, Donna; Dowd, M Denise

    2015-03-01

    The purpose of this study was to conduct a baseline assessment of intimate partner violence (IPV) practices in a pediatric hospital system. The Delphi Instrument for Hospital-based Domestic Violence Programs was used to assess the structure and components of the hospital system's IPV practices. Through key stakeholder interviews, we also assessed IPV practices in individual patient care areas. Qualitative analysis of interview data used a grounded theory approach. The hospital scored 17 of 100 points on the Delphi instrument assessment. Key areas of weakness identified by the Delphi instrument and interviews included lack of coordinated provider training and evaluation of IPV-related processes and no standards for IPV screening, safety assessment, and documentation. Most interviewees supported addressing IPV; all identified barriers to IPV screening at individual provider and institutional levels. Institutional barriers included lack of a standardized response to IPV disclosure, need for individualized screening protocols for different patient care settings, lack of standardized provider training, concerns about overextending social work resources, and lack of resources for hospital staff experiencing vicarious trauma. Individual barriers included concern that screening may harm physician-patient-family relationships and the perception that physicians are unwilling to address psychosocial issues. The Delphi Instrument for Hospital-based Domestic Violence Programs identified weaknesses and key areas for improvement in IPV practices. Deficiencies revealed by the Delphi instrument were affirmed by individual interview results. Institutional and individual provider level barriers must be addressed to optimize IPV practices in a pediatric hospital system. Copyright © 2015 by the American Academy of Pediatrics.

  7. Assessing the validity and intra-observer agreement of the MIDAM-LTC; an instrument measuring factors that influence personal dignity in long-term care facilities

    Science.gov (United States)

    2014-01-01

    Background Patients who are cared for in long-term care facilities are vulnerable to lose personal dignity. An instrument measuring factors that influence dignity can be used to better target dignity-conserving care to an individual patient, but no such instrument is yet available for the long-term care setting. The aim of this study was to create the Measurement Instrument for Dignity AMsterdam - for Long-Term Care facilities (MIDAM-LTC) and to assess its validity and intra-observer agreement. Methods Thirteen items specific for the LTC setting were added to the earlier developed, more general MIDAM. The MIDAM-LTC consisted of 39 symptoms or experiences for which presence as well as influence on dignity were asked, and a single item score for overall personal dignity. Questionnaires containing the MIDAM-LTC were administered face-to-face at two moments (with a 1-week interval) to 95 nursing home residents residing on general medical wards of six nursing homes in the Netherlands. Constructs related to dignity (WHO Well-Being Five Index, quality of life and physical health status) were also measured. Ten residents answered the questions while thinking aloud. Content validity, construct validity and intra-observer agreement were examined. Results Nine of the 39 items barely exerted influence on dignity. Eight of them could be omitted from the MIDAM-LTC, because the thinking aloud method revealed sensible explanations for their small influence on dignity. Residents reported that they missed no important items. Hypotheses to support construct validity, about the strength of correlations between on the one hand personal dignity and on the other hand well-being, quality of life or physical health status, were confirmed. On average, 83% of the scores given for each item’s influence on dignity were practically consistent over 1 week, and more than 80% of the residents gave consistent scores for the single item score for overall dignity. Conclusion The MIDAM-LTC has good

  8. Systematic pain assessment using an observational scale in nursing home residents with dementia: exploring feasibility and applied interventions.

    Science.gov (United States)

    Zwakhalen, Sandra M G; van't Hof, Charlotte E; Hamers, Jan P H

    2012-11-01

    To investigate the feasibility of regular pain assessment using an observational scale in nursing home residents with dementia and; determine interventions applied after diagnosing possible pain. Pain occurs regularly among nursing home residents with dementia and is frequently undertreated. Over the last decade a variety of observational scales have been developed to assess pain in elderly people with dementia. One of these observational scales is pain assessment using an observational scale. There are indications that the regular use of pain assessments scales can contribute to an adequate diagnosis of pain and therefore would improve pain treatment. In this exploratory descriptive observational study regular pain assessment using an observational scale as an intervention was evaluated. Data were collected during a 6-week period (August-September 2009) where pain was measured twice a week among 22 residents of a psychogeriatric nursing home ward, using the pain assessment using an observational scale scale. Interventions undertaken as a result of the pain score were recorded on a datasheet. After the third and sixth week the implementation of pain assessment was evaluated with staff members using interviews. In total, 264 pain assessments were conducted using the pain assessment using an observational scale. Of all scheduled standardized assessments, 90% were completed. Sixty out of 264 assessment resulted in a pain score. The completed datasheets (n = 39), including information on the selected intervention and the reason for selecting a specific intervention, showed that a pain score (n = 17) did not often result in any intervention. The majority of interventions undertaken consisted of a non-pharmacological approach (n = 19). This study demonstrates that although there was a high compliance rate, pain relieving interventions were not frequently applied. Interventions undertaken after pain assessment were mainly non-pharmacological. Providing nursing staff

  9. [Legal capacity and instruments assessing cognitive functions in patients with dementia].

    Science.gov (United States)

    Voskou, P; Papageorgiou, S; Economou, A; Douzenis, A

    2017-01-01

    The term "legal capacity" refers to the ability of a person to make a valid declaration of his will or to accept such a declaration. This ability constitutes the main condition for the validity of the legal transaction. The legal transaction includes issues that are adjusted by the Civil Code with which the relations of the citizens in a society are regulated. General practitioners and legal advisors, in any case of a person with cognitive impairment of various severity, should take into account that the assessment tests of the cognitive functions are not by themselves diagnostic of the dementia and they cannot be used as the only way of evaluation of the capacity of patients with cognitive impairment or possible dementia to respond to the needs of everyday life and in more complex decisions, such as the legal capacity. The existing methods for the assessment of the cognitive functions are valuable, mainly, for the detection of any cognitive impairment which may not be perceptible during the clinical evaluation of the patient and secondly for the detection of any changes in the cognitive status of the patient during its following up. The description and study of the instruments which are frequently used in the international scientific society for the assessment of the cognitive functions of the patients with mild cognitive impairment or dementia, during the evaluation of the legal capacity of these patients. The literature relevant to the existing methods assessing the cognitive functions during the evaluation of the legal capacity of patients with dementia was reviewed. The scientific database searched was Pubmed, Medline and Scopus. The key-words used were cognitive functions, dementia, instruments, legal capacity. Various instruments which assess the cognitive functions have been developed and can be grouped in 4 categories. The first one includes instruments used for the general assessment of the cognitive status. These instruments can be extensive or short and

  10. Neurocritical care education during neurology residency

    Science.gov (United States)

    Drogan, O.; Manno, E.; Geocadin, R.G.; Ziai, W.

    2012-01-01

    Objective: Limited information is available regarding the current state of neurocritical care education for neurology residents. The goal of our survey was to assess the need and current state of neurocritical care training for neurology residents. Methods: A survey instrument was developed and, with the support of the American Academy of Neurology, distributed to residency program directors of 132 accredited neurology programs in the United States in 2011. Results: A response rate of 74% (98 of 132) was achieved. A dedicated neuroscience intensive care unit (neuro-ICU) existed in 64%. Fifty-six percent of residency programs offer a dedicated rotation in the neuro-ICU, lasting 4 weeks on average. Where available, the neuro-ICU rotation was required in the vast majority (91%) of programs. Neurology residents' exposure to the fundamental principles of neurocritical care was obtained through a variety of mechanisms. Of program directors, 37% indicated that residents would be interested in performing away rotations in a neuro-ICU. From 2005 to 2010, the number of programs sending at least one resident into a neuro-ICU fellowship increased from 14% to 35%. Conclusions: Despite the expansion of neurocritical care, large proportions of US neurology residents have limited exposure to a neuro-ICU and neurointensivists. Formal training in the principles of neurocritical care may be highly variable. The results of this survey suggest a charge to address the variability of resident education and to develop standardized curricula in neurocritical care for neurology residents. PMID:22573636

  11. Comparison of two different approaches for the application of the mini nutritional assessment in nursing homes: resident interviews versus assessment by nursing staff.

    Science.gov (United States)

    Kaiser, R; Winning, K; Uter, W; Lesser, S; Stehle, P; Sieber, C C; Bauer, J M

    2009-12-01

    When the Mini Nutritional Assessment (MNA) was developed, the authors did not specifically focus on the nursing home setting. Due to a number of particularities of nursing home residents, such as cognitive and linguistic disabilities, a number of uncertainties with regard to its application await clarification. The aim of this study was to compare the results of two different modes of MNA application in nursing homes: resident interviews versus assessment by nursing staff. The MNA was applied to 200 residents of two municipal nursing homes in Nuremberg, Germany. First one-on-one interviews of the residents were conducted by two researchers from our group. Next, the MNA was applied by the attending nursing staff who was blinded to the results of the first MNA. To evaluate the prognostic properties of the two different approaches, data on mortality of the screened residents were collected during a six-month follow-up period. Among 200 residents (f 147 m 53, f 86.5 +/- 7.4 y. m 83.0 +/- 8.5 y.), the MNA could be applied to 138 residents (69.0%) by one-on-one interviews and to 188 residents (94.0%) by the nursing staff. 15.2% of the residents were categorised as malnourished by the interviews and 8.7% by the nursing staff's assessment. The agreement of the two forms was low for the MNA short form (weighted kappa = 0.31; 95% CI: 0.14 - 0.47) as well as for the full MNA (weighted kappa = 0.35; 95% CI: 0.27 - 0.44). After exclusion of residents with cognitive impairment (n=89), agreement for the full version increased (weighted kappa = 0.47, 95% CI 0.25 - 0.68). 25 (12.5%) study participants deceased during the follow-up period. Mortality was significantly associated with the mortality for both approaches, while the MNA application by the nursing staff proved to be superior (nursing staff p application rate is higher and interference with cognitive as well as linguistic deficits is lower. In future studies, the mode of MNA application in nursing home residents should be

  12. Quality of synthetic speech perceptual dimensions, influencing factors, and instrumental assessment

    CERN Document Server

    Hinterleitner, Florian

    2017-01-01

    This book reviews research towards perceptual quality dimensions of synthetic speech, compares these findings with the state of the art, and derives a set of five universal perceptual quality dimensions for TTS signals. They are: (i) naturalness of voice, (ii) prosodic quality, (iii) fluency and intelligibility, (iv) absence of disturbances, and (v) calmness. Moreover, a test protocol for the efficient indentification of those dimensions in a listening test is introduced. Furthermore, several factors influencing these dimensions are examined. In addition, different techniques for the instrumental quality assessment of TTS signals are introduced, reviewed and tested. Finally, the requirements for the integration of an instrumental quality measure into a concatenative TTS system are examined.

  13. An Instrument to Assess Self-Statements During Public Speaking: Scale Development and Preliminary Psychometric Properties

    Science.gov (United States)

    Hofmann, Stefan G.; DiBartolo, Patricia Marten

    2006-01-01

    Public speaking is the most commonly reported fearful social situation. Although a number of contemporary theories emphasize the importance of cognitive processes in social anxiety, there is no instrument available to assess fearful thoughts experienced during public speaking. The Self-Statements During Public Speaking (SSPS) scale is a 10-item questionnaire consisting of two 5-item subscales, the “Positive Self-Statements” (SSPS-P) and the “Negative Self-Statements” subscale (SSPS-N). Four studies report on the development and the preliminary psychometric properties of this instrument. PMID:16763666

  14. Competence Assessment Instruments in Perianesthesia Nursing Care: A Scoping Review of the Literature.

    Science.gov (United States)

    Jeon, Yunsuk; Lakanmaa, Riitta-Liisa; Meretoja, Riitta; Leino-Kilpi, Helena

    2017-12-01

    To identify competence assessment instruments in perianesthesia nursing care and to describe the validity and reliability of the instruments. A scoping review in a systematic manner. A search in CINAHL, MEDLINE, and ERIC was carried out to identify empirical studies from 1994 to 2015. A narrative synthesis approach was undertaken to analyze the data. Nine competence assessment instruments in perianesthesia nursing care were identified. The instruments used three types of data collection methods: Self-report, observation, and written examinations. The most commonly reported validity method was content validity involving expert panels and reliability tests for internal consistency and inter-rater's consistency. Integrating more than one data collection method may give support to overcoming some of the limitations, such as lack of objectivity and misinterpretation of the assessment results. In an ever-changing environment, perianesthesia nursing competence requires constant reassessment from the perspective of content validity, scoring methods, and reliability. Copyright © 2016 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

  15. Evaluating medical residents as managers of care : a critical appraisal of assessment methods

    NARCIS (Netherlands)

    Busari, Jamiu O; Stammen, Lorette A; Gennissen, Lokke M; Moonen, Rob M

    2014-01-01

    INTRODUCTION: The increasing demands for effective and efficient health care delivery systems worldwide have resulted in an expansion of the desired competencies that physicians need to possess upon graduation. Presently, medical residents require additional professional competencies that can

  16. Shifting perceptions: a pre-post study to assess the impact of a senior resident rotation bundle.

    Science.gov (United States)

    Fabreau, Gabriel; Elliott, Meghan; Khanna, Suneil; Minty, Evan; Wallace, Jean E; de Grood, Jill; Lewin, Adriane; Brown, Garielle; Bharwani, Aleem; Gilmour, Janet; Lemaire, Jane B

    2013-08-29

    Extended duty hours for residents are associated with negative consequences. Strategies to accommodate duty hour restrictions may also have unintended impacts. To eliminate extended duty hours and potentially lessen these impacts, we developed a senior resident rotation bundle that integrates a night float system, educational sessions on sleep hygiene, an electronic handover tool, and a simulation-based medical education curriculum. The aim of this study was to assess internal medicine residents' perceptions of the impact of the bundle on three domains: the senior residents' wellness, ability to deliver quality health care, and medical education experience. This prospective study compared eligible residents' experiences (N = 67) before and after a six-month trial of the bundle at a training program in western Canada. Data was collected using an on-line survey. Pre- and post-intervention scores for the final sample (N = 50) were presented as means and compared using the t-test for paired samples. Participants felt that most aspects of the three domains were unaffected by the introduction of the bundle. Four improved and two worsened perception shifts emerged post-intervention: less exposure to personal harm, reduced potential for medical error, more successful teaching, fewer disruptions to other rotations, increased conflicting role demands and less staff physician supervision. The rotation bundle integrates components that potentially ease some of the perceived negative consequences of night float rotations and duty hour restrictions. Future areas of study should include objective measures of the three domains to validate our study participants' perceptions.

  17. Instruments used in the assessment of expectation toward a spine surgery: an integrative review

    Directory of Open Access Journals (Sweden)

    Eliane Nepomuceno

    Full Text Available Abstract OBJECTIVE To identify and describe the instruments used to assess patients' expectations toward spine surgery. METHOD An integrative review was carried out in the databases PubMed, CINAHL, LILACS and PsycINFO. RESULTS A total of 4,402 publications were identified, of which 25 met the selection criteria. Of the studies selected, only three used tools that had confirmed validity and reliability to be applied; in five studies, clinical scores were used, and were modified for the assessment of patients' expectations, and in 17 studies the researchers developed scales without an adequate description of the method used for their development and validation. CONCLUSION The assessment of patients' expectations has been methodologically conducted in different ways. Until the completion of this integrative review, only two valid and reliable instruments had been used in three of the selected studies.

  18. Assessing knowledge and attitudes towards addictions in medical residents of a general hospital

    OpenAIRE

    Barral, Carmen; Eiroa-Orosa, Francisco Jose; Navarro-Marfisis, Maria Cecilia; Roncero, Carlos; Casas, Miguel

    2014-01-01

    Addiction treatment training has been recognized to be an essential part of the curriculum in psychiatry and general medicine. Our objective in this study was to measure the knowledge and attitudes towards addictions among medical residents of a general hospital in Catalonia, Spain.\\ud \\ud Method\\ud Within a sample of medical residents, we administered a questionnaire based on previous literature including attitudes towards patients with drug use problems, evaluation of knowledge and beliefs ...

  19. The clinimetric qualities of patient-assessed instruments for measuring chronic ankle instability: A systematic review

    Directory of Open Access Journals (Sweden)

    Asman Sara

    2007-01-01

    Full Text Available Abstract Background The assessment of outcomes from the patient's perspective becomes more recognized in health care. Also in patients with chronic ankle instability, the degree of present impairments, disabilities and participation problems should be documented from the perspective of the patient. The decision about which patient-assessed instrument is most appropriate for clinical practice should be based upon systematic reviews. Only rating scales constructed for patients with acute ligament injuries were systematically reviewed in the past. The aim of this study was to review systematically the clinimetric qualities of patient-assessed instruments designed for patients with chronic ankle instability. Methods A computerized literature search of Medline, Embase, Cinahl, Web of Science, Sport Discus and the Cochrane Controlled Trial Register was performed to identify eligible instruments. Two reviewers independently evaluated the clinimetric qualities of the selected instruments using a criteria list. The inter-observer reliability of both the selection procedure and the clinimetric evaluation was calculated using modified kappa coefficients. Results The inter-observer reliability of the selection procedure was excellent (k = .86. Four instruments met the eligibility criteria: the Ankle Joint Functional Assessment Tool (AJFAT, the Functional Ankle Outcome Score (FAOS, the Foot and Ankle Disability Index (FADI and the Functional Ankle Ability Measure (FAAM. The inter-observer reliability of the quality assessment was substantial to excellent (k between .64 and .88. Test-retest reliability was demonstrated for the FAOS, the FADI and the FAAM but not for the AJFAT. The FAOS and the FAAM met the criteria for content validity and construct validity. For none of the studied instruments, the internal consistency was sufficiently demonstrated. The presence of floor- and ceiling effects was assessed for the FAOS but ceiling effects were present for all

  20. Cognitive assessment instruments in Parkinson's disease patients undergoing deep brain stimulation

    Directory of Open Access Journals (Sweden)

    Aline Juliane Romann

    Full Text Available ABSTRACT Deep Brain Stimulation (DBS is a widely used surgical technique in individuals with Parkinson's disease (PD that can lead to significant reductions in motor symptoms. Objectives: To determine, from publications, the most commonly used instruments for cognitive evaluation of individuals with PD undergoing DBS. Methods: A systematic review of the databases: PubMed, Medline, EBECS, Scielo and LILACS was conducted, using the descriptors "Deep Brain Stimulation", "Verbal Fluency", "Parkinson Disease", "Executive Function", "Cognition" and "Cognitive Assessment" in combination. Results: The Verbal Fluency test was found to be the most used instrument for this investigation in the studies, followed by the Boston Naming Test. References to the Stroop Test, Trail Making Test, and Rey's Auditory Verbal Learning Test were also found. Conclusions: The validation of instruments for this population is needed as is the use of batteries offering greater specificity and sensitivity for the detection of cognitive impairment.

  1. [Assessment instruments for a Health-Related Quality of Life in diabetes mellitus].

    Science.gov (United States)

    Aguiar, Carlos Clayton Torres; Vieira, Anya Pimentel G Fernandes; Carvalho, André Ferrer; Montenegro-Junior, Renan M

    2008-08-01

    The assessment of Health-Related Quality of Life (HRQoL) has been increasingly used to measure the overall impact of diseases in people's life. Diabetes mellitus (DM) is a chronic disease associated with high morbidity, mortality, and HRQoL impairment in patients. In longitudinal studies, the psychosocial impact of DM predicts mortality. The objective of this review is to describe and to analyze the main instruments used for the HRQoL evaluation in patients with DM. Generic instruments such, as the Quality of Well-Being Scale (QWB), Medical Outcomes Study 36-item Short-Form Health Survey (SF-36), EuroQol (EQ-5D) and specific instruments as the Diabetes Care Profile (DCP), Diabetes Quality of Life Measure (DQOL), Diabetes Impact Measurement Scales (DIMS), Appraisal of Diabetes Scale (ADS), Audit of Diabetes-Dependent Quality of Life (ADDQoL), Diabetes Health Profile (DHP-1 and DHP-18), Questionnaire on Stress in Patients with Diabetes-Revised (QSD-R), Well-Being Enquiry goes Diabetics (WED), Diabetes-Specific Quality-of-life Scale (DSQOLS), Diabetes 39 (D-39) Problems Areas in Diabetes (PAID) were analyzed. PAID is the only translated and validated instrument available in Brazil. The generic and specific instruments have their stregths and shortcomings for evaluation of HRQL in patients with DM. The combined use of both generic (such as the SF-36) and specific (such as the PAID) appears to be a consistent way to evaluate HRQoL as a construct in Brazilian patients with DM. The present article reviews a variety of instruments and emphasizes the urgent need for validation studies of such instruments to be used in Brazilian subjects with DM.

  2. Development and validation of an instrument to assess knowledge and skills of evidence-based nursing.

    Science.gov (United States)

    Gu, Mee Ock; Ha, Yeongmi; Kim, Jeongsook

    2015-05-01

    To develop an objective instrument to measure nurses' entry-level knowledge of and skills in evidence-based practice, and to evaluate the validity and reliability of the instrument. To promote evidence-based practice in nursing, nurses should initially receive education about evidence-based practice knowledge and learn the skills, and this should be followed by measurement with an instrument that was developed to evaluate the extent to which they are prepared to use evidence-based practice knowledge and skills. Although some self-report instruments have been developed to measure evidence-based practice in nursing, an objective instrument to evaluate nurses' evidence-based practice knowledge and skills is not available at present. A methodological study. This study was conducted in two stages: the instrument development and its psychometric evaluation, including its validity and reliability. An instrument, 'Knowledge and Skills of Evidence-based Nursing,' was developed. Content validity was assessed by five experts in evidence-based nursing, and the construct validity was evaluated by the known-groups method. Reliability was examined with internal consistency reliability and inter-rater reliability. A content validity index >0·80 was achieved. For construct validity, there were statistically significant differences between the evidence-based practice and nonevidence-based practice groups in total scores and in the scores on each subscale of the Knowledge and Skills of Evidence-based Nursing. Cronbach's alpha was 0·96, and the inter-rater reliability was excellent. The Knowledge and Skills of Evidence-based Nursing is a valid and reliable instrument for objectively assessing nurses' evidence-based practice knowledge and skills; it is quick to complete and to score the answers. Because the Knowledge and Skills of Evidence-based Nursing objectively assesses nurses' evidence-based practice knowledge and skills, it can be used to examine the effects of evidence

  3. Development and validation of an instrument to assess imminent risk of homelessness among veterans.

    Science.gov (United States)

    Montgomery, Ann Elizabeth; Fargo, Jamison D; Kane, Vincent; Culhane, Dennis P

    2014-01-01

    Veterans are overrepresented within the homeless population compared with their non-veteran counterparts, particularly when controlling for poverty. The U.S. Department of Veterans Affairs (VA) aims to prevent new episodes of homelessness by targeting households at greatest risk; however, there are no instruments that systematically assess veterans' risk of homelessness. We developed and tested a brief screening instrument to identify imminent risk of homelessness among veterans accessing VA health care. The study team developed initial assessment items, conducted cognitive interviews with veterans experiencing homelessness, refined pilot items based on veterans' and experts' feedback and results of psychometric analyses, and assigned weights to items in the final instrument to indicate a measure of homelessness risk. One-third of veterans who responded to the field instrument reported imminent risk of homelessness (i.e., housing instability in the previous 90 days or expected in the next 90 days). The reliability coefficient for the instrument was 0.85, indicating good internal consistency. Veterans who had a recent change in income, had unpaid housing expenses, were living temporarily with family and friends, needed help to get or keep housing, and had poor rental and credit histories were more likely to report a risk of homelessness than those who did not. This study provides the field with an instrument to identify individuals and households at risk of or experiencing homelessness, which is necessary to prevent and end homelessness. In addition, it supports VA's investment in homelessness prevention and rapid rehousing services for veterans who are experiencing or are at risk for homelessness.

  4. Development and Validation of an Instrument to Assess Imminent Risk of Homelessness Among Veterans

    Science.gov (United States)

    Fargo, Jamison D.; Kane, Vincent; Culhane, Dennis P.

    2014-01-01

    Objectives Veterans are overrepresented within the homeless population compared with their non-veteran counterparts, particularly when controlling for poverty. The U.S. Department of Veterans Affairs (VA) aims to prevent new episodes of homelessness by targeting households at greatest risk; however, there are no instruments that systematically assess veterans' risk of homelessness. We developed and tested a brief screening instrument to identify imminent risk of homelessness among veterans accessing VA health care. Methods The study team developed initial assessment items, conducted cognitive interviews with veterans experiencing homelessness, refined pilot items based on veterans' and experts' feedback and results of psychometric analyses, and assigned weights to items in the final instrument to indicate a measure of homelessness risk. Results One-third of veterans who responded to the field instrument reported imminent risk of homelessness (i.e., housing instability in the previous 90 days or expected in the next 90 days). The reliability coefficient for the instrument was 0.85, indicating good internal consistency. Veterans who had a recent change in income, had unpaid housing expenses, were living temporarily with family and friends, needed help to get or keep housing, and had poor rental and credit histories were more likely to report a risk of homelessness than those who did not. Conclusion This study provides the field with an instrument to identify individuals and households at risk of or experiencing homelessness, which is necessary to prevent and end homelessness. In addition, it supports VA's investment in homelessness prevention and rapid rehousing services for veterans who are experiencing or are at risk for homelessness. PMID:25177054

  5. Research methodologies to assess teaching in psychiatric residency: a literature review Metodologias de pesquisa para avaliação do ensino na residência de psiquiatria: uma revisão da literatura

    Directory of Open Access Journals (Sweden)

    Ibiracy de Barros Camargo

    2003-09-01

    Full Text Available OBJECTIVES: Research methodologies in psychiatry have followed both the changes in mental health care and the need of updating programs of medical residency. To identify empirical articles in the indexed literature from 1997 to 2002, with the aim of analyzing and discussing methodological aspects of research dealing with the description and assessment of residency programs in psychiatry. METHOD: The bibliographic survey was performed using MedLine, PsycLit, Web of Science, and Lilacs. Twenty-one articles were identified. RESULTS: Nineteen studies were characterized as exploratory-descriptive and two as experimental. Data collection used questionnaires in 12 of them, and combined techniques in the other seven and the two experimental studies had data collected by tests applied before and after the teaching intervention. Most of the subjects were residents and program directors. Fifteen studies used statistical analysis. CONCLUSIONS: All the articles outlined the problems based on literature reviews. Most of the studies made use of standard techniques of social research and only two used experimental procedures. Only three studies employed external measures in order to establish correlations with the collected data. Procedures to validate and assess the reliability of the instrument by means of pilot-studies were absent in 11 studies, what may indicate methodological biases.OBJETIVOS: As metodologias de pesquisa na psiquiatria têm acompanhado tanto as transformações nos sistemas de atendimento à saúde mental como a necessidade de atualização dos programas de residência médica. Identificar, analisar e avaliar na literatura indexada entre 1997 e 2002 artigos empíricos relativos à avaliação de programas de residência em psiquiatria. MÉTODO: O levantamento bibliográfico foi realizado através dos indexadores MedLine, PsycLit, Web of Science e Lilacs. Foram identificados 21 artigos. RESULTADOS: 19 estudos caracterizam-se como

  6. An integrated assessment instrument: Developing and validating instrument for facilitating critical thinking abilities and science process skills on electrolyte and nonelectrolyte solution matter

    Science.gov (United States)

    Astuti, Sri Rejeki Dwi; Suyanta, LFX, Endang Widjajanti; Rohaeti, Eli

    2017-05-01

    The demanding of assessment in learning process was impact by policy changes. Nowadays, assessment is not only emphasizing knowledge, but also skills and attitudes. However, in reality there are many obstacles in measuring them. This paper aimed to describe how to develop integrated assessment instrument and to verify instruments' validity such as content validity and construct validity. This instrument development used test development model by McIntire. Development process data was acquired based on development test step. Initial product was observed by three peer reviewer and six expert judgments (two subject matter experts, two evaluation experts and two chemistry teachers) to acquire content validity. This research involved 376 first grade students of two Senior High Schools in Bantul Regency to acquire construct validity. Content validity was analyzed used Aiken's formula. The verifying of construct validity was analyzed by exploratory factor analysis using SPSS ver 16.0. The result show that all constructs in integrated assessment instrument are asserted valid according to content validity and construct validity. Therefore, the integrated assessment instrument is suitable for measuring critical thinking abilities and science process skills of senior high school students on electrolyte solution matter.

  7. Performance assessment of diffuse optical spectroscopic imaging instruments in a 2-year multicenter breast cancer trial

    Science.gov (United States)

    Leproux, Anaïs; O'Sullivan, Thomas D.; Cerussi, Albert; Durkin, Amanda; Hill, Brian; Hylton, Nola; Yodh, Arjun G.; Carp, Stefan A.; Boas, David; Jiang, Shudong; Paulsen, Keith D.; Pogue, Brian; Roblyer, Darren; Yang, Wei; Tromberg, Bruce J.

    2017-12-01

    We present a framework for characterizing the performance of an experimental imaging technology, diffuse optical spectroscopic imaging (DOSI), in a 2-year multicenter American College of Radiology Imaging Network (ACRIN) breast cancer study (ACRIN-6691). DOSI instruments combine broadband frequency-domain photon migration with time-independent near-infrared (650 to 1000 nm) spectroscopy to measure tissue absorption and reduced scattering spectra and tissue hemoglobin, water, and lipid composition. The goal of ACRIN-6691 was to test the effectiveness of optically derived imaging endpoints in predicting the final pathologic response of neoadjuvant chemotherapy (NAC). Sixty patients were enrolled over a 2-year period at participating sites and received multiple DOSI scans prior to and during 3- to 6-month NAC. The impact of three sources of error on accuracy and precision, including different operators, instruments, and calibration standards, was evaluated using a broadband reflectance standard and two different solid tissue-simulating optical phantoms. Instruments showed <0.0010 mm-1 (10.3%) and 0.06 mm-1 (4.7%) deviation in broadband absorption and reduced scattering, respectively, over the 2-year duration of ACRIN-6691. These variations establish a useful performance criterion for assessing instrument stability. The proposed procedures and tests are not limited to DOSI; rather, they are intended to provide methods to characterize performance of any instrument used in translational optical imaging.

  8. [Dietary exposure assessment of aflatoxin of foodstuff and edible oil from Shenzhen residents].

    Science.gov (United States)

    Li, Ke; Qiu, Fen; Jiang, Lixin; Yang, Mei

    2014-07-01

    To assess the dietary exposure aflatoxin B1 and total aflatoxins of foodstuff and edible oil in Shenzhen residents. Aflatoxins in the samples were determined by the immuno-affinity column clean-up plus UPLC. The aflatoxin B1 and aflatoxins dietary exposure were calculated by the level of aflatoxins contamination in the food and consumption of dietary. The average diary aflatoxin B1 dietary exposure of the man of the 2 to 6, 7 to 14, 15 to 50 and > 50 age group in Shenzhen were 0.320, 0.385, 0.401 and 0.398 ng/(kg BW x d), the results of the woman were 0.282, 0.222, 0.367 and 0.470 ng/(kg BW x d) respectively. The total average daily dietary aflatoxin B1 exposure of the man were 0.012, 0.015, 0.016 and 0.016 ng/(kg BW x d) about each age group. The results of the woman were 78.4, 167, 113 and 103 ng/(kg BW d). According to the the average levels of consumption and the high levels of consumption, the risk of AFB, of the man were 0.012,0.015, 0.016, 0. 016 and 3.0, 8.2, 4.1, 4.4 cancer patient per one hundred thousand, respectively. The results of the woman were 0.010, 0.009, 0.014, 0.018 and 2.9, 6.7, 4.4, 4.0 cancer patient per one hundred thousand, respectively. 7 to 14 age group compared with adults age group face higher exposure levels. The rice and peanut oil are most primary aflatoxin dietary exposure sources in Shenzhen.

  9. Pilot Evaluation of a Communication Skills Training Program for Psychiatry Residents Using Standardized Patient Assessment.

    Science.gov (United States)

    Ditton-Phare, Philippa; Sandhu, Harsimrat; Kelly, Brian; Kissane, David; Loughland, Carmel

    2016-10-01

    Mental health clinicians can experience difficulties communicating diagnostic information to patients and their families/carers, especially about distressing psychiatric disorders such as schizophrenia. There is evidence for the effectiveness of communication skills training (CST) for improving diagnostic discussions, particularly in specialties such as oncology, but only limited evidence exists about CST for psychiatry. This study evaluated a CST program specifically developed for psychiatry residents called ComPsych that focuses on conveying diagnostic and prognostic information about schizophrenia. The ComPsych program consists of an introductory lecture, module booklets for trainees, and exemplary skills videos, followed by small group role-plays with simulated patients (SPs) led by a trained facilitator. A standardized patient assessment (SPA) was digitally recorded pre- and post-training with a SP using a standardized scenario in a time-limited (15 min) period. Recorded SPAs were independently rated using a validated coding system (ComSkil) to identify frequency of skills used in five skills categories (agenda setting, checking, questioning, information organization, and empathic communication). Thirty trainees (15 males and 15 females; median age = 32) undertaking their vocational specialty training in psychiatry participated in ComPsych training and pre- and post-ComPsych SPAs. Skills increased post-training for agenda setting (d = -0.82), while questioning skills (d = 0.56) decreased. There were no significant differences in any other skills grouping, although checking, information organization, and empathic communication skills tended to increase post-training. A dose effect was observed for agenda setting, with trainees who attended more CST sessions outperforming those attending fewer. Findings support the generalization and translation of ComPsych CST to psychiatry.

  10. Effects of a Short Video-Based Resident-as-Teacher Training Toolkit on Resident Teaching.

    Science.gov (United States)

    Ricciotti, Hope A; Freret, Taylor S; Aluko, Ashley; McKeon, Bri Anne; Haviland, Miriam J; Newman, Lori R

    2017-10-01

    To pilot a short video-based resident-as-teacher training toolkit and assess its effect on resident teaching skills in clinical settings. A video-based resident-as-teacher training toolkit was previously developed by educational experts at Beth Israel Deaconess Medical Center, Harvard Medical School. Residents were recruited from two academic hospitals, watched two videos from the toolkit ("Clinical Teaching Skills" and "Effective Clinical Supervision"), and completed an accompanying self-study guide. A novel assessment instrument for evaluating the effect of the toolkit on teaching was created through a modified Delphi process. Before and after the intervention, residents were observed leading a clinical teaching encounter and scored using the 15-item assessment instrument. The primary outcome of interest was the change in number of skills exhibited, which was assessed using the Wilcoxon signed-rank test. Twenty-eight residents from two academic hospitals were enrolled, and 20 (71%) completed all phases of the study. More than one third of residents who volunteered to participate reported no prior formal teacher training. After completing two training modules, residents demonstrated a significant increase in the median number of teaching skills exhibited in a clinical teaching encounter, from 7.5 (interquartile range 6.5-9.5) to 10.0 (interquartile range 9.0-11.5; Pteaching skills assessed, there were significant improvements in asking for the learner's perspective (P=.01), providing feedback (P=.005), and encouraging questions (P=.046). Using a resident-as-teacher video-based toolkit was associated with improvements in teaching skills in residents from multiple specialties.

  11. American Academy of Orthopaedic Surgeons lower limb outcomes assessment instruments. Reliability, validity, and sensitivity to change.

    Science.gov (United States)

    Johanson, Norman A; Liang, Matthew H; Daltroy, Lawren; Rudicel, Sally; Richmond, John

    2004-05-01

    The American Academy of Orthopaedic Surgeons (AAOS) has developed an array of outcomes assessment instruments designed for the efficient collection of outcomes data from patients of all ages with musculoskeletal conditions in all body regions. The Lower Limb Instruments were developed through a process of literature review, consensus-building, and field-testing. The instruments were distributed to a total of 290 subjects in twenty orthopaedic practices throughout the United States and Canada. Of the 290 patients, seventy each had a diagnosis in the categories of foot and ankle, sports/knee, and hip and knee and forty each had a diagnosis in the categories of trauma and rehabilitation. Retests to be taken twenty-four hours after the first test were distributed to subsamples of patients for each instrument. Seventy-one one-year follow-up questionnaires (twenty-five Sports/Knee, twenty-five Foot and Ankle, sixteen Hip and Knee, and five Lower Limb Core instruments) were returned. The Lower Limb Core Scale and the Hip and Knee Core Scale, each consisting of seven items addressing pain, stiffness and swelling, and function, performed at an acceptable level. Additional Sports/Knee and Foot and Ankle Modules proved to have internal and retest reliability of 0.80 or better, comparable with the values for well-established measures such as the Short Form-36 (SF-36). All of the new scales were moderately to strongly correlated with other measures of pain and function, such as physician ratings, the SF-36, and the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC). Seventy-one patients provided follow-up information for the analysis of sensitivity to change. The Lower Limb Core was found to contribute independently to the prediction of the transition score based on the patient and physician assessments of change. The AAOS Lower Limb Instruments for outcomes assessment are highly reliable and are correlated with other measures for similar constructs. They

  12. Reliability of Verbal Handoff Assessment and Handoff Quality Before and After Implementation of a Resident Handoff Bundle.

    Science.gov (United States)

    Feraco, Angela M; Starmer, Amy J; Sectish, Theodore C; Spector, Nancy D; West, Daniel C; Landrigan, Christopher P

    2016-08-01

    1) To develop validity evidence for the use of the Verbal Handoff Assessment Tool (VHAT) and examine the reliability of VHAT scores, and 2) to determine whether implementation of a resident handoff bundle (RHB) was associated with improved verbal patient handoffs among pediatric resident physicians. In a pre-post design, prospectively audio recorded verbal patient handoffs conducted at Boston Children's Hospital before and after implementation of the RHB were rated using the VHAT, which was developed for this study (primary outcome). Using generalizability theory, we evaluated the reliability of VHAT scores. Overall, VHAT scores increased after RHB implementation (mean 142 vs 191, possible score 0-500; P Verbal handoffs improved after implementation of a RHB, although gains were variable across the 2 clinical units. The VHAT shows promise as an assessment tool for resident handoff skills. If used for competency or entrustment decisions, a resident's mean VHAT score should be on the basis of observation of verbal handoff of ≥21 patients. Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

  13. Radiology resident MR and CT image analysis skill assessment using an interactive volumetric simulation tool - the RadioLOG project.

    Science.gov (United States)

    Gondim Teixeira, Pedro Augusto; Cendre, Romain; Hossu, Gabriela; Leplat, Christophe; Felblinger, Jacques; Blum, Alain; Braun, Marc

    2017-02-01

    Assess the use of a volumetric simulation tool for the evaluation of radiology resident MR and CT interpretation skills. Forty-three participants were evaluated with a software allowing the visualisation of multiple volumetric image series. There were 7 medical students, 28 residents and 8 senior radiologists among the participants. Residents were divided into two sub-groups (novice and advanced). The test was composed of 15 exercises on general radiology and lasted 45 min. Participants answered a questionnaire on their experience with the test using a 5-point Likert scale. This study was approved by the dean of the medical school and did not require ethics committee approval. The reliability of the test was good with a Cronbach alpha value of 0.9. Test scores were significantly different in all sub-groups studies (p radiological practice (3.9 ± 0.9 on a 5-point scale) and was better than the conventional evaluation methods (4.6 ± 0.5 on a 5-point scale). This software provides a high quality evaluation tool for the assessment of the interpretation skills in radiology residents. • This tool allows volumetric image analysis of MR and CT studies. • A high reliability test could be created with this tool. • Test scores were strongly associated with the examinee expertise level. • Examinees positively evaluated the authenticity and usability of this tool.

  14. Application of Allan Deviation to Assessing Uncertainties of Continuous-measurement Instruments, and Optimizing Calibration Schemes

    Science.gov (United States)

    Jacobson, Gloria; Rella, Chris; Farinas, Alejandro

    2014-05-01

    Technological advancement of instrumentation in atmospheric and other geoscience disciplines over the past decade has lead to a shift from discrete sample analysis to continuous, in-situ monitoring. Standard error analysis used for discrete measurements is not sufficient to assess and compare the error contribution of noise and drift from continuous-measurement instruments, and a different statistical analysis approach should be applied. The Allan standard deviation analysis technique developed for atomic clock stability assessment by David W. Allan [1] can be effectively and gainfully applied to continuous measurement instruments. As an example, P. Werle et al has applied these techniques to look at signal averaging for atmospheric monitoring by Tunable Diode-Laser Absorption Spectroscopy (TDLAS) [2]. This presentation will build on, and translate prior foundational publications to provide contextual definitions and guidelines for the practical application of this analysis technique to continuous scientific measurements. The specific example of a Picarro G2401 Cavity Ringdown Spectroscopy (CRDS) analyzer used for continuous, atmospheric monitoring of CO2, CH4 and CO will be used to define the basics features the Allan deviation, assess factors affecting the analysis, and explore the time-series to Allan deviation plot translation for different types of instrument noise (white noise, linear drift, and interpolated data). In addition, the useful application of using an Allan deviation to optimize and predict the performance of different calibration schemes will be presented. Even though this presentation will use the specific example of the Picarro G2401 CRDS Analyzer for atmospheric monitoring, the objective is to present the information such that it can be successfully applied to other instrument sets and disciplines. [1] D.W. Allan, "Statistics of Atomic Frequency Standards," Proc, IEEE, vol. 54, pp 221-230, Feb 1966 [2] P. Werle, R. Miicke, F. Slemr, "The Limits

  15. A Simulation Screening Mammography Module Created for Instruction and Assessment: Radiology Residents vs National Benchmarks.

    Science.gov (United States)

    Poot, Jeffrey D; Chetlen, Alison L

    2016-11-01

    To improve mammographic screening training and breast cancer detection, radiology residents participated in a simulation screening mammography module in which they interpreted an enriched set of screening mammograms with known outcomes. This pilot research study evaluates the effectiveness of the simulation module while tracking the progress, efficiency, and accuracy of radiology resident interpretations and also compares their performance against national benchmarks. A simulation module was created with 266 digital screening mammograms enriched with high-risk breast lesions (seven cases) and breast malignancies (65 cases). Over a period of 27 months, 39 radiology residents participated in the simulation screening mammography module. Resident sensitivity and specificity were compared to Breast Cancer Surveillance Consortium (BCSC data through 2009) national benchmark and American College of Radiology (ACR) Breast Imaging Reporting and Data System (BI-RADS) acceptable screening mammography audit ranges. The sensitivity, the percentage of cancers with an abnormal initial interpretation (BI-RADS 0), among residents was 84.5%, similar to the BCSC benchmark sensitivity of 84.9% (sensitivity for tissue diagnosis of cancer within 1 year following the initial examination) and within the acceptable ACR BI-RADS medical audit range of ≥75%. The specificity, the percentage of noncancers that had a negative image interpretation (BI-RADS 1 or 2), among residents was 83.2% compared to 90.3% reported in the BCSC benchmark data, but lower than the suggested ACR BI-RADS range of 88%-95%. Using simulation modules for interpretation of screening mammograms is a promising method for training radiology residents to detect breast cancer and to help them achieve competence toward national benchmarks. Copyright © 2016 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

  16. Assessment of transport performance index for urban transport development strategies — Incorporating residents' preferences

    International Nuclear Information System (INIS)

    Ambarwati, Lasmini; Verhaeghe, Robert; Arem, Bart van; Pel, Adam J.

    2017-01-01

    The performance of urban transport depends on a variety of factors related to metropolitan structure; in particular, the patterns of commuting, roads and public transport (PT) systems. To evaluate urban transport planning efforts, there is a need for a metric expressing the aggregate performance of the city's transport systems which should relate to residents' preferences. The existing metrics have typically focused on a measure to express the proximity of job locations to residences. A Transport Performance Index (TPI) is proposed in which the total cost of transportation system (operational and environmental costs) is divided by willingness to pay (WTP) for transport plus the willingness to accept (WTA) the environmental effects on residents. Transport operational as well as the environmental costs are derived from a simulation of all transport systems, to particular designs of spatial development. Willingness to pay for transport and willingness to accept the environmental effects are derived from surveys among residents. Simulations were modelled of Surabaya's spatial structure and public transport expansion. The results indicate that the current TPI is high, which will double by 2030. With a hypothetical polycentric city structure and adjusted job housing balance, a lower index occurs because of the improvements in urban transport performance. A low index means that the residents obtain much benefit from the alternative proposed. This illustrates the importance of residents' preferences in urban spatial planning in order to achieve efficient urban transport. Applying the index suggests that city authorities should provide fair and equitable public transport systems for suburban residents in the effort to control the phenomenon of urban sprawl. This index is certainly a good tool and prospective benchmark for measuring sustainability in relation to urban development.

  17. Validity and reliability of a dental operator posture assessment instrument (PAI).

    Science.gov (United States)

    Branson, Bonnie G; Williams, Karen B; Bray, Kimberly Krust; Mcllnay, Sandy L; Dickey, Diana

    2002-01-01

    Basic operating posture is considered an important occupational health issue for oral health care clinicians. It is generally agreed that the physical posture of the operator, while providing care, should be such that all muscles are in a relaxed, well-balanced, and neutral position. Postures outside of this neutral position are likely to cause musculoskeletal discomfort. To date, the range of the neutral operator position has not been well-defined; nor have any specific instruments been identified that can quantitatively or semi-quantitatively assess dental operator posture. This paper reports on the development of an instrument that can be used to semi-quantitatively evaluate postural components. During the first phase of the study, an expert panel defined the basic parameters for acceptable, compromised, and harmful operator postures and established face validity of a posture assessment instrument (PAI). During the second phase, the PAI was tested for reliability using generalizability theory. Four raters tested the instrument for reliability. Overall, total PAI scores were similar amongst three of the raters, with the fourth rater's scores being slightly greater than the other three. The main effect of the rater on individual postural components was moderate, indicating that rater variance contributed to 11.9% of total variance. The PAI measures posture as it occurs and will have numerous applications when evaluating operator performance in the dental and dental hygiene education setting. Also, the PAI will prove useful when examining the effects of operator posture and musculoskeletal disorders.

  18. Development of instrument for assessing students’ critical and creative thinking ability

    Science.gov (United States)

    Herpiana, R.; Rosidin, U.

    2018-01-01

    The purpose of this study was to develop instruments to measure critical thinking ability and creative students in the topics of physics simple harmonic motion. The research method used was research development with application of procedures including research and data collection, planning, and initial product development. The participants of the study were thirty-four tenth grade students and five physics teachers of physics who were selected randomly from schools in the province of Lampung. The data collected by using test and analyzed in quantitative descriptive. Initial data showed that students’ critical and creative thinking ability were still low and instruments to assess students’ critical thinking skills and creative students was not yet available. Most of assessment conducted focused on memorization. Thus, the researchers developed a draft of instrument in the form of the test description based on criteria that encouraged students’ activity in understanding the concepts, strategies and decision/solution in dealing with problems. The development of the instrument was conducted considering real-world phenomena in the form of pictures and stories, description of the situation, and verbal presentation.

  19. Language profiles in young children with autism spectrum disorder: A community sample using multiple assessment instruments.

    Science.gov (United States)

    Nevill, Rose; Hedley, Darren; Uljarević, Mirko; Sahin, Ensu; Zadek, Johanna; Butter, Eric; Mulick, James A

    2017-11-01

    This study investigated language profiles in a community-based sample of 104 children aged 1-3 years who had been diagnosed with autism spectrum disorder using Diagnostic and Statistical Manual of Mental Disorders (5th ed.) diagnostic criteria. Language was assessed with the Mullen scales, Preschool Language Scale, fifth edition, and Vineland-II parent-report. The study aimed to determine whether the receptive-to-expressive language profile is independent from the assessment instrument used, and whether nonverbal cognition, early communicative behaviors, and autism spectrum disorder symptoms predict language scores. Receptive-to-expressive language profiles differed between assessment instruments and reporters, and Preschool Language Scale, fifth edition profiles were also dependent on developmental level. Nonverbal cognition and joint attention significantly predicted receptive language scores, and nonverbal cognition and frequency of vocalizations predicted expressive language scores. These findings support the administration of multiple direct assessment and parent-report instruments when evaluating language in young children with autism spectrum disorder, for both research and in clinical settings. Results also support that joint attention is a useful intervention target for improving receptive language skills in young children with autism spectrum disorder. Future research comparing language profiles of young children with autism spectrum disorder to children with non-autism spectrum disorder developmental delays and typical development will add to our knowledge of early language development in children with autism spectrum disorder.

  20. Using Qualitative and Quantitative Assessment to Develop a Patient Safety Curriculum for Surgical Residents.

    Science.gov (United States)

    McKee, Rohini; Sussman, Andrew L; Nelson, M Timothy; Russell, John C

    2016-01-01

    The objective is to use qualitative and quantitative analysis to develop a patient safety curriculum for surgical residents. A prospective study of surgical residents using both quantitative and qualitative methods to craft a patient safety curriculum. Both a survey and focus groups were held before and 4 months after delivery of the patient safety curriculum. The University of New Mexico Hospital, a tertiary academic medical center. General surgery residents, postgraduate years 1 to 5 RESULTS: Qualitative and quantitative analysis revealed areas that required attention and thus helped to mold the curriculum. Qualitative analysis after delivery of the curriculum showed positive changes in attitudes and normative beliefs toward patient safety. Specifically, attitudes and approach to quality improvement and teamwork showed improvement. Survey analysis did not show any significant change in resident perception of the environment during the time frame of this study. Using qualitative analysis to uncover attitudinal barriers to a safe patient environment can help to enhance the relevance and content of a patient safety curriculum for general surgery residents. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

  1. Assessing patient-centred communication in teaching: a systematic review of instruments.

    Science.gov (United States)

    Brouwers, Marianne; Rasenberg, Ellemieke; van Weel, Chris; Laan, Roland; van Weel-Baumgarten, Evelyn

    2017-11-01

    Patient-centred communication is a key component of patient centredness in medical care. Therefore, adequate education in and assessment of patient-centred communication skills are necessary. In general, feedback on communication skills is most effective when it is provided directly and is systematic. This calls for adequate measurement instruments. The aim of this study was to provide a systematic review of existing instruments that measure patient centredness in doctor-patient communication and can be used to provide direct feedback. A systematic review was conducted using an extensive validated search strategy for measurement instruments in PubMed, EMBASE, PsycINFO and CINAHL. The databases were searched from their inception to 1 July 2016. Articles describing the development or evaluation of the measurement properties of instruments that measure patient centredness (by applying three or more of the six dimensions of a published definition of patient centredness) in doctor-patient communication and that can be used for the provision of direct feedback were included. The methodological quality of measurement properties was evaluated using the COSMIN checklist. Thirteen articles describing 14 instruments measuring patient centredness in doctor-patient communication were identified. These studies cover a wide range of settings and patient populations, and vary in the dimensions of patient centredness applied and in methodological quality on aspects of reliability and validity. This review gives a comprehensive overview of all instruments available for the measurement of patient centredness in doctor-patient communication that can be used for the provision of direct feedback and are described in the literature. Despite the widely felt need for valid and reliable instruments for the measurement of patient-centred communication, most of the instruments currently available have not been thoroughly investigated. Therefore, we recommend further research into and

  2. Instrument for assessing mobile technology acceptability in diabetes self-management: a validation and reliability study

    Directory of Open Access Journals (Sweden)

    Frandes M

    2017-02-01

    Full Text Available Mirela Frandes,1 Anca V Deiac,2 Bogdan Timar,1,3 Diana Lungeanu1,2 1Department of Functional Sciences, “Victor Babes” University of Medicine and Pharmacy of Timisoara, 2Department of Mathematics, Polytechnic University of Timisoara, 3Third Medical Clinic, Emergency Hospital of Timisoara, Timisoara, Romania Background: Nowadays, mobile technologies are part of everyday life, but the lack of instruments to assess their acceptability for the management of chronic diseases makes their actual adoption for this purpose slow.Objective: The objective of this study was to develop a survey instrument for assessing patients’ attitude toward and intention to use mobile technology for diabetes mellitus (DM self-management, as well as to identify sociodemographic characteristics and quality of life factors that affect them.Methods: We first conducted the documentation and instrument design phases, which were subsequently followed by the pilot study and instrument validation. Afterward, the instrument was administered 103 patients (median age: 37 years; range: 18–65 years diagnosed with type 1 or type 2 DM, who accepted to participate in the study. The reliability and construct validity were assessed by computing Cronbach’s alpha and using factor analysis, respectively.Results: The instrument included statements about the actual use of electronic devices for DM management, interaction between patient and physician, attitude toward using mobile technology, and quality of life evaluation. Cronbach’s alpha was 0.9 for attitude toward using mobile technology and 0.97 for attitude toward using mobile device applications for DM self-management. Younger patients (Spearman’s ρ=-0.429; P<0.001 with better glycemic control (Spearman’s ρ=-0.322; P<0.001 and higher education level (Kendall’s τ=0.51; P<0.001 had significantly more favorable attitude toward using mobile assistive applications for DM control. Moreover, patients with a higher quality of

  3. Objective Methodology to Assess Meaningful Research Productivity by Orthopaedic Residency Departments: Validation Against Widely Distributed Ranking Metrics and Published Surrogates.

    Science.gov (United States)

    Jones, Louis B; Goel, Sameer; Hung, Leroy Y; Graves, Matthew L; Spitler, Clay A; Russell, George V; Bergin, Patrick F

    2018-04-01

    The mission of any academic orthopaedic training program can be divided into 3 general areas of focus: clinical care, academic performance, and research. Clinical care is evaluated on clinical volume, patient outcomes, patient satisfaction, and becoming increasingly focused on data-driven quality metrics. Academic performance of a department can be used to motivate individual surgeons, but objective measures are used to define a residency program. Annual in-service examinations serve as a marker of resident knowledge base, and board pass rates are clearly scrutinized. Research productivity, however, has proven harder to objectively quantify. In an effort to improve transparency and better account for conflicts of interest, bias, and self-citation, multiple bibliometric measures have been developed. Rather than using individuals' research productivity as a surrogate for departmental research, we sought to establish an objective methodology to better assess a residency program's ability to conduct meaningful research. In this study, we describe a process to assess the number and quality of publications produced by an orthopaedic residency department. This would allow chairmen and program directors to benchmark their current production and make measurable goals for future research investment. The main goal of the benchmarking system is to create an "h-index" for residency programs. To do this, we needed to create a list of relevant articles in the orthopaedic literature. We used the Journal Citation Reports. This publication lists all orthopaedic journals that are given an impact factor rating every year. When we accessed the Journal Citation Reports database, there were 72 journals included in the orthopaedic literature section. To ensure only relevant, impactful journals were included, we selected journals with an impact factor greater than 0.95 and an Eigenfactor Score greater than 0.00095. After excluding journals not meeting these criteria, we were left with 45

  4. The interpersonal relationship in clinical practice. The Barrett-Lennard Relationship Inventory as an assessment instrument.

    Science.gov (United States)

    Simmons, J; Roberge, L; Kendrick, S B; Richards, B

    1995-03-01

    The biomedical model that has long been central to medical practice is gradually being expanded to a broader biopsychosocial model. Relationship-building skills commensurate with the new paradigm need to be understood by educators and taught to medical practitioners. The person-centered, or humanistic, model of psychologist Carl Rogers provides a theoretical approach for the development of effective biopsychosocial relationships. The Barrett-Lennard Relationship Inventory (BLRI) was developed in 1962 as an assessment instrument for the person-centered model. In this article, the person-centered model and the use of the BLRI as an assessment instrument of this model are discussed. Current and potential uses of the BLRI are explored.

  5. Comparing instrumental and deliberative paradigms underpinning the assessment of social values for cultural ecosystem services

    DEFF Research Database (Denmark)

    Raymond, Christopher M.; Kenter, Jasper O.; Plieninger, Tobias

    2014-01-01

    discussion. We present and then justify through case examples two approaches for assessing social values for ecosystem services using the instrumental paradigm and two approaches using the deliberative paradigm. Each approach makes different assumptions about: the underlying rationale for values assessment......; the process through which values are elicited; the type of representativeness sought, and; the degree of involvement of decision-makers. However, case examples demonstrate that the boundaries between instrumental and deliberative paradigms are often not concrete. To accommodate this fluidity, we offer a third......, pragmatic paradigm that integrates some of the qualities of both. This paradigm has implications for engaging multiple community groups and decision-makers in the articulation and mapping of social values for cultural ecosystem services....

  6. Integrating a flexible modeling framework (FMF) with the network security assessment instrument to reduce software security risk

    Science.gov (United States)

    Gilliam, D. P.; Powell, J. D.

    2002-01-01

    This paper presents a portion of an overall research project on the generation of the network security assessment instrument to aid developers in assessing and assuring the security of software in the development and maintenance lifecycles.

  7. Cytogenetic assessment of the effect of radioecological situation to the residents of Zhovti Vody city

    Directory of Open Access Journals (Sweden)

    L. K. Bezdrobna

    2016-12-01

    Full Text Available Results of chromosomal aberration frequency and the spectrum study in peripheral blood lymphocytes cultures of the residents at age of 19 - 60 in Zhovti Vody city (n = 42 and Kyiv (n = 42, who did not have professional contact with radiation and others mutagenic factors, and also the incidence analysis of adult population of these cities and Ukraine in total are given. Average frequency of metaphases with chromosomal aberration and chromosome type aberrations specific to the action of the radiation factor, namely unstable interchromosomal exchanges with the accompanying fragment and without fragment, free acentrics, atypical monocentrics and chromatid type aberrations, that represent the total genome instability, is significantly higher in the group of Zhovti Vody's residents comparing to the group of Kyiv’s residents. Futhermore, multiaberrant cells in three persons from Zhovti Vody were found. The morbidity of malignant tumors in Zhovti Vody is higher than in Kyiv and in Ukraine in total.

  8. Exploring the concurrent validity of the nationwide assessment of permanent nursing home residence in Denmark

    DEFF Research Database (Denmark)

    Bebe, Anna; Nielsen, Anni Brit Sternhagen; Willadsen, Tora Grauers

    2017-01-01

    in a nursing home or in a private home. Method 2 is based on an algorithm created by Stat D for the municipalities where Method 1 is not applicable. Our gold standard was the information from the local administrative system in all ten selected municipalities. Each municipality provided a list with all......Background: Many register studies make use of information about permanent nursing home residents. Statistics Denmark (StatD) identifies nursing home residents by two different indirect methods, one based on reports from the municipalities regarding home care in taken place in a nursing home......, and the other based on an algorithm created by StatD.The aim of the present study was to validate StatD’s nursing home register using dedicated administrative municipality records on individual nursing home residents as gold standard. Methods: In total, ten Danish municipalities were selected. Within each...

  9. Measurement properties of instruments assessing permanent functional impairment of the spine: a systematic review protocol

    Science.gov (United States)

    Trask, Catherine M; Boden, Catherine; Bath, Brenna; Hendrick, Paul; Clay, Lynne; Zeng, Xiaoke; Milosavljevic, Stephan

    2018-01-01

    Introduction Permanent functional impairment (PFI) of the spine is a rating system used by compensation authorities, such as workers compensation boards, to establish an appropriate level of financial compensation for persistent loss of function. Determination of PFI of the spine is commonly based on the assessment of spinal movement combined with other measures of physical and functional impairments; however, the reliability and validity of the measurement instruments used for these evaluations have yet to be established. The aim of this study is to systematically review and synthesise the literature concerning measurement properties of the various and different instruments used for assessing PFI of the spine. Methods Three conceptual groups of terms (1) PFI, (2) spinal disorder and (3) measurement properties will be combined to search Medline, EMBASE, CINAHL, Web of Science, Scopus, PEDro, OTSeeker and Health and Safety Science Abstracts. We will examine peer-reviewed, full-text articles over the full available date range. Two reviewers will independently screen citations (title, abstract and full text) and perform data extraction. Included studies will be appraised as to their methodological quality using the COnsensus-based Standards for the selection of health Measurement INstruments criteria. Findings will be summarised and presented descriptively, with meta-analysis pursued as appropriate. Ethics and dissemination This review will summarise the current level of evidence of measurement properties of instruments used for assessing PFI of the spine. Findings of this review may be applicable to clinicians, policy-makers, workers’ compensation boards, other insurers and health and safety organisations. The findings will likely provide a foundation and direction for future research priorities for assessing spinal PFI. PROSPERO registration number CRD42017060390. PMID:29374671

  10. Validation of an empirically based instrument for the assessment of the quality of teaching in medicine

    OpenAIRE

    Prescher, Anja

    2016-01-01

    Measuring the quality of teaching is a necessary prerequisite for the evaluation and development of medical education and thus for high-quality patient care. Corresponding quality indicators can make the feedback for teachers comprehensible. A completely empirically based instrument for the assessment of the quality of teaching in medicine has not yet been described. Ten empirically based criteria from the field of general pedagogy were developed: clear structure, amount of true learning time...

  11. A Systematic Review of Instruments to Assess Organizational Readiness for Knowledge Translation in Health Care

    OpenAIRE

    Gagnon, Marie-Pierre; Attieh, Randa; Ghandour, El Kebir; Légaré, France; Ouimet, Mathieu; Estabrooks, Carole A.; Grimshaw, Jeremy

    2014-01-01

    Background : The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments. Methods : We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publicatio...

  12. Assessing and Promoting the Wellness of United States Ophthalmology Residents: A Survey of Program Directors.

    Science.gov (United States)

    Tran, Elaine M; Scott, Ingrid U; Clark, Melissa A; Greenberg, Paul B

    To report on the status of residency-based wellness initiatives in ophthalmic graduate medical education and identify strategies for promoting ophthalmology resident wellness by surveying US ophthalmology program directors (PDs). The PDs were each sent an e-mail containing a link to an anonymous online 15-question survey. The PDs also received a letter with the survey link and a $1 incentive. After 2 weeks, nonresponders received 2 weekly reminder e-mails and phone calls. Descriptive statistics were used to analyze the multiple choice responses and categorize the free response answers. National survey. All 111 US ophthalmology PDs were invited to participate. Of 111 PDs, 56 (50%) responded; 14 (26%) of 53 respondents reported that their programs faced an issue involving resident depression, burnout, or suicide within the last year; 25 (45%) of 56 reported that their department had a resident wellness program. Respondents without wellness programs reported a shortage of time (19/30; 63%) and lack of training and resources (19/30; 63%) as barriers to instituting these programs. Respondents reported that the Accreditation Council for Graduate Medical Education could better promote resident wellness by providing training resources for burnout and depression screening (35/53; 66%), resilience skills building (38/53; 72%), and wellness program development (36/53; 68%). This survey suggests that there is a substantial burden of burnout and depression among residents in ophthalmic graduate medical education and that this burden can be addressed by promoting the training of educators to recognize the signs of burnout and depression, and providing resources to develop and expand formal wellness programs. Published by Elsevier Inc.

  13. Assessing Independence of Residents Suffering from Dementia in Meeting Basic Living Needs in Ljubljana Nursing Homes

    Directory of Open Access Journals (Sweden)

    Radojka Trkulja Kobentar

    2015-09-01

    Full Text Available Background:Obviously a very high proportion of nursing home residents exhibit the clinical signs of dementia, which affect the independence of the impaired individual. The purpose of the study is to determine the level of independence of the residents in performing basic life activities.Methods:The research examines 233 residents of both sexes, with a clinical diagnosis of dementia that are aged 65 years and over that have resided in one of the four Ljubljana municipality nursing homes for at least one year prior to the begin of the study. The autonomy in carrying out 11 basic live activities was measured on a three-level scale and their cognitive skills with a quick test of cognitive abilities (KPSS. The data was processed with SPSS, ver. 13.0 through methods of descriptive statistics, t-test for two independent samples and the variance analysis (ANOVA.Results:The examined population sample shows a high cognitive decline measured on the KPSS scale, as 50.2% of subjects in mid-stage reached ≤ 24-11 points and 43.4% of those in the late-stage reached ≤ 10-0 points in the scale (out of 30 in total. Those in the early stage reached ≤ 29-25 points in only 6.4 % of the examined population. The significant findings may thus indicate a high overall average depending on the implementation of all 11 life activities (x = 2.57 on the three-level scale (1 being self-sufficient, 2 and 3 standing for partially dependent and entirely dependent, respectively.Conclusions:The examined nursing home residents in the sample, suffering from dementia, show a high degree of dependency in performing basic life activities. The survey results so far present a starting point for the planning of programmes for increasing involvement of residents in psychosocial activities, through practical exercises in self-sufficiency through implementation of fundamental life activities. 

  14. Ovid MEDLINE Instruction can be Evaluated Using a Validated Search Assessment Tool. A Review of: Rana, G. K., Bradley, D. R., Hamstra, S. J., Ross, P. T., Schumacher, R. E., Frohna, J. G., & Lypson, M. L. (2011. A validated search assessment tool: Assessing practice-based learning and improvement in a residency program. Journal of the Medical Library Association, 99(1, 77-81. doi:10.3163/1536-5050.99.1.013

    Directory of Open Access Journals (Sweden)

    Giovanna Badia

    2011-01-01

    Full Text Available Objective – To determine the construct validity of a search assessment instrument that is used to evaluate search strategies in Ovid MEDLINE. Design – Cross-sectional, cohort study. Setting – The Academic Medical Center of the University of Michigan. Subjects – All 22 first-year residents in the Department of Pediatrics in 2004 (cohort 1; 10 senior pediatric residents in 2005 (cohort 2; and 9 faculty members who taught evidence based medicine (EBM and published on EBM topics. Methods – Two methods were employed to determine whether the University of Michigan MEDLINE Search Assessment Instrument (UMMSA could show differences between searchers’ construction of a MEDLINE search strategy.The first method tested the search skills of all 22 incoming pediatrics residents (cohort 1 after they received MEDLINE training in 2004, and again upon graduation in 2007. Only 15 of these residents were tested upon graduation; seven were either no longer in the residency program, or had quickly left the institution after graduation. The search test asked study participants to read a clinical scenario, identify the search question in the scenario, and perform an Ovid MEDLINE search. Two librarians scored the blinded search strategies.The second method compared the scores of the 22 residents with the scores of ten senior residents (cohort 2 and nine faculty volunteers. Unlike the first cohort, the ten senior residents had not received any MEDLINE training. The faculty members’ search strategies were used as the gold standard comparison for scoring the search skills of the two cohorts.Main Results – The search strategy scores of the 22 first-year residents, who received training, improved from 2004 to 2007 (mean improvement: 51.7 to 78.7; t(14=5.43, PConclusion – According to the authors, “the results of this study provide evidence for the validity of an instrument to evaluate MEDLINE search strategies” (p. 81, since the instrument under

  15. Valid and reliable instruments for arm-hand assessment at ICF activity level in persons with hemiplegia: a systematic review

    Science.gov (United States)

    2012-01-01

    Background Loss of arm-hand performance due to a hemiparesis as a result of stroke or cerebral palsy (CP), leads to large problems in daily life of these patients. Assessment of arm-hand performance is important in both clinical practice and research. To gain more insight in e.g. effectiveness of common therapies for different patient populations with similar clinical characteristics, consensus regarding the choice and use of outcome measures is paramount. To guide this choice, an overview of available instruments is necessary. The aim of this systematic review is to identify, evaluate and categorize instruments, reported to be valid and reliable, assessing arm-hand performance at the ICF activity level in patients with stroke or cerebral palsy. Methods A systematic literature search was performed to identify articles containing instruments assessing arm-hand skilled performance in patients with stroke or cerebral palsy. Instruments were identified and divided into the categories capacity, perceived performance and actual performance. A second search was performed to obtain information on their content and psychometrics. Results Regarding capacity, perceived performance and actual performance, 18, 9 and 3 instruments were included respectively. Only 3 of all included instruments were used and tested in both patient populations. The content of the instruments differed widely regarding the ICF levels measured, assessment of the amount of use versus the quality of use, the inclusion of unimanual and/or bimanual tasks and the inclusion of basic and/or extended tasks. Conclusions Although many instruments assess capacity and perceived performance, a dearth exists of instruments assessing actual performance. In addition, instruments appropriate for more than one patient population are sparse. For actual performance, new instruments have to be developed, with specific focus on the usability in different patient populations and the assessment of quality of use as well as

  16. Assessment of apically extruded debris and irrigant produced by different nickel-titanium instrument systems.

    Science.gov (United States)

    Küçükyilmaz, Ebru; Savas, Selcuk; Saygili, Gokhan; Uysal, Banu

    2015-01-01

    The aim of this study was to evaluate the preparation time and the amounts of apically extruded debris and irrigant using different nickel-titanium instrumentation systems. Forty-five extracted single-rooted mandibular premolar teeth were selected and divided into three groups. The root canals were instrumented according to the manufacturers' instructions, using a reciprocating single-file system, a single-file rotary system and a multiple-file rotary system. Bidistilled water was used as the irrigant solution. The apically extruded debris and irrigant were collected into preweighed Eppendorf tubes. The amounts of extruded debris and irrigant were assessed with a precision micro-balance. The Eppendorf tubes were incubated at 37°C for 15 days. After the incubation period, they were weighed again to assess the debris extrusion. The time required to prepare the canals was also recorded. The results were statistically analyzed using MANOVA and Bonferroni's adjustment. Considering the apically extruded debris and irrigant, there were no statistically significant differences among the groups (p > 0.05). The Reciproc group produced the highest debris (0.000632 ± 0.000162 gr) and irrigant (0.844587 ± 0.437814 ml) extrusion values. While the least extruded debris was observed with OneShape (0,000431 ± 0,000171 gr), the least extruded irrigant was observed with ProTaper system (0.564147 ± 0.370596 ml). Instrumentation was faster using the Reciproc than the other two instruments (70.27 ± 13.38 s) (p < 0.05). All of the instrumentation systems used in this study produced apical debris and irrigant extrusion. The reciprocating single-file system tended to produce more debris and irrigant extrusion, compared with the rotary systems. Considering the preparation time, the single-file systems appeared to be advantageous due to their working time.

  17. Assessing Symptom Burden in Bladder Cancer: An Overview of Bladder Cancer Specific Health-Related Quality of Life Instruments.

    Science.gov (United States)

    Danna, Bernard J; Metcalfe, Michael J; Wood, Erika L; Shah, Jay B

    2016-07-27

    Background: A key component to monitoring and investigating patient QOL is through patient reported health related quality of life (HRQOL) outcome measures. Many instruments have been used to assess HRQOL in bladder cancer and each instrument varies in its development, validation, the context of its usage in the literature and its applicability to certain disease states. Objective: In this review, we sought to summarize how clinicians and researchers should most appropriately utilize the available HRQOL instruments for bladder cancer. Methods: We performed a comprehensive literature search of each instrument used in bladder cancer, paying particular attention to the outcomes assessed. We used these outcomes to group the available instruments into categories best reflecting their optimal usage by stage of disease. Results: We found 5 instruments specific to bladder cancer, of which 3 are validated. Only one of the instruments (the EORTC-QLQ-NMIBC24) was involved in a randomized, prospective validation study. The most heavily used instruments are the EORTC-QLQ-BLM30 for muscle-invasive disease and the FACT-Bl which is used across all disease states. Of the 5 available instruments, 4 are automatically administered with general instruments, while the BCI lacks modularity, and requires co-administration with a generalized instrument. Conclusion: There are multiple strong instruments for use in gauging HRQOL in bladder cancer patients. We have divided these instruments into three categories which optimize their usage: instruments for use following NMIBC treatments (EORTC-QLQ-NMIBC24), instruments for use following radical cystectomy (FACT-Bl-Cys and EORTC-QLQ-BLM30) and more inclusive instruments not limited by treatment modality (BCI and FACT-Bl).

  18. Evaluation and feedback for effective clinical teaching in postgraduate medical education: validation of an assessment instrument incorporating the CanMEDS roles.

    Science.gov (United States)

    Fluit, Cornelia; Bolhuis, Sanneke; Grol, Richard; Ham, Marieke; Feskens, Remco; Laan, Roland; Wensing, Michel

    2012-01-01

    Providing clinical teachers in postgraduate medical education with feedback about their teaching skills is a powerful tool to improve clinical teaching. A systematic review showed that available instruments do not comprehensively cover all domains of clinical teaching. We developed and empirically test a comprehensive instrument for assessing clinical teachers in the setting of workplace learning and linked to the CanMEDS roles. In a Delphi study, the content validity of a preliminary instrument with 88 items was studied, leading to the construction of the EFFECT (evaluation and feedback for effective clinical teaching) instrument. The response process was explored in a pilot test and focus group research with 18 residents of 6 different disciplines. A confirmatory factor analyses (CFA) and reliability analyses were performed on 407 evaluations of 117 supervisors, collected in 3 medical disciplines (paediatrics, pulmonary diseases and surgery) of 6 departments in 4 different hospitals. CFA yielded an 11 factor model with a good to excellent fit and internal consistencies ranged from 0.740 to 0.940 per domain; 7 items could be deleted. The model of workplace learning showed to be a useful framework for developing EFFECT, which incorporates the CanMEDS competencies and proved to be valid and reliable.

  19. TRIANGULATION OF INSTRUMENTATION AND DATA SOURCE: A STRONGER METHOD IN ASSESSING ENGLISH LANGUAGE NEEDS

    Directory of Open Access Journals (Sweden)

    Meedy Nugraha

    2002-01-01

    Full Text Available This paper proposes the importance of multiple instrumentation and data source (triangulation in a needs analysis. Various data gathering methods developed in assessing learners' English language needs are reviewed. The justification of employing more than a single data gathering method and data source in a needs analysis is also presented by examining the strengths and weaknesses of each method and evaluating previous needs analyses carried out in some Asian countries. Highlights are then given to the methodology mostly implemented in assessing English needs in Indonesia and a recommendation is addressed to further studies on learners's needs in Indonesia

  20. Independent Assessment of Instrumentation for ISS On-Orbit NDE. Volume 1

    Science.gov (United States)

    Madaras, Eric I

    2013-01-01

    International Space Station (ISS) Structural and Mechanical Systems Manager, requested that the NASA Engineering and Safety Center (NESC) provide a quantitative assessment of commercially available nondestructive evaluation (NDE) instruments for potential application to the ISS. This work supports risk mitigation as outlined in the ISS Integrated Risk Management Application (IRMA) Watch Item #4669, which addresses the requirement for structural integrity after an ISS pressure wall leak in the event of a penetration due to micrometeoroid or debris (MMOD) impact. This document contains the outcome of the NESC assessment.

  1. Health status of radiation exposed residents living near the Semipalatinsk Nuclear Test Site based on health assessment by interview

    International Nuclear Information System (INIS)

    Hirabayashi, Kyoko; Kawano, Noriyuki; Ohtaki, Megu; Harada, Yuka; Hoshi, Masaharu; Hadara, Hironori; Muldagaliyev, Talgat; Apsalikov, Kazbek

    2008-01-01

    The purpose of the present paper is to examine the aftereffects of radiation exposure on residents of villages near the Semipalatinsk Nuclear Test Site (SNTS) in Kazakhstan. Our Hiroshima University (Japan) research team began field research in 2002 by means of health assessments conducted via interviews. We focus on persons who responded to questions concerning their medical conditions and symptoms. In this paper, we summarize and analyze, using multiple linear logistic regression analysis, the answers obtained by questionnaire survey. The results show: 31% of the residents reported that they felt bad or were in very poor health. Residents living in villages having higher radiation levels were more likely to report having poor or very poor health, minor complaints such as loss of sleep, headaches, nighttime sweating and swollen arms or legs, and the need for nursing care in performing activities of daily living. Symptoms reported by over 40% of the respondents included high blood pressure, heart disease and arthralgia/lower back pain/arthritis. Our results suggest that radiation exposure in the Semipalatinsk area is one of the causes of poor health in general among residents. There is also a possibility that radiation exposure has influenced the incidence of some specific medical conditions. (author)

  2. Mixed-methods study to develop a patient complexity assessment instrument for district nurses.

    Science.gov (United States)

    Thomas, Susan J; Wallace, Carolyn; Jarvis, Paul; Davis, Ruth Elizabeth

    2016-03-01

    There is increasing reference to complex patient needs in health care. However, little is known about how to measure patient complexity or the relationship between it and district nursing activity. To illustrate the use of group concept mapping (GCM) to conceptualise and develop items for a patient complexity assessment instrument to be used by district nurses. The first phase of this research used GCM conceptualisation and consensus methodology to identify items for a community-based patient complexity instrument. GCM helped to provide a conceptual understanding of community-based patient complexity through focused exploration of the term. indicated that a number of environmental, sociological, psychological, behavioural, physical and organisational factors needed to be included. This, in turn, showed that an existing taxonomy did not contain the relevant items. Consequently, amendments were made and a new instrument developed. GCM is a suitable consensus method for use in nursing theory and developing instruments. It proved successful in achieving consensus with no loss of participants' views. GCM is a suitable method for nurses to use in research or practice development activities as it is based on a facilitative and engagement-led approach.

  3. Validity and reliability of an instrument in Portuguese to assess bicycle use patterns in urban areas

    Directory of Open Access Journals (Sweden)

    Marilson Kienteka

    2017-05-01

    Full Text Available DOI: http://dx.doi.org/10.5007/1980-0037.2017v19n1p17   The aim of this study was to analyze the validity and reliability of an instrument to assess bicycle use patterns in urban areas through systematic observation. The instrument items were selected from a literature review. Content validity was established by consensus opinion of experts of the physical activity area. The temporal stability (reliability was verified by percentage of agreement and intraclass correlation coefficient (ICC. Observations were conducted using an adapted protocol based on the System for Observing Play and Recreation in Communities (SOPARC, consisting of systematic scans for counting cyclists in an urban area through video images provided by the public transport control system of Curitiba (URBS. Observers A and B recorded a total of 383 and 378 cyclists. Most of the observed subjects were men (87%, adults (84%, cycling on the BRT lane (54%, coming from downtown (54%, rode the bicycle on the wrong side of the street (58.2%, were not wearing a helmet (76.8 and bicycled alone (64%. Agreement percentiles ranged from 89.2 to 99.5% and ICC values from 0.922 to 0.999. According to criteria adopted, reliability was considered high in all categories included in the instrument. The instrument showed validity and reliability to be used in studies aiming to evaluate bicycle use patterns in Brazilian urban areas.

  4. [Assessment of the use of music therapy with nursing home residents].

    Science.gov (United States)

    Sanchez, Stéphane; Le Guillou, Adrien; Messaoudi, Yasmine; Letty, Aude; Denormandie, Philippe

    A study analysed, on the one hand, the efficacy of the use of music therapy with residents and, on the other, the feasibility of the implementation of such a technique in nursing homes and in follow-up and rehabilitation units. In this context, music therapy seems to be an effective alternative to traditional approaches. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

  5. Assessing and Comparing Physical Environments for Nursing Home Residents: Using New Tools for Greater Research Specificity

    Science.gov (United States)

    Cutler, Lois J.; Kane, Rosalie A.; Degenholtz, Howard B.; Miller, Michael J.; Grant, Leslie

    2006-01-01

    Purpose: We developed and tested theoretically derived procedures to observe physical environments experienced by nursing home residents at three nested levels: their rooms, the nursing unit, and the overall facility. Illustrating with selected descriptive results, in this article we discuss the development of the approach. Design and Methods: On…

  6. GUIDELINES FOR THE DESIGN OF INSTRUMENTS OF COMPETENCE ASSESSMENT FROM MEASURABLE LEARNING STANDARDS

    Directory of Open Access Journals (Sweden)

    Ignacio Polo Martínez

    2015-06-01

    Full Text Available The evaluation is not enough to improve education necessary but. There are no magic to educational problems through assessment solutions. However, the evaluation, in partnership with the methodology, should be treated as determinants of the quality and improving education. Surely, many teachers agree that it is not easy to design assessment tools that are consistent with the teaching-learning competence and, in turn, with rigorous curriculum standards and assessment of the Autonomous Community. However, this difficulty should not be considered as an impossibility. Through this article aims to contribute to building an improvement plan associated with the design of the evaluation instruments from different areas or subjects. Such a design should be based on at least the following: I want to evaluate (referring to assessment criteria and standards of assessable learning included in the instrument and I will evaluate (referencing jurisdictional situations linked to next and known student context, HOW I WILL QUALIFY (preserving the right of students to an objective evaluation and what consequences they will have the results for the different agents that make up the educational community.

  7. The Program Sustainability Assessment Tool: A New Instrument for Public Health Programs

    Science.gov (United States)

    Calhoun, Annaliese; Robichaux, Christopher B.; Elliott, Michael B.; Moreland-Russell, Sarah

    2014-01-01

    Introduction Public health programs can deliver benefits only if they are able to sustain programs, policies, and activities over time. Although numerous sustainability frameworks and models have been developed, there are almost no assessment tools that have demonstrated reliability or validity or have been widely disseminated. We present the Program Sustainability Assessment Tool (PSAT), a new and reliable instrument for assessing the capacity for program sustainability of various public health and other programs. Methods A measurement development study was conducted to assess the reliability of the PSAT. Program managers and staff (n = 592) representing 252 public health programs used the PSAT to rate the sustainability of their program. State and community-level programs participated, representing 4 types of chronic disease programs: tobacco control, diabetes, obesity prevention, and oral health. Results The final version of the PSAT contains 40 items, spread across 8 sustainability domains, with 5 items per domain. Confirmatory factor analysis shows good fit of the data with the 8 sustainability domains. The subscales have excellent internal consistency; the average Cronbach’s α is 0.88, ranging from 0.79 to 0.92. Preliminary validation analyses suggest that PSAT scores are related to important program and organizational characteristics. Conclusion The PSAT is a new and reliable assessment instrument that can be used to measure a public health program’s capacity for sustainability. The tool is designed to be used by researchers, evaluators, program managers, and staff for large and small public health programs. PMID:24456645

  8. Operational aspects of Quality-of-Life Assessment. Choosing the right instrument.

    Science.gov (United States)

    Erickson, P; Taeuber, R C; Scott, J

    1995-01-01

    In assessing quality of life, the most important goal is to develop a strategy that produces useable and useful information for decision making. Assessment design is complex, and whether an assessment is developed from scratch, or 1 or more portions of existing instruments are adapted, the focus must be on the quality of the theoretical and operational elements of the particular line of inquiry and its environment. The necessary and most often discussed focus on the theoretical dimensions of validity, reliability and responsiveness is not sufficient to insure that the data are of the requisite high quality. There is also a need, almost universally given little attention in the literature, to look at operational aspects, such as design, format, flow, appearance, and response-stimulus, of each assessment instrument. Searching for guidance in the quality-of-life (QOL) literature remains a challenge even with computers, modems, keywords, static guidebooks and bibliographic systems. The On-Line Guide to Quality-of-Life Assessments (OLGA) is presented as a personal computer-based system that is updated 3 times a year to provide QOL researchers and assessment developers with 2 databases: assessments providing full descriptions and contact information; and references providing fully keyed citations to the assessment use literature. These databases are made more useful by decision-logical programs that identify relevant assessments and supporting research literature. OLGA can thus save time and other resources by helping investigators concentrate on the most relevant elements of the existing literature. This focus will assist them in avoiding the problems of ending up with the right answers to the wrong questions.

  9. Developing Authentic Assessment Instrument on Short Story Appreciation and Production for Senior High School Students

    Directory of Open Access Journals (Sweden)

    Purwadi Susilo

    2017-10-01

    Full Text Available This study was conducted as the follow-up action toward the result of a preliminary study which showed that Indonesian Language teachers in Senior High School (mentioned as “SMA” YPI Tunas Bangsa Palembang had not yet implemented any standardized, objective, accurate nor appropriate assessment instruments as demanded by the 2013 curriculum. Based on this problem, the research question in this study was “How are teachers’ necessities of an authentic assessment instrument to assess understanding on the short stories production and appreciation in SMA YPI Tunas Bangsa Palembang?”. This study employed the research and development method adapted from the one proposed by Akker which consisted of several steps: (1 analysis, (2 design, (3 evaluation, and the one by Tessmer: (1 self-evaluation, (2 expert judgment, (3 one-to-one, (4 small group, (5 revision, and (6 field test. The implementation of the authentic assessment for short stories production and appreciation was analyzed by using the inter-rater agreement. The inter-rater reliability was measured using the Cronbach’s Alfa. The data were also analyzed using the SPSS 16 program which resulted to a level of significance at 0.5. Therefore, it is found that the evaluation given by the experts and the respondents reached a similar perception. Based on the result of the Cronbach’s Alpha test, a value of 0.99 was obtained above 0.70 which implies that the authentic assessment instruments developed in this study are highly reliable.

  10. Using the Rasch measurement model to design a report writing assessment instrument.

    Science.gov (United States)

    Carlson, Wayne R

    2013-01-01

    This paper describes how the Rasch measurement model was used to develop an assessment instrument designed to measure student ability to write law enforcement incident and investigative reports. The ability to write reports is a requirement of all law enforcement recruits in the state of Michigan and is a part of the state's mandatory basic training curriculum, which is promulgated by the Michigan Commission on Law Enforcement Standards (MCOLES). Recently, MCOLES conducted research to modernize its training and testing in the area of report writing. A structured validation process was used, which included: a) an examination of the job tasks of a patrol officer, b) input from content experts, c) a review of the professional research, and d) the creation of an instrument to measure student competency. The Rasch model addressed several measurement principles that were central to construct validity, which were particularly useful for assessing student performances. Based on the results of the report writing validation project, the state established a legitimate connectivity between the report writing standard and the essential job functions of a patrol officer in Michigan. The project also produced an authentic instrument for measuring minimum levels of report writing competency, which generated results that are valid for inferences of student ability. Ultimately, the state of Michigan must ensure the safety of its citizens by licensing only those patrol officers who possess a minimum level of core competency. Maintaining the validity and reliability of both the training and testing processes can ensure that the system for producing such candidates functions as intended.

  11. Strategies for assessing mental health in Haiti: local instrument development and transcultural translation.

    Science.gov (United States)

    Kaiser, Bonnie N; Kohrt, Brandon A; Keys, Hunter M; Khoury, Nayla M; Brewster, Aimée-Rika T

    2013-08-01

    The lack of culturally appropriate mental health assessment instruments is a major barrier to screening and evaluating efficacy of interventions. Simple translation of questionnaires produces misleading and inaccurate conclusions. Multiple alternate approaches have been proposed, and this study compared two approaches tested in rural Haiti. First, an established transcultural translation process was used to develop Haitian Kreyòl versions of the Beck Depression Inventory (BDI) and Beck Anxiety Inventory (BAI). This entailed focus group discussions evaluating comprehensibility, acceptability, relevance, and completeness. Second, qualitative data collection was employed to develop new instruments: the Kreyòl Distress Idioms (KDI) and Kreyòl Function Assessment (KFA) scales. For the BDI and BAI, some items were found to be nonequivalent due to lack of specificity, interpersonal interpretation, or conceptual nonequivalence. For all screening tools, items were adjusted if they were difficult to endorse or severely stigmatizing, represented somatic experiences of physical illness, or were difficult to understand. After the qualitative development phases, the BDI and BAI were piloted with 31 and 27 adults, respectively, and achieved good reliability. Without these efforts to develop appropriate tools, attempts at screening would have captured a combination of atypical suffering, everyday phenomena, and potential psychotic symptoms. Ultimately, a combination of transculturally adapted and locally developed instruments appropriately identified those in need of care through accounting for locally salient symptoms of distress and their negative sequelae.

  12. Automatic creation of Markov models for reliability assessment of safety instrumented systems

    International Nuclear Information System (INIS)

    Guo Haitao; Yang Xianhui

    2008-01-01

    After the release of new international functional safety standards like IEC 61508, people care more for the safety and availability of safety instrumented systems. Markov analysis is a powerful and flexible technique to assess the reliability measurements of safety instrumented systems, but it is fallible and time-consuming to create Markov models manually. This paper presents a new technique to automatically create Markov models for reliability assessment of safety instrumented systems. Many safety related factors, such as failure modes, self-diagnostic, restorations, common cause and voting, are included in Markov models. A framework is generated first based on voting, failure modes and self-diagnostic. Then, repairs and common-cause failures are incorporated into the framework to build a complete Markov model. Eventual simplification of Markov models can be done by state merging. Examples given in this paper show how explosively the size of Markov model increases as the system becomes a little more complicated as well as the advancement of automatic creation of Markov models

  13. National Beef Quality Audit - 2016: Survey of carcass characteristics through instrument grading assessments.

    Science.gov (United States)

    Boykin, C A; Eastwood, L C; Harris, M K; Hale, D S; Kerth, C R; Griffin, D B; Arnold, A N; Hasty, J D; Belk, K E; Woerner, D R; Delmore, R J; Martin, J N; VanOverbeke, D L; Mafi, G G; Pfeiffer, M M; Lawrence, T E; McEvers, T J; Schmidt, T B; Maddock, R J; Johnson, D D; Carr, C C; Scheffler, J M; Pringle, T D; Stelzleni, A M; Gottlieb, J; Savell, J W

    2017-07-01

    The instrument grading assessment portion of the National Beef Quality Audit (NBQA) - 2016 allows the unique opportunity to evaluate beef carcass traits over the course of a year. One week of instrument grading data was collected each month from 5 beef processing corporations encompassing 18 facilities from January 2016 through December 2016 ( = 4,544,635 carcasses). Mean USDA yield grade (YG) was 3.1 with 1.37 cm fat thickness (FT), 88.9 cm LM area, 393.6 kg HCW, and 2.1% KPH. Frequency distribution of USDA YG was 9.5% YG 1, 34.6% YG 2, 38.8% YG 3, 14.6% YG 4, and 2.5% YG 5. Increases in HCW and FT since the NBQA-2011 were major contributors to differences in mean YG and the (numerically) increased frequency of YG 3, 4, and 5 carcasses found in the current audit. Mean marbling score was Small, and the distribution of USDA quality grades was 4.2% Prime, 71.4% Choice, 21.7% Select, and 2.7% other. Frequency of carcasses grading Prime on Monday (6.43%) was numerically higher than the average frequency of carcasses grading Prime overall (4.2%). Monthly HCW means were 397.6 kg in January, 397.2 kg in February, 396.5 kg in March, 389.3 kg in April, 384.8 kg in May, 385.0 kg in June, 386.1 kg in July, 394.1 kg in August, 399.1 kg in September, 403.9 kg in October, 406.5 kg in November, and 401.9 kg in December. Monthly mean marbling scores were Small in January, Small in February, Small in March, Small in April, Small in May, Small in June, Small in July, Small in August, Small in September, Small in October, Small in November, and Small in December. Both mean HCW and mean marbling score declined in the months of May and June. The month with the greatest numerical frequency of dark cutters was October (0.74%). Comparison of overall data from in-plant carcass and instrument grading assessments revealed close alignment of information, especially for YG (3.1 for in-plant assessment versus 3.1 for instrument grading) and marbling (Small for in-plant assessment versus Small

  14. Briefer assessment of social network drinking: A test of the Important People Instrument-5 (IP-5).

    Science.gov (United States)

    Hallgren, Kevin A; Barnett, Nancy P

    2016-12-01

    The Important People instrument (IP; Longabaugh et al., 2010) is one of the most commonly used measures of social network drinking. Although its reliability and validity are well-supported, the length of the instrument may limit its use in many settings. The present study evaluated whether a briefer, 5-person version of the IP (IP-5) adequately reproduces scores from the full IP. College freshmen (N = 1,053) reported their own past-month drinking, alcohol-related consequences, and information about drinking in their close social networks at baseline and 1 year later. From this we derived network members' drinking frequency, percentage of drinkers, and percentage of heavy drinkers, assessed for up to 10 (full IP) or 5 (IP-5) network members. We first modeled the expected concordance between full-IP scores and scores from simulated shorter IP instruments by sampling smaller subsets of network members from full IP data. Then, using quasi-experimental methods, we administered the full IP and IP-5 and compared the 2 instruments' score distributions and concurrent and year-lagged associations with participants' alcohol consumption and consequences. Most of the full-IP variance was reproduced from simulated shorter versions of the IP (ICCs ≥ 0.80). The full IP and IP-5 yielded similar score distributions, concurrent associations with drinking (r = 0.22 to 0.52), and year-lagged associations with drinking. The IP-5 retains most of the information about social network drinking from the full IP. The shorter instrument may be useful in clinical and research settings that require frequent measure administration, yielding greater temporal resolution for monitoring social network drinking. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

  15. Assessment of the nutritional status among residents in a Danish nursing home - health effects of a formulated food and meal policy.

    Science.gov (United States)

    Kuosma, Kirsi; Hjerrild, Joan; Pedersen, Preben Ulrich; Hundrup, Yrsa Andersen

    2008-09-01

    To gain information about the effects of implementation of a written food and meal policy and to evaluate to what extent systematic nutritional assessment and intervention would result in weight stability among the residents. Studies have shown that aged residents living in institutions suffer from malnutrition or are at risk of malnutrition. Health policies have pointed out that more attention should be given to individualised nutritional care. Several techniques are available to identify malnourished nursing home residents, but very few studies have reported findings of studies based on systematic nutritional assessment. A quasi-experimental study based on a time series design used the residents as their own controls. The study included all 20 residents who resided at the nursing home at baseline in September 2004. Five residents died during the study period (mean age 84.4 years, range 62-91 years). Altogether 15 residents (75%) were assessed all five times during the study period. The proportion of weight-stable residents increased significantly over the study from 52.6% (CI 99%: 23.1-80.2) at baseline to 87.7% (p hospitals.

  16. Assessment of laparoscopic skills of Gynecology and Obstetrics residents after a training program.

    Science.gov (United States)

    Fernandes, Carla Ferreira Kikuchi; Ruano, José Maria Cordeiro; Kati, Lea Mina; Noguti, Alberto Sinhiti; Girão, Manoel João Batista Castello; Sartori, Marair Gracio Ferreira

    2016-01-01

    To evaluate laparoscopic skills of third-year Gynecology and Obstetrics residents after training at a training and surgical experimentation center. Use of a prospective questionnaire analyzing demographic data, medical residency, skills, competences, and training in a box trainer and in pigs. After the training, there was significant improvement in laparoscopic skills according to the residents (before 1.3/after 2.7; p=0.000) and preceptors (before 2.1/after 4.8; p=0.000). There was also significant improvement in the feeling of competence in surgeries with level 1 and 2 of difficulty. All residents approved the training. The training was distributed into 12 hours in the box trainer and 20 hours in animals, and led to better laparoscopic skills and a feeling of more surgical competence in laparoscopic surgery levels 1 and 2. Avaliar a habilidade laparoscópica dos residentes do terceiro ano de residência médica em Ginecologia e Obstetrícia após treinamento em um centro de treinamento e experimentação cirúrgica. Aplicação de questionário de forma prospectiva analisando dados demográficos, da residência médica, da habilidade, da competência e do treinamento em caixa preta e em porcas. Após o treinamento, houve melhora da habilidade em laparoscopia de forma significativa na avaliação dos residentes (antes 1,3/depois 2,7; p=0,000) e preceptores (antes 2,1/depois 4,8; p=0,000). Houve melhora significativa na sensação de competência em cirurgias de níveis 1 e 2 de dificuldade. Todos os residentes aprovaram o treinamento. O treinamento dividido em 12 horas de caixa preta e 20 horas em animais trouxe melhora na habilidade em laparoscopia e na sensação de melhora na competência cirúrgica em cirurgias laparoscópicas de níveis 1 e 2.

  17. Paroxysmal positional vertigo despite complete vestibular impairment: the role of instrumental assessment.

    Science.gov (United States)

    Casani, A P; Cerchiai, N; Navari, E

    2018-02-28

    Lindsay and Hemenway syndrome is characterised by a posterior canal benign paroxysmal positional vertigo following a partial unilateral vestibular loss affecting the same side. The syndrome is caused by damage of structures innervated by the superior division of the vestibular nerve and perfused by the anterior vestibular artery; the detached otoconia can cause vertigo in the still intact posterior semicircular canal. The most recent vestibular instrumental techniques allow reaching an accurate topodiagnosis in case of peripheral vestibular failure. We report on two cases of Lindsay-Hemenway syndrome despite complete vestibular failure demonstrated by vestibular instrumental assessment. After making some critical considerations on these findings, we underline the importance of not disregarding the diagnosis of paroxysmal positional vertigo in an established complete labyrinthine loss of function. © Copyright by Società Italiana di Otorinolaringologia e Chirurgia Cervico-Facciale.

  18. Development and validation of an instrument to evaluate science teachers' assessment beliefs and practices

    Science.gov (United States)

    Genc, Evrim

    The primary purpose of this study was to develop a valid and reliable instrument to examine science teachers' assessment beliefs and practices in science classrooms. The present study also investigated the relationship between teachers' beliefs and practices in terms of assessment issues in science, their perceptions of the factors that influenced their assessment practices and their feelings towards high-stakes testing. The participants of the study were 408 science teachers teaching at middle and high school levels in the State of Florida. Data were collected through two modes of administration of the instrument as a paper-and-pencil and a web-based form. The response rate for paper-and-pencil administration was estimated as 68% whereas the response for the web administration was found to be 27%. Results from the various dimensions of validity and reliability analyses revealed that the 24 item-four-factor belief and practice measures were psychometrically sound and conceptually anchored measures of science teachers' assessment beliefs and self-reported practices. Reliability estimates for the belief measure ranged from .83 to .91 whereas alpha values for the practice measure ranged from .56 to .90. Results from the multigroup analysis supported that the instrument has the same theoretical structure across both administration groups. Therefore, future researchers may use either a paper-and-pencil or web-based format of the instrument. This study underscored a discrepancy between what teachers believe and how they act in classroom settings. It was emphasized that certain factors were mediating the dynamics between the belief and the practice. The majority of teachers reported that instruction time, class size, professional development activities, availability of school funding, and state testing mandates impact their assessment routines. Teachers reported that both the preparation process and the results of the test created unbelievable tension both on students and

  19. Selecting instruments for assessing psychological wellbeing in Afghan and Kurdish refugee groups

    Directory of Open Access Journals (Sweden)

    Sulaiman-Hill Cheryl MR

    2010-09-01

    Full Text Available Abstract Background Afghan and Iraqi refugees comprise nearly half of all those currently under United Nations protection. As many of them will eventually be resettled in countries outside the region of origin, their long term health and settlement concerns are of relevance to host societies, and will be a likely focus for future research. Since Australia and New Zealand have both accepted refugees for many years and have dedicated, but different settlement and immigration policies, a study comparing the resettlement of two different refugee groups in these countries was undertaken. The purpose of this article is to describe the instrument selection for this study assessing mental health and psychological well being with Afghan and Kurdish former refugees, in particular to address linguistic considerations and translated instrument availability. A summary of instruments previously used with refugee and migrant groups from the Middle East region is presented to assist other researchers, before describing the three instruments ultimately selected for the quantitative component of our study. Findings The Kessler-10 Psychological Distress Scale (K10, General Perceived Self-Efficacy Scale (GPSE, and Personal Well-Being Index (PWI all showed good reliability (Cronbach's alphas of 0.86, 0.89 and 0.83 respectively for combined language versions and ease of use even for pre-literate participants, with the sample of 193 refugees, although some concepts in the GPSE proved problematic for a small number of respondents. Farsi was the language of choice for the majority of Afghan participants, while most of the Kurds chose to complete English versions in addition to Farsi. No one used Arabic or Turkish translations. Participants settled less than ten years were more likely to complete questionnaires in Farsi. Descriptive summary statistics are presented for each instrument with results split by gender, refugee group and language version completed. Conclusion

  20. Instruments to assess and measure personal and environmental radiofrequency-electromagnetic field exposures

    International Nuclear Information System (INIS)

    Bhatt, Chhavi R.; Redmayne, Mary; Abramson, Michael J.; Benke, Geza

    2016-01-01

    Radiofrequency-electromagnetic field (RF-EMF) exposure of human populations is increasing due to the widespread use of mobile phones and other telecommunication and broadcasting technologies. There are ongoing concerns about potential short- and long-term public health consequences from RF-EMF exposures. To elucidate the RF-EMF exposure-effect relationships, an objective evaluation of the exposures with robust assessment tools is necessary. This review discusses and compares currently available RF-EMF exposure assessment instruments, which can be used in human epidemiological studies. Quantitative assessment instruments are either mobile phone-based (apps/software-modified and hardware-modified) or exposimeters. Each of these tool has its usefulness and limitations. Our review suggests that assessment of RF-EMF exposures can be improved by using these tools compared to the proxy measures of exposure (e.g. questionnaires and billing records). This in turn, could be used to help increase knowledge about RF-EMF exposure induced health effects in human populations.

  1. Instruments to assess and measure personal and environmental radiofrequency-electromagnetic field exposures.

    Science.gov (United States)

    Bhatt, Chhavi Raj; Redmayne, Mary; Abramson, Michael J; Benke, Geza

    2016-03-01

    Radiofrequency-electromagnetic field (RF-EMF) exposure of human populations is increasing due to the widespread use of mobile phones and other telecommunication and broadcasting technologies. There are ongoing concerns about potential short- and long-term public health consequences from RF-EMF exposures. To elucidate the RF-EMF exposure-effect relationships, an objective evaluation of the exposures with robust assessment tools is necessary. This review discusses and compares currently available RF-EMF exposure assessment instruments, which can be used in human epidemiological studies. Quantitative assessment instruments are either mobile phone-based (apps/software-modified and hardware-modified) or exposimeters. Each of these tool has its usefulness and limitations. Our review suggests that assessment of RF-EMF exposures can be improved by using these tools compared to the proxy measures of exposure (e.g. questionnaires and billing records). This in turn, could be used to help increase knowledge about RF-EMF exposure induced health effects in human populations.

  2. Development of Instruments to Assess Shame and Guilt in Adolescents: Empirical Differences Between the Constructs

    Directory of Open Access Journals (Sweden)

    Lorena Maria Laskoski

    2013-05-01

    Full Text Available Shame and guilt are terms easily mixed in everyday life and often used as synonyms. Although they are words of similar use, they represent theoretically different moral emotions. The aims of this study were to develop and validate instruments to assess shame and guilt and to test the empirical independence of the constructs. Five hundred and eighty high school students from three Brazilian states participated in this study, 55% of them female, with an average age of 16.0 years. The participants answered a questionnaire containing socio demographic questions and scales designed for this study in order to assess shame and guilt. The scales developed gave appropriate evidence of validity and reliability. A single factor was extracted to assess shame and two factors to assess guilt (recognition of mistake and regret. The constructs revealed to be correlated, but independent. It is considered that there is sufficient evidence to affirm that shame and guilt are emotions with distinctive peculiarities and can be measured using the instruments developed in this research.

  3. Music@Home: A novel instrument to assess the home musical environment in the early years.

    Science.gov (United States)

    Politimou, Nina; Stewart, Lauren; Müllensiefen, Daniel; Franco, Fabia

    2018-01-01

    The majority of children under the age of 5 appear to show spontaneous enjoyment of singing, being exposed to music and interacting with musical instruments, but whether variations in engaging in such activities in the home could contribute to developmental outcomes is still largely unknown. Critically, researchers lack a comprehensive instrument with good psychometric properties to assess the home musical environment from infancy to the preschool years. To address this gap, this paper presents two studies that describe the development and validation of the Music@Home questionnaire, which comprises two versions: Infant and Preschool. In Study 1, an initial pool of items was generated and administered to a wide audience of parents (n = 287 for the Infant, n = 347 for the Preschool version). Exploratory factor analysis was used to identify different dimensions comprising the home musical environment of both infants and pre-schoolers, and to reduce the initial pool of items to a smaller number of meaningful items. In Study 2, convergent and divergent validity and internal and test-retest reliability of the new instrument were established, using data from a different sample of participants (n = 213 for the Infant, n = 213 for the Preschool version). The second study also investigated associations between the Music@Home and musical characteristics of the parents, such as their musical education and personal engagement with music. Overall, the Music@Home constitutes a novel, valid and reliable instrument that allows for the systematic assessment of distinct aspects of the home musical environment in families with children under the age of 5. Furthermore, the Infant and Preschool versions of the Music@Home present differential associations with musical characteristics of the parents opening a new area of inquiry into how musical exposure and interaction in the home may vary across different developmental stages.

  4. An instrument for broadened risk assessment in antenatal health care including non-medical issues

    Directory of Open Access Journals (Sweden)

    Amber Amanda Vos

    2015-03-01

    Full Text Available Introduction: Growing evidence on the risk contributing role of non-medical factors on pregnancy outcomes urged for a new approach in early antenatal risk selection. The evidence invites to more integration, in particular between the clinical working area and the public health domain. We developed a non-invasive, standardized instrument for comprehensive antenatal risk assessment. The current study presents the application-oriented development of a risk screening instrument for early antenatal detection of risk factors and tailored prevention in an integrated care setting.Methods: A review of published instruments complemented with evidence from cohort studies. Selection and standardization of risk factors associated with small for gestational age, preterm birth, congenital anomalies and perinatal mortality. Risk factors were weighted to obtain a cumulative risk score. Responses were then connected to corresponding care pathways. A cumulative risk threshold was defined, which can be adapted to the population and the availability of preventive facilities. A score above the threshold implies multidisciplinary consultation between caregivers.Results: The resulting digital score card consisted of 70 items, subdivided into four non-medical and two medical domains. Weighing of risk factors was based on existing evidence. Pilot-evidence from a cohort of 218 pregnancies in a multi-practice urban setting showed a cut-off of 16 points would imply 20% of all pregnant women to be assessed in a multidisciplinary setting. A total of 28 care pathways were defined.Conclusion: The resulting score card is a universal risk screening instrument which incorporates recent evidence on non-medical risk factors for adverse pregnancy outcomes and enables systematic risk management in an integrated antenatal health care setting.

  5. An instrument for broadened risk assessment in antenatal health care including non-medical issues

    Directory of Open Access Journals (Sweden)

    Amber Amanda Vos

    2015-03-01

    Full Text Available Introduction: Growing evidence on the risk contributing role of non-medical factors on pregnancy outcomes urged for a new approach in early antenatal risk selection. The evidence invites to more integration, in particular between the clinical working area and the public health domain. We developed a non-invasive, standardized instrument for comprehensive antenatal risk assessment. The current study presents the application-oriented development of a risk screening instrument for early antenatal detection of risk factors and tailored prevention in an integrated care setting. Methods: A review of published instruments complemented with evidence from cohort studies. Selection and standardization of risk factors associated with small for gestational age, preterm birth, congenital anomalies and perinatal mortality. Risk factors were weighted to obtain a cumulative risk score. Responses were then connected to corresponding care pathways. A cumulative risk threshold was defined, which can be adapted to the population and the availability of preventive facilities. A score above the threshold implies multidisciplinary consultation between caregivers. Results: The resulting digital score card consisted of 70 items, subdivided into four non-medical and two medical domains. Weighing of risk factors was based on existing evidence. Pilot-evidence from a cohort of 218 pregnancies in a multi-practice urban setting showed a cut-off of 16 points would imply 20% of all pregnant women to be assessed in a multidisciplinary setting. A total of 28 care pathways were defined. Conclusion: The resulting score card is a universal risk screening instrument which incorporates recent evidence on non-medical risk factors for adverse pregnancy outcomes and enables systematic risk management in an integrated antenatal health care setting.

  6. Assessing the potential of economic instruments for managing drought risk at river basin scale

    Science.gov (United States)

    Pulido-Velazquez, M.; Lopez-Nicolas, A.; Macian-Sorribes, H.

    2015-12-01

    Economic instruments work as incentives to adapt individual decisions to collectively agreed goals. Different types of economic instruments have been applied to manage water resources, such as water-related taxes and charges (water pricing, environmental taxes, etc.), subsidies, markets or voluntary agreements. Hydroeconomic models (HEM) provide useful insight on optimal strategies for coping with droughts by simultaneously analysing engineering, hydrology and economics of water resources management. We use HEMs for evaluating the potential of economic instruments on managing drought risk at river basin scale, considering three criteria for assessing drought risk: reliability, resilience and vulnerability. HEMs allow to calculate water scarcity costs as the economic losses due to water deliveries below the target demands, which can be used as a vulnerability descriptor of drought risk. Two generic hydroeconomic DSS tools, SIMGAMS and OPTIGAMS ( both programmed in GAMS) have been developed to evaluate water scarcity cost at river basin scale based on simulation and optimization approaches. The simulation tool SIMGAMS allocates water according to the system priorities and operating rules, and evaluate the scarcity costs using economic demand functions. The optimization tool allocates water resources for maximizing net benefits (minimizing total water scarcity plus operating cost of water use). SIMGAS allows to simulate incentive water pricing policies based on water availability in the system (scarcity pricing), while OPTIGAMS is used to simulate the effect of ideal water markets by economic optimization. These tools have been applied to the Jucar river system (Spain), highly regulated and with high share of water use for crop irrigation (greater than 80%), where water scarcity, irregular hydrology and groundwater overdraft cause droughts to have significant economic, social and environmental consequences. An econometric model was first used to explain the variation

  7. Sonographic detection of pneumothorax by radiology residents as part of extended focused assessment with sonography for trauma.

    Science.gov (United States)

    Brook, Olga R; Beck-Razi, Nira; Abadi, Subhi; Filatov, Janna; Ilivitzki, Anat; Litmanovich, Diana; Gaitini, Diana

    2009-06-01

    The purpose of this study was to assess the accuracy of sonographic pneumothorax detection by radiology residents as a part of extended focused assessment with sonography for trauma (eFAST). In a prospective study, a sonographic search for pneumothoraces was performed as part of a standard FAST examination by the on-call resident. Each lung field was scanned at the second to fourth anterior intercostal spaces and the sixth to eighth midaxillary line intercostal spaces. A normal pleural interface was identified by the presence of parietal-over-visceral pleural sliding with "comet tail" artifacts behind. Absence of these normal features indicated a pneumothorax. The sonographic diagnosis was correlated with supine chest radiography and chest computed tomography (CT). A total of 338 lung fields in 169 patients were included in the study. Patients underwent eFAST, chest radiography, and chest CT when clinically indicated. Chest CT was considered the reference standard examination. Computed tomography identified 43 pneumothoraces (13%): 34 small and 9 moderate. On chest radiography, 7 pneumothoraces (16%) were identified. Extended FAST identified 23 pneumothoraces (53%). Compared with CT, eFAST had sensitivity of 47%, specificity of 99%, a positive predictive value of 87%, and a negative predictive value of 93%. All of the moderate pneumothoraces were identified by eFAST. Twenty small pneumothoraces missed by eFAST did not require drainage during the hospitalization period. Extended FAST performed by residents is an accurate and efficient tool for early detection of clinically important pneumothoraces.

  8. Senior general surgery residents can be trained to perform focused assessment with sonography for trauma patients accurately.

    Science.gov (United States)

    Hsu, Sheng-Der; Chen, Cheng-Jueng; Chan, De-Chuan; Yu, Jyh-Cherng

    2017-12-01

    Researchers studying trauma have found that physicians are able to perform a focused assessment with sonography for trauma (FAST) with minimal training and achieve ideal accuracy. However, there are currently no consensus or standard guidelines regarding the performance of this assessment. The aim of our study was to clarify the value of FAST performed by well-qualified senior general surgery residents in cases of suspected blunt abdominal trauma, which presents an important diagnostic problem in emergency departments. This was a retrospective study in the emergency department (ED) of our hospital performed from January 2011 to September 2013. Patients were included if they (1) had undergone a FAST examination performed by qualified residents and (2) had received subsequent formal radiographic or surgical evaluations. The results were compared against subsequent surgical findings or formal Department of Radiology reference standards. Among the 438 patients enrolled, false-negative results were obtained in 8 and false-positive results in 5. Only one patient was missed and required laparotomy to repair a small intestine perforation. The sensitivity and specificity were 87 and 99%, respectively; the accuracy was 97%. Senior general surgery residents can be trained to perform accurate FAST examinations on trauma patients.

  9. HEALTH RISK ASSESSMENT OF NITRATE EXPOSURE IN WELL WATER OF RESIDENTS IN INTENSIVE AGRICULTURE AREA

    OpenAIRE

    Noraziah Jamaludin; Shaharuddin Mohd Sham; Sharifah Norkhadijah Syed Ismail

    2013-01-01

    Nitrate in well water has become a public health concern especially in agriculture areas. Nitrate contamination in drinking water poses health risks to humans. This cross-sectional study was conducted with an aim to determine the health risk of residents in intensive agriculture area of Bachok Kelantan from nitrate exposure in drinking well water. Nitrate in well water was determined with Spectrophotometer while the health risk was determined through calculation of Chronic Daily Intake (CDI) ...

  10. Pain monitoring and medication assessment in elderly nursing home residents with dementia.

    Science.gov (United States)

    Tang, Mette Marie; Wollsen, Morten Gill; Aagaard, Lise

    2016-01-01

    To monitor pain intensity, pain symptoms, and medication use in elderly with dementia. Nursing home residents above 65 years of age, diagnosed with dementia, and showing pain symptoms were included in the study. The patients' mental status was monitored through a mini-mental state examination score and observations of pain symptoms using Part 1 of the Mobilization-Observation-Behaviour-Intensity-Dementia-2 (MOBID-2) pain scale. Community pharmacists reviewed the patients' medication use, and the prescriptions were compared with guidelines for treatment of geriatric patients. Alterations to the patients' medicine use were forwarded to the general practitioners. Sixty-one nursing home residents diagnosed with dementia were identified, 15 of these fulfilled the inclusion criteria, and 12 agreed to participate in the study. The mean age was 87 years of age (range: 77-96), and 42% of the residents were males. The patients' overall pain intensity was 83% for observations on the numeric pain rating scale (NRS) >0 and 67% for NRS ≥3. Most painful were the situations in which the residents were to mobilize their legs, turn around to both sides of the bed, and when sitting on the bed. The medication reviews identified a total of 95 individual prescriptions, and 33% of these were for nervous system medications, followed by medicines for the treatment of alimentary tract and metabolism disorders (31% of total). Eleven prescriptions for pain medicine were identified; the majority of these were for paracetamol and opioids. Seventeen proposals to patients' medication use were suggested, but the general practitioners accepted only 6% of these. This study indicates that the MOBID-2 pain scale in combination with medication reviews can be used as a tool for optimization of patients' medication use. However, we recommend the conduction of a larger-scale study in multiple settings, to validate our results and the generalizability of the findings.

  11. A Systematic Review of Patient- or Proxy-Reported Validated Instruments Assessing Pediatric Dysphagia.

    Science.gov (United States)

    Myer, Charles M; Howell, Rebecca J; Cohen, Aliza P; Willging, J Paul; Ishman, Stacey L

    2016-05-01

    Pediatric dysphagia occurs in 500,000 children each year; however, there is not a common tool to assess these children. Our aim was to identify validated patient- or parent-reported outcome assessment tools evaluating pediatric dysphagia. Scopus, EMBASE, PubMed, Cochrane Library, and CINAHL electronic databases (all indexed years through August 2014). Inclusion criteria included English-language articles containing instruments evaluated in children. Two investigators independently reviewed all articles, and the review was performed according to PRISMA guidelines (Preferred Reporting Items for Systematic Reviews and Meta-analyses). The initial search yielded 1697 abstracts; 158 studies were assessed further. Four symptom questionnaires, validated in adults, were used to report pediatric dysphagia outcomes. Four outcomes tools assessing dysphagia were validated in pediatrics in selected populations. The Dysphagia in Multiple Sclerosis questionnaire and the Dysphagia Symptom Questionnaire for eosinophilic esophagitis were validated in adolescents and adults. The Symptom Questionnaire for Eosinophilic Esophagitis was validated in children with eosinophilic esophagitis. The Pediatric Quality of Life Inventory Gastrointestinal Symptoms Module, validated in children with gastrointestinal disorders, includes 2 domains that assess swallowing function. We did not identify any validated patient- or parent-reported outcome assessment tools examining dysphagia symptoms in a general pediatric population. However, we identified 4 questionnaires that have been validated in specific pediatric disease cohorts. Having a standardized assessment instrument validated in all children would allow clinicians to systematically report symptoms and compare results of pediatric clinical trials. With this in mind, we recommend establishing a standard questionnaire for the broader pediatric population. © American Academy of Otolaryngology—Head and Neck Surgery Foundation 2016.

  12. An assessment of cultural values and resident-centered culture change in U.S. nursing facilities.

    Science.gov (United States)

    Banaszak-Holl, Jane; Castle, Nicholas G; Lin, Michael; Spreitzer, Gretchen

    2013-01-01

    Culture change initiatives propose to improve care by addressing the lack of managerial supports and prevalent stressful work environments in the industry; however, little is known about how culture change facilities differ from facilities in the industry that have not chosen to affiliate with the resident-centered care movements. The aim of this study was to evaluate representation of organizational culture values within a random sample of U.S. nursing home facilities using the competing values framework and to determine whether organizational values are related to membership in resident-centered culture change initiatives. We collected reports of cultural values using a well-established competing values framework instrument in a random survey of facility administrators and directors of nursing within all states. We received responses from 57% of the facilities that were mailed the survey. Directors of nursing and administrators did not differ significantly in their reports of culture and facility measures combined their responses. Nursing facilities favored market-focused cultural values on average, and developmental values, key to innovation, were the least common across all nursing homes. Approximately 17% of the facilities reported that all cultural values were strong within their facilities. Only high developmental cultural values were linked to participation in culture change initiatives. Culture change facilities were not different from non-culture change facilities in the promotion of employee focus as organizational culture, as emphasized in group culture values. Likewise, culture change facilities were also not more likely to have hierarchical or market foci than non-culture change facilities. Our results counter the argument that culture change facilities have a stronger internal employee focus than facilities more generally but do show that culture change facilities report stronger developmental cultures than non-culture change facilities, which

  13. Toward automated assessment of health Web page quality using the DISCERN instrument.

    Science.gov (United States)

    Allam, Ahmed; Schulz, Peter J; Krauthammer, Michael

    2017-05-01

    As the Internet becomes the number one destination for obtaining health-related information, there is an increasing need to identify health Web pages that convey an accurate and current view of medical knowledge. In response, the research community has created multicriteria instruments for reliably assessing online medical information quality. One such instrument is DISCERN, which measures health Web page quality by assessing an array of features. In order to scale up use of the instrument, there is interest in automating the quality evaluation process by building machine learning (ML)-based DISCERN Web page classifiers. The paper addresses 2 key issues that are essential before constructing automated DISCERN classifiers: (1) generation of a robust DISCERN training corpus useful for training classification algorithms, and (2) assessment of the usefulness of the current DISCERN scoring schema as a metric for evaluating the performance of these algorithms. Using DISCERN, 272 Web pages discussing treatment options in breast cancer, arthritis, and depression were evaluated and rated by trained coders. First, different consensus models were compared to obtain a robust aggregated rating among the coders, suitable for a DISCERN ML training corpus. Second, a new DISCERN scoring criterion was proposed (features-based score) as an ML performance metric that is more reflective of the score distribution across different DISCERN quality criteria. First, we found that a probabilistic consensus model applied to the DISCERN instrument was robust against noise (random ratings) and superior to other approaches for building a training corpus. Second, we found that the established DISCERN scoring schema (overall score) is ill-suited to measure ML performance for automated classifiers. Use of a probabilistic consensus model is advantageous for building a training corpus for the DISCERN instrument, and use of a features-based score is an appropriate ML metric for automated DISCERN

  14. A national review of the frequency of minimally invasive surgery among general surgery residents: assessment of ACGME case logs during 2 decades of general surgery resident training.

    Science.gov (United States)

    Richards, Morgan K; McAteer, Jarod P; Drake, F Thurston; Goldin, Adam B; Khandelwal, Saurabh; Gow, Kenneth W

    2015-02-01

    Minimally invasive surgery (MIS) has created a shift in how many surgical diseases are treated. Examining the effect on resident operative experience provides valuable insight into trends that may be useful for restructuring the requirements of resident training. To evaluate changes in general surgery resident operative experience regarding MIS. Retrospective review of the frequency of MIS relative to open operations among general surgery residents using the Accreditation Council for Graduate Medical Education case logs for academic years 1993-1994 through 2011-2012. General surgery residency training among accredited programs in the United States. We analyzed the difference in the mean number of MIS techniques and corresponding open procedures across training periods using 2-tailed t tests with statistical significance set at P surgery has an increasingly prominent role in contemporary surgical therapy for many common diseases. The open approach, however, still predominates in all but 5 procedures. Residents today must become efficient at performing multiple techniques for a single procedure, which demands a broader skill set than in the past.

  15. Development and initial validation of an instrument to assess stressors among South African sports coaches.

    Science.gov (United States)

    Kubayi, Alliance; Toriola, Abel; Didymus, Faye

    2018-06-01

    The aim of this series of studies was to develop and initially validate an instrument to assess stressors among South African sports coaches. In study one, a preliminary pool of 45 items was developed based on existing literature and an expert panel was employed to assess the content validity and applicability of these items. In study two, the 32 items that were retained after study one were analysed using principal component analysis (PCA). The resultant factorial structure comprised four components: environmental stressors, performance stressors, task-related stressors, and athlete stressors. These four components were made up of 26 items and, together, the components and items comprised the provisional Stressors in Sports Coaching Questionnaire (SSCQ). The results show that the SSCQ demonstrates acceptable internal consistency (.73-.89). The findings provide preliminary evidence that SSCQ is a valid tool to assess stressors among South African sports coaches.

  16. Development of instruments for assessment of knowledge and skills in performing venepuncture and inserting peripheral venous catheters.

    Science.gov (United States)

    Ahlin, Catharina; Löfmark, Anna; Klang-Söderkvist, Birgitta; Johansson, Eva

    2013-01-01

    Performing venepuncture is one of the most routinely performed invasive procedures in nursing care. The aim of this study was to develop instruments for the assessment of nursing students' knowledge and skills when performing venepuncture and inserting a peripheral venous catheter. 
 Two instruments were developed using the following steps. 1) Assessment items of importance for the procedures (venepuncture 48 items and peripheral venous catheter 51 items) were collected from focus groups including nurses, lecturers and patients. 2) The number of items was reduced using a method based on the Delphi method. Experts (n=51) reviewed the instruments in two rounds. The revised versions included 31 items for venepuncture and 33 items for peripheral venous catheter insertion. 3) Usability tests were conducted by nurses who tested the instruments to confirm that items were possible to assess. 4) Inter-rater reliability was assessed by twelve lecturers who in pairs, but independently of each other, used the instruments to assess 50 nursing students. Proportion of agreement and Cohen's kappa coefficient were calculated for each item to determine inter-rater reliability. Among the tested items for both instruments, the median proportion of agreement was 1 (range 0.66-1) and the median kappa was 0.52 (range 0.22-1). The instruments developed for assessing nursing students' knowledge and skills of venepuncture and peripheral venous catheter insertion showed satisfactory inter-rater reliability.

  17. New Contemporary Criterion-Referenced Assessment Instruments for Astronomy & Geology: TOAST & EGGS

    Science.gov (United States)

    Guffey, Sarah Katie; Slater, Stephanie J.; Slater, Timothy F.

    2015-08-01

    Considerable effort in the astronomy and Earth sciences education research over the past decade has focused on developing assessment tools in the form of multiple-choice conceptual diagnostics and content knowledge surveys. This has been critically important in advancing discipline-based education research allowing scholar to establish the initial, incoming knowledge state of students as well as to attempt to measure some of the impacts of innovative instructional interventions. Before now, few of the existing instruments were constructed upon a solid list of clearly articulated and widely agreed upon learning objectives. Whereas first-generation assessment tools, such as the Astronomy Diagnostics Test ADT2) were based primarily upon further identifying documented astronomy misconceptions, scholars from the CAPER Center for Astronomy & Physics Education Research team are creating contemporary instruments based instead by developing items using modern test construction techniques and tightly aligned to the consensus learning goals identified by the American Association of the Advancement of Science’s Project 2061 Benchmarks, and the National Research Council’s National Science Education Standards, and the National Research Council’s Frameworks for A Framework for K-12 Science Education: Practices, Crosscutting Concepts, and Core Ideas. These consensus learning goals are further enhanced guiding documents from the American Astronomical Society - Chair’s Conference on ASTRO 101 and the NSF-funded Earth Science Literacy Initiative. Two of the resulting criterion-referenced assessment tools widely used by researchers are the Test Of Astronomy STandards (TOAST) and the Exam of GeoloGy StandardS (EGGS). These easy-to-use and easy-to-score multiple-choice instruments have a high degree of reliability and validity for instructors and researchers needing information on students’ initial knowledge state at the beginning of a course and can be used, in aggregate, to

  18. First Results from the Test Of Astronomy STandards (TOAST) Assessment Instrument

    Science.gov (United States)

    Slater, Stephanie

    2009-01-01

    Considerable effort in the astronomy education research over the past several years has focused on developing assessment tools in the form of multiple-choice conceptual diagnostics and content knowledge surveys. This has been critically important in advancing astronomy as a sub-discipline of physics education research, allowing researchers to establish the initial knowledge state of students as well as to attempt to measure some of the impacts of innovative instructional interventions. Before now, few of the existing instruments were constructed upon a solid list of clearly articulated and widely agreed upon learning objectives. Moving beyond the 10-year old Astronomy Diagnostics Test, we have developed and validated a new assessment instrument that is tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. Researchers from the Cognition in Astronomy, Physics and Earth sciences Research (CAPER) Team at the University of Wyoming's Science and Math Teaching Center (UWYO SMTC) designed a criterion-referenced assessment tool, called the Test Of Astronomy STandards (TOAST). Through iterative development, this multiple-choice instrument has a high degree of reliability and validity for instructors and researchers needing information on students’ initial knowledge state at the beginning of a course and can be used, in aggregate, to help measure the impact of course-length duration instructional strategies for undergraduate science survey courses with learning goals tightly aligned to the consensus goals of the astronomy education community.

  19. The Discriminant Validity Of The Culture Assessment Instrument: A Comparison Of Company Cultures

    Directory of Open Access Journals (Sweden)

    Willie Du Toit

    2003-09-01

    Full Text Available The aim of this study was to assess the discriminant validity of the Culture Assessment Instrument (CAI; that is to distinguish between mean culture scores of different companies. The convenience sample consisted of 4066 respondents from five different companies, originating from various industries. CAI scores of 56 items were factor analysed on two levels, followed by iterative item analyses. Significant differences between company mean scores were identified, but only a small portion of the variance in these scores could be ascribed to culture differences. Based on these findings, it was concluded that the CAI in its current form does not possess discriminant validity. It is recommended that items attuned to deeper levels of culture, based on Schein’s three-level typology, be added to the instrument. OpsommingDie doel van die studie was om die diskriminante geldigheid van die ‘Culture Assessment Instrument’ (CAI te beoordeel; dit is om tussen gemiddelde kultuurtellings van verskillende ondernemings te onderskei. Die geleentheidsteekproef het bestaan uit 4066 respondente uit vyf verskillende ondernemings afkomstig uit verskeie industrieë. CAI-tellings van 56 items is op twee vlakke gefaktoranaliseer, gevolg deur iteratiewe itemontledings. Beduidende verskille tussen ondernemings se gemiddelde kultuurtellings is gevind, maar slegs ’n klein proporsie van die variansie in die tellings kon aan kultuurverskille toegeskryf word. Gebaseer op hierdie bevindinge, is daar tot die slotsom gekom dat die CAI in sy huidige vorm nie oor diskriminante geldigheid beskik nie. Daar is aanbeveel dat items gerig op dieper kultuurvlakke, gebaseer op Schein se drievlaktipologie, tot die instrument gevoeg word.

  20. Development of an instrument to assess the quality of acupuncture: results from a Delphi process.

    Science.gov (United States)

    Smith, Caroline A; Zaslawski, Christopher J; Zheng, Zhen; Cobbin, Deidre; Cochrane, Suzanne; Lenon, George B; Loyeung, Bertrand; Meier, Peter C; Walsh, Sean; Xue, Charlie Changli; Zhang, Anthony L; Zhu, Xiaoshu; Bensoussan, Alan

    2011-05-01

    Quality acupuncture influences the outcomes of clinical research, and issues associated with effective administration of acupuncture in randomized controlled trials need to be addressed when appraising studies. The study objective was to achieve consensus on domains and items for inclusion in a rating scale to assess quality acupuncture administered in clinical research. An active group of Australian acupuncture researchers initially identified a pool of items assessing quality. The Delphi consensus process was then used to select and reduce the number of items, and an additional expert panel of 42 researchers were invited to participate. Participants initially ranked items along a five-point scale for the first Delphi round, and indicated an agree or disagree response during the second round. For an item to be retained into the second round, an item had to attain greater than 80% agreement that the item described a dimension of quality acupuncture and related study design. Thirty-two (32) experts agreed to participate in the study. After two rounds of the Delphi process, consensus was reached on 14 domains and 26 items relating to quality acupuncture. Domains, items, and minimum standards related to study design; rationale of the intervention; criteria relating to needling stimulation either manual or electrostimulation; duration and frequency of treatment; and practitioner training. Items for inclusion in an instrument to assess quality acupuncture in clinical research were identified. Further development of the instrument including relative weighting of items and reliability testing is under way.

  1. Is It Working? Distractor Analysis Results from the Test Of Astronomy STandards (TOAST) Assessment Instrument

    Science.gov (United States)

    Slater, Stephanie

    2009-05-01

    The Test Of Astronomy STandards (TOAST) assessment instrument is a multiple-choice survey tightly aligned to the consensus learning goals stated by the American Astronomical Society - Chair's Conference on ASTRO 101, the American Association of the Advancement of Science's Project 2061 Benchmarks, and the National Research Council's National Science Education Standards. Researchers from the Cognition in Astronomy, Physics and Earth sciences Research (CAPER) Team at the University of Wyoming's Science and Math Teaching Center (UWYO SMTC) have been conducting a question-by-question distractor analysis procedure to determine the sensitivity and effectiveness of each item. In brief, the frequency each possible answer choice, known as a foil or distractor on a multiple-choice test, is determined and compared to the existing literature on the teaching and learning of astronomy. In addition to having statistical difficulty and discrimination values, a well functioning assessment item will show students selecting distractors in the relative proportions to how we expect them to respond based on known misconceptions and reasoning difficulties. In all cases, our distractor analysis suggests that all items are functioning as expected. These results add weight to the validity of the Test Of Astronomy STandards (TOAST) assessment instrument, which is designed to help instructors and researchers measure the impact of course-length duration instructional strategies for undergraduate science survey courses with learning goals tightly aligned to the consensus goals of the astronomy education community.

  2. [Caregiving consequences in mental disorders--definitions and instruments of assessment].

    Science.gov (United States)

    Ciałkowska-Kuźmińska, Magdalena; Kiejna, Andrzej

    2010-01-01

    Severe mental illnesses have far-reaching consequences for both patients and their relatives. This paper reviews literature on the measures of caregiving consequences. Authors provide a condensed knowledge and research results in the area of caregiving consequences, especially both subjective and objective caregivers' burden. The consequences of care apply to carers' social and leisure activities, financial status, health condition. The burden of care has three fundamental causes: the reorganisation of mental health services, a social isolation of patients and their families and the lack of systemic support for caregivers. The problem of caregiving consequences has been investigated in several studies. In order to identify factors, which have impact on caregiver distress, a variety instruments have been developed. This paper focuses on questionnaires useful for the systematic assessment of both objective and subjective burden: Involvement Evaluation Questionnaire (IEQ), Perceived Family Burden Scale (PFBS), Zarit Caregiver Burden Scale (ZCBS), Experience of Caregiving Inventory (ECI), Family Problems Questionnaire (FPQ). The mentioned instruments proved to be a reliable instrument for measuring caregiver consequences in mental healthcare.

  3. Cross-cultural adaptation of Preschool Language Assessment Instrument: Second Edition.

    Science.gov (United States)

    Lindau, Tâmara Andrade; Rossi, Natalia Freitas; Giacheti, Célia Maria

    2014-01-01

    In Brazil, formal tools for the evaluation of spoken language are scarce. Therefore, this study aimed to translate and adapt to Brazilian Portuguese the Preschool Language Assessment Instrument: Second Edition (PLAI-2). The process of translation and adaptation of this instrument was conducted in two stages - Stage 1: (1a) translation of the original version to Brazilian Portuguese, (1b) comparison of the translated versions and synthesis into a single Portuguese version, (1c) back-translation, (1d) revision of the translated version; and Step 2: (2a) application of the Portuguese version in a pilot project with 30 subjects, and (2b) statistical comparison of three age groups. In the Brazilian version, all items of the original version were kept. However, it was necessary to modify the application order of one item, and the change of one picture was suggested in another. The results obtained after application indicated that the Brazilian version of the PLAI-2 allows us to distinguish the performance of participants belonging to different age groups, and that the raw score tends to increase with age. Semantic and syntactic adjustments were required and made to ensure that PLAI-2 would be used with the same methodological rigor of the original instrument. The adaptation process observed the theoretical, semantic, and cultural equivalences.

  4. Validation of a New Instrument for Self-Assessment of Nurses’ Core Competencies in Palliative Care

    Directory of Open Access Journals (Sweden)

    Kari Slåtten

    2014-01-01

    Full Text Available Competence can be seen as a prerequisite for high quality nursing in clinical settings. Few research studies have focused on nurses’ core competencies in clinical palliative care and few measurement tools have been developed to explore these core competencies. The purpose of this study was to test and validate the nurses’ core competence in palliative care (NCPC instrument. A total of 122 clinical nurse specialists who had completed a postbachelor program in palliative care at two university colleges in Norway answered the questionnaire. The initial analysis, with structural equation modelling, was run in Mplus 7. A modified confirmatory factor analysis revealed the following five domains: knowledge in symptom management, systematic use of the Edmonton symptom assessment system, teamwork skills, interpersonal skills, and life closure skills. The actual instrument needs to be tested in a practice setting with a larger sample to confirm its usefulness. The instrument has the potential to be used to refine clinical competence in palliative care and be used for the training and evaluation of palliative care nurses.

  5. Development and Validation of Mechanical Engineering Trade Skills Assessment Instrument for Sustainable Job Security in Yobe State

    Science.gov (United States)

    Adamu, Gishua Garba; Dawha, Josphine Musa; Kamar, Tiamiyu Salihu

    2015-01-01

    Mechanical Engineering Trade Skills Assessment Instrument (METSAI) is aimed at determining the extent to which students have acquired practical skills before graduation that will enable them get employment for sustainable job security in Yobe state. The study employed instrumentation research design. The populations of the study were 23 mechanical…

  6. Developing Instruments to Assess and Compare the Quality of Engineering Education: The Case of China and Russia

    Science.gov (United States)

    Kardanova, Elena; Loyalka, Prashant; Chirikov, Igor; Liu, Lydia; Li, Guirong; Wang, Huan; Enchikova, Ekaterina; Shi, Henry; Johnson, Natalie

    2016-01-01

    Relatively little is known about differences in the quality of engineering education within and across countries because of the lack of valid instruments that allow for the assessment and comparison of engineering students' skill gains. The purpose of our study is to develop and validate instruments that can be used to compare student skill gains…

  7. Evaluation of the FOCUS (Feedback on Counseling Using Simulation) Instrument for Assessment of Client-Centered Nutrition Counseling Behaviors

    Science.gov (United States)

    Henry, Beverly W.; Smith, Thomas J.

    2010-01-01

    Objective: To develop an instrument to assess client-centered counseling behaviors (skills) of student-counselors in a standardized patient (SP) exercise. Methods: Descriptive study of the accuracy and utility of a newly developed counseling evaluation instrument. Study participants included 11 female student-counselors at a Midwestern…

  8. Assessment and management of ageing of electrical instrumentation and control cables

    International Nuclear Information System (INIS)

    Pachner, J.; Burnay, S.G.

    2001-01-01

    This paper presents a summary of the results of an IAEA Co-ordinated Research Project (CRP) on Management of Ageing of In-containment Instrumentation and Control (I and C) Cables addressing current practices and techniques for assessing and managing ageing degradation of cables in real nuclear power plant (NPP) environments. These practices and techniques include environmental qualification, identification of cables of concern, condition monitoring, and predictive modelling. The paper shows how they should be integrated within a plant-specific ageing management programme utilising a systematic ageing management process, which is an adaptation of Deming Plan-Do-Check-Act cycle to ageing management. (author)

  9. Validation of an instrumented dummy to assess mechanical aspects of discomfort during load carriage.

    Directory of Open Access Journals (Sweden)

    Patrick D Wettenschwiler

    Full Text Available Due to the increasing load in backpacks and other load carriage systems over the last decades, load carriage system designs have to be adapted accordingly to minimize discomfort and to reduce the risk of injury. As subject studies are labor-intensive and include further challenges such as intra-subject and inter-subject variability, we aimed to validate an instrumented dummy as an objective laboratory tool to assess the mechanical aspects of discomfort. The validation of the instrumented dummy was conducted by comparison with a recent subject study. The mechanical parameters that characterize the static and dynamic interaction between backpack and body during different backpack settings were compared. The second aim was to investigate whether high predictive power (coefficient of determination R2>0.5 in assessing the discomfort of load carriage systems could be reached using the instrumented dummy. Measurements were conducted under static conditions, simulating upright standing, and dynamic conditions, simulating level walking. Twelve different configurations of a typical load carriage system, a commercially available backpack with a hip belt, were assessed. The mechanical parameters were measured in the shoulder and the hip region of the dummy and consisted of average pressure, peak pressure, strap force and relative motion between the system and the body. The twelve configurations consisted of three different weights (15kg, 20kg, and 25kg, combined with four different hip belt tensions (30N, 60N, 90N, and 120N. Through the significant (p<0.05 correlation of the mechanical parameters measured on the dummy with the corresponding values of the subject study, the dummy was validated for all static measurements and for dynamic measurements in the hip region to accurately simulate the interaction between the human body and the load carriage system. Multiple linear regressions with the mechanical parameters measured on the dummy as independent

  10. Independent Assessment of Instrumentation for ISS On-Orbit NDE. Volume 2; Appendices

    Science.gov (United States)

    Madaras, Eric I.

    2013-01-01

    International Space Station (ISS) Structural and Mechanical Systems Manager, requested that the NASA Engineering and Safety Center (NESC) provide a quantitative assessment of commercially available nondestructive evaluation (NDE) instruments for potential application to the ISS. This work supports risk mitigation as outlined in the ISS Integrated Risk Management Application (IRMA) Watch Item #4669, which addresses the requirement for structural integrity after an ISS pressure wall leak in the event of a penetration due to micrometeoroid or debris (MMOD) impact. This document contains the appendices the final report.

  11. Influence of instruments performance and material properties on exposure assessment of airborne engineered nanomaterials

    DEFF Research Database (Denmark)

    Levin, Marcus

    Over the last decades, materials engineered of nanosized structures have increased tremendously, in terms of both produced tonnage and economic market share. This, together with the fact that some of these engineered nanomaterials have shown an increased toxicological effect in humans as compared...... to their bulk counterpart, has expanded the scientific field of exposure measurements to airborne nanoparticles. As the greatest potential for human exposure to engineered nanomaterials resides within the production, packaging and downstream powdermaterial handling, as well as at reworking/waste treatment...... facilities, exposure risk for workers has received great focus. The studies described in this thesis come to four main conclusions: 1) Mass-balance modeling of airborne engineered nanomaterials using dustiness index as a primary source term can be useful for assessment of material-specific exposure scenarios...

  12. Use of geographic information systems to assess the error associated with the use of place of residence in injury research.

    Science.gov (United States)

    Amram, Ofer; Schuurman, Nadine; Yanchar, Natalie L; Pike, Ian; Friger, Michael; Griesdale, Donald

    In any spatial research, the use of accurate location data is critical to the reliability of the results. Unfortunately, however, many of the administrative data sets used in injury research do not include the location at which the injury takes place. The aim of this paper is to examine the error associated with using place of residence as opposed to place of injury when identifying injury hotspots and hospital access. Traumatic Brian Injury (TBI) data from the BC Trauma Registry (BCTR) was used to identify all TBI patients admitted to BC hospitals between January 2000 and March 2013. In order to estimate how locational error impacts the identification of injury hotspots, the data was aggregated to the level of dissemination area (DA) and census tract (CT) and a linear regression was performed using place of residence as a predictor for place of injury. In order to assess the impact of locational error in studies examining hospital access, an analysis of the driving time between place of injury and place of residence and the difference in driving time between place of residence and the treatment hospital, and place of injury and the same hospital was conducted. The driving time analysis indicated that 73.3 % of the injuries occurred within 5 min of place of residence, 11.2 % between five and ten minutes and 15.5 % over 20 min. Misclassification error occurs at both the DA and CT level. The residual map of the DA clearly shows more detailed misclassification. As expected, the driving time between place of residence and place of injury and the difference between these same two locations and the treatment hospital share a positive relationship. In fact, the larger the distance was between the two locations, the larger the error was when estimating access to hospital. Our results highlight the need for more systematic recording of place of injury as this will allow researchers to more accurately pinpoint where injuries occur. It will also allow researchers to

  13. Assessing the Effects of the 2003 Resident Duty Hours Reform on Internal Medicine Board Scores

    Science.gov (United States)

    Romano, Patrick S.; Itani, Kamal M.F.; Rosen, Amy K.; Small, Dylan; Lipner, Rebecca S.; Bosk, Charles L.; Wang, Yanli; Halenar, Michael J.; Korovaichuk, Sophia; Even-Shoshan, Orit; Volpp, Kevin G.

    2014-01-01

    Purpose To determine whether the 2003 Accreditation Council for Graduate Medical Education (ACGME) duty hours reform affected medical knowledge as reflected by written board scores for internal medicine (IM) residents. Method The authors conducted a retrospective cohort analysis of postgraduate year 1 (PGY-1) Internal Medicine residents who started training before and after the 2003 duty hour reform using a merged data set of American Board of Internal Medicine (ABIM) Board examination and the National Board of Medical Examiners (NMBE) United States Medical Licensing Examination (USMLE) Step 2 Clinical Knowledge test scores. Specifically, using four regression models, the authors compared IM residents beginning PGY-1 training in 2000 and completing training unexposed to the 2003 duty hours reform (PGY-1 2000 cohort, n = 5,475) to PGY-1 cohorts starting in 2001 through 2005 (n = 28,008), all with some exposure to the reform. Results The mean ABIM board score for the unexposed PGY-1 2000 cohort (n = 5,475) was 491, SD = 85. Adjusting for demographics, program, and USMLE Step 2 exam score, the mean differences (95% CI) in ABIM board scores between the PGY-1 2001, 2002, 2003, 2004 and 2005 cohorts minus the PGY-1 2000 cohort were −5.43 (−7.63, −3.23), −3.44 (−5.65, −1.24), 2.58 (0.36, 4.79), 11.10 (8.88, 13.33) and 11.28 (8.98, 13.58) points respectively. None of these differences exceeded one-fifth of an SD in ABIM board scores. Conclusions The duty hours reforms of 2003 did not meaningfully affect medical knowledge as measured by scores on the ABIM board examinations. PMID:24556772

  14. Dietary Exposure to Aluminium and Health Risk Assessment in the Residents of Shenzhen, China

    OpenAIRE

    Yang, Mei; Jiang, Lixin; Huang, Huiping; Zeng, Shengbo; Qiu, Fen; Yu, Miao; Li, Xiaorong; Wei, Sheng

    2014-01-01

    Although there are great changes of dietary in the past few decades in China, few are known about the aluminium exposure in Chinese diet. The aim of this study is to systematically evaluate the dietary aluminium intake level in residents of Shenzhen, China. A total of 853 persons from 244 household were investigated their diet by three days food records. Finally, 149 kinds of foods in 17 food groups were selected to be the most consumed foods. From them, 1399 food samples were collected from ...

  15. The Self-assessment Practices of Hong Kong Secondary Students: Findings with a New Instrument.

    Science.gov (United States)

    Yan, Zi

    Self-assessment is a core skill that enables students to engage in self-regulated learning. The purpose of this study was to examine the psychometric properties of a Self-assessment Practice Scale and to depict the characteristics of self-assessment practices of Hong Kong secondary students using this newly developed instrument. A total of 6,125 students from 10 Hong Kong secondary schools completed the survey. Both Rasch and factor analyses revealed a two-dimension scale structure (i.e., Self-directed Feedback Seeking and Self-reflection). The two subscales demonstrated acceptable psychometric properties and suggestions for further improvement were proposed. The findings regarding self-assessment practices of secondary students indicated that, in general, students were quite used to engaging in self-reflection based on available feedback, but they were less disposed to taking the initiative to seek feedback on their own performance. Key demographic variables, e.g., gender and year level, played important roles in students' self-assessment practices. Girls had significantly higher self-assessment measures on both scales than did boys. Junior students had higher measures on both scales than did their senior counterparts. Implications and directions for future research were discussed.

  16. Assessing procedural skills in context: Exploring the feasibility of an Integrated Procedural Performance Instrument (IPPI).

    Science.gov (United States)

    Kneebone, R; Nestel, D; Yadollahi, F; Brown, R; Nolan, C; Durack, J; Brenton, H; Moulton, C; Archer, J; Darzi, A

    2006-11-01

    The assessment of clinical procedural skills has traditionally focused on technical elements alone. However, in real practice, clinicians are expected to be able to integrate technical with communication and other professional skills. We describe an integrated procedural performance instrument (IPPI), where clinicians are assessed on 12 clinical procedures in a simulated clinical setting which combines simulated patients (SPs) with inanimate models or items of medical equipment. Candidates are observed remotely by assessors whose data are fed back to the clinician within 24 hours of the assessment. This paper describes the feasibility of IPPI. A full-scale IPPI and 2 pilot studies with trainee and qualified health care professionals has yielded an extensive data set including 585 scenario evaluations from candidates, 60 from clinical assessors and 31 from simulated patients (SPs). Interview and questionnaire data showed that for the majority of candidates IPPI provided a powerful and valuable learning experience. Realism was rated highly. Remote and real-time assessment worked effectively, although for some procedures limited camera resolution affected observation of fine details. IPPI offers an innovative approach to assessing clinical procedural skills. Although resource-intensive, it has the potential to provide insight into individual's performance over a spectrum of clinical scenarios and at no risk to the safety of patients. Additional benefits of IPPI include assessment in real time from experts (allowing remote rating by external examiners) as well as provision of feedback from simulated patients.

  17. Measuring the intensity of resident supervision in the department of veterans affairs: the resident supervision index.

    Science.gov (United States)

    Byrne, John M; Kashner, Michael; Gilman, Stuart C; Aron, David C; Cannon, Grant W; Chang, Barbara K; Godleski, Linda; Golden, Richard M; Henley, Steven S; Holland, Gloria J; Kaminetzky, Catherine P; Keitz, Sheri A; Kirsh, Susan; Muchmore, Elaine A; Wicker, Annie B

    2010-07-01

    To develop a survey instrument designed to quantify supervision by attending physicians in nonprocedural care and to assess the instrument's feasibility and reliability. In 2008, the Department of Veterans Affairs (VA) Office of Academic Affiliations convened an expert panel to adopt a working definition of attending supervision in nonprocedural patient care and to construct a survey to quantify it. Feasibility was field-tested on residents and their supervising attending physicians at primary care internal medicine clinics at the VA Loma Linda Healthcare System in their encounters with randomly selected outpatients diagnosed with either major depressive disorder or diabetes. The authors assessed both interrater concurrent reliability and test-retest reliability. The expert panel adopted the VA's definition of resident supervision and developed the Resident Supervision Index (RSI) to measure supervision in terms of residents' case understanding, attending physicians' contributions to patient care through feedback to the resident, and attending physicians' time (minutes). The RSI was field-tested on 60 residents and 37 attending physicians for 148 supervision episodes from 143 patient encounters. Consent rates were 94% for residents and 97% for attending physicians; test-retest reliability intraclass correlations (ICCs) were 0.93 and 0.88, respectively. Concurrent reliability between residents' and attending physicians' reported time was an ICC of 0.69. The RSI is a feasible and reliable measure of resident supervision that is intended for research studies in graduate medical education focusing on education outcomes, as well as studies assessing quality of care, patient health outcomes, care costs, and clinical workload.

  18. The Development of an ASSA Module as an Auxiliary Tool for Assessment of Existing Plant Instrumentation and enhancement of the instruments performance

    International Nuclear Information System (INIS)

    Koo, Kil Mo; Kang, Kyung Ho; Ha, Kwang Soon; Cho, Young Ro; Cho, Young; Park, Rae Jun; Kim, Sang Baik; Kim, Hee Dong

    2007-04-01

    A review of a plant's accident management capabilities is one of the key elements in achieving regulatory closure of severe accident issues. During accidents, information and data from plant's instruments, as well as others sources, are essential for assessing the plant's status and response. Unlike for design basis accidents, there are inherently some uncertainties to instrumentation capabilities for severe accident conditions. There are many ways to obtain information during a severe accident. Moreover, precise measurements are not necessary. The redundancy and ruggedness of a plant's instrumentation provides considerable depth in the capability of existing designs. The circuit simulation analysis and diagnosis methods are used to assess instruments in detail when they give apparently abnormal readings. A new simulator, ASSA(abnormal signal simulator analysis), through an analysis of the important circuits modeling under severe accident conditions has been designed. It has three main functions which are a signal processing tool, an accident management tool, and an additional guide from the initial screen. In this paper, it can be simulated to the temperature characteristic analysis procedure of the ASSA through EQ data comparative method and using specific signal processing under severe accident condition

  19. Using method triangulation to validate a new instrument (CPWQ-com) assessing cancer patients' satisfaction with communication

    DEFF Research Database (Denmark)

    Ross, Lone; Lundstrøm, Louise Hyldborg; Petersen, Morten Aagaard

    2012-01-01

    Patients' perceptions of care including the communication with health care staff is recognized as an important aspect of the quality of cancer care. Using mixed methods, we developed and validated a short instrument assessing this communication....

  20. Developmental norms for eight instruments used in the neuropsychological assessment of children: studies in Brazil

    Directory of Open Access Journals (Sweden)

    Brito G.N.O.

    1998-01-01

    Full Text Available Norms for a battery of instruments, including Denckla's and Garfield's tests of Motor Persistence, Benton's Right-Left Discrimination, two recall modalities (Immediate and Delayed of the Bender Test, Wechsler's Digit Span, the Color Span Test and the Human Figure Drawing Test, were developed for the neuropsychological assessment of children in the greater Rio de Janeiro area. Additionally, the behavior of each child was assessed with the Composite Teacher Rating Scale (Brito GNO and Pinto RCA (1991 Journal of Clinical and Experimental Neuropsychology, 13: 417-418. A total of 398 children (199 boys and 199 girls balanced for age with a mean age of 9.3 years (SD = 2.8, who were attending a public school in Niterói, were the subjects of this study. Gender and age had significant effects on performance which depended on the instrument. Nonachievers performed worse than achievers in most neuropsychological tests. Comparison of our data to the available counterparts in the United States revealed that American children outperformed Brazilian children on the Right-Left Discrimination, Forward Digit Span, Color Span and Human Figure Drawing Tests. Further analysis showed that the neurobehavioral data consist of different factorial dimensions, including Human Body Representation, Motor Persistence of the Legs, Orbito-Orobuccal Motor Persistence, Attention-Memory, Visuospatial Memory, Neuropsychomotor Speed, Hyperactivity-Inattention, and Anxiety-Negative Socialization. We conclude that gender and age should be taken into account when using the normative data for most of the instruments studied in the present report. Furthermore, we stress the need for major changes in the Brazilian public school system in order to foster the development of secondary cognitive abilities in our children